2024-09-12T17:26:11.621 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T17:26:11.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:26:11.720 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746 branch: wip-rgw-meta-handlers description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7902746' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOTRWiPKMRQMsbNjeZSS15eA7Plmd5HhoqL4/seJpO/B6wyk3TbD+52UjJtckuIQPjtBaSuzF6KQgQW4LqoUyFY= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEm23VdnwGX4QpC0Oa/oHvOuvNHSZpsHEtnWxXRgVuR1jdvTYkdN30edmV3x2wmeru3soEQNVOCaOOpTpS1ImuQ= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T17:26:11.721 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T17:26:11.721 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T17:26:11.722 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T17:26:11.723 INFO:teuthology.task.internal:Checking packages... 2024-09-12T17:26:11.744 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T17:26:11.744 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T17:26:11.744 INFO:teuthology.packaging:ref: None 2024-09-12T17:26:11.744 INFO:teuthology.packaging:tag: None 2024-09-12T17:26:11.744 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T17:26:11.745 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:26:11.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T17:26:11.899 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:26:11.900 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T17:26:11.907 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T17:26:11.907 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T17:26:11.913 INFO:teuthology.task.internal:Saving configuration 2024-09-12T17:26:11.930 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T17:26:11.937 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T17:26:11.960 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:19:59.163562', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKsZKLndFGB2EVy10osKOfVCr6iugJGxiDLesGfHmBqZ'} 2024-09-12T17:26:11.978 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:19:59.161588', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJP7bsGRSDPQ3Lo3C54e0A+NLHN0oy3p6NUBo0Qd69XP'} 2024-09-12T17:26:11.978 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T17:26:11.984 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:26:11.984 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:26:11.985 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T17:26:12.048 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f86064a72e0>, signals=[15]) 2024-09-12T17:26:12.048 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T17:26:12.054 INFO:teuthology.task.internal:Opening connections... 2024-09-12T17:26:12.054 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T17:26:12.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:26:12.136 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T17:26:12.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:26:12.215 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T17:26:12.221 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-09-12T17:26:12.226 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-09-12T17:26:12.227 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-09-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2024-09-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="22.04" 2024-09-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=jammy 2024-09-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2024-09-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2024-09-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:26:12.273 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:26:12.273 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-09-12T17:26:12.293 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-09-12T17:26:12.302 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-09-12T17:26:12.302 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-09-12T17:26:12.346 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:26:12.346 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2024-09-12T17:26:12.346 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="22.04" 2024-09-12T17:26:12.347 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:26:12.347 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=jammy 2024-09-12T17:26:12.347 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2024-09-12T17:26:12.347 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2024-09-12T17:26:12.347 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:26:12.347 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:26:12.347 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:26:12.347 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:26:12.347 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:26:12.347 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-09-12T17:26:12.368 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T17:26:12.378 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T17:26:12.444 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T17:26:12.445 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:26:12.447 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:26:12.452 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T17:26:12.539 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T17:26:12.539 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:26:12.542 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:26:12.560 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T17:26:12.658 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T17:26:12.676 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T17:26:12.676 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T17:26:12.676 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:26:12.677 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:26:12.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:26:12.681 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-09-12T17:26:12.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:26:12.682 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-09-12T17:26:12.728 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-56-generic 2024-09-12T17:26:12.729 INFO:teuthology.task.kernel:Running kernel on smithi157: 5.15.0-56-generic 2024-09-12T17:26:12.729 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-09-12T17:26:12.735 INFO:teuthology.orchestra.run.smithi190.stdout:5.15.0-56-generic 2024-09-12T17:26:12.735 INFO:teuthology.task.kernel:Running kernel on smithi190: 5.15.0-56-generic 2024-09-12T17:26:12.735 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get clean 2024-09-12T17:26:12.860 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-09-12T17:26:12.877 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-09-12T17:26:13.054 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:26:13.132 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:26:13.132 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:26:13.158 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:26:13.187 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:26:13.240 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:26:13.257 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:26:13.356 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:26:13.394 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:26:13.396 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:26:13.397 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:26:13.397 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:26:13.416 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:26:13.419 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:26:13.419 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:26:13.423 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:26:13.429 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:26:13.430 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:26:13.431 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:26:13.431 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:26:13.464 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:26:13.465 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:26:13.542 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:26:13.568 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:26:13.595 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:26:13.681 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:26:13.734 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:26:13.861 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:26:14.000 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:26:14.032 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:26:14.034 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:26:14.047 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:26:14.047 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:26:14.047 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:26:14.047 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:26:14.048 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:26:14.049 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:26:14.084 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:26:14.101 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:26:14.101 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:26:14.101 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:26:14.115 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:26:14.159 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:26:14.159 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:26:14.159 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:26:14.160 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:26:14.167 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:26:14.168 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:26:14.169 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:26:14.170 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:26:14.183 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:26:14.183 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:26:14.185 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:26:14.185 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:26:14.188 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:26:14.189 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:26:14.189 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:26:14.190 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:26:14.193 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:26:14.197 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:26:14.197 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:26:14.198 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:26:14.207 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:26:14.236 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:26:14.242 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:26:14.243 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:26:14.244 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:26:14.245 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:26:14.245 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:26:14.246 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:26:14.246 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:26:14.271 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:26:14.272 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:26:14.272 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:26:14.272 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:26:14.273 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:26:14.279 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:26:14.279 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:26:14.294 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:26:14.294 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:26:14.296 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:26:14.297 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:26:14.327 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:26:14.376 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:26:14.376 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:26:14.376 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:26:14.377 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:26:14.377 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:26:19.664 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 15.8 MB in 2s (7,478 kB/s) 2024-09-12T17:26:20.318 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 15.8 MB in 3s (5,705 kB/s) 2024-09-12T17:26:21.226 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-12T17:26:21.246 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:26:21.307 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-12T17:26:21.495 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-09-12T17:26:21.495 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-09-12T17:26:21.659 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:26:21.659 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:26:21.659 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:26:21.659 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:26:21.659 INFO:teuthology.orchestra.run.smithi190.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:26:21.660 INFO:teuthology.orchestra.run.smithi190.stdout: python2.7-minimal 2024-09-12T17:26:21.660 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:26:21.661 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-09-12T17:26:21.661 INFO:teuthology.orchestra.run.smithi190.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:26:21.661 INFO:teuthology.orchestra.run.smithi190.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:26:21.661 INFO:teuthology.orchestra.run.smithi190.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:26:21.663 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-09-12T17:26:21.663 INFO:teuthology.orchestra.run.smithi190.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:26:21.663 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2024-09-12T17:26:21.663 INFO:teuthology.orchestra.run.smithi190.stdout: thermald 2024-09-12T17:26:21.711 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-09-12T17:26:21.711 INFO:teuthology.orchestra.run.smithi190.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:26:21.711 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:26:21.712 INFO:teuthology.orchestra.run.smithi190.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:26:21.713 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2024-09-12T17:26:21.713 INFO:teuthology.orchestra.run.smithi190.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:26:21.738 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-12T17:26:21.756 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:26:21.820 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-12T17:26:21.911 INFO:teuthology.orchestra.run.smithi190.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:26:21.911 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 113 MB of archives. 2024-09-12T17:26:21.911 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:26:21.912 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:26:22.007 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-12T17:26:22.008 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-12T17:26:22.173 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:26:22.173 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:26:22.173 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:26:22.174 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:26:22.174 INFO:teuthology.orchestra.run.smithi157.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:26:22.174 INFO:teuthology.orchestra.run.smithi157.stdout: python2.7-minimal 2024-09-12T17:26:22.174 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:26:22.175 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-09-12T17:26:22.175 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:26:22.175 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:26:22.175 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:26:22.176 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-09-12T17:26:22.177 INFO:teuthology.orchestra.run.smithi157.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:26:22.177 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-09-12T17:26:22.177 INFO:teuthology.orchestra.run.smithi157.stdout: thermald 2024-09-12T17:26:22.225 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-09-12T17:26:22.225 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:26:22.225 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:26:22.226 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:26:22.227 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-09-12T17:26:22.227 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:26:22.407 INFO:teuthology.orchestra.run.smithi157.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:26:22.407 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 113 MB of archives. 2024-09-12T17:26:22.407 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:26:22.407 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:26:23.317 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:26:23.665 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:26:23.895 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:26:24.245 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:26:25.868 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:26:25.868 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:26:25.869 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:26:26.291 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:26:26.349 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:26:26.472 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:26:26.472 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:26:26.473 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:26:26.768 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 113 MB in 5s (24.5 MB/s) 2024-09-12T17:26:26.816 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:26:26.897 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:26:26.960 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:26:27.289 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 113 MB in 5s (24.3 MB/s) 2024-09-12T17:26:27.479 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:26:28.965 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:26:28.969 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:26:29.073 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:29.435 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:26:29.439 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:26:29.501 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:31.182 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:26:31.204 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:26:31.281 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:31.711 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:26:31.732 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:26:31.743 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:26:31.765 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:26:31.810 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:31.810 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:32.231 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:26:32.251 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:26:32.281 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:38.953 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:26:39.076 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:26:39.115 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:26:39.217 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:26:39.442 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:26:39.533 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:26:39.605 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:26:39.679 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:26:39.849 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T17:26:39.860 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T17:26:39.890 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:26:39.949 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T17:26:39.971 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T17:26:40.007 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:26:45.707 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T17:26:45.726 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:26:45.765 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:45.886 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T17:26:45.923 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:26:45.961 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:48.728 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:26:49.545 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:26:49.596 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:26:49.696 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:26:49.895 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:26:50.004 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:26:50.041 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:50.117 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:50.150 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T17:26:50.218 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T17:26:50.279 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:50.347 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:51.631 INFO:teuthology.orchestra.run.smithi190.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:26:51.631 INFO:teuthology.orchestra.run.smithi190.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T17:26:51.631 INFO:teuthology.orchestra.run.smithi190.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:26:51.631 INFO:teuthology.orchestra.run.smithi190.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T17:26:51.685 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:26:51.686 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T17:26:51.686 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:26:51.686 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T17:26:51.798 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:51.848 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:53.249 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:53.399 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:54.967 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T17:26:55.068 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T17:26:55.203 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:55.277 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T17:26:55.278 INFO:teuthology.orchestra.run.smithi157.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:26:55.451 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T17:26:55.577 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T17:26:55.703 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:26:55.787 INFO:teuthology.orchestra.run.smithi190.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T17:26:55.787 INFO:teuthology.orchestra.run.smithi190.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:27:09.420 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T17:27:09.421 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub' 2024-09-12T17:27:09.438 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:27:09.463 INFO:teuthology.orchestra.run.smithi157.stdout:Generating grub configuration file ... 2024-09-12T17:27:09.739 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:27:09.764 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:27:09.978 INFO:teuthology.orchestra.run.smithi190.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T17:27:09.978 INFO:teuthology.orchestra.run.smithi190.stdout:Sourcing file `/etc/default/grub' 2024-09-12T17:27:10.014 INFO:teuthology.orchestra.run.smithi190.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:27:10.040 INFO:teuthology.orchestra.run.smithi190.stdout:Generating grub configuration file ... 2024-09-12T17:27:10.075 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:27:10.080 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:27:10.146 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:27:10.152 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:27:10.325 INFO:teuthology.orchestra.run.smithi157.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:27:10.325 INFO:teuthology.orchestra.run.smithi157.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:27:10.325 INFO:teuthology.orchestra.run.smithi157.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:27:10.359 INFO:teuthology.orchestra.run.smithi157.stdout:done 2024-09-12T17:27:10.366 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:27:10.385 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:27:10.681 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:27:10.686 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:27:10.759 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:27:10.765 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:27:10.803 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-09-12T17:27:10.829 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-09-12T17:27:10.829 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-09-12T17:27:10.829 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-09-12T17:27:10.830 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-09-12T17:27:10.830 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-09-12T17:27:10.830 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:27:10.830 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-09-12T17:27:10.830 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-09-12T17:27:10.830 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.119.119 2024-09-12T17:27:10.831 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:27:10.831 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:27:10.831 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-09-12T17:27:10.831 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-09-12T17:27:10.831 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:27:10.832 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-09-12T17:27:10.832 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T17:27:10.832 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:27:10.833 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:27:10.833 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T17:27:10.833 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:27:10.833 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-09-12T17:27:10.921 INFO:teuthology.orchestra.run.smithi190.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:27:10.921 INFO:teuthology.orchestra.run.smithi190.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:27:10.921 INFO:teuthology.orchestra.run.smithi190.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:27:10.970 INFO:teuthology.orchestra.run.smithi190.stdout:done 2024-09-12T17:27:10.999 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-09-12T17:27:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:27:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:27:11.320 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:27:11.402 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:27:11.463 DEBUG:teuthology.orchestra.run.smithi190:> dpkg -s linux-image-generic 2024-09-12T17:27:11.487 INFO:teuthology.orchestra.run.smithi190.stdout:Package: linux-image-generic 2024-09-12T17:27:11.487 INFO:teuthology.orchestra.run.smithi190.stdout:Status: install ok installed 2024-09-12T17:27:11.487 INFO:teuthology.orchestra.run.smithi190.stdout:Priority: optional 2024-09-12T17:27:11.487 INFO:teuthology.orchestra.run.smithi190.stdout:Section: kernel 2024-09-12T17:27:11.487 INFO:teuthology.orchestra.run.smithi190.stdout:Installed-Size: 21 2024-09-12T17:27:11.487 INFO:teuthology.orchestra.run.smithi190.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:27:11.488 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: amd64 2024-09-12T17:27:11.488 INFO:teuthology.orchestra.run.smithi190.stdout:Source: linux-meta 2024-09-12T17:27:11.488 INFO:teuthology.orchestra.run.smithi190.stdout:Version: 5.15.0.119.119 2024-09-12T17:27:11.488 INFO:teuthology.orchestra.run.smithi190.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:27:11.488 INFO:teuthology.orchestra.run.smithi190.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:27:11.488 INFO:teuthology.orchestra.run.smithi190.stdout:Recommends: thermald 2024-09-12T17:27:11.488 INFO:teuthology.orchestra.run.smithi190.stdout:Description: Generic Linux kernel image 2024-09-12T17:27:11.488 INFO:teuthology.orchestra.run.smithi190.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:27:11.488 INFO:teuthology.orchestra.run.smithi190.stdout: available. 2024-09-12T17:27:11.488 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T17:27:11.489 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:27:11.489 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:27:11.489 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T17:27:11.489 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi190.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:27:11.489 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get clean 2024-09-12T17:27:11.647 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-09-12T17:27:11.897 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:27:11.897 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:27:11.970 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:27:12.052 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:27:12.714 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-12T17:27:12.732 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:27:12.786 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-12T17:27:12.971 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-12T17:27:12.972 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-12T17:27:13.140 INFO:teuthology.orchestra.run.smithi157.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T17:27:13.140 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:27:13.140 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:27:13.140 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:27:13.140 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:27:13.141 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:27:13.141 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:27:13.141 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:27:13.181 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:27:13.183 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-09-12T17:27:13.235 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-09-12T17:27:13.235 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-09-12T17:27:13.235 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.119.119 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:27:13.236 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-09-12T17:27:13.237 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-09-12T17:27:13.283 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.F2qHJS4XVR 2024-09-12T17:27:13.284 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub/grub.cfg /tmp/tmp.F2qHJS4XVR 2024-09-12T17:27:13.344 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.F2qHJS4XVR 2024-09-12T17:27:13.355 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-12T17:27:13.374 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:27:13.428 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-12T17:27:13.460 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.F2qHJS4XVR is 10KB 2024-09-12T17:27:13.473 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.F2qHJS4XVR 2024-09-12T17:27:13.478 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T17:27:13.530 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:27:13.530 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T17:27:13.530 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T17:27:13.604 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T17:27:13.604 DEBUG:teuthology.orchestra.run.smithi157:> sudo update-grub 2024-09-12T17:27:13.626 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-09-12T17:27:13.626 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-09-12T17:27:13.797 INFO:teuthology.orchestra.run.smithi190.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T17:27:13.797 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:27:13.797 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:27:13.797 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:27:13.798 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:27:13.798 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:27:13.798 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:27:13.798 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:27:13.838 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:27:13.840 DEBUG:teuthology.orchestra.run.smithi190:> dpkg -s linux-image-generic 2024-09-12T17:27:13.856 INFO:teuthology.orchestra.run.smithi190.stdout:Package: linux-image-generic 2024-09-12T17:27:13.856 INFO:teuthology.orchestra.run.smithi190.stdout:Status: install ok installed 2024-09-12T17:27:13.856 INFO:teuthology.orchestra.run.smithi190.stdout:Priority: optional 2024-09-12T17:27:13.856 INFO:teuthology.orchestra.run.smithi190.stdout:Section: kernel 2024-09-12T17:27:13.856 INFO:teuthology.orchestra.run.smithi190.stdout:Installed-Size: 21 2024-09-12T17:27:13.856 INFO:teuthology.orchestra.run.smithi190.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:27:13.856 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: amd64 2024-09-12T17:27:13.857 INFO:teuthology.orchestra.run.smithi190.stdout:Source: linux-meta 2024-09-12T17:27:13.857 INFO:teuthology.orchestra.run.smithi190.stdout:Version: 5.15.0.119.119 2024-09-12T17:27:13.857 INFO:teuthology.orchestra.run.smithi190.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:27:13.857 INFO:teuthology.orchestra.run.smithi190.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:27:13.857 INFO:teuthology.orchestra.run.smithi190.stdout:Recommends: thermald 2024-09-12T17:27:13.857 INFO:teuthology.orchestra.run.smithi190.stdout:Description: Generic Linux kernel image 2024-09-12T17:27:13.857 INFO:teuthology.orchestra.run.smithi190.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:27:13.857 INFO:teuthology.orchestra.run.smithi190.stdout: available. 2024-09-12T17:27:13.857 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-09-12T17:27:13.901 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.NcuJ6fhKSa 2024-09-12T17:27:13.901 DEBUG:teuthology.orchestra.run.smithi190:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NcuJ6fhKSa 2024-09-12T17:27:13.958 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.NcuJ6fhKSa 2024-09-12T17:27:14.074 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.NcuJ6fhKSa is 10KB 2024-09-12T17:27:14.086 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.NcuJ6fhKSa 2024-09-12T17:27:14.092 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T17:27:14.145 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:27:14.146 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T17:27:14.146 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T17:27:14.213 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T17:27:14.213 DEBUG:teuthology.orchestra.run.smithi190:> sudo update-grub 2024-09-12T17:27:14.803 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub' 2024-09-12T17:27:14.805 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:27:14.806 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-09-12T17:27:14.986 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:27:14.991 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:27:15.218 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:27:15.222 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:27:15.258 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:27:15.263 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:27:15.378 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:27:15.378 INFO:teuthology.orchestra.run.smithi157.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:27:15.378 INFO:teuthology.orchestra.run.smithi157.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:27:15.393 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-09-12T17:27:15.395 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-09-12T17:27:15.579 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub' 2024-09-12T17:27:15.580 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:27:15.584 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2024-09-12T17:27:15.769 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:27:15.775 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:27:16.053 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:27:16.058 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:27:16.101 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:27:16.106 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:27:16.243 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:27:16.243 INFO:teuthology.orchestra.run.smithi190.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:27:16.243 INFO:teuthology.orchestra.run.smithi190.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:27:16.255 INFO:teuthology.orchestra.run.smithi190.stderr:done 2024-09-12T17:27:16.257 DEBUG:teuthology.orchestra.run.smithi190:> sudo shutdown -r now 2024-09-12T17:27:45.425 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T17:27:45.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-12T17:27:45.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:27:46.260 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T17:27:46.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-12T17:27:46.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:28:20.034 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-09-12T17:28:29.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-12T17:28:29.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:28:32.125 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-09-12T17:28:44.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-12T17:28:44.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:28:46.265 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:28:55.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-12T17:28:55.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:28:55.276 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-09-12T17:29:02.525 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-09-12T17:29:07.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-12T17:29:07.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:29:07.608 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-09-12T17:29:08.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-12T17:29:08.248 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T17:29:08.248 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-09-12T17:29:08.293 INFO:teuthology.orchestra.run.smithi190.stdout:5.15.0-119-generic 2024-09-12T17:29:08.293 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:29:08.293 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:29:08.293 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:29:09.295 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T17:29:09.295 DEBUG:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:29:09.632 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2024-09-12T17:29:09.654 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:17.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-12T17:29:17.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:29:17.899 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-09-12T17:29:18.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-12T17:29:18.514 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T17:29:18.514 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-09-12T17:29:18.519 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-119-generic 2024-09-12T17:29:18.520 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:29:18.520 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:29:18.520 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:29:19.520 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T17:29:19.521 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:29:19.625 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-09-12T17:29:19.648 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:19.648 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T17:29:19.661 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T17:29:19.662 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:29:19.665 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:29:19.672 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T17:29:19.750 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T17:29:19.757 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T17:29:19.757 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:29:19.759 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:29:19.865 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T17:29:19.871 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T17:29:19.872 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:29:19.874 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:29:19.896 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:29:19.897 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:29:19.904 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:29:19.905 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:29:19.906 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T17:29:19.913 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T17:29:19.913 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:29:19.951 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:29:19.973 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T17:29:19.982 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T17:29:19.982 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:29:20.020 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:29:20.025 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:29:20.070 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:29:20.118 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:29:20.119 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:29:20.201 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:29:20.207 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:29:20.253 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:29:20.254 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:29:20.322 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-09-12T17:29:20.324 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2024-09-12T17:29:20.402 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T17:29:20.409 INFO:teuthology.task.internal:Starting timer... 2024-09-12T17:29:20.409 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T17:29:20.564 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T17:29:20.573 DEBUG:teuthology.task.selinux:Excluding smithi157: OS 'ubuntu' does not support SELinux 2024-09-12T17:29:20.574 DEBUG:teuthology.task.selinux:Excluding smithi190: OS 'ubuntu' does not support SELinux 2024-09-12T17:29:20.574 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T17:29:20.574 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T17:29:20.574 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T17:29:20.574 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T17:29:20.582 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T17:29:20.594 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T17:29:20.595 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi157.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:36:52.985 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi157.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2024-09-12T17:36:53.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-12T17:36:53.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:36:53.099 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-09-12T17:36:53.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-12T17:36:53.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-12T17:36:53.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:36:53.261 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-09-12T17:36:53.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-12T17:36:53.341 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:36:53.356 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:36:53.356 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:36:53.357 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:36:53.359 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:36:53.359 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:36:53.388 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:36:53.388 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: Command line: ntpd -gq 2024-09-12T17:36:53.388 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: ---------------------------------------------------- 2024-09-12T17:36:53.388 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:36:53.388 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:36:53.389 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: corporation. Support and training for ntp-4 are 2024-09-12T17:36:53.389 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: available at https://www.nwtime.org/support 2024-09-12T17:36:53.389 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: ---------------------------------------------------- 2024-09-12T17:36:53.389 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: proto: precision = 0.045 usec (-24) 2024-09-12T17:36:53.389 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: basedate set to 2022-02-04 2024-09-12T17:36:53.390 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:36:53.390 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:36:53.390 INFO:teuthology.orchestra.run.smithi157.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:36:53.390 INFO:teuthology.orchestra.run.smithi157.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:36:53.391 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:36:53.391 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:36:53.391 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:36:53.391 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:36:53.391 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: Listen normally on 3 enp3s0f1 172.21.15.157:123 2024-09-12T17:36:53.391 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: Listen normally on 4 lo [::1]:123 2024-09-12T17:36:53.392 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea1%5]:123 2024-09-12T17:36:53.392 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:36:53 ntpd[18462]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:36:53.411 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:36:53.411 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: Command line: ntpd -gq 2024-09-12T17:36:53.411 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: ---------------------------------------------------- 2024-09-12T17:36:53.411 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:36:53.411 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:36:53.411 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: corporation. Support and training for ntp-4 are 2024-09-12T17:36:53.411 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: available at https://www.nwtime.org/support 2024-09-12T17:36:53.411 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: ---------------------------------------------------- 2024-09-12T17:36:53.412 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: proto: precision = 0.044 usec (-24) 2024-09-12T17:36:53.412 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: basedate set to 2022-02-04 2024-09-12T17:36:53.412 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:36:53.413 INFO:teuthology.orchestra.run.smithi190.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:36:53.413 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:36:53.413 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:36:53.413 INFO:teuthology.orchestra.run.smithi190.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:36:53.414 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:36:53.414 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:36:53.414 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:36:53.414 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: Listen normally on 3 enp3s0f1 172.21.15.190:123 2024-09-12T17:36:53.414 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: Listen normally on 4 lo [::1]:123 2024-09-12T17:36:53.415 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7763%5]:123 2024-09-12T17:36:53.415 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:36:53 ntpd[18542]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:36:54.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:54 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:54.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:54 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:54.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:54 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:54.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:54 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:54.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:54 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:54.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:54 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:54.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:54 ntpd[18542]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:54.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:54 ntpd[18542]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:55.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:55 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:55.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:55 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:55.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:55 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:55.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:55 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:55.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:55 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:55.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:55 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:55.411 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:55 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:55.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:55 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:55.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:55 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:55.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:55 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:55.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:55 ntpd[18542]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:55.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:55 ntpd[18542]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:56.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:56 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:56.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:56 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:56.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:56 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:56.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:56 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:56.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:56 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:56.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:56 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:56.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:56 ntpd[18542]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:56.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:56 ntpd[18542]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:57.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:57.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:57.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:57.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:57.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:57.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:57.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:57.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:57.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:57.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:57.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:57.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:57 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:57.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:57.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:57.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:57.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:57.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:57.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:57.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:57.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:57.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:57.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:57.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:57.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:57 ntpd[18542]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:58.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:58 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:58.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:58 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:58.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:58 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:58.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:58 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:58.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:58 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:58.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:58 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:58.411 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:58 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:58.411 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:58 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:58.411 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:58 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:58.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:58 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:58.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:58 ntpd[18542]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:58.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:58 ntpd[18542]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:59.396 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:59.396 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:59.396 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:36:59 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:59.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:59.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:59.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:59.414 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:59.414 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:59.414 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:59.414 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:59.414 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:36:59.414 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:36:59.414 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:36:59.414 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:36:59.415 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:36:59 ntpd[18542]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:37:00.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:00 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:37:00.392 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:00 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:37:00.392 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:00 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:37:00.393 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:00 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:37:00.393 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:00 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:37:00.393 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:00 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:37:00.411 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:37:00 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:37:00.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:37:00 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:37:00.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:37:00 ntpd[18542]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:37:00.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:37:00 ntpd[18542]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:37:00.412 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:37:00 ntpd[18542]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:37:00.412 INFO:teuthology.orchestra.run.smithi190.stdout:12 Sep 17:37:00 ntpd[18542]: ntpd: time slew +0.000483 s 2024-09-12T17:37:00.412 INFO:teuthology.orchestra.run.smithi190.stdout:ntpd: time slew +0.000483s 2024-09-12T17:37:00.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:37:00 ntpd[18542]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:37:00.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:37:00 ntpd[18542]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:37:00.413 INFO:teuthology.orchestra.run.smithi190.stderr:12 Sep 17:37:00 ntpd[18542]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:37:00.454 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:37:00.454 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2024-09-12T17:37:00.454 INFO:teuthology.orchestra.run.smithi190.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:37:00.454 INFO:teuthology.orchestra.run.smithi190.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:37:00.455 INFO:teuthology.orchestra.run.smithi190.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:37:00.455 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:37:01.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:01 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:37:01.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:01 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:37:01.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:01 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:37:01.389 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:01 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:37:01.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:01 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:37:01.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:01 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:37:01.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:01 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:37:01.390 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:01 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:37:01.390 INFO:teuthology.orchestra.run.smithi157.stdout:12 Sep 17:37:01 ntpd[18462]: ntpd: time slew -0.001354 s 2024-09-12T17:37:01.390 INFO:teuthology.orchestra.run.smithi157.stdout:ntpd: time slew -0.001354s 2024-09-12T17:37:01.391 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:01 ntpd[18462]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:37:01.391 INFO:teuthology.orchestra.run.smithi157.stderr:12 Sep 17:37:01 ntpd[18462]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:37:01.438 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:37:01.438 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-09-12T17:37:01.439 INFO:teuthology.orchestra.run.smithi157.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:37:01.439 INFO:teuthology.orchestra.run.smithi157.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:37:01.439 INFO:teuthology.orchestra.run.smithi157.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:37:01.439 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:37:01.439 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:37:01.447 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:37:01.447 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:37:01.447 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:37:01.448 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:37:01.453 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:37:01.453 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:37:01.453 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-key list | grep Ceph 2024-09-12T17:37:01.454 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-key list | grep Ceph 2024-09-12T17:37:01.517 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:37:01.543 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:37:01.547 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:37:01.547 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:37:01.548 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:37:01.548 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T17:37:01.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:37:01.570 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:37:01.570 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:37:01.570 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:37:01.570 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T17:37:01.570 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:37:01.702 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:37:01.702 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:37:01.707 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:37:01.707 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:37:01.815 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:37:01.815 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:37:01.819 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:37:01.819 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:37:01.864 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-09-12T17:37:01.871 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-09-12T17:37:02.058 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:37:02.067 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:37:02.084 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:37:02.085 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:37:02.095 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:37:02.107 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:37:02.116 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:37:02.130 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:37:02.140 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:37:02.152 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:37:02.161 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:37:02.166 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:37:02.171 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:37:02.172 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:37:02.187 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:37:02.193 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:37:02.252 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:37:02.334 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:37:02.400 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 28.6 kB in 0s (81.8 kB/s) 2024-09-12T17:37:02.532 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 28.6 kB in 0s (58.4 kB/s) 2024-09-12T17:37:03.361 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-12T17:37:03.377 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:37:03.443 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-12T17:37:03.533 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-12T17:37:03.548 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:37:03.610 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-12T17:37:03.651 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-12T17:37:03.652 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-12T17:37:03.819 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-09-12T17:37:03.819 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-09-12T17:37:03.859 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:37:03.860 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:37:03.860 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:37:03.860 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:37:03.860 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:37:03.860 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:37:03.860 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:37:03.861 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-09-12T17:37:03.861 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:37:03.861 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:37:03.862 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:37:03.863 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:37:03.864 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:37:03.864 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:37:03.864 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:37:03.864 INFO:teuthology.orchestra.run.smithi157.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:37:03.864 INFO:teuthology.orchestra.run.smithi157.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:37:03.864 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:37:03.864 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:37:03.864 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet zip 2024-09-12T17:37:03.864 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-09-12T17:37:03.864 INFO:teuthology.orchestra.run.smithi157.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:37:03.865 INFO:teuthology.orchestra.run.smithi157.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:37:03.865 INFO:teuthology.orchestra.run.smithi157.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:37:03.865 INFO:teuthology.orchestra.run.smithi157.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:37:03.865 INFO:teuthology.orchestra.run.smithi157.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:37:03.865 INFO:teuthology.orchestra.run.smithi157.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:37:03.865 INFO:teuthology.orchestra.run.smithi157.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:37:03.865 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-09-12T17:37:03.865 INFO:teuthology.orchestra.run.smithi157.stdout: btrfs-tools 2024-09-12T17:37:03.968 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-09-12T17:37:03.969 INFO:teuthology.orchestra.run.smithi157.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:37:03.969 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:37:03.969 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:37:03.969 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:37:03.969 INFO:teuthology.orchestra.run.smithi157.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:37:03.969 INFO:teuthology.orchestra.run.smithi157.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:37:03.970 INFO:teuthology.orchestra.run.smithi157.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:37:03.970 INFO:teuthology.orchestra.run.smithi157.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:37:03.970 INFO:teuthology.orchestra.run.smithi157.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:37:03.970 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:37:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:37:03.972 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:37:03.972 INFO:teuthology.orchestra.run.smithi157.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:37:04.011 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:37:04.011 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:37:04.012 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:37:04.012 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:37:04.012 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:37:04.012 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:37:04.012 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:37:04.013 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-09-12T17:37:04.013 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:37:04.013 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:37:04.013 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:37:04.013 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:37:04.014 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:37:04.014 INFO:teuthology.orchestra.run.smithi190.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:37:04.014 INFO:teuthology.orchestra.run.smithi190.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:37:04.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:37:04.016 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:37:04.016 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:37:04.016 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet zip 2024-09-12T17:37:04.016 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-09-12T17:37:04.016 INFO:teuthology.orchestra.run.smithi190.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:37:04.016 INFO:teuthology.orchestra.run.smithi190.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:37:04.016 INFO:teuthology.orchestra.run.smithi190.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:37:04.016 INFO:teuthology.orchestra.run.smithi190.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:37:04.016 INFO:teuthology.orchestra.run.smithi190.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:37:04.016 INFO:teuthology.orchestra.run.smithi190.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:37:04.017 INFO:teuthology.orchestra.run.smithi190.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:37:04.017 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2024-09-12T17:37:04.017 INFO:teuthology.orchestra.run.smithi190.stdout: btrfs-tools 2024-09-12T17:37:04.111 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:37:04.111 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 243 MB of archives. 2024-09-12T17:37:04.111 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:37:04.111 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:37:04.118 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-09-12T17:37:04.119 INFO:teuthology.orchestra.run.smithi190.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:37:04.119 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:37:04.119 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:37:04.120 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:37:04.120 INFO:teuthology.orchestra.run.smithi190.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:37:04.120 INFO:teuthology.orchestra.run.smithi190.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:37:04.120 INFO:teuthology.orchestra.run.smithi190.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:37:04.120 INFO:teuthology.orchestra.run.smithi190.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:37:04.120 INFO:teuthology.orchestra.run.smithi190.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:37:04.120 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:37:04.120 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:37:04.120 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:37:04.121 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:37:04.122 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:37:04.122 INFO:teuthology.orchestra.run.smithi190.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:37:04.157 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:37:04.266 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:37:04.266 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 243 MB of archives. 2024-09-12T17:37:04.266 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:37:04.266 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:37:04.310 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:37:04.325 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:37:04.408 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:37:04.423 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:37:04.438 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:37:04.439 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:37:04.443 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:37:04.445 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:37:04.462 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:37:04.504 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:37:04.577 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:37:04.590 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:37:04.635 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:37:04.650 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:37:04.668 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:37:04.673 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:37:04.673 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:37:04.677 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:37:04.678 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:37:04.679 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:37:04.682 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:37:04.684 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:37:04.690 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:37:04.734 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:37:04.746 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:37:04.827 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:37:04.901 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:37:04.911 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:37:04.941 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:37:04.949 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:37:04.950 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:37:04.952 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:37:04.970 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:37:04.974 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:37:04.979 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:37:04.985 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:37:05.019 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:37:05.022 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:37:05.034 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:37:05.056 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:37:05.063 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:37:05.068 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:37:05.069 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:37:05.072 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:37:05.075 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:37:05.077 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:37:05.077 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:37:05.079 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:37:05.080 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:37:05.080 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:37:05.098 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:37:05.107 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:37:05.108 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:37:05.109 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:37:05.127 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:37:05.131 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:37:05.135 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:37:05.139 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:37:05.149 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:37:05.163 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:37:05.164 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:37:05.165 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:37:05.170 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:37:05.171 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:37:05.220 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:37:05.224 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:37:05.228 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:37:05.231 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:37:05.231 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:37:05.232 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:37:05.232 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:37:05.233 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:37:05.234 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:37:05.234 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:37:05.235 INFO:teuthology.orchestra.run.smithi157.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:37:05.235 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:37:05.263 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:37:05.302 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:37:05.312 INFO:teuthology.orchestra.run.smithi157.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:37:05.315 INFO:teuthology.orchestra.run.smithi157.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:37:05.317 INFO:teuthology.orchestra.run.smithi157.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:37:05.318 INFO:teuthology.orchestra.run.smithi157.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:37:05.328 INFO:teuthology.orchestra.run.smithi157.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:37:05.345 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:37:05.346 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:37:05.347 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:37:05.352 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:37:05.353 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:37:05.384 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:37:05.385 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:37:05.387 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:37:05.388 INFO:teuthology.orchestra.run.smithi190.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:37:05.394 INFO:teuthology.orchestra.run.smithi157.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:37:05.395 INFO:teuthology.orchestra.run.smithi157.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:37:05.396 INFO:teuthology.orchestra.run.smithi157.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:37:05.399 INFO:teuthology.orchestra.run.smithi157.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:37:05.403 INFO:teuthology.orchestra.run.smithi157.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:37:05.465 INFO:teuthology.orchestra.run.smithi190.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:37:05.468 INFO:teuthology.orchestra.run.smithi190.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:37:05.469 INFO:teuthology.orchestra.run.smithi190.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:37:05.470 INFO:teuthology.orchestra.run.smithi190.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:37:05.475 INFO:teuthology.orchestra.run.smithi157.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:37:05.481 INFO:teuthology.orchestra.run.smithi190.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:37:05.518 INFO:teuthology.orchestra.run.smithi157.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:37:05.520 INFO:teuthology.orchestra.run.smithi157.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:37:05.547 INFO:teuthology.orchestra.run.smithi190.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:37:05.548 INFO:teuthology.orchestra.run.smithi190.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:37:05.549 INFO:teuthology.orchestra.run.smithi190.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:37:05.551 INFO:teuthology.orchestra.run.smithi190.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:37:05.555 INFO:teuthology.orchestra.run.smithi190.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:37:05.578 INFO:teuthology.orchestra.run.smithi157.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:37:05.578 INFO:teuthology.orchestra.run.smithi157.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:37:05.579 INFO:teuthology.orchestra.run.smithi157.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:37:05.581 INFO:teuthology.orchestra.run.smithi157.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:37:05.587 INFO:teuthology.orchestra.run.smithi157.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:37:05.628 INFO:teuthology.orchestra.run.smithi190.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:37:05.631 INFO:teuthology.orchestra.run.smithi190.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:37:05.632 INFO:teuthology.orchestra.run.smithi190.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:37:05.637 INFO:teuthology.orchestra.run.smithi190.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:37:05.638 INFO:teuthology.orchestra.run.smithi190.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:37:05.669 INFO:teuthology.orchestra.run.smithi157.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:37:05.673 INFO:teuthology.orchestra.run.smithi157.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:37:05.683 INFO:teuthology.orchestra.run.smithi157.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:37:05.709 INFO:teuthology.orchestra.run.smithi190.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:37:05.714 INFO:teuthology.orchestra.run.smithi190.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:37:05.754 INFO:teuthology.orchestra.run.smithi157.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:37:05.756 INFO:teuthology.orchestra.run.smithi157.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:37:05.758 INFO:teuthology.orchestra.run.smithi157.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:37:05.759 INFO:teuthology.orchestra.run.smithi157.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:37:05.761 INFO:teuthology.orchestra.run.smithi157.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:37:05.821 INFO:teuthology.orchestra.run.smithi157.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:37:05.826 INFO:teuthology.orchestra.run.smithi157.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:37:05.829 INFO:teuthology.orchestra.run.smithi157.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:37:05.830 INFO:teuthology.orchestra.run.smithi157.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:37:05.858 INFO:teuthology.orchestra.run.smithi157.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:37:05.858 INFO:teuthology.orchestra.run.smithi157.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:37:05.875 INFO:teuthology.orchestra.run.smithi190.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:37:05.877 INFO:teuthology.orchestra.run.smithi190.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:37:05.879 INFO:teuthology.orchestra.run.smithi190.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:37:05.879 INFO:teuthology.orchestra.run.smithi190.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:37:05.881 INFO:teuthology.orchestra.run.smithi190.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:37:05.914 INFO:teuthology.orchestra.run.smithi190.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:37:05.917 INFO:teuthology.orchestra.run.smithi190.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:37:05.917 INFO:teuthology.orchestra.run.smithi190.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:37:05.921 INFO:teuthology.orchestra.run.smithi157.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:37:05.922 INFO:teuthology.orchestra.run.smithi157.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:37:05.923 INFO:teuthology.orchestra.run.smithi157.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:37:05.924 INFO:teuthology.orchestra.run.smithi157.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:37:05.925 INFO:teuthology.orchestra.run.smithi157.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:37:05.926 INFO:teuthology.orchestra.run.smithi157.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:37:05.932 INFO:teuthology.orchestra.run.smithi157.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:37:05.937 INFO:teuthology.orchestra.run.smithi157.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:37:05.977 INFO:teuthology.orchestra.run.smithi190.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:37:05.977 INFO:teuthology.orchestra.run.smithi190.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:37:06.002 INFO:teuthology.orchestra.run.smithi157.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:37:06.006 INFO:teuthology.orchestra.run.smithi157.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:37:06.008 INFO:teuthology.orchestra.run.smithi157.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:37:06.041 INFO:teuthology.orchestra.run.smithi190.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:37:06.045 INFO:teuthology.orchestra.run.smithi190.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:37:06.046 INFO:teuthology.orchestra.run.smithi190.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:37:06.047 INFO:teuthology.orchestra.run.smithi190.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:37:06.048 INFO:teuthology.orchestra.run.smithi190.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:37:06.084 INFO:teuthology.orchestra.run.smithi157.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:37:06.091 INFO:teuthology.orchestra.run.smithi157.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:37:06.093 INFO:teuthology.orchestra.run.smithi157.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:37:06.095 INFO:teuthology.orchestra.run.smithi157.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:37:06.106 INFO:teuthology.orchestra.run.smithi157.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:37:06.107 INFO:teuthology.orchestra.run.smithi157.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:37:06.115 INFO:teuthology.orchestra.run.smithi157.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:37:06.127 INFO:teuthology.orchestra.run.smithi190.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:37:06.130 INFO:teuthology.orchestra.run.smithi190.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:37:06.135 INFO:teuthology.orchestra.run.smithi190.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:37:06.139 INFO:teuthology.orchestra.run.smithi190.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:37:06.143 INFO:teuthology.orchestra.run.smithi190.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:37:06.144 INFO:teuthology.orchestra.run.smithi190.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:37:06.166 INFO:teuthology.orchestra.run.smithi157.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:37:06.167 INFO:teuthology.orchestra.run.smithi157.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:37:06.168 INFO:teuthology.orchestra.run.smithi157.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:37:06.204 INFO:teuthology.orchestra.run.smithi190.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:37:06.211 INFO:teuthology.orchestra.run.smithi190.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:37:06.213 INFO:teuthology.orchestra.run.smithi190.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:37:06.247 INFO:teuthology.orchestra.run.smithi157.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:37:06.249 INFO:teuthology.orchestra.run.smithi157.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:37:06.263 INFO:teuthology.orchestra.run.smithi190.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:37:06.269 INFO:teuthology.orchestra.run.smithi157.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:37:06.269 INFO:teuthology.orchestra.run.smithi190.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:37:06.270 INFO:teuthology.orchestra.run.smithi157.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:37:06.270 INFO:teuthology.orchestra.run.smithi157.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:37:06.272 INFO:teuthology.orchestra.run.smithi190.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:37:06.276 INFO:teuthology.orchestra.run.smithi157.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:37:06.278 INFO:teuthology.orchestra.run.smithi157.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:37:06.286 INFO:teuthology.orchestra.run.smithi190.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:37:06.297 INFO:teuthology.orchestra.run.smithi190.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:37:06.298 INFO:teuthology.orchestra.run.smithi190.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:37:06.306 INFO:teuthology.orchestra.run.smithi190.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:37:06.307 INFO:teuthology.orchestra.run.smithi190.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:37:06.309 INFO:teuthology.orchestra.run.smithi190.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:37:06.310 INFO:teuthology.orchestra.run.smithi190.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:37:06.322 INFO:teuthology.orchestra.run.smithi190.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:37:06.367 INFO:teuthology.orchestra.run.smithi190.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:37:06.369 INFO:teuthology.orchestra.run.smithi190.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:37:06.386 INFO:teuthology.orchestra.run.smithi190.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:37:06.449 INFO:teuthology.orchestra.run.smithi190.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:37:06.449 INFO:teuthology.orchestra.run.smithi190.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:37:06.455 INFO:teuthology.orchestra.run.smithi190.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:37:06.456 INFO:teuthology.orchestra.run.smithi190.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:37:06.586 INFO:teuthology.orchestra.run.smithi190.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:37:06.654 INFO:teuthology.orchestra.run.smithi157.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:37:06.698 INFO:teuthology.orchestra.run.smithi157.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:37:06.714 INFO:teuthology.orchestra.run.smithi157.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:37:06.758 INFO:teuthology.orchestra.run.smithi157.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:37:06.768 INFO:teuthology.orchestra.run.smithi157.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:37:06.770 INFO:teuthology.orchestra.run.smithi157.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:37:07.499 INFO:teuthology.orchestra.run.smithi190.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:37:07.499 INFO:teuthology.orchestra.run.smithi190.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:37:07.516 INFO:teuthology.orchestra.run.smithi190.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:37:07.559 INFO:teuthology.orchestra.run.smithi190.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:37:07.580 INFO:teuthology.orchestra.run.smithi190.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:37:07.582 INFO:teuthology.orchestra.run.smithi190.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:37:08.834 INFO:teuthology.orchestra.run.smithi157.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:37:09.019 INFO:teuthology.orchestra.run.smithi157.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:37:09.020 INFO:teuthology.orchestra.run.smithi157.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:37:09.805 INFO:teuthology.orchestra.run.smithi190.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:37:10.022 INFO:teuthology.orchestra.run.smithi190.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:37:10.022 INFO:teuthology.orchestra.run.smithi190.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:37:10.560 INFO:teuthology.orchestra.run.smithi157.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:37:10.562 INFO:teuthology.orchestra.run.smithi157.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:37:10.563 INFO:teuthology.orchestra.run.smithi157.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:37:11.025 INFO:teuthology.orchestra.run.smithi157.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:37:11.426 INFO:teuthology.orchestra.run.smithi190.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:37:11.505 INFO:teuthology.orchestra.run.smithi190.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:37:11.506 INFO:teuthology.orchestra.run.smithi190.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:37:11.603 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 243 MB in 7s (34.6 MB/s) 2024-09-12T17:37:11.733 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:37:11.809 INFO:teuthology.orchestra.run.smithi190.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:37:11.831 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:37:11.836 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:37:11.915 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:37:12.260 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:37:12.286 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:37:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:37:12.380 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 243 MB in 8s (31.7 MB/s) 2024-09-12T17:37:12.541 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:37:12.641 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:37:12.646 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:37:12.663 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:37:12.679 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:37:12.721 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:37:12.731 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:37:13.026 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:37:13.052 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:37:13.092 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:37:13.099 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:37:13.126 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:37:13.166 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:37:13.429 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:37:13.455 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:37:13.495 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:37:13.553 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:37:13.579 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:37:13.619 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:37:13.857 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:37:13.884 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:37:13.923 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:37:13.973 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:37:13.999 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:37:14.039 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:37:14.310 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:37:14.337 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:37:14.342 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:37:14.357 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:37:14.377 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:37:14.401 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:37:14.721 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:37:14.748 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:37:14.753 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librados2. 2024-09-12T17:37:14.780 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:14.787 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:37:14.820 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:37:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:37:15.165 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:37:15.273 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:37:15.299 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:15.339 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:15.468 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librados2. 2024-09-12T17:37:15.495 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:15.535 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:15.768 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:37:15.794 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:15.826 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:16.004 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:37:16.031 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:16.070 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:16.087 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:37:16.102 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:16.145 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:16.548 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:37:16.575 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:16.614 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:16.656 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:37:16.682 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:16.714 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:16.875 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:37:16.899 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:16.900 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:37:16.915 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:16.933 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:16.958 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:17.245 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:37:17.271 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:17.278 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:37:17.304 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:17.311 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:17.344 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:17.514 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:37:17.529 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:17.563 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:17.697 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:37:17.723 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:37:17.772 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:37:17.874 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:37:17.901 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:17.941 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:18.058 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:37:18.085 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:37:18.125 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:37:18.244 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:37:18.271 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:37:18.311 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:37:18.394 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:37:18.421 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:18.461 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:18.630 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:37:18.656 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:37:18.696 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:37:18.814 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:37:18.840 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:37:18.881 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:37:18.957 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:37:18.984 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:19.015 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:19.158 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:37:19.173 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:37:19.208 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:37:19.343 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:37:19.370 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:37:19.410 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:37:19.505 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:37:19.531 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:37:19.571 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:37:19.688 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:37:19.714 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:37:19.754 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:37:19.908 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:37:19.934 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:37:19.974 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:37:20.082 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:37:20.097 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:37:20.141 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:37:20.286 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:37:20.302 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:37:20.336 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:37:20.444 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:37:20.469 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:37:20.501 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:37:20.580 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package zip. 2024-09-12T17:37:20.603 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:37:20.648 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:37:20.813 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:37:20.828 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:37:20.871 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:37:20.967 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package unzip. 2024-09-12T17:37:20.993 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:37:21.033 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:37:21.106 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package zip. 2024-09-12T17:37:21.122 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:37:21.165 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:37:21.429 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:37:21.455 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:37:21.495 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:37:21.751 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package unzip. 2024-09-12T17:37:21.778 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:37:21.826 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:37:22.137 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:37:22.163 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:22.197 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:37:22.223 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:37:22.228 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:22.263 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:37:22.637 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:37:22.664 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:22.704 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:22.839 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:37:22.866 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:22.906 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:23.267 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:37:23.293 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:37:23.331 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:37:23.333 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:37:23.358 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:23.398 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:23.603 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:37:23.618 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:23.661 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:23.700 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:37:23.727 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:37:23.767 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:37:24.062 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:37:24.088 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:24.090 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:37:24.116 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:24.128 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:24.156 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:24.556 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:37:24.583 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:24.622 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:25.753 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:37:25.780 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:25.829 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:37:26.031 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:26.080 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:26.383 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:37:26.409 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:37:26.441 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:37:26.727 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:37:26.753 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:37:26.793 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:37:26.875 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:37:26.902 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:37:26.942 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:37:27.245 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:37:27.271 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:37:27.311 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:37:27.313 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:37:27.339 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:37:27.379 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:37:27.631 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:37:27.657 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:37:27.682 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:37:27.697 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:37:27.709 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:37:27.749 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:37:27.983 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:37:28.001 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:37:28.010 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:37:28.017 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:37:28.041 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:37:28.051 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:37:28.328 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:37:28.346 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:37:28.354 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:37:28.373 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:37:28.394 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:37:28.413 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:37:28.697 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:37:28.723 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:37:28.764 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:37:28.765 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:37:28.792 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:37:28.840 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:37:29.025 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:37:29.051 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:37:29.083 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:37:29.143 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:37:29.170 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:37:29.235 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:37:29.352 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:37:29.379 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:37:29.419 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:37:29.538 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:37:29.564 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:37:29.605 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:37:29.730 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:37:29.745 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:37:29.788 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:37:29.950 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:37:29.977 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:37:30.016 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:37:30.158 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:37:30.185 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:37:30.225 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:37:30.278 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:37:30.305 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:37:30.353 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:37:30.536 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:37:30.562 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:37:30.603 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:37:30.639 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:37:30.654 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:37:30.697 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:37:30.906 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:37:30.932 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:37:30.972 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:37:31.000 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:37:31.027 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:37:31.066 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:37:31.241 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:37:31.268 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:37:31.300 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:37:31.403 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:37:31.430 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:37:31.470 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:37:31.611 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:37:31.638 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:37:31.677 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:37:31.739 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:37:31.754 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:37:31.789 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:37:31.980 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:37:32.007 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:37:32.047 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:37:32.100 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:37:32.127 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:37:32.166 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:37:32.308 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:37:32.334 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:37:32.366 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:37:32.678 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:37:32.685 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:37:32.705 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:37:32.712 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:37:32.747 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:37:32.748 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:37:33.038 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:37:33.065 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:37:33.073 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:37:33.099 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:37:33.105 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:37:33.139 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:37:33.424 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:37:33.450 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:37:33.451 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:37:33.477 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:37:33.491 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:37:33.517 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:37:33.769 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:37:33.784 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:37:33.827 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:37:33.837 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:37:33.864 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:37:33.904 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:37:34.121 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:37:34.149 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:37:34.188 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:37:34.206 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:37:34.233 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:37:34.273 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:37:34.499 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:37:34.526 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:37:34.559 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:37:34.585 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:37:34.591 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:37:34.617 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:37:34.887 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:37:34.902 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:37:34.914 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:37:34.929 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:37:34.954 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:37:34.968 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:37:35.300 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:37:35.315 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:37:35.327 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:37:35.341 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:37:35.366 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:37:35.381 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:37:35.684 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:37:35.694 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:37:35.710 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:37:35.711 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:37:35.750 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:37:35.753 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:37:36.037 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:37:36.064 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:37:36.072 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:37:36.088 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:37:36.103 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:37:36.130 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:37:36.459 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:37:36.485 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:37:36.525 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:37:36.822 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:37:36.846 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:37:36.911 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:37:37.215 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:37:37.240 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:37:37.241 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:37.268 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:37:37.281 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:37.306 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:37:37.584 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:37:37.611 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:37:37.642 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:37:37.929 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:37:37.955 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:37.995 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:38.367 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:37:38.393 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:38.425 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:38.519 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:37:38.546 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:38.585 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:38.661 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:37:38.688 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:37:38.719 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:37:38.897 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:37:38.924 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:37:38.964 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:37:39.022 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:37:39.049 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:37:39.088 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:37:39.300 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:37:39.326 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:37:39.375 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:37:39.425 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:37:39.452 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:39.491 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:39.719 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:37:39.746 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:39.786 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:39.869 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:37:39.896 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:39.960 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:40.231 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:37:40.258 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:40.297 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:40.506 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:37:40.533 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:40.572 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:40.984 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:37:41.011 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:41.059 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:41.584 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph. 2024-09-12T17:37:41.611 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:41.650 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:41.978 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:37:42.005 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:42.044 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:42.132 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph. 2024-09-12T17:37:42.156 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:42.196 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:42.523 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:37:42.550 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:42.589 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:42.647 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:37:42.674 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:42.714 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:43.118 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:37:43.125 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:37:43.145 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:43.152 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:43.176 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:43.191 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:43.503 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:37:43.529 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:37:43.569 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:37:43.588 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:37:43.614 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:43.654 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:43.897 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:37:43.923 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:37:43.963 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:37:43.974 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:37:44.000 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:37:44.040 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:37:44.335 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:37:44.361 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:37:44.401 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:37:44.968 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:37:44.995 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:37:45.034 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:37:45.354 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:37:45.381 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:37:45.420 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:37:45.465 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:37:45.492 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:37:45.523 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:37:45.774 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:37:45.800 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:45.840 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:45.851 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:37:45.878 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:37:45.925 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:37:46.177 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:37:46.203 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:37:46.243 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:37:46.304 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:37:46.331 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:46.379 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:46.546 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:37:46.573 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:37:46.637 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:37:46.724 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:37:46.751 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:37:46.790 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:37:46.974 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:37:47.001 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:47.040 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:47.110 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:37:47.137 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:37:47.176 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:37:47.522 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:37:47.549 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:47.588 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:49.644 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:37:49.662 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:37:49.702 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:37:50.248 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:37:50.276 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:37:50.314 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:37:50.351 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:37:50.381 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:37:50.426 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:37:50.634 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:37:50.662 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:37:50.692 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:37:50.947 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:37:50.974 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:37:51.012 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:37:51.013 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:37:51.039 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:37:51.078 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:37:51.316 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:37:51.344 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:37:51.383 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:37:51.694 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:37:51.721 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:37:51.736 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:37:51.752 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:51.760 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:37:51.880 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:52.502 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:37:52.519 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:52.647 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:52.825 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:37:52.853 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:37:52.891 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:37:53.194 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:37:53.222 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:37:53.277 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:37:53.573 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:37:53.600 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:37:53.639 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:37:53.833 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:37:53.862 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:37:53.908 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:37:53.909 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:37:53.936 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:37:53.975 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:37:54.261 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:37:54.289 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:37:54.295 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:37:54.323 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:37:54.328 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:37:54.361 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:37:54.656 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:37:54.685 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:37:54.690 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:37:54.717 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:37:54.722 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:37:54.756 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:37:55.018 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:37:55.045 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:37:55.067 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:37:55.084 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:37:55.095 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:37:55.134 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:37:55.404 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:37:55.428 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:37:55.432 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:37:55.444 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:37:55.471 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:37:55.478 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:37:55.791 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:37:55.807 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:37:55.849 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:37:56.101 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:37:56.129 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:56.160 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:37:56.167 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:56.188 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:37:56.218 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:37:56.478 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:37:56.506 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:37:56.513 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:37:56.541 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:37:56.544 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:37:56.580 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:37:56.864 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:37:56.892 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:37:56.930 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:37:57.175 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package jq. 2024-09-12T17:37:57.203 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:37:57.233 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:37:57.244 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:37:57.260 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:37:57.302 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:57.477 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package socat. 2024-09-12T17:37:57.493 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:37:57.535 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:37:57.597 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:37:57.624 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:37:57.663 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:37:57.991 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:37:58.019 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:37:58.057 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:37:58.180 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:37:58.196 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:37:58.230 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:37:58.327 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package jq. 2024-09-12T17:37:58.355 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:37:58.393 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:37:58.584 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:37:58.600 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:58.634 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:37:58.648 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package socat. 2024-09-12T17:37:58.677 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:37:58.706 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:37:59.018 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:37:59.034 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:37:59.076 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:37:59.422 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:37:59.438 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:37:59.489 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:00.813 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:38:00.841 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:38:00.888 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:01.192 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:38:01.208 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:38:01.250 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:01.561 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:38:01.589 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:38:01.627 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:38:01.735 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:38:01.763 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:38:01.801 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:01.965 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:38:01.993 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:38:02.024 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:38:02.113 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:38:02.130 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:38:02.171 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:02.394 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:38:02.421 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:38:02.460 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:38:02.491 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:38:02.519 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:38:02.558 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:38:02.874 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:38:02.896 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:38:02.901 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:38:02.924 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:38:02.940 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:38:02.962 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:38:03.201 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:38:03.217 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:38:03.276 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:38:03.316 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:38:03.345 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:38:03.382 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:38:03.679 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:38:03.707 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:38:03.745 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:38:04.023 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:38:04.025 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:38:04.039 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:38:04.054 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:38:04.073 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:38:04.096 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:38:04.351 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:38:04.366 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:38:04.375 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:38:04.394 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:38:04.409 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:38:04.432 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:38:04.712 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:38:04.740 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:38:04.778 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:38:04.852 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:38:04.880 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:38:04.918 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:38:05.131 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:38:05.159 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:38:05.196 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:38:05.197 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:38:05.224 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:38:05.262 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:38:05.501 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:38:05.529 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:38:05.549 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:38:05.566 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:38:05.567 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:38:05.599 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:38:05.894 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:38:05.924 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:38:05.960 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:38:06.038 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:38:06.066 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:38:06.104 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:38:06.288 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:38:06.317 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:38:06.354 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:38:06.384 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:38:06.412 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:38:06.442 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:38:06.658 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:38:06.687 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:38:06.724 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:38:06.753 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:38:06.781 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:38:06.820 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:38:07.123 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:38:07.151 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:38:07.187 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:38:07.189 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:38:07.216 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:38:07.253 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:38:07.459 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:38:07.484 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:38:07.517 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:38:07.581 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:38:07.610 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:38:07.648 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:38:07.934 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:38:07.962 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:38:07.992 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:38:08.196 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:38:08.224 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:38:08.262 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:08.321 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:38:08.349 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:38:08.387 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:38:08.681 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:38:08.698 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:38:08.739 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:38:09.132 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:38:09.148 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:38:09.190 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:09.427 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:38:09.456 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:38:09.493 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:09.503 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:38:09.745 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:38:09.862 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:38:10.151 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:38:10.346 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:38:10.363 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:38:10.404 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:10.496 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:38:10.726 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:38:10.964 INFO:teuthology.orchestra.run.smithi190.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:38:10.976 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:38:11.030 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:11.102 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:38:11.362 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:38:11.489 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user cephadm....done 2024-09-12T17:38:11.620 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:38:11.706 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:38:11.888 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:38:12.126 INFO:teuthology.orchestra.run.smithi157.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:38:12.139 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:38:12.196 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:12.265 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:38:12.533 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:38:12.729 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user cephadm....done 2024-09-12T17:38:12.792 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:38:12.885 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:38:12.901 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:38:13.178 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:38:13.209 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:38:13.421 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:38:13.547 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:38:13.580 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:38:13.807 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:38:13.831 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:38:14.058 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:38:14.099 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:38:14.158 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:38:14.375 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:38:14.452 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:38:14.634 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:38:14.804 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:38:14.877 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:38:15.055 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:38:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:15.323 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:38:15.371 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:38:15.497 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:38:15.591 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:38:15.623 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:38:15.757 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:38:15.825 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:38:16.008 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:38:16.077 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:38:16.327 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:16.447 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:38:16.480 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:38:16.573 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:38:16.587 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:38:16.688 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:38:16.695 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:38:16.806 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:38:16.932 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:38:17.055 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:38:17.181 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:38:17.191 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:38:17.449 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:38:17.576 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:38:17.605 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:38:17.669 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:38:17.717 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:38:17.779 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:38:18.034 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:38:18.130 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:38:18.135 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:38:18.248 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:38:18.524 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:38:18.754 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:38:18.783 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:38:19.005 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:38:19.068 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:38:19.131 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:38:19.194 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:38:19.265 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:38:19.558 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:38:19.854 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:38:19.942 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:38:20.114 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:38:20.168 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:38:20.240 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:38:20.341 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:38:20.528 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:38:20.625 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:38:20.804 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:38:20.976 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:38:21.148 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:38:21.219 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:38:21.399 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:38:21.524 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:21.604 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:38:21.859 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:38:21.897 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:38:22.168 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:38:22.248 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:38:22.483 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:38:22.601 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:22.902 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:38:23.338 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:38:23.374 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:38:23.642 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:38:23.768 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:38:24.019 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:38:24.120 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:38:24.246 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:38:24.547 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:38:24.617 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:38:24.807 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:38:24.869 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:38:25.003 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:38:25.050 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:38:25.176 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:38:25.263 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:38:25.389 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:38:25.460 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:38:25.506 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:38:25.703 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:38:25.783 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:38:25.962 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:38:26.017 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:38:26.213 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:38:26.260 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:38:26.386 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:38:26.464 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:38:26.696 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:38:26.740 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:38:26.866 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:38:26.956 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:38:27.142 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:38:27.232 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:38:27.268 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:38:27.458 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:38:27.553 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:38:27.700 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:38:27.854 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:38:27.960 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:38:28.086 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:38:28.105 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:38:28.230 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:38:28.356 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:38:28.378 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:38:28.447 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:38:28.505 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:38:28.675 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:38:28.801 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:38:28.806 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:38:29.082 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:38:29.317 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:38:29.426 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:38:29.552 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:38:29.555 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:38:29.642 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:38:29.811 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:38:29.888 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:38:29.962 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:38:30.013 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:38:30.222 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:38:30.347 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:38:30.398 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:38:30.641 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:38:30.665 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:38:30.767 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:38:30.983 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:38:31.035 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:38:31.161 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:38:31.259 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:38:31.385 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:38:31.470 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:38:31.653 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:38:31.779 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:38:31.929 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:38:32.064 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:38:32.165 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:38:32.282 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:38:32.416 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:38:32.650 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:38:32.667 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:38:32.935 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:38:33.021 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:38:33.271 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:38:33.397 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:33.397 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:38:33.522 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:33.657 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:38:33.665 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:38:33.985 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:38:33.993 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:34.111 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:34.119 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:34.237 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:34.245 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:38:34.363 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:38:34.521 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:34.647 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:34.657 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:34.757 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:34.809 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:34.935 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:38:34.961 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:38:34.961 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:38:35.245 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:35.387 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:35.458 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:35.513 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:35.584 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:35.710 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:35.727 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:38:35.727 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:38:35.852 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:38:36.198 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:36.299 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:36.400 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:36.509 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:38:37.064 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:37.199 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:37.325 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:37.442 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:37.560 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:37.713 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:37.848 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:37.949 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:38.050 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:38.068 INFO:teuthology.orchestra.run.smithi190.stdout:Adding group ceph....done 2024-09-12T17:38:38.151 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:38.412 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user ceph....done 2024-09-12T17:38:38.582 INFO:teuthology.orchestra.run.smithi190.stdout:Setting system user ceph properties....done 2024-09-12T17:38:38.596 INFO:teuthology.orchestra.run.smithi190.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:38:38.702 INFO:teuthology.orchestra.run.smithi157.stdout:Adding group ceph....done 2024-09-12T17:38:38.731 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:38:39.028 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user ceph....done 2024-09-12T17:38:39.058 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:38:39.197 INFO:teuthology.orchestra.run.smithi157.stdout:Setting system user ceph properties....done 2024-09-12T17:38:39.216 INFO:teuthology.orchestra.run.smithi157.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:38:39.352 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:38:39.552 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:39.668 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:38:39.678 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:40.149 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:38:40.149 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:38:40.160 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:40.328 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:40.822 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:40.841 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:38:40.841 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:38:41.173 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:38:41.381 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:41.666 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:41.704 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:38:41.906 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:38:41.906 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:38:42.160 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:42.385 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:38:42.386 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:38:42.417 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:42.630 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:38:42.630 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:38:42.860 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:43.072 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:38:43.072 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:38:43.143 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:43.449 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:38:43.449 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:38:43.511 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:43.778 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:38:43.778 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:38:43.961 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:44.087 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:44.238 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:44.254 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:44.389 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:44.459 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:38:44.459 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:38:44.523 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:44.719 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:38:44.719 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:38:45.194 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:45.420 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:45.441 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:45.546 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:45.688 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:45.777 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:45.903 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:46.033 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:38:46.048 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:38:46.142 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:38:46.286 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:38:46.399 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:38:46.499 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:38:46.652 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:38:47.345 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:38:47.836 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:38:47.995 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:38:47.998 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T17:38:48.053 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-12T17:38:48.249 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-09-12T17:38:48.249 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-09-12T17:38:48.429 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:38:48.429 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:38:48.430 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:38:48.430 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:38:48.430 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:38:48.430 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:38:48.430 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:38:48.431 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-09-12T17:38:48.431 INFO:teuthology.orchestra.run.smithi190.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:38:48.431 INFO:teuthology.orchestra.run.smithi190.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:38:48.431 INFO:teuthology.orchestra.run.smithi190.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:38:48.432 INFO:teuthology.orchestra.run.smithi190.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:38:48.432 INFO:teuthology.orchestra.run.smithi190.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:38:48.432 INFO:teuthology.orchestra.run.smithi190.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:38:48.432 INFO:teuthology.orchestra.run.smithi190.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:38:48.432 INFO:teuthology.orchestra.run.smithi190.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:38:48.432 INFO:teuthology.orchestra.run.smithi190.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:38:48.432 INFO:teuthology.orchestra.run.smithi190.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:38:48.432 INFO:teuthology.orchestra.run.smithi190.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T17:38:48.433 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-09-12T17:38:48.433 INFO:teuthology.orchestra.run.smithi190.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T17:38:48.433 INFO:teuthology.orchestra.run.smithi190.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T17:38:48.433 INFO:teuthology.orchestra.run.smithi190.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T17:38:48.433 INFO:teuthology.orchestra.run.smithi190.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T17:38:48.433 INFO:teuthology.orchestra.run.smithi190.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T17:38:48.472 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-09-12T17:38:48.472 INFO:teuthology.orchestra.run.smithi190.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:38:48.472 INFO:teuthology.orchestra.run.smithi190.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:38:48.472 INFO:teuthology.orchestra.run.smithi190.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:38:48.472 INFO:teuthology.orchestra.run.smithi190.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:38:48.472 INFO:teuthology.orchestra.run.smithi190.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:38:48.473 INFO:teuthology.orchestra.run.smithi190.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:38:48.473 INFO:teuthology.orchestra.run.smithi190.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:38:48.473 INFO:teuthology.orchestra.run.smithi190.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:38:48.473 INFO:teuthology.orchestra.run.smithi190.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:38:48.473 INFO:teuthology.orchestra.run.smithi190.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:38:48.474 INFO:teuthology.orchestra.run.smithi190.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T17:38:48.474 INFO:teuthology.orchestra.run.smithi190.stdout: s3cmd 2024-09-12T17:38:48.498 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:38:48.501 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T17:38:48.557 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-12T17:38:48.654 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:38:48.655 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 10.4 MB of archives. 2024-09-12T17:38:48.655 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T17:38:48.655 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T17:38:48.737 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T17:38:48.737 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T17:38:48.745 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-12T17:38:48.745 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-12T17:38:48.754 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T17:38:48.920 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T17:38:48.924 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:38:48.924 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:38:48.924 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:38:48.924 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:38:48.925 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:38:48.925 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:38:48.925 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:38:48.927 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-09-12T17:38:48.927 INFO:teuthology.orchestra.run.smithi157.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:38:48.927 INFO:teuthology.orchestra.run.smithi157.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:38:48.927 INFO:teuthology.orchestra.run.smithi157.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:38:48.927 INFO:teuthology.orchestra.run.smithi157.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:38:48.927 INFO:teuthology.orchestra.run.smithi157.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:38:48.927 INFO:teuthology.orchestra.run.smithi157.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:38:48.927 INFO:teuthology.orchestra.run.smithi157.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:38:48.927 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:38:48.927 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:38:48.928 INFO:teuthology.orchestra.run.smithi157.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:38:48.928 INFO:teuthology.orchestra.run.smithi157.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T17:38:48.928 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-09-12T17:38:48.928 INFO:teuthology.orchestra.run.smithi157.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T17:38:48.928 INFO:teuthology.orchestra.run.smithi157.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T17:38:48.928 INFO:teuthology.orchestra.run.smithi157.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T17:38:48.928 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T17:38:48.928 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T17:38:48.968 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-09-12T17:38:48.968 INFO:teuthology.orchestra.run.smithi157.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:38:48.968 INFO:teuthology.orchestra.run.smithi157.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:38:48.968 INFO:teuthology.orchestra.run.smithi157.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:38:48.968 INFO:teuthology.orchestra.run.smithi157.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:38:48.968 INFO:teuthology.orchestra.run.smithi157.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:38:48.968 INFO:teuthology.orchestra.run.smithi157.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:38:48.968 INFO:teuthology.orchestra.run.smithi157.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:38:48.968 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:38:48.969 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:38:48.969 INFO:teuthology.orchestra.run.smithi157.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:38:48.969 INFO:teuthology.orchestra.run.smithi157.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T17:38:48.969 INFO:teuthology.orchestra.run.smithi157.stdout: s3cmd 2024-09-12T17:38:48.989 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T17:38:48.997 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T17:38:49.021 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:38:49.021 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 10.4 MB of archives. 2024-09-12T17:38:49.022 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T17:38:49.022 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T17:38:49.039 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T17:38:49.039 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T17:38:49.043 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T17:38:49.078 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T17:38:49.093 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T17:38:49.095 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T17:38:49.125 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T17:38:49.132 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T17:38:49.146 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T17:38:49.147 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T17:38:49.148 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T17:38:49.195 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T17:38:49.195 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T17:38:49.213 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T17:38:49.213 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T17:38:49.214 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T17:38:49.215 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T17:38:49.215 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T17:38:49.218 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T17:38:49.218 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T17:38:49.224 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T17:38:49.227 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T17:38:49.228 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T17:38:49.232 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T17:38:49.243 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T17:38:49.243 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T17:38:49.244 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T17:38:49.244 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T17:38:49.245 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T17:38:49.245 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T17:38:49.247 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T17:38:49.250 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T17:38:49.265 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T17:38:49.280 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T17:38:49.280 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T17:38:49.297 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T17:38:49.297 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T17:38:49.297 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T17:38:49.381 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T17:38:49.382 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T17:38:49.423 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T17:38:49.424 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T17:38:49.425 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T17:38:49.427 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T17:38:49.427 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T17:38:49.433 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T17:38:49.434 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T17:38:49.477 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T17:38:49.479 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T17:38:49.531 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T17:38:49.533 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T17:38:49.533 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T17:38:49.536 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T17:38:49.537 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T17:38:49.558 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T17:38:49.567 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T17:38:49.573 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T17:38:49.640 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T17:38:49.640 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T17:38:49.671 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T17:38:49.672 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T17:38:49.672 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T17:38:49.732 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 10.4 MB in 0s (32.3 MB/s) 2024-09-12T17:38:49.826 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T17:38:49.887 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T17:38:49.892 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T17:38:49.942 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T17:38:50.118 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 10.4 MB in 1s (8,697 kB/s) 2024-09-12T17:38:50.199 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T17:38:50.228 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T17:38:50.244 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T17:38:50.275 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T17:38:50.280 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T17:38:50.286 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:38:50.323 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T17:38:50.530 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T17:38:50.547 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T17:38:50.559 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T17:38:50.581 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:38:50.587 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T17:38:50.667 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:38:50.920 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T17:38:50.936 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T17:38:50.978 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:38:51.171 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T17:38:51.199 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T17:38:51.213 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T17:38:51.230 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T17:38:51.237 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T17:38:51.280 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T17:38:51.506 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T17:38:51.523 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T17:38:51.524 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T17:38:51.552 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T17:38:51.556 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T17:38:51.591 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T17:38:51.810 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T17:38:51.817 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T17:38:51.826 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T17:38:51.833 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T17:38:51.876 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T17:38:51.893 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T17:38:52.111 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T17:38:52.127 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T17:38:52.145 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T17:38:52.161 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T17:38:52.169 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T17:38:52.204 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T17:38:52.422 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T17:38:52.439 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T17:38:52.456 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T17:38:52.481 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T17:38:52.485 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T17:38:52.523 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T17:38:52.783 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T17:38:52.799 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T17:38:52.818 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T17:38:52.842 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:38:52.845 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T17:38:52.884 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:38:53.094 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T17:38:53.102 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T17:38:53.110 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T17:38:53.119 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T17:38:53.152 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:38:53.186 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:38:53.389 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libguava-java. 2024-09-12T17:38:53.417 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T17:38:53.447 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libguava-java. 2024-09-12T17:38:53.455 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T17:38:53.463 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T17:38:53.505 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T17:38:53.866 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T17:38:53.893 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T17:38:53.899 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T17:38:53.916 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T17:38:53.950 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T17:38:53.957 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T17:38:54.176 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libguice-java. 2024-09-12T17:38:54.185 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libguice-java. 2024-09-12T17:38:54.194 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T17:38:54.213 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T17:38:54.226 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T17:38:54.252 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T17:38:54.597 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T17:38:54.605 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T17:38:54.621 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T17:38:54.625 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T17:38:54.663 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:38:54.664 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:38:54.916 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T17:38:54.925 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T17:38:54.932 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T17:38:54.953 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T17:38:54.974 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T17:38:54.991 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T17:38:55.227 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T17:38:55.244 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T17:38:55.252 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T17:38:55.280 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T17:38:55.285 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T17:38:55.318 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T17:38:55.513 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T17:38:55.529 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T17:38:55.546 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T17:38:55.563 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T17:38:55.574 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T17:38:55.612 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T17:38:55.815 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T17:38:55.831 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T17:38:55.865 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T17:38:55.873 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:38:55.892 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T17:38:55.931 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:38:56.159 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T17:38:56.176 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T17:38:56.200 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T17:38:56.217 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T17:38:56.217 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:38:56.259 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:38:56.487 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T17:38:56.503 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T17:38:56.536 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T17:38:56.537 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:38:56.565 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T17:38:56.603 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:38:56.807 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T17:38:56.824 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T17:38:56.865 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T17:38:56.866 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:38:56.882 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T17:38:56.923 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:38:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T17:38:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T17:38:57.184 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T17:38:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T17:38:57.212 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T17:38:57.251 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T17:38:57.429 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T17:38:57.457 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T17:38:57.496 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:38:57.503 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T17:38:57.520 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T17:38:57.561 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:38:57.740 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T17:38:57.756 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T17:38:57.807 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:38:57.814 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T17:38:57.842 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T17:38:57.880 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:38:58.059 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T17:38:58.076 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T17:38:58.108 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T17:38:58.117 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:38:58.136 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T17:38:58.174 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:38:58.353 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T17:38:58.370 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T17:38:58.403 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:38:58.435 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T17:38:58.451 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T17:38:58.493 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:38:58.656 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T17:38:58.672 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T17:38:58.722 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T17:38:58.745 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T17:38:58.762 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T17:38:58.804 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T17:38:59.043 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T17:38:59.043 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T17:38:59.059 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T17:38:59.060 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T17:38:59.101 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:38:59.109 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:38:59.387 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T17:38:59.403 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T17:38:59.412 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T17:38:59.429 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T17:38:59.445 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:38:59.471 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:38:59.698 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T17:38:59.715 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T17:38:59.740 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T17:38:59.756 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:38:59.756 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T17:38:59.798 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:39:00.169 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T17:39:00.185 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T17:39:00.186 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T17:39:00.202 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T17:39:00.227 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T17:39:00.244 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T17:39:00.454 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T17:39:00.483 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T17:39:00.497 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T17:39:00.521 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:39:00.525 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T17:39:00.563 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:39:00.975 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package maven. 2024-09-12T17:39:00.982 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package maven. 2024-09-12T17:39:01.003 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T17:39:01.010 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T17:39:01.041 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T17:39:01.048 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T17:39:01.373 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-magic. 2024-09-12T17:39:01.377 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-magic. 2024-09-12T17:39:01.398 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T17:39:01.405 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T17:39:01.436 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T17:39:01.443 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T17:39:01.713 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package s3cmd. 2024-09-12T17:39:01.741 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T17:39:01.764 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package s3cmd. 2024-09-12T17:39:01.771 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T17:39:01.792 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T17:39:01.830 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T17:39:02.116 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T17:39:02.210 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T17:39:02.243 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:39:02.319 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:39:02.420 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:39:02.494 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:39:02.521 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:39:02.620 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T17:39:02.647 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T17:39:02.763 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T17:39:02.773 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T17:39:02.889 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:39:02.899 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:39:03.015 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T17:39:03.034 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T17:39:03.160 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:39:03.165 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:39:03.266 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:39:03.285 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:39:03.395 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T17:39:03.401 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T17:39:03.496 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:39:03.527 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:39:03.597 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:39:03.653 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:39:03.723 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:39:03.778 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:39:03.849 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:39:03.904 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:39:03.983 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T17:39:04.030 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T17:39:04.243 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T17:39:04.290 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T17:39:04.369 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:39:04.416 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:39:04.495 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:39:04.542 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:39:04.621 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T17:39:04.660 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T17:39:04.747 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T17:39:04.785 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T17:39:04.856 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:39:04.911 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:39:04.957 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T17:39:05.037 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T17:39:05.250 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:39:05.338 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:39:05.376 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:39:05.489 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:39:05.527 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T17:39:05.607 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T17:39:05.653 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T17:39:05.725 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T17:39:05.779 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T17:39:05.842 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T17:39:05.905 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T17:39:05.968 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T17:39:06.014 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T17:39:06.094 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T17:39:06.124 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T17:39:06.220 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T17:39:06.242 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T17:39:06.346 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T17:39:06.368 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:39:06.489 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:39:06.594 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:39:06.614 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:39:06.732 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T17:39:06.820 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T17:39:06.956 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T17:39:07.028 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:39:07.076 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T17:39:07.141 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:39:08.370 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:39:08.376 DEBUG:teuthology.parallel:result is None 2024-09-12T17:39:08.467 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:39:08.471 DEBUG:teuthology.parallel:result is None 2024-09-12T17:39:08.472 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:39:08.628 DEBUG:teuthology.orchestra.run.smithi157:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:39:08.647 INFO:teuthology.orchestra.run.smithi157.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:39:08.648 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:39:08.648 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:39:08.650 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:39:08.791 DEBUG:teuthology.orchestra.run.smithi190:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:39:08.810 INFO:teuthology.orchestra.run.smithi190.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:39:08.810 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:39:08.810 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:39:08.812 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:39:08.813 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:08.813 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:39:08.827 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:08.827 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:39:08.866 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:39:08.866 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:08.867 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:39:08.882 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:39:08.940 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:08.940 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:39:08.952 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:39:09.005 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:39:09.005 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:09.005 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:39:09.018 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:39:09.074 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:09.074 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:39:09.087 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:39:09.141 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:39:09.141 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:09.142 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:39:09.155 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:39:09.210 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:09.210 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:39:09.223 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:39:09.277 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:39:09.366 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:39:09.367 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2024-09-12T17:39:09.369 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2024-09-12T17:39:09.382 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:39:09.382 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:39:09.424 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:39:09.437 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:39:09.437 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:39:09.480 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:39:09.504 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:39:09.504 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:39:09.504 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7902746', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOTRWiPKMRQMsbNjeZSS15eA7Plmd5HhoqL4/seJpO/B6wyk3TbD+52UjJtckuIQPjtBaSuzF6KQgQW4LqoUyFY=', 'smithi190.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEm23VdnwGX4QpC0Oa/oHvOuvNHSZpsHEtnWxXRgVuR1jdvTYkdN30edmV3x2wmeru3soEQNVOCaOOpTpS1ImuQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:39:09.505 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:39:09.535 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:39:09.542 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:39:09.583 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:39:09.598 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:09.598 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:39:09.642 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:39:09.643 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-09-12T17:39:09.691 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:39:09.691 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:39:09.691 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-09-12T17:39:09.691 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:39:09.691 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-12 17:33:22.640277166 +0000 2024-09-12T17:39:09.691 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-12 17:33:22.396279344 +0000 2024-09-12T17:39:09.691 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-12 17:33:22.396279344 +0000 2024-09-12T17:39:09.692 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-12T17:39:09.692 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:39:09.745 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-12T17:39:09.745 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-12T17:39:09.746 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000313614 s, 1.6 MB/s 2024-09-12T17:39:09.746 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:39:09.801 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-09-12T17:39:09.850 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:39:09.850 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:39:09.850 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-09-12T17:39:09.850 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:39:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-12 17:33:23.128272806 +0000 2024-09-12T17:39:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-12 17:33:22.856275236 +0000 2024-09-12T17:39:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-12 17:33:22.856275236 +0000 2024-09-12T17:39:09.851 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-12T17:39:09.851 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:39:09.909 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-12T17:39:09.909 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-12T17:39:09.909 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000330328 s, 1.5 MB/s 2024-09-12T17:39:09.910 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:39:09.960 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-09-12T17:39:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:39:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:39:10.006 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-12T17:39:10.006 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:39:10.006 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-12 17:33:23.672267948 +0000 2024-09-12T17:39:10.007 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-12 17:33:23.356270770 +0000 2024-09-12T17:39:10.007 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-12 17:33:23.356270770 +0000 2024-09-12T17:39:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-12T17:39:10.007 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:39:10.061 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-12T17:39:10.061 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-12T17:39:10.061 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.0002893 s, 1.8 MB/s 2024-09-12T17:39:10.062 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:39:10.112 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-09-12T17:39:10.159 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:39:10.159 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:39:10.159 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-09-12T17:39:10.159 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:39:10.159 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-12 17:33:24.172263481 +0000 2024-09-12T17:39:10.159 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-12 17:33:23.892265983 +0000 2024-09-12T17:39:10.159 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-12 17:33:23.892265983 +0000 2024-09-12T17:39:10.159 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-12T17:39:10.159 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:39:10.214 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-12T17:39:10.214 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-12T17:39:10.214 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.00025617 s, 2.0 MB/s 2024-09-12T17:39:10.215 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:39:10.263 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:39:10.264 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:10.264 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:39:10.270 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:39:10.270 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2024-09-12T17:39:10.319 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:39:10.319 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:39:10.319 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-12T17:39:10.319 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:39:10.320 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-12 17:33:21.126436808 +0000 2024-09-12T17:39:10.320 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-12 17:33:20.886438949 +0000 2024-09-12T17:39:10.320 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-12 17:33:20.886438949 +0000 2024-09-12T17:39:10.320 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-12T17:39:10.320 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:39:10.373 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-12T17:39:10.373 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-12T17:39:10.373 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000374056 s, 1.4 MB/s 2024-09-12T17:39:10.375 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:39:10.424 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2024-09-12T17:39:10.470 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:39:10.471 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:39:10.471 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-09-12T17:39:10.471 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:39:10.471 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-12 17:33:21.654432096 +0000 2024-09-12T17:39:10.471 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-12 17:33:21.394434416 +0000 2024-09-12T17:39:10.471 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-12 17:33:21.394434416 +0000 2024-09-12T17:39:10.471 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-12T17:39:10.471 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:39:10.524 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-12T17:39:10.525 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-12T17:39:10.525 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000418726 s, 1.2 MB/s 2024-09-12T17:39:10.526 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:39:10.576 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2024-09-12T17:39:10.622 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:39:10.622 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:39:10.622 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-09-12T17:39:10.623 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:39:10.623 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-12 17:33:22.130427848 +0000 2024-09-12T17:39:10.623 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-12 17:33:21.890429989 +0000 2024-09-12T17:39:10.623 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-12 17:33:21.890429989 +0000 2024-09-12T17:39:10.623 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-12T17:39:10.623 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:39:10.677 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-12T17:39:10.677 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-12T17:39:10.677 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000428222 s, 1.2 MB/s 2024-09-12T17:39:10.678 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:39:10.727 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2024-09-12T17:39:10.774 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:39:10.774 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:39:10.774 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-09-12T17:39:10.774 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:39:10.774 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-12 17:33:22.586423778 +0000 2024-09-12T17:39:10.774 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-12 17:33:22.342425956 +0000 2024-09-12T17:39:10.774 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-12 17:33:22.342425956 +0000 2024-09-12T17:39:10.774 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-12T17:39:10.775 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:39:10.829 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-12T17:39:10.829 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-12T17:39:10.829 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000385984 s, 1.3 MB/s 2024-09-12T17:39:10.830 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:39:10.879 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:39:10.880 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:39:10.880 INFO:tasks.ceph:Generating config... 2024-09-12T17:39:10.881 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T17:39:10.881 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T17:39:10.881 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T17:39:10.881 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T17:39:10.881 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T17:39:10.882 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:39:10.882 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T17:39:10.882 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T17:39:10.882 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T17:39:10.882 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T17:39:10.882 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T17:39:10.882 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T17:39:10.882 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T17:39:10.882 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T17:39:10.882 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T17:39:10.882 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T17:39:10.882 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T17:39:10.882 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T17:39:10.883 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-12T17:39:10.883 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:39:10.883 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:39:10.883 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:39:10.883 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:39:10.883 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:39:10.883 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T17:39:10.883 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:39:10.883 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:39:10.883 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:39:10.883 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:39:10.883 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:39:10.883 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:39:10.884 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T17:39:10.885 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:39:10.885 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:39:10.918 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:39:10.945 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:39:11.022 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:39:11.078 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.157'), ('mon.c', '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]'), ('mon.b', '172.21.15.190')] 2024-09-12T17:39:11.079 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790],172.21.15.190', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T17:39:11.079 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:11.080 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:39:11.127 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.157 --addv c '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]' --add b 172.21.15.190 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:11.217 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:11.217 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: generated fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T17:39:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:setting min_mon_release = quincy 2024-09-12T17:39:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 0 2024-09-12T17:39:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T17:39:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T17:39:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-09-12T17:39:11.218869+0000 2024-09-12T17:39:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:min_mon_release 17 (quincy) 2024-09-12T17:39:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:election_strategy: 1 2024-09-12T17:39:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T17:39:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T17:39:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T17:39:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T17:39:11.220 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:39:11.266 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 634e9294-a45c-40c3-b542-a6fcc3acc794... 2024-09-12T17:39:11.267 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:39:11.311 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:39:11.343 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2024-09-12T17:39:11.343 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2024-09-12T17:39:11.343 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:39:11.343 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.344 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2024-09-12T17:39:11.345 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2024-09-12T17:39:11.347 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2024-09-12T17:39:11.347 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2024-09-12T17:39:11.347 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790],172.21.15.190" 2024-09-12T17:39:11.347 INFO:teuthology.orchestra.run.smithi157.stdout: mon client directed command retry = 5 2024-09-12T17:39:11.347 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject socket failures = 5000 2024-09-12T17:39:11.347 INFO:teuthology.orchestra.run.smithi157.stdout: osd heartbeat grace = 40 2024-09-12T17:39:11.347 INFO:teuthology.orchestra.run.smithi157.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:39:11.347 INFO:teuthology.orchestra.run.smithi157.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:39:11.347 INFO:teuthology.orchestra.run.smithi157.stdout: rgw override bucket index max shards = 1 2024-09-12T17:39:11.347 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T17:39:11.347 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2024-09-12T17:39:11.348 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug trim objects = true 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.349 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:39:11.350 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2024-09-12T17:39:11.350 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.350 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2024-09-12T17:39:11.350 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2024-09-12T17:39:11.350 INFO:teuthology.orchestra.run.smithi157.stdout: bdev async discard = True 2024-09-12T17:39:11.350 INFO:teuthology.orchestra.run.smithi157.stdout: bdev enable discard = True 2024-09-12T17:39:11.350 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore allocator = bitmap 2024-09-12T17:39:11.350 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2024-09-12T17:39:11.350 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2024-09-12T17:39:11.350 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 1/20 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 1/20 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: debug objclass = 20 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 4/10 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: osd fast shutdown = False 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: osd shutdown pgref assert = True 2024-09-12T17:39:11.351 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.352 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2024-09-12T17:39:11.352 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-09-12T17:39:11.352 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2024-09-12T17:39:11.352 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-09-12T17:39:11.352 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-09-12T17:39:11.352 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:39:11.352 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:39:11.352 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2024-09-12T17:39:11.352 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.352 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:39:11.353 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd crush smoke test = False 2024-09-12T17:39:11.354 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: debug rgw = 20 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: debug rgw notification = 20 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: rgw bucket counters cache = True 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: rgw crypt require ssl = False 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:39:11.355 INFO:teuthology.orchestra.run.smithi157.stdout: rgw s3 auth use sts = True 2024-09-12T17:39:11.356 INFO:teuthology.orchestra.run.smithi157.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:39:11.356 INFO:teuthology.orchestra.run.smithi157.stdout: rgw torrent flag = True 2024-09-12T17:39:11.356 INFO:teuthology.orchestra.run.smithi157.stdout: rgw user counters cache = True 2024-09-12T17:39:11.356 INFO:teuthology.orchestra.run.smithi157.stdout: setgroup = ceph 2024-09-12T17:39:11.356 INFO:teuthology.orchestra.run.smithi157.stdout: setuser = ceph 2024-09-12T17:39:11.356 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2024-09-12T17:39:11.356 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2024-09-12T17:39:11.356 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2024-09-12T17:39:11.358 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2024-09-12T17:39:11.358 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2024-09-12T17:39:11.358 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:39:11.358 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2024-09-12T17:39:11.358 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.358 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2024-09-12T17:39:11.358 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:39:11.359 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:39:11.360 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790],172.21.15.190" 2024-09-12T17:39:11.361 INFO:teuthology.orchestra.run.smithi190.stdout: mon client directed command retry = 5 2024-09-12T17:39:11.362 INFO:teuthology.orchestra.run.smithi190.stdout: ms inject socket failures = 5000 2024-09-12T17:39:11.362 INFO:teuthology.orchestra.run.smithi190.stdout: osd heartbeat grace = 40 2024-09-12T17:39:11.362 INFO:teuthology.orchestra.run.smithi190.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:39:11.362 INFO:teuthology.orchestra.run.smithi190.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:39:11.362 INFO:teuthology.orchestra.run.smithi190.stdout: rgw override bucket index max shards = 1 2024-09-12T17:39:11.362 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T17:39:11.362 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.362 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2024-09-12T17:39:11.362 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2024-09-12T17:39:11.362 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug trim objects = true 2024-09-12T17:39:11.363 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2024-09-12T17:39:11.364 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: bdev async discard = True 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: bdev enable discard = True 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore allocator = bitmap 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 1/20 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 1/20 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: debug objclass = 20 2024-09-12T17:39:11.365 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 4/10 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: osd fast shutdown = False 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: osd shutdown pgref assert = True 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2024-09-12T17:39:11.366 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2024-09-12T17:39:11.367 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.368 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd crush smoke test = False 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: debug rgw = 20 2024-09-12T17:39:11.369 INFO:teuthology.orchestra.run.smithi190.stdout: debug rgw notification = 20 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout: rgw bucket counters cache = True 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout: rgw crypt require ssl = False 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout: rgw s3 auth use sts = True 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout: rgw torrent flag = True 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout: rgw user counters cache = True 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout: setgroup = ceph 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout: setuser = ceph 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2024-09-12T17:39:11.370 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2024-09-12T17:39:11.371 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2024-09-12T17:39:11.371 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:39:11.371 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:39:11.450 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:39:11.450 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:11.450 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:39:11.456 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:11.456 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:39:11.503 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T17:39:11.503 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:11.503 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:39:11.503 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:39:11.567 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:11.567 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:11.618 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T17:39:11.618 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:11.619 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:39:11.619 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:39:11.642 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:11.642 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:11.695 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:39:11.695 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:39:11.695 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:39:11.739 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:39:11.742 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:39:11.786 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:39:11.796 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:39:11.797 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:39:11.797 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:39:11.830 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:39:11.841 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T17:39:11.876 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T17:39:11.887 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:39:11.887 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:39:11.887 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:39:11.900 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:39:11.901 INFO:tasks.ceph:role: osd.0 2024-09-12T17:39:11.901 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T17:39:11.901 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:39:11.955 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:39:11.955 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:39:11.955 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:39:11.955 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:39:11.955 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:39:11.955 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:39:11.955 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:39:11.955 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:39:11.955 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:39:11.955 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:39:11.979 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-09-12T17:39:11.981 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-09-12T17:39:11.981 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:39:12.038 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:39:12.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:39:12.091 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:39:12.092 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:39:12.145 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:39:12.145 INFO:tasks.ceph:role: osd.1 2024-09-12T17:39:12.146 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T17:39:12.146 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:39:12.206 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:39:12.206 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:39:12.206 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:39:12.206 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:39:12.207 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:39:12.207 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:39:12.207 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:39:12.207 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:39:12.207 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:39:12.207 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:39:12.230 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-09-12T17:39:12.232 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-09-12T17:39:12.232 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T17:39:12.289 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:39:12.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:39:12.343 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:39:12.343 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:39:12.397 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:39:12.397 INFO:tasks.ceph:role: osd.2 2024-09-12T17:39:12.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T17:39:12.398 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:39:12.453 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:39:12.453 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:39:12.453 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:39:12.453 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:39:12.453 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:39:12.453 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:39:12.453 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:39:12.453 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:39:12.453 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:39:12.453 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:39:12.477 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-09-12T17:39:12.478 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-09-12T17:39:12.478 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T17:39:12.542 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:39:12.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:39:12.597 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:39:12.601 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:39:12.649 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:39:12.649 INFO:tasks.ceph:role: osd.3 2024-09-12T17:39:12.649 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T17:39:12.649 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:39:12.702 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:39:12.702 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:39:12.702 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:39:12.702 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:39:12.702 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:39:12.702 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:39:12.702 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:39:12.703 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:39:12.703 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:39:12.703 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:39:12.726 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-09-12T17:39:12.728 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-09-12T17:39:12.728 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T17:39:12.785 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:39:12.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:39:12.837 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:39:12.837 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:12.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:12.939+0000 7fee091a37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:39:12.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:12.939+0000 7fee091a37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:39:12.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:12.943+0000 7fee091a37c0 -1 bdev(0x5649a7f75800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:39:12.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:12.943+0000 7fee091a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:39:16.075 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:39:16.088 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:16.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:16.163+0000 7f554db687c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:39:16.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:16.163+0000 7f554db687c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:39:16.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:16.163+0000 7f554db687c0 -1 bdev(0x5653caead800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:39:16.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:16.163+0000 7f554db687c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:39:19.305 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:39:19.368 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:19.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:19.455+0000 7fabe735b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:39:19.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:19.455+0000 7fabe735b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:39:19.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:19.455+0000 7fabe735b7c0 -1 bdev(0x55c748417800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:39:19.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:19.455+0000 7fabe735b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:39:22.600 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:39:22.655 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:22.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:22.731+0000 7febf22847c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:39:22.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:22.735+0000 7febf22847c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:39:22.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:22.735+0000 7febf22847c0 -1 bdev(0x556b0b06b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:39:22.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:39:22.735+0000 7febf22847c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:39:25.876 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:39:25.929 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T17:39:25.943 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:39:25.944 INFO:tasks.ceph:role: osd.4 2024-09-12T17:39:25.944 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T17:39:25.944 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:39:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:39:26.005 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:39:26.005 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:39:26.005 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:39:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:39:26.006 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:39:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:39:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:39:26.006 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:39:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:39:26.496 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-09-12T17:39:26.498 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-09-12T17:39:26.498 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T17:39:26.664 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T17:39:26.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:39:26.676 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:39:26.677 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T17:39:26.730 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:39:26.730 INFO:tasks.ceph:role: osd.5 2024-09-12T17:39:26.730 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T17:39:26.731 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:39:26.794 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:39:26.794 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:39:26.794 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:39:26.794 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:39:26.794 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:39:26.794 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:39:26.794 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:39:26.794 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:39:26.795 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:39:26.795 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:39:27.234 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-09-12T17:39:27.237 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-09-12T17:39:27.237 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T17:39:27.327 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T17:39:27.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:39:27.337 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:39:27.337 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T17:39:27.388 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:39:27.388 INFO:tasks.ceph:role: osd.6 2024-09-12T17:39:27.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T17:39:27.388 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:39:27.450 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:39:27.450 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:39:27.450 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:39:27.450 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:39:27.450 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:39:27.451 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:39:27.451 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:39:27.451 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:39:27.451 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:39:27.451 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:39:27.914 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-09-12T17:39:27.916 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-09-12T17:39:27.916 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T17:39:28.037 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T17:39:28.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:39:28.047 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:39:28.047 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T17:39:28.100 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:39:28.100 INFO:tasks.ceph:role: osd.7 2024-09-12T17:39:28.100 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T17:39:28.100 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:39:28.162 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:39:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:39:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:39:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:39:28.163 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:39:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:39:28.163 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:39:28.163 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:39:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:39:28.163 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:39:28.658 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-09-12T17:39:28.660 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-09-12T17:39:28.660 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T17:39:28.812 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T17:39:28.823 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:39:28.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:39:28.825 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:28.930 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:28.927+0000 7f26322e07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T17:39:28.933 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:28.927+0000 7f26322e07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T17:39:28.934 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:28.927+0000 7f26322e07c0 -1 bdev(0x560d63b77800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T17:39:28.934 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:28.931+0000 7f26322e07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T17:39:32.078 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T17:39:32.091 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:32.172 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:32.167+0000 7f22155587c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T17:39:32.173 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:32.167+0000 7f22155587c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T17:39:32.173 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:32.167+0000 7f22155587c0 -1 bdev(0x560ce208d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T17:39:32.173 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:32.167+0000 7f22155587c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T17:39:35.307 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T17:39:35.362 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:35.444 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:35.439+0000 7f52cd95f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T17:39:35.444 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:35.439+0000 7f52cd95f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T17:39:35.445 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:35.439+0000 7f52cd95f7c0 -1 bdev(0x560b83373800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T17:39:35.445 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:35.439+0000 7f52cd95f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T17:39:38.586 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T17:39:38.646 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:38.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:38.723+0000 7f836cf667c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T17:39:38.730 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:38.723+0000 7f836cf667c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T17:39:38.730 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:38.723+0000 7f836cf667c0 -1 bdev(0x5588f6175800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T17:39:38.730 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-12T17:39:38.727+0000 7f836cf667c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T17:39:41.896 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T17:39:41.951 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:39:41.951 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:41.951 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T17:39:41.966 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:41.966 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:39:42.023 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:42.023 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:39:42.077 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:42.078 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:39:42.133 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:42.133 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:39:42.189 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:42.190 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:39:42.204 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:42.204 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T17:39:42.259 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:42.259 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T17:39:42.318 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:42.318 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T17:39:42.373 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:42.373 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T17:39:42.429 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:42.429 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:39:42.435 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:42.435 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T17:39:42.478 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:39:42.479 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:39:42.482 DEBUG:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:39:42.524 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2024-09-12T17:39:42.525 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQA/J+NmckooLBAA7vFaIvoIOthHQuH9bW8N1w== 2024-09-12T17:39:42.525 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2024-09-12T17:39:42.525 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBAJ+NmRY90OBAADwAmua9yiuMoJ3cX+AGPBA== 2024-09-12T17:39:42.525 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2024-09-12T17:39:42.525 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBEJ+NmqkEpChAAhS/kh3AeWAHbO/dEwEEZBA== 2024-09-12T17:39:42.525 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2024-09-12T17:39:42.525 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBHJ+NmgUhtGxAADu2ecSDTz8C/HH6xPXt9+Q== 2024-09-12T17:39:42.525 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2024-09-12T17:39:42.525 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBKJ+NmldsRLBAA0j/ieC0NXUlV3d7inU0Ebg== 2024-09-12T17:39:42.525 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2024-09-12T17:39:42.525 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQA/J+NmuD7vLhAAeyspPbe+z+yO1lsSC8pSsQ== 2024-09-12T17:39:42.526 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2024-09-12T17:39:42.526 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBQJ+Nmwq2FNxAAsuFzO6tzrXBZpTFK8OJCjA== 2024-09-12T17:39:42.526 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2024-09-12T17:39:42.526 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBUJ+NmBdlaChAAYvs0eAgQXfVk4IWOa8LXLA== 2024-09-12T17:39:42.526 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2024-09-12T17:39:42.526 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBXJ+NmBJeQGhAAWv/mtX6jLd/xReiT8GFebg== 2024-09-12T17:39:42.526 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2024-09-12T17:39:42.526 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBaJ+NmtfSLKxAASZwWUBgWNjqebl7kOUDgMA== 2024-09-12T17:39:42.526 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2024-09-12T17:39:42.526 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQA/J+NmTf+XMRAAa4CRO3APLg1HBAlHnWai8Q== 2024-09-12T17:39:42.526 INFO:teuthology.orchestra.run.smithi157.stdout:[client.1] 2024-09-12T17:39:42.527 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQA/J+NmDu9JNBAALYlg+SWgrF5z7zkP5wLh2g== 2024-09-12T17:39:42.532 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA/J+NmckooLBAA7vFaIvoIOthHQuH9bW8N1w== 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBAJ+NmRY90OBAADwAmua9yiuMoJ3cX+AGPBA== 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBEJ+NmqkEpChAAhS/kh3AeWAHbO/dEwEEZBA== 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBHJ+NmgUhtGxAADu2ecSDTz8C/HH6xPXt9+Q== 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBKJ+NmldsRLBAA0j/ieC0NXUlV3d7inU0Ebg== 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA/J+NmuD7vLhAAeyspPbe+z+yO1lsSC8pSsQ== 2024-09-12T17:39:42.533 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2024-09-12T17:39:42.534 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBQJ+Nmwq2FNxAAsuFzO6tzrXBZpTFK8OJCjA== 2024-09-12T17:39:42.534 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2024-09-12T17:39:42.534 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBUJ+NmBdlaChAAYvs0eAgQXfVk4IWOa8LXLA== 2024-09-12T17:39:42.534 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2024-09-12T17:39:42.534 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBXJ+NmBJeQGhAAWv/mtX6jLd/xReiT8GFebg== 2024-09-12T17:39:42.534 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2024-09-12T17:39:42.534 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBaJ+NmtfSLKxAASZwWUBgWNjqebl7kOUDgMA== 2024-09-12T17:39:42.534 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2024-09-12T17:39:42.534 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA/J+NmTf+XMRAAa4CRO3APLg1HBAlHnWai8Q== 2024-09-12T17:39:42.534 INFO:teuthology.orchestra.run.smithi190.stdout:[client.1] 2024-09-12T17:39:42.534 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA/J+NmDu9JNBAALYlg+SWgrF5z7zkP5wLh2g== 2024-09-12T17:39:42.535 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:39:42.572 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:39:42.624 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:42.627 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:42.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:42.711 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:42.753 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:42.796 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:42.842 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:42.884 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:42.935 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:39:42.971 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:39:43.022 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:43.025 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:43.109 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:43.113 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:43.201 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:43.204 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:43.288 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:43.291 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:39:43.371 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:39:43.383 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:39:43.458 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:39:43.472 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:39:43.545 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:39:43.545 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:39:43.558 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:39:43.654 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:39:43.667 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T17:39:43.720 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:39:43.813 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T17:39:43.824 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T17:39:43.841 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:39:43.942 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T17:39:43.954 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:43.956 DEBUG:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:39:44.003 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:39:44.003 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:39:44.003 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:39:44.006 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:39:44.006 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T17:39:44.006 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T17:39:44.009 INFO:tasks.ceph.mon.c:Started 2024-09-12T17:39:44.009 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T17:39:44.009 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T17:39:44.048 INFO:tasks.ceph.mon.b:Started 2024-09-12T17:39:44.048 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:39:44.049 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T17:39:44.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T17:39:44.052 INFO:tasks.ceph.mgr.y:Started 2024-09-12T17:39:44.052 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:39:44.052 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:39:44.055 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:39:44.055 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:39:44.055 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:39:44.055 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:39:49.487 INFO:teuthology.orchestra.run.smithi157.stderr:adjusted tunables profile to default 2024-09-12T17:39:49.506 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:39:49.506 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:39:49.506 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:49.506 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:39:49.516 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:49.517 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:39:49.569 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:49.569 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:39:49.623 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:39:49.623 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:39:49.676 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:49.676 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T17:39:49.690 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:49.690 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T17:39:49.745 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:49.745 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T17:39:49.798 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-12T17:39:49.798 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T17:39:49.858 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 127eba9c-71ee-4e56-ad38-41e33131d3bc 0 2024-09-12T17:39:50.128 INFO:teuthology.orchestra.run.smithi190.stdout:0 2024-09-12T17:39:50.146 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 2614ac45-d4c7-4da5-9f21-da3980ec191e 1 2024-09-12T17:39:50.351 INFO:teuthology.orchestra.run.smithi190.stdout:1 2024-09-12T17:39:50.369 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 16bfeef6-4b24-4de6-ba35-92eb0fa56a0e 2 2024-09-12T17:39:50.627 INFO:teuthology.orchestra.run.smithi190.stdout:2 2024-09-12T17:39:50.648 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new da73acc4-b448-41f6-ab33-3a08c0ab7578 3 2024-09-12T17:39:50.837 INFO:teuthology.orchestra.run.smithi190.stdout:3 2024-09-12T17:39:50.854 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 081aabd0-3871-47e8-98da-8ded73a9cb8d 4 2024-09-12T17:39:51.049 INFO:teuthology.orchestra.run.smithi190.stdout:4 2024-09-12T17:39:51.065 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 0e43cc8f-ab71-4ffd-b644-fd357c3c32e4 5 2024-09-12T17:39:51.265 INFO:teuthology.orchestra.run.smithi190.stdout:5 2024-09-12T17:39:51.281 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 4abefff1-7456-497d-8d79-46f811031b1c 6 2024-09-12T17:39:51.479 INFO:teuthology.orchestra.run.smithi190.stdout:6 2024-09-12T17:39:51.495 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 36eb1495-cee5-41b2-9342-ccd37000b85d 7 2024-09-12T17:39:51.686 INFO:teuthology.orchestra.run.smithi190.stdout:7 2024-09-12T17:39:51.703 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:39:51.703 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:39:51.706 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:39:51.706 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:39:51.706 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:39:51.708 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:39:51.709 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:39:51.709 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:39:51.711 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:39:51.711 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:39:51.712 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:39:51.714 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:39:51.714 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T17:39:51.714 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T17:39:51.716 INFO:tasks.ceph.osd.4:Started 2024-09-12T17:39:51.717 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T17:39:51.717 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T17:39:51.719 INFO:tasks.ceph.osd.5:Started 2024-09-12T17:39:51.719 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T17:39:51.719 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T17:39:51.721 INFO:tasks.ceph.osd.6:Started 2024-09-12T17:39:51.721 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T17:39:51.721 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T17:39:51.723 INFO:tasks.ceph.osd.7:Started 2024-09-12T17:39:51.724 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:39:51.932 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:39:51.932 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":10,"fsid":"634e9294-a45c-40c3-b542-a6fcc3acc794","created":"2024-09-12T17:39:49.371481+0000","modified":"2024-09-12T17:39:51.684991+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:39:51.684991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"127eba9c-71ee-4e56-ad38-41e33131d3bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2614ac45-d4c7-4da5-9f21-da3980ec191e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"16bfeef6-4b24-4de6-ba35-92eb0fa56a0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"da73acc4-b448-41f6-ab33-3a08c0ab7578","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"081aabd0-3871-47e8-98da-8ded73a9cb8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e43cc8f-ab71-4ffd-b644-fd357c3c32e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4abefff1-7456-497d-8d79-46f811031b1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"36eb1495-cee5-41b2-9342-ccd37000b85d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:39:51.960 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:39:51.961 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:39:52.269 INFO:tasks.ceph.mgr.y.smithi157.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T17:39:52.269 INFO:tasks.ceph.mgr.y.smithi157.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T17:39:52.269 INFO:tasks.ceph.mgr.y.smithi157.stderr: from numpy import show_config as show_numpy_config 2024-09-12T17:39:52.429 INFO:tasks.ceph.mgr.x.smithi190.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T17:39:52.429 INFO:tasks.ceph.mgr.x.smithi190.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T17:39:52.429 INFO:tasks.ceph.mgr.x.smithi190.stderr: from numpy import show_config as show_numpy_config 2024-09-12T17:39:52.767 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:39:52.889 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-09-12T17:39:52.887+0000 7f95a93697c0 -1 Falling back to public interface 2024-09-12T17:39:52.961 INFO:teuthology.misc.health.smithi157.stdout: 2024-09-12T17:39:52.962 INFO:teuthology.misc.health.smithi157.stdout:{"epoch":10,"fsid":"634e9294-a45c-40c3-b542-a6fcc3acc794","created":"2024-09-12T17:39:49.371481+0000","modified":"2024-09-12T17:39:51.684991+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:39:51.684991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"127eba9c-71ee-4e56-ad38-41e33131d3bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2614ac45-d4c7-4da5-9f21-da3980ec191e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"16bfeef6-4b24-4de6-ba35-92eb0fa56a0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"da73acc4-b448-41f6-ab33-3a08c0ab7578","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"081aabd0-3871-47e8-98da-8ded73a9cb8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e43cc8f-ab71-4ffd-b644-fd357c3c32e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4abefff1-7456-497d-8d79-46f811031b1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"36eb1495-cee5-41b2-9342-ccd37000b85d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:39:52.977 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:39:53.167 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-09-12T17:39:53.167+0000 7f01673c67c0 -1 Falling back to public interface 2024-09-12T17:39:53.168 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-09-12T17:39:53.163+0000 7f4df95217c0 -1 Falling back to public interface 2024-09-12T17:39:53.194 INFO:tasks.ceph.osd.0.smithi157.stderr:2024-09-12T17:39:53.195+0000 7f194dca67c0 -1 Falling back to public interface 2024-09-12T17:39:53.195 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-09-12T17:39:53.195+0000 7f2e251447c0 -1 Falling back to public interface 2024-09-12T17:39:53.327 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-09-12T17:39:53.323+0000 7f15c1de57c0 -1 Falling back to public interface 2024-09-12T17:39:53.375 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-09-12T17:39:53.371+0000 7f7acce7f7c0 -1 Falling back to public interface 2024-09-12T17:39:53.599 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-09-12T17:39:53.595+0000 7f5d1bf7a7c0 -1 Falling back to public interface 2024-09-12T17:39:55.185 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-09-12T17:39:55.183+0000 7f9442f98640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T17:39:55.186 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-09-12T17:39:55.187+0000 7f9442f98640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T17:39:56.919 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-09-12T17:39:56.919+0000 7f95a93697c0 -1 osd.2 0 log_to_monitors true 2024-09-12T17:39:57.261 INFO:tasks.ceph.osd.0.smithi157.stderr:2024-09-12T17:39:57.259+0000 7f194dca67c0 -1 osd.0 0 log_to_monitors true 2024-09-12T17:39:57.277 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-09-12T17:39:57.271+0000 7f4df95217c0 -1 osd.5 0 log_to_monitors true 2024-09-12T17:39:57.557 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-09-12T17:39:57.551+0000 7f5d1bf7a7c0 -1 osd.7 0 log_to_monitors true 2024-09-12T17:39:57.558 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-09-12T17:39:57.559+0000 7f01673c67c0 -1 osd.3 0 log_to_monitors true 2024-09-12T17:39:57.621 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-09-12T17:39:57.611+0000 7f2e251447c0 -1 osd.1 0 log_to_monitors true 2024-09-12T17:39:57.633 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-09-12T17:39:57.615+0000 7f15c1de57c0 -1 osd.6 0 log_to_monitors true 2024-09-12T17:39:57.738 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-09-12T17:39:57.735+0000 7f7acce7f7c0 -1 osd.4 0 log_to_monitors true 2024-09-12T17:39:58.999 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-09-12T17:39:58.999+0000 7f95a5312640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:39:59.018 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-09-12T17:39:59.019+0000 7f959d144640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:39:59.783 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:40:00.293 INFO:teuthology.misc.health.smithi157.stdout: 2024-09-12T17:40:00.294 INFO:teuthology.misc.health.smithi157.stdout:{"epoch":13,"fsid":"634e9294-a45c-40c3-b542-a6fcc3acc794","created":"2024-09-12T17:39:49.371481+0000","modified":"2024-09-12T17:39:59.186868+0000","last_up_change":"2024-09-12T17:39:59.186868+0000","last_in_change":"2024-09-12T17:39:51.684991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"127eba9c-71ee-4e56-ad38-41e33131d3bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2614ac45-d4c7-4da5-9f21-da3980ec191e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"16bfeef6-4b24-4de6-ba35-92eb0fa56a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6801","nonce":2182114182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6803","nonce":2182114182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6807","nonce":2182114182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6805","nonce":2182114182}]},"public_addr":"172.21.15.157:6801/2182114182","cluster_addr":"172.21.15.157:6803/2182114182","heartbeat_back_addr":"172.21.15.157:6807/2182114182","heartbeat_front_addr":"172.21.15.157:6805/2182114182","state":["exists","up"]},{"osd":3,"uuid":"da73acc4-b448-41f6-ab33-3a08c0ab7578","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"081aabd0-3871-47e8-98da-8ded73a9cb8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e43cc8f-ab71-4ffd-b644-fd357c3c32e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4abefff1-7456-497d-8d79-46f811031b1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"36eb1495-cee5-41b2-9342-ccd37000b85d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:40:00.324 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T17:40:00.518 INFO:tasks.ceph.osd.0.smithi157.stderr:2024-09-12T17:40:00.519+0000 7f1949c4f640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:40:00.550 INFO:tasks.ceph.osd.0.smithi157.stderr:2024-09-12T17:40:00.551+0000 7f1941a81640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:40:00.553 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-09-12T17:40:00.555+0000 7f016336f640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:40:00.554 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-09-12T17:40:00.555+0000 7f2e210ed640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:40:00.574 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-09-12T17:40:00.575+0000 7f015b1a1640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:40:00.574 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-09-12T17:40:00.575+0000 7f2e18f1f640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:40:01.339 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-09-12T17:40:01.335+0000 7f5d18735640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T17:40:01.366 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-09-12T17:40:01.363+0000 7f5d0fd55640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:40:01.369 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-09-12T17:40:01.367+0000 7f7ac8e28640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T17:40:01.383 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-09-12T17:40:01.379+0000 7f15bdd8e640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T17:40:01.410 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-09-12T17:40:01.407+0000 7f7ac0c5a640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:40:01.418 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-09-12T17:40:01.415+0000 7f15b5bc0640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:40:01.427 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-09-12T17:40:01.423+0000 7f4df5cdc640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T17:40:01.470 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-09-12T17:40:01.471+0000 7f4ded2fc640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:40:07.133 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:40:07.440 INFO:teuthology.misc.health.smithi157.stdout: 2024-09-12T17:40:07.440 INFO:teuthology.misc.health.smithi157.stdout:{"epoch":18,"fsid":"634e9294-a45c-40c3-b542-a6fcc3acc794","created":"2024-09-12T17:39:49.371481+0000","modified":"2024-09-12T17:40:04.625542+0000","last_up_change":"2024-09-12T17:40:01.612523+0000","last_in_change":"2024-09-12T17:39:51.684991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:40:02.208651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"127eba9c-71ee-4e56-ad38-41e33131d3bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6817","nonce":2202738069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6819","nonce":2202738069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6825","nonce":2202738069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6822","nonce":2202738069}]},"public_addr":"172.21.15.157:6817/2202738069","cluster_addr":"172.21.15.157:6819/2202738069","heartbeat_back_addr":"172.21.15.157:6825/2202738069","heartbeat_front_addr":"172.21.15.157:6822/2202738069","state":["exists","up"]},{"osd":1,"uuid":"2614ac45-d4c7-4da5-9f21-da3980ec191e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6823","nonce":3908026248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6827","nonce":3908026248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6831","nonce":3908026248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6829","nonce":3908026248}]},"public_addr":"172.21.15.157:6823/3908026248","cluster_addr":"172.21.15.157:6827/3908026248","heartbeat_back_addr":"172.21.15.157:6831/3908026248","heartbeat_front_addr":"172.21.15.157:6829/3908026248","state":["exists","up"]},{"osd":2,"uuid":"16bfeef6-4b24-4de6-ba35-92eb0fa56a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6801","nonce":2182114182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6803","nonce":2182114182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6807","nonce":2182114182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6805","nonce":2182114182}]},"public_addr":"172.21.15.157:6801/2182114182","cluster_addr":"172.21.15.157:6803/2182114182","heartbeat_back_addr":"172.21.15.157:6807/2182114182","heartbeat_front_addr":"172.21.15.157:6805/2182114182","state":["exists","up"]},{"osd":3,"uuid":"da73acc4-b448-41f6-ab33-3a08c0ab7578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6809","nonce":3345787243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6811","nonce":3345787243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6815","nonce":3345787243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6813","nonce":3345787243}]},"public_addr":"172.21.15.157:6809/3345787243","cluster_addr":"172.21.15.157:6811/3345787243","heartbeat_back_addr":"172.21.15.157:6815/3345787243","heartbeat_front_addr":"172.21.15.157:6813/3345787243","state":["exists","up"]},{"osd":4,"uuid":"081aabd0-3871-47e8-98da-8ded73a9cb8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6817","nonce":2884135430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6819","nonce":2884135430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6823","nonce":2884135430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6821","nonce":2884135430}]},"public_addr":"172.21.15.190:6817/2884135430","cluster_addr":"172.21.15.190:6819/2884135430","heartbeat_back_addr":"172.21.15.190:6823/2884135430","heartbeat_front_addr":"172.21.15.190:6821/2884135430","state":["exists","up"]},{"osd":5,"uuid":"0e43cc8f-ab71-4ffd-b644-fd357c3c32e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6801","nonce":962816639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6803","nonce":962816639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6807","nonce":962816639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6805","nonce":962816639}]},"public_addr":"172.21.15.190:6801/962816639","cluster_addr":"172.21.15.190:6803/962816639","heartbeat_back_addr":"172.21.15.190:6807/962816639","heartbeat_front_addr":"172.21.15.190:6805/962816639","state":["exists","up"]},{"osd":6,"uuid":"4abefff1-7456-497d-8d79-46f811031b1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6809","nonce":393781841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6811","nonce":393781841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6815","nonce":393781841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6813","nonce":393781841}]},"public_addr":"172.21.15.190:6809/393781841","cluster_addr":"172.21.15.190:6811/393781841","heartbeat_back_addr":"172.21.15.190:6815/393781841","heartbeat_front_addr":"172.21.15.190:6813/393781841","state":["exists","up"]},{"osd":7,"uuid":"36eb1495-cee5-41b2-9342-ccd37000b85d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6825","nonce":996962901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6827","nonce":996962901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6831","nonce":996962901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6829","nonce":996962901}]},"public_addr":"172.21.15.190:6825/996962901","cluster_addr":"172.21.15.190:6827/996962901","heartbeat_back_addr":"172.21.15.190:6831/996962901","heartbeat_front_addr":"172.21.15.190:6829/996962901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.286623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.589301+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:57.927099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.576386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.715561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.327247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.590599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.566532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:40:07.458 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T17:40:07.458 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:40:07.458 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:40:08.661 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'rbd' created 2024-09-12T17:40:08.686 DEBUG:teuthology.orchestra.run.smithi157:> rbd --cluster ceph pool init rbd 2024-09-12T17:40:08.730 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:08.730 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:11.721 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:40:11.722 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:40:11.722 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:40:12.083 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:40:12.103 INFO:teuthology.orchestra.run.smithi157.stdout:[{"version":9,"timestamp":"2024-09-12T17:40:01.430552+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"5056.432918"}]}] 2024-09-12T17:40:12.104 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T17:40:12.104 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:40:12.104 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:40:12.105 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:40:12.457 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:40:12.475 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1922186176},{"type":"v1","addr":"172.21.15.157:6833","nonce":1922186176}]},"active_addr":"172.21.15.157:6833/1922186176","active_change":"2024-09-12T17:39:54.162048+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":1660118814}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":3767348500}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":1879425421}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":3503855615}]}]} 2024-09-12T17:40:12.479 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:40:12.479 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:40:12.479 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:40:12.778 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:40:12.779 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":22,"fsid":"634e9294-a45c-40c3-b542-a6fcc3acc794","created":"2024-09-12T17:39:49.371481+0000","modified":"2024-09-12T17:40:11.674825+0000","last_up_change":"2024-09-12T17:40:01.612523+0000","last_in_change":"2024-09-12T17:39:51.684991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:40:02.208651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:40:07.766549+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"127eba9c-71ee-4e56-ad38-41e33131d3bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6817","nonce":2202738069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6819","nonce":2202738069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6825","nonce":2202738069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6822","nonce":2202738069}]},"public_addr":"172.21.15.157:6817/2202738069","cluster_addr":"172.21.15.157:6819/2202738069","heartbeat_back_addr":"172.21.15.157:6825/2202738069","heartbeat_front_addr":"172.21.15.157:6822/2202738069","state":["exists","up"]},{"osd":1,"uuid":"2614ac45-d4c7-4da5-9f21-da3980ec191e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6823","nonce":3908026248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6827","nonce":3908026248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6831","nonce":3908026248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6829","nonce":3908026248}]},"public_addr":"172.21.15.157:6823/3908026248","cluster_addr":"172.21.15.157:6827/3908026248","heartbeat_back_addr":"172.21.15.157:6831/3908026248","heartbeat_front_addr":"172.21.15.157:6829/3908026248","state":["exists","up"]},{"osd":2,"uuid":"16bfeef6-4b24-4de6-ba35-92eb0fa56a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6801","nonce":2182114182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6803","nonce":2182114182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6807","nonce":2182114182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6805","nonce":2182114182}]},"public_addr":"172.21.15.157:6801/2182114182","cluster_addr":"172.21.15.157:6803/2182114182","heartbeat_back_addr":"172.21.15.157:6807/2182114182","heartbeat_front_addr":"172.21.15.157:6805/2182114182","state":["exists","up"]},{"osd":3,"uuid":"da73acc4-b448-41f6-ab33-3a08c0ab7578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6809","nonce":3345787243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6811","nonce":3345787243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6815","nonce":3345787243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6813","nonce":3345787243}]},"public_addr":"172.21.15.157:6809/3345787243","cluster_addr":"172.21.15.157:6811/3345787243","heartbeat_back_addr":"172.21.15.157:6815/3345787243","heartbeat_front_addr":"172.21.15.157:6813/3345787243","state":["exists","up"]},{"osd":4,"uuid":"081aabd0-3871-47e8-98da-8ded73a9cb8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6817","nonce":2884135430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6819","nonce":2884135430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6823","nonce":2884135430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6821","nonce":2884135430}]},"public_addr":"172.21.15.190:6817/2884135430","cluster_addr":"172.21.15.190:6819/2884135430","heartbeat_back_addr":"172.21.15.190:6823/2884135430","heartbeat_front_addr":"172.21.15.190:6821/2884135430","state":["exists","up"]},{"osd":5,"uuid":"0e43cc8f-ab71-4ffd-b644-fd357c3c32e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6801","nonce":962816639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6803","nonce":962816639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6807","nonce":962816639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6805","nonce":962816639}]},"public_addr":"172.21.15.190:6801/962816639","cluster_addr":"172.21.15.190:6803/962816639","heartbeat_back_addr":"172.21.15.190:6807/962816639","heartbeat_front_addr":"172.21.15.190:6805/962816639","state":["exists","up"]},{"osd":6,"uuid":"4abefff1-7456-497d-8d79-46f811031b1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6809","nonce":393781841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6811","nonce":393781841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6815","nonce":393781841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6813","nonce":393781841}]},"public_addr":"172.21.15.190:6809/393781841","cluster_addr":"172.21.15.190:6811/393781841","heartbeat_back_addr":"172.21.15.190:6815/393781841","heartbeat_front_addr":"172.21.15.190:6813/393781841","state":["exists","up"]},{"osd":7,"uuid":"36eb1495-cee5-41b2-9342-ccd37000b85d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6825","nonce":996962901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6827","nonce":996962901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6831","nonce":996962901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6829","nonce":996962901}]},"public_addr":"172.21.15.190:6825/996962901","cluster_addr":"172.21.15.190:6827/996962901","heartbeat_back_addr":"172.21.15.190:6831/996962901","heartbeat_front_addr":"172.21.15.190:6829/996962901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.286623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.589301+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:57.927099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.576386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.715561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.327247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.590599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.566532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:40:12.797 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:40:12.797 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:40:13.089 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:40:13.090 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":22,"fsid":"634e9294-a45c-40c3-b542-a6fcc3acc794","created":"2024-09-12T17:39:49.371481+0000","modified":"2024-09-12T17:40:11.674825+0000","last_up_change":"2024-09-12T17:40:01.612523+0000","last_in_change":"2024-09-12T17:39:51.684991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:40:02.208651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:40:07.766549+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"127eba9c-71ee-4e56-ad38-41e33131d3bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6817","nonce":2202738069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6819","nonce":2202738069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6825","nonce":2202738069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6822","nonce":2202738069}]},"public_addr":"172.21.15.157:6817/2202738069","cluster_addr":"172.21.15.157:6819/2202738069","heartbeat_back_addr":"172.21.15.157:6825/2202738069","heartbeat_front_addr":"172.21.15.157:6822/2202738069","state":["exists","up"]},{"osd":1,"uuid":"2614ac45-d4c7-4da5-9f21-da3980ec191e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6823","nonce":3908026248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6827","nonce":3908026248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6831","nonce":3908026248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6829","nonce":3908026248}]},"public_addr":"172.21.15.157:6823/3908026248","cluster_addr":"172.21.15.157:6827/3908026248","heartbeat_back_addr":"172.21.15.157:6831/3908026248","heartbeat_front_addr":"172.21.15.157:6829/3908026248","state":["exists","up"]},{"osd":2,"uuid":"16bfeef6-4b24-4de6-ba35-92eb0fa56a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6801","nonce":2182114182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6803","nonce":2182114182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6807","nonce":2182114182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6805","nonce":2182114182}]},"public_addr":"172.21.15.157:6801/2182114182","cluster_addr":"172.21.15.157:6803/2182114182","heartbeat_back_addr":"172.21.15.157:6807/2182114182","heartbeat_front_addr":"172.21.15.157:6805/2182114182","state":["exists","up"]},{"osd":3,"uuid":"da73acc4-b448-41f6-ab33-3a08c0ab7578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6809","nonce":3345787243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6811","nonce":3345787243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6815","nonce":3345787243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6813","nonce":3345787243}]},"public_addr":"172.21.15.157:6809/3345787243","cluster_addr":"172.21.15.157:6811/3345787243","heartbeat_back_addr":"172.21.15.157:6815/3345787243","heartbeat_front_addr":"172.21.15.157:6813/3345787243","state":["exists","up"]},{"osd":4,"uuid":"081aabd0-3871-47e8-98da-8ded73a9cb8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6817","nonce":2884135430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6819","nonce":2884135430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6823","nonce":2884135430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6821","nonce":2884135430}]},"public_addr":"172.21.15.190:6817/2884135430","cluster_addr":"172.21.15.190:6819/2884135430","heartbeat_back_addr":"172.21.15.190:6823/2884135430","heartbeat_front_addr":"172.21.15.190:6821/2884135430","state":["exists","up"]},{"osd":5,"uuid":"0e43cc8f-ab71-4ffd-b644-fd357c3c32e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6801","nonce":962816639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6803","nonce":962816639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6807","nonce":962816639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6805","nonce":962816639}]},"public_addr":"172.21.15.190:6801/962816639","cluster_addr":"172.21.15.190:6803/962816639","heartbeat_back_addr":"172.21.15.190:6807/962816639","heartbeat_front_addr":"172.21.15.190:6805/962816639","state":["exists","up"]},{"osd":6,"uuid":"4abefff1-7456-497d-8d79-46f811031b1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6809","nonce":393781841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6811","nonce":393781841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6815","nonce":393781841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6813","nonce":393781841}]},"public_addr":"172.21.15.190:6809/393781841","cluster_addr":"172.21.15.190:6811/393781841","heartbeat_back_addr":"172.21.15.190:6815/393781841","heartbeat_front_addr":"172.21.15.190:6813/393781841","state":["exists","up"]},{"osd":7,"uuid":"36eb1495-cee5-41b2-9342-ccd37000b85d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6825","nonce":996962901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6827","nonce":996962901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6831","nonce":996962901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6829","nonce":996962901}]},"public_addr":"172.21.15.190:6825/996962901","cluster_addr":"172.21.15.190:6827/996962901","heartbeat_back_addr":"172.21.15.190:6831/996962901","heartbeat_front_addr":"172.21.15.190:6829/996962901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.286623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.589301+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:57.927099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.576386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.715561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.327247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.590599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.566532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:40:13.108 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:40:13.109 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:40:13.109 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:40:13.110 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:40:13.110 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:40:13.111 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:40:13.111 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:40:13.111 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:40:13.365 INFO:teuthology.orchestra.run.smithi157.stdout:64424509446 2024-09-12T17:40:13.365 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:40:13.371 INFO:teuthology.orchestra.run.smithi157.stdout:64424509444 2024-09-12T17:40:13.371 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:40:13.380 INFO:teuthology.orchestra.run.smithi157.stdout:64424509446 2024-09-12T17:40:13.380 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:40:13.384 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2024-09-12T17:40:13.385 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:40:13.386 INFO:teuthology.orchestra.run.smithi157.stdout:64424509445 2024-09-12T17:40:13.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:40:13.388 INFO:teuthology.orchestra.run.smithi157.stdout:64424509445 2024-09-12T17:40:13.389 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:40:13.390 INFO:teuthology.orchestra.run.smithi157.stdout:64424509445 2024-09-12T17:40:13.390 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:40:13.391 INFO:teuthology.orchestra.run.smithi157.stdout:64424509445 2024-09-12T17:40:13.391 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:40:13.892 INFO:teuthology.orchestra.run.smithi157.stdout:64424509444 2024-09-12T17:40:13.895 INFO:teuthology.orchestra.run.smithi157.stdout:64424509444 2024-09-12T17:40:13.904 INFO:teuthology.orchestra.run.smithi157.stdout:64424509442 2024-09-12T17:40:13.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.4 2024-09-12T17:40:13.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.0 2024-09-12T17:40:13.928 INFO:teuthology.orchestra.run.smithi157.stdout:55834574852 2024-09-12T17:40:13.928 INFO:teuthology.orchestra.run.smithi157.stdout:64424509443 2024-09-12T17:40:13.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.1 2024-09-12T17:40:13.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.7 2024-09-12T17:40:13.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-12T17:40:13.958 INFO:teuthology.orchestra.run.smithi157.stdout:64424509443 2024-09-12T17:40:13.962 INFO:teuthology.orchestra.run.smithi157.stdout:64424509443 2024-09-12T17:40:13.980 INFO:teuthology.orchestra.run.smithi157.stdout:64424509443 2024-09-12T17:40:13.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.5 2024-09-12T17:40:13.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-09-12T17:40:13.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.6 2024-09-12T17:40:14.926 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:40:14.927 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:40:14.937 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:40:14.957 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:40:14.958 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:40:14.981 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:40:14.986 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:40:14.999 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:40:15.434 INFO:teuthology.orchestra.run.smithi157.stdout:64424509446 2024-09-12T17:40:15.455 INFO:teuthology.orchestra.run.smithi157.stdout:64424509446 2024-09-12T17:40:15.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-12T17:40:15.458 DEBUG:teuthology.parallel:result is None 2024-09-12T17:40:15.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-12T17:40:15.481 DEBUG:teuthology.parallel:result is None 2024-09-12T17:40:15.491 INFO:teuthology.orchestra.run.smithi157.stdout:64424509444 2024-09-12T17:40:15.494 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2024-09-12T17:40:15.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.1 2024-09-12T17:40:15.511 DEBUG:teuthology.parallel:result is None 2024-09-12T17:40:15.515 INFO:teuthology.orchestra.run.smithi157.stdout:64424509445 2024-09-12T17:40:15.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-09-12T17:40:15.524 DEBUG:teuthology.parallel:result is None 2024-09-12T17:40:15.526 INFO:teuthology.orchestra.run.smithi157.stdout:64424509445 2024-09-12T17:40:15.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-09-12T17:40:15.533 DEBUG:teuthology.parallel:result is None 2024-09-12T17:40:15.540 INFO:teuthology.orchestra.run.smithi157.stdout:64424509445 2024-09-12T17:40:15.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2024-09-12T17:40:15.553 DEBUG:teuthology.parallel:result is None 2024-09-12T17:40:15.554 INFO:teuthology.orchestra.run.smithi157.stdout:64424509445 2024-09-12T17:40:15.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.5 2024-09-12T17:40:15.558 DEBUG:teuthology.parallel:result is None 2024-09-12T17:40:15.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-09-12T17:40:15.572 DEBUG:teuthology.parallel:result is None 2024-09-12T17:40:15.572 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:40:15.572 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:40:15.884 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:40:15.885 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-09-12T17:40:15.901 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T17:40:14.175114+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239948,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734772,"statfs":{"total":773094113280,"available":772848406528,"internally_reserved":0,"allocated":2965504,"data_stored":1776982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.518377"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.748529+0000","last_change":"2024-09-12T17:40:11.748529+0000","last_active":"2024-09-12T17:40:11.748529+0000","last_peered":"2024-09-12T17:40:11.748529+0000","last_clean":"2024-09-12T17:40:11.748529+0000","last_became_active":"2024-09-12T17:40:09.674331+0000","last_became_peered":"2024-09-12T17:40:09.674331+0000","last_unstale":"2024-09-12T17:40:11.748529+0000","last_undegraded":"2024-09-12T17:40:11.748529+0000","last_fullsized":"2024-09-12T17:40:11.748529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:20.063434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.683217+0000","last_change":"2024-09-12T17:40:11.683217+0000","last_active":"2024-09-12T17:40:11.683217+0000","last_peered":"2024-09-12T17:40:11.683217+0000","last_clean":"2024-09-12T17:40:11.683217+0000","last_became_active":"2024-09-12T17:40:09.671019+0000","last_became_peered":"2024-09-12T17:40:09.671019+0000","last_unstale":"2024-09-12T17:40:11.683217+0000","last_undegraded":"2024-09-12T17:40:11.683217+0000","last_fullsized":"2024-09-12T17:40:11.683217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:29.653884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096571,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.747892+0000","last_change":"2024-09-12T17:40:11.747892+0000","last_active":"2024-09-12T17:40:11.747892+0000","last_peered":"2024-09-12T17:40:11.747892+0000","last_clean":"2024-09-12T17:40:11.747892+0000","last_became_active":"2024-09-12T17:40:09.770504+0000","last_became_peered":"2024-09-12T17:40:09.770504+0000","last_unstale":"2024-09-12T17:40:11.747892+0000","last_undegraded":"2024-09-12T17:40:11.747892+0000","last_fullsized":"2024-09-12T17:40:11.747892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:45.742830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001093257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.682969+0000","last_change":"2024-09-12T17:40:11.682969+0000","last_active":"2024-09-12T17:40:11.682969+0000","last_peered":"2024-09-12T17:40:11.682969+0000","last_clean":"2024-09-12T17:40:11.682969+0000","last_became_active":"2024-09-12T17:40:09.770645+0000","last_became_peered":"2024-09-12T17:40:09.770645+0000","last_unstale":"2024-09-12T17:40:11.682969+0000","last_undegraded":"2024-09-12T17:40:11.682969+0000","last_fullsized":"2024-09-12T17:40:11.682969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:00.566138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091158000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.696695+0000","last_change":"2024-09-12T17:40:11.695547+0000","last_active":"2024-09-12T17:40:11.696695+0000","last_peered":"2024-09-12T17:40:11.696695+0000","last_clean":"2024-09-12T17:40:11.696695+0000","last_became_active":"2024-09-12T17:40:09.672745+0000","last_became_peered":"2024-09-12T17:40:09.672745+0000","last_unstale":"2024-09-12T17:40:11.696695+0000","last_undegraded":"2024-09-12T17:40:11.696695+0000","last_fullsized":"2024-09-12T17:40:11.696695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:10.363335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002775694,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.748424+0000","last_change":"2024-09-12T17:40:11.749016+0000","last_active":"2024-09-12T17:40:11.748424+0000","last_peered":"2024-09-12T17:40:11.748424+0000","last_clean":"2024-09-12T17:40:11.748424+0000","last_became_active":"2024-09-12T17:40:09.771196+0000","last_became_peered":"2024-09-12T17:40:09.771196+0000","last_unstale":"2024-09-12T17:40:11.748424+0000","last_undegraded":"2024-09-12T17:40:11.748424+0000","last_fullsized":"2024-09-12T17:40:11.748424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:48.611278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010655720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.747849+0000","last_change":"2024-09-12T17:40:11.747849+0000","last_active":"2024-09-12T17:40:11.747849+0000","last_peered":"2024-09-12T17:40:11.747849+0000","last_clean":"2024-09-12T17:40:11.747849+0000","last_became_active":"2024-09-12T17:40:09.666272+0000","last_became_peered":"2024-09-12T17:40:09.666272+0000","last_unstale":"2024-09-12T17:40:11.747849+0000","last_undegraded":"2024-09-12T17:40:11.747849+0000","last_fullsized":"2024-09-12T17:40:11.747849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:15.707497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001052545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.694118+0000","last_change":"2024-09-12T17:40:11.694118+0000","last_active":"2024-09-12T17:40:11.694118+0000","last_peered":"2024-09-12T17:40:11.694118+0000","last_clean":"2024-09-12T17:40:11.694118+0000","last_became_active":"2024-09-12T17:40:09.670674+0000","last_became_peered":"2024-09-12T17:40:09.670674+0000","last_unstale":"2024-09-12T17:40:11.694118+0000","last_undegraded":"2024-09-12T17:40:11.694118+0000","last_fullsized":"2024-09-12T17:40:11.694118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:11.615670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001302742,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.746554+0000","last_change":"2024-09-12T17:40:03.638745+0000","last_active":"2024-09-12T17:40:11.746554+0000","last_peered":"2024-09-12T17:40:11.746554+0000","last_clean":"2024-09-12T17:40:11.746554+0000","last_became_active":"2024-09-12T17:40:03.636856+0000","last_became_peered":"2024-09-12T17:40:03.636856+0000","last_unstale":"2024-09-12T17:40:11.746554+0000","last_undegraded":"2024-09-12T17:40:11.746554+0000","last_fullsized":"2024-09-12T17:40:11.746554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_clean_scrub_stamp":"2024-09-12T17:40:02.615744+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:44.815912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":664894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":74545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":74526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":74545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":815104,"data_stored":664894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":221184,"data_stored":74526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:40:15.903 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:40:16.185 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:40:16.186 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-09-12T17:40:16.202 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T17:40:16.175802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239948,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734772,"statfs":{"total":773094113280,"available":772848406528,"internally_reserved":0,"allocated":2965504,"data_stored":1776982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.516939"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.748529+0000","last_change":"2024-09-12T17:40:11.748529+0000","last_active":"2024-09-12T17:40:11.748529+0000","last_peered":"2024-09-12T17:40:11.748529+0000","last_clean":"2024-09-12T17:40:11.748529+0000","last_became_active":"2024-09-12T17:40:09.674331+0000","last_became_peered":"2024-09-12T17:40:09.674331+0000","last_unstale":"2024-09-12T17:40:11.748529+0000","last_undegraded":"2024-09-12T17:40:11.748529+0000","last_fullsized":"2024-09-12T17:40:11.748529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:20.063434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.683217+0000","last_change":"2024-09-12T17:40:11.683217+0000","last_active":"2024-09-12T17:40:11.683217+0000","last_peered":"2024-09-12T17:40:11.683217+0000","last_clean":"2024-09-12T17:40:11.683217+0000","last_became_active":"2024-09-12T17:40:09.671019+0000","last_became_peered":"2024-09-12T17:40:09.671019+0000","last_unstale":"2024-09-12T17:40:11.683217+0000","last_undegraded":"2024-09-12T17:40:11.683217+0000","last_fullsized":"2024-09-12T17:40:11.683217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:29.653884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096571,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.747892+0000","last_change":"2024-09-12T17:40:11.747892+0000","last_active":"2024-09-12T17:40:11.747892+0000","last_peered":"2024-09-12T17:40:11.747892+0000","last_clean":"2024-09-12T17:40:11.747892+0000","last_became_active":"2024-09-12T17:40:09.770504+0000","last_became_peered":"2024-09-12T17:40:09.770504+0000","last_unstale":"2024-09-12T17:40:11.747892+0000","last_undegraded":"2024-09-12T17:40:11.747892+0000","last_fullsized":"2024-09-12T17:40:11.747892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:45.742830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001093257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.682969+0000","last_change":"2024-09-12T17:40:11.682969+0000","last_active":"2024-09-12T17:40:11.682969+0000","last_peered":"2024-09-12T17:40:11.682969+0000","last_clean":"2024-09-12T17:40:11.682969+0000","last_became_active":"2024-09-12T17:40:09.770645+0000","last_became_peered":"2024-09-12T17:40:09.770645+0000","last_unstale":"2024-09-12T17:40:11.682969+0000","last_undegraded":"2024-09-12T17:40:11.682969+0000","last_fullsized":"2024-09-12T17:40:11.682969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:00.566138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091158000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.696695+0000","last_change":"2024-09-12T17:40:11.695547+0000","last_active":"2024-09-12T17:40:11.696695+0000","last_peered":"2024-09-12T17:40:11.696695+0000","last_clean":"2024-09-12T17:40:11.696695+0000","last_became_active":"2024-09-12T17:40:09.672745+0000","last_became_peered":"2024-09-12T17:40:09.672745+0000","last_unstale":"2024-09-12T17:40:11.696695+0000","last_undegraded":"2024-09-12T17:40:11.696695+0000","last_fullsized":"2024-09-12T17:40:11.696695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:10.363335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002775694,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.748424+0000","last_change":"2024-09-12T17:40:11.749016+0000","last_active":"2024-09-12T17:40:11.748424+0000","last_peered":"2024-09-12T17:40:11.748424+0000","last_clean":"2024-09-12T17:40:11.748424+0000","last_became_active":"2024-09-12T17:40:09.771196+0000","last_became_peered":"2024-09-12T17:40:09.771196+0000","last_unstale":"2024-09-12T17:40:11.748424+0000","last_undegraded":"2024-09-12T17:40:11.748424+0000","last_fullsized":"2024-09-12T17:40:11.748424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:48.611278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010655720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.747849+0000","last_change":"2024-09-12T17:40:11.747849+0000","last_active":"2024-09-12T17:40:11.747849+0000","last_peered":"2024-09-12T17:40:11.747849+0000","last_clean":"2024-09-12T17:40:11.747849+0000","last_became_active":"2024-09-12T17:40:09.666272+0000","last_became_peered":"2024-09-12T17:40:09.666272+0000","last_unstale":"2024-09-12T17:40:11.747849+0000","last_undegraded":"2024-09-12T17:40:11.747849+0000","last_fullsized":"2024-09-12T17:40:11.747849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:15.707497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001052545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.694118+0000","last_change":"2024-09-12T17:40:11.694118+0000","last_active":"2024-09-12T17:40:11.694118+0000","last_peered":"2024-09-12T17:40:11.694118+0000","last_clean":"2024-09-12T17:40:11.694118+0000","last_became_active":"2024-09-12T17:40:09.670674+0000","last_became_peered":"2024-09-12T17:40:09.670674+0000","last_unstale":"2024-09-12T17:40:11.694118+0000","last_undegraded":"2024-09-12T17:40:11.694118+0000","last_fullsized":"2024-09-12T17:40:11.694118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:11.615670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001302742,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:40:11.746554+0000","last_change":"2024-09-12T17:40:03.638745+0000","last_active":"2024-09-12T17:40:11.746554+0000","last_peered":"2024-09-12T17:40:11.746554+0000","last_clean":"2024-09-12T17:40:11.746554+0000","last_became_active":"2024-09-12T17:40:03.636856+0000","last_became_peered":"2024-09-12T17:40:03.636856+0000","last_unstale":"2024-09-12T17:40:11.746554+0000","last_undegraded":"2024-09-12T17:40:11.746554+0000","last_fullsized":"2024-09-12T17:40:11.746554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_clean_scrub_stamp":"2024-09-12T17:40:02.615744+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:44.815912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":664894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":74545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":74526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":74545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":815104,"data_stored":664894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":221184,"data_stored":74526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:40:16.203 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:40:16.203 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:40:16.203 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:40:16.204 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:40:16.518 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:40:16.518 INFO:teuthology.orchestra.run.smithi157.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:40:16.536 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:40:16.536 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T17:40:16.547 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:40:16.560 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T17:40:16.561 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:40:16.561 INFO:tasks.rgw:Creating data pools 2024-09-12T17:40:16.561 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:40:16.561 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T17:40:17.717 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:40:17.753 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:40:18.737 INFO:teuthology.orchestra.run.smithi157.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:40:18.782 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:40:19.094 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:40:19.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:40:20.098 INFO:teuthology.orchestra.run.smithi157.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:40:20.144 DEBUG:tasks.rgw:Pools created 2024-09-12T17:40:20.144 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T17:40:20.145 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:40:20.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:40:20.145 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:40:20.203 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:20.203 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:22.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.199+0000 7f3e590f9640 0 -- 172.21.15.157:0/25850575 >> [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] conn(0x7f3d2c0709f0 msgr2=0x7f3d2c072eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:22.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.207+0000 7f3e5b5f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:22.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.207+0000 7f3e588f8640 0 -- 172.21.15.157:0/1898235242 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55ea7aab4310 msgr2=0x55ea7aab67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:22.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.410+0000 7f3e5b5f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:22.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.410+0000 7f3e5b5f39c0 20 realm 2024-09-12T17:40:22.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.410+0000 7f3e5b5f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:22.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.410+0000 7f3e5b5f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:22.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.410+0000 7f3e5b5f39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:22.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.410+0000 7f3e5b5f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:22.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.410+0000 7f3e5b5f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.410+0000 7f3e5b5f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.418+0000 7f3e5b5f39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.418+0000 7f3e5b5f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.418+0000 7f3e5b5f39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.418+0000 7f3e5b5f39c0 20 searching for the correct realm 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.446+0000 7f3e5b5f39c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.446+0000 7f3e5b5f39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.446+0000 7f3e5b5f39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.446+0000 7f3e5b5f39c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.446+0000 7f3e5b5f39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.446+0000 7f3e5b5f39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.446+0000 7f3e5b5f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.446+0000 7f3e5b5f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.446+0000 7f3e5b5f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 20 zone default found 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 4 Realm: () 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 20 zonegroup default 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:22.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:22.450+0000 7f3e5b5f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:24.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:24.162+0000 7f3e5b5f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:24.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:24.162+0000 7f3e5b5f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:24.178+0000 7f3e5b5f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:24.178+0000 7f3e5b5f39c0 20 started sync module instance, tier type = 2024-09-12T17:40:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:24.178+0000 7f3e5b5f39c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:40:26.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 add_watcher() i=0 2024-09-12T17:40:26.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 add_watcher() i=1 2024-09-12T17:40:26.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 add_watcher() i=2 2024-09-12T17:40:26.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 add_watcher() i=3 2024-09-12T17:40:26.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 add_watcher() i=4 2024-09-12T17:40:26.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 add_watcher() i=5 2024-09-12T17:40:26.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 add_watcher() i=6 2024-09-12T17:40:26.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 add_watcher() i=7 2024-09-12T17:40:26.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:26.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T17:40:26.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T17:40:26.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T17:40:26.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T17:40:26.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.222+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T17:40:26.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T17:40:26.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T17:40:26.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T17:40:26.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T17:40:26.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T17:40:26.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T17:40:26.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T17:40:26.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T17:40:26.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T17:40:26.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T17:40:26.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T17:40:26.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.226+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T17:40:26.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T17:40:26.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T17:40:26.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T17:40:26.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T17:40:26.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T17:40:26.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T17:40:26.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T17:40:26.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T17:40:26.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T17:40:26.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T17:40:26.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T17:40:26.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T17:40:26.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T17:40:26.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.230+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T17:40:26.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T17:40:26.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T17:40:26.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T17:40:26.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T17:40:26.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T17:40:26.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T17:40:26.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T17:40:26.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T17:40:26.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T17:40:26.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T17:40:26.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T17:40:26.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.234+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T17:40:26.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T17:40:26.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T17:40:26.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T17:40:26.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T17:40:26.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T17:40:26.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T17:40:26.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T17:40:26.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T17:40:26.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T17:40:26.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T17:40:26.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T17:40:26.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.238+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T17:40:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T17:40:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T17:40:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T17:40:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T17:40:26.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T17:40:26.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T17:40:26.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T17:40:26.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T17:40:26.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T17:40:26.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T17:40:26.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T17:40:26.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T17:40:26.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T17:40:26.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.242+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T17:40:26.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T17:40:26.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T17:40:26.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T17:40:26.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T17:40:26.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T17:40:26.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T17:40:26.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T17:40:26.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T17:40:26.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T17:40:26.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T17:40:26.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T17:40:26.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.246+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T17:40:26.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T17:40:26.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T17:40:26.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T17:40:26.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T17:40:26.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T17:40:26.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T17:40:26.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T17:40:26.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T17:40:26.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T17:40:26.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T17:40:26.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T17:40:26.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.250+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T17:40:26.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T17:40:26.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T17:40:26.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T17:40:26.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T17:40:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T17:40:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T17:40:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T17:40:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T17:40:26.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T17:40:26.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.254+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T17:40:26.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T17:40:26.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T17:40:26.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T17:40:26.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T17:40:26.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T17:40:26.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T17:40:26.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T17:40:26.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T17:40:26.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T17:40:26.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T17:40:26.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T17:40:26.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.258+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T17:40:26.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T17:40:26.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T17:40:26.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T17:40:26.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T17:40:26.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T17:40:26.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T17:40:26.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T17:40:26.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T17:40:26.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T17:40:26.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T17:40:26.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T17:40:26.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T17:40:26.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T17:40:26.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.262+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T17:40:26.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T17:40:26.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T17:40:26.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T17:40:26.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T17:40:26.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T17:40:26.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T17:40:26.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T17:40:26.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T17:40:26.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T17:40:26.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T17:40:26.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T17:40:26.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T17:40:26.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T17:40:26.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T17:40:26.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T17:40:26.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.266+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T17:40:26.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T17:40:26.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T17:40:26.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T17:40:26.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T17:40:26.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T17:40:26.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T17:40:26.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T17:40:26.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T17:40:26.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T17:40:26.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T17:40:26.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T17:40:26.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T17:40:26.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T17:40:26.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.270+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T17:40:26.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T17:40:26.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T17:40:26.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T17:40:26.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T17:40:26.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T17:40:26.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T17:40:26.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T17:40:26.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T17:40:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T17:40:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T17:40:26.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T17:40:26.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T17:40:26.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T17:40:26.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.274+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T17:40:26.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T17:40:26.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T17:40:26.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T17:40:26.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T17:40:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T17:40:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T17:40:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T17:40:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T17:40:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T17:40:26.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T17:40:26.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T17:40:26.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.278+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T17:40:26.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T17:40:26.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T17:40:26.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T17:40:26.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T17:40:26.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T17:40:26.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T17:40:26.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T17:40:26.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T17:40:26.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T17:40:26.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T17:40:26.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T17:40:26.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.282+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T17:40:26.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T17:40:26.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T17:40:26.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T17:40:26.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T17:40:26.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T17:40:26.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T17:40:26.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T17:40:26.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T17:40:26.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T17:40:26.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.286+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T17:40:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T17:40:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T17:40:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T17:40:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T17:40:26.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T17:40:26.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T17:40:26.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T17:40:26.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T17:40:26.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T17:40:26.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T17:40:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T17:40:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T17:40:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T17:40:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T17:40:26.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T17:40:26.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.290+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T17:40:26.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T17:40:26.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T17:40:26.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T17:40:26.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T17:40:26.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T17:40:26.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T17:40:26.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T17:40:26.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T17:40:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T17:40:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T17:40:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T17:40:26.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T17:40:26.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T17:40:26.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.294+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T17:40:26.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T17:40:26.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T17:40:26.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T17:40:26.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T17:40:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T17:40:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T17:40:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T17:40:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T17:40:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T17:40:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T17:40:26.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T17:40:26.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T17:40:26.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T17:40:26.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T17:40:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T17:40:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T17:40:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T17:40:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.298+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.302+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T17:40:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.302+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T17:40:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.302+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.302+0000 7f3e5b5f39c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T17:40:26.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.302+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T17:40:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.306+0000 7f3e5b5f39c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:40:26.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.314+0000 7f3d0bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:26.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.314+0000 7f3e5b5f39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:26.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:26.314+0000 7f3e5b5f39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:29.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.166+0000 7f3e5b5f39c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T17:40:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.166+0000 7f3e5b5f39c0 5 note: GC not initialized 2024-09-12T17:40:29.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.178+0000 7f3d0afe5640 20 reqs_thread_entry: start 2024-09-12T17:40:29.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.178+0000 7f3e5b5f39c0 20 init_complete bucket index max shards: 1 2024-09-12T17:40:29.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.178+0000 7f3e5b5f39c0 20 Filter name: none 2024-09-12T17:40:29.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.178+0000 7f3d08fe1640 20 reqs_thread_entry: start 2024-09-12T17:40:29.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.230+0000 7f3d0bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:29.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.234+0000 7f3e5b5f39c0 20 remove_watcher() i=0 2024-09-12T17:40:29.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.234+0000 7f3e5b5f39c0 2 removed watcher, disabling cache 2024-09-12T17:40:29.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.238+0000 7f3e5b5f39c0 20 remove_watcher() i=1 2024-09-12T17:40:29.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.238+0000 7f3e5b5f39c0 20 remove_watcher() i=2 2024-09-12T17:40:29.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.246+0000 7f3e5b5f39c0 20 remove_watcher() i=3 2024-09-12T17:40:29.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.250+0000 7f3e5b5f39c0 20 remove_watcher() i=4 2024-09-12T17:40:29.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.250+0000 7f3e5b5f39c0 20 remove_watcher() i=5 2024-09-12T17:40:29.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.250+0000 7f3e5b5f39c0 20 remove_watcher() i=6 2024-09-12T17:40:29.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.254+0000 7f3e5b5f39c0 20 remove_watcher() i=7 2024-09-12T17:40:29.273 INFO:teuthology.orchestra.run.smithi157.stdout:[] 2024-09-12T17:40:29.274 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:40:29.274 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:40:29.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:40:29.274 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T17:40:29.317 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:29.317 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:29.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.342+0000 7f9c020b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:29.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.342+0000 7f9c020b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:29.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.346+0000 7f9abe7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:29.368 INFO:teuthology.orchestra.run.smithi157.stdout:{"id":"e807567e-1eb5-4a0c-9e30-862938396cf3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:40:29.368 DEBUG:tasks.util.rgw: json result: {'id': 'e807567e-1eb5-4a0c-9e30-862938396cf3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:40:29.369 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:40:29.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:40:29.369 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:40:29.438 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:29.438 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:29.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.474+0000 7f708288e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:29.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.478+0000 7f708288e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:29.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.478+0000 7f708288e9c0 20 realm 2024-09-12T17:40:29.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.478+0000 7f708288e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:29.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.478+0000 7f708288e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:29.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.478+0000 7f708288e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:29.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.478+0000 7f708288e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:29.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.478+0000 7f708288e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:29.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.478+0000 7f708288e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:29.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.478+0000 7f708288e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:29.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.478+0000 7f708288e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:29.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.482+0000 7f708288e9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:40:29.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.482+0000 7f708288e9c0 20 searching for the correct realm 2024-09-12T17:40:29.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.482+0000 7f707fb93640 0 -- 172.21.15.157:0/234529949 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f7074043060 msgr2=0x7f707406ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:29.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.694+0000 7f7080394640 0 -- 172.21.15.157:0/234529949 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f7074069270 msgr2=0x7f707409c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.910+0000 7f708288e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:40:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.910+0000 7f708288e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.910+0000 7f708288e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.910+0000 7f708288e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:40:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.910+0000 7f708288e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.910+0000 7f708288e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.910+0000 7f708288e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.910+0000 7f708288e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.910+0000 7f708288e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:29.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:40:29.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 zone default found 2024-09-12T17:40:29.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 4 Realm: () 2024-09-12T17:40:29.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:40:29.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:40:29.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:29.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 zonegroup default 2024-09-12T17:40:29.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 started sync module instance, tier type = 2024-09-12T17:40:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.914+0000 7f708288e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:40:29.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.938+0000 7f708288e9c0 20 add_watcher() i=0 2024-09-12T17:40:29.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.938+0000 7f708288e9c0 20 add_watcher() i=1 2024-09-12T17:40:29.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.938+0000 7f708288e9c0 20 add_watcher() i=2 2024-09-12T17:40:29.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.938+0000 7f708288e9c0 20 add_watcher() i=3 2024-09-12T17:40:29.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.938+0000 7f708288e9c0 20 add_watcher() i=4 2024-09-12T17:40:29.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.938+0000 7f708288e9c0 20 add_watcher() i=5 2024-09-12T17:40:29.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.938+0000 7f708288e9c0 20 add_watcher() i=6 2024-09-12T17:40:29.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.942+0000 7f708288e9c0 20 add_watcher() i=7 2024-09-12T17:40:29.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.942+0000 7f708288e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.946+0000 7f6f367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.946+0000 7f708288e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:29.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.946+0000 7f708288e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:29.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.946+0000 7f708288e9c0 5 note: GC not initialized 2024-09-12T17:40:29.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.946+0000 7f6f357e2640 20 reqs_thread_entry: start 2024-09-12T17:40:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.946+0000 7f708288e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:40:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.946+0000 7f708288e9c0 20 Filter name: none 2024-09-12T17:40:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.946+0000 7f6ea6ffd640 20 reqs_thread_entry: start 2024-09-12T17:40:29.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.966+0000 7f6f367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.970+0000 7f708288e9c0 20 remove_watcher() i=0 2024-09-12T17:40:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.970+0000 7f708288e9c0 2 removed watcher, disabling cache 2024-09-12T17:40:29.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.974+0000 7f708288e9c0 20 remove_watcher() i=1 2024-09-12T17:40:29.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.974+0000 7f708288e9c0 20 remove_watcher() i=2 2024-09-12T17:40:29.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.978+0000 7f708288e9c0 20 remove_watcher() i=3 2024-09-12T17:40:29.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.978+0000 7f708288e9c0 20 remove_watcher() i=4 2024-09-12T17:40:29.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.982+0000 7f708288e9c0 20 remove_watcher() i=5 2024-09-12T17:40:29.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.982+0000 7f708288e9c0 20 remove_watcher() i=6 2024-09-12T17:40:29.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:29.986+0000 7f708288e9c0 20 remove_watcher() i=7 2024-09-12T17:40:30.007 INFO:teuthology.orchestra.run.smithi157.stdout:[] 2024-09-12T17:40:30.008 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:40:30.008 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:40:30.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:40:30.008 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T17:40:30.092 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:30.092 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:30.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.122+0000 7faf2b65a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:30.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.122+0000 7faf2b65a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:30.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.126+0000 7fade77fe640 20 reqs_thread_entry: start 2024-09-12T17:40:30.146 INFO:teuthology.orchestra.run.smithi157.stdout:{"id":"e807567e-1eb5-4a0c-9e30-862938396cf3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:40:30.146 DEBUG:tasks.util.rgw: json result: {'id': 'e807567e-1eb5-4a0c-9e30-862938396cf3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:40:30.146 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:40:30.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:40:30.146 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:40:30.222 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:30.222 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:30.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.258+0000 7f14f0b429c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:30.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.262+0000 7f14f0b429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:30.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.262+0000 7f14f0b429c0 20 realm 2024-09-12T17:40:30.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.262+0000 7f14f0b429c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:30.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.262+0000 7f14f0b429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:30.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.262+0000 7f14f0b429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:30.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.262+0000 7f14f0b429c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:30.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.262+0000 7f14f0b429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:30.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.262+0000 7f14f0b429c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:30.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.266+0000 7f14f0b429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:30.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.266+0000 7f14f0b429c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.266+0000 7f14f0b429c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:40:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.266+0000 7f14f0b429c0 20 searching for the correct realm 2024-09-12T17:40:30.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.270+0000 7f14ede47640 0 -- 172.21.15.157:0/915903953 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f14e40d4bd0 msgr2=0x7f14e40cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:30.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.486+0000 7f14ee648640 0 -- 172.21.15.157:0/915903953 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f14e40e3900 msgr2=0x7f14e40c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:30.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.702+0000 7f14f0b429c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:40:30.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.702+0000 7f14f0b429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:30.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.702+0000 7f14f0b429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:30.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.702+0000 7f14f0b429c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:40:30.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.702+0000 7f14f0b429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:30.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.702+0000 7f14f0b429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:30.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.702+0000 7f14f0b429c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.702+0000 7f14f0b429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.702+0000 7f14f0b429c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:30.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:40:30.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 20 zone default found 2024-09-12T17:40:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 4 Realm: () 2024-09-12T17:40:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:40:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:40:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 20 zonegroup default 2024-09-12T17:40:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.706+0000 7f14f0b429c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.710+0000 7f14f0b429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:30.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.710+0000 7f14f0b429c0 20 started sync module instance, tier type = 2024-09-12T17:40:30.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.710+0000 7f14f0b429c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:40:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.730+0000 7f14f0b429c0 20 add_watcher() i=0 2024-09-12T17:40:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.730+0000 7f14f0b429c0 20 add_watcher() i=1 2024-09-12T17:40:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.730+0000 7f14f0b429c0 20 add_watcher() i=2 2024-09-12T17:40:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.730+0000 7f14f0b429c0 20 add_watcher() i=3 2024-09-12T17:40:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.730+0000 7f14f0b429c0 20 add_watcher() i=4 2024-09-12T17:40:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.730+0000 7f14f0b429c0 20 add_watcher() i=5 2024-09-12T17:40:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.730+0000 7f14f0b429c0 20 add_watcher() i=6 2024-09-12T17:40:30.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.734+0000 7f14f0b429c0 20 add_watcher() i=7 2024-09-12T17:40:30.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.734+0000 7f14f0b429c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.738+0000 7f13a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.738+0000 7f14f0b429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.738+0000 7f14f0b429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.738+0000 7f14f0b429c0 5 note: GC not initialized 2024-09-12T17:40:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.738+0000 7f131f7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:30.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.738+0000 7f14f0b429c0 20 init_complete bucket index max shards: 1 2024-09-12T17:40:30.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.738+0000 7f14f0b429c0 20 Filter name: none 2024-09-12T17:40:30.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.742+0000 7f131d7fa640 20 reqs_thread_entry: start 2024-09-12T17:40:30.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.762+0000 7f13a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:30.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.766+0000 7f14f0b429c0 20 remove_watcher() i=0 2024-09-12T17:40:30.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.766+0000 7f14f0b429c0 2 removed watcher, disabling cache 2024-09-12T17:40:30.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.770+0000 7f14f0b429c0 20 remove_watcher() i=1 2024-09-12T17:40:30.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.770+0000 7f14f0b429c0 20 remove_watcher() i=2 2024-09-12T17:40:30.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.774+0000 7f14f0b429c0 20 remove_watcher() i=3 2024-09-12T17:40:30.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.774+0000 7f14f0b429c0 20 remove_watcher() i=4 2024-09-12T17:40:30.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.778+0000 7f14f0b429c0 20 remove_watcher() i=5 2024-09-12T17:40:30.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.778+0000 7f14f0b429c0 20 remove_watcher() i=6 2024-09-12T17:40:30.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.782+0000 7f14f0b429c0 20 remove_watcher() i=7 2024-09-12T17:40:30.804 INFO:teuthology.orchestra.run.smithi157.stdout:[] 2024-09-12T17:40:30.804 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:40:30.804 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T17:40:30.804 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:40:30.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:40:30.805 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T17:40:30.888 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:30.889 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:30.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.914+0000 7f25baec99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:30.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.914+0000 7f25baec99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:30.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:30.922+0000 7f2436ffd640 20 reqs_thread_entry: start 2024-09-12T17:40:30.941 INFO:teuthology.orchestra.run.smithi157.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T17:40:30.942 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T17:40:30.942 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:40:30.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:40:30.942 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T17:40:31.023 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:31.023 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:31.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:31.050+0000 7fd43f4e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:31.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:31.050+0000 7fd43f4e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:31.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:31.054+0000 7fd2faffd640 20 reqs_thread_entry: start 2024-09-12T17:40:31.076 INFO:teuthology.orchestra.run.smithi157.stdout:{"id":"e807567e-1eb5-4a0c-9e30-862938396cf3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:40:31.076 DEBUG:tasks.util.rgw: json result: {'id': 'e807567e-1eb5-4a0c-9e30-862938396cf3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:40:31.076 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T17:40:31.076 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:40:31.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:40:31.077 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T17:40:31.155 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:31.469 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:31.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:31.186+0000 7f910645c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:31.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:31.186+0000 7f910645c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:31.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:31.190+0000 7f8f49ffb640 20 reqs_thread_entry: start 2024-09-12T17:40:31.471 INFO:teuthology.orchestra.run.smithi157.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T17:40:31.471 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T17:40:31.472 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:40:31.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:40:31.472 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T17:40:31.564 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:31.565 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:31.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:31.594+0000 7fd80930e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:31.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:31.594+0000 7fd80930e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:31.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:40:31.598+0000 7fd6c97e2640 20 reqs_thread_entry: start 2024-09-12T17:40:31.617 INFO:teuthology.orchestra.run.smithi157.stdout:{"id":"e807567e-1eb5-4a0c-9e30-862938396cf3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:40:31.617 DEBUG:tasks.util.rgw: json result: {'id': 'e807567e-1eb5-4a0c-9e30-862938396cf3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:40:31.618 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:40:31.618 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T17:40:31.618 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:40:31.618 DEBUG:teuthology.orchestra.run.smithi157:> sudo echo -n http://smithi157.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:40:31.681 INFO:teuthology.orchestra.run.smithi157.stdout:http://smithi157.front.sepia.ceph.com:80 2024-09-12T17:40:31.681 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:40:31.735 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T17:40:31.736 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:40:31.736 DEBUG:teuthology.orchestra.run.smithi157:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:40:31.782 INFO:tasks.rgw.client.0:Started 2024-09-12T17:40:31.783 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi157.front.sepia.ceph.com:80/ 2024-09-12T17:40:31.783 DEBUG:teuthology.orchestra.run.smithi157:> curl http://smithi157.front.sepia.ceph.com:80/ 2024-09-12T17:40:31.808 INFO:teuthology.orchestra.run.smithi157.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:40:31.809 INFO:teuthology.orchestra.run.smithi157.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:40:31.809 INFO:teuthology.orchestra.run.smithi157.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:40:31.809 INFO:teuthology.orchestra.run.smithi157.stderr:curl: (7) Failed to connect to smithi157.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:40:31.809 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:40:32.810 DEBUG:teuthology.orchestra.run.smithi157:> curl http://smithi157.front.sepia.ceph.com:80/ 2024-09-12T17:40:32.821 INFO:teuthology.orchestra.run.smithi157.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:40:32.821 INFO:teuthology.orchestra.run.smithi157.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:40:32.821 INFO:teuthology.orchestra.run.smithi157.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:40:32.821 INFO:teuthology.orchestra.run.smithi157.stderr:curl: (7) Failed to connect to smithi157.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:40:32.822 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:40:34.823 DEBUG:teuthology.orchestra.run.smithi157:> curl http://smithi157.front.sepia.ceph.com:80/ 2024-09-12T17:40:34.833 INFO:teuthology.orchestra.run.smithi157.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:40:34.833 INFO:teuthology.orchestra.run.smithi157.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:40:34.834 INFO:teuthology.orchestra.run.smithi157.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:40:34.834 INFO:teuthology.orchestra.run.smithi157.stderr:curl: (7) Failed to connect to smithi157.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:40:34.834 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:40:38.836 DEBUG:teuthology.orchestra.run.smithi157:> curl http://smithi157.front.sepia.ceph.com:80/ 2024-09-12T17:40:38.848 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:40:38.849 INFO:teuthology.orchestra.run.smithi157.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:40:38.849 INFO:teuthology.orchestra.run.smithi157.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:40:38.849 INFO:teuthology.orchestra.run.smithi157.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:40:38.849 INFO:teuthology.orchestra.run.smithi157.stderr:curl: (7) Failed to connect to smithi157.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:40:46.850 DEBUG:teuthology.orchestra.run.smithi157:> curl http://smithi157.front.sepia.ceph.com:80/ 2024-09-12T17:40:46.860 INFO:teuthology.orchestra.run.smithi157.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:40:46.860 INFO:teuthology.orchestra.run.smithi157.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:40:46.860 INFO:teuthology.orchestra.run.smithi157.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:40:46.861 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:40:46.861 INFO:teuthology.orchestra.run.smithi157.stderr:curl: (7) Failed to connect to smithi157.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:41:02.863 DEBUG:teuthology.orchestra.run.smithi157:> curl http://smithi157.front.sepia.ceph.com:80/ 2024-09-12T17:41:02.875 INFO:teuthology.orchestra.run.smithi157.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:41:02.875 INFO:teuthology.orchestra.run.smithi157.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:41:03.301 INFO:teuthology.orchestra.run.smithi157.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 438 0 --:--:-- --:--:-- --:--:-- 438 2024-09-12T17:41:03.302 INFO:teuthology.orchestra.run.smithi157.stdout:anonymous 2024-09-12T17:41:03.303 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T17:41:03.314 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T17:41:03.314 DEBUG:teuthology.orchestra.run.smithi157:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T17:41:06.245 DEBUG:teuthology.orchestra.run.smithi157:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T17:41:06.903 INFO:teuthology.orchestra.run.smithi157.stdout:Collecting tox==3.15.0 2024-09-12T17:41:07.005 INFO:teuthology.orchestra.run.smithi157.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T17:41:07.062 INFO:teuthology.orchestra.run.smithi157.stdout: ---------------------------------------- 82.1/82.1 KB 1.4 MB/s eta 0:00:00 2024-09-12T17:41:07.197 INFO:teuthology.orchestra.run.smithi157.stdout:Collecting py<2,>=1.4.17 2024-09-12T17:41:07.212 INFO:teuthology.orchestra.run.smithi157.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T17:41:07.263 INFO:teuthology.orchestra.run.smithi157.stdout: ---------------------------------------- 98.7/98.7 KB 1.9 MB/s eta 0:00:00 2024-09-12T17:41:07.375 INFO:teuthology.orchestra.run.smithi157.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T17:41:07.390 INFO:teuthology.orchestra.run.smithi157.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T17:41:07.523 INFO:teuthology.orchestra.run.smithi157.stdout:Collecting packaging>=14 2024-09-12T17:41:07.538 INFO:teuthology.orchestra.run.smithi157.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T17:41:07.573 INFO:teuthology.orchestra.run.smithi157.stdout: ---------------------------------------- 54.0/54.0 KB 1.4 MB/s eta 0:00:00 2024-09-12T17:41:07.666 INFO:teuthology.orchestra.run.smithi157.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T17:41:07.682 INFO:teuthology.orchestra.run.smithi157.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T17:41:07.791 INFO:teuthology.orchestra.run.smithi157.stdout:Collecting six<2,>=1.14.0 2024-09-12T17:41:07.806 INFO:teuthology.orchestra.run.smithi157.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:41:07.894 INFO:teuthology.orchestra.run.smithi157.stdout:Collecting toml>=0.9.4 2024-09-12T17:41:07.910 INFO:teuthology.orchestra.run.smithi157.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T17:41:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T17:41:08.230 INFO:teuthology.orchestra.run.smithi157.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T17:41:08.730 INFO:teuthology.orchestra.run.smithi157.stdout: ---------------------------------------- 6.0/6.0 MB 12.1 MB/s eta 0:00:00 2024-09-12T17:41:08.923 INFO:teuthology.orchestra.run.smithi157.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T17:41:08.939 INFO:teuthology.orchestra.run.smithi157.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T17:41:09.047 INFO:teuthology.orchestra.run.smithi157.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T17:41:09.063 INFO:teuthology.orchestra.run.smithi157.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T17:41:09.121 INFO:teuthology.orchestra.run.smithi157.stdout: --------------------------------------- 468.9/468.9 KB 8.7 MB/s eta 0:00:00 2024-09-12T17:41:09.284 INFO:teuthology.orchestra.run.smithi157.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T17:41:10.262 INFO:teuthology.orchestra.run.smithi157.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T17:41:10.349 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:41:10.363 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:41:10.364 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:41:10.364 DEBUG:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:41:10.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:41:10.369 INFO:teuthology.orchestra.run.smithi157.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:41:10.370 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:41:10.419 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:41:10.419 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:41:10.467 INFO:tasks.workunit:timeout=3h 2024-09-12T17:41:10.467 INFO:tasks.workunit:cleanup=True 2024-09-12T17:41:10.467 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:41:10.517 INFO:tasks.workunit.client.0.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:42:07.829 INFO:tasks.workunit.client.0.smithi157.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:42:07.830 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:07.830 INFO:tasks.workunit.client.0.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:42:07.830 INFO:tasks.workunit.client.0.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:42:07.830 INFO:tasks.workunit.client.0.smithi157.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:42:07.830 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:07.830 INFO:tasks.workunit.client.0.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:42:07.830 INFO:tasks.workunit.client.0.smithi157.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:42:07.830 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:07.830 INFO:tasks.workunit.client.0.smithi157.stderr: git switch -c 2024-09-12T17:42:07.831 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:07.831 INFO:tasks.workunit.client.0.smithi157.stderr:Or undo this operation with: 2024-09-12T17:42:07.831 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:07.831 INFO:tasks.workunit.client.0.smithi157.stderr: git switch - 2024-09-12T17:42:07.831 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:07.831 INFO:tasks.workunit.client.0.smithi157.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:42:07.831 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:07.831 INFO:tasks.workunit.client.0.smithi157.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:42:07.836 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:42:07.884 INFO:tasks.workunit.client.0.smithi157.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:42:07.888 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:42:07.888 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:42:08.847 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:42:08.931 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:42:08.990 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:42:08.992 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:42:08.992 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:42:09.037 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:42:09.040 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:42:09.040 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:42:09.088 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T17:42:09.089 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T17:42:09.089 DEBUG:teuthology.orchestra.run.smithi157:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:42:09.145 INFO:tasks.workunit.client.0.smithi157.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:42:09.145 INFO:tasks.workunit.client.0.smithi157.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:42:09.145 INFO:tasks.workunit.client.0.smithi157.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:42:11.919 INFO:tasks.workunit.client.0.smithi157.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:42:11.919 INFO:tasks.workunit.client.0.smithi157.stderr:++ deactivate nondestructive 2024-09-12T17:42:11.919 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T17:42:11.919 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T17:42:11.919 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:42:11.919 INFO:tasks.workunit.client.0.smithi157.stderr:++ hash -r 2024-09-12T17:42:11.919 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ export VIRTUAL_ENV 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ export PATH 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -z '' ']' 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ PS1='(rgw) ' 2024-09-12T17:42:11.920 INFO:tasks.workunit.client.0.smithi157.stderr:++ export PS1 2024-09-12T17:42:11.921 INFO:tasks.workunit.client.0.smithi157.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T17:42:11.921 INFO:tasks.workunit.client.0.smithi157.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T17:42:11.921 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:42:11.921 INFO:tasks.workunit.client.0.smithi157.stderr:++ hash -r 2024-09-12T17:42:11.921 INFO:tasks.workunit.client.0.smithi157.stderr:+ pip install pip --upgrade 2024-09-12T17:42:12.280 INFO:tasks.workunit.client.0.smithi157.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:42:12.526 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting pip 2024-09-12T17:42:12.638 INFO:tasks.workunit.client.0.smithi157.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:42:12.920 INFO:tasks.workunit.client.0.smithi157.stdout: ---------------------------------------- 1.8/1.8 MB 6.6 MB/s eta 0:00:00 2024-09-12T17:42:12.993 INFO:tasks.workunit.client.0.smithi157.stdout:Installing collected packages: pip 2024-09-12T17:42:12.993 INFO:tasks.workunit.client.0.smithi157.stdout: Attempting uninstall: pip 2024-09-12T17:42:12.993 INFO:tasks.workunit.client.0.smithi157.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:42:13.260 INFO:tasks.workunit.client.0.smithi157.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:42:13.266 INFO:tasks.workunit.client.0.smithi157.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:42:14.012 INFO:tasks.workunit.client.0.smithi157.stdout:Successfully installed pip-24.2 2024-09-12T17:42:14.074 INFO:tasks.workunit.client.0.smithi157.stderr:+ pip install boto3 2024-09-12T17:42:15.160 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting boto3 2024-09-12T17:42:15.205 INFO:tasks.workunit.client.0.smithi157.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:42:15.868 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:42:15.882 INFO:tasks.workunit.client.0.smithi157.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:42:16.018 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:42:16.032 INFO:tasks.workunit.client.0.smithi157.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:42:16.180 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:42:16.196 INFO:tasks.workunit.client.0.smithi157.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:42:16.317 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:42:16.333 INFO:tasks.workunit.client.0.smithi157.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:42:16.532 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:42:16.546 INFO:tasks.workunit.client.0.smithi157.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:42:16.797 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:42:16.811 INFO:tasks.workunit.client.0.smithi157.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:42:16.885 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:42:16.983 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:42:17.225 INFO:tasks.workunit.client.0.smithi157.stdout: ---------------------------------------- 12.5/12.5 MB 54.4 MB/s eta 0:00:00 2024-09-12T17:42:17.242 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:42:17.291 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:42:17.350 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:42:17.426 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:42:17.493 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:42:17.669 INFO:tasks.workunit.client.0.smithi157.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:42:18.864 INFO:tasks.workunit.client.0.smithi157.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:42:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T17:42:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T17:42:19.510 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:19.510 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:19.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.551+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.551+0000 7faa663dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:19.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.551+0000 7faa663dd9c0 20 realm 2024-09-12T17:42:19.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.551+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.551+0000 7faa663dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:19.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.551+0000 7faa663dd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:19.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.551+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.551+0000 7faa663dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:19.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.551+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.551+0000 7faa663dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:19.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.551+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.555+0000 7faa663dd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:19.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.555+0000 7faa663dd9c0 20 searching for the correct realm 2024-09-12T17:42:19.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.559+0000 7faa646e4640 0 -- 172.21.15.157:0/3249166911 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7faa580f6040 msgr2=0x7faa580f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:19.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.775+0000 7faa63ee3640 0 -- 172.21.15.157:0/3249166911 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x562327957db0 msgr2=0x56232795a1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:19.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:19.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:19.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:19.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:19.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:19.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:19.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:19.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.783+0000 7faa663dd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 20 zone default found 2024-09-12T17:42:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 4 Realm: () 2024-09-12T17:42:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:19.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:19.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 20 zonegroup default 2024-09-12T17:42:19.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:19.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:19.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:19.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 20 started sync module instance, tier type = 2024-09-12T17:42:19.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.787+0000 7faa663dd9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:19.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.815+0000 7faa663dd9c0 20 add_watcher() i=0 2024-09-12T17:42:19.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.815+0000 7faa663dd9c0 20 add_watcher() i=1 2024-09-12T17:42:19.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.815+0000 7faa663dd9c0 20 add_watcher() i=2 2024-09-12T17:42:19.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.815+0000 7faa663dd9c0 20 add_watcher() i=3 2024-09-12T17:42:19.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.815+0000 7faa663dd9c0 20 add_watcher() i=4 2024-09-12T17:42:19.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.815+0000 7faa663dd9c0 20 add_watcher() i=5 2024-09-12T17:42:19.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.815+0000 7faa663dd9c0 20 add_watcher() i=6 2024-09-12T17:42:19.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.815+0000 7faa663dd9c0 20 add_watcher() i=7 2024-09-12T17:42:19.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.815+0000 7faa663dd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:19.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7fa919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:19.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:19.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:19.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 5 note: GC not initialized 2024-09-12T17:42:19.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7fa918fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 20 Filter name: none 2024-09-12T17:42:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7fa8927fc640 20 reqs_thread_entry: start 2024-09-12T17:42:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T17:42:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:19.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T17:42:19.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:42:19.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T17:42:19.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.823+0000 7faa663dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:19.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.827+0000 7faa663dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:19.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.827+0000 7faa663dd9c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T17:42:19.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.827+0000 7faa663dd9c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:42:19.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.827+0000 7faa663dd9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:42:19.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.827+0000 7faa663dd9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:42:19.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.827+0000 7faa663dd9c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:42:19.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.827+0000 7faa663dd9c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:42:19.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.827+0000 7faa663dd9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T17:42:19.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.831+0000 7fa942ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789952 cookie 94708988000752 notifier 4541 bl.length()=593 2024-09-12T17:42:19.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.831+0000 7fa942ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:42:19.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.831+0000 7fa942ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:42:19.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.859+0000 7faa663dd9c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:42:19.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.859+0000 7faa663dd9c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:42:19.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.859+0000 7faa663dd9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T17:42:19.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.863+0000 7fa942ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789952 cookie 94708987958288 notifier 4541 bl.length()=186 2024-09-12T17:42:19.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.863+0000 7fa942ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:42:19.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.863+0000 7fa942ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:42:19.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.867+0000 7fa919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:19.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.871+0000 7faa663dd9c0 20 remove_watcher() i=0 2024-09-12T17:42:19.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.871+0000 7faa663dd9c0 2 removed watcher, disabling cache 2024-09-12T17:42:19.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.875+0000 7faa663dd9c0 20 remove_watcher() i=1 2024-09-12T17:42:19.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.875+0000 7faa663dd9c0 20 remove_watcher() i=2 2024-09-12T17:42:19.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.879+0000 7faa663dd9c0 20 remove_watcher() i=3 2024-09-12T17:42:19.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.883+0000 7faa663dd9c0 20 remove_watcher() i=4 2024-09-12T17:42:19.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.883+0000 7faa663dd9c0 20 remove_watcher() i=5 2024-09-12T17:42:19.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.883+0000 7faa663dd9c0 20 remove_watcher() i=6 2024-09-12T17:42:19.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:19.887+0000 7faa663dd9c0 20 remove_watcher() i=7 2024-09-12T17:42:23.570 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T17:42:23.570 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:23.570 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:42:23.604 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:23.604 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:23.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.646+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.646+0000 7fd8db3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:23.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.646+0000 7fd8db3689c0 20 realm 2024-09-12T17:42:23.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.646+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.650+0000 7fd8db3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:23.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.650+0000 7fd8db3689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:23.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.650+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.650+0000 7fd8db3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:23.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.650+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.650+0000 7fd8db3689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:23.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.650+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.650+0000 7fd8db3689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:23.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.650+0000 7fd8db3689c0 20 searching for the correct realm 2024-09-12T17:42:23.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.654+0000 7fd8d8e6e640 0 -- 172.21.15.157:0/2659115780 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7fd8c800d3b0 msgr2=0x7fd8c800d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:23.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.662+0000 7fd8d8e6e640 0 -- 172.21.15.157:0/2659115780 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fd8c00f3230 msgr2=0x7fd8c010d0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:23.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.878+0000 7fd8db3689c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:23.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.878+0000 7fd8db3689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:23.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.878+0000 7fd8db3689c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:23.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.878+0000 7fd8db3689c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:23.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.878+0000 7fd8db3689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:23.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.878+0000 7fd8db3689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:23.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.878+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.878+0000 7fd8db3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:23.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.878+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.878+0000 7fd8db3689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:23.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.878+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:23.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 20 zone default found 2024-09-12T17:42:23.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 4 Realm: () 2024-09-12T17:42:23.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:23.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:23.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:23.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 20 zonegroup default 2024-09-12T17:42:23.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:23.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:23.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:23.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 20 started sync module instance, tier type = 2024-09-12T17:42:23.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.882+0000 7fd8db3689c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:23.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.906+0000 7fd8db3689c0 20 add_watcher() i=0 2024-09-12T17:42:23.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.906+0000 7fd8db3689c0 20 add_watcher() i=1 2024-09-12T17:42:23.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.906+0000 7fd8db3689c0 20 add_watcher() i=2 2024-09-12T17:42:23.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.906+0000 7fd8db3689c0 20 add_watcher() i=3 2024-09-12T17:42:23.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.906+0000 7fd8db3689c0 20 add_watcher() i=4 2024-09-12T17:42:23.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.906+0000 7fd8db3689c0 20 add_watcher() i=5 2024-09-12T17:42:23.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.906+0000 7fd8db3689c0 20 add_watcher() i=6 2024-09-12T17:42:23.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.910+0000 7fd8db3689c0 20 add_watcher() i=7 2024-09-12T17:42:23.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.910+0000 7fd8db3689c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:23.916 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd78f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:23.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:23.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:23.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 5 note: GC not initialized 2024-09-12T17:42:23.918 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd78e7e4640 20 reqs_thread_entry: start 2024-09-12T17:42:23.918 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:23.918 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 20 Filter name: none 2024-09-12T17:42:23.918 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd7877fe640 20 reqs_thread_entry: start 2024-09-12T17:42:23.918 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:42:23.918 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:23.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:42:23.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:42:23.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 : miss 2024-09-12T17:42:23.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.914+0000 7fd8db3689c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:23.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.918+0000 7fd8db3689c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:23.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.918+0000 7fd8db3689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 info.flags=0x17 2024-09-12T17:42:23.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.918+0000 7fd8db3689c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 to cache LRU end 2024-09-12T17:42:23.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.918+0000 7fd8db3689c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:23.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.918+0000 7fd8db3689c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:42:23.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.918+0000 7fd8db3689c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 2024-09-12T17:42:23.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.918+0000 7fd8db3689c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:23.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.926+0000 7fd78f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:23.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.930+0000 7fd8db3689c0 20 remove_watcher() i=0 2024-09-12T17:42:23.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.930+0000 7fd8db3689c0 2 removed watcher, disabling cache 2024-09-12T17:42:23.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.934+0000 7fd8db3689c0 20 remove_watcher() i=1 2024-09-12T17:42:23.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.934+0000 7fd8db3689c0 20 remove_watcher() i=2 2024-09-12T17:42:23.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.938+0000 7fd8db3689c0 20 remove_watcher() i=3 2024-09-12T17:42:23.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.942+0000 7fd8db3689c0 20 remove_watcher() i=4 2024-09-12T17:42:23.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.942+0000 7fd8db3689c0 20 remove_watcher() i=5 2024-09-12T17:42:23.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.942+0000 7fd8db3689c0 20 remove_watcher() i=6 2024-09-12T17:42:23.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:23.946+0000 7fd8db3689c0 20 remove_watcher() i=7 2024-09-12T17:42:23.965 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:42:23.995 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:23.995 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:24.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.034+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.038+0000 7f86234129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.038+0000 7f86234129c0 20 realm 2024-09-12T17:42:24.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.038+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.038+0000 7f86234129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.038+0000 7f86234129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:24.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.038+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.038+0000 7f86234129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.038+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.038+0000 7f86234129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:24.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.038+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.042+0000 7f86234129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:24.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.042+0000 7f86234129c0 20 searching for the correct realm 2024-09-12T17:42:24.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.046+0000 7f8620717640 0 -- 172.21.15.157:0/2267015827 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f8614041b60 msgr2=0x7f861403a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:24.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.054+0000 7f8620717640 0 -- 172.21.15.157:0/2267015827 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f84ec07de40 msgr2=0x7f84ec080270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:24.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.058+0000 7f86234129c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:24.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.058+0000 7f86234129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:24.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.058+0000 7f86234129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:24.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.058+0000 7f86234129c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:24.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.058+0000 7f86234129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:24.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.058+0000 7f86234129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:24.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.058+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.058+0000 7f86234129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.058+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:24.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:24.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 zone default found 2024-09-12T17:42:24.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 4 Realm: () 2024-09-12T17:42:24.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:24.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:24.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:24.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 zonegroup default 2024-09-12T17:42:24.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 started sync module instance, tier type = 2024-09-12T17:42:24.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.062+0000 7f86234129c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:24.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.078+0000 7f86234129c0 20 add_watcher() i=0 2024-09-12T17:42:24.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.078+0000 7f86234129c0 20 add_watcher() i=1 2024-09-12T17:42:24.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.078+0000 7f86234129c0 20 add_watcher() i=2 2024-09-12T17:42:24.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.078+0000 7f86234129c0 20 add_watcher() i=3 2024-09-12T17:42:24.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.078+0000 7f86234129c0 20 add_watcher() i=4 2024-09-12T17:42:24.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.078+0000 7f86234129c0 20 add_watcher() i=5 2024-09-12T17:42:24.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.078+0000 7f86234129c0 20 add_watcher() i=6 2024-09-12T17:42:24.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.082+0000 7f86234129c0 20 add_watcher() i=7 2024-09-12T17:42:24.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.082+0000 7f86234129c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:24.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.082+0000 7f84d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:24.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.082+0000 7f86234129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:24.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.082+0000 7f86234129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:24.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.082+0000 7f86234129c0 5 note: GC not initialized 2024-09-12T17:42:24.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.082+0000 7f84d67e4640 20 reqs_thread_entry: start 2024-09-12T17:42:24.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:24.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 Filter name: none 2024-09-12T17:42:24.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f84cf7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:24.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:24.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:24.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:24.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:24.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:24.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.086+0000 7f86234129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:24.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.090+0000 7f84d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:24.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.094+0000 7f86234129c0 20 remove_watcher() i=0 2024-09-12T17:42:24.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.094+0000 7f86234129c0 2 removed watcher, disabling cache 2024-09-12T17:42:24.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.098+0000 7f86234129c0 20 remove_watcher() i=1 2024-09-12T17:42:24.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.098+0000 7f86234129c0 20 remove_watcher() i=2 2024-09-12T17:42:24.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.102+0000 7f86234129c0 20 remove_watcher() i=3 2024-09-12T17:42:24.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.102+0000 7f86234129c0 20 remove_watcher() i=4 2024-09-12T17:42:24.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.102+0000 7f86234129c0 20 remove_watcher() i=5 2024-09-12T17:42:24.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.106+0000 7f86234129c0 20 remove_watcher() i=6 2024-09-12T17:42:24.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.106+0000 7f86234129c0 20 remove_watcher() i=7 2024-09-12T17:42:24.123 INFO:tasks.workunit.client.0.smithi157.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 100, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T17:42:24.123 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T17:42:24.123 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:24.123 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:42:24.155 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:24.155 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:24.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.194+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.194+0000 7f049b5c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.194+0000 7f049b5c09c0 20 realm 2024-09-12T17:42:24.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.194+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.194+0000 7f049b5c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.194+0000 7f049b5c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:24.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.194+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.194+0000 7f049b5c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.194+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.198+0000 7f049b5c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:24.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.198+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.198+0000 7f049b5c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:24.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.198+0000 7f049b5c09c0 20 searching for the correct realm 2024-09-12T17:42:24.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.202+0000 7f04998c7640 0 -- 172.21.15.157:0/58658389 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55e0ed726c70 msgr2=0x55e0ed7290d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:24.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.210+0000 7f04988c5640 0 -- 172.21.15.157:0/58658389 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f04900e7040 msgr2=0x7f04900cd420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:24.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:24.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:24.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:24.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:24.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:24.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:24.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:24.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:24.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 zone default found 2024-09-12T17:42:24.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 4 Realm: () 2024-09-12T17:42:24.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:24.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:24.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:24.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 zonegroup default 2024-09-12T17:42:24.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:24.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 started sync module instance, tier type = 2024-09-12T17:42:24.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.218+0000 7f049b5c09c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:24.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.238+0000 7f049b5c09c0 20 add_watcher() i=0 2024-09-12T17:42:24.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.238+0000 7f049b5c09c0 20 add_watcher() i=1 2024-09-12T17:42:24.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.238+0000 7f049b5c09c0 20 add_watcher() i=2 2024-09-12T17:42:24.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.238+0000 7f049b5c09c0 20 add_watcher() i=3 2024-09-12T17:42:24.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.238+0000 7f049b5c09c0 20 add_watcher() i=4 2024-09-12T17:42:24.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.238+0000 7f049b5c09c0 20 add_watcher() i=5 2024-09-12T17:42:24.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.238+0000 7f049b5c09c0 20 add_watcher() i=6 2024-09-12T17:42:24.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.238+0000 7f049b5c09c0 20 add_watcher() i=7 2024-09-12T17:42:24.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.238+0000 7f049b5c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:24.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.238+0000 7f034f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:24.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:24.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:24.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 5 note: GC not initialized 2024-09-12T17:42:24.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f034e7e4640 20 reqs_thread_entry: start 2024-09-12T17:42:24.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:24.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 20 Filter name: none 2024-09-12T17:42:24.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f02bffff640 20 reqs_thread_entry: start 2024-09-12T17:42:24.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:42:24.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:24.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:42:24.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:42:24.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 : miss 2024-09-12T17:42:24.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:24.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:24.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 info.flags=0x17 2024-09-12T17:42:24.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 to cache LRU end 2024-09-12T17:42:24.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:24.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:42:24.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 2024-09-12T17:42:24.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.242+0000 7f049b5c09c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:24.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.246+0000 7f049b5c09c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:42:24.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.246+0000 7f049b5c09c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:42:24.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.246+0000 7f034f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:24.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.250+0000 7f049b5c09c0 20 remove_watcher() i=0 2024-09-12T17:42:24.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.250+0000 7f049b5c09c0 2 removed watcher, disabling cache 2024-09-12T17:42:24.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.250+0000 7f049b5c09c0 20 remove_watcher() i=1 2024-09-12T17:42:24.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.254+0000 7f049b5c09c0 20 remove_watcher() i=2 2024-09-12T17:42:24.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.254+0000 7f049b5c09c0 20 remove_watcher() i=3 2024-09-12T17:42:24.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.258+0000 7f049b5c09c0 20 remove_watcher() i=4 2024-09-12T17:42:24.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.258+0000 7f049b5c09c0 20 remove_watcher() i=5 2024-09-12T17:42:24.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.262+0000 7f049b5c09c0 20 remove_watcher() i=6 2024-09-12T17:42:24.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:24.262+0000 7f049b5c09c0 20 remove_watcher() i=7 2024-09-12T17:42:24.278 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:42:24.708 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:42:26.324 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:42:26.325 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:42:26.360 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:26.360 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:26.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.398+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.402+0000 7f58fffef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.402+0000 7f58fffef9c0 20 realm 2024-09-12T17:42:26.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.402+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.402+0000 7f58fffef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.402+0000 7f58fffef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:26.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.402+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.402+0000 7f58fffef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.402+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.402+0000 7f58fffef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:26.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.402+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.406+0000 7f58fffef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.406+0000 7f58fffef9c0 20 searching for the correct realm 2024-09-12T17:42:26.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.410+0000 7f58fd2f4640 0 -- 172.21.15.157:0/3343979520 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x565241d36f40 msgr2=0x565241d39330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:26.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.418+0000 7f58fd2f4640 0 -- 172.21.15.157:0/3343979520 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f58f4121040 msgr2=0x7f58f40fcd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:26.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:26.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:26.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:26.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:26.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:26.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:26.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:26.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:26.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 zone default found 2024-09-12T17:42:26.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 4 Realm: () 2024-09-12T17:42:26.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:26.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:26.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:26.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 zonegroup default 2024-09-12T17:42:26.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.422+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.426+0000 7f58fffef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.426+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.426+0000 7f58fffef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.426+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.426+0000 7f58fffef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.426+0000 7f58fffef9c0 20 started sync module instance, tier type = 2024-09-12T17:42:26.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.426+0000 7f58fffef9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.442+0000 7f58fffef9c0 20 add_watcher() i=0 2024-09-12T17:42:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.442+0000 7f58fffef9c0 20 add_watcher() i=1 2024-09-12T17:42:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.442+0000 7f58fffef9c0 20 add_watcher() i=2 2024-09-12T17:42:26.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.442+0000 7f58fffef9c0 20 add_watcher() i=3 2024-09-12T17:42:26.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.442+0000 7f58fffef9c0 20 add_watcher() i=4 2024-09-12T17:42:26.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.442+0000 7f58fffef9c0 20 add_watcher() i=5 2024-09-12T17:42:26.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.442+0000 7f58fffef9c0 20 add_watcher() i=6 2024-09-12T17:42:26.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.442+0000 7f58fffef9c0 20 add_watcher() i=7 2024-09-12T17:42:26.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.442+0000 7f58fffef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:26.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.442+0000 7f57affff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:26.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:26.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:26.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 5 note: GC not initialized 2024-09-12T17:42:26.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f57aeffd640 20 reqs_thread_entry: start 2024-09-12T17:42:26.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:26.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 Filter name: none 2024-09-12T17:42:26.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f57acff9640 20 reqs_thread_entry: start 2024-09-12T17:42:26.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:26.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:26.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:26.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:26.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 INFO: main: starting shard=0 2024-09-12T17:42:26.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:26.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:42:26.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.446+0000 7f58fffef9c0 20 INFO: main: done 2024-09-12T17:42:26.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.450+0000 7f57affff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:26.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.454+0000 7f58fffef9c0 20 remove_watcher() i=0 2024-09-12T17:42:26.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.454+0000 7f58fffef9c0 2 removed watcher, disabling cache 2024-09-12T17:42:26.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.454+0000 7f58fffef9c0 20 remove_watcher() i=1 2024-09-12T17:42:26.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.458+0000 7f58fffef9c0 20 remove_watcher() i=2 2024-09-12T17:42:26.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.458+0000 7f58fffef9c0 20 remove_watcher() i=3 2024-09-12T17:42:26.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.462+0000 7f58fffef9c0 20 remove_watcher() i=4 2024-09-12T17:42:26.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.466+0000 7f58fffef9c0 20 remove_watcher() i=5 2024-09-12T17:42:26.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.466+0000 7f58fffef9c0 20 remove_watcher() i=6 2024-09-12T17:42:26.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.466+0000 7f58fffef9c0 20 remove_watcher() i=7 2024-09-12T17:42:26.664 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:42:26.664 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:42:26.700 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:26.700 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:26.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.738+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 20 realm 2024-09-12T17:42:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:26.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:26.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.742+0000 7fea458309c0 20 searching for the correct realm 2024-09-12T17:42:26.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.750+0000 7fea42b35640 0 -- 172.21.15.157:0/1858132882 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fea3408ab40 msgr2=0x7fea34091320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:26.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.754+0000 7fea42b35640 0 -- 172.21.15.157:0/1858132882 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fe90c07dea0 msgr2=0x7fe90c0802d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:26.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:26.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:26.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:26.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:26.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:26.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:26.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:26.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:26.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 zone default found 2024-09-12T17:42:26.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 4 Realm: () 2024-09-12T17:42:26.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:26.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:26.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:26.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 zonegroup default 2024-09-12T17:42:26.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.762+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.766+0000 7fea458309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.766+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.766+0000 7fea458309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:26.769 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.766+0000 7fea458309c0 20 started sync module instance, tier type = 2024-09-12T17:42:26.769 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.766+0000 7fea458309c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:26.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.782+0000 7fea458309c0 20 add_watcher() i=0 2024-09-12T17:42:26.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.782+0000 7fea458309c0 20 add_watcher() i=1 2024-09-12T17:42:26.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.782+0000 7fea458309c0 20 add_watcher() i=2 2024-09-12T17:42:26.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.782+0000 7fea458309c0 20 add_watcher() i=3 2024-09-12T17:42:26.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.782+0000 7fea458309c0 20 add_watcher() i=4 2024-09-12T17:42:26.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.782+0000 7fea458309c0 20 add_watcher() i=5 2024-09-12T17:42:26.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.782+0000 7fea458309c0 20 add_watcher() i=6 2024-09-12T17:42:26.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.782+0000 7fea458309c0 20 add_watcher() i=7 2024-09-12T17:42:26.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.782+0000 7fea458309c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:26.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.786+0000 7fe8f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:26.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.786+0000 7fea458309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:26.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.786+0000 7fea458309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:26.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.786+0000 7fea458309c0 5 note: GC not initialized 2024-09-12T17:42:26.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.786+0000 7fe8f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:26.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.786+0000 7fea458309c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:26.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.786+0000 7fea458309c0 20 Filter name: none 2024-09-12T17:42:26.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.786+0000 7fe8727fc640 20 reqs_thread_entry: start 2024-09-12T17:42:26.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.786+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.786+0000 7fea458309c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:26.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.786+0000 7fea458309c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:26.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.790+0000 7fea458309c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:26.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.790+0000 7fea458309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:26.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.790+0000 7fea458309c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:26.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.790+0000 7fea458309c0 20 INFO: main: starting shard=0 2024-09-12T17:42:26.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.790+0000 7fea458309c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:26.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.790+0000 7fea458309c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:42:26.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.790+0000 7fea458309c0 20 INFO: main: done 2024-09-12T17:42:26.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.790+0000 7fe8f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:26.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.798+0000 7fea458309c0 20 remove_watcher() i=0 2024-09-12T17:42:26.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.798+0000 7fea458309c0 2 removed watcher, disabling cache 2024-09-12T17:42:26.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.798+0000 7fea458309c0 20 remove_watcher() i=1 2024-09-12T17:42:26.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.802+0000 7fea458309c0 20 remove_watcher() i=2 2024-09-12T17:42:26.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.802+0000 7fea458309c0 20 remove_watcher() i=3 2024-09-12T17:42:26.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.802+0000 7fea458309c0 20 remove_watcher() i=4 2024-09-12T17:42:26.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.806+0000 7fea458309c0 20 remove_watcher() i=5 2024-09-12T17:42:26.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.806+0000 7fea458309c0 20 remove_watcher() i=6 2024-09-12T17:42:26.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:26.806+0000 7fea458309c0 20 remove_watcher() i=7 2024-09-12T17:42:26.960 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:42:26.960 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:42:26.996 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:26.996 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:27.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.034+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.038+0000 7f9804ca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.038+0000 7f9804ca49c0 20 realm 2024-09-12T17:42:27.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.038+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.038+0000 7f9804ca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.038+0000 7f9804ca49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:27.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.038+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.038+0000 7f9804ca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.038+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.038+0000 7f9804ca49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:27.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.038+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.042+0000 7f9804ca49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:27.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.042+0000 7f9804ca49c0 20 searching for the correct realm 2024-09-12T17:42:27.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.050+0000 7f9802fab640 0 -- 172.21.15.157:0/167025614 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f97ec00e040 msgr2=0x7f97ec037920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:27.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.054+0000 7f9801fa9640 0 -- 172.21.15.157:0/167025614 >> [v2:172.21.15.157:6800/2182114182,v1:172.21.15.157:6801/2182114182] conn(0x558631419bc0 msgr2=0x55863141bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:27.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.058+0000 7f9804ca49c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:27.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.058+0000 7f9804ca49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:27.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.058+0000 7f9804ca49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:27.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.058+0000 7f9804ca49c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:27.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.058+0000 7f9804ca49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:27.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.058+0000 7f9804ca49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:27.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.058+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.058+0000 7f9804ca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.058+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:27.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:27.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 zone default found 2024-09-12T17:42:27.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 4 Realm: () 2024-09-12T17:42:27.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:27.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:27.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:27.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 zonegroup default 2024-09-12T17:42:27.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 started sync module instance, tier type = 2024-09-12T17:42:27.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.062+0000 7f9804ca49c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:27.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.078+0000 7f9804ca49c0 20 add_watcher() i=0 2024-09-12T17:42:27.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.078+0000 7f9804ca49c0 20 add_watcher() i=1 2024-09-12T17:42:27.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.078+0000 7f9804ca49c0 20 add_watcher() i=2 2024-09-12T17:42:27.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.078+0000 7f9804ca49c0 20 add_watcher() i=3 2024-09-12T17:42:27.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.078+0000 7f9804ca49c0 20 add_watcher() i=4 2024-09-12T17:42:27.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.078+0000 7f9804ca49c0 20 add_watcher() i=5 2024-09-12T17:42:27.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.078+0000 7f9804ca49c0 20 add_watcher() i=6 2024-09-12T17:42:27.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.078+0000 7f9804ca49c0 20 add_watcher() i=7 2024-09-12T17:42:27.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.078+0000 7f9804ca49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:27.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f96b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:27.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:27.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:27.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 5 note: GC not initialized 2024-09-12T17:42:27.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f96337fe640 20 reqs_thread_entry: start 2024-09-12T17:42:27.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:27.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 Filter name: none 2024-09-12T17:42:27.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f96317fa640 20 reqs_thread_entry: start 2024-09-12T17:42:27.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:27.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:27.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:27.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:27.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 INFO: main: starting shard=0 2024-09-12T17:42:27.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.082+0000 7f9804ca49c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:27.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.086+0000 7f9804ca49c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:42:27.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.086+0000 7f9804ca49c0 20 INFO: main: done 2024-09-12T17:42:27.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.086+0000 7f96b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:27.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.090+0000 7f9804ca49c0 20 remove_watcher() i=0 2024-09-12T17:42:27.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.090+0000 7f9804ca49c0 2 removed watcher, disabling cache 2024-09-12T17:42:27.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.094+0000 7f9804ca49c0 20 remove_watcher() i=1 2024-09-12T17:42:27.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.094+0000 7f9804ca49c0 20 remove_watcher() i=2 2024-09-12T17:42:27.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.098+0000 7f9804ca49c0 20 remove_watcher() i=3 2024-09-12T17:42:27.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.098+0000 7f9804ca49c0 20 remove_watcher() i=4 2024-09-12T17:42:27.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.102+0000 7f9804ca49c0 20 remove_watcher() i=5 2024-09-12T17:42:27.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.102+0000 7f9804ca49c0 20 remove_watcher() i=6 2024-09-12T17:42:27.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.102+0000 7f9804ca49c0 20 remove_watcher() i=7 2024-09-12T17:42:27.252 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:42:27.253 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:42:27.291 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:27.291 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:27.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.334+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.334+0000 7f0a3b0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.334+0000 7f0a3b0be9c0 20 realm 2024-09-12T17:42:27.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.334+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.339 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.334+0000 7f0a3b0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.339 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.334+0000 7f0a3b0be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:27.339 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.334+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.339 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.338+0000 7f0a3b0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.339 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.338+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.338+0000 7f0a3b0be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:27.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.338+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.338+0000 7f0a3b0be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:27.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.338+0000 7f0a3b0be9c0 20 searching for the correct realm 2024-09-12T17:42:27.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.342+0000 7f0a393c5640 0 -- 172.21.15.157:0/3947450692 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x563f8244a600 msgr2=0x563f8244cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:27.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.350+0000 7f0a38bc4640 0 -- 172.21.15.157:0/3947450692 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f0a2c056970 msgr2=0x7f0a2c025410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:27.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:27.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:27.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:27.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:27.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:27.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:27.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:27.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:27.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 zone default found 2024-09-12T17:42:27.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 4 Realm: () 2024-09-12T17:42:27.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:27.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:27.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:27.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 zonegroup default 2024-09-12T17:42:27.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.358+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.362+0000 7f0a3b0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.362+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.362+0000 7f0a3b0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:27.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.362+0000 7f0a3b0be9c0 20 started sync module instance, tier type = 2024-09-12T17:42:27.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.362+0000 7f0a3b0be9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:27.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.378+0000 7f0a3b0be9c0 20 add_watcher() i=0 2024-09-12T17:42:27.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.378+0000 7f0a3b0be9c0 20 add_watcher() i=1 2024-09-12T17:42:27.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.378+0000 7f0a3b0be9c0 20 add_watcher() i=2 2024-09-12T17:42:27.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.378+0000 7f0a3b0be9c0 20 add_watcher() i=3 2024-09-12T17:42:27.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.378+0000 7f0a3b0be9c0 20 add_watcher() i=4 2024-09-12T17:42:27.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.378+0000 7f0a3b0be9c0 20 add_watcher() i=5 2024-09-12T17:42:27.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.378+0000 7f0a3b0be9c0 20 add_watcher() i=6 2024-09-12T17:42:27.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.378+0000 7f0a3b0be9c0 20 add_watcher() i=7 2024-09-12T17:42:27.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.378+0000 7f0a3b0be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:27.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f08eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:27.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:27.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:27.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 5 note: GC not initialized 2024-09-12T17:42:27.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f08edfe3640 20 reqs_thread_entry: start 2024-09-12T17:42:27.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:27.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 Filter name: none 2024-09-12T17:42:27.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f085f7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:27.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:27.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:27.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:27.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:27.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:27.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 INFO: main: starting shard=0 2024-09-12T17:42:27.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.382+0000 7f0a3b0be9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:27.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.386+0000 7f0a3b0be9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:42:27.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.386+0000 7f0a3b0be9c0 20 INFO: main: done 2024-09-12T17:42:27.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.386+0000 7f08eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:27.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.390+0000 7f0a3b0be9c0 20 remove_watcher() i=0 2024-09-12T17:42:27.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.390+0000 7f0a3b0be9c0 2 removed watcher, disabling cache 2024-09-12T17:42:27.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.394+0000 7f0a3b0be9c0 20 remove_watcher() i=1 2024-09-12T17:42:27.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.394+0000 7f0a3b0be9c0 20 remove_watcher() i=2 2024-09-12T17:42:27.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.398+0000 7f0a3b0be9c0 20 remove_watcher() i=3 2024-09-12T17:42:27.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.398+0000 7f0a3b0be9c0 20 remove_watcher() i=4 2024-09-12T17:42:27.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.402+0000 7f0a3b0be9c0 20 remove_watcher() i=5 2024-09-12T17:42:27.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.402+0000 7f0a3b0be9c0 20 remove_watcher() i=6 2024-09-12T17:42:27.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:27.402+0000 7f0a3b0be9c0 20 remove_watcher() i=7 2024-09-12T17:42:27.446 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:42:27.880 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:42:28.321 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T17:42:28.321 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:28.321 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:42:28.354 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:28.355 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:28.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.390+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.390+0000 7f36e13989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:28.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.390+0000 7f36e13989c0 20 realm 2024-09-12T17:42:28.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.390+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.390+0000 7f36e13989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:28.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.390+0000 7f36e13989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:28.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.390+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.390+0000 7f36e13989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:28.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.390+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.394+0000 7f36e13989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:28.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.394+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.394+0000 7f36e13989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:28.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.394+0000 7f36e13989c0 20 searching for the correct realm 2024-09-12T17:42:28.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.398+0000 7f36df69f640 0 -- 172.21.15.157:0/3028548365 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f36c809c0b0 msgr2=0x7f36c8015950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:28.616 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.614+0000 7f36dee9e640 0 -- 172.21.15.157:0/3028548365 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55db028c7c60 msgr2=0x55db028ca070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:28.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:28.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:28.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:28.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:28.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:28.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:28.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:28.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:28.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:28.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 zone default found 2024-09-12T17:42:28.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 4 Realm: () 2024-09-12T17:42:28.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:28.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:28.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:28.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 zonegroup default 2024-09-12T17:42:28.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:28.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.622+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.626+0000 7f36e13989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:28.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.626+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.626+0000 7f36e13989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:28.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.626+0000 7f36e13989c0 20 started sync module instance, tier type = 2024-09-12T17:42:28.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.626+0000 7f36e13989c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:28.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.650+0000 7f36e13989c0 20 add_watcher() i=0 2024-09-12T17:42:28.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.650+0000 7f36e13989c0 20 add_watcher() i=1 2024-09-12T17:42:28.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.650+0000 7f36e13989c0 20 add_watcher() i=2 2024-09-12T17:42:28.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.650+0000 7f36e13989c0 20 add_watcher() i=3 2024-09-12T17:42:28.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.650+0000 7f36e13989c0 20 add_watcher() i=4 2024-09-12T17:42:28.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.650+0000 7f36e13989c0 20 add_watcher() i=5 2024-09-12T17:42:28.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.650+0000 7f36e13989c0 20 add_watcher() i=6 2024-09-12T17:42:28.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.654+0000 7f36e13989c0 20 add_watcher() i=7 2024-09-12T17:42:28.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.654+0000 7f36e13989c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:28.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f3595fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:28.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:28.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:28.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 5 note: GC not initialized 2024-09-12T17:42:28.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f3594fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:28.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:28.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 20 Filter name: none 2024-09-12T17:42:28.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f358dffb640 20 reqs_thread_entry: start 2024-09-12T17:42:28.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:42:28.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.663 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:28.663 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:42:28.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:42:28.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 : miss 2024-09-12T17:42:28.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.658+0000 7f36e13989c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:28.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.662+0000 7f36e13989c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:28.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.662+0000 7f36e13989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 info.flags=0x17 2024-09-12T17:42:28.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.662+0000 7f36e13989c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 to cache LRU end 2024-09-12T17:42:28.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.662+0000 7f36e13989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:28.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.662+0000 7f36e13989c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:42:28.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.662+0000 7f36e13989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 2024-09-12T17:42:28.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.662+0000 7f36e13989c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:28.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.666+0000 7f36e13989c0 1 NOTICE: finished shard 0 (4 entries found) 2024-09-12T17:42:28.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.666+0000 7f36e13989c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T17:42:28.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.666+0000 7f3595fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:28.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.674+0000 7f36e13989c0 20 remove_watcher() i=0 2024-09-12T17:42:28.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.674+0000 7f36e13989c0 2 removed watcher, disabling cache 2024-09-12T17:42:28.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.674+0000 7f36e13989c0 20 remove_watcher() i=1 2024-09-12T17:42:28.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.678+0000 7f36e13989c0 20 remove_watcher() i=2 2024-09-12T17:42:28.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.678+0000 7f36e13989c0 20 remove_watcher() i=3 2024-09-12T17:42:28.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.682+0000 7f36e13989c0 20 remove_watcher() i=4 2024-09-12T17:42:28.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.682+0000 7f36e13989c0 20 remove_watcher() i=5 2024-09-12T17:42:28.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.686+0000 7f36e13989c0 20 remove_watcher() i=6 2024-09-12T17:42:28.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:28.686+0000 7f36e13989c0 20 remove_watcher() i=7 2024-09-12T17:42:28.712 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: unlinked entries are not listable 2024-09-12T17:42:28.712 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:28.843 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T17:42:28.843 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:29.048 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T17:42:29.048 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:29.049 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:42:29.088 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:29.089 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:29.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.130+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.130+0000 7f633b69e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:29.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.130+0000 7f633b69e9c0 20 realm 2024-09-12T17:42:29.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.130+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.130+0000 7f633b69e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:29.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.130+0000 7f633b69e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:29.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.130+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.130+0000 7f633b69e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:29.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.130+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.134+0000 7f633b69e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:29.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.134+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.134+0000 7f633b69e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:29.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.134+0000 7f633b69e9c0 20 searching for the correct realm 2024-09-12T17:42:29.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.138+0000 7f63391a4640 0 -- 172.21.15.157:0/2671779792 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f6334032040 msgr2=0x7f633401b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:29.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.142+0000 7f63391a4640 0 -- 172.21.15.157:0/2671779792 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f6330068be0 msgr2=0x7f633005db70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.358+0000 7f633b69e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.358+0000 7f633b69e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.358+0000 7f633b69e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.358+0000 7f633b69e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.358+0000 7f633b69e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.358+0000 7f633b69e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.358+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:29.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:29.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:29.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 zone default found 2024-09-12T17:42:29.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 4 Realm: () 2024-09-12T17:42:29.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:29.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:29.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:29.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 zonegroup default 2024-09-12T17:42:29.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:29.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:29.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.362+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.366+0000 7f633b69e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:29.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.366+0000 7f633b69e9c0 20 started sync module instance, tier type = 2024-09-12T17:42:29.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.366+0000 7f633b69e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:29.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.390+0000 7f633b69e9c0 20 add_watcher() i=0 2024-09-12T17:42:29.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.390+0000 7f633b69e9c0 20 add_watcher() i=1 2024-09-12T17:42:29.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.390+0000 7f633b69e9c0 20 add_watcher() i=2 2024-09-12T17:42:29.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.390+0000 7f633b69e9c0 20 add_watcher() i=3 2024-09-12T17:42:29.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.390+0000 7f633b69e9c0 20 add_watcher() i=4 2024-09-12T17:42:29.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.390+0000 7f633b69e9c0 20 add_watcher() i=5 2024-09-12T17:42:29.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.390+0000 7f633b69e9c0 20 add_watcher() i=6 2024-09-12T17:42:29.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.390+0000 7f633b69e9c0 20 add_watcher() i=7 2024-09-12T17:42:29.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.390+0000 7f633b69e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:29.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.394+0000 7f61ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:29.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:29.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:29.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 5 note: GC not initialized 2024-09-12T17:42:29.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f61ee7e4640 20 reqs_thread_entry: start 2024-09-12T17:42:29.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:29.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 20 Filter name: none 2024-09-12T17:42:29.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f615ffff640 20 reqs_thread_entry: start 2024-09-12T17:42:29.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:42:29.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:29.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:42:29.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:42:29.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 : miss 2024-09-12T17:42:29.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:29.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:29.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 info.flags=0x17 2024-09-12T17:42:29.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 to cache LRU end 2024-09-12T17:42:29.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:29.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:42:29.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 2024-09-12T17:42:29.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.398+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.402+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.402+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:c state=0x557e0cd1df88 s->prefetch_data=0 2024-09-12T17:42:29.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.402+0000 7f633b69e9c0 20 get_obj_state: setting s->obj_tag to bjg0h20kn2qmsrl2tuywz41xwpoje90l 2024-09-12T17:42:29.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.402+0000 7f633b69e9c0 20 get_obj_state_impl: setting s->olh_tag to xpnks8y2ixcwq8hb0gu2yn62f2kd2hcg 2024-09-12T17:42:29.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.402+0000 7f633b69e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xpnks8y2ixcwq8hb0gu2yn62f2kd2hcg 2024-09-12T17:42:29.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.406+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.410+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.410+0000 7f633b69e9c0 20 olh_log_entry: epoch=3 op=3 key=c[Q.qsQpzSGeQ7q5x7Vgck1u9BtbAuI-j] 2024-09-12T17:42:29.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.410+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:_:Q.qsQpzSGeQ7q5x7Vgck1u9BtbAuI-j_c state=0x557e0cd18538 s->prefetch_data=0 2024-09-12T17:42:29.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.414+0000 7f633b69e9c0 10 manifest: total_size = 11 2024-09-12T17:42:29.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.414+0000 7f633b69e9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6634717768353075007 2024-09-12T17:42:29.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.414+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:_:Q.qsQpzSGeQ7q5x7Vgck1u9BtbAuI-j_c state=0x557e0cd18538 s->prefetch_data=0 2024-09-12T17:42:29.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.414+0000 7f633b69e9c0 20 prepare_atomic_modification: state is not atomic. state=0x557e0cd18538 2024-09-12T17:42:29.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.414+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.418+0000 7f633b69e9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:42:29.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.418+0000 7f633b69e9c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:42:29.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.418+0000 7f633b69e9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:42:29.421 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.418+0000 7f633b69e9c0 5 delete_objs_inline: removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1__shadow:Q.qsQpzSGeQ7q5x7Vgck1u9BtbAuI-j_.b4QG9n54ydESDHl1em2LOtOwqUvmV3U_0 2024-09-12T17:42:29.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.418+0000 7f633b69e9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:42:29.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.422+0000 7f620bfff640 20 handle_completion(): completion ok for obj=c[Q.qsQpzSGeQ7q5x7Vgck1u9BtbAuI-j] 2024-09-12T17:42:29.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.422+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.422+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.426+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.426+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.426+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:d state=0x557e0cd1da78 s->prefetch_data=0 2024-09-12T17:42:29.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.430+0000 7f633b69e9c0 20 get_obj_state: setting s->obj_tag to pdk550yr65kuxyx25u5yi39q662mud1e 2024-09-12T17:42:29.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.430+0000 7f633b69e9c0 20 get_obj_state_impl: setting s->olh_tag to l43rvkz8lgy7s7ibaypxux9mx1sm6q12 2024-09-12T17:42:29.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.430+0000 7f633b69e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l43rvkz8lgy7s7ibaypxux9mx1sm6q12 2024-09-12T17:42:29.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.430+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.434+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.434+0000 7f633b69e9c0 20 olh_log_entry: epoch=3 op=3 key=d[UPRd7dbpRRbovBJGbca.ESg1jDwQeXf] 2024-09-12T17:42:29.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.434+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:_:UPRd7dbpRRbovBJGbca.ESg1jDwQeXf_d state=0x557e0cd18538 s->prefetch_data=0 2024-09-12T17:42:29.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.438+0000 7f633b69e9c0 10 manifest: total_size = 22 2024-09-12T17:42:29.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.438+0000 7f633b69e9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11160072630021807412 2024-09-12T17:42:29.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.438+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:_:UPRd7dbpRRbovBJGbca.ESg1jDwQeXf_d state=0x557e0cd18538 s->prefetch_data=0 2024-09-12T17:42:29.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.438+0000 7f633b69e9c0 20 prepare_atomic_modification: state is not atomic. state=0x557e0cd18538 2024-09-12T17:42:29.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.438+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.442+0000 7f633b69e9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:42:29.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.442+0000 7f633b69e9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:42:29.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.442+0000 7f633b69e9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:42:29.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.442+0000 7f633b69e9c0 5 delete_objs_inline: removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1__shadow:UPRd7dbpRRbovBJGbca.ESg1jDwQeXf_.hiLkvvbAr3uKoSfCC49WbrVmfAAEImO_0 2024-09-12T17:42:29.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.446+0000 7f633b69e9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:42:29.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.446+0000 7f620bfff640 20 handle_completion(): completion ok for obj=d[UPRd7dbpRRbovBJGbca.ESg1jDwQeXf] 2024-09-12T17:42:29.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.446+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.446+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.450+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.450+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.450+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:e state=0x557e0cd1da78 s->prefetch_data=0 2024-09-12T17:42:29.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.454+0000 7f633b69e9c0 20 get_obj_state: setting s->obj_tag to go2bksli3v8i39o4psr6ohf285llu79f 2024-09-12T17:42:29.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.454+0000 7f633b69e9c0 20 get_obj_state_impl: setting s->olh_tag to bourthc4fgcy8lpruae3lh6v630vxwyp 2024-09-12T17:42:29.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.454+0000 7f633b69e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bourthc4fgcy8lpruae3lh6v630vxwyp 2024-09-12T17:42:29.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.454+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.458+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.462+0000 7f633b69e9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:42:29.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.462+0000 7f633b69e9c0 20 olh_log_entry: epoch=2 op=3 key=e[BAyUL9Yfe6kbVJSWGH5rgQUiIN5-Ij1] 2024-09-12T17:42:29.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.462+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:_:BAyUL9Yfe6kbVJSWGH5rgQUiIN5-Ij1_e state=0x557e0cd18538 s->prefetch_data=0 2024-09-12T17:42:29.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.462+0000 7f633b69e9c0 10 manifest: total_size = 12 2024-09-12T17:42:29.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.462+0000 7f633b69e9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9322223370365465409 2024-09-12T17:42:29.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.462+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:_:BAyUL9Yfe6kbVJSWGH5rgQUiIN5-Ij1_e state=0x557e0cd18538 s->prefetch_data=0 2024-09-12T17:42:29.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.462+0000 7f633b69e9c0 20 prepare_atomic_modification: state is not atomic. state=0x557e0cd18538 2024-09-12T17:42:29.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.462+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.470+0000 7f633b69e9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:42:29.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.470+0000 7f633b69e9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:42:29.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.470+0000 7f633b69e9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:42:29.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.470+0000 7f633b69e9c0 5 delete_objs_inline: removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1__shadow:BAyUL9Yfe6kbVJSWGH5rgQUiIN5-Ij1_.g8KTHxCS9KW8vDbM2xKu3SAlgwdbydn_0 2024-09-12T17:42:29.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.474+0000 7f621cff9640 20 handle_completion(): completion ok for obj=e[BAyUL9Yfe6kbVJSWGH5rgQUiIN5-Ij1] 2024-09-12T17:42:29.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.474+0000 7f633b69e9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:42:29.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.478+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:e state=0x557e0cd1da78 s->prefetch_data=0 2024-09-12T17:42:29.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.478+0000 7f633b69e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bourthc4fgcy8lpruae3lh6v630vxwyp 2024-09-12T17:42:29.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.482+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.486+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.486+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.490+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:f state=0x557e0cd1da78 s->prefetch_data=0 2024-09-12T17:42:29.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.490+0000 7f633b69e9c0 20 get_obj_state: setting s->obj_tag to baoiht9w6ndw5p9jmtrvte8vfjx3c1fw 2024-09-12T17:42:29.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.490+0000 7f633b69e9c0 20 get_obj_state_impl: setting s->olh_tag to 7btufsq3vpexsu853egogysxsldg9x3q 2024-09-12T17:42:29.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.490+0000 7f633b69e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7btufsq3vpexsu853egogysxsldg9x3q 2024-09-12T17:42:29.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.494+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.494+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.498+0000 7f633b69e9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:42:29.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.498+0000 7f633b69e9c0 20 olh_log_entry: epoch=2 op=3 key=f[CZH9zSzajEsVmDev-mfk-aiW8qv9pq0] 2024-09-12T17:42:29.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.498+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:_:CZH9zSzajEsVmDev-mfk-aiW8qv9pq0_f state=0x557e0cd18538 s->prefetch_data=0 2024-09-12T17:42:29.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.498+0000 7f633b69e9c0 10 manifest: total_size = 22 2024-09-12T17:42:29.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.498+0000 7f633b69e9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6694954859708359813 2024-09-12T17:42:29.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.498+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:_:CZH9zSzajEsVmDev-mfk-aiW8qv9pq0_f state=0x557e0cd18538 s->prefetch_data=0 2024-09-12T17:42:29.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.498+0000 7f633b69e9c0 20 prepare_atomic_modification: state is not atomic. state=0x557e0cd18538 2024-09-12T17:42:29.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.498+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.502+0000 7f633b69e9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:42:29.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.502+0000 7f633b69e9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:42:29.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.502+0000 7f633b69e9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:42:29.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.502+0000 7f633b69e9c0 5 delete_objs_inline: removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1__shadow:CZH9zSzajEsVmDev-mfk-aiW8qv9pq0_._slgY8g8zjDlCx83ujO1FXc8sE3xDLO_0 2024-09-12T17:42:29.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.506+0000 7f633b69e9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:42:29.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.510+0000 7f620bfff640 20 handle_completion(): completion ok for obj=f[CZH9zSzajEsVmDev-mfk-aiW8qv9pq0] 2024-09-12T17:42:29.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.510+0000 7f633b69e9c0 20 get_obj_state: octx=0x557e0ca6b200 obj=check-bucket:f state=0x557e0cd1da78 s->prefetch_data=0 2024-09-12T17:42:29.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.510+0000 7f633b69e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7btufsq3vpexsu853egogysxsldg9x3q 2024-09-12T17:42:29.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.514+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.518+0000 7f633b69e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:29.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.518+0000 7f633b69e9c0 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T17:42:29.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.518+0000 7f633b69e9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:42:29.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.522+0000 7f61ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:29.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.526+0000 7f633b69e9c0 20 remove_watcher() i=0 2024-09-12T17:42:29.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.526+0000 7f633b69e9c0 2 removed watcher, disabling cache 2024-09-12T17:42:29.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.530+0000 7f633b69e9c0 20 remove_watcher() i=1 2024-09-12T17:42:29.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.530+0000 7f633b69e9c0 20 remove_watcher() i=2 2024-09-12T17:42:29.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.534+0000 7f633b69e9c0 20 remove_watcher() i=3 2024-09-12T17:42:29.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.534+0000 7f633b69e9c0 20 remove_watcher() i=4 2024-09-12T17:42:29.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.538+0000 7f633b69e9c0 20 remove_watcher() i=5 2024-09-12T17:42:29.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.538+0000 7f633b69e9c0 20 remove_watcher() i=6 2024-09-12T17:42:29.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:29.542+0000 7f633b69e9c0 20 remove_watcher() i=7 2024-09-12T17:42:29.761 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T17:42:29.761 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:30.137 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T17:42:30.137 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:30.138 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:42:30.176 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:30.177 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:30.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.218+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 20 realm 2024-09-12T17:42:30.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:30.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:30.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:30.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e56de9c0 20 searching for the correct realm 2024-09-12T17:42:30.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.222+0000 7f84e39e5640 0 -- 172.21.15.157:0/3048005952 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x5618f37fedc0 msgr2=0x5618f3801280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:30.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.438+0000 7f84e39e5640 0 -- 172.21.15.157:0/3048005952 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f84d80e4090 msgr2=0x7f84d80ab030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:30.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:30.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:30.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:30.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:30.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:30.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:30.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:30.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:30.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 zone default found 2024-09-12T17:42:30.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 4 Realm: () 2024-09-12T17:42:30.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:30.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:30.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:30.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 zonegroup default 2024-09-12T17:42:30.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.662+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.666+0000 7f84e56de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.666+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.666+0000 7f84e56de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.666+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.666+0000 7f84e56de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.666+0000 7f84e56de9c0 20 started sync module instance, tier type = 2024-09-12T17:42:30.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.666+0000 7f84e56de9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.690+0000 7f84e56de9c0 20 add_watcher() i=0 2024-09-12T17:42:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.690+0000 7f84e56de9c0 20 add_watcher() i=1 2024-09-12T17:42:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.690+0000 7f84e56de9c0 20 add_watcher() i=2 2024-09-12T17:42:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.690+0000 7f84e56de9c0 20 add_watcher() i=3 2024-09-12T17:42:30.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.690+0000 7f84e56de9c0 20 add_watcher() i=4 2024-09-12T17:42:30.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.690+0000 7f84e56de9c0 20 add_watcher() i=5 2024-09-12T17:42:30.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.690+0000 7f84e56de9c0 20 add_watcher() i=6 2024-09-12T17:42:30.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.694+0000 7f84e56de9c0 20 add_watcher() i=7 2024-09-12T17:42:30.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.694+0000 7f84e56de9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:30.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.698+0000 7f83957f2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:30.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.698+0000 7f84e56de9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:30.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.698+0000 7f84e56de9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:30.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.698+0000 7f84e56de9c0 5 note: GC not initialized 2024-09-12T17:42:30.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.698+0000 7f830ffff640 20 reqs_thread_entry: start 2024-09-12T17:42:30.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.698+0000 7f84e56de9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:30.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.698+0000 7f84e56de9c0 20 Filter name: none 2024-09-12T17:42:30.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f830e7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:30.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:42:30.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:30.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:42:30.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:42:30.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 : miss 2024-09-12T17:42:30.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:30.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 info.flags=0x17 2024-09-12T17:42:30.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 to cache LRU end 2024-09-12T17:42:30.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:30.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:42:30.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 2024-09-12T17:42:30.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:30.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:42:30.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.702+0000 7f84e56de9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:42:30.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.706+0000 7f83957f2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:30.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.710+0000 7f84e56de9c0 20 remove_watcher() i=0 2024-09-12T17:42:30.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.710+0000 7f84e56de9c0 2 removed watcher, disabling cache 2024-09-12T17:42:30.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.714+0000 7f84e56de9c0 20 remove_watcher() i=1 2024-09-12T17:42:30.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.714+0000 7f84e56de9c0 20 remove_watcher() i=2 2024-09-12T17:42:30.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.718+0000 7f84e56de9c0 20 remove_watcher() i=3 2024-09-12T17:42:30.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.722+0000 7f84e56de9c0 20 remove_watcher() i=4 2024-09-12T17:42:30.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.722+0000 7f84e56de9c0 20 remove_watcher() i=5 2024-09-12T17:42:30.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.722+0000 7f84e56de9c0 20 remove_watcher() i=6 2024-09-12T17:42:30.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:30.726+0000 7f84e56de9c0 20 remove_watcher() i=7 2024-09-12T17:42:31.194 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:42:31.230 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:31.230 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:31.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.466+0000 7fe9b1f5a640 0 --2- 172.21.15.157:0/3107568082 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bf12aa2210 0x55bf12aa2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:42:31.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.482+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.482+0000 7fe9b3c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.482+0000 7fe9b3c539c0 20 realm 2024-09-12T17:42:31.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.482+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.482+0000 7fe9b3c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.482+0000 7fe9b3c539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:31.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.482+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.482+0000 7fe9b3c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.482+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.486+0000 7fe9b3c539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:31.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.486+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.486+0000 7fe9b0f58640 0 -- 172.21.15.157:0/409132937 >> [v2:172.21.15.157:6800/2182114182,v1:172.21.15.157:6801/2182114182] conn(0x55bf12b13160 msgr2=0x55bf12b15550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:31.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.486+0000 7fe9b3c539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:31.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.486+0000 7fe9b3c539c0 20 searching for the correct realm 2024-09-12T17:42:31.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.490+0000 7fe9b1759640 0 -- 172.21.15.157:0/409132937 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7fe9ac09bc20 msgr2=0x7fe9ac09b1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:31.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:31.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:31.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:31.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:31.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:31.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:31.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:31.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:31.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 zone default found 2024-09-12T17:42:31.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 4 Realm: () 2024-09-12T17:42:31.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:31.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:31.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:31.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 zonegroup default 2024-09-12T17:42:31.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.506+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.510+0000 7fe9b3c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.510+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.510+0000 7fe9b3c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.510+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.510+0000 7fe9b3c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.510+0000 7fe9b3c539c0 20 started sync module instance, tier type = 2024-09-12T17:42:31.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.510+0000 7fe9b3c539c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:31.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.530+0000 7fe9b3c539c0 20 add_watcher() i=0 2024-09-12T17:42:31.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.530+0000 7fe9b3c539c0 20 add_watcher() i=1 2024-09-12T17:42:31.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.530+0000 7fe9b3c539c0 20 add_watcher() i=2 2024-09-12T17:42:31.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.530+0000 7fe9b3c539c0 20 add_watcher() i=3 2024-09-12T17:42:31.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.530+0000 7fe9b3c539c0 20 add_watcher() i=4 2024-09-12T17:42:31.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.530+0000 7fe9b3c539c0 20 add_watcher() i=5 2024-09-12T17:42:31.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.530+0000 7fe9b3c539c0 20 add_watcher() i=6 2024-09-12T17:42:31.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.530+0000 7fe9b3c539c0 20 add_watcher() i=7 2024-09-12T17:42:31.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.530+0000 7fe9b3c539c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:31.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.534+0000 7fe8637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:31.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.534+0000 7fe9b3c539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:31.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.534+0000 7fe9b3c539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:31.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.534+0000 7fe9b3c539c0 5 note: GC not initialized 2024-09-12T17:42:31.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.534+0000 7fe8627e4640 20 reqs_thread_entry: start 2024-09-12T17:42:31.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.534+0000 7fe9b3c539c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:31.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.534+0000 7fe9b3c539c0 20 Filter name: none 2024-09-12T17:42:31.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.534+0000 7fe7d3fff640 20 reqs_thread_entry: start 2024-09-12T17:42:31.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.534+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.534+0000 7fe9b3c539c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:31.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.534+0000 7fe9b3c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.538+0000 7fe9b3c539c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:31.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.538+0000 7fe9b3c539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:31.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.538+0000 7fe9b3c539c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:31.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.538+0000 7fe9b3c539c0 20 INFO: main: starting shard=0 2024-09-12T17:42:31.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.538+0000 7fe9b3c539c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:31.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.538+0000 7fe9b3c539c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:42:31.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.538+0000 7fe9b3c539c0 20 INFO: main: done 2024-09-12T17:42:31.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.538+0000 7fe8637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:31.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.546+0000 7fe9b3c539c0 20 remove_watcher() i=0 2024-09-12T17:42:31.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.546+0000 7fe9b3c539c0 2 removed watcher, disabling cache 2024-09-12T17:42:31.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.546+0000 7fe9b3c539c0 20 remove_watcher() i=1 2024-09-12T17:42:31.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.550+0000 7fe9b3c539c0 20 remove_watcher() i=2 2024-09-12T17:42:31.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.550+0000 7fe9b3c539c0 20 remove_watcher() i=3 2024-09-12T17:42:31.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.554+0000 7fe9b3c539c0 20 remove_watcher() i=4 2024-09-12T17:42:31.558 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.554+0000 7fe9b3c539c0 20 remove_watcher() i=5 2024-09-12T17:42:31.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.558+0000 7fe9b3c539c0 20 remove_watcher() i=6 2024-09-12T17:42:31.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.558+0000 7fe9b3c539c0 20 remove_watcher() i=7 2024-09-12T17:42:31.577 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:42:31.606 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:31.606 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:31.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.646+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.646+0000 7f99a27609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.646+0000 7f99a27609c0 20 realm 2024-09-12T17:42:31.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.646+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.646+0000 7f99a27609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.646+0000 7f99a27609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:31.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.646+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.646+0000 7f99a27609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.646+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.650+0000 7f99a27609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:31.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.650+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.650+0000 7f99a27609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:31.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.650+0000 7f99a27609c0 20 searching for the correct realm 2024-09-12T17:42:31.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.654+0000 7f999fa65640 0 -- 172.21.15.157:0/3301113854 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f999410c470 msgr2=0x7f99941280f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:31.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:31.870+0000 7f99a0266640 0 -- 172.21.15.157:0/3301113854 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f999412faf0 msgr2=0x7f99941248c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:32.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.086+0000 7f99a27609c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:32.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.086+0000 7f99a27609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:32.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.086+0000 7f99a27609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:32.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.086+0000 7f99a27609c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:32.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.086+0000 7f99a27609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:32.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.086+0000 7f99a27609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:32.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.086+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:32.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 zone default found 2024-09-12T17:42:32.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 4 Realm: () 2024-09-12T17:42:32.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:32.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:32.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:32.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 zonegroup default 2024-09-12T17:42:32.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.090+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.094+0000 7f99a27609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.094+0000 7f99a27609c0 20 started sync module instance, tier type = 2024-09-12T17:42:32.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.094+0000 7f99a27609c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:32.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.118+0000 7f99a27609c0 20 add_watcher() i=0 2024-09-12T17:42:32.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.118+0000 7f99a27609c0 20 add_watcher() i=1 2024-09-12T17:42:32.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.118+0000 7f99a27609c0 20 add_watcher() i=2 2024-09-12T17:42:32.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.118+0000 7f99a27609c0 20 add_watcher() i=3 2024-09-12T17:42:32.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.118+0000 7f99a27609c0 20 add_watcher() i=4 2024-09-12T17:42:32.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.118+0000 7f99a27609c0 20 add_watcher() i=5 2024-09-12T17:42:32.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.118+0000 7f99a27609c0 20 add_watcher() i=6 2024-09-12T17:42:32.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.118+0000 7f99a27609c0 20 add_watcher() i=7 2024-09-12T17:42:32.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.118+0000 7f99a27609c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:32.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.122+0000 7f9856fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.126+0000 7f99a27609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:32.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.126+0000 7f99a27609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:32.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.126+0000 7f99a27609c0 5 note: GC not initialized 2024-09-12T17:42:32.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.126+0000 7f9855fe3640 20 reqs_thread_entry: start 2024-09-12T17:42:32.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.126+0000 7f99a27609c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:32.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.126+0000 7f99a27609c0 20 Filter name: none 2024-09-12T17:42:32.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.126+0000 7f984effd640 20 reqs_thread_entry: start 2024-09-12T17:42:32.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.126+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.126+0000 7f99a27609c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:32.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.126+0000 7f99a27609c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.130+0000 7f99a27609c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:32.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.130+0000 7f99a27609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:32.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.130+0000 7f99a27609c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:32.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.130+0000 7f99a27609c0 20 INFO: main: starting shard=0 2024-09-12T17:42:32.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.130+0000 7f99a27609c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:32.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.130+0000 7f99a27609c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:42:32.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.130+0000 7f99a27609c0 20 INFO: main: done 2024-09-12T17:42:32.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.130+0000 7f9856fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.138+0000 7f99a27609c0 20 remove_watcher() i=0 2024-09-12T17:42:32.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.138+0000 7f99a27609c0 2 removed watcher, disabling cache 2024-09-12T17:42:32.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.138+0000 7f99a27609c0 20 remove_watcher() i=1 2024-09-12T17:42:32.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.142+0000 7f99a27609c0 20 remove_watcher() i=2 2024-09-12T17:42:32.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.142+0000 7f99a27609c0 20 remove_watcher() i=3 2024-09-12T17:42:32.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.146+0000 7f99a27609c0 20 remove_watcher() i=4 2024-09-12T17:42:32.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.146+0000 7f99a27609c0 20 remove_watcher() i=5 2024-09-12T17:42:32.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.150+0000 7f99a27609c0 20 remove_watcher() i=6 2024-09-12T17:42:32.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.150+0000 7f99a27609c0 20 remove_watcher() i=7 2024-09-12T17:42:32.168 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T17:42:32.169 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:32.169 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:42:32.203 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:32.203 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:32.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.242+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.246+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.246+0000 7fdc6bc4b9c0 20 realm 2024-09-12T17:42:32.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.246+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.246+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.246+0000 7fdc6bc4b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:32.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.246+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.246+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.246+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.246+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.246+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.250+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:32.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.250+0000 7fdc6bc4b9c0 20 searching for the correct realm 2024-09-12T17:42:32.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.254+0000 7fdc69f52640 0 -- 172.21.15.157:0/980398073 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x55fb57a8c210 msgr2=0x55fb57a8e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.258+0000 7fdc69751640 0 -- 172.21.15.157:0/980398073 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fdc600f8950 msgr2=0x7fdc600dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.266+0000 7fdc6bc4b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:32.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.266+0000 7fdc6bc4b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:32.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.266+0000 7fdc6bc4b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:32.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.266+0000 7fdc6bc4b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:32.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.266+0000 7fdc6bc4b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:32.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.266+0000 7fdc6bc4b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:32.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.266+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.266+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.266+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:32.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 zone default found 2024-09-12T17:42:32.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 4 Realm: () 2024-09-12T17:42:32.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:32.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:32.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:32.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 zonegroup default 2024-09-12T17:42:32.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 started sync module instance, tier type = 2024-09-12T17:42:32.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.270+0000 7fdc6bc4b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:32.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.286+0000 7fdc6bc4b9c0 20 add_watcher() i=0 2024-09-12T17:42:32.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.286+0000 7fdc6bc4b9c0 20 add_watcher() i=1 2024-09-12T17:42:32.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.286+0000 7fdc6bc4b9c0 20 add_watcher() i=2 2024-09-12T17:42:32.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.286+0000 7fdc6bc4b9c0 20 add_watcher() i=3 2024-09-12T17:42:32.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.286+0000 7fdc6bc4b9c0 20 add_watcher() i=4 2024-09-12T17:42:32.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.286+0000 7fdc6bc4b9c0 20 add_watcher() i=5 2024-09-12T17:42:32.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.286+0000 7fdc6bc4b9c0 20 add_watcher() i=6 2024-09-12T17:42:32.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.290+0000 7fdc6bc4b9c0 20 add_watcher() i=7 2024-09-12T17:42:32.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.290+0000 7fdc6bc4b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:32.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.290+0000 7fdb1ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.290+0000 7fdc6bc4b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:32.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.290+0000 7fdc6bc4b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:32.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.290+0000 7fdc6bc4b9c0 5 note: GC not initialized 2024-09-12T17:42:32.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.290+0000 7fdb1efe5640 20 reqs_thread_entry: start 2024-09-12T17:42:32.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.290+0000 7fdc6bc4b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:32.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.290+0000 7fdc6bc4b9c0 20 Filter name: none 2024-09-12T17:42:32.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdb1cfe1640 20 reqs_thread_entry: start 2024-09-12T17:42:32.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:42:32.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:32.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:42:32.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:42:32.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 : miss 2024-09-12T17:42:32.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:32.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 info.flags=0x17 2024-09-12T17:42:32.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 to cache LRU end 2024-09-12T17:42:32.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:32.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:42:32.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 2024-09-12T17:42:32.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:32.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 1 NOTICE: finished shard 0 (2 entries found) 2024-09-12T17:42:32.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdc6bc4b9c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T17:42:32.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.294+0000 7fdb1ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.304 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.302+0000 7fdc6bc4b9c0 20 remove_watcher() i=0 2024-09-12T17:42:32.304 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.302+0000 7fdc6bc4b9c0 2 removed watcher, disabling cache 2024-09-12T17:42:32.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.302+0000 7fdc6bc4b9c0 20 remove_watcher() i=1 2024-09-12T17:42:32.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.306+0000 7fdc6bc4b9c0 20 remove_watcher() i=2 2024-09-12T17:42:32.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.306+0000 7fdc6bc4b9c0 20 remove_watcher() i=3 2024-09-12T17:42:32.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.310+0000 7fdc6bc4b9c0 20 remove_watcher() i=4 2024-09-12T17:42:32.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.310+0000 7fdc6bc4b9c0 20 remove_watcher() i=5 2024-09-12T17:42:32.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.314+0000 7fdc6bc4b9c0 20 remove_watcher() i=6 2024-09-12T17:42:32.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.314+0000 7fdc6bc4b9c0 20 remove_watcher() i=7 2024-09-12T17:42:32.330 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T17:42:32.330 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:32.330 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:42:32.361 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:32.361 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:32.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.398+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 20 realm 2024-09-12T17:42:32.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:32.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:32.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.402+0000 7f013fdd59c0 20 searching for the correct realm 2024-09-12T17:42:32.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.410+0000 7f013e0dc640 0 -- 172.21.15.157:0/3874727408 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x55bea2acf0c0 msgr2=0x55bea2ad1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.414+0000 7f013d8db640 0 -- 172.21.15.157:0/3874727408 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f01340393f0 msgr2=0x7f0134039870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:32.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:32.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:32.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:32.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:32.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:32.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:32.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 zone default found 2024-09-12T17:42:32.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 4 Realm: () 2024-09-12T17:42:32.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:32.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:32.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:32.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 zonegroup default 2024-09-12T17:42:32.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.422+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.426+0000 7f013fdd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.426+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.426+0000 7f013fdd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.426+0000 7f013fdd59c0 20 started sync module instance, tier type = 2024-09-12T17:42:32.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.426+0000 7f013fdd59c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:32.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.442+0000 7f013fdd59c0 20 add_watcher() i=0 2024-09-12T17:42:32.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.442+0000 7f013fdd59c0 20 add_watcher() i=1 2024-09-12T17:42:32.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.442+0000 7f013fdd59c0 20 add_watcher() i=2 2024-09-12T17:42:32.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.442+0000 7f013fdd59c0 20 add_watcher() i=3 2024-09-12T17:42:32.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.442+0000 7f013fdd59c0 20 add_watcher() i=4 2024-09-12T17:42:32.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.442+0000 7f013fdd59c0 20 add_watcher() i=5 2024-09-12T17:42:32.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.442+0000 7f013fdd59c0 20 add_watcher() i=6 2024-09-12T17:42:32.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.442+0000 7f013fdd59c0 20 add_watcher() i=7 2024-09-12T17:42:32.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.442+0000 7f013fdd59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:32.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.442+0000 7effef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:32.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:32.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 5 note: GC not initialized 2024-09-12T17:42:32.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7effee7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:32.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:32.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 20 Filter name: none 2024-09-12T17:42:32.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7eff5ffff640 20 reqs_thread_entry: start 2024-09-12T17:42:32.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:42:32.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:32.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:42:32.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:42:32.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 : miss 2024-09-12T17:42:32.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:32.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 info.flags=0x17 2024-09-12T17:42:32.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 to cache LRU end 2024-09-12T17:42:32.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:32.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:42:32.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 2024-09-12T17:42:32.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:32.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.446+0000 7f013fdd59c0 20 get_obj_state: octx=0x55bea28561f0 obj=check-bucket:c state=0x55bea2b04888 s->prefetch_data=0 2024-09-12T17:42:32.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.450+0000 7f013fdd59c0 20 get_obj_state: setting s->obj_tag to bjg0h20kn2qmsrl2tuywz41xwpoje90l 2024-09-12T17:42:32.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.450+0000 7f013fdd59c0 20 get_obj_state_impl: setting s->olh_tag to xpnks8y2ixcwq8hb0gu2yn62f2kd2hcg 2024-09-12T17:42:32.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.450+0000 7f013fdd59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:32.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.450+0000 7f013fdd59c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T17:42:32.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.450+0000 7f013fdd59c0 20 olh_log_entry: epoch=4 op=3 key=c[L2znq975U4k9QUW7ReiCBsXr0z96MDG] 2024-09-12T17:42:32.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.450+0000 7f013fdd59c0 20 get_obj_state: octx=0x55bea2b2e0a0 obj=check-bucket:_:L2znq975U4k9QUW7ReiCBsXr0z96MDG_c state=0x55bea2afe328 s->prefetch_data=0 2024-09-12T17:42:32.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.454+0000 7f013fdd59c0 20 get_obj_state: octx=0x55bea2b2e0a0 obj=check-bucket:c state=0x55bea2b05758 s->prefetch_data=0 2024-09-12T17:42:32.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.454+0000 7f013fdd59c0 20 get_obj_state: setting s->obj_tag to bjg0h20kn2qmsrl2tuywz41xwpoje90l 2024-09-12T17:42:32.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.454+0000 7f013fdd59c0 20 get_obj_state_impl: setting s->olh_tag to xpnks8y2ixcwq8hb0gu2yn62f2kd2hcg 2024-09-12T17:42:32.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.454+0000 7f013fdd59c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xpnks8y2ixcwq8hb0gu2yn62f2kd2hcg 2024-09-12T17:42:32.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.458+0000 7f013fdd59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:32.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.462+0000 7f013fdd59c0 20 get_obj_state: octx=0x55bea28561f0 obj=check-bucket:d state=0x55bea2b04888 s->prefetch_data=0 2024-09-12T17:42:32.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.462+0000 7f013fdd59c0 20 get_obj_state: setting s->obj_tag to pdk550yr65kuxyx25u5yi39q662mud1e 2024-09-12T17:42:32.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.462+0000 7f013fdd59c0 20 get_obj_state_impl: setting s->olh_tag to l43rvkz8lgy7s7ibaypxux9mx1sm6q12 2024-09-12T17:42:32.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.462+0000 7f013fdd59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:32.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.462+0000 7f013fdd59c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T17:42:32.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.462+0000 7f013fdd59c0 20 olh_log_entry: epoch=4 op=3 key=d[pdPOPb8t4Enjsko0dH1WHJCP5MiM30U] 2024-09-12T17:42:32.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.462+0000 7f013fdd59c0 20 get_obj_state: octx=0x55bea2b2e0a0 obj=check-bucket:_:pdPOPb8t4Enjsko0dH1WHJCP5MiM30U_d state=0x55bea2b2ea78 s->prefetch_data=0 2024-09-12T17:42:32.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.466+0000 7f013fdd59c0 20 get_obj_state: octx=0x55bea2b2e0a0 obj=check-bucket:d state=0x55bea2aff638 s->prefetch_data=0 2024-09-12T17:42:32.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.466+0000 7f013fdd59c0 20 get_obj_state: setting s->obj_tag to pdk550yr65kuxyx25u5yi39q662mud1e 2024-09-12T17:42:32.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.466+0000 7f013fdd59c0 20 get_obj_state_impl: setting s->olh_tag to l43rvkz8lgy7s7ibaypxux9mx1sm6q12 2024-09-12T17:42:32.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.466+0000 7f013fdd59c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l43rvkz8lgy7s7ibaypxux9mx1sm6q12 2024-09-12T17:42:32.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.466+0000 7f013fdd59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:32.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.470+0000 7f013fdd59c0 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-12T17:42:32.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.470+0000 7f013fdd59c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T17:42:32.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.470+0000 7effef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.474+0000 7f013fdd59c0 20 remove_watcher() i=0 2024-09-12T17:42:32.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.474+0000 7f013fdd59c0 2 removed watcher, disabling cache 2024-09-12T17:42:32.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.478+0000 7f013fdd59c0 20 remove_watcher() i=1 2024-09-12T17:42:32.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.478+0000 7f013fdd59c0 20 remove_watcher() i=2 2024-09-12T17:42:32.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.482+0000 7f013fdd59c0 20 remove_watcher() i=3 2024-09-12T17:42:32.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.486+0000 7f013fdd59c0 20 remove_watcher() i=4 2024-09-12T17:42:32.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.486+0000 7f013fdd59c0 20 remove_watcher() i=5 2024-09-12T17:42:32.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.486+0000 7f013fdd59c0 20 remove_watcher() i=6 2024-09-12T17:42:32.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.490+0000 7f013fdd59c0 20 remove_watcher() i=7 2024-09-12T17:42:32.505 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:42:32.533 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:32.533 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:32.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.570+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 20 realm 2024-09-12T17:42:32.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:32.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:32.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.574+0000 7fc353ecc9c0 20 searching for the correct realm 2024-09-12T17:42:32.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.582+0000 7fc3521d3640 0 -- 172.21.15.157:0/2680172198 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fc348014030 msgr2=0x7fc34807d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:32.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.798+0000 7fc3519d2640 0 -- 172.21.15.157:0/2680172198 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55ac1ec01000 msgr2=0x55ac1ec03490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.806+0000 7fc353ecc9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:32.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.806+0000 7fc353ecc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:32.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.806+0000 7fc353ecc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:32.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.806+0000 7fc353ecc9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:32.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.806+0000 7fc353ecc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:32.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.806+0000 7fc353ecc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:32.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.806+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.806+0000 7fc353ecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.806+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:32.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 zone default found 2024-09-12T17:42:32.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 4 Realm: () 2024-09-12T17:42:32.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:32.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:32.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:32.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 zonegroup default 2024-09-12T17:42:32.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 started sync module instance, tier type = 2024-09-12T17:42:32.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.810+0000 7fc353ecc9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:32.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.834+0000 7fc353ecc9c0 20 add_watcher() i=0 2024-09-12T17:42:32.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.834+0000 7fc353ecc9c0 20 add_watcher() i=1 2024-09-12T17:42:32.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.834+0000 7fc353ecc9c0 20 add_watcher() i=2 2024-09-12T17:42:32.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.834+0000 7fc353ecc9c0 20 add_watcher() i=3 2024-09-12T17:42:32.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.834+0000 7fc353ecc9c0 20 add_watcher() i=4 2024-09-12T17:42:32.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.834+0000 7fc353ecc9c0 20 add_watcher() i=5 2024-09-12T17:42:32.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.834+0000 7fc353ecc9c0 20 add_watcher() i=6 2024-09-12T17:42:32.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.838+0000 7fc353ecc9c0 20 add_watcher() i=7 2024-09-12T17:42:32.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.838+0000 7fc353ecc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:32.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.842+0000 7fc2037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.842+0000 7fc353ecc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:32.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.842+0000 7fc353ecc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:32.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.842+0000 7fc353ecc9c0 5 note: GC not initialized 2024-09-12T17:42:32.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.842+0000 7fc2027fc640 20 reqs_thread_entry: start 2024-09-12T17:42:32.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.842+0000 7fc353ecc9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:32.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.842+0000 7fc353ecc9c0 20 Filter name: none 2024-09-12T17:42:32.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.842+0000 7fc173fff640 20 reqs_thread_entry: start 2024-09-12T17:42:32.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.846+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.846+0000 7fc353ecc9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:32.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.846+0000 7fc353ecc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.846+0000 7fc353ecc9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:32.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.846+0000 7fc353ecc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:32.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.846+0000 7fc353ecc9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:32.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.846+0000 7fc353ecc9c0 20 INFO: main: starting shard=0 2024-09-12T17:42:32.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.846+0000 7fc353ecc9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:32.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.846+0000 7fc353ecc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:42:32.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.846+0000 7fc353ecc9c0 20 INFO: main: done 2024-09-12T17:42:32.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.850+0000 7fc2037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.854+0000 7fc353ecc9c0 20 remove_watcher() i=0 2024-09-12T17:42:32.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.854+0000 7fc353ecc9c0 2 removed watcher, disabling cache 2024-09-12T17:42:32.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.854+0000 7fc353ecc9c0 20 remove_watcher() i=1 2024-09-12T17:42:32.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.858+0000 7fc353ecc9c0 20 remove_watcher() i=2 2024-09-12T17:42:32.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.858+0000 7fc353ecc9c0 20 remove_watcher() i=3 2024-09-12T17:42:32.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.862+0000 7fc353ecc9c0 20 remove_watcher() i=4 2024-09-12T17:42:32.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.866+0000 7fc353ecc9c0 20 remove_watcher() i=5 2024-09-12T17:42:32.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.866+0000 7fc353ecc9c0 20 remove_watcher() i=6 2024-09-12T17:42:32.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.866+0000 7fc353ecc9c0 20 remove_watcher() i=7 2024-09-12T17:42:32.885 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:42:32.915 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:32.915 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:32.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.958+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.958+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.958+0000 7fdd1fb5a9c0 20 realm 2024-09-12T17:42:32.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.958+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.958+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.958+0000 7fdd1fb5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:32.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.958+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.958+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.958+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.962+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.962+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.962+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:32.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.962+0000 7fdd1fb5a9c0 20 searching for the correct realm 2024-09-12T17:42:32.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.966+0000 7fdd1d660640 0 -- 172.21.15.157:0/1731503694 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7fdd18068cc0 msgr2=0x7fdd18097050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:32.974+0000 7fdd1d660640 0 -- 172.21.15.157:0/1731503694 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fdd14059970 msgr2=0x7fdd14037420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.190+0000 7fdd1fb5a9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:33.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.190+0000 7fdd1fb5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:33.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.190+0000 7fdd1fb5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:33.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.190+0000 7fdd1fb5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:33.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.190+0000 7fdd1fb5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:33.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.190+0000 7fdd1fb5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:33.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.190+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:33.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 zone default found 2024-09-12T17:42:33.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 4 Realm: () 2024-09-12T17:42:33.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:33.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:33.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:33.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 zonegroup default 2024-09-12T17:42:33.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.194+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.198+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.198+0000 7fdd1fb5a9c0 20 started sync module instance, tier type = 2024-09-12T17:42:33.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.198+0000 7fdd1fb5a9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:33.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.222+0000 7fdd1fb5a9c0 20 add_watcher() i=0 2024-09-12T17:42:33.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.222+0000 7fdd1fb5a9c0 20 add_watcher() i=1 2024-09-12T17:42:33.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.222+0000 7fdd1fb5a9c0 20 add_watcher() i=2 2024-09-12T17:42:33.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.222+0000 7fdd1fb5a9c0 20 add_watcher() i=3 2024-09-12T17:42:33.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.222+0000 7fdd1fb5a9c0 20 add_watcher() i=4 2024-09-12T17:42:33.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.222+0000 7fdd1fb5a9c0 20 add_watcher() i=5 2024-09-12T17:42:33.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.222+0000 7fdd1fb5a9c0 20 add_watcher() i=6 2024-09-12T17:42:33.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.226+0000 7fdd1fb5a9c0 20 add_watcher() i=7 2024-09-12T17:42:33.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.226+0000 7fdd1fb5a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:33.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.230+0000 7fdbd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.230+0000 7fdd1fb5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:33.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.230+0000 7fdd1fb5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:33.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.230+0000 7fdd1fb5a9c0 5 note: GC not initialized 2024-09-12T17:42:33.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.230+0000 7fdbd27e4640 20 reqs_thread_entry: start 2024-09-12T17:42:33.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.230+0000 7fdd1fb5a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:33.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.230+0000 7fdd1fb5a9c0 20 Filter name: none 2024-09-12T17:42:33.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.230+0000 7fdb43fff640 20 reqs_thread_entry: start 2024-09-12T17:42:33.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.230+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.230+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:33.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.230+0000 7fdd1fb5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.234+0000 7fdd1fb5a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:33.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.234+0000 7fdd1fb5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:33.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.234+0000 7fdd1fb5a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:33.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.234+0000 7fdd1fb5a9c0 20 INFO: main: starting shard=0 2024-09-12T17:42:33.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.234+0000 7fdd1fb5a9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:33.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.234+0000 7fdd1fb5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:42:33.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.234+0000 7fdd1fb5a9c0 20 INFO: main: done 2024-09-12T17:42:33.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.234+0000 7fdbd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.242+0000 7fdd1fb5a9c0 20 remove_watcher() i=0 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.242+0000 7fdd1fb5a9c0 2 removed watcher, disabling cache 2024-09-12T17:42:33.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.242+0000 7fdd1fb5a9c0 20 remove_watcher() i=1 2024-09-12T17:42:33.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.246+0000 7fdd1fb5a9c0 20 remove_watcher() i=2 2024-09-12T17:42:33.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.250+0000 7fdd1fb5a9c0 20 remove_watcher() i=3 2024-09-12T17:42:33.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.250+0000 7fdd1fb5a9c0 20 remove_watcher() i=4 2024-09-12T17:42:33.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.254+0000 7fdd1fb5a9c0 20 remove_watcher() i=5 2024-09-12T17:42:33.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.254+0000 7fdd1fb5a9c0 20 remove_watcher() i=6 2024-09-12T17:42:33.259 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.258+0000 7fdd1fb5a9c0 20 remove_watcher() i=7 2024-09-12T17:42:33.283 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T17:42:33.283 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:33.284 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:42:33.314 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:33.314 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:33.360 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.358+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.358+0000 7f14a33339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.358+0000 7f14a33339c0 20 realm 2024-09-12T17:42:33.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.358+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.358+0000 7f14a33339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.358+0000 7f14a33339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:33.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.358+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.358+0000 7f14a33339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.358+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.362+0000 7f14a33339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.362+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.362+0000 7f14a33339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:33.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.362+0000 7f14a33339c0 20 searching for the correct realm 2024-09-12T17:42:33.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.366+0000 7f149bfff640 0 -- 172.21.15.157:0/486253073 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f148c0b9450 msgr2=0x7f148c0b9890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.374+0000 7f149bfff640 0 -- 172.21.15.157:0/486253073 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f136c07de40 msgr2=0x7f136c080270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:33.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:33.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:33.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:33.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:33.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:33.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:33.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 zone default found 2024-09-12T17:42:33.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 4 Realm: () 2024-09-12T17:42:33.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:33.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:33.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:33.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 zonegroup default 2024-09-12T17:42:33.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 started sync module instance, tier type = 2024-09-12T17:42:33.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.382+0000 7f14a33339c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:33.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.398+0000 7f14a33339c0 20 add_watcher() i=0 2024-09-12T17:42:33.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.398+0000 7f14a33339c0 20 add_watcher() i=1 2024-09-12T17:42:33.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.398+0000 7f14a33339c0 20 add_watcher() i=2 2024-09-12T17:42:33.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.398+0000 7f14a33339c0 20 add_watcher() i=3 2024-09-12T17:42:33.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.398+0000 7f14a33339c0 20 add_watcher() i=4 2024-09-12T17:42:33.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.398+0000 7f14a33339c0 20 add_watcher() i=5 2024-09-12T17:42:33.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.398+0000 7f14a33339c0 20 add_watcher() i=6 2024-09-12T17:42:33.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.402+0000 7f14a33339c0 20 add_watcher() i=7 2024-09-12T17:42:33.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.402+0000 7f14a33339c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:33.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.402+0000 7f1356fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:33.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:33.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 5 note: GC not initialized 2024-09-12T17:42:33.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f1355fe3640 20 reqs_thread_entry: start 2024-09-12T17:42:33.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:33.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 20 Filter name: none 2024-09-12T17:42:33.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f12c77fe640 20 reqs_thread_entry: start 2024-09-12T17:42:33.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:42:33.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 : miss 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:33.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 info.flags=0x17 2024-09-12T17:42:33.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 to cache LRU end 2024-09-12T17:42:33.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:33.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:42:33.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 2024-09-12T17:42:33.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:33.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:42:33.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.406+0000 7f14a33339c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:42:33.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.410+0000 7f1356fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.418+0000 7f14a33339c0 20 remove_watcher() i=0 2024-09-12T17:42:33.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.418+0000 7f14a33339c0 2 removed watcher, disabling cache 2024-09-12T17:42:33.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.418+0000 7f14a33339c0 20 remove_watcher() i=1 2024-09-12T17:42:33.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.422+0000 7f14a33339c0 20 remove_watcher() i=2 2024-09-12T17:42:33.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.422+0000 7f14a33339c0 20 remove_watcher() i=3 2024-09-12T17:42:33.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.426+0000 7f14a33339c0 20 remove_watcher() i=4 2024-09-12T17:42:33.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.426+0000 7f14a33339c0 20 remove_watcher() i=5 2024-09-12T17:42:33.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.426+0000 7f14a33339c0 20 remove_watcher() i=6 2024-09-12T17:42:33.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:33.430+0000 7f14a33339c0 20 remove_watcher() i=7 2024-09-12T17:42:33.445 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T17:42:33.445 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:33.582 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T17:42:33.583 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:42:35.446 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:42:35.884 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:42:37.488 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:42:37.524 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:37.525 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:37.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.566+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 20 realm 2024-09-12T17:42:37.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:37.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:37.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:37.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:37.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:37.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.570+0000 7fd98363c9c0 20 searching for the correct realm 2024-09-12T17:42:37.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.574+0000 7fd980941640 0 -- 172.21.15.157:0/1556286931 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fd978025040 msgr2=0x7fd978034400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:37.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:37.790+0000 7fd981142640 0 -- 172.21.15.157:0/1556286931 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fd9780473f0 msgr2=0x7fd978047850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:38.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.006+0000 7fd98363c9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:38.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.006+0000 7fd98363c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.006+0000 7fd98363c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.006+0000 7fd98363c9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.006+0000 7fd98363c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.006+0000 7fd98363c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.006+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.006+0000 7fd98363c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.006+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:38.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:38.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 zone default found 2024-09-12T17:42:38.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 4 Realm: () 2024-09-12T17:42:38.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:38.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:38.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:38.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 zonegroup default 2024-09-12T17:42:38.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 started sync module instance, tier type = 2024-09-12T17:42:38.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.010+0000 7fd98363c9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:38.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.034+0000 7fd98363c9c0 20 add_watcher() i=0 2024-09-12T17:42:38.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.034+0000 7fd98363c9c0 20 add_watcher() i=1 2024-09-12T17:42:38.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.034+0000 7fd98363c9c0 20 add_watcher() i=2 2024-09-12T17:42:38.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.034+0000 7fd98363c9c0 20 add_watcher() i=3 2024-09-12T17:42:38.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.034+0000 7fd98363c9c0 20 add_watcher() i=4 2024-09-12T17:42:38.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.034+0000 7fd98363c9c0 20 add_watcher() i=5 2024-09-12T17:42:38.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.034+0000 7fd98363c9c0 20 add_watcher() i=6 2024-09-12T17:42:38.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.038+0000 7fd98363c9c0 20 add_watcher() i=7 2024-09-12T17:42:38.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.038+0000 7fd98363c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:38.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.042+0000 7fd837fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:38.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:38.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:38.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 5 note: GC not initialized 2024-09-12T17:42:38.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd836fe5640 20 reqs_thread_entry: start 2024-09-12T17:42:38.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:38.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 Filter name: none 2024-09-12T17:42:38.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd834fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:38.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:38.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:38.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:38.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:38.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 INFO: main: starting shard=0 2024-09-12T17:42:38.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.046+0000 7fd98363c9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:38.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.050+0000 7fd98363c9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:42:38.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.050+0000 7fd98363c9c0 20 INFO: main: done 2024-09-12T17:42:38.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.050+0000 7fd837fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:38.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.058+0000 7fd98363c9c0 20 remove_watcher() i=0 2024-09-12T17:42:38.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.058+0000 7fd98363c9c0 2 removed watcher, disabling cache 2024-09-12T17:42:38.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.058+0000 7fd98363c9c0 20 remove_watcher() i=1 2024-09-12T17:42:38.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.062+0000 7fd98363c9c0 20 remove_watcher() i=2 2024-09-12T17:42:38.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.062+0000 7fd98363c9c0 20 remove_watcher() i=3 2024-09-12T17:42:38.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.066+0000 7fd98363c9c0 20 remove_watcher() i=4 2024-09-12T17:42:38.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.066+0000 7fd98363c9c0 20 remove_watcher() i=5 2024-09-12T17:42:38.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.070+0000 7fd98363c9c0 20 remove_watcher() i=6 2024-09-12T17:42:38.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.070+0000 7fd98363c9c0 20 remove_watcher() i=7 2024-09-12T17:42:38.268 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:42:38.268 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:42:38.305 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:38.305 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:38.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.346+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.351 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.351 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 20 realm 2024-09-12T17:42:38.351 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:38.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:38.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:38.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.350+0000 7fda4c4e29c0 20 searching for the correct realm 2024-09-12T17:42:38.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.358+0000 7fda4a7e9640 0 -- 172.21.15.157:0/3089961539 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x5619619397e0 msgr2=0x56196193bbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:38.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.362+0000 7fda49fe8640 0 -- 172.21.15.157:0/3089961539 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fda4006ebb0 msgr2=0x7fda40066560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:38.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:38.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:38.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:38.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:38.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:38.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:38.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:38.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:38.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 zone default found 2024-09-12T17:42:38.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 4 Realm: () 2024-09-12T17:42:38.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:38.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:38.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:38.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 zonegroup default 2024-09-12T17:42:38.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.370+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.374+0000 7fda4c4e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.374+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.374+0000 7fda4c4e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.374+0000 7fda4c4e29c0 20 started sync module instance, tier type = 2024-09-12T17:42:38.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.374+0000 7fda4c4e29c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:38.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.390+0000 7fda4c4e29c0 20 add_watcher() i=0 2024-09-12T17:42:38.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.390+0000 7fda4c4e29c0 20 add_watcher() i=1 2024-09-12T17:42:38.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.390+0000 7fda4c4e29c0 20 add_watcher() i=2 2024-09-12T17:42:38.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.390+0000 7fda4c4e29c0 20 add_watcher() i=3 2024-09-12T17:42:38.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.390+0000 7fda4c4e29c0 20 add_watcher() i=4 2024-09-12T17:42:38.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.390+0000 7fda4c4e29c0 20 add_watcher() i=5 2024-09-12T17:42:38.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.390+0000 7fda4c4e29c0 20 add_watcher() i=6 2024-09-12T17:42:38.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.390+0000 7fda4c4e29c0 20 add_watcher() i=7 2024-09-12T17:42:38.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.390+0000 7fda4c4e29c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:38.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.394+0000 7fd8fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:38.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.394+0000 7fda4c4e29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:38.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.394+0000 7fda4c4e29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:38.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.394+0000 7fda4c4e29c0 5 note: GC not initialized 2024-09-12T17:42:38.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.394+0000 7fd8faffd640 20 reqs_thread_entry: start 2024-09-12T17:42:38.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.394+0000 7fda4c4e29c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:38.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.394+0000 7fda4c4e29c0 20 Filter name: none 2024-09-12T17:42:38.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.394+0000 7fd8f8ff9640 20 reqs_thread_entry: start 2024-09-12T17:42:38.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.394+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.394+0000 7fda4c4e29c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:38.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.394+0000 7fda4c4e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.398+0000 7fda4c4e29c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:38.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.398+0000 7fda4c4e29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:38.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.398+0000 7fda4c4e29c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:38.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.398+0000 7fda4c4e29c0 20 INFO: main: starting shard=0 2024-09-12T17:42:38.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.398+0000 7fda4c4e29c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:38.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.398+0000 7fda4c4e29c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:42:38.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.398+0000 7fda4c4e29c0 20 INFO: main: done 2024-09-12T17:42:38.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.398+0000 7fd8fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:38.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.402+0000 7fda4c4e29c0 20 remove_watcher() i=0 2024-09-12T17:42:38.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.402+0000 7fda4c4e29c0 2 removed watcher, disabling cache 2024-09-12T17:42:38.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.406+0000 7fda4c4e29c0 20 remove_watcher() i=1 2024-09-12T17:42:38.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.410+0000 7fda4c4e29c0 20 remove_watcher() i=2 2024-09-12T17:42:38.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.410+0000 7fda4c4e29c0 20 remove_watcher() i=3 2024-09-12T17:42:38.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.414+0000 7fda4c4e29c0 20 remove_watcher() i=4 2024-09-12T17:42:38.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.414+0000 7fda4c4e29c0 20 remove_watcher() i=5 2024-09-12T17:42:38.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.418+0000 7fda4c4e29c0 20 remove_watcher() i=6 2024-09-12T17:42:38.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.418+0000 7fda4c4e29c0 20 remove_watcher() i=7 2024-09-12T17:42:38.576 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:42:38.576 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:42:38.612 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:38.612 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:38.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.654+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.654+0000 7ff9468f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.654+0000 7ff9468f09c0 20 realm 2024-09-12T17:42:38.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.654+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.654+0000 7ff9468f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.654+0000 7ff9468f09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:38.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.654+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.654+0000 7ff9468f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.654+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.658+0000 7ff9468f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:38.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.658+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.658+0000 7ff9468f09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:38.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.658+0000 7ff9468f09c0 20 searching for the correct realm 2024-09-12T17:42:38.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.662+0000 7ff943bf5640 0 -- 172.21.15.157:0/3520809054 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55765dde43c0 msgr2=0x55765dde67b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:38.672 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.670+0000 7ff943bf5640 0 -- 172.21.15.157:0/3520809054 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7ff938099040 msgr2=0x7ff93805d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:38.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:38.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:38.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:38.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:38.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:38.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:38.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:38.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:38.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 zone default found 2024-09-12T17:42:38.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 4 Realm: () 2024-09-12T17:42:38.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:38.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:38.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:38.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 zonegroup default 2024-09-12T17:42:38.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 started sync module instance, tier type = 2024-09-12T17:42:38.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.678+0000 7ff9468f09c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:38.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.698+0000 7ff9468f09c0 20 add_watcher() i=0 2024-09-12T17:42:38.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.698+0000 7ff9468f09c0 20 add_watcher() i=1 2024-09-12T17:42:38.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.698+0000 7ff9468f09c0 20 add_watcher() i=2 2024-09-12T17:42:38.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.698+0000 7ff9468f09c0 20 add_watcher() i=3 2024-09-12T17:42:38.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.698+0000 7ff9468f09c0 20 add_watcher() i=4 2024-09-12T17:42:38.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.698+0000 7ff9468f09c0 20 add_watcher() i=5 2024-09-12T17:42:38.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.698+0000 7ff9468f09c0 20 add_watcher() i=6 2024-09-12T17:42:38.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.698+0000 7ff9468f09c0 20 add_watcher() i=7 2024-09-12T17:42:38.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.698+0000 7ff9468f09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:38.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff7fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:38.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:38.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:38.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 5 note: GC not initialized 2024-09-12T17:42:38.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff7f9fdb640 20 reqs_thread_entry: start 2024-09-12T17:42:38.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:38.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 Filter name: none 2024-09-12T17:42:38.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff76b7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:38.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:38.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:38.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:38.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:38.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 INFO: main: starting shard=0 2024-09-12T17:42:38.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.702+0000 7ff9468f09c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:38.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.706+0000 7ff9468f09c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:42:38.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.706+0000 7ff9468f09c0 20 INFO: main: done 2024-09-12T17:42:38.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.706+0000 7ff7fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:38.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.710+0000 7ff9468f09c0 20 remove_watcher() i=0 2024-09-12T17:42:38.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.710+0000 7ff9468f09c0 2 removed watcher, disabling cache 2024-09-12T17:42:38.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.714+0000 7ff9468f09c0 20 remove_watcher() i=1 2024-09-12T17:42:38.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.714+0000 7ff9468f09c0 20 remove_watcher() i=2 2024-09-12T17:42:38.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.718+0000 7ff9468f09c0 20 remove_watcher() i=3 2024-09-12T17:42:38.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.718+0000 7ff9468f09c0 20 remove_watcher() i=4 2024-09-12T17:42:38.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.722+0000 7ff9468f09c0 20 remove_watcher() i=5 2024-09-12T17:42:38.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.722+0000 7ff9468f09c0 20 remove_watcher() i=6 2024-09-12T17:42:38.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.722+0000 7ff9468f09c0 20 remove_watcher() i=7 2024-09-12T17:42:38.868 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:42:38.868 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:42:38.903 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:38.903 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:38.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.942+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 20 realm 2024-09-12T17:42:38.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:38.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:38.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:38.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.946+0000 7efc2862e9c0 20 searching for the correct realm 2024-09-12T17:42:38.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.954+0000 7efc26134640 0 -- 172.21.15.157:0/1734029634 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7efc18115be0 msgr2=0x7efc180fac90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:38.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.958+0000 7efc26134640 0 -- 172.21.15.157:0/1734029634 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x56554abd49e0 msgr2=0x56554abd6ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:38.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.966+0000 7efc2862e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:38.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.966+0000 7efc2862e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:38.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.966+0000 7efc2862e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:38.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.966+0000 7efc2862e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:38.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.966+0000 7efc2862e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:38.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.966+0000 7efc2862e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:38.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.966+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.966+0000 7efc2862e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.966+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.966+0000 7efc2862e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:38.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:38.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 zone default found 2024-09-12T17:42:38.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 4 Realm: () 2024-09-12T17:42:38.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:38.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:38.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:38.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 zonegroup default 2024-09-12T17:42:38.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:38.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 started sync module instance, tier type = 2024-09-12T17:42:38.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.970+0000 7efc2862e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:38.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.986+0000 7efc2862e9c0 20 add_watcher() i=0 2024-09-12T17:42:38.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.986+0000 7efc2862e9c0 20 add_watcher() i=1 2024-09-12T17:42:38.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.986+0000 7efc2862e9c0 20 add_watcher() i=2 2024-09-12T17:42:38.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.986+0000 7efc2862e9c0 20 add_watcher() i=3 2024-09-12T17:42:38.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.986+0000 7efc2862e9c0 20 add_watcher() i=4 2024-09-12T17:42:38.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.986+0000 7efc2862e9c0 20 add_watcher() i=5 2024-09-12T17:42:38.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.986+0000 7efc2862e9c0 20 add_watcher() i=6 2024-09-12T17:42:38.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.990+0000 7efc2862e9c0 20 add_watcher() i=7 2024-09-12T17:42:38.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.990+0000 7efc2862e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:38.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.990+0000 7efadcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:38.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.990+0000 7efc2862e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:38.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.990+0000 7efc2862e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:38.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.990+0000 7efc2862e9c0 5 note: GC not initialized 2024-09-12T17:42:38.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.990+0000 7efa577fe640 20 reqs_thread_entry: start 2024-09-12T17:42:38.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.990+0000 7efc2862e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:38.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.990+0000 7efc2862e9c0 20 Filter name: none 2024-09-12T17:42:38.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.990+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.990+0000 7efa557fa640 20 reqs_thread_entry: start 2024-09-12T17:42:38.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.994+0000 7efc2862e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:38.996 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.994+0000 7efc2862e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:38.996 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.994+0000 7efc2862e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:38.996 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.994+0000 7efc2862e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:38.996 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.994+0000 7efc2862e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:42:38.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.994+0000 7efc2862e9c0 20 INFO: main: starting shard=0 2024-09-12T17:42:38.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.994+0000 7efc2862e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:38.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.994+0000 7efc2862e9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:42:38.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.994+0000 7efc2862e9c0 20 INFO: main: done 2024-09-12T17:42:38.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:38.994+0000 7efadcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:39.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.002+0000 7efc2862e9c0 20 remove_watcher() i=0 2024-09-12T17:42:39.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.002+0000 7efc2862e9c0 2 removed watcher, disabling cache 2024-09-12T17:42:39.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.002+0000 7efc2862e9c0 20 remove_watcher() i=1 2024-09-12T17:42:39.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.006+0000 7efc2862e9c0 20 remove_watcher() i=2 2024-09-12T17:42:39.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.006+0000 7efc2862e9c0 20 remove_watcher() i=3 2024-09-12T17:42:39.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.010+0000 7efc2862e9c0 20 remove_watcher() i=4 2024-09-12T17:42:39.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.010+0000 7efc2862e9c0 20 remove_watcher() i=5 2024-09-12T17:42:39.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.010+0000 7efc2862e9c0 20 remove_watcher() i=6 2024-09-12T17:42:39.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.014+0000 7efc2862e9c0 20 remove_watcher() i=7 2024-09-12T17:42:39.058 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:42:39.495 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:42:39.917 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:42:39.947 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:39.947 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:39.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.986+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:39.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.986+0000 7f7e5d97b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:39.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.986+0000 7f7e5d97b9c0 20 realm 2024-09-12T17:42:39.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.986+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:39.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.986+0000 7f7e5d97b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:39.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.986+0000 7f7e5d97b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:39.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.986+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:39.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.986+0000 7f7e5d97b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:39.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.986+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:39.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.990+0000 7f7e5d97b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:39.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.990+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:39.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.990+0000 7f7e5d97b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:39.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.990+0000 7f7e5d97b9c0 20 searching for the correct realm 2024-09-12T17:42:39.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:39.994+0000 7f7e5bc82640 0 -- 172.21.15.157:0/442866192 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f7e5006c5b0 msgr2=0x7f7e5006a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:40.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.210+0000 7f7e5bc82640 0 -- 172.21.15.157:0/442866192 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f7d2407de20 msgr2=0x7f7d24080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:40.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:40.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:40.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:40.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:40.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:40.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:40.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:40.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:40.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:40.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 zone default found 2024-09-12T17:42:40.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 4 Realm: () 2024-09-12T17:42:40.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:40.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:40.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:40.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 zonegroup default 2024-09-12T17:42:40.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:40.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.222+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.226+0000 7f7e5d97b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:40.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.226+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.226+0000 7f7e5d97b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:40.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.226+0000 7f7e5d97b9c0 20 started sync module instance, tier type = 2024-09-12T17:42:40.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.226+0000 7f7e5d97b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:40.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.250+0000 7f7e5d97b9c0 20 add_watcher() i=0 2024-09-12T17:42:40.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.250+0000 7f7e5d97b9c0 20 add_watcher() i=1 2024-09-12T17:42:40.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.250+0000 7f7e5d97b9c0 20 add_watcher() i=2 2024-09-12T17:42:40.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.250+0000 7f7e5d97b9c0 20 add_watcher() i=3 2024-09-12T17:42:40.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.250+0000 7f7e5d97b9c0 20 add_watcher() i=4 2024-09-12T17:42:40.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.250+0000 7f7e5d97b9c0 20 add_watcher() i=5 2024-09-12T17:42:40.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.250+0000 7f7e5d97b9c0 20 add_watcher() i=6 2024-09-12T17:42:40.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.254+0000 7f7e5d97b9c0 20 add_watcher() i=7 2024-09-12T17:42:40.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.254+0000 7f7e5d97b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:40.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7d11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:40.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:40.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:40.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 5 note: GC not initialized 2024-09-12T17:42:40.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7d10fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:40.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:40.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 20 Filter name: none 2024-09-12T17:42:40.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7c8a7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:40.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:42:40.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:40.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:42:40.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:42:40.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 : miss 2024-09-12T17:42:40.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.258+0000 7f7e5d97b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.262+0000 7f7e5d97b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:40.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.262+0000 7f7e5d97b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 info.flags=0x17 2024-09-12T17:42:40.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.262+0000 7f7e5d97b9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 to cache LRU end 2024-09-12T17:42:40.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.262+0000 7f7e5d97b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:40.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.262+0000 7f7e5d97b9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:42:40.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.262+0000 7f7e5d97b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 2024-09-12T17:42:40.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.262+0000 7f7e5d97b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.270+0000 7f7d11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:40.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.274+0000 7f7e5d97b9c0 20 remove_watcher() i=0 2024-09-12T17:42:40.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.274+0000 7f7e5d97b9c0 2 removed watcher, disabling cache 2024-09-12T17:42:40.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.278+0000 7f7e5d97b9c0 20 remove_watcher() i=1 2024-09-12T17:42:40.283 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.278+0000 7f7e5d97b9c0 20 remove_watcher() i=2 2024-09-12T17:42:40.285 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.282+0000 7f7e5d97b9c0 20 remove_watcher() i=3 2024-09-12T17:42:40.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.286+0000 7f7e5d97b9c0 20 remove_watcher() i=4 2024-09-12T17:42:40.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.286+0000 7f7e5d97b9c0 20 remove_watcher() i=5 2024-09-12T17:42:40.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.286+0000 7f7e5d97b9c0 20 remove_watcher() i=6 2024-09-12T17:42:40.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.290+0000 7f7e5d97b9c0 20 remove_watcher() i=7 2024-09-12T17:42:40.308 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:42:40.339 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:40.340 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:40.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.378+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.378+0000 7f79dbc329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:40.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.378+0000 7f79dbc329c0 20 realm 2024-09-12T17:42:40.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.378+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.378+0000 7f79dbc329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:40.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.378+0000 7f79dbc329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:40.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.378+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.378+0000 7f79dbc329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:40.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.378+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.382+0000 7f79dbc329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:40.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.382+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.382+0000 7f79dbc329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:40.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.382+0000 7f79dbc329c0 20 searching for the correct realm 2024-09-12T17:42:40.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.390+0000 7f79d9f39640 0 -- 172.21.15.157:0/191798937 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f79c40dc950 msgr2=0x7f79c40db3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:40.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.606+0000 7f79d9738640 0 -- 172.21.15.157:0/191798937 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55c2b79a8410 msgr2=0x55c2b79aa840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:40.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.614+0000 7f79dbc329c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:40.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.614+0000 7f79dbc329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:40.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.614+0000 7f79dbc329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:40.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.614+0000 7f79dbc329c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:40.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.614+0000 7f79dbc329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:40.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.614+0000 7f79dbc329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:40.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.614+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.614+0000 7f79dbc329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:40.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.614+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.614+0000 7f79dbc329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:40.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.614+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:40.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 20 zone default found 2024-09-12T17:42:40.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 4 Realm: () 2024-09-12T17:42:40.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:40.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:40.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:40.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 20 zonegroup default 2024-09-12T17:42:40.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:40.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:40.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:40.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 20 started sync module instance, tier type = 2024-09-12T17:42:40.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.618+0000 7f79dbc329c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:40.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.642+0000 7f79dbc329c0 20 add_watcher() i=0 2024-09-12T17:42:40.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.642+0000 7f79dbc329c0 20 add_watcher() i=1 2024-09-12T17:42:40.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.642+0000 7f79dbc329c0 20 add_watcher() i=2 2024-09-12T17:42:40.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.642+0000 7f79dbc329c0 20 add_watcher() i=3 2024-09-12T17:42:40.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.642+0000 7f79dbc329c0 20 add_watcher() i=4 2024-09-12T17:42:40.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.642+0000 7f79dbc329c0 20 add_watcher() i=5 2024-09-12T17:42:40.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.642+0000 7f79dbc329c0 20 add_watcher() i=6 2024-09-12T17:42:40.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.646+0000 7f79dbc329c0 20 add_watcher() i=7 2024-09-12T17:42:40.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.646+0000 7f79dbc329c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:40.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.650+0000 7f788ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:40.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.650+0000 7f79dbc329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:40.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.650+0000 7f79dbc329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:40.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.650+0000 7f79dbc329c0 5 note: GC not initialized 2024-09-12T17:42:40.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.650+0000 7f788efe5640 20 reqs_thread_entry: start 2024-09-12T17:42:40.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.650+0000 7f79dbc329c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:40.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.650+0000 7f79dbc329c0 20 Filter name: none 2024-09-12T17:42:40.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.650+0000 7f788cfe1640 20 reqs_thread_entry: start 2024-09-12T17:42:40.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.650+0000 7f79dbc329c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:42:40.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.650+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:40.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:42:40.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:42:40.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 : miss 2024-09-12T17:42:40.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:40.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:40.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 info.flags=0x17 2024-09-12T17:42:40.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 to cache LRU end 2024-09-12T17:42:40.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:40.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:42:40.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1 2024-09-12T17:42:40.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.654+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.658+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.658+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:c state=0x55c2b79e5f68 s->prefetch_data=0 2024-09-12T17:42:40.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.658+0000 7f79dbc329c0 20 get_obj_state: setting s->obj_tag to pjdw20785518x4ktyq2k7pc1ytlky5x7 2024-09-12T17:42:40.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.658+0000 7f79dbc329c0 20 get_obj_state_impl: setting s->olh_tag to pq0cqns56cl7t8stsx24j4zcj61exh0w 2024-09-12T17:42:40.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.658+0000 7f79dbc329c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pq0cqns56cl7t8stsx24j4zcj61exh0w 2024-09-12T17:42:40.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.662+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.666+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.666+0000 7f79dbc329c0 20 olh_log_entry: epoch=3 op=3 key=c[7i5z2U9immaIcz-G08V8OwoX0QHfgB3] 2024-09-12T17:42:40.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.666+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:_:7i5z2U9immaIcz-G08V8OwoX0QHfgB3_c state=0x55c2b79e0b38 s->prefetch_data=0 2024-09-12T17:42:40.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.666+0000 7f79dbc329c0 10 manifest: total_size = 22 2024-09-12T17:42:40.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.666+0000 7f79dbc329c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1338535490531571220 2024-09-12T17:42:40.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.666+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:_:7i5z2U9immaIcz-G08V8OwoX0QHfgB3_c state=0x55c2b79e0b38 s->prefetch_data=0 2024-09-12T17:42:40.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.666+0000 7f79dbc329c0 20 prepare_atomic_modification: state is not atomic. state=0x55c2b79e0b38 2024-09-12T17:42:40.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.666+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.674+0000 7f79dbc329c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:42:40.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.674+0000 7f79dbc329c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:42:40.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.674+0000 7f79dbc329c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:42:40.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.674+0000 7f79dbc329c0 5 delete_objs_inline: removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1__shadow:7i5z2U9immaIcz-G08V8OwoX0QHfgB3_.Ht-avls_XUsiW4f09OR67QDuA3gk1gu_0 2024-09-12T17:42:40.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.678+0000 7f79dbc329c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:42:40.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.678+0000 7f78abfff640 20 handle_completion(): completion ok for obj=c[7i5z2U9immaIcz-G08V8OwoX0QHfgB3] 2024-09-12T17:42:40.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.678+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.678+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.686+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.686+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.686+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:d state=0x55c2b79e5f68 s->prefetch_data=0 2024-09-12T17:42:40.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.686+0000 7f79dbc329c0 20 get_obj_state: setting s->obj_tag to hhb33syr3c87o3bcz5by5gsvu9gn22p8 2024-09-12T17:42:40.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.686+0000 7f79dbc329c0 20 get_obj_state_impl: setting s->olh_tag to h4bz2813ybosd5n0ivnkpguq1b94prqz 2024-09-12T17:42:40.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.686+0000 7f79dbc329c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=h4bz2813ybosd5n0ivnkpguq1b94prqz 2024-09-12T17:42:40.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.690+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.694+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.694+0000 7f79dbc329c0 20 olh_log_entry: epoch=3 op=3 key=d[7wBreLWcKHi4ymP8j13robSZH2OPbTA] 2024-09-12T17:42:40.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.694+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:_:7wBreLWcKHi4ymP8j13robSZH2OPbTA_d state=0x55c2b7a16d98 s->prefetch_data=0 2024-09-12T17:42:40.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.694+0000 7f79dbc329c0 10 manifest: total_size = 9 2024-09-12T17:42:40.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.694+0000 7f79dbc329c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8364968688928222041 2024-09-12T17:42:40.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.694+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:_:7wBreLWcKHi4ymP8j13robSZH2OPbTA_d state=0x55c2b7a16d98 s->prefetch_data=0 2024-09-12T17:42:40.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.694+0000 7f79dbc329c0 20 prepare_atomic_modification: state is not atomic. state=0x55c2b7a16d98 2024-09-12T17:42:40.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.694+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.702+0000 7f79dbc329c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:42:40.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.702+0000 7f79dbc329c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T17:42:40.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.702+0000 7f79dbc329c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:42:40.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.702+0000 7f79dbc329c0 5 delete_objs_inline: removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1__shadow:7wBreLWcKHi4ymP8j13robSZH2OPbTA_.tPE99e9XOjCINkXvlebx6nBRo77NB9T_0 2024-09-12T17:42:40.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.702+0000 7f78bcff9640 20 handle_completion(): completion ok for obj=d[7wBreLWcKHi4ymP8j13robSZH2OPbTA] 2024-09-12T17:42:40.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.706+0000 7f79dbc329c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:42:40.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.706+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.706+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.710+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.710+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.710+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:e state=0x55c2b7a123c8 s->prefetch_data=0 2024-09-12T17:42:40.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.714+0000 7f79dbc329c0 20 get_obj_state: setting s->obj_tag to rcovyxy8bjwbvo81t1u63p9ayhbyicqd 2024-09-12T17:42:40.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.714+0000 7f79dbc329c0 20 get_obj_state_impl: setting s->olh_tag to ca1qo6maqs13vwr0u1hbzkutg39j5y7l 2024-09-12T17:42:40.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.714+0000 7f79dbc329c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ca1qo6maqs13vwr0u1hbzkutg39j5y7l 2024-09-12T17:42:40.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.718+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.718+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.722+0000 7f79dbc329c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:42:40.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.722+0000 7f79dbc329c0 20 olh_log_entry: epoch=2 op=3 key=e[KhDTwDwvsoNcVaWvpvGsyehVBICQLvq] 2024-09-12T17:42:40.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.722+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:_:KhDTwDwvsoNcVaWvpvGsyehVBICQLvq_e state=0x55c2b79e6f78 s->prefetch_data=0 2024-09-12T17:42:40.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.722+0000 7f79dbc329c0 10 manifest: total_size = 9 2024-09-12T17:42:40.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.722+0000 7f79dbc329c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6064836421368237880 2024-09-12T17:42:40.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.722+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:_:KhDTwDwvsoNcVaWvpvGsyehVBICQLvq_e state=0x55c2b79e6f78 s->prefetch_data=0 2024-09-12T17:42:40.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.722+0000 7f79dbc329c0 20 prepare_atomic_modification: state is not atomic. state=0x55c2b79e6f78 2024-09-12T17:42:40.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.722+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.730+0000 7f79dbc329c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:42:40.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.730+0000 7f79dbc329c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T17:42:40.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.730+0000 7f79dbc329c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:42:40.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.730+0000 7f79dbc329c0 5 delete_objs_inline: removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1__shadow:KhDTwDwvsoNcVaWvpvGsyehVBICQLvq_.t1bzspydJv1W58dEWlDGo2RU3TCeeMz_0 2024-09-12T17:42:40.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.734+0000 7f79dbc329c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:42:40.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.734+0000 7f78bcff9640 20 handle_completion(): completion ok for obj=e[KhDTwDwvsoNcVaWvpvGsyehVBICQLvq] 2024-09-12T17:42:40.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.734+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:e state=0x55c2b7a123c8 s->prefetch_data=0 2024-09-12T17:42:40.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.734+0000 7f79dbc329c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ca1qo6maqs13vwr0u1hbzkutg39j5y7l 2024-09-12T17:42:40.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.742+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.746+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.746+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.746+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:f state=0x55c2b7a15d88 s->prefetch_data=0 2024-09-12T17:42:40.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.746+0000 7f79dbc329c0 20 get_obj_state: setting s->obj_tag to 1u13xazemajz60kb8bvjk17ad7zfeii7 2024-09-12T17:42:40.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.746+0000 7f79dbc329c0 20 get_obj_state_impl: setting s->olh_tag to 06siif1phm089lp9snak3he1muuan72z 2024-09-12T17:42:40.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.746+0000 7f79dbc329c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=06siif1phm089lp9snak3he1muuan72z 2024-09-12T17:42:40.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.750+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.754+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.754+0000 7f79dbc329c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:42:40.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.754+0000 7f79dbc329c0 20 olh_log_entry: epoch=2 op=3 key=f[j-D27NQKppmxK5QF4YRzUF.Ab-0TfnJ] 2024-09-12T17:42:40.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.754+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:_:j-D27NQKppmxK5QF4YRzUF.Ab-0TfnJ_f state=0x55c2b79e6f78 s->prefetch_data=0 2024-09-12T17:42:40.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.758+0000 7f79dbc329c0 10 manifest: total_size = 22 2024-09-12T17:42:40.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.758+0000 7f79dbc329c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7100296663314662852 2024-09-12T17:42:40.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.758+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:_:j-D27NQKppmxK5QF4YRzUF.Ab-0TfnJ_f state=0x55c2b79e6f78 s->prefetch_data=0 2024-09-12T17:42:40.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.758+0000 7f79dbc329c0 20 prepare_atomic_modification: state is not atomic. state=0x55c2b79e6f78 2024-09-12T17:42:40.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.758+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.766+0000 7f79dbc329c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:42:40.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.766+0000 7f79dbc329c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:42:40.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.766+0000 7f79dbc329c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:42:40.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.766+0000 7f79dbc329c0 5 delete_objs_inline: removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1__shadow:j-D27NQKppmxK5QF4YRzUF.Ab-0TfnJ_.H6Wi61jO1YFgDy4J0HRPb8eAjjXt57Z_0 2024-09-12T17:42:40.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.766+0000 7f79dbc329c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:42:40.771 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.770+0000 7f78bcff9640 20 handle_completion(): completion ok for obj=f[j-D27NQKppmxK5QF4YRzUF.Ab-0TfnJ] 2024-09-12T17:42:40.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.770+0000 7f79dbc329c0 20 get_obj_state: octx=0x55c2b7737200 obj=check-bucket:f state=0x55c2b7a15d88 s->prefetch_data=0 2024-09-12T17:42:40.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.770+0000 7f79dbc329c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=06siif1phm089lp9snak3he1muuan72z 2024-09-12T17:42:40.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.778+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.778+0000 7f79dbc329c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1.0 2024-09-12T17:42:40.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.778+0000 7f79dbc329c0 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T17:42:40.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.778+0000 7f79dbc329c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:42:40.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.782+0000 7f788ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:40.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.790+0000 7f79dbc329c0 20 remove_watcher() i=0 2024-09-12T17:42:40.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.790+0000 7f79dbc329c0 2 removed watcher, disabling cache 2024-09-12T17:42:40.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.790+0000 7f79dbc329c0 20 remove_watcher() i=1 2024-09-12T17:42:40.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.794+0000 7f79dbc329c0 20 remove_watcher() i=2 2024-09-12T17:42:40.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.798+0000 7f79dbc329c0 20 remove_watcher() i=3 2024-09-12T17:42:40.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.798+0000 7f79dbc329c0 20 remove_watcher() i=4 2024-09-12T17:42:40.804 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.802+0000 7f79dbc329c0 20 remove_watcher() i=5 2024-09-12T17:42:40.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.802+0000 7f79dbc329c0 20 remove_watcher() i=6 2024-09-12T17:42:40.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:40.806+0000 7f79dbc329c0 20 remove_watcher() i=7 2024-09-12T17:42:41.364 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:42:41.397 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:41.397 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:41.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.438+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.442+0000 7f4cff6669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:41.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.442+0000 7f4cff6669c0 20 realm 2024-09-12T17:42:41.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.442+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.442+0000 7f4cff6669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:41.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.442+0000 7f4cff6669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:41.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.442+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.442+0000 7f4cff6669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:41.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.442+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.442+0000 7f4cff6669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:41.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.442+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.446+0000 7f4cff6669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:41.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.446+0000 7f4cff6669c0 20 searching for the correct realm 2024-09-12T17:42:41.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.654+0000 7f4cfc96b640 0 -- 172.21.15.157:0/1434018119 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f4cf401f040 msgr2=0x7f4cf403aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:41.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.666+0000 7f4cfd16c640 0 -- 172.21.15.157:0/1434018119 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f4cf402d420 msgr2=0x7f4cf402d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.882+0000 7f4cff6669c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:42:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.882+0000 7f4cff6669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.882+0000 7f4cff6669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.882+0000 7f4cff6669c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:42:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.882+0000 7f4cff6669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.882+0000 7f4cff6669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.882+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.882+0000 7f4cff6669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:41.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.882+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:41.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 zone default found 2024-09-12T17:42:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 4 Realm: () 2024-09-12T17:42:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:42:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:42:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 zonegroup default 2024-09-12T17:42:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:41.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:41.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:41.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 started sync module instance, tier type = 2024-09-12T17:42:41.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.886+0000 7f4cff6669c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:42:41.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.910+0000 7f4cff6669c0 20 add_watcher() i=0 2024-09-12T17:42:41.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.910+0000 7f4cff6669c0 20 add_watcher() i=1 2024-09-12T17:42:41.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.910+0000 7f4cff6669c0 20 add_watcher() i=2 2024-09-12T17:42:41.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.910+0000 7f4cff6669c0 20 add_watcher() i=3 2024-09-12T17:42:41.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.910+0000 7f4cff6669c0 20 add_watcher() i=4 2024-09-12T17:42:41.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.910+0000 7f4cff6669c0 20 add_watcher() i=5 2024-09-12T17:42:41.916 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.910+0000 7f4cff6669c0 20 add_watcher() i=6 2024-09-12T17:42:41.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.914+0000 7f4cff6669c0 20 add_watcher() i=7 2024-09-12T17:42:41.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.914+0000 7f4cff6669c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:41.921 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.918+0000 7f4bb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:41.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.918+0000 7f4cff6669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:41.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.918+0000 7f4cff6669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:41.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.918+0000 7f4cff6669c0 5 note: GC not initialized 2024-09-12T17:42:41.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.918+0000 7f4bb27e4640 20 reqs_thread_entry: start 2024-09-12T17:42:41.923 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.918+0000 7f4cff6669c0 20 init_complete bucket index max shards: 1 2024-09-12T17:42:41.924 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4cff6669c0 20 Filter name: none 2024-09-12T17:42:41.924 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4b23fff640 20 reqs_thread_entry: start 2024-09-12T17:42:41.924 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.924 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4cff6669c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:41.924 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.925 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4cff6669c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:41.925 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4cff6669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:41.925 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4cff6669c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:42:41.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4cff6669c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:41.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4cff6669c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:42:41.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.922+0000 7f4cff6669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:41.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.926+0000 7f4bb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:41.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.934+0000 7f4cff6669c0 20 remove_watcher() i=0 2024-09-12T17:42:41.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.934+0000 7f4cff6669c0 2 removed watcher, disabling cache 2024-09-12T17:42:41.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.934+0000 7f4cff6669c0 20 remove_watcher() i=1 2024-09-12T17:42:41.940 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.938+0000 7f4cff6669c0 20 remove_watcher() i=2 2024-09-12T17:42:41.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.938+0000 7f4cff6669c0 20 remove_watcher() i=3 2024-09-12T17:42:41.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.942+0000 7f4cff6669c0 20 remove_watcher() i=4 2024-09-12T17:42:41.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.942+0000 7f4cff6669c0 20 remove_watcher() i=5 2024-09-12T17:42:41.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.946+0000 7f4cff6669c0 20 remove_watcher() i=6 2024-09-12T17:42:41.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:42:41.946+0000 7f4cff6669c0 20 remove_watcher() i=7 2024-09-12T17:42:41.963 INFO:tasks.workunit.client.0.smithi157.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:42:41.963 INFO:tasks.workunit.client.0.smithi157.stderr:Deleting bucket check-bucket 2024-09-12T17:42:42.305 INFO:tasks.workunit.client.0.smithi157.stderr:Completed bucket check tests 2024-09-12T17:42:42.305 INFO:tasks.workunit.client.0.smithi157.stdout:connected to http://localhost:80 2024-09-12T17:42:42.405 INFO:tasks.workunit.client.0.smithi157.stderr:+ deactivate 2024-09-12T17:42:42.406 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T17:42:42.406 INFO:tasks.workunit.client.0.smithi157.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:42:42.406 INFO:tasks.workunit.client.0.smithi157.stderr:+ export PATH 2024-09-12T17:42:42.406 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:42:42.406 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n '' ']' 2024-09-12T17:42:42.406 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:42:42.406 INFO:tasks.workunit.client.0.smithi157.stderr:+ hash -r 2024-09-12T17:42:42.406 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n '' ']' 2024-09-12T17:42:42.406 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:42:42.406 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:42:42.406 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:42:42.407 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset -f deactivate 2024-09-12T17:42:42.407 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo OK. 2024-09-12T17:42:42.408 INFO:tasks.workunit.client.0.smithi157.stdout:OK. 2024-09-12T17:42:42.408 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:42:42.408 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:42:42.427 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T17:42:42.427 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:42:42.851 DEBUG:teuthology.parallel:result is None 2024-09-12T17:42:42.852 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:42:42.864 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:42:42.864 DEBUG:teuthology.orchestra.run.smithi157:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:42:42.918 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:42:42.918 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:42:42.929 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:42:42.930 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:42:42.930 DEBUG:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:42:42.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:42:42.964 INFO:teuthology.orchestra.run.smithi157.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:42:42.964 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:42:43.012 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:42:43.012 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:42:43.060 INFO:tasks.workunit:timeout=3h 2024-09-12T17:42:43.060 INFO:tasks.workunit:cleanup=True 2024-09-12T17:42:43.060 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:42:43.110 INFO:tasks.workunit.client.0.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:43:40.433 INFO:tasks.workunit.client.0.smithi157.stderr:Updating files: 99% (12585/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:43:41.097 INFO:tasks.workunit.client.0.smithi157.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:43:41.098 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:43:41.098 INFO:tasks.workunit.client.0.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:43:41.098 INFO:tasks.workunit.client.0.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:43:41.098 INFO:tasks.workunit.client.0.smithi157.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:43:41.098 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:43:41.098 INFO:tasks.workunit.client.0.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:43:41.098 INFO:tasks.workunit.client.0.smithi157.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:43:41.098 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:43:41.098 INFO:tasks.workunit.client.0.smithi157.stderr: git switch -c 2024-09-12T17:43:41.098 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi157.stderr:Or undo this operation with: 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi157.stderr: git switch - 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi157.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi157.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:43:41.106 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:43:41.153 INFO:tasks.workunit.client.0.smithi157.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:43:41.155 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:43:41.155 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:43:41.212 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:43:41.271 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:43:41.320 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:43:41.323 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:43:41.323 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:43:41.366 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:43:41.369 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:43:41.369 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:43:41.415 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T17:43:41.417 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T17:43:41.417 DEBUG:teuthology.orchestra.run.smithi157:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T17:43:41.479 INFO:tasks.workunit.client.0.smithi157.stdout:Running main() from gmock_main.cc 2024-09-12T17:43:41.480 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:43:41.480 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:43:41.480 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 11 tests from ClsLock 2024-09-12T17:43:41.480 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T17:43:43.679 INFO:tasks.workunit.client.0.smithi157.stdout:lock: mylock 2024-09-12T17:43:43.679 INFO:tasks.workunit.client.0.smithi157.stdout: lock_type: exclusive 2024-09-12T17:43:43.679 INFO:tasks.workunit.client.0.smithi157.stdout: tag: 2024-09-12T17:43:43.679 INFO:tasks.workunit.client.0.smithi157.stdout: lockers: 2024-09-12T17:43:43.680 INFO:tasks.workunit.client.0.smithi157.stdout: client.5184 expiration=2024-09-12T17:45:43.668805+0000 addr=v1:172.21.15.157:0/2404742466 cookie= 2024-09-12T17:43:43.692 INFO:tasks.workunit.client.0.smithi157.stdout:lock: mylock 2024-09-12T17:43:43.692 INFO:tasks.workunit.client.0.smithi157.stdout: lock_type: shared 2024-09-12T17:43:43.692 INFO:tasks.workunit.client.0.smithi157.stdout: tag: 2024-09-12T17:43:43.692 INFO:tasks.workunit.client.0.smithi157.stdout: lockers: 2024-09-12T17:43:43.692 INFO:tasks.workunit.client.0.smithi157.stdout: client.5184 expiration=2024-09-12T17:45:43.688231+0000 addr=v1:172.21.15.157:0/2404742466 cookie= 2024-09-12T17:43:43.692 INFO:tasks.workunit.client.0.smithi157.stdout: client.5193 expiration=0.000000 addr=v1:172.21.15.157:0/2472293065 cookie= 2024-09-12T17:43:43.697 INFO:tasks.workunit.client.0.smithi157.stdout:lock: mylock 2024-09-12T17:43:43.697 INFO:tasks.workunit.client.0.smithi157.stdout: lock_type: shared 2024-09-12T17:43:43.697 INFO:tasks.workunit.client.0.smithi157.stdout: tag: 2024-09-12T17:43:43.697 INFO:tasks.workunit.client.0.smithi157.stdout: lockers: 2024-09-12T17:43:43.697 INFO:tasks.workunit.client.0.smithi157.stdout: client.5193 expiration=0.000000 addr=v1:172.21.15.157:0/2472293065 cookie= 2024-09-12T17:43:44.461 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsLock.TestMultiLocking (2982 ms) 2024-09-12T17:43:44.462 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T17:43:46.546 INFO:tasks.workunit.client.0.smithi157.stdout:lock: mylock 2024-09-12T17:43:46.546 INFO:tasks.workunit.client.0.smithi157.stdout: lock_type: shared 2024-09-12T17:43:46.546 INFO:tasks.workunit.client.0.smithi157.stdout: tag: 2024-09-12T17:43:46.546 INFO:tasks.workunit.client.0.smithi157.stdout: lockers: 2024-09-12T17:43:46.546 INFO:tasks.workunit.client.0.smithi157.stdout: client.5205 expiration=0.000000 addr=v1:172.21.15.157:0/205898437 cookie= 2024-09-12T17:43:46.550 INFO:tasks.workunit.client.0.smithi157.stdout:lock: mylock 2024-09-12T17:43:46.550 INFO:tasks.workunit.client.0.smithi157.stdout: lock_type: exclusive 2024-09-12T17:43:46.550 INFO:tasks.workunit.client.0.smithi157.stdout: tag: new_tag 2024-09-12T17:43:46.550 INFO:tasks.workunit.client.0.smithi157.stdout: lockers: 2024-09-12T17:43:46.550 INFO:tasks.workunit.client.0.smithi157.stdout: client.5003 expiration=0.000000 addr=v1:172.21.15.157:0/974043267 cookie= 2024-09-12T17:43:47.485 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsLock.TestMeta (3024 ms) 2024-09-12T17:43:47.485 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T17:43:49.541 INFO:tasks.workunit.client.0.smithi157.stdout:lock: mylock 2024-09-12T17:43:49.542 INFO:tasks.workunit.client.0.smithi157.stdout: lock_type: exclusive 2024-09-12T17:43:49.542 INFO:tasks.workunit.client.0.smithi157.stdout: tag: 2024-09-12T17:43:49.542 INFO:tasks.workunit.client.0.smithi157.stdout: lockers: 2024-09-12T17:43:49.546 INFO:tasks.workunit.client.0.smithi157.stdout:lock: mylock 2024-09-12T17:43:49.548 INFO:tasks.workunit.client.0.smithi157.stdout: lock_type: shared 2024-09-12T17:43:49.548 INFO:tasks.workunit.client.0.smithi157.stdout: tag: 2024-09-12T17:43:49.548 INFO:tasks.workunit.client.0.smithi157.stdout: lockers: 2024-09-12T17:43:49.548 INFO:tasks.workunit.client.0.smithi157.stdout: client.5211 expiration=0.000000 addr=v1:172.21.15.157:0/827374236 cookie= 2024-09-12T17:43:49.548 INFO:tasks.workunit.client.0.smithi157.stdout: client.5211 expiration=0.000000 addr=v1:172.21.15.157:0/827374236 cookie=new cookie 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsLock.TestCookie (3049 ms) 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T17:43:53.585 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsLock.TestMultipleLocks (3051 ms) 2024-09-12T17:43:53.585 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T17:44:01.347 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsLock.TestLockDuration (7762 ms) 2024-09-12T17:44:01.347 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T17:44:04.397 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsLock.TestAssertLocked (3050 ms) 2024-09-12T17:44:04.398 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T17:44:07.420 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsLock.TestSetCookie (3022 ms) 2024-09-12T17:44:07.420 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T17:44:28.372 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsLock.TestRenew (20953 ms) 2024-09-12T17:44:28.373 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T17:44:35.438 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7063 ms) 2024-09-12T17:44:35.439 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T17:44:43.491 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8056 ms) 2024-09-12T17:44:43.491 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T17:44:51.372 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7881 ms) 2024-09-12T17:44:51.373 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 11 tests from ClsLock (69893 ms total) 2024-09-12T17:44:51.373 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:44:51.373 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:44:51.373 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 11 tests from 1 test suite ran. (69893 ms total) 2024-09-12T17:44:51.373 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 11 tests. 2024-09-12T17:44:51.378 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:44:51.379 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:44:51.439 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T17:44:51.440 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T17:44:51.441 DEBUG:teuthology.orchestra.run.smithi157:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T17:44:51.505 INFO:tasks.workunit.client.0.smithi157.stdout:Running main() from gmock_main.cc 2024-09-12T17:44:51.505 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:44:51.505 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:44:51.505 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 4 tests from cls_log 2024-09-12T17:44:51.506 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T17:44:54.422 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_log.test_log_add_same_time (2913 ms) 2024-09-12T17:44:54.422 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T17:44:57.445 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_log.test_log_add_different_time (3027 ms) 2024-09-12T17:44:57.446 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T17:45:00.504 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_log.trim_by_time (3058 ms) 2024-09-12T17:45:00.504 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T17:45:03.511 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_log.trim_by_marker (3007 ms) 2024-09-12T17:45:03.511 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 4 tests from cls_log (12006 ms total) 2024-09-12T17:45:03.512 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:45:03.512 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:45:03.512 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 4 tests from 1 test suite ran. (12006 ms total) 2024-09-12T17:45:03.512 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 4 tests. 2024-09-12T17:45:03.516 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:45:03.516 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:45:03.571 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T17:45:03.573 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T17:45:03.573 DEBUG:teuthology.orchestra.run.smithi157:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T17:45:03.641 INFO:tasks.workunit.client.0.smithi157.stdout:Running main() from gmock_main.cc 2024-09-12T17:45:03.641 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:45:03.642 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:45:03.642 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 10 tests from cls_refcount 2024-09-12T17:45:03.642 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T17:45:06.583 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_refcount.test_implicit (2942 ms) 2024-09-12T17:45:06.583 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T17:45:09.591 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3008 ms) 2024-09-12T17:45:09.591 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T17:45:18.699 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_refcount.test_put_snap (9108 ms) 2024-09-12T17:45:18.699 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T17:45:21.706 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_refcount.test_explicit (3007 ms) 2024-09-12T17:45:21.706 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_refcount.set 2024-09-12T17:45:24.786 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_refcount.set (3076 ms) 2024-09-12T17:45:24.786 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T17:45:31.804 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_refcount.test_implicit_ec (7021 ms) 2024-09-12T17:45:31.804 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T17:45:38.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7044 ms) 2024-09-12T17:45:38.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T17:45:51.006 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_refcount.test_put_snap_ec (12159 ms) 2024-09-12T17:45:51.007 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T17:45:58.064 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_refcount.test_explicit_ec (7058 ms) 2024-09-12T17:45:58.065 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T17:46:05.106 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_refcount.set_ec (7042 ms) 2024-09-12T17:46:05.107 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 10 tests from cls_refcount (61466 ms total) 2024-09-12T17:46:05.107 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:46:05.107 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:46:05.107 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 10 tests from 1 test suite ran. (61466 ms total) 2024-09-12T17:46:05.107 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 10 tests. 2024-09-12T17:46:05.112 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:46:05.112 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:46:05.167 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T17:46:05.168 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T17:46:05.169 DEBUG:teuthology.orchestra.run.smithi157:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T17:46:05.235 INFO:tasks.workunit.client.0.smithi157.stdout:Running main() from gmock_main.cc 2024-09-12T17:46:05.235 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-12T17:46:05.235 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:46:05.236 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 18 tests from cls_rgw 2024-09-12T17:46:07.136 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T17:46:07.215 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.index_basic (79 ms) 2024-09-12T17:46:07.216 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T17:46:07.295 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (80 ms) 2024-09-12T17:46:07.296 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T17:46:07.408 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.index_remove_object (112 ms) 2024-09-12T17:46:07.408 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T17:46:09.884 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.index_suggest (2477 ms) 2024-09-12T17:46:09.884 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T17:46:09.900 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.index_suggest_complete (15 ms) 2024-09-12T17:46:09.900 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T17:46:09.972 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.index_list (73 ms) 2024-09-12T17:46:09.973 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T17:46:48.067 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.index_list_delimited (38094 ms) 2024-09-12T17:46:48.067 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T17:46:48.203 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.bi_list (137 ms) 2024-09-12T17:46:48.203 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T17:46:48.218 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.gc_set (16 ms) 2024-09-12T17:46:48.218 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T17:46:48.234 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.gc_list (15 ms) 2024-09-12T17:46:48.234 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T17:46:55.609 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.gc_defer (7375 ms) 2024-09-12T17:46:55.609 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T17:46:55.822 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.usage_basic (213 ms) 2024-09-12T17:46:55.822 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T17:46:55.825 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-09-12T17:46:55.825 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T17:46:56.059 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.usage_clear (234 ms) 2024-09-12T17:46:56.059 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T17:46:56.173 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.bi_log_trim (114 ms) 2024-09-12T17:46:56.174 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T17:46:56.206 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.index_racing_removes (32 ms) 2024-09-12T17:46:56.206 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T17:46:56.243 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.reshardlog_list (37 ms) 2024-09-12T17:46:56.243 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T17:46:56.269 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw.reshardlog_num (26 ms) 2024-09-12T17:46:56.615 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 18 tests from cls_rgw (49133 ms total) 2024-09-12T17:46:56.615 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:46:56.616 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:46:56.616 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 18 tests from 1 test suite ran. (51380 ms total) 2024-09-12T17:46:56.616 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 18 tests. 2024-09-12T17:46:56.623 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:46:56.623 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:46:56.677 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T17:46:56.678 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T17:46:56.679 DEBUG:teuthology.orchestra.run.smithi157:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T17:46:56.743 INFO:tasks.workunit.client.0.smithi157.stdout:Running main() from gmock_main.cc 2024-09-12T17:46:56.743 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:46:56.743 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:46:56.743 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T17:46:56.743 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T17:46:58.622 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw_gc.init (1879 ms) 2024-09-12T17:46:58.622 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T17:46:58.846 INFO:tasks.workunit.client.0.smithi157.stderr:[ ] list info tag = chain-0 2024-09-12T17:46:58.846 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (224 ms) 2024-09-12T17:46:58.846 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T17:46:58.864 INFO:tasks.workunit.client.0.smithi157.stderr:[ ] next_marker is: = 0/4263 2024-09-12T17:46:58.865 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (19 ms) 2024-09-12T17:46:58.865 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T17:46:58.883 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (19 ms) 2024-09-12T17:46:58.883 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T17:46:58.905 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (22 ms) 2024-09-12T17:46:58.906 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T17:46:58.924 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (18 ms) 2024-09-12T17:46:58.925 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T17:46:58.943 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (19 ms) 2024-09-12T17:46:58.943 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T17:46:58.961 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (17 ms) 2024-09-12T17:46:58.961 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T17:46:59.649 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw_gc.finalize (688 ms) 2024-09-12T17:46:59.649 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 9 tests from cls_rgw_gc (2906 ms total) 2024-09-12T17:46:59.649 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:46:59.649 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:46:59.649 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 9 tests from 1 test suite ran. (2906 ms total) 2024-09-12T17:46:59.649 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 9 tests. 2024-09-12T17:46:59.654 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:46:59.654 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:46:59.711 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T17:46:59.712 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T17:46:59.712 DEBUG:teuthology.orchestra.run.smithi157:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T17:46:59.786 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:59.787 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:59.787 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T17:46:59.787 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:47:01.665 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T17:47:01.665 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T17:47:01.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.695+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=8ZDYKNVHXBI7 type=del size=4027689 2024-09-12T17:47:01.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.695+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=6DHPZ6L9900U type=del size=3105738 2024-09-12T17:47:01.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.703+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~Q1IDD6JIV75Q.0 size=67544 2024-09-12T17:47:01.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.703+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=Q1IDD6JIV75Q tag=M7P0V0QJPQS7 type=write size=1116120 2024-09-12T17:47:01.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.703+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=P2K8TEL967EW type=del size=3793105 2024-09-12T17:47:01.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.707+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~J1L1A6O4LEU2.0 size=434177 2024-09-12T17:47:01.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.707+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=J1L1A6O4LEU2 tag=1U3271XKGM4W type=write size=1482753 2024-09-12T17:47:01.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.711+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=BXQH808STPR3 type=del size=3977128 2024-09-12T17:47:01.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.711+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=POZRNECOEFLZ type=del size=500625 2024-09-12T17:47:01.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.715+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~U4PKJB0OW05Z.0 size=1048576 2024-09-12T17:47:01.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.719+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~U4PKJB0OW05Z.1 size=1048576 2024-09-12T17:47:01.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.719+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~U4PKJB0OW05Z.2 size=752393 2024-09-12T17:47:01.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.719+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=U4PKJB0OW05Z tag=1Q9GL0NGKDTB type=write size=3898121 2024-09-12T17:47:01.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.723+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=0UDLOFV0Y2RR type=del size=2100917 2024-09-12T17:47:01.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.727+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~OIOQIL4M46QH.0 size=1048576 2024-09-12T17:47:01.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.731+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~OIOQIL4M46QH.1 size=80041 2024-09-12T17:47:01.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.731+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=OIOQIL4M46QH tag=MIT8B5RWH9YC type=write size=2177193 2024-09-12T17:47:01.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.731+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=7YH3JL3U037C type=del size=1601154 2024-09-12T17:47:01.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.735+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=LP7E0FQG5F9Y type=del size=2683513 2024-09-12T17:47:01.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~SSUX386XG83M.0 size=1048576 2024-09-12T17:47:01.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~SSUX386XG83M.1 size=777464 2024-09-12T17:47:01.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.739+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=SSUX386XG83M tag=4MHCC70J69XR type=write size=2874616 2024-09-12T17:47:01.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.743+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~OTQF78ASWXYN.0 size=1048576 2024-09-12T17:47:01.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.747+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~OTQF78ASWXYN.1 size=623122 2024-09-12T17:47:01.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.747+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=OTQF78ASWXYN tag=Q17FB18G72BH type=write size=2720274 2024-09-12T17:47:01.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.751+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=8BQ6K0I58JOX type=del size=518363 2024-09-12T17:47:01.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.751+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=BZGPPNOB65EJ type=del size=3960399 2024-09-12T17:47:01.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.755+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=8ZDYKNVHXBI7 type=del 2024-09-12T17:47:01.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.755+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=XOED79JMPTDM type=del size=1650677 2024-09-12T17:47:01.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.759+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=6DHPZ6L9900U type=del 2024-09-12T17:47:01.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.759+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=8Z1JP6HG6O2S type=del size=535742 2024-09-12T17:47:01.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.763+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~Q1IDD6JIV75Q.0 size=67544 2024-09-12T17:47:01.771 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.767+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=Q1IDD6JIV75Q tag=M7P0V0QJPQS7 type=write size=1116120 2024-09-12T17:47:01.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.771+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~ZL09IUK2GD58.0 size=282208 2024-09-12T17:47:01.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.771+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=ZL09IUK2GD58 tag=GXSKIBFJ5SOB type=write size=1330784 2024-09-12T17:47:01.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.775+0000 7f68bc0598c0 1 < suggested update operation key=06W7N11O7F1I tag=P2K8TEL967EW type=del size=3793105 2024-09-12T17:47:01.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.779+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=A022SI4QQDTI type=del size=608849 2024-09-12T17:47:01.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.783+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~J1L1A6O4LEU2.0 size=434177 2024-09-12T17:47:01.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.787+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=J1L1A6O4LEU2 tag=1U3271XKGM4W type=write size=1482753 2024-09-12T17:47:01.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.787+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=QFXNNXLYOXW6 type=del size=2707284 2024-09-12T17:47:01.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.791+0000 7f68bc0598c0 1 < suggested update operation key=KW3VWTA43PBM tag=BXQH808STPR3 type=del size=3977128 2024-09-12T17:47:01.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.795+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=HJOZBGBZU8Z2 type=del size=2313766 2024-09-12T17:47:01.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.799+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=POZRNECOEFLZ type=del 2024-09-12T17:47:01.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.803+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~50RGEYM3QHCV.0 size=669605 2024-09-12T17:47:01.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.803+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=50RGEYM3QHCV tag=FJID2LD0G802 type=write size=1718181 2024-09-12T17:47:01.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.803+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~U4PKJB0OW05Z.0 size=1048576 2024-09-12T17:47:01.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.807+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~U4PKJB0OW05Z.1 size=1048576 2024-09-12T17:47:01.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.807+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~U4PKJB0OW05Z.2 size=752393 2024-09-12T17:47:01.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.811+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=U4PKJB0OW05Z tag=1Q9GL0NGKDTB type=write size=3898121 2024-09-12T17:47:01.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.815+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=S897FWPKAGFN type=del size=1117509 2024-09-12T17:47:01.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.819+0000 7f68bc0598c0 1 < suggested remove operation key=F4F4P4L8K5D9 tag=0UDLOFV0Y2RR type=del 2024-09-12T17:47:01.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.819+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=BOSEN6D5NQ89 type=write size=209661 2024-09-12T17:47:01.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.823+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~OIOQIL4M46QH.0 size=1048576 2024-09-12T17:47:01.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.823+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~OIOQIL4M46QH.1 size=80041 2024-09-12T17:47:01.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.831+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=OIOQIL4M46QH tag=MIT8B5RWH9YC type=write size=2177193 2024-09-12T17:47:01.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~ZTEUS9R3JDLL.0 size=1048576 2024-09-12T17:47:01.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~ZTEUS9R3JDLL.1 size=1048576 2024-09-12T17:47:01.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~ZTEUS9R3JDLL.2 size=832346 2024-09-12T17:47:01.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.835+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=ZTEUS9R3JDLL tag=Q3H3H4L4H5DF type=write size=3978074 2024-09-12T17:47:01.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.839+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=7YH3JL3U037C type=del 2024-09-12T17:47:01.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.843+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=98OADTCBYEFK type=del size=2847482 2024-09-12T17:47:01.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.843+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=LP7E0FQG5F9Y type=del 2024-09-12T17:47:01.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.847+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~0RCZIZZW48CC.0 size=1048576 2024-09-12T17:47:01.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.851+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~0RCZIZZW48CC.1 size=611617 2024-09-12T17:47:01.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.851+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=0RCZIZZW48CC tag=T09O95RIK8YK type=write size=2708769 2024-09-12T17:47:01.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.851+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~SSUX386XG83M.0 size=1048576 2024-09-12T17:47:01.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.855+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~SSUX386XG83M.1 size=777464 2024-09-12T17:47:01.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.859+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=SSUX386XG83M tag=4MHCC70J69XR type=write size=2874616 2024-09-12T17:47:01.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.863+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=ZJHM1LGQGTAT type=del size=1379405 2024-09-12T17:47:01.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.863+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~OTQF78ASWXYN.0 size=1048576 2024-09-12T17:47:01.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.863+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~OTQF78ASWXYN.1 size=623122 2024-09-12T17:47:01.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.867+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=OTQF78ASWXYN tag=Q17FB18G72BH type=write size=2720274 2024-09-12T17:47:01.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.871+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=VPJCZN8P8818 type=del size=2540723 2024-09-12T17:47:01.877 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.875+0000 7f68bc0598c0 1 < canceled operation key=6SUA9FBDU69A tag=8BQ6K0I58JOX type=del size=518363 2024-09-12T17:47:01.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.875+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=K6CX1RESJAES type=del size=2720474 2024-09-12T17:47:01.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.879+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=BZGPPNOB65EJ type=del 2024-09-12T17:47:01.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.883+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=R80XHZAS3X72 type=del size=10456 2024-09-12T17:47:01.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.883+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=XOED79JMPTDM type=del 2024-09-12T17:47:01.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.887+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=8DTJPUX6EGHN type=del size=3920572 2024-09-12T17:47:01.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.887+0000 7f68bc0598c0 -1 < failed to complete operation key=F4F4P4L8K5D9 tag=8Z1JP6HG6O2S type=del size=535742: (22) Invalid argument 2024-09-12T17:47:01.896 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~DIY7QPWNXLU9.0 size=1048576 2024-09-12T17:47:01.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.895+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~DIY7QPWNXLU9.1 size=1048576 2024-09-12T17:47:01.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.895+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~DIY7QPWNXLU9.2 size=1019149 2024-09-12T17:47:01.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.895+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=DIY7QPWNXLU9 tag=OJ98FQ8AQDYG type=write size=4164877 2024-09-12T17:47:01.902 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.899+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~ZL09IUK2GD58.0 size=282208 2024-09-12T17:47:01.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.903+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=ZL09IUK2GD58 tag=GXSKIBFJ5SOB type=write size=1330784 2024-09-12T17:47:01.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.907+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~37603UP01K65.0 size=384713 2024-09-12T17:47:01.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.907+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=37603UP01K65 tag=AZ5W0PVZN85C type=write size=1433289 2024-09-12T17:47:01.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.911+0000 7f68bc0598c0 1 < suggested update operation key=WUGDIFCHNL90 tag=A022SI4QQDTI type=del size=608849 2024-09-12T17:47:01.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.915+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~F49P5WWPMNQ8.0 size=447021 2024-09-12T17:47:01.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.915+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=F49P5WWPMNQ8 tag=6OYHBY4QXGBL type=write size=1495597 2024-09-12T17:47:01.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.919+0000 7f68bc0598c0 1 < suggested remove operation key=4R9ENKMRB1GT tag=QFXNNXLYOXW6 type=del 2024-09-12T17:47:01.924 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.919+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=01QF8AZAYZEA type=write size=844056 2024-09-12T17:47:01.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.923+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=HJOZBGBZU8Z2 type=del 2024-09-12T17:47:01.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.927+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=7U7QD07AAQ8A type=del size=767217 2024-09-12T17:47:01.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.927+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~50RGEYM3QHCV.0 size=669605 2024-09-12T17:47:01.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.935+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=50RGEYM3QHCV tag=FJID2LD0G802 type=write size=1718181 2024-09-12T17:47:01.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.935+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~SGPYE9WDMH05.0 size=1048576 2024-09-12T17:47:01.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.939+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~SGPYE9WDMH05.1 size=1048576 2024-09-12T17:47:01.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.939+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~SGPYE9WDMH05.2 size=624125 2024-09-12T17:47:01.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.939+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=SGPYE9WDMH05 tag=GPSGDYS0NMZC type=write size=3769853 2024-09-12T17:47:01.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.943+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=S897FWPKAGFN type=del 2024-09-12T17:47:01.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.947+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~JOMCMP5FR6VH.0 size=428707 2024-09-12T17:47:01.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.947+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=JOMCMP5FR6VH tag=G7M9QEBAI05L type=write size=1477283 2024-09-12T17:47:01.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.947+0000 7f68bc0598c0 1 < canceled operation key=UMQLPH9XGWRZ tag=BOSEN6D5NQ89 type=write size=209661 2024-09-12T17:47:01.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.951+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=MS7U4L7UG4NH type=del size=1496688 2024-09-12T17:47:01.956 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.951+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~ZTEUS9R3JDLL.0 size=1048576 2024-09-12T17:47:01.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.955+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~ZTEUS9R3JDLL.1 size=1048576 2024-09-12T17:47:01.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.955+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~ZTEUS9R3JDLL.2 size=832346 2024-09-12T17:47:01.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.959+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=ZTEUS9R3JDLL tag=Q3H3H4L4H5DF type=write size=3978074 2024-09-12T17:47:01.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.963+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~XD0YIN844AOH.0 size=1048576 2024-09-12T17:47:01.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.967+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~XD0YIN844AOH.1 size=1048576 2024-09-12T17:47:01.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.967+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~XD0YIN844AOH.2 size=760843 2024-09-12T17:47:01.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.967+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=XD0YIN844AOH tag=O3CKPG0V30VE type=write size=3906571 2024-09-12T17:47:01.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.967+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=98OADTCBYEFK type=del 2024-09-12T17:47:01.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.971+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=M631SDH8PAYH type=del size=2299202 2024-09-12T17:47:01.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.971+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~0RCZIZZW48CC.0 size=1048576 2024-09-12T17:47:01.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.975+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~0RCZIZZW48CC.1 size=611617 2024-09-12T17:47:01.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.979+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=0RCZIZZW48CC tag=T09O95RIK8YK type=write size=2708769 2024-09-12T17:47:01.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.983+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~LWOR3FIPJ49J.0 size=1048576 2024-09-12T17:47:01.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.983+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~LWOR3FIPJ49J.1 size=587905 2024-09-12T17:47:01.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.983+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=LWOR3FIPJ49J tag=O3YG3EFNJCI9 type=write size=2685057 2024-09-12T17:47:01.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.987+0000 7f68bc0598c0 1 < suggested remove operation key=XGJSQJ2IXJDK tag=ZJHM1LGQGTAT type=del 2024-09-12T17:47:01.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.991+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~CIE5VC1D3YY9.0 size=363634 2024-09-12T17:47:01.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.991+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=CIE5VC1D3YY9 tag=VZSF84G3YOT3 type=write size=1412210 2024-09-12T17:47:01.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.995+0000 7f68bc0598c0 -1 < failed to complete operation key=XGJSQJ2IXJDK tag=VPJCZN8P8818 type=del size=2540723: (22) Invalid argument 2024-09-12T17:47:01.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.995+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=6N24VB45QW8X type=del size=3324753 2024-09-12T17:47:02.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:01.999+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=K6CX1RESJAES type=del 2024-09-12T17:47:02.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.003+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~30IOXWQD6LJ7.0 size=1048576 2024-09-12T17:47:02.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.003+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~30IOXWQD6LJ7.1 size=1048576 2024-09-12T17:47:02.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.007+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~30IOXWQD6LJ7.2 size=53174 2024-09-12T17:47:02.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.007+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=30IOXWQD6LJ7 tag=WKV6EQ2F35X0 type=write size=3198902 2024-09-12T17:47:02.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.011+0000 7f68bc0598c0 1 < suggested remove operation key=SBQGW2EK6I1J tag=R80XHZAS3X72 type=del 2024-09-12T17:47:02.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.015+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~3F572XTUPUNA.0 size=1048576 2024-09-12T17:47:02.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.015+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~3F572XTUPUNA.1 size=667589 2024-09-12T17:47:02.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.015+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=3F572XTUPUNA tag=IHDD2DENQHQL type=write size=2764741 2024-09-12T17:47:02.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.019+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=8DTJPUX6EGHN type=del 2024-09-12T17:47:02.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.023+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~QBR287JV1YIL.0 size=956283 2024-09-12T17:47:02.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.023+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=QBR287JV1YIL tag=R230GO5BP98M type=write size=2004859 2024-09-12T17:47:02.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.023+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~DIY7QPWNXLU9.0 size=1048576 2024-09-12T17:47:02.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.027+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~DIY7QPWNXLU9.1 size=1048576 2024-09-12T17:47:02.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.027+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~DIY7QPWNXLU9.2 size=1019149 2024-09-12T17:47:02.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.031+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=DIY7QPWNXLU9 tag=OJ98FQ8AQDYG type=write size=4164877 2024-09-12T17:47:02.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.035+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~FPIMMTT3SHPG.0 size=763396 2024-09-12T17:47:02.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.035+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=FPIMMTT3SHPG tag=KQ9CJ0SFQFJJ type=write size=1811972 2024-09-12T17:47:02.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.039+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~37603UP01K65.0 size=384713 2024-09-12T17:47:02.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.039+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=37603UP01K65 tag=AZ5W0PVZN85C type=write size=1433289 2024-09-12T17:47:02.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.043+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=38SMH19BWT7Z type=del size=1004885 2024-09-12T17:47:02.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.043+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~F49P5WWPMNQ8.0 size=447021 2024-09-12T17:47:02.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.047+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=F49P5WWPMNQ8 tag=6OYHBY4QXGBL type=write size=1495597 2024-09-12T17:47:02.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.051+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=BRDUSIHGS7SQ type=write size=379672 2024-09-12T17:47:02.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.051+0000 7f68bc0598c0 1 < completed write operation key=W8JEQ5NOIE6O tag=01QF8AZAYZEA type=write size=844056 2024-09-12T17:47:02.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~2MKFV83BTMKM.0 size=929815 2024-09-12T17:47:02.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.055+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=2MKFV83BTMKM tag=6NR3AF232ZJT type=write size=1978391 2024-09-12T17:47:02.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.059+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=7U7QD07AAQ8A type=del size=767217 2024-09-12T17:47:02.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.063+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~0HGZSHAEUKUS.0 size=534042 2024-09-12T17:47:02.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.063+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=0HGZSHAEUKUS tag=XKT317KM0BWW type=write size=1582618 2024-09-12T17:47:02.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.067+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~SGPYE9WDMH05.0 size=1048576 2024-09-12T17:47:02.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.067+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~SGPYE9WDMH05.1 size=1048576 2024-09-12T17:47:02.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.067+0000 7f68bc0598c0 1 < canceled part key=_multipart_P8T1VX1XFJ31.2~SGPYE9WDMH05.2 size=624125 2024-09-12T17:47:02.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.071+0000 7f68bc0598c0 1 < canceled multipart upload key=P8T1VX1XFJ31 upload=SGPYE9WDMH05 tag=GPSGDYS0NMZC type=write size=3769853 2024-09-12T17:47:02.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.075+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~UM9PWP2RWM3B.0 size=1048576 2024-09-12T17:47:02.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.079+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~UM9PWP2RWM3B.1 size=445202 2024-09-12T17:47:02.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.079+0000 7f68bc0598c0 1 > prepared multipart upload key=2129SG6US3LI upload=UM9PWP2RWM3B tag=KNK5GWYJV1GG type=write size=2542354 2024-09-12T17:47:02.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.079+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~JOMCMP5FR6VH.0 size=428707 2024-09-12T17:47:02.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.083+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=JOMCMP5FR6VH tag=G7M9QEBAI05L type=write size=1477283 2024-09-12T17:47:02.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.087+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~EW5Z85VFBOPO.0 size=425505 2024-09-12T17:47:02.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.087+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=EW5Z85VFBOPO tag=1I34YVOP0TXW type=write size=1474081 2024-09-12T17:47:02.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.091+0000 7f68bc0598c0 1 < suggested remove operation key=3JPRQXKB5K3W tag=MS7U4L7UG4NH type=del 2024-09-12T17:47:02.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.095+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~OVMGBC0Y47L4.0 size=195097 2024-09-12T17:47:02.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.095+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=OVMGBC0Y47L4 tag=NTL1UQUNVYC5 type=write size=1243673 2024-09-12T17:47:02.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.099+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~XD0YIN844AOH.0 size=1048576 2024-09-12T17:47:02.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.099+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~XD0YIN844AOH.1 size=1048576 2024-09-12T17:47:02.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.103+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~XD0YIN844AOH.2 size=760843 2024-09-12T17:47:02.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.107+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=XD0YIN844AOH tag=O3CKPG0V30VE type=write size=3906571 2024-09-12T17:47:02.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.111+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~U66H3E04XBI6.0 size=1048576 2024-09-12T17:47:02.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.111+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~U66H3E04XBI6.1 size=651612 2024-09-12T17:47:02.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.111+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=U66H3E04XBI6 tag=5TZBW2VA1ILV type=write size=2748764 2024-09-12T17:47:02.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.115+0000 7f68bc0598c0 1 < canceled operation key=2129SG6US3LI tag=M631SDH8PAYH type=del size=2299202 2024-09-12T17:47:02.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.119+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=RZG4SM96VX36 type=write size=12552 2024-09-12T17:47:02.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.119+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~LWOR3FIPJ49J.0 size=1048576 2024-09-12T17:47:02.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.123+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~LWOR3FIPJ49J.1 size=587905 2024-09-12T17:47:02.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.127+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=LWOR3FIPJ49J tag=O3YG3EFNJCI9 type=write size=2685057 2024-09-12T17:47:02.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.135+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~NBICFJ28TJ57.0 size=1048576 2024-09-12T17:47:02.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.135+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~NBICFJ28TJ57.1 size=702791 2024-09-12T17:47:02.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.135+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=NBICFJ28TJ57 tag=TLK0UJSJQ3UE type=write size=2799943 2024-09-12T17:47:02.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.139+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~CIE5VC1D3YY9.0 size=363634 2024-09-12T17:47:02.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.143+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=CIE5VC1D3YY9 tag=VZSF84G3YOT3 type=write size=1412210 2024-09-12T17:47:02.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.147+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=X2VAC9IR473P type=del size=2363664 2024-09-12T17:47:02.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.151+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=6N24VB45QW8X type=del 2024-09-12T17:47:02.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.151+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=HLH7T8LYE637 type=write size=376311 2024-09-12T17:47:02.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.155+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~30IOXWQD6LJ7.0 size=1048576 2024-09-12T17:47:02.161 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.159+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~30IOXWQD6LJ7.1 size=1048576 2024-09-12T17:47:02.163 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.159+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~30IOXWQD6LJ7.2 size=53174 2024-09-12T17:47:02.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.163+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=30IOXWQD6LJ7 tag=WKV6EQ2F35X0 type=write size=3198902 2024-09-12T17:47:02.171 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.167+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~M93CSTNH7R48.0 size=1048576 2024-09-12T17:47:02.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.167+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~M93CSTNH7R48.1 size=1048576 2024-09-12T17:47:02.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~M93CSTNH7R48.2 size=233347 2024-09-12T17:47:02.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.171+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=M93CSTNH7R48 tag=9JVDL2MSACLU type=write size=3379075 2024-09-12T17:47:02.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.175+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~3F572XTUPUNA.0 size=1048576 2024-09-12T17:47:02.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.175+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~3F572XTUPUNA.1 size=667589 2024-09-12T17:47:02.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.179+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=3F572XTUPUNA tag=IHDD2DENQHQL type=write size=2764741 2024-09-12T17:47:02.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.183+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~783Q9RBM37B0.0 size=1048576 2024-09-12T17:47:02.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.187+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~783Q9RBM37B0.1 size=1048576 2024-09-12T17:47:02.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.187+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~783Q9RBM37B0.2 size=757300 2024-09-12T17:47:02.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.187+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=783Q9RBM37B0 tag=SHIETFH5V3VO type=write size=3903028 2024-09-12T17:47:02.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.191+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~QBR287JV1YIL.0 size=956283 2024-09-12T17:47:02.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.195+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=QBR287JV1YIL tag=R230GO5BP98M type=write size=2004859 2024-09-12T17:47:02.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.199+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~YN5HQJ20JR85.0 size=1048576 2024-09-12T17:47:02.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.199+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~YN5HQJ20JR85.1 size=1048576 2024-09-12T17:47:02.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.199+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~YN5HQJ20JR85.2 size=433138 2024-09-12T17:47:02.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.199+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=YN5HQJ20JR85 tag=9OVPOZ2FM16M type=write size=3578866 2024-09-12T17:47:02.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.203+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~FPIMMTT3SHPG.0 size=763396 2024-09-12T17:47:02.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.207+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=FPIMMTT3SHPG tag=KQ9CJ0SFQFJJ type=write size=1811972 2024-09-12T17:47:02.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~L1F4V8Z5UL1E.0 size=1048576 2024-09-12T17:47:02.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~L1F4V8Z5UL1E.1 size=208574 2024-09-12T17:47:02.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.211+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=L1F4V8Z5UL1E tag=DTZQZUA8JG6T type=write size=2305726 2024-09-12T17:47:02.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.219+0000 7f68bc0598c0 1 < suggested remove operation key=XGJSQJ2IXJDK tag=38SMH19BWT7Z type=del 2024-09-12T17:47:02.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.219+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=3AQ1T7JUOHC0 type=write size=745417 2024-09-12T17:47:02.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.227+0000 7f68bc0598c0 1 < suggested update operation key=7XH1E2GEH9O2 tag=BRDUSIHGS7SQ type=write size=379672 2024-09-12T17:47:02.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.231+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~R4FMOBDDLQLF.0 size=1048576 2024-09-12T17:47:02.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.231+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~R4FMOBDDLQLF.1 size=492002 2024-09-12T17:47:02.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.231+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=R4FMOBDDLQLF tag=WEE7GYAYTADF type=write size=2589154 2024-09-12T17:47:02.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.235+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~2MKFV83BTMKM.0 size=929815 2024-09-12T17:47:02.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.239+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=2MKFV83BTMKM tag=6NR3AF232ZJT type=write size=1978391 2024-09-12T17:47:02.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.243+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~PVSZ2RW1Z1QA.0 size=1048576 2024-09-12T17:47:02.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.243+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~PVSZ2RW1Z1QA.1 size=1048576 2024-09-12T17:47:02.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.247+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~PVSZ2RW1Z1QA.2 size=457585 2024-09-12T17:47:02.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.247+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=PVSZ2RW1Z1QA tag=0IFYE5ZF4T7R type=write size=3603313 2024-09-12T17:47:02.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.247+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~0HGZSHAEUKUS.0 size=534042 2024-09-12T17:47:02.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.251+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=0HGZSHAEUKUS tag=XKT317KM0BWW type=write size=1582618 2024-09-12T17:47:02.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.255+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=H9GFDRPV295O type=del size=1571719 2024-09-12T17:47:02.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.259+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~UM9PWP2RWM3B.0 size=1048576 2024-09-12T17:47:02.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.259+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~UM9PWP2RWM3B.1 size=445202 2024-09-12T17:47:02.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.263+0000 7f68bc0598c0 1 < completed multipart upload key=2129SG6US3LI upload=UM9PWP2RWM3B tag=KNK5GWYJV1GG type=write size=2542354 2024-09-12T17:47:02.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.267+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~JWJKLCAYA0NQ.0 size=1048576 2024-09-12T17:47:02.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.271+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~JWJKLCAYA0NQ.1 size=1048576 2024-09-12T17:47:02.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.271+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~JWJKLCAYA0NQ.2 size=659633 2024-09-12T17:47:02.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.271+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=JWJKLCAYA0NQ tag=Y0F2B305GMYS type=write size=3805361 2024-09-12T17:47:02.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.275+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~EW5Z85VFBOPO.0 size=425505 2024-09-12T17:47:02.282 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.279+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=EW5Z85VFBOPO tag=1I34YVOP0TXW type=write size=1474081 2024-09-12T17:47:02.285 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.279+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=6EC1QLQBT00K type=del size=3735321 2024-09-12T17:47:02.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.283+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~OVMGBC0Y47L4.0 size=195097 2024-09-12T17:47:02.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.287+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=OVMGBC0Y47L4 tag=NTL1UQUNVYC5 type=write size=1243673 2024-09-12T17:47:02.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.291+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=LR8XABIRBXBM type=del size=2291092 2024-09-12T17:47:02.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.295+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~U66H3E04XBI6.0 size=1048576 2024-09-12T17:47:02.300 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.295+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~U66H3E04XBI6.1 size=651612 2024-09-12T17:47:02.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.299+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=U66H3E04XBI6 tag=5TZBW2VA1ILV type=write size=2748764 2024-09-12T17:47:02.307 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.303+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=VPBB61I7X2NK type=write size=604925 2024-09-12T17:47:02.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.307+0000 7f68bc0598c0 1 < suggested remove operation key=S0B1RP89NO44 tag=RZG4SM96VX36 type=write 2024-09-12T17:47:02.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.311+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=S32RZ4R8UYIU type=del size=3351496 2024-09-12T17:47:02.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.315+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~NBICFJ28TJ57.0 size=1048576 2024-09-12T17:47:02.319 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.315+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~NBICFJ28TJ57.1 size=702791 2024-09-12T17:47:02.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.319+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=NBICFJ28TJ57 tag=TLK0UJSJQ3UE type=write size=2799943 2024-09-12T17:47:02.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.323+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~IG3H4ABBXOCX.0 size=989026 2024-09-12T17:47:02.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.323+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=IG3H4ABBXOCX tag=5EKHVHWT0IJJ type=write size=2037602 2024-09-12T17:47:02.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.327+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=X2VAC9IR473P type=del 2024-09-12T17:47:02.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.327+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=EWJHBMHGL74M type=write size=201632 2024-09-12T17:47:02.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.331+0000 7f68bc0598c0 1 < completed write operation key=6SUA9FBDU69A tag=HLH7T8LYE637 type=write size=376311 2024-09-12T17:47:02.340 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.335+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~08QQ8T9OJC0Q.0 size=1048576 2024-09-12T17:47:02.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.339+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~08QQ8T9OJC0Q.1 size=743712 2024-09-12T17:47:02.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.339+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=08QQ8T9OJC0Q tag=R9E522BPSHF8 type=write size=2840864 2024-09-12T17:47:02.345 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.339+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~M93CSTNH7R48.0 size=1048576 2024-09-12T17:47:02.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.343+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~M93CSTNH7R48.1 size=1048576 2024-09-12T17:47:02.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.343+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~M93CSTNH7R48.2 size=233347 2024-09-12T17:47:02.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.347+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=M93CSTNH7R48 tag=9JVDL2MSACLU type=write size=3379075 2024-09-12T17:47:02.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.351+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=TIGCY5P67Y2N type=write size=137182 2024-09-12T17:47:02.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.355+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~783Q9RBM37B0.0 size=1048576 2024-09-12T17:47:02.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.359+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~783Q9RBM37B0.1 size=1048576 2024-09-12T17:47:02.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.359+0000 7f68bc0598c0 1 < canceled part key=_multipart_S0B1RP89NO44.2~783Q9RBM37B0.2 size=757300 2024-09-12T17:47:02.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.363+0000 7f68bc0598c0 1 < canceled multipart upload key=S0B1RP89NO44 upload=783Q9RBM37B0 tag=SHIETFH5V3VO type=write size=3903028 2024-09-12T17:47:02.370 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.367+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~WFXIONOMB0Z5.0 size=1048576 2024-09-12T17:47:02.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.367+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~WFXIONOMB0Z5.1 size=1048576 2024-09-12T17:47:02.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.371+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~WFXIONOMB0Z5.2 size=821901 2024-09-12T17:47:02.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.371+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=WFXIONOMB0Z5 tag=SQBGKBKEPFRX type=write size=3967629 2024-09-12T17:47:02.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.371+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~YN5HQJ20JR85.0 size=1048576 2024-09-12T17:47:02.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.375+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~YN5HQJ20JR85.1 size=1048576 2024-09-12T17:47:02.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.375+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~YN5HQJ20JR85.2 size=433138 2024-09-12T17:47:02.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.379+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=YN5HQJ20JR85 tag=9OVPOZ2FM16M type=write size=3578866 2024-09-12T17:47:02.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.383+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~KOSX6MD3SDCH.0 size=1048576 2024-09-12T17:47:02.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.387+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~KOSX6MD3SDCH.1 size=667887 2024-09-12T17:47:02.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.387+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=KOSX6MD3SDCH tag=HX6JVX2O2JZ4 type=write size=2765039 2024-09-12T17:47:02.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.387+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~L1F4V8Z5UL1E.0 size=1048576 2024-09-12T17:47:02.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.391+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~L1F4V8Z5UL1E.1 size=208574 2024-09-12T17:47:02.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.395+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=L1F4V8Z5UL1E tag=DTZQZUA8JG6T type=write size=2305726 2024-09-12T17:47:02.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.399+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~E0M50ULRM00N.0 size=825779 2024-09-12T17:47:02.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.399+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=E0M50ULRM00N tag=3MFU2G101SGF type=write size=1874355 2024-09-12T17:47:02.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.399+0000 7f68bc0598c0 1 < canceled operation key=57O6H52NHYOL tag=3AQ1T7JUOHC0 type=write size=745417 2024-09-12T17:47:02.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.403+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~SFTVINXZUOYG.0 size=1048576 2024-09-12T17:47:02.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.407+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~SFTVINXZUOYG.1 size=152286 2024-09-12T17:47:02.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.407+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=SFTVINXZUOYG tag=JQIFTZWM692J type=write size=2249438 2024-09-12T17:47:02.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.407+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~R4FMOBDDLQLF.0 size=1048576 2024-09-12T17:47:02.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.411+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~R4FMOBDDLQLF.1 size=492002 2024-09-12T17:47:02.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.415+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=R4FMOBDDLQLF tag=WEE7GYAYTADF type=write size=2589154 2024-09-12T17:47:02.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.415+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=EJIQVL710PYO type=del size=2245761 2024-09-12T17:47:02.421 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.419+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~PVSZ2RW1Z1QA.0 size=1048576 2024-09-12T17:47:02.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.419+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~PVSZ2RW1Z1QA.1 size=1048576 2024-09-12T17:47:02.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.419+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~PVSZ2RW1Z1QA.2 size=457585 2024-09-12T17:47:02.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.423+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=PVSZ2RW1Z1QA tag=0IFYE5ZF4T7R type=write size=3603313 2024-09-12T17:47:02.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.427+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~XH0AXJVUSO3P.0 size=1048576 2024-09-12T17:47:02.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.431+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~XH0AXJVUSO3P.1 size=1048576 2024-09-12T17:47:02.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.431+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~XH0AXJVUSO3P.2 size=1013953 2024-09-12T17:47:02.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.431+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=XH0AXJVUSO3P tag=GST9BUXS29NQ type=write size=4159681 2024-09-12T17:47:02.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.435+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=H9GFDRPV295O type=del 2024-09-12T17:47:02.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.435+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=O4SCHY2JK39X type=del size=3249141 2024-09-12T17:47:02.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.439+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~JWJKLCAYA0NQ.0 size=1048576 2024-09-12T17:47:02.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.439+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~JWJKLCAYA0NQ.1 size=1048576 2024-09-12T17:47:02.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.443+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~JWJKLCAYA0NQ.2 size=659633 2024-09-12T17:47:02.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.447+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=JWJKLCAYA0NQ tag=Y0F2B305GMYS type=write size=3805361 2024-09-12T17:47:02.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.447+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=SG1IUJUMOKQ9 type=write size=543778 2024-09-12T17:47:02.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.451+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=6EC1QLQBT00K type=del 2024-09-12T17:47:02.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.455+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~9C17GKLG6A5X.0 size=879916 2024-09-12T17:47:02.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.455+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=9C17GKLG6A5X tag=X1QWUZJW9SON type=write size=1928492 2024-09-12T17:47:02.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.455+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=LR8XABIRBXBM type=del 2024-09-12T17:47:02.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~JIWN60SGSCUG.0 size=1048576 2024-09-12T17:47:02.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.463+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~JIWN60SGSCUG.1 size=1048576 2024-09-12T17:47:02.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.463+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~JIWN60SGSCUG.2 size=436006 2024-09-12T17:47:02.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.463+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=JIWN60SGSCUG tag=X4FQ5N4AV72V type=write size=3581734 2024-09-12T17:47:02.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.467+0000 7f68bc0598c0 1 < completed write operation key=0XFYVNU2Q7KO tag=VPBB61I7X2NK type=write size=604925 2024-09-12T17:47:02.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.471+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~ZJJFIDFWRNSF.0 size=850854 2024-09-12T17:47:02.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.471+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=ZJJFIDFWRNSF tag=TUJTRMY81IR7 type=write size=1899430 2024-09-12T17:47:02.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.475+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=S32RZ4R8UYIU type=del 2024-09-12T17:47:02.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.479+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~0YQ1WABHJBLW.0 size=1048576 2024-09-12T17:47:02.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.479+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~0YQ1WABHJBLW.1 size=144775 2024-09-12T17:47:02.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.479+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=0YQ1WABHJBLW tag=OTAFP5DTC9WS type=write size=2241927 2024-09-12T17:47:02.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.479+0000 7f68bc0598c0 1 < canceled part key=_multipart_W8JEQ5NOIE6O.2~IG3H4ABBXOCX.0 size=989026 2024-09-12T17:47:02.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.483+0000 7f68bc0598c0 1 < canceled multipart upload key=W8JEQ5NOIE6O upload=IG3H4ABBXOCX tag=5EKHVHWT0IJJ type=write size=2037602 2024-09-12T17:47:02.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.487+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=6DBUCELKMS5X type=del size=1545370 2024-09-12T17:47:02.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.487+0000 7f68bc0598c0 1 < completed write operation key=3JPRQXKB5K3W tag=EWJHBMHGL74M type=write size=201632 2024-09-12T17:47:02.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.495+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~CC4H4CV2N5DN.0 size=1048576 2024-09-12T17:47:02.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.495+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~CC4H4CV2N5DN.1 size=91231 2024-09-12T17:47:02.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.495+0000 7f68bc0598c0 1 > prepared multipart upload key=2129SG6US3LI upload=CC4H4CV2N5DN tag=CLMZ57W45UT3 type=write size=2188383 2024-09-12T17:47:02.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.499+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~08QQ8T9OJC0Q.0 size=1048576 2024-09-12T17:47:02.503 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.499+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~08QQ8T9OJC0Q.1 size=743712 2024-09-12T17:47:02.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.503+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=08QQ8T9OJC0Q tag=R9E522BPSHF8 type=write size=2840864 2024-09-12T17:47:02.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.507+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=TNC1EPAU15XA type=del size=2858037 2024-09-12T17:47:02.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.507+0000 7f68bc0598c0 1 < canceled operation key=P8T1VX1XFJ31 tag=TIGCY5P67Y2N type=write size=137182 2024-09-12T17:47:02.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.511+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=N6NPZ83700J3 type=del size=3642939 2024-09-12T17:47:02.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.511+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~WFXIONOMB0Z5.0 size=1048576 2024-09-12T17:47:02.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.515+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~WFXIONOMB0Z5.1 size=1048576 2024-09-12T17:47:02.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.515+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~WFXIONOMB0Z5.2 size=821901 2024-09-12T17:47:02.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.519+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=WFXIONOMB0Z5 tag=SQBGKBKEPFRX type=write size=3967629 2024-09-12T17:47:02.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.523+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~BRIIHSBY1CS5.0 size=1048576 2024-09-12T17:47:02.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.527+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~BRIIHSBY1CS5.1 size=1048576 2024-09-12T17:47:02.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.527+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~BRIIHSBY1CS5.2 size=495338 2024-09-12T17:47:02.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.527+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=BRIIHSBY1CS5 tag=3FD33SYOD0ZT type=write size=3641066 2024-09-12T17:47:02.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.531+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~KOSX6MD3SDCH.0 size=1048576 2024-09-12T17:47:02.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.531+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~KOSX6MD3SDCH.1 size=667887 2024-09-12T17:47:02.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.535+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=KOSX6MD3SDCH tag=HX6JVX2O2JZ4 type=write size=2765039 2024-09-12T17:47:02.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.539+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=0S3843G22G07 type=del size=3826923 2024-09-12T17:47:02.545 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.543+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~E0M50ULRM00N.0 size=825779 2024-09-12T17:47:02.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.543+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=E0M50ULRM00N tag=3MFU2G101SGF type=write size=1874355 2024-09-12T17:47:02.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.547+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=GDQD1SBBT9ZR type=write size=587518 2024-09-12T17:47:02.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.551+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~SFTVINXZUOYG.0 size=1048576 2024-09-12T17:47:02.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.551+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~SFTVINXZUOYG.1 size=152286 2024-09-12T17:47:02.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.555+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=SFTVINXZUOYG tag=JQIFTZWM692J type=write size=2249438 2024-09-12T17:47:02.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.559+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=3WLQ0PHLHU0E type=del size=1705372 2024-09-12T17:47:02.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.563+0000 7f68bc0598c0 1 < suggested remove operation key=0XFYVNU2Q7KO tag=EJIQVL710PYO type=del 2024-09-12T17:47:02.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.567+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=3AFB868ATAMW type=del size=140467 2024-09-12T17:47:02.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.571+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~XH0AXJVUSO3P.0 size=1048576 2024-09-12T17:47:02.575 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.571+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~XH0AXJVUSO3P.1 size=1048576 2024-09-12T17:47:02.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.571+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~XH0AXJVUSO3P.2 size=1013953 2024-09-12T17:47:02.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.575+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=XH0AXJVUSO3P tag=GST9BUXS29NQ type=write size=4159681 2024-09-12T17:47:02.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.583+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~EOKFVKF0A65I.0 size=1048576 2024-09-12T17:47:02.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.583+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~EOKFVKF0A65I.1 size=326299 2024-09-12T17:47:02.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.583+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=EOKFVKF0A65I tag=5729RYME35M6 type=write size=2423451 2024-09-12T17:47:02.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.587+0000 7f68bc0598c0 1 < canceled operation key=9846YLKC8P8S tag=O4SCHY2JK39X type=del size=3249141 2024-09-12T17:47:02.593 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.591+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~0LJALWC5OYB2.0 size=369481 2024-09-12T17:47:02.593 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.591+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=0LJALWC5OYB2 tag=VH4R08W2FUXQ type=write size=1418057 2024-09-12T17:47:02.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.595+0000 7f68bc0598c0 1 < suggested update operation key=FC3K0QN3TAWH tag=SG1IUJUMOKQ9 type=write size=543778 2024-09-12T17:47:02.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.599+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~UERL18IXXUDP.0 size=1048576 2024-09-12T17:47:02.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.599+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~UERL18IXXUDP.1 size=189239 2024-09-12T17:47:02.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.599+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=UERL18IXXUDP tag=4JOC0SXY3AE1 type=write size=2286391 2024-09-12T17:47:02.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.603+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~9C17GKLG6A5X.0 size=879916 2024-09-12T17:47:02.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.607+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=9C17GKLG6A5X tag=X1QWUZJW9SON type=write size=1928492 2024-09-12T17:47:02.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.607+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=0UQQ24AKTQL1 type=del size=441235 2024-09-12T17:47:02.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.611+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~JIWN60SGSCUG.0 size=1048576 2024-09-12T17:47:02.616 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.611+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~JIWN60SGSCUG.1 size=1048576 2024-09-12T17:47:02.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.615+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~JIWN60SGSCUG.2 size=436006 2024-09-12T17:47:02.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.619+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=JIWN60SGSCUG tag=X4FQ5N4AV72V type=write size=3581734 2024-09-12T17:47:02.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.623+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~SXXMWJ3RWX3Z.0 size=330231 2024-09-12T17:47:02.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.623+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=SXXMWJ3RWX3Z tag=FI5HV51MGB4B type=write size=1378807 2024-09-12T17:47:02.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.623+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~ZJJFIDFWRNSF.0 size=850854 2024-09-12T17:47:02.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.627+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=ZJJFIDFWRNSF tag=TUJTRMY81IR7 type=write size=1899430 2024-09-12T17:47:02.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.631+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=LVQRGOHRCKRY type=write size=659749 2024-09-12T17:47:02.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.631+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~0YQ1WABHJBLW.0 size=1048576 2024-09-12T17:47:02.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.631+0000 7f68bc0598c0 1 < canceled part key=_multipart_XGJSQJ2IXJDK.2~0YQ1WABHJBLW.1 size=144775 2024-09-12T17:47:02.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.635+0000 7f68bc0598c0 1 < canceled multipart upload key=XGJSQJ2IXJDK upload=0YQ1WABHJBLW tag=OTAFP5DTC9WS type=write size=2241927 2024-09-12T17:47:02.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.639+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=MKWAT5VZA70Q type=del size=4020391 2024-09-12T17:47:02.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.643+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=6DBUCELKMS5X type=del 2024-09-12T17:47:02.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.643+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=QOMGJIH7MCI9 type=del size=3329839 2024-09-12T17:47:02.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.647+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~CC4H4CV2N5DN.0 size=1048576 2024-09-12T17:47:02.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.647+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~CC4H4CV2N5DN.1 size=91231 2024-09-12T17:47:02.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.655+0000 7f68bc0598c0 1 < completed multipart upload key=2129SG6US3LI upload=CC4H4CV2N5DN tag=CLMZ57W45UT3 type=write size=2188383 2024-09-12T17:47:02.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.667+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=51NWIHY2MY04 type=del size=285833 2024-09-12T17:47:02.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.671+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=TNC1EPAU15XA type=del size=2858037 2024-09-12T17:47:02.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.671+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=VIISSLT5GHHB type=del size=821645 2024-09-12T17:47:02.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.675+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=N6NPZ83700J3 type=del 2024-09-12T17:47:02.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.675+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=HFQOFF5ZPU3C type=del size=1480540 2024-09-12T17:47:02.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.675+0000 7f68bc0598c0 1 < canceled part key=_multipart_9846YLKC8P8S.2~BRIIHSBY1CS5.0 size=1048576 2024-09-12T17:47:02.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.679+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~BRIIHSBY1CS5.1 size=1048576 2024-09-12T17:47:02.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.679+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~BRIIHSBY1CS5.2 size=495338 2024-09-12T17:47:02.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.683+0000 7f68bc0598c0 1 < canceled multipart upload key=9846YLKC8P8S upload=BRIIHSBY1CS5 tag=3FD33SYOD0ZT type=write size=3641066 2024-09-12T17:47:02.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.687+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~EVTKQCETOCER.0 size=1048576 2024-09-12T17:47:02.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.691+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~EVTKQCETOCER.1 size=1048576 2024-09-12T17:47:02.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.691+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~EVTKQCETOCER.2 size=26659 2024-09-12T17:47:02.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.691+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=EVTKQCETOCER tag=61ZE6RYLDM2C type=write size=3172387 2024-09-12T17:47:02.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.695+0000 7f68bc0598c0 1 < suggested remove operation key=6J677S46BXS4 tag=0S3843G22G07 type=del 2024-09-12T17:47:02.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.695+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=8I9A6ZEL6EDF type=del size=1570009 2024-09-12T17:47:02.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.699+0000 7f68bc0598c0 -1 < failed to complete operation key=W8JEQ5NOIE6O tag=GDQD1SBBT9ZR type=write size=587518: (22) Invalid argument 2024-09-12T17:47:02.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.703+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~WNSS7C5O5BM9.0 size=1048576 2024-09-12T17:47:02.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.703+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~WNSS7C5O5BM9.1 size=367822 2024-09-12T17:47:02.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.703+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=WNSS7C5O5BM9 tag=OY76Q9RFMB5I type=write size=2464974 2024-09-12T17:47:02.710 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.707+0000 7f68bc0598c0 1 < suggested update operation key=6SUA9FBDU69A tag=3WLQ0PHLHU0E type=del size=1705372 2024-09-12T17:47:02.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.711+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~LDTUZDNTL0GR.0 size=130203 2024-09-12T17:47:02.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.711+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=LDTUZDNTL0GR tag=Z3E2T8SNK1IL type=write size=1178779 2024-09-12T17:47:02.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.715+0000 7f68bc0598c0 1 < suggested remove operation key=BKAT5SGAC5Z8 tag=3AFB868ATAMW type=del 2024-09-12T17:47:02.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.719+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~HNRZ7IN3BD9A.0 size=1006162 2024-09-12T17:47:02.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.719+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=HNRZ7IN3BD9A tag=U12M75E4R4CG type=write size=2054738 2024-09-12T17:47:02.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.719+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~EOKFVKF0A65I.0 size=1048576 2024-09-12T17:47:02.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.719+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~EOKFVKF0A65I.1 size=326299 2024-09-12T17:47:02.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.723+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=EOKFVKF0A65I tag=5729RYME35M6 type=write size=2423451 2024-09-12T17:47:02.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.727+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~FF53YWKS1A2P.0 size=1048576 2024-09-12T17:47:02.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.731+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~FF53YWKS1A2P.1 size=1048576 2024-09-12T17:47:02.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.731+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~FF53YWKS1A2P.2 size=200435 2024-09-12T17:47:02.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.731+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=FF53YWKS1A2P tag=DL5P9QOVGRIO type=write size=3346163 2024-09-12T17:47:02.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.735+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~0LJALWC5OYB2.0 size=369481 2024-09-12T17:47:02.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.739+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=0LJALWC5OYB2 tag=VH4R08W2FUXQ type=write size=1418057 2024-09-12T17:47:02.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.739+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=IVVM34DIT24N type=del size=2227181 2024-09-12T17:47:02.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.743+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~UERL18IXXUDP.0 size=1048576 2024-09-12T17:47:02.747 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.743+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~UERL18IXXUDP.1 size=189239 2024-09-12T17:47:02.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.747+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=UERL18IXXUDP tag=4JOC0SXY3AE1 type=write size=2286391 2024-09-12T17:47:02.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.751+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~ZOM1Z3FBB269.0 size=1048576 2024-09-12T17:47:02.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.751+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~ZOM1Z3FBB269.1 size=551723 2024-09-12T17:47:02.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.751+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=ZOM1Z3FBB269 tag=1YZHEBQDT408 type=write size=2648875 2024-09-12T17:47:02.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.755+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=0UQQ24AKTQL1 type=del 2024-09-12T17:47:02.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.759+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~9HIVU8B6G5RF.0 size=1048576 2024-09-12T17:47:02.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.759+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~9HIVU8B6G5RF.1 size=1048576 2024-09-12T17:47:02.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.763+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~9HIVU8B6G5RF.2 size=494912 2024-09-12T17:47:02.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.763+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=9HIVU8B6G5RF tag=3ZT6G70M9X2U type=write size=3640640 2024-09-12T17:47:02.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.763+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~SXXMWJ3RWX3Z.0 size=330231 2024-09-12T17:47:02.771 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.767+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=SXXMWJ3RWX3Z tag=FI5HV51MGB4B type=write size=1378807 2024-09-12T17:47:02.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.771+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=8ZBFKM3P8ON1 type=del size=718246 2024-09-12T17:47:02.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.771+0000 7f68bc0598c0 1 < completed write operation key=9XK00RPA6Q38 tag=LVQRGOHRCKRY type=write size=659749 2024-09-12T17:47:02.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.775+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~JVBPK329F8YB.0 size=1048576 2024-09-12T17:47:02.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.779+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~JVBPK329F8YB.1 size=439918 2024-09-12T17:47:02.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.779+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=JVBPK329F8YB tag=76B87KHB9UT0 type=write size=2537070 2024-09-12T17:47:02.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.779+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=MKWAT5VZA70Q type=del 2024-09-12T17:47:02.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.783+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=X4KZ1Z8HHB1Y type=del size=2002479 2024-09-12T17:47:02.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.783+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=QOMGJIH7MCI9 type=del 2024-09-12T17:47:02.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.791+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~567AXJYH4OTZ.0 size=659841 2024-09-12T17:47:02.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.791+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=567AXJYH4OTZ tag=CIO2Q0B1AL7T type=write size=1708417 2024-09-12T17:47:02.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.791+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=51NWIHY2MY04 type=del 2024-09-12T17:47:02.804 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.799+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~Q69O89IXJBYL.0 size=23669 2024-09-12T17:47:02.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.799+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=Q69O89IXJBYL tag=EY9J929A7MO9 type=write size=1072245 2024-09-12T17:47:02.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.803+0000 7f68bc0598c0 1 < suggested remove operation key=9XK00RPA6Q38 tag=VIISSLT5GHHB type=del 2024-09-12T17:47:02.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.807+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=0YFE3FKSICGA type=del size=2064965 2024-09-12T17:47:02.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.807+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=HFQOFF5ZPU3C type=del 2024-09-12T17:47:02.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.811+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=MVX79TCO9C4V type=del size=1484050 2024-09-12T17:47:02.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.811+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~EVTKQCETOCER.0 size=1048576 2024-09-12T17:47:02.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.815+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~EVTKQCETOCER.1 size=1048576 2024-09-12T17:47:02.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.815+0000 7f68bc0598c0 1 < canceled part key=_multipart_WUGDIFCHNL90.2~EVTKQCETOCER.2 size=26659 2024-09-12T17:47:02.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.815+0000 7f68bc0598c0 1 < canceled multipart upload key=WUGDIFCHNL90 upload=EVTKQCETOCER tag=61ZE6RYLDM2C type=write size=3172387 2024-09-12T17:47:02.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.819+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=SWTE06O2RE94 type=del size=3000370 2024-09-12T17:47:02.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.819+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=8I9A6ZEL6EDF type=del 2024-09-12T17:47:02.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.823+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=3FJC8HQ172XX type=del size=3793032 2024-09-12T17:47:02.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.823+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~WNSS7C5O5BM9.0 size=1048576 2024-09-12T17:47:02.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.823+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~WNSS7C5O5BM9.1 size=367822 2024-09-12T17:47:02.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.827+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=WNSS7C5O5BM9 tag=OY76Q9RFMB5I type=write size=2464974 2024-09-12T17:47:02.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.827+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=3NA41EGX9S4K type=write size=280446 2024-09-12T17:47:02.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.831+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~LDTUZDNTL0GR.0 size=130203 2024-09-12T17:47:02.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.835+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=LDTUZDNTL0GR tag=Z3E2T8SNK1IL type=write size=1178779 2024-09-12T17:47:02.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~7FWIJYF83NKB.0 size=1048576 2024-09-12T17:47:02.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.839+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~7FWIJYF83NKB.1 size=867818 2024-09-12T17:47:02.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.839+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=7FWIJYF83NKB tag=ZLMQ5RVM2VWK type=write size=2964970 2024-09-12T17:47:02.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.839+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~HNRZ7IN3BD9A.0 size=1006162 2024-09-12T17:47:02.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.843+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=HNRZ7IN3BD9A tag=U12M75E4R4CG type=write size=2054738 2024-09-12T17:47:02.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.843+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=C0O2W0LOQBKV type=del size=265134 2024-09-12T17:47:02.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.843+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~FF53YWKS1A2P.0 size=1048576 2024-09-12T17:47:02.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.847+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~FF53YWKS1A2P.1 size=1048576 2024-09-12T17:47:02.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.847+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~FF53YWKS1A2P.2 size=200435 2024-09-12T17:47:02.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.851+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=FF53YWKS1A2P tag=DL5P9QOVGRIO type=write size=3346163 2024-09-12T17:47:02.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.851+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=1A7HDF1UHANF type=del size=2640393 2024-09-12T17:47:02.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.851+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=IVVM34DIT24N type=del 2024-09-12T17:47:02.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.855+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=7CPO75L32F52 type=del size=86601 2024-09-12T17:47:02.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.855+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~ZOM1Z3FBB269.0 size=1048576 2024-09-12T17:47:02.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.859+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~ZOM1Z3FBB269.1 size=551723 2024-09-12T17:47:02.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.859+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=ZOM1Z3FBB269 tag=1YZHEBQDT408 type=write size=2648875 2024-09-12T17:47:02.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.863+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~WEOB7L70RB1P.0 size=1048576 2024-09-12T17:47:02.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.863+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~WEOB7L70RB1P.1 size=254565 2024-09-12T17:47:02.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.863+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=WEOB7L70RB1P tag=58HEPEKIDSMU type=write size=2351717 2024-09-12T17:47:02.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.867+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~9HIVU8B6G5RF.0 size=1048576 2024-09-12T17:47:02.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.867+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~9HIVU8B6G5RF.1 size=1048576 2024-09-12T17:47:02.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.867+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~9HIVU8B6G5RF.2 size=494912 2024-09-12T17:47:02.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.871+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=9HIVU8B6G5RF tag=3ZT6G70M9X2U type=write size=3640640 2024-09-12T17:47:02.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.871+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=FZNO0SK1EIU8 type=del size=2722830 2024-09-12T17:47:02.877 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.875+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=8ZBFKM3P8ON1 type=del 2024-09-12T17:47:02.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.875+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=46A477L3CS9Y type=write size=896421 2024-09-12T17:47:02.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.875+0000 7f68bc0598c0 1 < canceled part key=_multipart_0XFYVNU2Q7KO.2~JVBPK329F8YB.0 size=1048576 2024-09-12T17:47:02.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.875+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~JVBPK329F8YB.1 size=439918 2024-09-12T17:47:02.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.879+0000 7f68bc0598c0 1 < canceled multipart upload key=0XFYVNU2Q7KO upload=JVBPK329F8YB tag=76B87KHB9UT0 type=write size=2537070 2024-09-12T17:47:02.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.883+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~MDPQM3XKE8J6.0 size=557439 2024-09-12T17:47:02.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.883+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=MDPQM3XKE8J6 tag=J1PV9F0B0YAA type=write size=1606015 2024-09-12T17:47:02.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.883+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=X4KZ1Z8HHB1Y type=del 2024-09-12T17:47:02.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.887+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=KGRCNQTGL29P type=del size=2891068 2024-09-12T17:47:02.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.887+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~567AXJYH4OTZ.0 size=659841 2024-09-12T17:47:02.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.891+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=567AXJYH4OTZ tag=CIO2Q0B1AL7T type=write size=1708417 2024-09-12T17:47:02.895 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.891+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=44H8IHYRO1M7 type=write size=254243 2024-09-12T17:47:02.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.891+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~Q69O89IXJBYL.0 size=23669 2024-09-12T17:47:02.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.895+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=Q69O89IXJBYL tag=EY9J929A7MO9 type=write size=1072245 2024-09-12T17:47:02.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.899+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=3577HPL1L5A2 type=del size=3622735 2024-09-12T17:47:02.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.899+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=0YFE3FKSICGA type=del 2024-09-12T17:47:02.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.899+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=4HAJY3L13013 type=del size=690716 2024-09-12T17:47:02.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.903+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=MVX79TCO9C4V type=del 2024-09-12T17:47:02.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.903+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=3RJS7LTNW6R3 type=del size=2623643 2024-09-12T17:47:02.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.907+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=SWTE06O2RE94 type=del 2024-09-12T17:47:02.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.907+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=LM8QTAYL4BBD type=del size=3597904 2024-09-12T17:47:02.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.907+0000 7f68bc0598c0 1 < canceled operation key=7XH1E2GEH9O2 tag=3FJC8HQ172XX type=del size=3793032 2024-09-12T17:47:02.916 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.911+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~AQ7HFXK81VEZ.0 size=1048576 2024-09-12T17:47:02.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.915+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~AQ7HFXK81VEZ.1 size=536048 2024-09-12T17:47:02.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.915+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=AQ7HFXK81VEZ tag=ZTJUS5GNOBB1 type=write size=2633200 2024-09-12T17:47:02.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.915+0000 7f68bc0598c0 1 < completed write operation key=8P0EWBVO0BQD tag=3NA41EGX9S4K type=write size=280446 2024-09-12T17:47:02.921 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.915+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=GDY3F8R827DJ type=del size=2157893 2024-09-12T17:47:02.921 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.919+0000 7f68bc0598c0 1 < canceled part key=_multipart_MRS3KW2H5AKK.2~7FWIJYF83NKB.0 size=1048576 2024-09-12T17:47:02.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.919+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~7FWIJYF83NKB.1 size=867818 2024-09-12T17:47:02.925 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.923+0000 7f68bc0598c0 1 < canceled multipart upload key=MRS3KW2H5AKK upload=7FWIJYF83NKB tag=ZLMQ5RVM2VWK type=write size=2964970 2024-09-12T17:47:02.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.923+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=MOI7BCONM8QV type=del size=1661335 2024-09-12T17:47:02.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.927+0000 7f68bc0598c0 1 < suggested update operation key=RTY1OT2PSAAY tag=C0O2W0LOQBKV type=del size=265134 2024-09-12T17:47:02.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.927+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=69VV9Z8YAPZ0 type=del size=3897735 2024-09-12T17:47:02.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.931+0000 7f68bc0598c0 1 < suggested update operation key=WPQ755ODAFNT tag=1A7HDF1UHANF type=del size=2640393 2024-09-12T17:47:02.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.935+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=7IHJT1I6CV01 type=del size=53754 2024-09-12T17:47:02.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.935+0000 7f68bc0598c0 -1 < failed to complete operation key=WPQ755ODAFNT tag=7CPO75L32F52 type=del size=86601: (22) Invalid argument 2024-09-12T17:47:02.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.939+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=A188G6OHZXP3 type=del size=3052011 2024-09-12T17:47:02.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.939+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~WEOB7L70RB1P.0 size=1048576 2024-09-12T17:47:02.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.939+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~WEOB7L70RB1P.1 size=254565 2024-09-12T17:47:02.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.943+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=WEOB7L70RB1P tag=58HEPEKIDSMU type=write size=2351717 2024-09-12T17:47:02.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.947+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~KU2HBRSRQEMW.0 size=1048576 2024-09-12T17:47:02.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.947+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~KU2HBRSRQEMW.1 size=1048576 2024-09-12T17:47:02.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.951+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~KU2HBRSRQEMW.2 size=108309 2024-09-12T17:47:02.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.951+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=KU2HBRSRQEMW tag=33J5ND7XGCF7 type=write size=3254037 2024-09-12T17:47:02.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.951+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=FZNO0SK1EIU8 type=del 2024-09-12T17:47:02.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.955+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~TM22TGWA3ZJJ.0 size=720680 2024-09-12T17:47:02.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.955+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=TM22TGWA3ZJJ tag=JWKQFFRYEHZB type=write size=1769256 2024-09-12T17:47:02.959 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.955+0000 7f68bc0598c0 1 < completed write operation key=W8JEQ5NOIE6O tag=46A477L3CS9Y type=write size=896421 2024-09-12T17:47:02.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.959+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=16B66SGSTK68 type=del size=2823375 2024-09-12T17:47:02.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.959+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~MDPQM3XKE8J6.0 size=557439 2024-09-12T17:47:02.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.963+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=MDPQM3XKE8J6 tag=J1PV9F0B0YAA type=write size=1606015 2024-09-12T17:47:02.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.963+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=PO89FL5LT6DP type=write size=284455 2024-09-12T17:47:02.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.967+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=KGRCNQTGL29P type=del 2024-09-12T17:47:02.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.967+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=FRC0Y594ZLKT type=del size=3214960 2024-09-12T17:47:02.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.967+0000 7f68bc0598c0 1 < completed write operation key=KW3VWTA43PBM tag=44H8IHYRO1M7 type=write size=254243 2024-09-12T17:47:02.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.971+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=TBYGIWOB2CF6 type=del size=2210214 2024-09-12T17:47:02.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.975+0000 7f68bc0598c0 1 < suggested remove operation key=2129SG6US3LI tag=3577HPL1L5A2 type=del 2024-09-12T17:47:02.980 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.975+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~DNM8R8P5ANLN.0 size=1048576 2024-09-12T17:47:02.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.979+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~DNM8R8P5ANLN.1 size=690702 2024-09-12T17:47:02.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.979+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=DNM8R8P5ANLN tag=39QUGIZCDTL5 type=write size=2787854 2024-09-12T17:47:02.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.979+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=4HAJY3L13013 type=del 2024-09-12T17:47:02.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.979+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=7EY7KKOK1N4K type=write size=934179 2024-09-12T17:47:02.986 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.983+0000 7f68bc0598c0 1 < canceled operation key=XGJSQJ2IXJDK tag=3RJS7LTNW6R3 type=del size=2623643 2024-09-12T17:47:02.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.987+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~OPYLLAPDHL5V.0 size=1048576 2024-09-12T17:47:02.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.987+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~OPYLLAPDHL5V.1 size=432993 2024-09-12T17:47:02.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.987+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=OPYLLAPDHL5V tag=VMEYUVQKTWU7 type=write size=2530145 2024-09-12T17:47:02.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.987+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=LM8QTAYL4BBD type=del 2024-09-12T17:47:02.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.991+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=2W052FVMGGNR type=del size=3754720 2024-09-12T17:47:02.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.991+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~AQ7HFXK81VEZ.0 size=1048576 2024-09-12T17:47:02.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.991+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~AQ7HFXK81VEZ.1 size=536048 2024-09-12T17:47:02.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.995+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=AQ7HFXK81VEZ tag=ZTJUS5GNOBB1 type=write size=2633200 2024-09-12T17:47:03.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.999+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~DO1ZZNZF3HY0.0 size=877085 2024-09-12T17:47:03.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:02.999+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=DO1ZZNZF3HY0 tag=BH9H2RUHXOL1 type=write size=1925661 2024-09-12T17:47:03.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.003+0000 7f68bc0598c0 1 < suggested remove operation key=FC3K0QN3TAWH tag=GDY3F8R827DJ type=del 2024-09-12T17:47:03.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.003+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=2F3XXTOMKYSC type=del size=26682 2024-09-12T17:47:03.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.003+0000 7f68bc0598c0 -1 < failed to complete operation key=RTY1OT2PSAAY tag=MOI7BCONM8QV type=del size=1661335: (22) Invalid argument 2024-09-12T17:47:03.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.007+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=7F1NMMA8TG44 type=del size=4098053 2024-09-12T17:47:03.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.011+0000 7f68bc0598c0 1 < suggested remove operation key=6J677S46BXS4 tag=69VV9Z8YAPZ0 type=del 2024-09-12T17:47:03.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.011+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=C1R52GUKJYRV type=del size=3220478 2024-09-12T17:47:03.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.015+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=7IHJT1I6CV01 type=del 2024-09-12T17:47:03.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.015+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~IK3MNCCAD1HU.0 size=1048576 2024-09-12T17:47:03.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.019+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~IK3MNCCAD1HU.1 size=252394 2024-09-12T17:47:03.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.019+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=IK3MNCCAD1HU tag=UFIN7LOTLEE7 type=write size=2349546 2024-09-12T17:47:03.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.019+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=A188G6OHZXP3 type=del 2024-09-12T17:47:03.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.019+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=Z3WAZQUGEN3U type=del size=59272 2024-09-12T17:47:03.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.023+0000 7f68bc0598c0 1 < canceled part key=_multipart_SBQGW2EK6I1J.2~KU2HBRSRQEMW.0 size=1048576 2024-09-12T17:47:03.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.023+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~KU2HBRSRQEMW.1 size=1048576 2024-09-12T17:47:03.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.023+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~KU2HBRSRQEMW.2 size=108309 2024-09-12T17:47:03.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.027+0000 7f68bc0598c0 1 < canceled multipart upload key=SBQGW2EK6I1J upload=KU2HBRSRQEMW tag=33J5ND7XGCF7 type=write size=3254037 2024-09-12T17:47:03.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.031+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~8NU25KATI1VK.0 size=323733 2024-09-12T17:47:03.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.031+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=8NU25KATI1VK tag=APXHMZW97FOB type=write size=1372309 2024-09-12T17:47:03.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.031+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~TM22TGWA3ZJJ.0 size=720680 2024-09-12T17:47:03.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.035+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=TM22TGWA3ZJJ tag=JWKQFFRYEHZB type=write size=1769256 2024-09-12T17:47:03.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.035+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~3222M91OFOIA.0 size=1044460 2024-09-12T17:47:03.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.035+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=3222M91OFOIA tag=6ZH6VUWGDGME type=write size=2093036 2024-09-12T17:47:03.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.039+0000 7f68bc0598c0 -1 < failed to complete operation key=2129SG6US3LI tag=16B66SGSTK68 type=del size=2823375: (22) Invalid argument 2024-09-12T17:47:03.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.039+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=VU77DU262M8H type=write size=457022 2024-09-12T17:47:03.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.043+0000 7f68bc0598c0 1 < completed write operation key=7XH1E2GEH9O2 tag=PO89FL5LT6DP type=write size=284455 2024-09-12T17:47:03.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.043+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~DPF3OQOYPZ2C.0 size=1048576 2024-09-12T17:47:03.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.047+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~DPF3OQOYPZ2C.1 size=1048576 2024-09-12T17:47:03.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.047+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~DPF3OQOYPZ2C.2 size=569939 2024-09-12T17:47:03.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.047+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=DPF3OQOYPZ2C tag=287W3FR52PJ8 type=write size=3715667 2024-09-12T17:47:03.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.051+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=FRC0Y594ZLKT type=del 2024-09-12T17:47:03.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~NZKJWXQVAZQI.0 size=1048576 2024-09-12T17:47:03.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~NZKJWXQVAZQI.1 size=872230 2024-09-12T17:47:03.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.055+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=NZKJWXQVAZQI tag=3W8A6ND2ATTT type=write size=2969382 2024-09-12T17:47:03.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.059+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=TBYGIWOB2CF6 type=del 2024-09-12T17:47:03.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.059+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=AY85ZHEIURPZ type=write size=392936 2024-09-12T17:47:03.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.063+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~DNM8R8P5ANLN.0 size=1048576 2024-09-12T17:47:03.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.063+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~DNM8R8P5ANLN.1 size=690702 2024-09-12T17:47:03.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.067+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=DNM8R8P5ANLN tag=39QUGIZCDTL5 type=write size=2787854 2024-09-12T17:47:03.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.071+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~FLZLUR8D3PZT.0 size=406935 2024-09-12T17:47:03.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.071+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=FLZLUR8D3PZT tag=QJ652NBBTBJ1 type=write size=1455511 2024-09-12T17:47:03.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.075+0000 7f68bc0598c0 1 < completed write operation key=WPQ755ODAFNT tag=7EY7KKOK1N4K type=write size=934179 2024-09-12T17:47:03.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.079+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=O2X8QTUS28LD type=del size=2959057 2024-09-12T17:47:03.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.079+0000 7f68bc0598c0 1 < canceled part key=_multipart_WUGDIFCHNL90.2~OPYLLAPDHL5V.0 size=1048576 2024-09-12T17:47:03.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.079+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~OPYLLAPDHL5V.1 size=432993 2024-09-12T17:47:03.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.083+0000 7f68bc0598c0 1 < canceled multipart upload key=WUGDIFCHNL90 upload=OPYLLAPDHL5V tag=VMEYUVQKTWU7 type=write size=2530145 2024-09-12T17:47:03.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.087+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=O33IAZZEG7WC type=del size=1166830 2024-09-12T17:47:03.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.087+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=2W052FVMGGNR type=del 2024-09-12T17:47:03.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.091+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~WNO6P0MLYKLH.0 size=1048576 2024-09-12T17:47:03.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.095+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~WNO6P0MLYKLH.1 size=560004 2024-09-12T17:47:03.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.095+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=WNO6P0MLYKLH tag=SGAKAV6AEA46 type=write size=2657156 2024-09-12T17:47:03.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.095+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~DO1ZZNZF3HY0.0 size=877085 2024-09-12T17:47:03.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.099+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=DO1ZZNZF3HY0 tag=BH9H2RUHXOL1 type=write size=1925661 2024-09-12T17:47:03.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.103+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=9ZBHIUQ32SNU type=write size=500484 2024-09-12T17:47:03.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.103+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=2F3XXTOMKYSC type=del 2024-09-12T17:47:03.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.107+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=K0MUV8FMR0FQ type=write size=555426 2024-09-12T17:47:03.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.111+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=7F1NMMA8TG44 type=del 2024-09-12T17:47:03.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.115+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~9DG9H0OGYWKA.0 size=343081 2024-09-12T17:47:03.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.115+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=9DG9H0OGYWKA tag=6QNP7T2H3WQW type=write size=1391657 2024-09-12T17:47:03.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.115+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=C1R52GUKJYRV type=del 2024-09-12T17:47:03.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.119+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=4QG3P23UFVL1 type=del size=2587389 2024-09-12T17:47:03.124 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.119+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~IK3MNCCAD1HU.0 size=1048576 2024-09-12T17:47:03.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.123+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~IK3MNCCAD1HU.1 size=252394 2024-09-12T17:47:03.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.127+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=IK3MNCCAD1HU tag=UFIN7LOTLEE7 type=write size=2349546 2024-09-12T17:47:03.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.131+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~G0EUK9UGWMBR.0 size=1048576 2024-09-12T17:47:03.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.131+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~G0EUK9UGWMBR.1 size=1048576 2024-09-12T17:47:03.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.131+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~G0EUK9UGWMBR.2 size=415991 2024-09-12T17:47:03.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.131+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=G0EUK9UGWMBR tag=4FNH6234YVN5 type=write size=3561719 2024-09-12T17:47:03.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.135+0000 7f68bc0598c0 1 < suggested remove operation key=UOW521GPXBQ0 tag=Z3WAZQUGEN3U type=del 2024-09-12T17:47:03.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.139+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~CEGJV3WYHV2X.0 size=4310 2024-09-12T17:47:03.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.139+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=CEGJV3WYHV2X tag=3CMOOM41XQ4G type=write size=1052886 2024-09-12T17:47:03.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.143+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~8NU25KATI1VK.0 size=323733 2024-09-12T17:47:03.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.147+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=8NU25KATI1VK tag=APXHMZW97FOB type=write size=1372309 2024-09-12T17:47:03.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.151+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=KOB5RJX43RD0 type=del size=2185146 2024-09-12T17:47:03.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.151+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~3222M91OFOIA.0 size=1044460 2024-09-12T17:47:03.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.155+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=3222M91OFOIA tag=6ZH6VUWGDGME type=write size=2093036 2024-09-12T17:47:03.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.159+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~W0MF4GUPORU3.0 size=1048576 2024-09-12T17:47:03.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.159+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~W0MF4GUPORU3.1 size=1048576 2024-09-12T17:47:03.165 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.163+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~W0MF4GUPORU3.2 size=301925 2024-09-12T17:47:03.165 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.163+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=W0MF4GUPORU3 tag=BFFBBYDPW7PD type=write size=3447653 2024-09-12T17:47:03.166 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.163+0000 7f68bc0598c0 -1 < no bi entry to suggest for operation key=UOW521GPXBQ0 tag=VU77DU262M8H type=write size=457022: (2) No such file or directory 2024-09-12T17:47:03.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.167+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~9UYKDTZB4C1P.0 size=1048576 2024-09-12T17:47:03.171 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.167+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~9UYKDTZB4C1P.1 size=1048576 2024-09-12T17:47:03.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~9UYKDTZB4C1P.2 size=770218 2024-09-12T17:47:03.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.171+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=9UYKDTZB4C1P tag=6R91M1UCIQCM type=write size=3915946 2024-09-12T17:47:03.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.171+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~DPF3OQOYPZ2C.0 size=1048576 2024-09-12T17:47:03.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.175+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~DPF3OQOYPZ2C.1 size=1048576 2024-09-12T17:47:03.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.175+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~DPF3OQOYPZ2C.2 size=569939 2024-09-12T17:47:03.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.179+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=DPF3OQOYPZ2C tag=287W3FR52PJ8 type=write size=3715667 2024-09-12T17:47:03.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.179+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=8JM4IHYVNQU5 type=del size=2534818 2024-09-12T17:47:03.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.183+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~NZKJWXQVAZQI.0 size=1048576 2024-09-12T17:47:03.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.183+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~NZKJWXQVAZQI.1 size=872230 2024-09-12T17:47:03.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.187+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=NZKJWXQVAZQI tag=3W8A6ND2ATTT type=write size=2969382 2024-09-12T17:47:03.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.191+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=TFOY8IKYOCX6 type=del size=908786 2024-09-12T17:47:03.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.191+0000 7f68bc0598c0 1 < completed write operation key=FC3K0QN3TAWH tag=AY85ZHEIURPZ type=write size=392936 2024-09-12T17:47:03.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.195+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=BXGN6U33KBCZ type=del size=486100 2024-09-12T17:47:03.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.195+0000 7f68bc0598c0 1 < canceled part key=_multipart_NLPTU26RO70S.2~FLZLUR8D3PZT.0 size=406935 2024-09-12T17:47:03.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.199+0000 7f68bc0598c0 1 < canceled multipart upload key=NLPTU26RO70S upload=FLZLUR8D3PZT tag=QJ652NBBTBJ1 type=write size=1455511 2024-09-12T17:47:03.205 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.203+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=LTT54C6KB5BU type=write size=663120 2024-09-12T17:47:03.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.203+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=O2X8QTUS28LD type=del 2024-09-12T17:47:03.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~M1D30XVKJL61.0 size=1048576 2024-09-12T17:47:03.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~M1D30XVKJL61.1 size=1048576 2024-09-12T17:47:03.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.215+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~M1D30XVKJL61.2 size=795284 2024-09-12T17:47:03.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.215+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=M1D30XVKJL61 tag=CCJKJJ8IP27D type=write size=3941012 2024-09-12T17:47:03.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.219+0000 7f68bc0598c0 1 < suggested update operation key=OG0V0I1SDHG5 tag=O33IAZZEG7WC type=del size=1166830 2024-09-12T17:47:03.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.223+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=R7HIKLQM0SID type=del size=3711767 2024-09-12T17:47:03.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.227+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~WNO6P0MLYKLH.0 size=1048576 2024-09-12T17:47:03.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.227+0000 7f68bc0598c0 1 < canceled part key=_multipart_F4F4P4L8K5D9.2~WNO6P0MLYKLH.1 size=560004 2024-09-12T17:47:03.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.231+0000 7f68bc0598c0 1 < canceled multipart upload key=F4F4P4L8K5D9 upload=WNO6P0MLYKLH tag=SGAKAV6AEA46 type=write size=2657156 2024-09-12T17:47:03.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.235+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~BJ77YSPR6KU7.0 size=191270 2024-09-12T17:47:03.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.235+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=BJ77YSPR6KU7 tag=K16CC06CYUN4 type=write size=1239846 2024-09-12T17:47:03.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.235+0000 7f68bc0598c0 1 < completed write operation key=QGO5SPFPT548 tag=9ZBHIUQ32SNU type=write size=500484 2024-09-12T17:47:03.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.239+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~200VBFNLVJUN.0 size=116241 2024-09-12T17:47:03.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.239+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=200VBFNLVJUN tag=PNRUIA2DQKPK type=write size=1164817 2024-09-12T17:47:03.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.243+0000 7f68bc0598c0 -1 < failed to complete operation key=OG0V0I1SDHG5 tag=K0MUV8FMR0FQ type=write size=555426: (22) Invalid argument 2024-09-12T17:47:03.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.247+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=BWCKDI1WQ5F0 type=del size=2690988 2024-09-12T17:47:03.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.247+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~9DG9H0OGYWKA.0 size=343081 2024-09-12T17:47:03.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.251+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=9DG9H0OGYWKA tag=6QNP7T2H3WQW type=write size=1391657 2024-09-12T17:47:03.259 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.255+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=8JIAUFY3J6XH type=del size=3781013 2024-09-12T17:47:03.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.259+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=4QG3P23UFVL1 type=del 2024-09-12T17:47:03.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.259+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=AF06XH0VTKYI type=del size=1960249 2024-09-12T17:47:03.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.263+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~G0EUK9UGWMBR.0 size=1048576 2024-09-12T17:47:03.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.267+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~G0EUK9UGWMBR.1 size=1048576 2024-09-12T17:47:03.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.267+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~G0EUK9UGWMBR.2 size=415991 2024-09-12T17:47:03.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.271+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=G0EUK9UGWMBR tag=4FNH6234YVN5 type=write size=3561719 2024-09-12T17:47:03.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.275+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=6GCLOFJL4VR1 type=del size=1307397 2024-09-12T17:47:03.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.275+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~CEGJV3WYHV2X.0 size=4310 2024-09-12T17:47:03.283 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.279+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=CEGJV3WYHV2X tag=3CMOOM41XQ4G type=write size=1052886 2024-09-12T17:47:03.285 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.283+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=RPB7HG6HL1NZ type=write size=563202 2024-09-12T17:47:03.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.283+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=KOB5RJX43RD0 type=del 2024-09-12T17:47:03.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.287+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=33BPZTKDJN3T type=write size=749579 2024-09-12T17:47:03.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.287+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~W0MF4GUPORU3.0 size=1048576 2024-09-12T17:47:03.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.291+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~W0MF4GUPORU3.1 size=1048576 2024-09-12T17:47:03.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.291+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~W0MF4GUPORU3.2 size=301925 2024-09-12T17:47:03.299 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.295+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=W0MF4GUPORU3 tag=BFFBBYDPW7PD type=write size=3447653 2024-09-12T17:47:03.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.299+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=VH8LN2ZIRVWC type=del size=3391068 2024-09-12T17:47:03.303 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.299+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~9UYKDTZB4C1P.0 size=1048576 2024-09-12T17:47:03.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.303+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~9UYKDTZB4C1P.1 size=1048576 2024-09-12T17:47:03.307 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.303+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~9UYKDTZB4C1P.2 size=770218 2024-09-12T17:47:03.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.307+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=9UYKDTZB4C1P tag=6R91M1UCIQCM type=write size=3915946 2024-09-12T17:47:03.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.307+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=FHDQFJVOYVMM type=del size=1560593 2024-09-12T17:47:03.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.311+0000 7f68bc0598c0 1 < suggested remove operation key=2129SG6US3LI tag=8JM4IHYVNQU5 type=del 2024-09-12T17:47:03.319 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.315+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=EHP0RTWZCPA3 type=del size=645515 2024-09-12T17:47:03.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.319+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=TFOY8IKYOCX6 type=del 2024-09-12T17:47:03.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.323+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=OGYKHDVZ2IT1 type=del size=1760655 2024-09-12T17:47:03.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.323+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=BXGN6U33KBCZ type=del 2024-09-12T17:47:03.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.327+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=24QM3QZXODZ1 type=write size=992002 2024-09-12T17:47:03.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.331+0000 7f68bc0598c0 1 < suggested remove operation key=W8JEQ5NOIE6O tag=LTT54C6KB5BU type=write 2024-09-12T17:47:03.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.331+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=L0LI1VPEW2ML type=del size=3477634 2024-09-12T17:47:03.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.331+0000 7f68bc0598c0 1 < canceled part key=_multipart_8P0EWBVO0BQD.2~M1D30XVKJL61.0 size=1048576 2024-09-12T17:47:03.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.335+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~M1D30XVKJL61.1 size=1048576 2024-09-12T17:47:03.340 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.335+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~M1D30XVKJL61.2 size=795284 2024-09-12T17:47:03.343 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.339+0000 7f68bc0598c0 1 < canceled multipart upload key=8P0EWBVO0BQD upload=M1D30XVKJL61 tag=CCJKJJ8IP27D type=write size=3941012 2024-09-12T17:47:03.345 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.343+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=EWHA4QXKG9SG type=write size=741187 2024-09-12T17:47:03.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.347+0000 7f68bc0598c0 1 < suggested remove operation key=WPQ755ODAFNT tag=R7HIKLQM0SID type=del 2024-09-12T17:47:03.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.351+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~FUIZU3U293TA.0 size=1048576 2024-09-12T17:47:03.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.351+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~FUIZU3U293TA.1 size=754977 2024-09-12T17:47:03.356 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.351+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=FUIZU3U293TA tag=JAL9DI40QBBV type=write size=2852129 2024-09-12T17:47:03.358 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.355+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~BJ77YSPR6KU7.0 size=191270 2024-09-12T17:47:03.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.359+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=BJ77YSPR6KU7 tag=K16CC06CYUN4 type=write size=1239846 2024-09-12T17:47:03.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.359+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=0ZHX3IR7YI61 type=del size=3190672 2024-09-12T17:47:03.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.363+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~200VBFNLVJUN.0 size=116241 2024-09-12T17:47:03.370 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.367+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=200VBFNLVJUN tag=PNRUIA2DQKPK type=write size=1164817 2024-09-12T17:47:03.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.367+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=S22R8Z8G5029 type=del size=765146 2024-09-12T17:47:03.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.371+0000 7f68bc0598c0 1 < canceled operation key=DMJZUQJ7IY60 tag=BWCKDI1WQ5F0 type=del size=2690988 2024-09-12T17:47:03.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.375+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~354N38Q6PPB1.0 size=1048576 2024-09-12T17:47:03.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.375+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~354N38Q6PPB1.1 size=1048576 2024-09-12T17:47:03.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.379+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~354N38Q6PPB1.2 size=30041 2024-09-12T17:47:03.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.379+0000 7f68bc0598c0 1 > prepared multipart upload key=BKAT5SGAC5Z8 upload=354N38Q6PPB1 tag=PE5E8FFGRN8F type=write size=3175769 2024-09-12T17:47:03.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.379+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=8JIAUFY3J6XH type=del 2024-09-12T17:47:03.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.383+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=O45RGX1KF0MS type=del size=907683 2024-09-12T17:47:03.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.383+0000 7f68bc0598c0 1 < canceled operation key=S0B1RP89NO44 tag=AF06XH0VTKYI type=del size=1960249 2024-09-12T17:47:03.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.387+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=LLNS7U6XP3SH type=del size=2549511 2024-09-12T17:47:03.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.391+0000 7f68bc0598c0 1 < suggested update operation key=0XFYVNU2Q7KO tag=6GCLOFJL4VR1 type=del size=1307397 2024-09-12T17:47:03.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.391+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=A65LLP9Q6V7A type=del size=3118342 2024-09-12T17:47:03.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.395+0000 7f68bc0598c0 1 < suggested update operation key=BKAT5SGAC5Z8 tag=RPB7HG6HL1NZ type=write size=563202 2024-09-12T17:47:03.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.399+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=3UI2BHRUV8XB type=del size=110373 2024-09-12T17:47:03.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.399+0000 7f68bc0598c0 -1 < failed to complete operation key=2129SG6US3LI tag=33BPZTKDJN3T type=write size=749579: (22) Invalid argument 2024-09-12T17:47:03.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.403+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~UCP2R1X7D5ZT.0 size=1048576 2024-09-12T17:47:03.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.403+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~UCP2R1X7D5ZT.1 size=1048576 2024-09-12T17:47:03.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.407+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~UCP2R1X7D5ZT.2 size=449033 2024-09-12T17:47:03.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.407+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=UCP2R1X7D5ZT tag=LTS9K4C6NOZ7 type=write size=3594761 2024-09-12T17:47:03.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.407+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=VH8LN2ZIRVWC type=del 2024-09-12T17:47:03.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.411+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=E2MMMKESL24I type=del size=461218 2024-09-12T17:47:03.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.411+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=FHDQFJVOYVMM type=del 2024-09-12T17:47:03.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.415+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~6KJVED6EE3CC.0 size=790450 2024-09-12T17:47:03.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.415+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=6KJVED6EE3CC tag=ZN64WZJUYAQT type=write size=1839026 2024-09-12T17:47:03.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.419+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=EHP0RTWZCPA3 type=del 2024-09-12T17:47:03.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.419+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~QG72BE2EMDV9.0 size=1048576 2024-09-12T17:47:03.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.423+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~QG72BE2EMDV9.1 size=1048576 2024-09-12T17:47:03.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.423+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~QG72BE2EMDV9.2 size=878087 2024-09-12T17:47:03.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.423+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=QG72BE2EMDV9 tag=SI4OWX2N4MQ1 type=write size=4023815 2024-09-12T17:47:03.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.427+0000 7f68bc0598c0 -1 < failed to complete operation key=0XFYVNU2Q7KO tag=OGYKHDVZ2IT1 type=del size=1760655: (22) Invalid argument 2024-09-12T17:47:03.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.427+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=2RKJ1LG1EQIX type=del size=830742 2024-09-12T17:47:03.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.431+0000 7f68bc0598c0 1 < completed write operation key=4R9ENKMRB1GT tag=24QM3QZXODZ1 type=write size=992002 2024-09-12T17:47:03.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.431+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=VQUTA0NBERZL type=del size=1018881 2024-09-12T17:47:03.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.435+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=L0LI1VPEW2ML type=del 2024-09-12T17:47:03.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.435+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=SI3CM88WR9DJ type=del size=3564284 2024-09-12T17:47:03.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.439+0000 7f68bc0598c0 1 < completed write operation key=9846YLKC8P8S tag=EWHA4QXKG9SG type=write size=741187 2024-09-12T17:47:03.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.439+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=DMSB5THOM00I type=del size=3922196 2024-09-12T17:47:03.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.443+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~FUIZU3U293TA.0 size=1048576 2024-09-12T17:47:03.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.443+0000 7f68bc0598c0 1 < canceled part key=_multipart_F4F4P4L8K5D9.2~FUIZU3U293TA.1 size=754977 2024-09-12T17:47:03.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.443+0000 7f68bc0598c0 1 < canceled multipart upload key=F4F4P4L8K5D9 upload=FUIZU3U293TA tag=JAL9DI40QBBV type=write size=2852129 2024-09-12T17:47:03.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.447+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~6AP8F2YP0E96.0 size=318335 2024-09-12T17:47:03.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.447+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=6AP8F2YP0E96 tag=5A7PALGINHBH type=write size=1366911 2024-09-12T17:47:03.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.451+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=0ZHX3IR7YI61 type=del 2024-09-12T17:47:03.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.451+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=FMBQZFI33OFT type=write size=1033777 2024-09-12T17:47:03.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.455+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=S22R8Z8G5029 type=del 2024-09-12T17:47:03.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.455+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=HTAM2IAJC8NJ type=write size=238812 2024-09-12T17:47:03.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.455+0000 7f68bc0598c0 1 < canceled part key=_multipart_BKAT5SGAC5Z8.2~354N38Q6PPB1.0 size=1048576 2024-09-12T17:47:03.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.459+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~354N38Q6PPB1.1 size=1048576 2024-09-12T17:47:03.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.459+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~354N38Q6PPB1.2 size=30041 2024-09-12T17:47:03.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.463+0000 7f68bc0598c0 1 < canceled multipart upload key=BKAT5SGAC5Z8 upload=354N38Q6PPB1 tag=PE5E8FFGRN8F type=write size=3175769 2024-09-12T17:47:03.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.467+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~4OI2CX9J9988.0 size=1048576 2024-09-12T17:47:03.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.467+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~4OI2CX9J9988.1 size=586931 2024-09-12T17:47:03.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.467+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=4OI2CX9J9988 tag=O2A37EL4P1CH type=write size=2684083 2024-09-12T17:47:03.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.471+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=O45RGX1KF0MS type=del 2024-09-12T17:47:03.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.471+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=7ZCWWHM4IDPQ type=del size=2466666 2024-09-12T17:47:03.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.475+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=LLNS7U6XP3SH type=del 2024-09-12T17:47:03.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.475+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=SZC8C8J46JSC type=del size=2583127 2024-09-12T17:47:03.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.475+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=A65LLP9Q6V7A type=del 2024-09-12T17:47:03.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.479+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=GQR26836HO80 type=del size=2466944 2024-09-12T17:47:03.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.479+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=3UI2BHRUV8XB type=del 2024-09-12T17:47:03.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.483+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~YZGK5IN6P42Y.0 size=1048576 2024-09-12T17:47:03.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.487+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~YZGK5IN6P42Y.1 size=1002552 2024-09-12T17:47:03.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.487+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=YZGK5IN6P42Y tag=LR0EHGQVXIYL type=write size=3099704 2024-09-12T17:47:03.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.487+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~UCP2R1X7D5ZT.0 size=1048576 2024-09-12T17:47:03.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.491+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~UCP2R1X7D5ZT.1 size=1048576 2024-09-12T17:47:03.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.491+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~UCP2R1X7D5ZT.2 size=449033 2024-09-12T17:47:03.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.495+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=UCP2R1X7D5ZT tag=LTS9K4C6NOZ7 type=write size=3594761 2024-09-12T17:47:03.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.495+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=KI19C9MZVCCZ type=del size=1349296 2024-09-12T17:47:03.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.499+0000 7f68bc0598c0 1 < suggested remove operation key=RTY1OT2PSAAY tag=E2MMMKESL24I type=del 2024-09-12T17:47:03.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.503+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~4W8ICVT9MBOF.0 size=788299 2024-09-12T17:47:03.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.503+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=4W8ICVT9MBOF tag=ORVKPCMVZSSE type=write size=1836875 2024-09-12T17:47:03.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.507+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~6KJVED6EE3CC.0 size=790450 2024-09-12T17:47:03.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.511+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=6KJVED6EE3CC tag=ZN64WZJUYAQT type=write size=1839026 2024-09-12T17:47:03.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.515+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~12FB0DU0C4XM.0 size=1048576 2024-09-12T17:47:03.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.515+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~12FB0DU0C4XM.1 size=1048576 2024-09-12T17:47:03.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.519+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~12FB0DU0C4XM.2 size=28336 2024-09-12T17:47:03.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.519+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=12FB0DU0C4XM tag=2PQ7Y1P9GQ3Q type=write size=3174064 2024-09-12T17:47:03.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.519+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~QG72BE2EMDV9.0 size=1048576 2024-09-12T17:47:03.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.523+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~QG72BE2EMDV9.1 size=1048576 2024-09-12T17:47:03.527 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.523+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~QG72BE2EMDV9.2 size=878087 2024-09-12T17:47:03.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.527+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=QG72BE2EMDV9 tag=SI4OWX2N4MQ1 type=write size=4023815 2024-09-12T17:47:03.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.527+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=ODX2Z85WFA9E type=del size=3772226 2024-09-12T17:47:03.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.531+0000 7f68bc0598c0 1 < suggested update operation key=FC3K0QN3TAWH tag=2RKJ1LG1EQIX type=del size=830742 2024-09-12T17:47:03.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.535+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=2D2DEWFEEGJ3 type=del size=1819964 2024-09-12T17:47:03.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.535+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=VQUTA0NBERZL type=del 2024-09-12T17:47:03.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.539+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=EFSY0FF6S3QN type=del size=323749 2024-09-12T17:47:03.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.539+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=SI3CM88WR9DJ type=del 2024-09-12T17:47:03.546 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.543+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=64WAB4ANXLHY type=del size=3811500 2024-09-12T17:47:03.546 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.543+0000 7f68bc0598c0 -1 < no bi entry to suggest for operation key=RTY1OT2PSAAY tag=DMSB5THOM00I type=del size=3922196: (2) No such file or directory 2024-09-12T17:47:03.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.547+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~AGQU8S1DY625.0 size=1048576 2024-09-12T17:47:03.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.547+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~AGQU8S1DY625.1 size=1048576 2024-09-12T17:47:03.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.551+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~AGQU8S1DY625.2 size=515563 2024-09-12T17:47:03.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.551+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=AGQU8S1DY625 tag=0ZAPCGNUR0ZQ type=write size=3661291 2024-09-12T17:47:03.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.551+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~6AP8F2YP0E96.0 size=318335 2024-09-12T17:47:03.558 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.555+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=6AP8F2YP0E96 tag=5A7PALGINHBH type=write size=1366911 2024-09-12T17:47:03.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.559+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~CM365IP7FNFO.0 size=1048576 2024-09-12T17:47:03.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.559+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~CM365IP7FNFO.1 size=444795 2024-09-12T17:47:03.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.559+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=CM365IP7FNFO tag=X6NVD5ZZX5YY type=write size=2541947 2024-09-12T17:47:03.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.563+0000 7f68bc0598c0 1 < completed write operation key=UOW521GPXBQ0 tag=FMBQZFI33OFT type=write size=1033777 2024-09-12T17:47:03.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.563+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~ZFYFLCW2V9M8.0 size=1048576 2024-09-12T17:47:03.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.567+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~ZFYFLCW2V9M8.1 size=412497 2024-09-12T17:47:03.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.567+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=ZFYFLCW2V9M8 tag=2Q7K2TU4IUJ3 type=write size=2509649 2024-09-12T17:47:03.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.567+0000 7f68bc0598c0 -1 < failed to complete operation key=FC3K0QN3TAWH tag=HTAM2IAJC8NJ type=write size=238812: (22) Invalid argument 2024-09-12T17:47:03.575 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.571+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~YIAN7ARSN67S.0 size=1048576 2024-09-12T17:47:03.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.575+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~YIAN7ARSN67S.1 size=841237 2024-09-12T17:47:03.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.575+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=YIAN7ARSN67S tag=9KPE977GJRZS type=write size=2938389 2024-09-12T17:47:03.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.575+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~4OI2CX9J9988.0 size=1048576 2024-09-12T17:47:03.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.579+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~4OI2CX9J9988.1 size=586931 2024-09-12T17:47:03.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.583+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=4OI2CX9J9988 tag=O2A37EL4P1CH type=write size=2684083 2024-09-12T17:47:03.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.587+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~41X5TVALEM0C.0 size=559053 2024-09-12T17:47:03.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.587+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=41X5TVALEM0C tag=LS2UPJI76TTY type=write size=1607629 2024-09-12T17:47:03.593 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.591+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=7ZCWWHM4IDPQ type=del 2024-09-12T17:47:03.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.595+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~YDTYF0FQC5R7.0 size=28909 2024-09-12T17:47:03.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.595+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=YDTYF0FQC5R7 tag=LSQ3WRFHJ7AV type=write size=1077485 2024-09-12T17:47:03.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.599+0000 7f68bc0598c0 1 < suggested update operation key=06W7N11O7F1I tag=SZC8C8J46JSC type=del size=2583127 2024-09-12T17:47:03.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.599+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=ILEQJZHQEFK6 type=del size=2630573 2024-09-12T17:47:03.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.603+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=GQR26836HO80 type=del 2024-09-12T17:47:03.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.603+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=704M3MAQNBR3 type=del size=3530766 2024-09-12T17:47:03.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.607+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~YZGK5IN6P42Y.0 size=1048576 2024-09-12T17:47:03.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.607+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~YZGK5IN6P42Y.1 size=1002552 2024-09-12T17:47:03.616 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.611+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=YZGK5IN6P42Y tag=LR0EHGQVXIYL type=write size=3099704 2024-09-12T17:47:03.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.615+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=6O02TFMAQTYP type=del size=3265333 2024-09-12T17:47:03.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.615+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=KI19C9MZVCCZ type=del 2024-09-12T17:47:03.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.619+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~1G3S5DD3QF92.0 size=908919 2024-09-12T17:47:03.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.619+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=1G3S5DD3QF92 tag=XG9VQE4AQC8I type=write size=1957495 2024-09-12T17:47:03.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.623+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~4W8ICVT9MBOF.0 size=788299 2024-09-12T17:47:03.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.627+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=4W8ICVT9MBOF tag=ORVKPCMVZSSE type=write size=1836875 2024-09-12T17:47:03.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.627+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=FFVTGRD6IDD1 type=del size=2230474 2024-09-12T17:47:03.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.631+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~12FB0DU0C4XM.0 size=1048576 2024-09-12T17:47:03.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.631+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~12FB0DU0C4XM.1 size=1048576 2024-09-12T17:47:03.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.631+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~12FB0DU0C4XM.2 size=28336 2024-09-12T17:47:03.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.635+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=12FB0DU0C4XM tag=2PQ7Y1P9GQ3Q type=write size=3174064 2024-09-12T17:47:03.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.643+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~HI2ZT369ZZ3N.0 size=1048576 2024-09-12T17:47:03.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.643+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~HI2ZT369ZZ3N.1 size=1048576 2024-09-12T17:47:03.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.643+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~HI2ZT369ZZ3N.2 size=237508 2024-09-12T17:47:03.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.643+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=HI2ZT369ZZ3N tag=HPUB4VM4UHCN type=write size=3383236 2024-09-12T17:47:03.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.647+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=ODX2Z85WFA9E type=del 2024-09-12T17:47:03.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.651+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=HXE4BXD57AFY type=del size=876172 2024-09-12T17:47:03.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.651+0000 7f68bc0598c0 1 < canceled operation key=8P0EWBVO0BQD tag=2D2DEWFEEGJ3 type=del size=1819964 2024-09-12T17:47:03.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.655+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=9XF5Q2OKD2XG type=del size=1525672 2024-09-12T17:47:03.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.655+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=EFSY0FF6S3QN type=del 2024-09-12T17:47:03.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.659+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=93AFUPJ5TLR1 type=del size=3954785 2024-09-12T17:47:03.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.663+0000 7f68bc0598c0 1 < suggested remove operation key=HGY9WK7MKCYS tag=64WAB4ANXLHY type=del 2024-09-12T17:47:03.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.667+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~ZMHJPWNNT12L.0 size=874266 2024-09-12T17:47:03.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.667+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=ZMHJPWNNT12L tag=XIEHU3A1WZXI type=write size=1922842 2024-09-12T17:47:03.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.667+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~AGQU8S1DY625.0 size=1048576 2024-09-12T17:47:03.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.671+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~AGQU8S1DY625.1 size=1048576 2024-09-12T17:47:03.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.671+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~AGQU8S1DY625.2 size=515563 2024-09-12T17:47:03.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.675+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=AGQU8S1DY625 tag=0ZAPCGNUR0ZQ type=write size=3661291 2024-09-12T17:47:03.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.679+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=33Z2WILGYUTO type=del size=1800256 2024-09-12T17:47:03.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.679+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~CM365IP7FNFO.0 size=1048576 2024-09-12T17:47:03.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.683+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~CM365IP7FNFO.1 size=444795 2024-09-12T17:47:03.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.687+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=CM365IP7FNFO tag=X6NVD5ZZX5YY type=write size=2541947 2024-09-12T17:47:03.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.687+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=FGV5ANETQIA1 type=del size=1531513 2024-09-12T17:47:03.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.691+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~ZFYFLCW2V9M8.0 size=1048576 2024-09-12T17:47:03.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.691+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~ZFYFLCW2V9M8.1 size=412497 2024-09-12T17:47:03.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.695+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=ZFYFLCW2V9M8 tag=2Q7K2TU4IUJ3 type=write size=2509649 2024-09-12T17:47:03.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.699+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~0046PIRJCIVU.0 size=1048576 2024-09-12T17:47:03.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.699+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~0046PIRJCIVU.1 size=420055 2024-09-12T17:47:03.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.699+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=0046PIRJCIVU tag=AAWPSPX3L3OQ type=write size=2517207 2024-09-12T17:47:03.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.703+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~YIAN7ARSN67S.0 size=1048576 2024-09-12T17:47:03.710 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.707+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~YIAN7ARSN67S.1 size=841237 2024-09-12T17:47:03.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.711+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=YIAN7ARSN67S tag=9KPE977GJRZS type=write size=2938389 2024-09-12T17:47:03.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.711+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=WF09HZXBQAYF type=del size=3384769 2024-09-12T17:47:03.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.715+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~41X5TVALEM0C.0 size=559053 2024-09-12T17:47:03.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.719+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=41X5TVALEM0C tag=LS2UPJI76TTY type=write size=1607629 2024-09-12T17:47:03.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.723+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~LECF7ON4YA6Y.0 size=630646 2024-09-12T17:47:03.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.723+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=LECF7ON4YA6Y tag=F2UIZIRMYWPO type=write size=1679222 2024-09-12T17:47:03.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.727+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~YDTYF0FQC5R7.0 size=28909 2024-09-12T17:47:03.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.727+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=YDTYF0FQC5R7 tag=LSQ3WRFHJ7AV type=write size=1077485 2024-09-12T17:47:03.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.731+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=9BN9OP83PU2G type=del size=1193170 2024-09-12T17:47:03.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.735+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=ILEQJZHQEFK6 type=del 2024-09-12T17:47:03.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~X0V0ZDPDNF57.0 size=1048576 2024-09-12T17:47:03.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~X0V0ZDPDNF57.1 size=58776 2024-09-12T17:47:03.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.739+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=X0V0ZDPDNF57 tag=3BUYJLLOAI80 type=write size=2155928 2024-09-12T17:47:03.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.743+0000 7f68bc0598c0 1 < suggested update operation key=OG0V0I1SDHG5 tag=704M3MAQNBR3 type=del size=3530766 2024-09-12T17:47:03.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.747+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=1GVNUBKMHH87 type=del size=1847685 2024-09-12T17:47:03.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.747+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=6O02TFMAQTYP type=del 2024-09-12T17:47:03.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.755+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~O527W81N47FZ.0 size=1048576 2024-09-12T17:47:03.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.755+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~O527W81N47FZ.1 size=1048576 2024-09-12T17:47:03.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.755+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~O527W81N47FZ.2 size=119492 2024-09-12T17:47:03.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.755+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=O527W81N47FZ tag=Q00C2PGGIEJ7 type=write size=3265220 2024-09-12T17:47:03.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.759+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~1G3S5DD3QF92.0 size=908919 2024-09-12T17:47:03.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.763+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=1G3S5DD3QF92 tag=XG9VQE4AQC8I type=write size=1957495 2024-09-12T17:47:03.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.767+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=UYLDNTI1PJUG type=del size=2363190 2024-09-12T17:47:03.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.767+0000 7f68bc0598c0 1 < canceled operation key=9XK00RPA6Q38 tag=FFVTGRD6IDD1 type=del size=2230474 2024-09-12T17:47:03.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.775+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~48QXJ00FP7A9.0 size=1048576 2024-09-12T17:47:03.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.775+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~48QXJ00FP7A9.1 size=1048576 2024-09-12T17:47:03.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.775+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~48QXJ00FP7A9.2 size=727372 2024-09-12T17:47:03.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.775+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=48QXJ00FP7A9 tag=LJ8GGBWISPR3 type=write size=3873100 2024-09-12T17:47:03.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.779+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~HI2ZT369ZZ3N.0 size=1048576 2024-09-12T17:47:03.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.783+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~HI2ZT369ZZ3N.1 size=1048576 2024-09-12T17:47:03.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.783+0000 7f68bc0598c0 1 < canceled part key=_multipart_SBQGW2EK6I1J.2~HI2ZT369ZZ3N.2 size=237508 2024-09-12T17:47:03.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.787+0000 7f68bc0598c0 1 < canceled multipart upload key=SBQGW2EK6I1J upload=HI2ZT369ZZ3N tag=HPUB4VM4UHCN type=write size=3383236 2024-09-12T17:47:03.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.791+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=4P20FXKTL47L type=del size=1857536 2024-09-12T17:47:03.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.791+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=HXE4BXD57AFY type=del 2024-09-12T17:47:03.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.795+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=VEAHNGJAXIBD type=write size=22922 2024-09-12T17:47:03.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.799+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=9XF5Q2OKD2XG type=del 2024-09-12T17:47:03.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.803+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~9MYJF0J0RHI5.0 size=475388 2024-09-12T17:47:03.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.803+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=9MYJF0J0RHI5 tag=2G1TSSUEGSML type=write size=1523964 2024-09-12T17:47:03.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.807+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=93AFUPJ5TLR1 type=del 2024-09-12T17:47:03.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.811+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~HUGWMDAM6FC2.0 size=1048576 2024-09-12T17:47:03.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.815+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~HUGWMDAM6FC2.1 size=401262 2024-09-12T17:47:03.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.815+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=HUGWMDAM6FC2 tag=1C1PM86GQL0T type=write size=2498414 2024-09-12T17:47:03.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.819+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~ZMHJPWNNT12L.0 size=874266 2024-09-12T17:47:03.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.823+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=ZMHJPWNNT12L tag=XIEHU3A1WZXI type=write size=1922842 2024-09-12T17:47:03.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.827+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=8NMUZAKF0DVI type=del size=3755084 2024-09-12T17:47:03.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.831+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=33Z2WILGYUTO type=del 2024-09-12T17:47:03.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.835+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=JBSZK0ATQRNL type=del size=1431289 2024-09-12T17:47:03.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.843+0000 7f68bc0598c0 1 < suggested update operation key=9XK00RPA6Q38 tag=FGV5ANETQIA1 type=del size=1531513 2024-09-12T17:47:03.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.847+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~PZZ4KZINQ140.0 size=1048576 2024-09-12T17:47:03.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.851+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~PZZ4KZINQ140.1 size=1048576 2024-09-12T17:47:03.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.851+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~PZZ4KZINQ140.2 size=822842 2024-09-12T17:47:03.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.851+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=PZZ4KZINQ140 tag=ZTEFZHW0C02Q type=write size=3968570 2024-09-12T17:47:03.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.855+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~0046PIRJCIVU.0 size=1048576 2024-09-12T17:47:03.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.855+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~0046PIRJCIVU.1 size=420055 2024-09-12T17:47:03.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.863+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=0046PIRJCIVU tag=AAWPSPX3L3OQ type=write size=2517207 2024-09-12T17:47:03.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.863+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=MGZNOYQW9MA0 type=del size=3944602 2024-09-12T17:47:03.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.867+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=WF09HZXBQAYF type=del 2024-09-12T17:47:03.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.871+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=8RD8BCQCVS7O type=write size=315105 2024-09-12T17:47:03.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.875+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~LECF7ON4YA6Y.0 size=630646 2024-09-12T17:47:03.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.879+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=LECF7ON4YA6Y tag=F2UIZIRMYWPO type=write size=1679222 2024-09-12T17:47:03.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.883+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=51020VY42OCO type=del size=2482757 2024-09-12T17:47:03.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.887+0000 7f68bc0598c0 1 < suggested remove operation key=WPQ755ODAFNT tag=9BN9OP83PU2G type=del 2024-09-12T17:47:03.895 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~CEGYGV21EHZ1.0 size=1048576 2024-09-12T17:47:03.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.895+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~CEGYGV21EHZ1.1 size=1048576 2024-09-12T17:47:03.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.895+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~CEGYGV21EHZ1.2 size=966001 2024-09-12T17:47:03.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.895+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=CEGYGV21EHZ1 tag=KFAZGLP238CA type=write size=4111729 2024-09-12T17:47:03.902 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.899+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~X0V0ZDPDNF57.0 size=1048576 2024-09-12T17:47:03.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.899+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~X0V0ZDPDNF57.1 size=58776 2024-09-12T17:47:03.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.903+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=X0V0ZDPDNF57 tag=3BUYJLLOAI80 type=write size=2155928 2024-09-12T17:47:03.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.907+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=MQKCCNRQJ1P7 type=del size=2145357 2024-09-12T17:47:03.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.911+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=1GVNUBKMHH87 type=del 2024-09-12T17:47:03.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.915+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~DJ21RODJV8DE.0 size=1048576 2024-09-12T17:47:03.921 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.919+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~DJ21RODJV8DE.1 size=1048576 2024-09-12T17:47:03.923 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.919+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~DJ21RODJV8DE.2 size=578241 2024-09-12T17:47:03.923 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.919+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=DJ21RODJV8DE tag=1NCWI90B0YMD type=write size=3723969 2024-09-12T17:47:03.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.923+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~O527W81N47FZ.0 size=1048576 2024-09-12T17:47:03.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.923+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~O527W81N47FZ.1 size=1048576 2024-09-12T17:47:03.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.927+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~O527W81N47FZ.2 size=119492 2024-09-12T17:47:03.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.931+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=O527W81N47FZ tag=Q00C2PGGIEJ7 type=write size=3265220 2024-09-12T17:47:03.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.931+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=VX2I85O91PW1 type=write size=228967 2024-09-12T17:47:03.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.935+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=UYLDNTI1PJUG type=del 2024-09-12T17:47:03.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.935+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=LZR14SK283S7 type=del size=213908 2024-09-12T17:47:03.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.939+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~48QXJ00FP7A9.0 size=1048576 2024-09-12T17:47:03.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.943+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~48QXJ00FP7A9.1 size=1048576 2024-09-12T17:47:03.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.943+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~48QXJ00FP7A9.2 size=727372 2024-09-12T17:47:03.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.951+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=48QXJ00FP7A9 tag=LJ8GGBWISPR3 type=write size=3873100 2024-09-12T17:47:03.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.955+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~DOJZQQ1H21B5.0 size=1048576 2024-09-12T17:47:03.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.955+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~DOJZQQ1H21B5.1 size=1048576 2024-09-12T17:47:03.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.959+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~DOJZQQ1H21B5.2 size=502333 2024-09-12T17:47:03.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.959+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=DOJZQQ1H21B5 tag=RP2F0Y9OQRI4 type=write size=3648061 2024-09-12T17:47:03.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.963+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=4P20FXKTL47L type=del 2024-09-12T17:47:03.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.963+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=4DJE1HQ6EBUA type=del size=587915 2024-09-12T17:47:03.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.971+0000 7f68bc0598c0 1 < suggested remove operation key=OG0V0I1SDHG5 tag=VEAHNGJAXIBD type=write 2024-09-12T17:47:03.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.971+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=S526GDML2WTO type=del size=3160198 2024-09-12T17:47:03.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.975+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~9MYJF0J0RHI5.0 size=475388 2024-09-12T17:47:03.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.979+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=9MYJF0J0RHI5 tag=2G1TSSUEGSML type=write size=1523964 2024-09-12T17:47:03.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.979+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=TLZPMOE6OS9U type=del size=1816876 2024-09-12T17:47:03.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.983+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~HUGWMDAM6FC2.0 size=1048576 2024-09-12T17:47:03.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.983+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~HUGWMDAM6FC2.1 size=401262 2024-09-12T17:47:03.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.991+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=HUGWMDAM6FC2 tag=1C1PM86GQL0T type=write size=2498414 2024-09-12T17:47:03.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.995+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~981PYH71MXNS.0 size=1048576 2024-09-12T17:47:03.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.995+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~981PYH71MXNS.1 size=1048576 2024-09-12T17:47:04.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.999+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~981PYH71MXNS.2 size=247501 2024-09-12T17:47:04.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.999+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=981PYH71MXNS tag=HM2GZNYVU2Q0 type=write size=3393229 2024-09-12T17:47:04.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:03.999+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=8NMUZAKF0DVI type=del 2024-09-12T17:47:04.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.003+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=WJPJY6JF7MO2 type=del size=1496889 2024-09-12T17:47:04.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.007+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=JBSZK0ATQRNL type=del 2024-09-12T17:47:04.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.011+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~QZF7THV87HYV.0 size=1048576 2024-09-12T17:47:04.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.015+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~QZF7THV87HYV.1 size=191337 2024-09-12T17:47:04.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.015+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=QZF7THV87HYV tag=FI6K0RII407W type=write size=2288489 2024-09-12T17:47:04.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.015+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~PZZ4KZINQ140.0 size=1048576 2024-09-12T17:47:04.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.019+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~PZZ4KZINQ140.1 size=1048576 2024-09-12T17:47:04.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.019+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~PZZ4KZINQ140.2 size=822842 2024-09-12T17:47:04.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.027+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=PZZ4KZINQ140 tag=ZTEFZHW0C02Q type=write size=3968570 2024-09-12T17:47:04.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.027+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=Z6B5D9U7WZLP type=del size=2373617 2024-09-12T17:47:04.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.031+0000 7f68bc0598c0 -1 < failed to complete operation key=OG0V0I1SDHG5 tag=MGZNOYQW9MA0 type=del size=3944602: (22) Invalid argument 2024-09-12T17:47:04.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.035+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=H7BUE3AKXLH4 type=del size=2548191 2024-09-12T17:47:04.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.035+0000 7f68bc0598c0 1 < completed write operation key=9846YLKC8P8S tag=8RD8BCQCVS7O type=write size=315105 2024-09-12T17:47:04.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.043+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~MP1KMUHCSWSG.0 size=1048576 2024-09-12T17:47:04.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.043+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~MP1KMUHCSWSG.1 size=1048576 2024-09-12T17:47:04.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.047+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~MP1KMUHCSWSG.2 size=405186 2024-09-12T17:47:04.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.047+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=MP1KMUHCSWSG tag=6Y8SDS7DGU7O type=write size=3550914 2024-09-12T17:47:04.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.047+0000 7f68bc0598c0 1 < canceled operation key=F4F4P4L8K5D9 tag=51020VY42OCO type=del size=2482757 2024-09-12T17:47:04.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.051+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=OZ0XH9J67ZLI type=del size=3086308 2024-09-12T17:47:04.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.055+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~CEGYGV21EHZ1.0 size=1048576 2024-09-12T17:47:04.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.055+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~CEGYGV21EHZ1.1 size=1048576 2024-09-12T17:47:04.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.059+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~CEGYGV21EHZ1.2 size=966001 2024-09-12T17:47:04.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.063+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=CEGYGV21EHZ1 tag=KFAZGLP238CA type=write size=4111729 2024-09-12T17:47:04.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.067+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=PY3VGF9VB9FT type=write size=252659 2024-09-12T17:47:04.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.067+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=MQKCCNRQJ1P7 type=del 2024-09-12T17:47:04.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.075+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~LVRNA4O23UX1.0 size=279450 2024-09-12T17:47:04.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.075+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=LVRNA4O23UX1 tag=B0ACEGLYEZAG type=write size=1328026 2024-09-12T17:47:04.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.075+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~DJ21RODJV8DE.0 size=1048576 2024-09-12T17:47:04.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.079+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~DJ21RODJV8DE.1 size=1048576 2024-09-12T17:47:04.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.079+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~DJ21RODJV8DE.2 size=578241 2024-09-12T17:47:04.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.087+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=DJ21RODJV8DE tag=1NCWI90B0YMD type=write size=3723969 2024-09-12T17:47:04.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.087+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=8CZTOJS6TEWE type=del size=706245 2024-09-12T17:47:04.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.091+0000 7f68bc0598c0 1 < completed write operation key=4R9ENKMRB1GT tag=VX2I85O91PW1 type=write size=228967 2024-09-12T17:47:04.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.095+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=6QREBM46OQ2D type=write size=727105 2024-09-12T17:47:04.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.099+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=LZR14SK283S7 type=del 2024-09-12T17:47:04.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.099+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=PZ1M509CST0K type=del size=1923364 2024-09-12T17:47:04.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.099+0000 7f68bc0598c0 1 < canceled part key=_multipart_DMJZUQJ7IY60.2~DOJZQQ1H21B5.0 size=1048576 2024-09-12T17:47:04.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.103+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~DOJZQQ1H21B5.1 size=1048576 2024-09-12T17:47:04.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.107+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~DOJZQQ1H21B5.2 size=502333 2024-09-12T17:47:04.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.111+0000 7f68bc0598c0 1 < canceled multipart upload key=DMJZUQJ7IY60 upload=DOJZQQ1H21B5 tag=RP2F0Y9OQRI4 type=write size=3648061 2024-09-12T17:47:04.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.115+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=BH0IZBPMRM2E type=del size=2507027 2024-09-12T17:47:04.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.119+0000 7f68bc0598c0 1 < suggested remove operation key=NLPTU26RO70S tag=4DJE1HQ6EBUA type=del 2024-09-12T17:47:04.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.123+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=7DCP56NFL1QW type=write size=80212 2024-09-12T17:47:04.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.123+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=S526GDML2WTO type=del 2024-09-12T17:47:04.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.131+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~24248ROFF7MY.0 size=1048576 2024-09-12T17:47:04.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.131+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~24248ROFF7MY.1 size=962252 2024-09-12T17:47:04.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.131+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=24248ROFF7MY tag=GIQ53LD0HWG7 type=write size=3059404 2024-09-12T17:47:04.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.135+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=TLZPMOE6OS9U type=del 2024-09-12T17:47:04.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.139+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=T2WAY479YMO0 type=write size=508653 2024-09-12T17:47:04.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.139+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~981PYH71MXNS.0 size=1048576 2024-09-12T17:47:04.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.143+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~981PYH71MXNS.1 size=1048576 2024-09-12T17:47:04.149 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.143+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~981PYH71MXNS.2 size=247501 2024-09-12T17:47:04.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.151+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=981PYH71MXNS tag=HM2GZNYVU2Q0 type=write size=3393229 2024-09-12T17:47:04.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.151+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=N3BJGFTVT4RG type=del size=3134270 2024-09-12T17:47:04.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.155+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=WJPJY6JF7MO2 type=del 2024-09-12T17:47:04.163 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.159+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=72D4VN698163 type=write size=692610 2024-09-12T17:47:04.166 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.163+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~QZF7THV87HYV.0 size=1048576 2024-09-12T17:47:04.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.163+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~QZF7THV87HYV.1 size=191337 2024-09-12T17:47:04.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.171+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=QZF7THV87HYV tag=FI6K0RII407W type=write size=2288489 2024-09-12T17:47:04.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.171+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=V1HCZPO83HZR type=del size=574314 2024-09-12T17:47:04.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.175+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=Z6B5D9U7WZLP type=del 2024-09-12T17:47:04.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.179+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=T2GG7YCSLQUX type=del size=3337753 2024-09-12T17:47:04.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.179+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=H7BUE3AKXLH4 type=del 2024-09-12T17:47:04.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.183+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=S2Q4VM56FZ8N type=del size=2597019 2024-09-12T17:47:04.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.187+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~MP1KMUHCSWSG.0 size=1048576 2024-09-12T17:47:04.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.187+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~MP1KMUHCSWSG.1 size=1048576 2024-09-12T17:47:04.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.187+0000 7f68bc0598c0 1 < canceled part key=_multipart_KW3VWTA43PBM.2~MP1KMUHCSWSG.2 size=405186 2024-09-12T17:47:04.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.191+0000 7f68bc0598c0 1 < canceled multipart upload key=KW3VWTA43PBM upload=MP1KMUHCSWSG tag=6Y8SDS7DGU7O type=write size=3550914 2024-09-12T17:47:04.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.195+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~J9S8CVD74RUM.0 size=94195 2024-09-12T17:47:04.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.195+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=J9S8CVD74RUM tag=UAWLZS2L4K76 type=write size=1142771 2024-09-12T17:47:04.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.203+0000 7f68bc0598c0 1 < suggested remove operation key=6J677S46BXS4 tag=OZ0XH9J67ZLI type=del 2024-09-12T17:47:04.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.207+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=8WLSURKBZ9I7 type=del size=4175526 2024-09-12T17:47:04.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.207+0000 7f68bc0598c0 1 < canceled operation key=DMJZUQJ7IY60 tag=PY3VGF9VB9FT type=write size=252659 2024-09-12T17:47:04.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.211+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=37VZFS5TXZ53 type=del size=929556 2024-09-12T17:47:04.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.211+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~LVRNA4O23UX1.0 size=279450 2024-09-12T17:47:04.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.215+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=LVRNA4O23UX1 tag=B0ACEGLYEZAG type=write size=1328026 2024-09-12T17:47:04.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.219+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~I66HV6S203K8.0 size=201699 2024-09-12T17:47:04.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.219+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=I66HV6S203K8 tag=0HROIVMHX72Y type=write size=1250275 2024-09-12T17:47:04.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.223+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=8CZTOJS6TEWE type=del size=706245 2024-09-12T17:47:04.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.227+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=WO994KVN452X type=del size=2290418 2024-09-12T17:47:04.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.231+0000 7f68bc0598c0 -1 < failed to complete operation key=W8JEQ5NOIE6O tag=6QREBM46OQ2D type=write size=727105: (22) Invalid argument 2024-09-12T17:47:04.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.231+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=S1A2C1CW85DO type=del size=3798889 2024-09-12T17:47:04.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.235+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=PZ1M509CST0K type=del 2024-09-12T17:47:04.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.235+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=TZ9GXGVQUCTK type=del size=2932268 2024-09-12T17:47:04.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.239+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=BH0IZBPMRM2E type=del 2024-09-12T17:47:04.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.243+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=MHC6YBDNM90Z type=del size=1307651 2024-09-12T17:47:04.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.243+0000 7f68bc0598c0 1 < completed write operation key=9XK00RPA6Q38 tag=7DCP56NFL1QW type=write size=80212 2024-09-12T17:47:04.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.247+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=EV7CTWF2WPAQ type=del size=3839146 2024-09-12T17:47:04.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.251+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~24248ROFF7MY.0 size=1048576 2024-09-12T17:47:04.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.251+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~24248ROFF7MY.1 size=962252 2024-09-12T17:47:04.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.255+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=24248ROFF7MY tag=GIQ53LD0HWG7 type=write size=3059404 2024-09-12T17:47:04.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.259+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=QFSD300R3W9J type=del size=598530 2024-09-12T17:47:04.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.263+0000 7f68bc0598c0 1 < completed write operation key=XGJSQJ2IXJDK tag=T2WAY479YMO0 type=write size=508653 2024-09-12T17:47:04.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.267+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=BHP0KSF7NZ8R type=write size=984788 2024-09-12T17:47:04.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.267+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=N3BJGFTVT4RG type=del 2024-09-12T17:47:04.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.271+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~BSBNG1Y2K2O9.0 size=1048576 2024-09-12T17:47:04.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.275+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~BSBNG1Y2K2O9.1 size=1048576 2024-09-12T17:47:04.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.275+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~BSBNG1Y2K2O9.2 size=250691 2024-09-12T17:47:04.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.275+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=BSBNG1Y2K2O9 tag=5B5BWUIXTPZD type=write size=3396419 2024-09-12T17:47:04.284 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.279+0000 7f68bc0598c0 1 < suggested remove operation key=BKAT5SGAC5Z8 tag=72D4VN698163 type=write 2024-09-12T17:47:04.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.283+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=OVAC89IGH2ZG type=del size=3776752 2024-09-12T17:47:04.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.287+0000 7f68bc0598c0 1 < suggested remove operation key=OG0V0I1SDHG5 tag=V1HCZPO83HZR type=del 2024-09-12T17:47:04.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.295+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~FMBK009CEJH5.0 size=1048576 2024-09-12T17:47:04.300 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.295+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~FMBK009CEJH5.1 size=1032715 2024-09-12T17:47:04.300 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.295+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=FMBK009CEJH5 tag=746T1T7OP919 type=write size=3129867 2024-09-12T17:47:04.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.303+0000 7f68bc0598c0 1 < suggested update operation key=9846YLKC8P8S tag=T2GG7YCSLQUX type=del size=3337753 2024-09-12T17:47:04.309 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.307+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=S23F10M8FVXN type=write size=310125 2024-09-12T17:47:04.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.311+0000 7f68bc0598c0 1 < suggested remove operation key=9XK00RPA6Q38 tag=S2Q4VM56FZ8N type=del 2024-09-12T17:47:04.322 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.319+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~CTLVMEXJGIPG.0 size=582504 2024-09-12T17:47:04.322 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.319+0000 7f68bc0598c0 1 > prepared multipart upload key=BKAT5SGAC5Z8 upload=CTLVMEXJGIPG tag=ZB53OUS36FKL type=write size=1631080 2024-09-12T17:47:04.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.323+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~J9S8CVD74RUM.0 size=94195 2024-09-12T17:47:04.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.327+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=J9S8CVD74RUM tag=UAWLZS2L4K76 type=write size=1142771 2024-09-12T17:47:04.334 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.331+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=MSFLM8I3USD3 type=del size=1320883 2024-09-12T17:47:04.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.335+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=8WLSURKBZ9I7 type=del 2024-09-12T17:47:04.340 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.335+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=QJBMQNLS3G0L type=del size=3537798 2024-09-12T17:47:04.343 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.339+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=37VZFS5TXZ53 type=del 2024-09-12T17:47:04.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.343+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~ZD37SIZ935WD.0 size=1048576 2024-09-12T17:47:04.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.347+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~ZD37SIZ935WD.1 size=1048576 2024-09-12T17:47:04.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.351+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~ZD37SIZ935WD.2 size=804629 2024-09-12T17:47:04.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.351+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=ZD37SIZ935WD tag=QSIV51GUY22K type=write size=3950357 2024-09-12T17:47:04.356 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.351+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~I66HV6S203K8.0 size=201699 2024-09-12T17:47:04.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.359+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=I66HV6S203K8 tag=0HROIVMHX72Y type=write size=1250275 2024-09-12T17:47:04.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.363+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~F88Y00VVP02P.0 size=1048576 2024-09-12T17:47:04.369 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.363+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~F88Y00VVP02P.1 size=1048576 2024-09-12T17:47:04.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.367+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~F88Y00VVP02P.2 size=1028151 2024-09-12T17:47:04.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.367+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=F88Y00VVP02P tag=CKC5JJUYX4U0 type=write size=4173879 2024-09-12T17:47:04.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.371+0000 7f68bc0598c0 -1 < failed to complete operation key=OG0V0I1SDHG5 tag=WO994KVN452X type=del size=2290418: (22) Invalid argument 2024-09-12T17:47:04.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.371+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=3PIV66RX1V63 type=write size=819772 2024-09-12T17:47:04.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.375+0000 7f68bc0598c0 -1 < failed to complete operation key=9846YLKC8P8S tag=S1A2C1CW85DO type=del size=3798889: (22) Invalid argument 2024-09-12T17:47:04.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.379+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=5PHGVQG429MW type=del size=1690557 2024-09-12T17:47:04.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.379+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=TZ9GXGVQUCTK type=del 2024-09-12T17:47:04.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.383+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=63DK9URHGX47 type=del size=971221 2024-09-12T17:47:04.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.387+0000 7f68bc0598c0 1 < suggested update operation key=KW3VWTA43PBM tag=MHC6YBDNM90Z type=del size=1307651 2024-09-12T17:47:04.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.391+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=TXB47H0MGZKL type=del size=4174989 2024-09-12T17:47:04.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.391+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=EV7CTWF2WPAQ type=del 2024-09-12T17:47:04.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.395+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=FD7ZPO5O1PI1 type=write size=35908 2024-09-12T17:47:04.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.395+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=QFSD300R3W9J type=del 2024-09-12T17:47:04.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.399+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=8N61TM26996U type=write size=624263 2024-09-12T17:47:04.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.403+0000 7f68bc0598c0 1 < completed write operation key=NLPTU26RO70S tag=BHP0KSF7NZ8R type=write size=984788 2024-09-12T17:47:04.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.407+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~48K1QLCGOUJE.0 size=1048576 2024-09-12T17:47:04.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.407+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~48K1QLCGOUJE.1 size=915033 2024-09-12T17:47:04.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.407+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=48K1QLCGOUJE tag=OA6XAB3T3JIU type=write size=3012185 2024-09-12T17:47:04.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.411+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~BSBNG1Y2K2O9.0 size=1048576 2024-09-12T17:47:04.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.415+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~BSBNG1Y2K2O9.1 size=1048576 2024-09-12T17:47:04.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.415+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~BSBNG1Y2K2O9.2 size=250691 2024-09-12T17:47:04.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.419+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=BSBNG1Y2K2O9 tag=5B5BWUIXTPZD type=write size=3396419 2024-09-12T17:47:04.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.423+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=10R7EPARADL1 type=del size=3287572 2024-09-12T17:47:04.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.427+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=OVAC89IGH2ZG type=del 2024-09-12T17:47:04.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.427+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=6Z7PEFZDNPLG type=write size=163168 2024-09-12T17:47:04.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.431+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~FMBK009CEJH5.0 size=1048576 2024-09-12T17:47:04.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.431+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~FMBK009CEJH5.1 size=1032715 2024-09-12T17:47:04.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.435+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=FMBK009CEJH5 tag=746T1T7OP919 type=write size=3129867 2024-09-12T17:47:04.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.439+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~JXUAK7V84LF4.0 size=1048576 2024-09-12T17:47:04.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.443+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~JXUAK7V84LF4.1 size=1048576 2024-09-12T17:47:04.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.443+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~JXUAK7V84LF4.2 size=715774 2024-09-12T17:47:04.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.443+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=JXUAK7V84LF4 tag=ZA8NN3M2XNPY type=write size=3861502 2024-09-12T17:47:04.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.447+0000 7f68bc0598c0 1 < suggested remove operation key=9846YLKC8P8S tag=S23F10M8FVXN type=write 2024-09-12T17:47:04.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.451+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=IBX6ZZU9V6R9 type=del size=986170 2024-09-12T17:47:04.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.455+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~CTLVMEXJGIPG.0 size=582504 2024-09-12T17:47:04.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.459+0000 7f68bc0598c0 1 < completed multipart upload key=BKAT5SGAC5Z8 upload=CTLVMEXJGIPG tag=ZB53OUS36FKL type=write size=1631080 2024-09-12T17:47:04.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.459+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=P0ZV1FI43C9G type=del size=1188409 2024-09-12T17:47:04.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.463+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=MSFLM8I3USD3 type=del 2024-09-12T17:47:04.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.467+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=83KBVP4KIXBQ type=del size=3975251 2024-09-12T17:47:04.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.471+0000 7f68bc0598c0 1 < suggested update operation key=MRS3KW2H5AKK tag=QJBMQNLS3G0L type=del size=3537798 2024-09-12T17:47:04.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.471+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=M0ESRE37GRAN type=del size=2609071 2024-09-12T17:47:04.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.475+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~ZD37SIZ935WD.0 size=1048576 2024-09-12T17:47:04.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.479+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~ZD37SIZ935WD.1 size=1048576 2024-09-12T17:47:04.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.479+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~ZD37SIZ935WD.2 size=804629 2024-09-12T17:47:04.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.483+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=ZD37SIZ935WD tag=QSIV51GUY22K type=write size=3950357 2024-09-12T17:47:04.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.487+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=ZFGUOEGYWZA1 type=del size=2072048 2024-09-12T17:47:04.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.487+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~F88Y00VVP02P.0 size=1048576 2024-09-12T17:47:04.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.491+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~F88Y00VVP02P.1 size=1048576 2024-09-12T17:47:04.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.491+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~F88Y00VVP02P.2 size=1028151 2024-09-12T17:47:04.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.495+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=F88Y00VVP02P tag=CKC5JJUYX4U0 type=write size=4173879 2024-09-12T17:47:04.503 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.499+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~8Q33RGIM71QQ.0 size=638523 2024-09-12T17:47:04.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.499+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=8Q33RGIM71QQ tag=12HU1QBZL854 type=write size=1687099 2024-09-12T17:47:04.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.503+0000 7f68bc0598c0 1 < suggested update operation key=MRS3KW2H5AKK tag=3PIV66RX1V63 type=write size=819772 2024-09-12T17:47:04.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.507+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~WE0JJCEOZZ5H.0 size=486587 2024-09-12T17:47:04.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.507+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=WE0JJCEOZZ5H tag=ZC7MVU2ERMJ4 type=write size=1535163 2024-09-12T17:47:04.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.511+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=5PHGVQG429MW type=del 2024-09-12T17:47:04.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.515+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~5FY1U1KRM34X.0 size=617610 2024-09-12T17:47:04.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.515+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=5FY1U1KRM34X tag=KODP8REPOYCK type=write size=1666186 2024-09-12T17:47:04.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.515+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=63DK9URHGX47 type=del 2024-09-12T17:47:04.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.519+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=4WXYOHOOS50V type=del size=1336117 2024-09-12T17:47:04.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.523+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=TXB47H0MGZKL type=del 2024-09-12T17:47:04.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.523+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=TFTMXAAYC6HL type=del size=4060982 2024-09-12T17:47:04.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.527+0000 7f68bc0598c0 -1 < failed to complete operation key=9846YLKC8P8S tag=FD7ZPO5O1PI1 type=write size=35908: (22) Invalid argument 2024-09-12T17:47:04.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.527+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=BN8LLG4MZ3CV type=del size=2591889 2024-09-12T17:47:04.535 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.531+0000 7f68bc0598c0 1 < completed write operation key=3JPRQXKB5K3W tag=8N61TM26996U type=write size=624263 2024-09-12T17:47:04.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.535+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=3DLW29RH82NF type=del size=199618 2024-09-12T17:47:04.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.535+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~48K1QLCGOUJE.0 size=1048576 2024-09-12T17:47:04.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.539+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~48K1QLCGOUJE.1 size=915033 2024-09-12T17:47:04.545 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.543+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=48K1QLCGOUJE tag=OA6XAB3T3JIU type=write size=3012185 2024-09-12T17:47:04.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.543+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=GIT5S8Y48S1A type=write size=137191 2024-09-12T17:47:04.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.547+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=10R7EPARADL1 type=del 2024-09-12T17:47:04.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.551+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~CL0HREUA7ZGX.0 size=591156 2024-09-12T17:47:04.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.551+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=CL0HREUA7ZGX tag=B66JLPSYIDK4 type=write size=1639732 2024-09-12T17:47:04.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.551+0000 7f68bc0598c0 -1 < failed to complete operation key=MRS3KW2H5AKK tag=6Z7PEFZDNPLG type=write size=163168: (22) Invalid argument 2024-09-12T17:47:04.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.555+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=V671V0XKVKYF type=del size=3032026 2024-09-12T17:47:04.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.555+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~JXUAK7V84LF4.0 size=1048576 2024-09-12T17:47:04.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.559+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~JXUAK7V84LF4.1 size=1048576 2024-09-12T17:47:04.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.559+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~JXUAK7V84LF4.2 size=715774 2024-09-12T17:47:04.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.563+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=JXUAK7V84LF4 tag=ZA8NN3M2XNPY type=write size=3861502 2024-09-12T17:47:04.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.567+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~I9R87L2YLYLB.0 size=1048576 2024-09-12T17:47:04.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.571+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~I9R87L2YLYLB.1 size=1048576 2024-09-12T17:47:04.575 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.571+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~I9R87L2YLYLB.2 size=216012 2024-09-12T17:47:04.575 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.571+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=I9R87L2YLYLB tag=ZDL11PKJRL8A type=write size=3361740 2024-09-12T17:47:04.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.575+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=IBX6ZZU9V6R9 type=del 2024-09-12T17:47:04.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.579+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~VJGUEJQ22VGV.0 size=1048576 2024-09-12T17:47:04.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.579+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~VJGUEJQ22VGV.1 size=686201 2024-09-12T17:47:04.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.579+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=VJGUEJQ22VGV tag=WWVKUMGJEP1J type=write size=2783353 2024-09-12T17:47:04.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.583+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=P0ZV1FI43C9G type=del 2024-09-12T17:47:04.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.587+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=HXHAG3NQRVP6 type=del size=3703751 2024-09-12T17:47:04.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.587+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=83KBVP4KIXBQ type=del 2024-09-12T17:47:04.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.591+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~JVYQ3OAK1NSO.0 size=1048576 2024-09-12T17:47:04.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.595+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~JVYQ3OAK1NSO.1 size=334000 2024-09-12T17:47:04.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.595+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=JVYQ3OAK1NSO tag=47C2BMFS38B0 type=write size=2431152 2024-09-12T17:47:04.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.595+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=M0ESRE37GRAN type=del 2024-09-12T17:47:04.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.599+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=1MM310YC4Y12 type=del size=4160921 2024-09-12T17:47:04.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.599+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=ZFGUOEGYWZA1 type=del 2024-09-12T17:47:04.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~J68FZBISJXQ0.0 size=1048576 2024-09-12T17:47:04.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~J68FZBISJXQ0.1 size=148156 2024-09-12T17:47:04.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.607+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=J68FZBISJXQ0 tag=B4SLIPOFG0OP type=write size=2245308 2024-09-12T17:47:04.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.611+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~8Q33RGIM71QQ.0 size=638523 2024-09-12T17:47:04.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.611+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=8Q33RGIM71QQ tag=12HU1QBZL854 type=write size=1687099 2024-09-12T17:47:04.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.615+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=JOYYJ5Z2EQS2 type=del size=2325345 2024-09-12T17:47:04.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.619+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~WE0JJCEOZZ5H.0 size=486587 2024-09-12T17:47:04.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.623+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=WE0JJCEOZZ5H tag=ZC7MVU2ERMJ4 type=write size=1535163 2024-09-12T17:47:04.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.623+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=M24NDCMXJE4N type=del size=4040265 2024-09-12T17:47:04.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.627+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~5FY1U1KRM34X.0 size=617610 2024-09-12T17:47:04.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.631+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=5FY1U1KRM34X tag=KODP8REPOYCK type=write size=1666186 2024-09-12T17:47:04.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.635+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~37KITJW3QEOK.0 size=1048576 2024-09-12T17:47:04.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.635+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~37KITJW3QEOK.1 size=982320 2024-09-12T17:47:04.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.635+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=37KITJW3QEOK tag=AZPO0JA5MMIE type=write size=3079472 2024-09-12T17:47:04.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.639+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=4WXYOHOOS50V type=del 2024-09-12T17:47:04.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.639+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=6RV971KFL5WP type=del size=3311872 2024-09-12T17:47:04.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.643+0000 7f68bc0598c0 1 < canceled operation key=BKAT5SGAC5Z8 tag=TFTMXAAYC6HL type=del size=4060982 2024-09-12T17:47:04.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.647+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~ZFGB0K3Y6CGV.0 size=717878 2024-09-12T17:47:04.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.647+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=ZFGB0K3Y6CGV tag=B4DIJEY9JQ5D type=write size=1766454 2024-09-12T17:47:04.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.647+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=BN8LLG4MZ3CV type=del 2024-09-12T17:47:04.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.651+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=WAAW3YFSHKO5 type=del size=3375306 2024-09-12T17:47:04.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.651+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=3DLW29RH82NF type=del 2024-09-12T17:47:04.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.655+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=PHACCHQOD0BK type=del size=2564208 2024-09-12T17:47:04.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.659+0000 7f68bc0598c0 1 < completed write operation key=6SUA9FBDU69A tag=GIT5S8Y48S1A type=write size=137191 2024-09-12T17:47:04.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.659+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=UKVE0BUWGCXE type=del size=3063472 2024-09-12T17:47:04.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.663+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~CL0HREUA7ZGX.0 size=591156 2024-09-12T17:47:04.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.667+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=CL0HREUA7ZGX tag=B66JLPSYIDK4 type=write size=1639732 2024-09-12T17:47:04.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.671+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~DO5FAB64BAON.0 size=1048576 2024-09-12T17:47:04.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.675+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~DO5FAB64BAON.1 size=1048576 2024-09-12T17:47:04.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.675+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~DO5FAB64BAON.2 size=651528 2024-09-12T17:47:04.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.675+0000 7f68bc0598c0 1 > prepared multipart upload key=2129SG6US3LI upload=DO5FAB64BAON tag=N9FUXGIGHT5Y type=write size=3797256 2024-09-12T17:47:04.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.679+0000 7f68bc0598c0 1 < suggested remove operation key=FC3K0QN3TAWH tag=V671V0XKVKYF type=del 2024-09-12T17:47:04.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.683+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~3QBH6GWH0RKM.0 size=1048576 2024-09-12T17:47:04.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.687+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~3QBH6GWH0RKM.1 size=326091 2024-09-12T17:47:04.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.687+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=3QBH6GWH0RKM tag=Z0XSGGW32ZZ9 type=write size=2423243 2024-09-12T17:47:04.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.687+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~I9R87L2YLYLB.0 size=1048576 2024-09-12T17:47:04.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.691+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~I9R87L2YLYLB.1 size=1048576 2024-09-12T17:47:04.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.691+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~I9R87L2YLYLB.2 size=216012 2024-09-12T17:47:04.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.695+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=I9R87L2YLYLB tag=ZDL11PKJRL8A type=write size=3361740 2024-09-12T17:47:04.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.699+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=QSO9Z1Y46JCL type=write size=893735 2024-09-12T17:47:04.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.703+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~VJGUEJQ22VGV.0 size=1048576 2024-09-12T17:47:04.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.703+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~VJGUEJQ22VGV.1 size=686201 2024-09-12T17:47:04.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.711+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=VJGUEJQ22VGV tag=WWVKUMGJEP1J type=write size=2783353 2024-09-12T17:47:04.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.715+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~S3OGLAM9L2F9.0 size=1048576 2024-09-12T17:47:04.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.715+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~S3OGLAM9L2F9.1 size=143722 2024-09-12T17:47:04.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.715+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=S3OGLAM9L2F9 tag=O1KETRYIKPG4 type=write size=2240874 2024-09-12T17:47:04.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.719+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=HXHAG3NQRVP6 type=del 2024-09-12T17:47:04.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.723+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=0J0NAU2W9QQS type=write size=324749 2024-09-12T17:47:04.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.723+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~JVYQ3OAK1NSO.0 size=1048576 2024-09-12T17:47:04.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.727+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~JVYQ3OAK1NSO.1 size=334000 2024-09-12T17:47:04.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.731+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=JVYQ3OAK1NSO tag=47C2BMFS38B0 type=write size=2431152 2024-09-12T17:47:04.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.735+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~4WOZL455XQTT.0 size=523614 2024-09-12T17:47:04.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.735+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=4WOZL455XQTT tag=WMTLALIS2B90 type=write size=1572190 2024-09-12T17:47:04.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.735+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=1MM310YC4Y12 type=del 2024-09-12T17:47:04.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.739+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=HXSZNMB7ZGGM type=del size=3982123 2024-09-12T17:47:04.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.739+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~J68FZBISJXQ0.0 size=1048576 2024-09-12T17:47:04.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.743+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~J68FZBISJXQ0.1 size=148156 2024-09-12T17:47:04.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.747+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=J68FZBISJXQ0 tag=B4SLIPOFG0OP type=write size=2245308 2024-09-12T17:47:04.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.747+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=FUYMSEDR0YYA type=del size=13727 2024-09-12T17:47:04.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.751+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=JOYYJ5Z2EQS2 type=del 2024-09-12T17:47:04.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.755+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=6OI2IDJU9V4H type=write size=14443 2024-09-12T17:47:04.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.755+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=M24NDCMXJE4N type=del 2024-09-12T17:47:04.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.759+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~69KJDVO9X2FK.0 size=1048576 2024-09-12T17:47:04.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.763+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~69KJDVO9X2FK.1 size=1048576 2024-09-12T17:47:04.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.763+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~69KJDVO9X2FK.2 size=316594 2024-09-12T17:47:04.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.763+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=69KJDVO9X2FK tag=6P2HQ9EMAK8P type=write size=3462322 2024-09-12T17:47:04.771 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.767+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~37KITJW3QEOK.0 size=1048576 2024-09-12T17:47:04.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.767+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~37KITJW3QEOK.1 size=982320 2024-09-12T17:47:04.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.771+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=37KITJW3QEOK tag=AZPO0JA5MMIE type=write size=3079472 2024-09-12T17:47:04.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.775+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=XN18V58L8BHQ type=write size=608983 2024-09-12T17:47:04.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.779+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=6RV971KFL5WP type=del 2024-09-12T17:47:04.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.779+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=KQRHY0IVOE4E type=del size=4130642 2024-09-12T17:47:04.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.783+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~ZFGB0K3Y6CGV.0 size=717878 2024-09-12T17:47:04.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.787+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=ZFGB0K3Y6CGV tag=B4DIJEY9JQ5D type=write size=1766454 2024-09-12T17:47:04.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.791+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~KDEIA2WCHK9U.0 size=1048576 2024-09-12T17:47:04.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.791+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~KDEIA2WCHK9U.1 size=496328 2024-09-12T17:47:04.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.791+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=KDEIA2WCHK9U tag=PLJ4IJMRDQOJ type=write size=2593480 2024-09-12T17:47:04.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.795+0000 7f68bc0598c0 1 < canceled operation key=UMQLPH9XGWRZ tag=WAAW3YFSHKO5 type=del size=3375306 2024-09-12T17:47:04.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.799+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~IBCA5GMY29HJ.0 size=1048576 2024-09-12T17:47:04.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.799+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~IBCA5GMY29HJ.1 size=955570 2024-09-12T17:47:04.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.799+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=IBCA5GMY29HJ tag=26SU8I5P6ERG type=write size=3052722 2024-09-12T17:47:04.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.803+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=PHACCHQOD0BK type=del 2024-09-12T17:47:04.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.807+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=8W3Z77VNLPXH type=write size=810363 2024-09-12T17:47:04.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.807+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=UKVE0BUWGCXE type=del 2024-09-12T17:47:04.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.811+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=A269KKVVUX21 type=del size=896990 2024-09-12T17:47:04.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.811+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~DO5FAB64BAON.0 size=1048576 2024-09-12T17:47:04.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.815+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~DO5FAB64BAON.1 size=1048576 2024-09-12T17:47:04.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.815+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~DO5FAB64BAON.2 size=651528 2024-09-12T17:47:04.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.819+0000 7f68bc0598c0 1 < completed multipart upload key=2129SG6US3LI upload=DO5FAB64BAON tag=N9FUXGIGHT5Y type=write size=3797256 2024-09-12T17:47:04.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.823+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=5EVPPT71J85O type=del size=2031447 2024-09-12T17:47:04.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.823+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~3QBH6GWH0RKM.0 size=1048576 2024-09-12T17:47:04.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.827+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~3QBH6GWH0RKM.1 size=326091 2024-09-12T17:47:04.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.831+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=3QBH6GWH0RKM tag=Z0XSGGW32ZZ9 type=write size=2423243 2024-09-12T17:47:04.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.831+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~2MW1C2T6ZDNY.0 size=1048576 2024-09-12T17:47:04.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~2MW1C2T6ZDNY.1 size=1048576 2024-09-12T17:47:04.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~2MW1C2T6ZDNY.2 size=962687 2024-09-12T17:47:04.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.835+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=2MW1C2T6ZDNY tag=034JO0T6XBUB type=write size=4108415 2024-09-12T17:47:04.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.839+0000 7f68bc0598c0 1 < completed write operation key=6J677S46BXS4 tag=QSO9Z1Y46JCL type=write size=893735 2024-09-12T17:47:04.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.843+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~DQLFP6UKOJCL.0 size=771158 2024-09-12T17:47:04.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.843+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=DQLFP6UKOJCL tag=B9B3DZMRX4H2 type=write size=1819734 2024-09-12T17:47:04.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.847+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~S3OGLAM9L2F9.0 size=1048576 2024-09-12T17:47:04.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.847+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~S3OGLAM9L2F9.1 size=143722 2024-09-12T17:47:04.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.851+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=S3OGLAM9L2F9 tag=O1KETRYIKPG4 type=write size=2240874 2024-09-12T17:47:04.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.855+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=T7QV72NHYWEO type=write size=25483 2024-09-12T17:47:04.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.855+0000 7f68bc0598c0 1 < completed write operation key=4R9ENKMRB1GT tag=0J0NAU2W9QQS type=write size=324749 2024-09-12T17:47:04.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.859+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=WCV02R9S3GMZ type=del size=1297821 2024-09-12T17:47:04.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.859+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~4WOZL455XQTT.0 size=523614 2024-09-12T17:47:04.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.863+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=4WOZL455XQTT tag=WMTLALIS2B90 type=write size=1572190 2024-09-12T17:47:04.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.867+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=0EVJY65J51L2 type=del size=1228589 2024-09-12T17:47:04.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.867+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=HXSZNMB7ZGGM type=del 2024-09-12T17:47:04.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.871+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=63LKQQGE5A9S type=del size=765964 2024-09-12T17:47:04.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.875+0000 7f68bc0598c0 1 < suggested remove operation key=2129SG6US3LI tag=FUYMSEDR0YYA type=del 2024-09-12T17:47:04.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.879+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~LCJH8XF06IGC.0 size=277245 2024-09-12T17:47:04.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.879+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=LCJH8XF06IGC tag=3MYC28NBYCTN type=write size=1325821 2024-09-12T17:47:04.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.887+0000 7f68bc0598c0 1 < completed write operation key=DMJZUQJ7IY60 tag=6OI2IDJU9V4H type=write size=14443 2024-09-12T17:47:04.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.887+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=U5MUPG6M4MHV type=del size=2105837 2024-09-12T17:47:04.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.891+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~69KJDVO9X2FK.0 size=1048576 2024-09-12T17:47:04.896 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.891+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~69KJDVO9X2FK.1 size=1048576 2024-09-12T17:47:04.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.895+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~69KJDVO9X2FK.2 size=316594 2024-09-12T17:47:04.902 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.899+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=69KJDVO9X2FK tag=6P2HQ9EMAK8P type=write size=3462322 2024-09-12T17:47:04.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.899+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=ORSZ8U6JVFVJ type=del size=3230614 2024-09-12T17:47:04.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.907+0000 7f68bc0598c0 1 < suggested update operation key=MRS3KW2H5AKK tag=XN18V58L8BHQ type=write size=608983 2024-09-12T17:47:04.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.907+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=3RQ8LL1RPXSA type=write size=567614 2024-09-12T17:47:04.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.911+0000 7f68bc0598c0 1 < canceled operation key=NLPTU26RO70S tag=KQRHY0IVOE4E type=del size=4130642 2024-09-12T17:47:04.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.915+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=2B3QG6UPPUY0 type=del size=2399307 2024-09-12T17:47:04.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.915+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~KDEIA2WCHK9U.0 size=1048576 2024-09-12T17:47:04.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.919+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~KDEIA2WCHK9U.1 size=496328 2024-09-12T17:47:04.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.923+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=KDEIA2WCHK9U tag=PLJ4IJMRDQOJ type=write size=2593480 2024-09-12T17:47:04.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.927+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~8B1GXKOZ91O1.0 size=1048576 2024-09-12T17:47:04.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.931+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~8B1GXKOZ91O1.1 size=1048576 2024-09-12T17:47:04.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.935+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~8B1GXKOZ91O1.2 size=5105 2024-09-12T17:47:04.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.935+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=8B1GXKOZ91O1 tag=E9BP13RJ3A31 type=write size=3150833 2024-09-12T17:47:04.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.935+0000 7f68bc0598c0 1 < canceled part key=_multipart_HGY9WK7MKCYS.2~IBCA5GMY29HJ.0 size=1048576 2024-09-12T17:47:04.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.939+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~IBCA5GMY29HJ.1 size=955570 2024-09-12T17:47:04.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.943+0000 7f68bc0598c0 1 < canceled multipart upload key=HGY9WK7MKCYS upload=IBCA5GMY29HJ tag=26SU8I5P6ERG type=write size=3052722 2024-09-12T17:47:04.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.943+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=WOTLNBPQHZY2 type=del size=1968077 2024-09-12T17:47:04.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.947+0000 7f68bc0598c0 1 < completed write operation key=DMJZUQJ7IY60 tag=8W3Z77VNLPXH type=write size=810363 2024-09-12T17:47:04.956 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.951+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~MS6I3YNKL66G.0 size=302969 2024-09-12T17:47:04.956 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.951+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=MS6I3YNKL66G tag=OZXDDKYRHDNP type=write size=1351545 2024-09-12T17:47:04.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.959+0000 7f68bc0598c0 1 < suggested update operation key=KW3VWTA43PBM tag=A269KKVVUX21 type=del size=896990 2024-09-12T17:47:04.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.963+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~UUIHXCW673VE.0 size=1048576 2024-09-12T17:47:04.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.967+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~UUIHXCW673VE.1 size=1016599 2024-09-12T17:47:04.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.967+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=UUIHXCW673VE tag=7DAIH79YJABY type=write size=3113751 2024-09-12T17:47:04.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.967+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=5EVPPT71J85O type=del 2024-09-12T17:47:04.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.975+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~IE8JAC737TP9.0 size=1048576 2024-09-12T17:47:04.980 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.975+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~IE8JAC737TP9.1 size=1048576 2024-09-12T17:47:04.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.979+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~IE8JAC737TP9.2 size=506500 2024-09-12T17:47:04.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.979+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=IE8JAC737TP9 tag=4FQOM3YOUKWJ type=write size=3652228 2024-09-12T17:47:04.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.983+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~2MW1C2T6ZDNY.0 size=1048576 2024-09-12T17:47:04.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.983+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~2MW1C2T6ZDNY.1 size=1048576 2024-09-12T17:47:04.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.987+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~2MW1C2T6ZDNY.2 size=962687 2024-09-12T17:47:04.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.991+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=2MW1C2T6ZDNY tag=034JO0T6XBUB type=write size=4108415 2024-09-12T17:47:04.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.995+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=VNFQGASHS92A type=write size=631414 2024-09-12T17:47:05.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:04.999+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~DQLFP6UKOJCL.0 size=771158 2024-09-12T17:47:05.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.003+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=DQLFP6UKOJCL tag=B9B3DZMRX4H2 type=write size=1819734 2024-09-12T17:47:05.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.007+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~KP1BRMQATXAK.0 size=494734 2024-09-12T17:47:05.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.007+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=KP1BRMQATXAK tag=UOF0F885LJ30 type=write size=1543310 2024-09-12T17:47:05.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.011+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=T7QV72NHYWEO type=write size=25483 2024-09-12T17:47:05.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.015+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=18C09GOZ668H type=del size=3290678 2024-09-12T17:47:05.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.019+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=WCV02R9S3GMZ type=del 2024-09-12T17:47:05.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.023+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~3EZ4LG7FI0N6.0 size=1048576 2024-09-12T17:47:05.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.023+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~3EZ4LG7FI0N6.1 size=466295 2024-09-12T17:47:05.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.023+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=3EZ4LG7FI0N6 tag=65V1B166QGYW type=write size=2563447 2024-09-12T17:47:05.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.027+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=0EVJY65J51L2 type=del 2024-09-12T17:47:05.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.031+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=3GU02K5IP4H8 type=del size=2439474 2024-09-12T17:47:05.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.035+0000 7f68bc0598c0 1 < suggested update operation key=MRS3KW2H5AKK tag=63LKQQGE5A9S type=del size=765964 2024-09-12T17:47:05.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.039+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=RIFPR0TACMGY type=del size=756071 2024-09-12T17:47:05.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.039+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~LCJH8XF06IGC.0 size=277245 2024-09-12T17:47:05.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.043+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=LCJH8XF06IGC tag=3MYC28NBYCTN type=write size=1325821 2024-09-12T17:47:05.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.051+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~3VA0MADAQYG2.0 size=1048576 2024-09-12T17:47:05.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.051+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~3VA0MADAQYG2.1 size=1048576 2024-09-12T17:47:05.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~3VA0MADAQYG2.2 size=590879 2024-09-12T17:47:05.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.055+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=3VA0MADAQYG2 tag=8DOB0K0I3L29 type=write size=3736607 2024-09-12T17:47:05.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.055+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=U5MUPG6M4MHV type=del 2024-09-12T17:47:05.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.059+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=POO6VGFKC43W type=del size=3818142 2024-09-12T17:47:05.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.063+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=ORSZ8U6JVFVJ type=del 2024-09-12T17:47:05.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.063+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=QF4SEHRIXK36 type=del size=1638782 2024-09-12T17:47:05.071 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.067+0000 7f68bc0598c0 1 < completed write operation key=WUGDIFCHNL90 tag=3RQ8LL1RPXSA type=write size=567614 2024-09-12T17:47:05.074 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.071+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=20AM98AZR61T type=del size=630057 2024-09-12T17:47:05.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.075+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=2B3QG6UPPUY0 type=del 2024-09-12T17:47:05.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.075+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=WANBYW1RWSF7 type=del size=618348 2024-09-12T17:47:05.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.079+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~8B1GXKOZ91O1.0 size=1048576 2024-09-12T17:47:05.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.083+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~8B1GXKOZ91O1.1 size=1048576 2024-09-12T17:47:05.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.083+0000 7f68bc0598c0 1 < canceled part key=_multipart_S0B1RP89NO44.2~8B1GXKOZ91O1.2 size=5105 2024-09-12T17:47:05.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.087+0000 7f68bc0598c0 1 < canceled multipart upload key=S0B1RP89NO44 upload=8B1GXKOZ91O1 tag=E9BP13RJ3A31 type=write size=3150833 2024-09-12T17:47:05.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.087+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=ESOBHZOKAIMU type=del size=731407 2024-09-12T17:47:05.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.091+0000 7f68bc0598c0 1 < canceled operation key=9846YLKC8P8S tag=WOTLNBPQHZY2 type=del size=1968077 2024-09-12T17:47:05.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.095+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=5NDI7NQTCA7A type=write size=113483 2024-09-12T17:47:05.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.099+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~MS6I3YNKL66G.0 size=302969 2024-09-12T17:47:05.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.103+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=MS6I3YNKL66G tag=OZXDDKYRHDNP type=write size=1351545 2024-09-12T17:47:05.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.107+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=OKC7UHN9I8F1 type=write size=369876 2024-09-12T17:47:05.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.107+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~UUIHXCW673VE.0 size=1048576 2024-09-12T17:47:05.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.111+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~UUIHXCW673VE.1 size=1016599 2024-09-12T17:47:05.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.115+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=UUIHXCW673VE tag=7DAIH79YJABY type=write size=3113751 2024-09-12T17:47:05.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.119+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=MEM6FP8LQ064 type=del size=463493 2024-09-12T17:47:05.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.123+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~IE8JAC737TP9.0 size=1048576 2024-09-12T17:47:05.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.123+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~IE8JAC737TP9.1 size=1048576 2024-09-12T17:47:05.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.127+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~IE8JAC737TP9.2 size=506500 2024-09-12T17:47:05.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.131+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=IE8JAC737TP9 tag=4FQOM3YOUKWJ type=write size=3652228 2024-09-12T17:47:05.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.139+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~B4D1607LUZ86.0 size=1048576 2024-09-12T17:47:05.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.139+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~B4D1607LUZ86.1 size=510111 2024-09-12T17:47:05.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.139+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=B4D1607LUZ86 tag=3G3GZ1UAEC1A type=write size=2607263 2024-09-12T17:47:05.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.147+0000 7f68bc0598c0 1 < suggested update operation key=FC3K0QN3TAWH tag=VNFQGASHS92A type=write size=631414 2024-09-12T17:47:05.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.155+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~ZNO5BPQ77K7D.0 size=1048576 2024-09-12T17:47:05.161 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.159+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~ZNO5BPQ77K7D.1 size=1048576 2024-09-12T17:47:05.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.159+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~ZNO5BPQ77K7D.2 size=1008988 2024-09-12T17:47:05.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.159+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=ZNO5BPQ77K7D tag=QH4TXUSQM8TY type=write size=4154716 2024-09-12T17:47:05.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.163+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~KP1BRMQATXAK.0 size=494734 2024-09-12T17:47:05.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.167+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=KP1BRMQATXAK tag=UOF0F885LJ30 type=write size=1543310 2024-09-12T17:47:05.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.171+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=3L8KQ02CMW9J type=del size=1824192 2024-09-12T17:47:05.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.175+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=18C09GOZ668H type=del 2024-09-12T17:47:05.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.179+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~A9IGD7ASI0F3.0 size=1048576 2024-09-12T17:47:05.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.183+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~A9IGD7ASI0F3.1 size=692394 2024-09-12T17:47:05.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.183+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=A9IGD7ASI0F3 tag=D9CG7NQCGCOJ type=write size=2789546 2024-09-12T17:47:05.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.183+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~3EZ4LG7FI0N6.0 size=1048576 2024-09-12T17:47:05.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.187+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~3EZ4LG7FI0N6.1 size=466295 2024-09-12T17:47:05.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.191+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=3EZ4LG7FI0N6 tag=65V1B166QGYW type=write size=2563447 2024-09-12T17:47:05.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.195+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=A7F1F4Q1ZNJI type=del size=3623906 2024-09-12T17:47:05.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.199+0000 7f68bc0598c0 -1 < failed to complete operation key=MRS3KW2H5AKK tag=3GU02K5IP4H8 type=del size=2439474: (22) Invalid argument 2024-09-12T17:47:05.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.203+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~OFL7Z88C1ECH.0 size=1048576 2024-09-12T17:47:05.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.207+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~OFL7Z88C1ECH.1 size=1048576 2024-09-12T17:47:05.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~OFL7Z88C1ECH.2 size=161038 2024-09-12T17:47:05.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.211+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=OFL7Z88C1ECH tag=96KA308XJ9SB type=write size=3306766 2024-09-12T17:47:05.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.211+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=RIFPR0TACMGY type=del 2024-09-12T17:47:05.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.219+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~AIMBHTDXEERG.0 size=1048576 2024-09-12T17:47:05.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.219+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~AIMBHTDXEERG.1 size=425300 2024-09-12T17:47:05.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.219+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=AIMBHTDXEERG tag=ZKVV7THEA11N type=write size=2522452 2024-09-12T17:47:05.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.223+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~3VA0MADAQYG2.0 size=1048576 2024-09-12T17:47:05.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.227+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~3VA0MADAQYG2.1 size=1048576 2024-09-12T17:47:05.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.227+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~3VA0MADAQYG2.2 size=590879 2024-09-12T17:47:05.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.235+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=3VA0MADAQYG2 tag=8DOB0K0I3L29 type=write size=3736607 2024-09-12T17:47:05.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.239+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~LE8Q9WZLS1U9.0 size=610727 2024-09-12T17:47:05.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.239+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=LE8Q9WZLS1U9 tag=F4OUCEFDJI8L type=write size=1659303 2024-09-12T17:47:05.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.243+0000 7f68bc0598c0 1 < canceled operation key=NLPTU26RO70S tag=POO6VGFKC43W type=del size=3818142 2024-09-12T17:47:05.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.243+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=8P21VOGI51L3 type=del size=2078420 2024-09-12T17:47:05.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.251+0000 7f68bc0598c0 1 < suggested update operation key=FC3K0QN3TAWH tag=QF4SEHRIXK36 type=del size=1638782 2024-09-12T17:47:05.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.255+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=MGY4NP8HKP4D type=del size=837358 2024-09-12T17:47:05.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.259+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=20AM98AZR61T type=del 2024-09-12T17:47:05.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.259+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=SVG95571ZSKB type=del size=2279282 2024-09-12T17:47:05.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.263+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=WANBYW1RWSF7 type=del 2024-09-12T17:47:05.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.271+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~HNGQFIU1Y211.0 size=1024011 2024-09-12T17:47:05.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.271+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=HNGQFIU1Y211 tag=ZXEROHAJ2FZ7 type=write size=2072587 2024-09-12T17:47:05.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.271+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=ESOBHZOKAIMU type=del 2024-09-12T17:47:05.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.275+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=SED9EIH4P67U type=del size=92188 2024-09-12T17:47:05.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.275+0000 7f68bc0598c0 1 < completed write operation key=6SUA9FBDU69A tag=5NDI7NQTCA7A type=write size=113483 2024-09-12T17:47:05.283 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.279+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=MCQPCVRI1J56 type=del size=1201346 2024-09-12T17:47:05.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.283+0000 7f68bc0598c0 1 < completed write operation key=SBQGW2EK6I1J tag=OKC7UHN9I8F1 type=write size=369876 2024-09-12T17:47:05.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.287+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=E2Q2OOPVUDBS type=del size=1657621 2024-09-12T17:47:05.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.291+0000 7f68bc0598c0 1 < suggested remove operation key=0XFYVNU2Q7KO tag=MEM6FP8LQ064 type=del 2024-09-12T17:47:05.299 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.295+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~K9BKUVDODTHY.0 size=1048576 2024-09-12T17:47:05.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.299+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~K9BKUVDODTHY.1 size=491070 2024-09-12T17:47:05.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.299+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=K9BKUVDODTHY tag=JMJXZT2HWH1N type=write size=2588222 2024-09-12T17:47:05.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.299+0000 7f68bc0598c0 1 < canceled part key=_multipart_QGO5SPFPT548.2~B4D1607LUZ86.0 size=1048576 2024-09-12T17:47:05.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.299+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~B4D1607LUZ86.1 size=510111 2024-09-12T17:47:05.307 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.303+0000 7f68bc0598c0 1 < canceled multipart upload key=QGO5SPFPT548 upload=B4D1607LUZ86 tag=3G3GZ1UAEC1A type=write size=2607263 2024-09-12T17:47:05.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.307+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~EYIQK1PBQY2J.0 size=1048576 2024-09-12T17:47:05.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.311+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~EYIQK1PBQY2J.1 size=504330 2024-09-12T17:47:05.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.311+0000 7f68bc0598c0 1 > prepared multipart upload key=BKAT5SGAC5Z8 upload=EYIQK1PBQY2J tag=EEU7EP67GSLE type=write size=2601482 2024-09-12T17:47:05.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.311+0000 7f68bc0598c0 1 < canceled part key=_multipart_WUGDIFCHNL90.2~ZNO5BPQ77K7D.0 size=1048576 2024-09-12T17:47:05.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.311+0000 7f68bc0598c0 1 < canceled part key=_multipart_WUGDIFCHNL90.2~ZNO5BPQ77K7D.1 size=1048576 2024-09-12T17:47:05.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.311+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~ZNO5BPQ77K7D.2 size=1008988 2024-09-12T17:47:05.321 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.315+0000 7f68bc0598c0 1 < canceled multipart upload key=WUGDIFCHNL90 upload=ZNO5BPQ77K7D tag=QH4TXUSQM8TY type=write size=4154716 2024-09-12T17:47:05.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.323+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~W1GK7FFP4Q98.0 size=1048576 2024-09-12T17:47:05.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.323+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~W1GK7FFP4Q98.1 size=941780 2024-09-12T17:47:05.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.323+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=W1GK7FFP4Q98 tag=0B4HHXK8ORXC type=write size=3038932 2024-09-12T17:47:05.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.327+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=3L8KQ02CMW9J type=del 2024-09-12T17:47:05.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.331+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=A2BVOBML5ORA type=del size=3292510 2024-09-12T17:47:05.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.331+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~A9IGD7ASI0F3.0 size=1048576 2024-09-12T17:47:05.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.335+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~A9IGD7ASI0F3.1 size=692394 2024-09-12T17:47:05.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.339+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=A9IGD7ASI0F3 tag=D9CG7NQCGCOJ type=write size=2789546 2024-09-12T17:47:05.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.343+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~UZM6GZAJ59FQ.0 size=1048576 2024-09-12T17:47:05.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.343+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~UZM6GZAJ59FQ.1 size=630456 2024-09-12T17:47:05.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.343+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=UZM6GZAJ59FQ tag=OW40JKNQPYPU type=write size=2727608 2024-09-12T17:47:05.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.347+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=A7F1F4Q1ZNJI type=del 2024-09-12T17:47:05.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.347+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=ZMNQ116SHMUU type=del size=2774174 2024-09-12T17:47:05.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.351+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~OFL7Z88C1ECH.0 size=1048576 2024-09-12T17:47:05.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.351+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~OFL7Z88C1ECH.1 size=1048576 2024-09-12T17:47:05.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.355+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~OFL7Z88C1ECH.2 size=161038 2024-09-12T17:47:05.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.359+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=OFL7Z88C1ECH tag=96KA308XJ9SB type=write size=3306766 2024-09-12T17:47:05.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.359+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=ZTDS7L7AZVUZ type=del size=2864627 2024-09-12T17:47:05.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.363+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~AIMBHTDXEERG.0 size=1048576 2024-09-12T17:47:05.369 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.367+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~AIMBHTDXEERG.1 size=425300 2024-09-12T17:47:05.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.371+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=AIMBHTDXEERG tag=ZKVV7THEA11N type=write size=2522452 2024-09-12T17:47:05.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.371+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=M81QRQWJX1MU type=del size=2524738 2024-09-12T17:47:05.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.375+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~LE8Q9WZLS1U9.0 size=610727 2024-09-12T17:47:05.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.379+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=LE8Q9WZLS1U9 tag=F4OUCEFDJI8L type=write size=1659303 2024-09-12T17:47:05.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.383+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=CZF50A5AUYGD type=write size=883063 2024-09-12T17:47:05.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.383+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=8P21VOGI51L3 type=del 2024-09-12T17:47:05.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.387+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=ICM3SKHHD7FE type=del size=3560748 2024-09-12T17:47:05.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.391+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=MGY4NP8HKP4D type=del 2024-09-12T17:47:05.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.391+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=2TT528VXYBAA type=write size=924590 2024-09-12T17:47:05.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.395+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=SVG95571ZSKB type=del 2024-09-12T17:47:05.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.399+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=DO0RTQYHE169 type=del size=3542657 2024-09-12T17:47:05.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.399+0000 7f68bc0598c0 1 < canceled part key=_multipart_4R9ENKMRB1GT.2~HNGQFIU1Y211.0 size=1024011 2024-09-12T17:47:05.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.403+0000 7f68bc0598c0 1 < canceled multipart upload key=4R9ENKMRB1GT upload=HNGQFIU1Y211 tag=ZXEROHAJ2FZ7 type=write size=2072587 2024-09-12T17:47:05.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.407+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=U3THPJXAUSKT type=del size=1078011 2024-09-12T17:47:05.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.411+0000 7f68bc0598c0 1 < suggested remove operation key=FC3K0QN3TAWH tag=SED9EIH4P67U type=del 2024-09-12T17:47:05.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.415+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=WCCH6ZF9XKLU type=write size=533515 2024-09-12T17:47:05.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.415+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=MCQPCVRI1J56 type=del 2024-09-12T17:47:05.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.419+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=CSN5XVNV23DB type=del size=2276213 2024-09-12T17:47:05.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.423+0000 7f68bc0598c0 1 < suggested update operation key=WUGDIFCHNL90 tag=E2Q2OOPVUDBS type=del size=1657621 2024-09-12T17:47:05.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.427+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=472ZE46EBC39 type=del size=1876836 2024-09-12T17:47:05.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.427+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~K9BKUVDODTHY.0 size=1048576 2024-09-12T17:47:05.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.431+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~K9BKUVDODTHY.1 size=491070 2024-09-12T17:47:05.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.435+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=K9BKUVDODTHY tag=JMJXZT2HWH1N type=write size=2588222 2024-09-12T17:47:05.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.435+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=35RTXXKRSWN4 type=write size=14032 2024-09-12T17:47:05.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.439+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~EYIQK1PBQY2J.0 size=1048576 2024-09-12T17:47:05.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.439+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~EYIQK1PBQY2J.1 size=504330 2024-09-12T17:47:05.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.443+0000 7f68bc0598c0 1 < completed multipart upload key=BKAT5SGAC5Z8 upload=EYIQK1PBQY2J tag=EEU7EP67GSLE type=write size=2601482 2024-09-12T17:47:05.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.447+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=CM2FFAEF1EET type=del size=3835317 2024-09-12T17:47:05.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.451+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~W1GK7FFP4Q98.0 size=1048576 2024-09-12T17:47:05.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.451+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~W1GK7FFP4Q98.1 size=941780 2024-09-12T17:47:05.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.455+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=W1GK7FFP4Q98 tag=0B4HHXK8ORXC type=write size=3038932 2024-09-12T17:47:05.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.459+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=FNQJHMIXNUN3 type=del size=1743839 2024-09-12T17:47:05.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.459+0000 7f68bc0598c0 1 < canceled operation key=57O6H52NHYOL tag=A2BVOBML5ORA type=del size=3292510 2024-09-12T17:47:05.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.463+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=0KNVIGZ5CXYH type=del size=3311101 2024-09-12T17:47:05.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.467+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~UZM6GZAJ59FQ.0 size=1048576 2024-09-12T17:47:05.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.467+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~UZM6GZAJ59FQ.1 size=630456 2024-09-12T17:47:05.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.471+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=UZM6GZAJ59FQ tag=OW40JKNQPYPU type=write size=2727608 2024-09-12T17:47:05.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.475+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=H0EV322XMYQY type=del size=1735424 2024-09-12T17:47:05.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.479+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=ZMNQ116SHMUU type=del 2024-09-12T17:47:05.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.479+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=984WXAT7TX52 type=del size=1370542 2024-09-12T17:47:05.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.483+0000 7f68bc0598c0 1 < suggested update operation key=F4F4P4L8K5D9 tag=ZTDS7L7AZVUZ type=del size=2864627 2024-09-12T17:47:05.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.491+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~5ZD8BQU82DSG.0 size=1048576 2024-09-12T17:47:05.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.491+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~5ZD8BQU82DSG.1 size=1048576 2024-09-12T17:47:05.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.495+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~5ZD8BQU82DSG.2 size=871856 2024-09-12T17:47:05.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.495+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=5ZD8BQU82DSG tag=LW5IM42LX7XH type=write size=4017584 2024-09-12T17:47:05.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.495+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=M81QRQWJX1MU type=del 2024-09-12T17:47:05.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.499+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~N06RFH734O8A.0 size=1048576 2024-09-12T17:47:05.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.503+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~N06RFH734O8A.1 size=353169 2024-09-12T17:47:05.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.503+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=N06RFH734O8A tag=Y4VY0WDNLAK4 type=write size=2450321 2024-09-12T17:47:05.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.507+0000 7f68bc0598c0 1 < completed write operation key=6SUA9FBDU69A tag=CZF50A5AUYGD type=write size=883063 2024-09-12T17:47:05.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.507+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=KU4G26IP0YTT type=del size=2578364 2024-09-12T17:47:05.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.511+0000 7f68bc0598c0 -1 < failed to complete operation key=F4F4P4L8K5D9 tag=ICM3SKHHD7FE type=del size=3560748: (22) Invalid argument 2024-09-12T17:47:05.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.515+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=24AOPDZ1A6L2 type=del size=1584067 2024-09-12T17:47:05.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.519+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=2TT528VXYBAA type=write size=924590 2024-09-12T17:47:05.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.519+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=R97V1FR83QBT type=write size=242849 2024-09-12T17:47:05.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.527+0000 7f68bc0598c0 1 < suggested remove operation key=6SUA9FBDU69A tag=DO0RTQYHE169 type=del 2024-09-12T17:47:05.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.527+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=WJSJ9HJEV2AO type=write size=798211 2024-09-12T17:47:05.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.535+0000 7f68bc0598c0 1 < suggested remove operation key=RTY1OT2PSAAY tag=U3THPJXAUSKT type=del 2024-09-12T17:47:05.543 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.539+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~M23P1Z5KJB21.0 size=1048576 2024-09-12T17:47:05.545 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.543+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~M23P1Z5KJB21.1 size=1048576 2024-09-12T17:47:05.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.543+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~M23P1Z5KJB21.2 size=903646 2024-09-12T17:47:05.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.543+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=M23P1Z5KJB21 tag=K52YTOD14WGQ type=write size=4049374 2024-09-12T17:47:05.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.547+0000 7f68bc0598c0 -1 < failed to complete operation key=F4F4P4L8K5D9 tag=WCCH6ZF9XKLU type=write size=533515: (22) Invalid argument 2024-09-12T17:47:05.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.551+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~YPECSCXN3IVO.0 size=1048576 2024-09-12T17:47:05.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.551+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~YPECSCXN3IVO.1 size=1048576 2024-09-12T17:47:05.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.555+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~YPECSCXN3IVO.2 size=922668 2024-09-12T17:47:05.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.555+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=YPECSCXN3IVO tag=K9T3F1XQ8OHC type=write size=4068396 2024-09-12T17:47:05.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.559+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=CSN5XVNV23DB type=del 2024-09-12T17:47:05.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.563+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~3G38JWK2TDRE.0 size=452959 2024-09-12T17:47:05.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.563+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=3G38JWK2TDRE tag=B3K6S3074C5V type=write size=1501535 2024-09-12T17:47:05.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.563+0000 7f68bc0598c0 1 < canceled operation key=S0B1RP89NO44 tag=472ZE46EBC39 type=del size=1876836 2024-09-12T17:47:05.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.567+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=30J53LLXU2PJ type=del size=3331780 2024-09-12T17:47:05.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.571+0000 7f68bc0598c0 -1 < failed to complete operation key=F4F4P4L8K5D9 tag=35RTXXKRSWN4 type=write size=14032: (22) Invalid argument 2024-09-12T17:47:05.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.575+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~85MQFXK4MVZW.0 size=1048576 2024-09-12T17:47:05.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.575+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~85MQFXK4MVZW.1 size=153654 2024-09-12T17:47:05.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.575+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=85MQFXK4MVZW tag=D07A7TMEM2LB type=write size=2250806 2024-09-12T17:47:05.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.579+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=CM2FFAEF1EET type=del 2024-09-12T17:47:05.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.583+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~Z82OIDLKZWYL.0 size=1048576 2024-09-12T17:47:05.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.587+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~Z82OIDLKZWYL.1 size=1048576 2024-09-12T17:47:05.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.587+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~Z82OIDLKZWYL.2 size=402009 2024-09-12T17:47:05.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.587+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=Z82OIDLKZWYL tag=A37QIMDP8Y0X type=write size=3547737 2024-09-12T17:47:05.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.591+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=FNQJHMIXNUN3 type=del 2024-09-12T17:47:05.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.595+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~8NHYKMFME8CI.0 size=1048576 2024-09-12T17:47:05.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.599+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~8NHYKMFME8CI.1 size=1020625 2024-09-12T17:47:05.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.599+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=8NHYKMFME8CI tag=4EKLO2EEBLJN type=write size=3117777 2024-09-12T17:47:05.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.599+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=0KNVIGZ5CXYH type=del 2024-09-12T17:47:05.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~EJZ0HWN9WO3O.0 size=1048576 2024-09-12T17:47:05.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~EJZ0HWN9WO3O.1 size=1048576 2024-09-12T17:47:05.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.611+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~EJZ0HWN9WO3O.2 size=406885 2024-09-12T17:47:05.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.611+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=EJZ0HWN9WO3O tag=1FAF0W2N4JHW type=write size=3552613 2024-09-12T17:47:05.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.615+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=H0EV322XMYQY type=del 2024-09-12T17:47:05.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.619+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~441D1IBTYLRH.0 size=1048576 2024-09-12T17:47:05.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.619+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~441D1IBTYLRH.1 size=1048576 2024-09-12T17:47:05.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.623+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~441D1IBTYLRH.2 size=413349 2024-09-12T17:47:05.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.623+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=441D1IBTYLRH tag=A80QN9OW5QDL type=write size=3559077 2024-09-12T17:47:05.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.627+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=984WXAT7TX52 type=del 2024-09-12T17:47:05.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.627+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=8KGPH08AQC18 type=del size=1107430 2024-09-12T17:47:05.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.631+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~5ZD8BQU82DSG.0 size=1048576 2024-09-12T17:47:05.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.631+0000 7f68bc0598c0 1 < canceled part key=_multipart_WUGDIFCHNL90.2~5ZD8BQU82DSG.1 size=1048576 2024-09-12T17:47:05.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.631+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~5ZD8BQU82DSG.2 size=871856 2024-09-12T17:47:05.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.635+0000 7f68bc0598c0 1 < canceled multipart upload key=WUGDIFCHNL90 upload=5ZD8BQU82DSG tag=LW5IM42LX7XH type=write size=4017584 2024-09-12T17:47:05.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.639+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=E7XC1WSFGCK2 type=del size=2907520 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.643+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~N06RFH734O8A.0 size=1048576 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.643+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~N06RFH734O8A.1 size=353169 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.647+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=N06RFH734O8A tag=Y4VY0WDNLAK4 type=write size=2450321 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.655+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~SI1ZJD1M35CQ.0 size=1048576 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.655+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~SI1ZJD1M35CQ.1 size=1048576 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.659+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~SI1ZJD1M35CQ.2 size=1016814 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.659+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=SI1ZJD1M35CQ tag=KKNOC5UX0AUH type=write size=4162542 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.663+0000 7f68bc0598c0 1 < suggested update operation key=8P0EWBVO0BQD tag=KU4G26IP0YTT type=del size=2578364 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.667+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~D9GV4463E2LZ.0 size=1048576 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.667+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~D9GV4463E2LZ.1 size=790463 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.667+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=D9GV4463E2LZ tag=ZSR9JPUAJCSB type=write size=2887615 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.671+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=24AOPDZ1A6L2 type=del 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.675+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=ZJMDHF0CZC3A type=del size=1740360 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.679+0000 7f68bc0598c0 1 < suggested update operation key=KW3VWTA43PBM tag=R97V1FR83QBT type=write size=242849 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.683+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~300Y7DLS4KKX.0 size=1048576 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.683+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~300Y7DLS4KKX.1 size=38800 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.683+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=300Y7DLS4KKX tag=Y98D2XJH6CFQ type=write size=2135952 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.687+0000 7f68bc0598c0 1 < suggested remove operation key=9XK00RPA6Q38 tag=WJSJ9HJEV2AO type=write 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.695+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~V55DGFXTIXDD.0 size=1048576 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.695+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~V55DGFXTIXDD.1 size=738844 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.695+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=V55DGFXTIXDD tag=XTLJ4IV5YF7Q type=write size=2835996 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.699+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~M23P1Z5KJB21.0 size=1048576 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.699+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~M23P1Z5KJB21.1 size=1048576 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.703+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~M23P1Z5KJB21.2 size=903646 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.707+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=M23P1Z5KJB21 tag=K52YTOD14WGQ type=write size=4049374 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.707+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=AMJ6VMBVQ32O type=del size=3245449 2024-09-12T17:47:05.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.711+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~YPECSCXN3IVO.0 size=1048576 2024-09-12T17:47:05.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.711+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~YPECSCXN3IVO.1 size=1048576 2024-09-12T17:47:05.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.711+0000 7f68bc0598c0 1 < canceled part key=_multipart_WUGDIFCHNL90.2~YPECSCXN3IVO.2 size=922668 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.715+0000 7f68bc0598c0 1 < canceled multipart upload key=WUGDIFCHNL90 upload=YPECSCXN3IVO tag=K9T3F1XQ8OHC type=write size=4068396 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.719+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~ESQNBPV259PU.0 size=1048576 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.723+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~ESQNBPV259PU.1 size=1048576 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.723+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~ESQNBPV259PU.2 size=751447 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.723+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=ESQNBPV259PU tag=CF2GVTCM587X type=write size=3897175 2024-09-12T17:47:05.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.727+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~3G38JWK2TDRE.0 size=452959 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.731+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=3G38JWK2TDRE tag=B3K6S3074C5V type=write size=1501535 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.735+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=LSEW12LBNQKX type=write size=191564 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.739+0000 7f68bc0598c0 1 < suggested update operation key=6SUA9FBDU69A tag=30J53LLXU2PJ type=del size=3331780 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.743+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=FDKXR4BH95X1 type=del size=3463763 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.743+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~85MQFXK4MVZW.0 size=1048576 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.747+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~85MQFXK4MVZW.1 size=153654 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.751+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=85MQFXK4MVZW tag=D07A7TMEM2LB type=write size=2250806 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.755+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~ZRXMYX2NY881.0 size=1048576 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.755+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~ZRXMYX2NY881.1 size=1048576 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.759+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~ZRXMYX2NY881.2 size=844255 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.759+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=ZRXMYX2NY881 tag=TUSRXTGJZOKN type=write size=3989983 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.759+0000 7f68bc0598c0 1 < canceled part key=_multipart_4R9ENKMRB1GT.2~Z82OIDLKZWYL.0 size=1048576 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.759+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~Z82OIDLKZWYL.1 size=1048576 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.763+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~Z82OIDLKZWYL.2 size=402009 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.763+0000 7f68bc0598c0 1 < canceled multipart upload key=4R9ENKMRB1GT upload=Z82OIDLKZWYL tag=A37QIMDP8Y0X type=write size=3547737 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.767+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=UPOM0O50ZNV5 type=write size=618232 2024-09-12T17:47:05.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.771+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~8NHYKMFME8CI.0 size=1048576 2024-09-12T17:47:05.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.771+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~8NHYKMFME8CI.1 size=1020625 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.775+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=8NHYKMFME8CI tag=4EKLO2EEBLJN type=write size=3117777 2024-09-12T17:47:05.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.779+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~GAMNZ3QBSBXN.0 size=1048576 2024-09-12T17:47:05.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.779+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~GAMNZ3QBSBXN.1 size=979703 2024-09-12T17:47:05.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.779+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=GAMNZ3QBSBXN tag=BKMERXQWFTZ4 type=write size=3076855 2024-09-12T17:47:05.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.783+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~EJZ0HWN9WO3O.0 size=1048576 2024-09-12T17:47:05.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.783+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~EJZ0HWN9WO3O.1 size=1048576 2024-09-12T17:47:05.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.787+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~EJZ0HWN9WO3O.2 size=406885 2024-09-12T17:47:05.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.791+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=EJZ0HWN9WO3O tag=1FAF0W2N4JHW type=write size=3552613 2024-09-12T17:47:05.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.791+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=WMKP5N2J6V0L type=del size=831806 2024-09-12T17:47:05.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.795+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~441D1IBTYLRH.0 size=1048576 2024-09-12T17:47:05.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.799+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~441D1IBTYLRH.1 size=1048576 2024-09-12T17:47:05.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.799+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~441D1IBTYLRH.2 size=413349 2024-09-12T17:47:05.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.803+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=441D1IBTYLRH tag=A80QN9OW5QDL type=write size=3559077 2024-09-12T17:47:05.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.807+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~Z2VZI80VVK0D.0 size=1048576 2024-09-12T17:47:05.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.807+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~Z2VZI80VVK0D.1 size=1048576 2024-09-12T17:47:05.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.811+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~Z2VZI80VVK0D.2 size=537586 2024-09-12T17:47:05.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.811+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=Z2VZI80VVK0D tag=VDMVT499LB6H type=write size=3683314 2024-09-12T17:47:05.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.811+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=8KGPH08AQC18 type=del 2024-09-12T17:47:05.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.815+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~95Q89VGLUPGH.0 size=1048576 2024-09-12T17:47:05.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.819+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~95Q89VGLUPGH.1 size=119525 2024-09-12T17:47:05.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.819+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=95Q89VGLUPGH tag=98SZVBEA4YY1 type=write size=2216677 2024-09-12T17:47:05.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.819+0000 7f68bc0598c0 1 < canceled operation key=S0B1RP89NO44 tag=E7XC1WSFGCK2 type=del size=2907520 2024-09-12T17:47:05.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.823+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~W07L4S2TR22D.0 size=1048576 2024-09-12T17:47:05.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.827+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~W07L4S2TR22D.1 size=817889 2024-09-12T17:47:05.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.827+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=W07L4S2TR22D tag=81VVTFIBXNBR type=write size=2915041 2024-09-12T17:47:05.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.827+0000 7f68bc0598c0 1 < canceled part key=_multipart_QGO5SPFPT548.2~SI1ZJD1M35CQ.0 size=1048576 2024-09-12T17:47:05.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.831+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~SI1ZJD1M35CQ.1 size=1048576 2024-09-12T17:47:05.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.831+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~SI1ZJD1M35CQ.2 size=1016814 2024-09-12T17:47:05.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.835+0000 7f68bc0598c0 1 < canceled multipart upload key=QGO5SPFPT548 upload=SI1ZJD1M35CQ tag=KKNOC5UX0AUH type=write size=4162542 2024-09-12T17:47:05.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.843+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~KG03FP7QBZWX.0 size=1048576 2024-09-12T17:47:05.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.843+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~KG03FP7QBZWX.1 size=779167 2024-09-12T17:47:05.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.843+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=KG03FP7QBZWX tag=CTOJVBCJGWYL type=write size=2876319 2024-09-12T17:47:05.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.847+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~D9GV4463E2LZ.0 size=1048576 2024-09-12T17:47:05.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.847+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~D9GV4463E2LZ.1 size=790463 2024-09-12T17:47:05.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.855+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=D9GV4463E2LZ tag=ZSR9JPUAJCSB type=write size=2887615 2024-09-12T17:47:05.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.859+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=MJ0X9G6DUX3B type=del size=2247141 2024-09-12T17:47:05.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.859+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=ZJMDHF0CZC3A type=del 2024-09-12T17:47:05.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.863+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=T9ZYK2S9XWPL type=del size=3176868 2024-09-12T17:47:05.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.867+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~300Y7DLS4KKX.0 size=1048576 2024-09-12T17:47:05.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.867+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~300Y7DLS4KKX.1 size=38800 2024-09-12T17:47:05.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.871+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=300Y7DLS4KKX tag=Y98D2XJH6CFQ type=write size=2135952 2024-09-12T17:47:05.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.875+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=KARTWEZWMGK5 type=del size=137008 2024-09-12T17:47:05.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.879+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~V55DGFXTIXDD.0 size=1048576 2024-09-12T17:47:05.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.879+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~V55DGFXTIXDD.1 size=738844 2024-09-12T17:47:05.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.883+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=V55DGFXTIXDD tag=XTLJ4IV5YF7Q type=write size=2835996 2024-09-12T17:47:05.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.887+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~SZJM58F0DCUX.0 size=1048576 2024-09-12T17:47:05.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~SZJM58F0DCUX.1 size=1048576 2024-09-12T17:47:05.896 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~SZJM58F0DCUX.2 size=700435 2024-09-12T17:47:05.896 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.891+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=SZJM58F0DCUX tag=6NALSB0PPCSU type=write size=3846163 2024-09-12T17:47:05.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.895+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=AMJ6VMBVQ32O type=del 2024-09-12T17:47:05.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.899+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=V4Y2P877LQ3S type=del size=2447588 2024-09-12T17:47:05.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.899+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~ESQNBPV259PU.0 size=1048576 2024-09-12T17:47:05.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.903+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~ESQNBPV259PU.1 size=1048576 2024-09-12T17:47:05.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.907+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~ESQNBPV259PU.2 size=751447 2024-09-12T17:47:05.916 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.911+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=ESQNBPV259PU tag=CF2GVTCM587X type=write size=3897175 2024-09-12T17:47:05.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.915+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~ED9V5EA9GGSE.0 size=1048576 2024-09-12T17:47:05.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.919+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~ED9V5EA9GGSE.1 size=1048576 2024-09-12T17:47:05.924 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.919+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~ED9V5EA9GGSE.2 size=537631 2024-09-12T17:47:05.924 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.919+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=ED9V5EA9GGSE tag=MVKYQCZJR4W2 type=write size=3683359 2024-09-12T17:47:05.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.923+0000 7f68bc0598c0 1 < completed write operation key=2129SG6US3LI tag=LSEW12LBNQKX type=write size=191564 2024-09-12T17:47:05.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.927+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~RAPRJK3FKMJQ.0 size=1048576 2024-09-12T17:47:05.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.931+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~RAPRJK3FKMJQ.1 size=173840 2024-09-12T17:47:05.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.931+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=RAPRJK3FKMJQ tag=MVJW54CO58HN type=write size=2270992 2024-09-12T17:47:05.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.931+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=FDKXR4BH95X1 type=del 2024-09-12T17:47:05.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.935+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=I2EV05ICS0YM type=del size=1454664 2024-09-12T17:47:05.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.939+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~ZRXMYX2NY881.0 size=1048576 2024-09-12T17:47:05.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.939+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~ZRXMYX2NY881.1 size=1048576 2024-09-12T17:47:05.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.943+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~ZRXMYX2NY881.2 size=844255 2024-09-12T17:47:05.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.947+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=ZRXMYX2NY881 tag=TUSRXTGJZOKN type=write size=3989983 2024-09-12T17:47:05.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.951+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=27NRH28VE6CV type=del size=1196179 2024-09-12T17:47:05.956 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.951+0000 7f68bc0598c0 1 < completed write operation key=P8T1VX1XFJ31 tag=UPOM0O50ZNV5 type=write size=618232 2024-09-12T17:47:05.959 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.955+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=VZRNAH02VT3E type=del size=1364428 2024-09-12T17:47:05.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.959+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~GAMNZ3QBSBXN.0 size=1048576 2024-09-12T17:47:05.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.959+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~GAMNZ3QBSBXN.1 size=979703 2024-09-12T17:47:05.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.963+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=GAMNZ3QBSBXN tag=BKMERXQWFTZ4 type=write size=3076855 2024-09-12T17:47:05.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.967+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=2D5OXWYFTZ0X type=del size=2666322 2024-09-12T17:47:05.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.971+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=WMKP5N2J6V0L type=del 2024-09-12T17:47:05.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.971+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=HXXKN9HUEGWJ type=del size=3749375 2024-09-12T17:47:05.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.975+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~Z2VZI80VVK0D.0 size=1048576 2024-09-12T17:47:05.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.975+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~Z2VZI80VVK0D.1 size=1048576 2024-09-12T17:47:05.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.979+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~Z2VZI80VVK0D.2 size=537586 2024-09-12T17:47:05.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.983+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=Z2VZI80VVK0D tag=VDMVT499LB6H type=write size=3683314 2024-09-12T17:47:05.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.987+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=SMWITD1ATSXK type=del size=3834954 2024-09-12T17:47:05.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.987+0000 7f68bc0598c0 1 < canceled part key=_multipart_DMJZUQJ7IY60.2~95Q89VGLUPGH.0 size=1048576 2024-09-12T17:47:05.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.987+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~95Q89VGLUPGH.1 size=119525 2024-09-12T17:47:05.996 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.991+0000 7f68bc0598c0 1 < canceled multipart upload key=DMJZUQJ7IY60 upload=95Q89VGLUPGH tag=98SZVBEA4YY1 type=write size=2216677 2024-09-12T17:47:05.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.995+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=CT5GBB0ZRYUN type=write size=174249 2024-09-12T17:47:06.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.999+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~W07L4S2TR22D.0 size=1048576 2024-09-12T17:47:06.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:05.999+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~W07L4S2TR22D.1 size=817889 2024-09-12T17:47:06.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.003+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=W07L4S2TR22D tag=81VVTFIBXNBR type=write size=2915041 2024-09-12T17:47:06.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.011+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~LZEA74F63C3D.0 size=1048576 2024-09-12T17:47:06.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.011+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~LZEA74F63C3D.1 size=377346 2024-09-12T17:47:06.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.011+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=LZEA74F63C3D tag=SG4VNXKRFF76 type=write size=2474498 2024-09-12T17:47:06.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.015+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~KG03FP7QBZWX.0 size=1048576 2024-09-12T17:47:06.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.019+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~KG03FP7QBZWX.1 size=779167 2024-09-12T17:47:06.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.023+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=KG03FP7QBZWX tag=CTOJVBCJGWYL type=write size=2876319 2024-09-12T17:47:06.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.023+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=YHZBI108TGVG type=write size=483012 2024-09-12T17:47:06.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.027+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=MJ0X9G6DUX3B type=del 2024-09-12T17:47:06.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.031+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=FYY17UFL8CLD type=write size=318039 2024-09-12T17:47:06.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.035+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=T9ZYK2S9XWPL type=del 2024-09-12T17:47:06.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.039+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~6Q3GX2WPQ4LZ.0 size=40918 2024-09-12T17:47:06.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.039+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=6Q3GX2WPQ4LZ tag=T45RKPE6Q9L0 type=write size=1089494 2024-09-12T17:47:06.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.043+0000 7f68bc0598c0 1 < suggested update operation key=6J677S46BXS4 tag=KARTWEZWMGK5 type=del size=137008 2024-09-12T17:47:06.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.047+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=N9HMQ9M0VO6C type=del size=1239826 2024-09-12T17:47:06.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.051+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~SZJM58F0DCUX.0 size=1048576 2024-09-12T17:47:06.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.051+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~SZJM58F0DCUX.1 size=1048576 2024-09-12T17:47:06.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.055+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~SZJM58F0DCUX.2 size=700435 2024-09-12T17:47:06.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.059+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=SZJM58F0DCUX tag=6NALSB0PPCSU type=write size=3846163 2024-09-12T17:47:06.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.063+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=HVADG96A37ZZ type=del size=2285910 2024-09-12T17:47:06.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.067+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=V4Y2P877LQ3S type=del 2024-09-12T17:47:06.074 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.071+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~5K7IIQ3MVFOS.0 size=1048576 2024-09-12T17:47:06.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.071+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~5K7IIQ3MVFOS.1 size=691101 2024-09-12T17:47:06.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.071+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=5K7IIQ3MVFOS tag=U1EUZB4RV8FE type=write size=2788253 2024-09-12T17:47:06.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.075+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~ED9V5EA9GGSE.0 size=1048576 2024-09-12T17:47:06.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.079+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~ED9V5EA9GGSE.1 size=1048576 2024-09-12T17:47:06.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.079+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~ED9V5EA9GGSE.2 size=537631 2024-09-12T17:47:06.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.083+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=ED9V5EA9GGSE tag=MVKYQCZJR4W2 type=write size=3683359 2024-09-12T17:47:06.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.087+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=PROMH5590Q78 type=del size=3351593 2024-09-12T17:47:06.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.091+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~RAPRJK3FKMJQ.0 size=1048576 2024-09-12T17:47:06.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.091+0000 7f68bc0598c0 1 < canceled part key=_multipart_6J677S46BXS4.2~RAPRJK3FKMJQ.1 size=173840 2024-09-12T17:47:06.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.095+0000 7f68bc0598c0 1 < canceled multipart upload key=6J677S46BXS4 upload=RAPRJK3FKMJQ tag=MVJW54CO58HN type=write size=2270992 2024-09-12T17:47:06.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.103+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~9XXJVKNQH2W7.0 size=1048576 2024-09-12T17:47:06.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.107+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~9XXJVKNQH2W7.1 size=344040 2024-09-12T17:47:06.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.107+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=9XXJVKNQH2W7 tag=VBSZDTQ7NE1Y type=write size=2441192 2024-09-12T17:47:06.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.107+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=I2EV05ICS0YM type=del 2024-09-12T17:47:06.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.111+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=V3JEFGIBRY7L type=del size=3677293 2024-09-12T17:47:06.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.115+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=27NRH28VE6CV type=del 2024-09-12T17:47:06.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.119+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=H93ZLS2G62ON type=del size=18955 2024-09-12T17:47:06.124 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.119+0000 7f68bc0598c0 -1 < failed to complete operation key=6J677S46BXS4 tag=VZRNAH02VT3E type=del size=1364428: (22) Invalid argument 2024-09-12T17:47:06.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.123+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=MLJAD8KYMUI1 type=write size=807226 2024-09-12T17:47:06.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.127+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=2D5OXWYFTZ0X type=del 2024-09-12T17:47:06.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.127+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=5JBW34A2IRY8 type=del size=2752975 2024-09-12T17:47:06.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.131+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=HXXKN9HUEGWJ type=del 2024-09-12T17:47:06.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.135+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=CJ46E0MTHP58 type=del size=3139618 2024-09-12T17:47:06.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.139+0000 7f68bc0598c0 1 < suggested update operation key=8P0EWBVO0BQD tag=SMWITD1ATSXK type=del size=3834954 2024-09-12T17:47:06.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.143+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=CPMZ6B10JMS0 type=del size=2513112 2024-09-12T17:47:06.149 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.147+0000 7f68bc0598c0 1 < completed write operation key=P8T1VX1XFJ31 tag=CT5GBB0ZRYUN type=write size=174249 2024-09-12T17:47:06.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.151+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~7RJLAOEU84F4.0 size=384469 2024-09-12T17:47:06.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.151+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=7RJLAOEU84F4 tag=J81AD8RHYE0M type=write size=1433045 2024-09-12T17:47:06.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.155+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~LZEA74F63C3D.0 size=1048576 2024-09-12T17:47:06.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.155+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~LZEA74F63C3D.1 size=377346 2024-09-12T17:47:06.165 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.163+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=LZEA74F63C3D tag=SG4VNXKRFF76 type=write size=2474498 2024-09-12T17:47:06.168 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.163+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=ULF0OOSQ2GRT type=write size=155846 2024-09-12T17:47:06.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.171+0000 7f68bc0598c0 1 < suggested remove operation key=HGY9WK7MKCYS tag=YHZBI108TGVG type=write 2024-09-12T17:47:06.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.171+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=PEFNA6G5WTNT type=del size=347123 2024-09-12T17:47:06.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.179+0000 7f68bc0598c0 1 < suggested remove operation key=2129SG6US3LI tag=FYY17UFL8CLD type=write 2024-09-12T17:47:06.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.183+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~BK57UULV1GZV.0 size=976525 2024-09-12T17:47:06.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.183+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=BK57UULV1GZV tag=N1TGRDCMXM6D type=write size=2025101 2024-09-12T17:47:06.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.187+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~6Q3GX2WPQ4LZ.0 size=40918 2024-09-12T17:47:06.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.191+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=6Q3GX2WPQ4LZ tag=T45RKPE6Q9L0 type=write size=1089494 2024-09-12T17:47:06.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.199+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~RILWBQ7K0X5H.0 size=16135 2024-09-12T17:47:06.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.199+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=RILWBQ7K0X5H tag=PI5WVNTEC8O7 type=write size=1064711 2024-09-12T17:47:06.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.199+0000 7f68bc0598c0 -1 < failed to complete operation key=8P0EWBVO0BQD tag=N9HMQ9M0VO6C type=del size=1239826: (22) Invalid argument 2024-09-12T17:47:06.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.203+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=BRYDF704XK9C type=del size=3326073 2024-09-12T17:47:06.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.207+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=HVADG96A37ZZ type=del 2024-09-12T17:47:06.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~3TEQSO5RRHSJ.0 size=1048576 2024-09-12T17:47:06.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~3TEQSO5RRHSJ.1 size=1048576 2024-09-12T17:47:06.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.215+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~3TEQSO5RRHSJ.2 size=569350 2024-09-12T17:47:06.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.215+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=3TEQSO5RRHSJ tag=T59ZW1BO4OXI type=write size=3715078 2024-09-12T17:47:06.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.215+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~5K7IIQ3MVFOS.0 size=1048576 2024-09-12T17:47:06.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.219+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~5K7IIQ3MVFOS.1 size=691101 2024-09-12T17:47:06.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.223+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=5K7IIQ3MVFOS tag=U1EUZB4RV8FE type=write size=2788253 2024-09-12T17:47:06.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.227+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~IF0IN6XLKP08.0 size=1048576 2024-09-12T17:47:06.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.231+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~IF0IN6XLKP08.1 size=1001991 2024-09-12T17:47:06.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.231+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=IF0IN6XLKP08 tag=2LH9VYWG1ZSL type=write size=3099143 2024-09-12T17:47:06.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.231+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=PROMH5590Q78 type=del 2024-09-12T17:47:06.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.235+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~XI2XKB1QIFSQ.0 size=1048576 2024-09-12T17:47:06.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.239+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~XI2XKB1QIFSQ.1 size=951719 2024-09-12T17:47:06.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.239+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=XI2XKB1QIFSQ tag=E42OF4Y6HTF8 type=write size=3048871 2024-09-12T17:47:06.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.239+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~9XXJVKNQH2W7.0 size=1048576 2024-09-12T17:47:06.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.243+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~9XXJVKNQH2W7.1 size=344040 2024-09-12T17:47:06.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.247+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=9XXJVKNQH2W7 tag=VBSZDTQ7NE1Y type=write size=2441192 2024-09-12T17:47:06.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.251+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~BJ2R252X0M63.0 size=906247 2024-09-12T17:47:06.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.251+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=BJ2R252X0M63 tag=FIJ50DC03DU3 type=write size=1954823 2024-09-12T17:47:06.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.255+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=V3JEFGIBRY7L type=del 2024-09-12T17:47:06.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.255+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=UINMDEB2EGRO type=del size=1715441 2024-09-12T17:47:06.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.259+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=H93ZLS2G62ON type=del 2024-09-12T17:47:06.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.263+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~0LWV4PGMM86R.0 size=1048576 2024-09-12T17:47:06.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.267+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~0LWV4PGMM86R.1 size=749875 2024-09-12T17:47:06.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.267+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=0LWV4PGMM86R tag=P55O0Y8ZWZH2 type=write size=2847027 2024-09-12T17:47:06.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.271+0000 7f68bc0598c0 1 < canceled operation key=QGO5SPFPT548 tag=MLJAD8KYMUI1 type=write size=807226 2024-09-12T17:47:06.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.275+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~5TGTB6CSZ6S2.0 size=1048576 2024-09-12T17:47:06.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.275+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~5TGTB6CSZ6S2.1 size=1048576 2024-09-12T17:47:06.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.279+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~5TGTB6CSZ6S2.2 size=73382 2024-09-12T17:47:06.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.279+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=5TGTB6CSZ6S2 tag=CHQNOC5QUJJ0 type=write size=3219110 2024-09-12T17:47:06.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.283+0000 7f68bc0598c0 1 < suggested update operation key=XGJSQJ2IXJDK tag=5JBW34A2IRY8 type=del size=2752975 2024-09-12T17:47:06.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.287+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=P6L3XTCHMCJ5 type=del size=3237590 2024-09-12T17:47:06.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.287+0000 7f68bc0598c0 1 < canceled operation key=F4F4P4L8K5D9 tag=CJ46E0MTHP58 type=del size=3139618 2024-09-12T17:47:06.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.291+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=GBPVS6MVHKK5 type=del size=560686 2024-09-12T17:47:06.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.291+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=CPMZ6B10JMS0 type=del 2024-09-12T17:47:06.299 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.295+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=QZIDRW070S6X type=del size=400814 2024-09-12T17:47:06.302 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.299+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~7RJLAOEU84F4.0 size=384469 2024-09-12T17:47:06.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.303+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=7RJLAOEU84F4 tag=J81AD8RHYE0M type=write size=1433045 2024-09-12T17:47:06.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.303+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=UEQ9TMM6WA4A type=write size=624733 2024-09-12T17:47:06.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.307+0000 7f68bc0598c0 1 < completed write operation key=9846YLKC8P8S tag=ULF0OOSQ2GRT type=write size=155846 2024-09-12T17:47:06.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.307+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=C06XHS98DCLT type=del size=3177196 2024-09-12T17:47:06.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.311+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=PEFNA6G5WTNT type=del 2024-09-12T17:47:06.319 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.315+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~0GOTIEB25U0U.0 size=202143 2024-09-12T17:47:06.320 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.315+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=0GOTIEB25U0U tag=JCA14H870JNT type=write size=1250719 2024-09-12T17:47:06.322 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.319+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~BK57UULV1GZV.0 size=976525 2024-09-12T17:47:06.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.323+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=BK57UULV1GZV tag=N1TGRDCMXM6D type=write size=2025101 2024-09-12T17:47:06.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.323+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=P8GKP9V75E7W type=del size=1629719 2024-09-12T17:47:06.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.327+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~RILWBQ7K0X5H.0 size=16135 2024-09-12T17:47:06.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.331+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=RILWBQ7K0X5H tag=PI5WVNTEC8O7 type=write size=1064711 2024-09-12T17:47:06.339 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.335+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=1O89VPRD5Y3C type=del size=1756635 2024-09-12T17:47:06.345 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.343+0000 7f68bc0598c0 1 < suggested remove operation key=W8JEQ5NOIE6O tag=BRYDF704XK9C type=del 2024-09-12T17:47:06.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.343+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=UYWHYR3XYBLN type=del size=3981087 2024-09-12T17:47:06.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.347+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~3TEQSO5RRHSJ.0 size=1048576 2024-09-12T17:47:06.351 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.347+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~3TEQSO5RRHSJ.1 size=1048576 2024-09-12T17:47:06.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.351+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~3TEQSO5RRHSJ.2 size=569350 2024-09-12T17:47:06.358 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.355+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=3TEQSO5RRHSJ tag=T59ZW1BO4OXI type=write size=3715078 2024-09-12T17:47:06.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.359+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~XMMLEKJV6U2W.0 size=22385 2024-09-12T17:47:06.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.359+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=XMMLEKJV6U2W tag=BKN9N4QXXGEG type=write size=1070961 2024-09-12T17:47:06.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.359+0000 7f68bc0598c0 1 < canceled part key=_multipart_OG0V0I1SDHG5.2~IF0IN6XLKP08.0 size=1048576 2024-09-12T17:47:06.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.359+0000 7f68bc0598c0 1 < canceled part key=_multipart_OG0V0I1SDHG5.2~IF0IN6XLKP08.1 size=1001991 2024-09-12T17:47:06.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.363+0000 7f68bc0598c0 1 < canceled multipart upload key=OG0V0I1SDHG5 upload=IF0IN6XLKP08 tag=2LH9VYWG1ZSL type=write size=3099143 2024-09-12T17:47:06.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.367+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~T7QFM3GKY3GT.0 size=1048576 2024-09-12T17:47:06.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.371+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~T7QFM3GKY3GT.1 size=1048576 2024-09-12T17:47:06.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.375+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~T7QFM3GKY3GT.2 size=186612 2024-09-12T17:47:06.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.375+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=T7QFM3GKY3GT tag=URM7EBOSW7PN type=write size=3332340 2024-09-12T17:47:06.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.375+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~XI2XKB1QIFSQ.0 size=1048576 2024-09-12T17:47:06.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.375+0000 7f68bc0598c0 1 < canceled part key=_multipart_9XK00RPA6Q38.2~XI2XKB1QIFSQ.1 size=951719 2024-09-12T17:47:06.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.379+0000 7f68bc0598c0 1 < canceled multipart upload key=9XK00RPA6Q38 upload=XI2XKB1QIFSQ tag=E42OF4Y6HTF8 type=write size=3048871 2024-09-12T17:47:06.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.383+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=E7TK1V7MOT27 type=del size=2021175 2024-09-12T17:47:06.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.387+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~BJ2R252X0M63.0 size=906247 2024-09-12T17:47:06.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.391+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=BJ2R252X0M63 tag=FIJ50DC03DU3 type=write size=1954823 2024-09-12T17:47:06.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.395+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=HT228AU7VBZC type=del size=3279034 2024-09-12T17:47:06.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.395+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=UINMDEB2EGRO type=del 2024-09-12T17:47:06.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.399+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=73N85DNW1TO7 type=del size=796716 2024-09-12T17:47:06.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.403+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~0LWV4PGMM86R.0 size=1048576 2024-09-12T17:47:06.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.403+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~0LWV4PGMM86R.1 size=749875 2024-09-12T17:47:06.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.407+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=0LWV4PGMM86R tag=P55O0Y8ZWZH2 type=write size=2847027 2024-09-12T17:47:06.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.411+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=ER0H0QOAWYX7 type=write size=383494 2024-09-12T17:47:06.418 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.415+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~5TGTB6CSZ6S2.0 size=1048576 2024-09-12T17:47:06.421 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.415+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~5TGTB6CSZ6S2.1 size=1048576 2024-09-12T17:47:06.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.419+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~5TGTB6CSZ6S2.2 size=73382 2024-09-12T17:47:06.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.423+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=5TGTB6CSZ6S2 tag=CHQNOC5QUJJ0 type=write size=3219110 2024-09-12T17:47:06.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.431+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~QNFGM62QS3OM.0 size=1048576 2024-09-12T17:47:06.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.431+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~QNFGM62QS3OM.1 size=482631 2024-09-12T17:47:06.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.431+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=QNFGM62QS3OM tag=J3MPH1I2MGT8 type=write size=2579783 2024-09-12T17:47:06.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.439+0000 7f68bc0598c0 1 < suggested remove operation key=KW3VWTA43PBM tag=P6L3XTCHMCJ5 type=del 2024-09-12T17:47:06.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.439+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=FP516JC2K1S0 type=del size=350161 2024-09-12T17:47:06.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.443+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=GBPVS6MVHKK5 type=del 2024-09-12T17:47:06.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.447+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~8J920KHJ16QH.0 size=752637 2024-09-12T17:47:06.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.447+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=8J920KHJ16QH tag=RB8WV5RFONCW type=write size=1801213 2024-09-12T17:47:06.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.451+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=QZIDRW070S6X type=del 2024-09-12T17:47:06.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.451+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=0IVB4K8VOFSB type=del size=2882709 2024-09-12T17:47:06.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.455+0000 7f68bc0598c0 1 < completed write operation key=7XH1E2GEH9O2 tag=UEQ9TMM6WA4A type=write size=624733 2024-09-12T17:47:06.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~4DMXW4QJ935T.0 size=1048576 2024-09-12T17:47:06.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~4DMXW4QJ935T.1 size=1048576 2024-09-12T17:47:06.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.463+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~4DMXW4QJ935T.2 size=78522 2024-09-12T17:47:06.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.463+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=4DMXW4QJ935T tag=C73RUM1BD796 type=write size=3224250 2024-09-12T17:47:06.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.463+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=C06XHS98DCLT type=del 2024-09-12T17:47:06.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.471+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~NNKQNMF5DYRM.0 size=1048576 2024-09-12T17:47:06.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.471+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~NNKQNMF5DYRM.1 size=350337 2024-09-12T17:47:06.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.471+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=NNKQNMF5DYRM tag=KFOY64UOR0YE type=write size=2447489 2024-09-12T17:47:06.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.475+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~0GOTIEB25U0U.0 size=202143 2024-09-12T17:47:06.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.479+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=0GOTIEB25U0U tag=JCA14H870JNT type=write size=1250719 2024-09-12T17:47:06.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.479+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=JX7Z7602H46P type=del size=3976963 2024-09-12T17:47:06.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.483+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=P8GKP9V75E7W type=del 2024-09-12T17:47:06.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.487+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~Q1005BQ4GLE2.0 size=1048576 2024-09-12T17:47:06.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.491+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~Q1005BQ4GLE2.1 size=483696 2024-09-12T17:47:06.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.491+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=Q1005BQ4GLE2 tag=S2LLEC7B69SK type=write size=2580848 2024-09-12T17:47:06.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.491+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=1O89VPRD5Y3C type=del 2024-09-12T17:47:06.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.495+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=X6OAZMRQJWS3 type=del size=3426922 2024-09-12T17:47:06.503 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.499+0000 7f68bc0598c0 1 < suggested update operation key=57O6H52NHYOL tag=UYWHYR3XYBLN type=del size=3981087 2024-09-12T17:47:06.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.503+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~M8WNXYLMXO4G.0 size=1048576 2024-09-12T17:47:06.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.507+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~M8WNXYLMXO4G.1 size=1048576 2024-09-12T17:47:06.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.507+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~M8WNXYLMXO4G.2 size=584415 2024-09-12T17:47:06.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.507+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=M8WNXYLMXO4G tag=G48OSGY75IAR type=write size=3730143 2024-09-12T17:47:06.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.511+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~XMMLEKJV6U2W.0 size=22385 2024-09-12T17:47:06.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.515+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=XMMLEKJV6U2W tag=BKN9N4QXXGEG type=write size=1070961 2024-09-12T17:47:06.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.515+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=XUAFRTI8YQT1 type=del size=3521369 2024-09-12T17:47:06.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.519+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~T7QFM3GKY3GT.0 size=1048576 2024-09-12T17:47:06.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.519+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~T7QFM3GKY3GT.1 size=1048576 2024-09-12T17:47:06.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.523+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~T7QFM3GKY3GT.2 size=186612 2024-09-12T17:47:06.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.527+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=T7QFM3GKY3GT tag=URM7EBOSW7PN type=write size=3332340 2024-09-12T17:47:06.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.527+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=LYWIIMNBHFWA type=del size=990424 2024-09-12T17:47:06.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.531+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=E7TK1V7MOT27 type=del 2024-09-12T17:47:06.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.535+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~NKNKBZFX6W25.0 size=247376 2024-09-12T17:47:06.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.535+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=NKNKBZFX6W25 tag=55SA8ONPNYRL type=write size=1295952 2024-09-12T17:47:06.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.535+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=HT228AU7VBZC type=del 2024-09-12T17:47:06.543 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.539+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=IEHNNSMSGK2O type=del size=421509 2024-09-12T17:47:06.545 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.543+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=73N85DNW1TO7 type=del 2024-09-12T17:47:06.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.543+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=P6NUSJLZ738P type=del size=441562 2024-09-12T17:47:06.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.547+0000 7f68bc0598c0 1 < completed write operation key=S0B1RP89NO44 tag=ER0H0QOAWYX7 type=write size=383494 2024-09-12T17:47:06.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.551+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~SR2TT5CZ8IIT.0 size=1048576 2024-09-12T17:47:06.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.551+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~SR2TT5CZ8IIT.1 size=781978 2024-09-12T17:47:06.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.551+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=SR2TT5CZ8IIT tag=AOFMBYN57FW0 type=write size=2879130 2024-09-12T17:47:06.558 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.555+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~QNFGM62QS3OM.0 size=1048576 2024-09-12T17:47:06.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.555+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~QNFGM62QS3OM.1 size=482631 2024-09-12T17:47:06.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.559+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=QNFGM62QS3OM tag=J3MPH1I2MGT8 type=write size=2579783 2024-09-12T17:47:06.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.563+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~MWWGRAGFL72J.0 size=961696 2024-09-12T17:47:06.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.563+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=MWWGRAGFL72J tag=OZOILDX2UZX3 type=write size=2010272 2024-09-12T17:47:06.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.567+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=FP516JC2K1S0 type=del 2024-09-12T17:47:06.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.571+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~MWRB48BDYAS2.0 size=1048576 2024-09-12T17:47:06.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.571+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~MWRB48BDYAS2.1 size=113486 2024-09-12T17:47:06.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.571+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=MWRB48BDYAS2 tag=3MMFRQVUHCXE type=write size=2210638 2024-09-12T17:47:06.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.575+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~8J920KHJ16QH.0 size=752637 2024-09-12T17:47:06.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.579+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=8J920KHJ16QH tag=RB8WV5RFONCW type=write size=1801213 2024-09-12T17:47:06.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.583+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=PW1RLSQOUQJP type=del size=2227549 2024-09-12T17:47:06.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.587+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=0IVB4K8VOFSB type=del 2024-09-12T17:47:06.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.587+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=NXBLA33G8HZ0 type=del size=1037079 2024-09-12T17:47:06.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.591+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~4DMXW4QJ935T.0 size=1048576 2024-09-12T17:47:06.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.591+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~4DMXW4QJ935T.1 size=1048576 2024-09-12T17:47:06.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.595+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~4DMXW4QJ935T.2 size=78522 2024-09-12T17:47:06.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.599+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=4DMXW4QJ935T tag=C73RUM1BD796 type=write size=3224250 2024-09-12T17:47:06.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.599+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=FV9RM37SAU5L type=del size=3663186 2024-09-12T17:47:06.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.603+0000 7f68bc0598c0 1 < canceled part key=_multipart_XGJSQJ2IXJDK.2~NNKQNMF5DYRM.0 size=1048576 2024-09-12T17:47:06.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.603+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~NNKQNMF5DYRM.1 size=350337 2024-09-12T17:47:06.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.607+0000 7f68bc0598c0 1 < canceled multipart upload key=XGJSQJ2IXJDK upload=NNKQNMF5DYRM tag=KFOY64UOR0YE type=write size=2447489 2024-09-12T17:47:06.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.611+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=N6X72CC2204G type=del size=3810372 2024-09-12T17:47:06.616 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.611+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=JX7Z7602H46P type=del 2024-09-12T17:47:06.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.615+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~3KTHRUJOW428.0 size=1013997 2024-09-12T17:47:06.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.615+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=3KTHRUJOW428 tag=GY46IH6W0QDB type=write size=2062573 2024-09-12T17:47:06.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.619+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~Q1005BQ4GLE2.0 size=1048576 2024-09-12T17:47:06.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.623+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~Q1005BQ4GLE2.1 size=483696 2024-09-12T17:47:06.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.623+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=Q1005BQ4GLE2 tag=S2LLEC7B69SK type=write size=2580848 2024-09-12T17:47:06.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.627+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~SS0I0TKK27FY.0 size=1048576 2024-09-12T17:47:06.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.631+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~SS0I0TKK27FY.1 size=959388 2024-09-12T17:47:06.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.631+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=SS0I0TKK27FY tag=V8DV49GB3U6F type=write size=3056540 2024-09-12T17:47:06.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.631+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=X6OAZMRQJWS3 type=del 2024-09-12T17:47:06.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.635+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~AU3ZZ808VXLZ.0 size=495082 2024-09-12T17:47:06.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.635+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=AU3ZZ808VXLZ tag=WU3X4HOM3C8H type=write size=1543658 2024-09-12T17:47:06.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.639+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~M8WNXYLMXO4G.0 size=1048576 2024-09-12T17:47:06.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.639+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~M8WNXYLMXO4G.1 size=1048576 2024-09-12T17:47:06.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.643+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~M8WNXYLMXO4G.2 size=584415 2024-09-12T17:47:06.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.647+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=M8WNXYLMXO4G tag=G48OSGY75IAR type=write size=3730143 2024-09-12T17:47:06.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.651+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~DONAY0JXHU5L.0 size=849969 2024-09-12T17:47:06.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.651+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=DONAY0JXHU5L tag=2IJVBASS7PX5 type=write size=1898545 2024-09-12T17:47:06.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.651+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=XUAFRTI8YQT1 type=del 2024-09-12T17:47:06.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.655+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~PGQTE0TX5D57.0 size=1048576 2024-09-12T17:47:06.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.655+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~PGQTE0TX5D57.1 size=163471 2024-09-12T17:47:06.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.655+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=PGQTE0TX5D57 tag=HGUE7V1DAE6V type=write size=2260623 2024-09-12T17:47:06.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.659+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=LYWIIMNBHFWA type=del 2024-09-12T17:47:06.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.663+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~AOSVR0WPHY0E.0 size=1048576 2024-09-12T17:47:06.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.663+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~AOSVR0WPHY0E.1 size=1048576 2024-09-12T17:47:06.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.663+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~AOSVR0WPHY0E.2 size=317805 2024-09-12T17:47:06.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.663+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=AOSVR0WPHY0E tag=GX0HH6T14AZM type=write size=3463533 2024-09-12T17:47:06.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.667+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~NKNKBZFX6W25.0 size=247376 2024-09-12T17:47:06.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.671+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=NKNKBZFX6W25 tag=55SA8ONPNYRL type=write size=1295952 2024-09-12T17:47:06.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.671+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=K9LE828ZJBWW type=del size=409492 2024-09-12T17:47:06.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.675+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=IEHNNSMSGK2O type=del 2024-09-12T17:47:06.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.675+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=YNTWHEDJ2DUV type=del size=2400623 2024-09-12T17:47:06.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.679+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=P6NUSJLZ738P type=del 2024-09-12T17:47:06.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.683+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~JXVD1AESLYMG.0 size=1048576 2024-09-12T17:47:06.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.683+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~JXVD1AESLYMG.1 size=1048576 2024-09-12T17:47:06.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.687+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~JXVD1AESLYMG.2 size=957242 2024-09-12T17:47:06.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.687+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=JXVD1AESLYMG tag=HN2ZC1TWDT98 type=write size=4102970 2024-09-12T17:47:06.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.687+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~SR2TT5CZ8IIT.0 size=1048576 2024-09-12T17:47:06.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.691+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~SR2TT5CZ8IIT.1 size=781978 2024-09-12T17:47:06.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.695+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=SR2TT5CZ8IIT tag=AOFMBYN57FW0 type=write size=2879130 2024-09-12T17:47:06.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.695+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=O9Z7IS8UKCOP type=del size=1883340 2024-09-12T17:47:06.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.699+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~MWWGRAGFL72J.0 size=961696 2024-09-12T17:47:06.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.703+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=MWWGRAGFL72J tag=OZOILDX2UZX3 type=write size=2010272 2024-09-12T17:47:06.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.703+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=JCGC6DXBFXJI type=del size=1667967 2024-09-12T17:47:06.711 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.707+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~MWRB48BDYAS2.0 size=1048576 2024-09-12T17:47:06.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.707+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~MWRB48BDYAS2.1 size=113486 2024-09-12T17:47:06.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.711+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=MWRB48BDYAS2 tag=3MMFRQVUHCXE type=write size=2210638 2024-09-12T17:47:06.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.715+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=ERN1FPFHYC0N type=del size=969737 2024-09-12T17:47:06.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.719+0000 7f68bc0598c0 1 < suggested remove operation key=W8JEQ5NOIE6O tag=PW1RLSQOUQJP type=del 2024-09-12T17:47:06.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.719+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=C6HTWABWDAAW type=del size=3711346 2024-09-12T17:47:06.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.723+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=NXBLA33G8HZ0 type=del 2024-09-12T17:47:06.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.723+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=0842259EZPVY type=del size=1753703 2024-09-12T17:47:06.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.727+0000 7f68bc0598c0 -1 < failed to complete operation key=W8JEQ5NOIE6O tag=FV9RM37SAU5L type=del size=3663186: (22) Invalid argument 2024-09-12T17:47:06.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.731+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~ZAWZ1MY0ERRK.0 size=1048576 2024-09-12T17:47:06.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.731+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~ZAWZ1MY0ERRK.1 size=760305 2024-09-12T17:47:06.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.731+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=ZAWZ1MY0ERRK tag=0WUQRTQYP0RO type=write size=2857457 2024-09-12T17:47:06.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.735+0000 7f68bc0598c0 -1 < failed to complete operation key=W8JEQ5NOIE6O tag=N6X72CC2204G type=del size=3810372: (22) Invalid argument 2024-09-12T17:47:06.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.735+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=28PHPV5BWBLQ type=write size=401748 2024-09-12T17:47:06.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.739+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~3KTHRUJOW428.0 size=1013997 2024-09-12T17:47:06.747 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.743+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=3KTHRUJOW428 tag=GY46IH6W0QDB type=write size=2062573 2024-09-12T17:47:06.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.747+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=A31CECYFNAMP type=del size=4009460 2024-09-12T17:47:06.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.747+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~SS0I0TKK27FY.0 size=1048576 2024-09-12T17:47:06.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.751+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~SS0I0TKK27FY.1 size=959388 2024-09-12T17:47:06.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.755+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=SS0I0TKK27FY tag=V8DV49GB3U6F type=write size=3056540 2024-09-12T17:47:06.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.755+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=5R2UE502805Z type=del size=2326365 2024-09-12T17:47:06.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.759+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~AU3ZZ808VXLZ.0 size=495082 2024-09-12T17:47:06.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.763+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=AU3ZZ808VXLZ tag=WU3X4HOM3C8H type=write size=1543658 2024-09-12T17:47:06.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.767+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=EWOD91B72FRL type=del size=1819523 2024-09-12T17:47:06.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.767+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~DONAY0JXHU5L.0 size=849969 2024-09-12T17:47:06.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.771+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=DONAY0JXHU5L tag=2IJVBASS7PX5 type=write size=1898545 2024-09-12T17:47:06.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.779+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~O1TC137UJLW6.0 size=1048576 2024-09-12T17:47:06.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.779+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~O1TC137UJLW6.1 size=1048576 2024-09-12T17:47:06.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.779+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~O1TC137UJLW6.2 size=642672 2024-09-12T17:47:06.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.779+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=O1TC137UJLW6 tag=G7XZ7F4WOJIG type=write size=3788400 2024-09-12T17:47:06.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.783+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~PGQTE0TX5D57.0 size=1048576 2024-09-12T17:47:06.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.787+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~PGQTE0TX5D57.1 size=163471 2024-09-12T17:47:06.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.791+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=PGQTE0TX5D57 tag=HGUE7V1DAE6V type=write size=2260623 2024-09-12T17:47:06.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.795+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=5FDNGEY9OBJX type=del size=224588 2024-09-12T17:47:06.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.799+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~AOSVR0WPHY0E.0 size=1048576 2024-09-12T17:47:06.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.799+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~AOSVR0WPHY0E.1 size=1048576 2024-09-12T17:47:06.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.803+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~AOSVR0WPHY0E.2 size=317805 2024-09-12T17:47:06.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.807+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=AOSVR0WPHY0E tag=GX0HH6T14AZM type=write size=3463533 2024-09-12T17:47:06.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.807+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=4197JUXNIU9R type=del size=2866468 2024-09-12T17:47:06.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.811+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=K9LE828ZJBWW type=del 2024-09-12T17:47:06.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.811+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=AX22KAJ2123S type=del size=3496160 2024-09-12T17:47:06.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.819+0000 7f68bc0598c0 1 < suggested update operation key=7XH1E2GEH9O2 tag=YNTWHEDJ2DUV type=del size=2400623 2024-09-12T17:47:06.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.819+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=BFC7RWZSK0YS type=del size=2438286 2024-09-12T17:47:06.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.823+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~JXVD1AESLYMG.0 size=1048576 2024-09-12T17:47:06.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.823+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~JXVD1AESLYMG.1 size=1048576 2024-09-12T17:47:06.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.827+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~JXVD1AESLYMG.2 size=957242 2024-09-12T17:47:06.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.827+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=JXVD1AESLYMG tag=HN2ZC1TWDT98 type=write size=4102970 2024-09-12T17:47:06.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.831+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~RSVX99Z7PZ2U.0 size=1048576 2024-09-12T17:47:06.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~RSVX99Z7PZ2U.1 size=691047 2024-09-12T17:47:06.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.835+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=RSVX99Z7PZ2U tag=WI34XN2FWW7M type=write size=2788199 2024-09-12T17:47:06.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.835+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=O9Z7IS8UKCOP type=del 2024-09-12T17:47:06.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.839+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=K59E4WF35R9S type=del size=4142758 2024-09-12T17:47:06.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.843+0000 7f68bc0598c0 1 < canceled operation key=0XFYVNU2Q7KO tag=JCGC6DXBFXJI type=del size=1667967 2024-09-12T17:47:06.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.843+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~QOECAPF74OJ2.0 size=1048576 2024-09-12T17:47:06.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.847+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~QOECAPF74OJ2.1 size=1048576 2024-09-12T17:47:06.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.847+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~QOECAPF74OJ2.2 size=258681 2024-09-12T17:47:06.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.847+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=QOECAPF74OJ2 tag=EA634QM2ANBQ type=write size=3404409 2024-09-12T17:47:06.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.855+0000 7f68bc0598c0 1 < suggested update operation key=3JPRQXKB5K3W tag=ERN1FPFHYC0N type=del size=969737 2024-09-12T17:47:06.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.859+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~R02MX2MP48LS.0 size=1048576 2024-09-12T17:47:06.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.859+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~R02MX2MP48LS.1 size=1048576 2024-09-12T17:47:06.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.863+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~R02MX2MP48LS.2 size=279750 2024-09-12T17:47:06.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.863+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=R02MX2MP48LS tag=9IN2EKQQ42ZW type=write size=3425478 2024-09-12T17:47:06.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.867+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=C6HTWABWDAAW type=del 2024-09-12T17:47:06.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.867+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=9SMPBJ67F7NB type=del size=2532345 2024-09-12T17:47:06.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.871+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=0842259EZPVY type=del 2024-09-12T17:47:06.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.871+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=T95T28DPK45N type=del size=2916609 2024-09-12T17:47:06.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.875+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~ZAWZ1MY0ERRK.0 size=1048576 2024-09-12T17:47:06.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.875+0000 7f68bc0598c0 1 < canceled part key=_multipart_3JPRQXKB5K3W.2~ZAWZ1MY0ERRK.1 size=760305 2024-09-12T17:47:06.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.879+0000 7f68bc0598c0 1 < canceled multipart upload key=3JPRQXKB5K3W upload=ZAWZ1MY0ERRK tag=0WUQRTQYP0RO type=write size=2857457 2024-09-12T17:47:06.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.883+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=Q8VXMKOB94AN type=del size=198901 2024-09-12T17:47:06.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.883+0000 7f68bc0598c0 1 < completed write operation key=BKAT5SGAC5Z8 tag=28PHPV5BWBLQ type=write size=401748 2024-09-12T17:47:06.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.887+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=O0RHTT1Z2DIM type=del size=2608816 2024-09-12T17:47:06.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.887+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=A31CECYFNAMP type=del 2024-09-12T17:47:06.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.891+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=DV90R7OWFP3R type=del size=463145 2024-09-12T17:47:06.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.895+0000 7f68bc0598c0 1 < suggested remove operation key=UOW521GPXBQ0 tag=5R2UE502805Z type=del 2024-09-12T17:47:06.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.895+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=X4BNYNKFLY58 type=del size=369767 2024-09-12T17:47:06.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.899+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=EWOD91B72FRL type=del 2024-09-12T17:47:06.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.903+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=7BC7LSHOJ8HW type=del size=923114 2024-09-12T17:47:06.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.903+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~O1TC137UJLW6.0 size=1048576 2024-09-12T17:47:06.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.907+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~O1TC137UJLW6.1 size=1048576 2024-09-12T17:47:06.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.911+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~O1TC137UJLW6.2 size=642672 2024-09-12T17:47:06.918 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.915+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=O1TC137UJLW6 tag=G7XZ7F4WOJIG type=write size=3788400 2024-09-12T17:47:06.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.915+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=CNXAPVJ7OUCU type=del size=1446737 2024-09-12T17:47:06.923 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.919+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=5FDNGEY9OBJX type=del 2024-09-12T17:47:06.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.923+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=EUJ06W05YP0Q type=del size=961510 2024-09-12T17:47:06.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.923+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=4197JUXNIU9R type=del 2024-09-12T17:47:06.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.931+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~LI945RY0BDZ2.0 size=622849 2024-09-12T17:47:06.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.931+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=LI945RY0BDZ2 tag=EIYIYJR4A3BY type=write size=1671425 2024-09-12T17:47:06.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.931+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=AX22KAJ2123S type=del 2024-09-12T17:47:06.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.935+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=Y22ZB5F5I8SK type=del size=2431162 2024-09-12T17:47:06.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.939+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=BFC7RWZSK0YS type=del 2024-09-12T17:47:06.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.939+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=5CSUL36F0Q3K type=del size=1710832 2024-09-12T17:47:06.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.939+0000 7f68bc0598c0 1 < canceled part key=_multipart_3JPRQXKB5K3W.2~RSVX99Z7PZ2U.0 size=1048576 2024-09-12T17:47:06.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.943+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~RSVX99Z7PZ2U.1 size=691047 2024-09-12T17:47:06.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.947+0000 7f68bc0598c0 1 < canceled multipart upload key=3JPRQXKB5K3W upload=RSVX99Z7PZ2U tag=WI34XN2FWW7M type=write size=2788199 2024-09-12T17:47:06.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.947+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=ULBDHB5Q6EIC type=del size=241512 2024-09-12T17:47:06.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.951+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=K59E4WF35R9S type=del 2024-09-12T17:47:06.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.955+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=VQKOYHXPCHTV type=del size=975256 2024-09-12T17:47:06.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.955+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~QOECAPF74OJ2.0 size=1048576 2024-09-12T17:47:06.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.959+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~QOECAPF74OJ2.1 size=1048576 2024-09-12T17:47:06.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.963+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~QOECAPF74OJ2.2 size=258681 2024-09-12T17:47:06.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.967+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=QOECAPF74OJ2 tag=EA634QM2ANBQ type=write size=3404409 2024-09-12T17:47:06.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.971+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~5MW2SRBPUN26.0 size=1048576 2024-09-12T17:47:06.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.971+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~5MW2SRBPUN26.1 size=836745 2024-09-12T17:47:06.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.971+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=5MW2SRBPUN26 tag=6YP3X7LHDLP0 type=write size=2933897 2024-09-12T17:47:06.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.975+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~R02MX2MP48LS.0 size=1048576 2024-09-12T17:47:06.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.979+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~R02MX2MP48LS.1 size=1048576 2024-09-12T17:47:06.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.979+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~R02MX2MP48LS.2 size=279750 2024-09-12T17:47:06.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.983+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=R02MX2MP48LS tag=9IN2EKQQ42ZW type=write size=3425478 2024-09-12T17:47:06.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.987+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=7761I273QB5S type=del size=2587573 2024-09-12T17:47:06.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.991+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=9SMPBJ67F7NB type=del 2024-09-12T17:47:06.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.995+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~HC2HE4QJ1ZX2.0 size=1048576 2024-09-12T17:47:07.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.999+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~HC2HE4QJ1ZX2.1 size=91851 2024-09-12T17:47:07.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.999+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=HC2HE4QJ1ZX2 tag=O18GRRH5KV22 type=write size=2189003 2024-09-12T17:47:07.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:06.999+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=T95T28DPK45N type=del 2024-09-12T17:47:07.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.003+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~N60S6DWMPFXL.0 size=1048576 2024-09-12T17:47:07.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.007+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~N60S6DWMPFXL.1 size=1048576 2024-09-12T17:47:07.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.007+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~N60S6DWMPFXL.2 size=219475 2024-09-12T17:47:07.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.007+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=N60S6DWMPFXL tag=M14P761CJ345 type=write size=3365203 2024-09-12T17:47:07.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.011+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=Q8VXMKOB94AN type=del 2024-09-12T17:47:07.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.015+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=KNDAVS5IRDVC type=del size=3840610 2024-09-12T17:47:07.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.015+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=O0RHTT1Z2DIM type=del 2024-09-12T17:47:07.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.019+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~PZX1US950QDO.0 size=1048576 2024-09-12T17:47:07.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.027+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~PZX1US950QDO.1 size=357298 2024-09-12T17:47:07.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.027+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=PZX1US950QDO tag=TM45AMVWT2Y0 type=write size=2454450 2024-09-12T17:47:07.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.027+0000 7f68bc0598c0 1 < canceled operation key=S0B1RP89NO44 tag=DV90R7OWFP3R type=del size=463145 2024-09-12T17:47:07.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.031+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~1SU6L0W0T3JD.0 size=1048576 2024-09-12T17:47:07.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.035+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~1SU6L0W0T3JD.1 size=244854 2024-09-12T17:47:07.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.035+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=1SU6L0W0T3JD tag=0EJVLYIYBB23 type=write size=2342006 2024-09-12T17:47:07.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.035+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=X4BNYNKFLY58 type=del 2024-09-12T17:47:07.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.039+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=HTZ820VRNDQV type=del size=899618 2024-09-12T17:47:07.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.043+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=7BC7LSHOJ8HW type=del 2024-09-12T17:47:07.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.047+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~OWENKP2EC7BH.0 size=1048576 2024-09-12T17:47:07.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.047+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~OWENKP2EC7BH.1 size=109942 2024-09-12T17:47:07.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.047+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=OWENKP2EC7BH tag=PA3MTB5GTZTQ type=write size=2207094 2024-09-12T17:47:07.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.051+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=CNXAPVJ7OUCU type=del 2024-09-12T17:47:07.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~WLKET0MCY3KF.0 size=964734 2024-09-12T17:47:07.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.055+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=WLKET0MCY3KF tag=GNY4I729RSEJ type=write size=2013310 2024-09-12T17:47:07.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.055+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=EUJ06W05YP0Q type=del 2024-09-12T17:47:07.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.059+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=BMIR1GVBJ28E type=del size=3434947 2024-09-12T17:47:07.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.059+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~LI945RY0BDZ2.0 size=622849 2024-09-12T17:47:07.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.063+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=LI945RY0BDZ2 tag=EIYIYJR4A3BY type=write size=1671425 2024-09-12T17:47:07.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.067+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=09U9SYMXQ9I8 type=del size=1051538 2024-09-12T17:47:07.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.067+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=Y22ZB5F5I8SK type=del 2024-09-12T17:47:07.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.071+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=R2DN2NEVIQ12 type=del size=3160580 2024-09-12T17:47:07.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.075+0000 7f68bc0598c0 1 < canceled operation key=OG0V0I1SDHG5 tag=5CSUL36F0Q3K type=del size=1710832 2024-09-12T17:47:07.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.079+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~65TU3CWF605Z.0 size=1048576 2024-09-12T17:47:07.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.079+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~65TU3CWF605Z.1 size=456929 2024-09-12T17:47:07.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.079+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=65TU3CWF605Z tag=4WN42UWTAPG3 type=write size=2554081 2024-09-12T17:47:07.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.083+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=ULBDHB5Q6EIC type=del 2024-09-12T17:47:07.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.083+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=UTVTSX390DAO type=del size=1848195 2024-09-12T17:47:07.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.087+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=VQKOYHXPCHTV type=del 2024-09-12T17:47:07.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.091+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~DGOEN6C828TY.0 size=1048576 2024-09-12T17:47:07.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.095+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~DGOEN6C828TY.1 size=1048576 2024-09-12T17:47:07.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.095+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~DGOEN6C828TY.2 size=964626 2024-09-12T17:47:07.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.095+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=DGOEN6C828TY tag=5NXUYN9KA0LM type=write size=4110354 2024-09-12T17:47:07.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.099+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~5MW2SRBPUN26.0 size=1048576 2024-09-12T17:47:07.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.103+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~5MW2SRBPUN26.1 size=836745 2024-09-12T17:47:07.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.107+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=5MW2SRBPUN26 tag=6YP3X7LHDLP0 type=write size=2933897 2024-09-12T17:47:07.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.111+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=YWZ8RKK9XZY8 type=del size=1813408 2024-09-12T17:47:07.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.111+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=7761I273QB5S type=del 2024-09-12T17:47:07.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.119+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~3CLYI5VZSRVF.0 size=1048576 2024-09-12T17:47:07.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.119+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~3CLYI5VZSRVF.1 size=1048576 2024-09-12T17:47:07.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.123+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~3CLYI5VZSRVF.2 size=266282 2024-09-12T17:47:07.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.123+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=3CLYI5VZSRVF tag=TOG0U87PR4LX type=write size=3412010 2024-09-12T17:47:07.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.123+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~HC2HE4QJ1ZX2.0 size=1048576 2024-09-12T17:47:07.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.127+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~HC2HE4QJ1ZX2.1 size=91851 2024-09-12T17:47:07.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.131+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=HC2HE4QJ1ZX2 tag=O18GRRH5KV22 type=write size=2189003 2024-09-12T17:47:07.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.135+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=01KL15Q8HQ22 type=del size=47087 2024-09-12T17:47:07.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.135+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~N60S6DWMPFXL.0 size=1048576 2024-09-12T17:47:07.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.139+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~N60S6DWMPFXL.1 size=1048576 2024-09-12T17:47:07.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.139+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~N60S6DWMPFXL.2 size=219475 2024-09-12T17:47:07.149 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.147+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=N60S6DWMPFXL tag=M14P761CJ345 type=write size=3365203 2024-09-12T17:47:07.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.151+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~X1QCM1P75FOA.0 size=515685 2024-09-12T17:47:07.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.151+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=X1QCM1P75FOA tag=COSBHWNAJR8M type=write size=1564261 2024-09-12T17:47:07.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.151+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=KNDAVS5IRDVC type=del 2024-09-12T17:47:07.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.155+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=OWKZUZG8PLJI type=del size=1413567 2024-09-12T17:47:07.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.159+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~PZX1US950QDO.0 size=1048576 2024-09-12T17:47:07.166 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.163+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~PZX1US950QDO.1 size=357298 2024-09-12T17:47:07.171 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.167+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=PZX1US950QDO tag=TM45AMVWT2Y0 type=write size=2454450 2024-09-12T17:47:07.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.171+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=Q6XYQTP12VP9 type=write size=907019 2024-09-12T17:47:07.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.171+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~1SU6L0W0T3JD.0 size=1048576 2024-09-12T17:47:07.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.175+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~1SU6L0W0T3JD.1 size=244854 2024-09-12T17:47:07.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.179+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=1SU6L0W0T3JD tag=0EJVLYIYBB23 type=write size=2342006 2024-09-12T17:47:07.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.183+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=8JB6DQAXTPES type=del size=3568221 2024-09-12T17:47:07.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.191+0000 7f68bc0598c0 1 < suggested remove operation key=UMQLPH9XGWRZ tag=HTZ820VRNDQV type=del 2024-09-12T17:47:07.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.191+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=IY6BECSLRF0X type=write size=529985 2024-09-12T17:47:07.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.195+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~OWENKP2EC7BH.0 size=1048576 2024-09-12T17:47:07.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.199+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~OWENKP2EC7BH.1 size=109942 2024-09-12T17:47:07.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.203+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=OWENKP2EC7BH tag=PA3MTB5GTZTQ type=write size=2207094 2024-09-12T17:47:07.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.207+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=IUSMU5QU9RFW type=del size=1937566 2024-09-12T17:47:07.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.211+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~WLKET0MCY3KF.0 size=964734 2024-09-12T17:47:07.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.215+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=WLKET0MCY3KF tag=GNY4I729RSEJ type=write size=2013310 2024-09-12T17:47:07.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.219+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~1PWRW7FZ94RF.0 size=979831 2024-09-12T17:47:07.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.219+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=1PWRW7FZ94RF tag=BII47V29QVYS type=write size=2028407 2024-09-12T17:47:07.230 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.227+0000 7f68bc0598c0 1 < suggested update operation key=P8T1VX1XFJ31 tag=BMIR1GVBJ28E type=del size=3434947 2024-09-12T17:47:07.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.231+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~0G6TJ884DSKF.0 size=611693 2024-09-12T17:47:07.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.231+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=0G6TJ884DSKF tag=01ZGBVZJ2WAF type=write size=1660269 2024-09-12T17:47:07.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.235+0000 7f68bc0598c0 -1 < failed to complete operation key=P8T1VX1XFJ31 tag=09U9SYMXQ9I8 type=del size=1051538: (22) Invalid argument 2024-09-12T17:47:07.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.235+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=46H7EAYI0UZA type=write size=933065 2024-09-12T17:47:07.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.239+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=R2DN2NEVIQ12 type=del 2024-09-12T17:47:07.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.243+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~CSRZSZO83W3C.0 size=686012 2024-09-12T17:47:07.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.243+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=CSRZSZO83W3C tag=10L1QHCF9UF6 type=write size=1734588 2024-09-12T17:47:07.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.247+0000 7f68bc0598c0 1 < canceled part key=_multipart_7XH1E2GEH9O2.2~65TU3CWF605Z.0 size=1048576 2024-09-12T17:47:07.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.247+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~65TU3CWF605Z.1 size=456929 2024-09-12T17:47:07.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.251+0000 7f68bc0598c0 1 < canceled multipart upload key=7XH1E2GEH9O2 upload=65TU3CWF605Z tag=4WN42UWTAPG3 type=write size=2554081 2024-09-12T17:47:07.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.255+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=NZ3P0XNHYVPW type=del size=1169524 2024-09-12T17:47:07.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.259+0000 7f68bc0598c0 1 < suggested remove operation key=9846YLKC8P8S tag=UTVTSX390DAO type=del 2024-09-12T17:47:07.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.263+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=R470GY6QEB6V type=write size=1004199 2024-09-12T17:47:07.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.263+0000 7f68bc0598c0 1 < canceled part key=_multipart_F4F4P4L8K5D9.2~DGOEN6C828TY.0 size=1048576 2024-09-12T17:47:07.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.267+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~DGOEN6C828TY.1 size=1048576 2024-09-12T17:47:07.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.267+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~DGOEN6C828TY.2 size=964626 2024-09-12T17:47:07.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.271+0000 7f68bc0598c0 1 < canceled multipart upload key=F4F4P4L8K5D9 upload=DGOEN6C828TY tag=5NXUYN9KA0LM type=write size=4110354 2024-09-12T17:47:07.284 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.279+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~QF61N62EL8HS.0 size=1048576 2024-09-12T17:47:07.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.283+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~QF61N62EL8HS.1 size=717855 2024-09-12T17:47:07.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.283+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=QF61N62EL8HS tag=A7RWNXNVDPZ8 type=write size=2815007 2024-09-12T17:47:07.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.287+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=YWZ8RKK9XZY8 type=del 2024-09-12T17:47:07.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.287+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=3AKNWZGOHMDE type=write size=435306 2024-09-12T17:47:07.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.291+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~3CLYI5VZSRVF.0 size=1048576 2024-09-12T17:47:07.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.295+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~3CLYI5VZSRVF.1 size=1048576 2024-09-12T17:47:07.300 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.295+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~3CLYI5VZSRVF.2 size=266282 2024-09-12T17:47:07.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.303+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=3CLYI5VZSRVF tag=TOG0U87PR4LX type=write size=3412010 2024-09-12T17:47:07.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.307+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~SKHJ9ULDB5ZO.0 size=1048576 2024-09-12T17:47:07.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.311+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~SKHJ9ULDB5ZO.1 size=1048576 2024-09-12T17:47:07.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.311+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~SKHJ9ULDB5ZO.2 size=204646 2024-09-12T17:47:07.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.311+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=SKHJ9ULDB5ZO tag=6ZCWXK4QGQKK type=write size=3350374 2024-09-12T17:47:07.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.315+0000 7f68bc0598c0 1 < canceled operation key=XGJSQJ2IXJDK tag=01KL15Q8HQ22 type=del size=47087 2024-09-12T17:47:07.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.319+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~QDFAU7Y15AIP.0 size=738277 2024-09-12T17:47:07.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.319+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=QDFAU7Y15AIP tag=7N17EM9JZCOE type=write size=1786853 2024-09-12T17:47:07.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.323+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~X1QCM1P75FOA.0 size=515685 2024-09-12T17:47:07.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.327+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=X1QCM1P75FOA tag=COSBHWNAJR8M type=write size=1564261 2024-09-12T17:47:07.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.327+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=7457YY8U1U70 type=del size=3364850 2024-09-12T17:47:07.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.331+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=OWKZUZG8PLJI type=del 2024-09-12T17:47:07.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.335+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=BPFZ1A4CTYQH type=write size=33823 2024-09-12T17:47:07.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.339+0000 7f68bc0598c0 1 < suggested remove operation key=2129SG6US3LI tag=Q6XYQTP12VP9 type=write 2024-09-12T17:47:07.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.343+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~21PPTUK16HQ1.0 size=241595 2024-09-12T17:47:07.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.343+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=21PPTUK16HQ1 tag=VPJYRZCL4TJ1 type=write size=1290171 2024-09-12T17:47:07.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.347+0000 7f68bc0598c0 -1 < failed to complete operation key=UMQLPH9XGWRZ tag=8JB6DQAXTPES type=del size=3568221: (22) Invalid argument 2024-09-12T17:47:07.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.347+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=XWZ2M1E4I305 type=del size=1711187 2024-09-12T17:47:07.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.351+0000 7f68bc0598c0 1 < completed write operation key=BKAT5SGAC5Z8 tag=IY6BECSLRF0X type=write size=529985 2024-09-12T17:47:07.358 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.355+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~9RYW6LGHWPRK.0 size=1048576 2024-09-12T17:47:07.360 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.355+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~9RYW6LGHWPRK.1 size=1048576 2024-09-12T17:47:07.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.359+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~9RYW6LGHWPRK.2 size=985908 2024-09-12T17:47:07.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.359+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=9RYW6LGHWPRK tag=TCFZ2M2HZS6N type=write size=4131636 2024-09-12T17:47:07.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.359+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=IUSMU5QU9RFW type=del 2024-09-12T17:47:07.369 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.367+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~AFWXO2GD7PFQ.0 size=925384 2024-09-12T17:47:07.369 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.367+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=AFWXO2GD7PFQ tag=LKI0RCIOTHHL type=write size=1973960 2024-09-12T17:47:07.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.367+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~1PWRW7FZ94RF.0 size=979831 2024-09-12T17:47:07.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.371+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=1PWRW7FZ94RF tag=BII47V29QVYS type=write size=2028407 2024-09-12T17:47:07.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.375+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=UIAD20ZUGWMY type=del size=895999 2024-09-12T17:47:07.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.379+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~0G6TJ884DSKF.0 size=611693 2024-09-12T17:47:07.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.383+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=0G6TJ884DSKF tag=01ZGBVZJ2WAF type=write size=1660269 2024-09-12T17:47:07.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.387+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~R8JY4GIRQ42F.0 size=1048576 2024-09-12T17:47:07.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.387+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~R8JY4GIRQ42F.1 size=1009544 2024-09-12T17:47:07.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.387+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=R8JY4GIRQ42F tag=ZNJRS3P7808X type=write size=3106696 2024-09-12T17:47:07.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.391+0000 7f68bc0598c0 1 < completed write operation key=4R9ENKMRB1GT tag=46H7EAYI0UZA type=write size=933065 2024-09-12T17:47:07.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.395+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=165EBK7Q6I4E type=del size=1296081 2024-09-12T17:47:07.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.399+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~CSRZSZO83W3C.0 size=686012 2024-09-12T17:47:07.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.403+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=CSRZSZO83W3C tag=10L1QHCF9UF6 type=write size=1734588 2024-09-12T17:47:07.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.403+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=HC9C0GJPA8O1 type=del size=1647772 2024-09-12T17:47:07.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.407+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=NZ3P0XNHYVPW type=del 2024-09-12T17:47:07.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.411+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=95S70NFXLXBL type=del size=910787 2024-09-12T17:47:07.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.411+0000 7f68bc0598c0 1 < completed write operation key=DMJZUQJ7IY60 tag=R470GY6QEB6V type=write size=1004199 2024-09-12T17:47:07.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.415+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=1LN7T64N8ALU type=del size=451848 2024-09-12T17:47:07.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.415+0000 7f68bc0598c0 1 < canceled part key=_multipart_RTY1OT2PSAAY.2~QF61N62EL8HS.0 size=1048576 2024-09-12T17:47:07.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.419+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~QF61N62EL8HS.1 size=717855 2024-09-12T17:47:07.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.423+0000 7f68bc0598c0 1 < canceled multipart upload key=RTY1OT2PSAAY upload=QF61N62EL8HS tag=A7RWNXNVDPZ8 type=write size=2815007 2024-09-12T17:47:07.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.427+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=5F6017XS427M type=write size=823123 2024-09-12T17:47:07.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.427+0000 7f68bc0598c0 1 < completed write operation key=3JPRQXKB5K3W tag=3AKNWZGOHMDE type=write size=435306 2024-09-12T17:47:07.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.431+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=CJ11PC6MAS3N type=del size=1457552 2024-09-12T17:47:07.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.435+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~SKHJ9ULDB5ZO.0 size=1048576 2024-09-12T17:47:07.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.435+0000 7f68bc0598c0 1 < canceled part key=_multipart_WPQ755ODAFNT.2~SKHJ9ULDB5ZO.1 size=1048576 2024-09-12T17:47:07.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.435+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~SKHJ9ULDB5ZO.2 size=204646 2024-09-12T17:47:07.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.439+0000 7f68bc0598c0 1 < canceled multipart upload key=WPQ755ODAFNT upload=SKHJ9ULDB5ZO tag=6ZCWXK4QGQKK type=write size=3350374 2024-09-12T17:47:07.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.447+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~NB373L2VJ9J8.0 size=739298 2024-09-12T17:47:07.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.447+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=NB373L2VJ9J8 tag=LDWRZRF11839 type=write size=1787874 2024-09-12T17:47:07.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.447+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~QDFAU7Y15AIP.0 size=738277 2024-09-12T17:47:07.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.451+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=QDFAU7Y15AIP tag=7N17EM9JZCOE type=write size=1786853 2024-09-12T17:47:07.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.455+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=7UOL1DZEAC65 type=del size=2857748 2024-09-12T17:47:07.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.455+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=7457YY8U1U70 type=del 2024-09-12T17:47:07.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.463+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~BYMV3A717LD7.0 size=7804 2024-09-12T17:47:07.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.463+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=BYMV3A717LD7 tag=8QUB6X0CD6AC type=write size=1056380 2024-09-12T17:47:07.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.463+0000 7f68bc0598c0 -1 < failed to complete operation key=2129SG6US3LI tag=BPFZ1A4CTYQH type=write size=33823: (22) Invalid argument 2024-09-12T17:47:07.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.467+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=W12OWLX37G3Q type=del size=787777 2024-09-12T17:47:07.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.467+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~21PPTUK16HQ1.0 size=241595 2024-09-12T17:47:07.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.471+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=21PPTUK16HQ1 tag=VPJYRZCL4TJ1 type=write size=1290171 2024-09-12T17:47:07.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.475+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=ICHTQV2V899H type=del size=323839 2024-09-12T17:47:07.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.479+0000 7f68bc0598c0 1 < suggested update operation key=HGY9WK7MKCYS tag=XWZ2M1E4I305 type=del size=1711187 2024-09-12T17:47:07.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.483+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~38DJFJY2EBBK.0 size=33171 2024-09-12T17:47:07.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.483+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=38DJFJY2EBBK tag=39CF2LDPSYP0 type=write size=1081747 2024-09-12T17:47:07.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.487+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~9RYW6LGHWPRK.0 size=1048576 2024-09-12T17:47:07.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.487+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~9RYW6LGHWPRK.1 size=1048576 2024-09-12T17:47:07.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.491+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~9RYW6LGHWPRK.2 size=985908 2024-09-12T17:47:07.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.495+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=9RYW6LGHWPRK tag=TCFZ2M2HZS6N type=write size=4131636 2024-09-12T17:47:07.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.499+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=0HXJCZ733RC0 type=del size=1159266 2024-09-12T17:47:07.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.499+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~AFWXO2GD7PFQ.0 size=925384 2024-09-12T17:47:07.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.503+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=AFWXO2GD7PFQ tag=LKI0RCIOTHHL type=write size=1973960 2024-09-12T17:47:07.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.507+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~NDJ9C4GK924R.0 size=1048576 2024-09-12T17:47:07.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.511+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~NDJ9C4GK924R.1 size=51098 2024-09-12T17:47:07.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.511+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=NDJ9C4GK924R tag=7AT6Y41O8L4V type=write size=2148250 2024-09-12T17:47:07.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.515+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=UIAD20ZUGWMY type=del 2024-09-12T17:47:07.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.515+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=WRL3YH95ZN85 type=del size=1043486 2024-09-12T17:47:07.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.519+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~R8JY4GIRQ42F.0 size=1048576 2024-09-12T17:47:07.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.519+0000 7f68bc0598c0 1 < canceled part key=_multipart_RTY1OT2PSAAY.2~R8JY4GIRQ42F.1 size=1009544 2024-09-12T17:47:07.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.523+0000 7f68bc0598c0 1 < canceled multipart upload key=RTY1OT2PSAAY upload=R8JY4GIRQ42F tag=ZNJRS3P7808X type=write size=3106696 2024-09-12T17:47:07.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.527+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=T7JQBZ9ZZGRN type=write size=472124 2024-09-12T17:47:07.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.531+0000 7f68bc0598c0 1 < suggested update operation key=FC3K0QN3TAWH tag=165EBK7Q6I4E type=del size=1296081 2024-09-12T17:47:07.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.535+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=PGVOEWKTUUVE type=write size=781815 2024-09-12T17:47:07.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.539+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=HC9C0GJPA8O1 type=del 2024-09-12T17:47:07.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.543+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~6GH3VW7H0WAH.0 size=1048576 2024-09-12T17:47:07.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.543+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~6GH3VW7H0WAH.1 size=617527 2024-09-12T17:47:07.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.543+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=6GH3VW7H0WAH tag=G0XJLICCU9RE type=write size=2714679 2024-09-12T17:47:07.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.547+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=95S70NFXLXBL type=del 2024-09-12T17:47:07.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.551+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~NJ1UN0SY46N7.0 size=434993 2024-09-12T17:47:07.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.551+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=NJ1UN0SY46N7 tag=D5GCNW1U36MG type=write size=1483569 2024-09-12T17:47:07.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.555+0000 7f68bc0598c0 1 < suggested update operation key=57O6H52NHYOL tag=1LN7T64N8ALU type=del size=451848 2024-09-12T17:47:07.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.559+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=FIN3I708LKTQ type=write size=539455 2024-09-12T17:47:07.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.563+0000 7f68bc0598c0 1 < completed write operation key=9846YLKC8P8S tag=5F6017XS427M type=write size=823123 2024-09-12T17:47:07.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.567+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~S4RHBTCOU5R8.0 size=1048576 2024-09-12T17:47:07.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.567+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~S4RHBTCOU5R8.1 size=439427 2024-09-12T17:47:07.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.567+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=S4RHBTCOU5R8 tag=RZ9RF3XFFF99 type=write size=2536579 2024-09-12T17:47:07.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.571+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=CJ11PC6MAS3N type=del 2024-09-12T17:47:07.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.571+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=SQU20YX54OBC type=del size=350068 2024-09-12T17:47:07.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.575+0000 7f68bc0598c0 1 < canceled part key=_multipart_3JPRQXKB5K3W.2~NB373L2VJ9J8.0 size=739298 2024-09-12T17:47:07.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.579+0000 7f68bc0598c0 1 < canceled multipart upload key=3JPRQXKB5K3W upload=NB373L2VJ9J8 tag=LDWRZRF11839 type=write size=1787874 2024-09-12T17:47:07.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.583+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~TMVUW3ZAKXHF.0 size=1048576 2024-09-12T17:47:07.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.587+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~TMVUW3ZAKXHF.1 size=1048576 2024-09-12T17:47:07.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.587+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~TMVUW3ZAKXHF.2 size=634613 2024-09-12T17:47:07.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.587+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=TMVUW3ZAKXHF tag=Y1M7DHHDTTT9 type=write size=3780341 2024-09-12T17:47:07.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.591+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=7UOL1DZEAC65 type=del 2024-09-12T17:47:07.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.591+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=DT65SQNCJ8ZM type=del size=807797 2024-09-12T17:47:07.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.595+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~BYMV3A717LD7.0 size=7804 2024-09-12T17:47:07.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.599+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=BYMV3A717LD7 tag=8QUB6X0CD6AC type=write size=1056380 2024-09-12T17:47:07.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.599+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=7C8952ISVPCZ type=del size=2038478 2024-09-12T17:47:07.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.603+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=W12OWLX37G3Q type=del 2024-09-12T17:47:07.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.607+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=2QGR2BSDPPJO type=del size=1570222 2024-09-12T17:47:07.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.611+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=ICHTQV2V899H type=del 2024-09-12T17:47:07.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.615+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~NT315K2S5D2X.0 size=1048576 2024-09-12T17:47:07.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.615+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~NT315K2S5D2X.1 size=205397 2024-09-12T17:47:07.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.615+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=NT315K2S5D2X tag=D6MDQX7U0BAQ type=write size=2302549 2024-09-12T17:47:07.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.619+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~38DJFJY2EBBK.0 size=33171 2024-09-12T17:47:07.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.623+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=38DJFJY2EBBK tag=39CF2LDPSYP0 type=write size=1081747 2024-09-12T17:47:07.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.627+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=BMUHVJEDXISZ type=del size=774922 2024-09-12T17:47:07.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.631+0000 7f68bc0598c0 1 < suggested update operation key=QGO5SPFPT548 tag=0HXJCZ733RC0 type=del size=1159266 2024-09-12T17:47:07.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.635+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=09R52SDZK3TA type=del size=2529427 2024-09-12T17:47:07.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.639+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~NDJ9C4GK924R.0 size=1048576 2024-09-12T17:47:07.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.639+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~NDJ9C4GK924R.1 size=51098 2024-09-12T17:47:07.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.647+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=NDJ9C4GK924R tag=7AT6Y41O8L4V type=write size=2148250 2024-09-12T17:47:07.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.651+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~XKNYWESUS0TY.0 size=742657 2024-09-12T17:47:07.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.651+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=XKNYWESUS0TY tag=14WHXK3N19S5 type=write size=1791233 2024-09-12T17:47:07.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.655+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=WRL3YH95ZN85 type=del 2024-09-12T17:47:07.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.655+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=X2R7CUO4J1BA type=del size=2749559 2024-09-12T17:47:07.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.663+0000 7f68bc0598c0 1 < suggested remove operation key=6J677S46BXS4 tag=T7JQBZ9ZZGRN type=write 2024-09-12T17:47:07.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.663+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=BB8Z2RQJJGMP type=del size=1748803 2024-09-12T17:47:07.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.667+0000 7f68bc0598c0 1 < completed write operation key=9846YLKC8P8S tag=PGVOEWKTUUVE type=write size=781815 2024-09-12T17:47:07.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.671+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=Z62SYLRQIG48 type=del size=3311946 2024-09-12T17:47:07.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.671+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~6GH3VW7H0WAH.0 size=1048576 2024-09-12T17:47:07.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.675+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~6GH3VW7H0WAH.1 size=617527 2024-09-12T17:47:07.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.679+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=6GH3VW7H0WAH tag=G0XJLICCU9RE type=write size=2714679 2024-09-12T17:47:07.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.679+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=RDUHLG21T7YI type=del size=1515888 2024-09-12T17:47:07.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.683+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~NJ1UN0SY46N7.0 size=434993 2024-09-12T17:47:07.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.687+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=NJ1UN0SY46N7 tag=D5GCNW1U36MG type=write size=1483569 2024-09-12T17:47:07.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.691+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=273RFZO9BD7L type=del size=3935086 2024-09-12T17:47:07.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.695+0000 7f68bc0598c0 1 < completed write operation key=UMQLPH9XGWRZ tag=FIN3I708LKTQ type=write size=539455 2024-09-12T17:47:07.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.695+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=LDQZ2RUYG36Q type=del size=1246592 2024-09-12T17:47:07.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.699+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~S4RHBTCOU5R8.0 size=1048576 2024-09-12T17:47:07.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.699+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~S4RHBTCOU5R8.1 size=439427 2024-09-12T17:47:07.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.703+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=S4RHBTCOU5R8 tag=RZ9RF3XFFF99 type=write size=2536579 2024-09-12T17:47:07.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.711+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~01UK72IU9S8L.0 size=1048576 2024-09-12T17:47:07.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.711+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~01UK72IU9S8L.1 size=644018 2024-09-12T17:47:07.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.711+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=01UK72IU9S8L tag=IQ2W0655H4WC type=write size=2741170 2024-09-12T17:47:07.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.715+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=SQU20YX54OBC type=del 2024-09-12T17:47:07.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.719+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~Z0IV8L77JKZV.0 size=1048576 2024-09-12T17:47:07.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.723+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~Z0IV8L77JKZV.1 size=18917 2024-09-12T17:47:07.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.723+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=Z0IV8L77JKZV tag=O5BG023AYFX2 type=write size=2116069 2024-09-12T17:47:07.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.727+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~TMVUW3ZAKXHF.0 size=1048576 2024-09-12T17:47:07.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.727+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~TMVUW3ZAKXHF.1 size=1048576 2024-09-12T17:47:07.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.731+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~TMVUW3ZAKXHF.2 size=634613 2024-09-12T17:47:07.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.735+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=TMVUW3ZAKXHF tag=Y1M7DHHDTTT9 type=write size=3780341 2024-09-12T17:47:07.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~6936H6K0PVT7.0 size=140741 2024-09-12T17:47:07.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.739+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=6936H6K0PVT7 tag=2884YUKOMTN8 type=write size=1189317 2024-09-12T17:47:07.747 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.743+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=DT65SQNCJ8ZM type=del 2024-09-12T17:47:07.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.747+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=CA874RU2RP2G type=del size=937639 2024-09-12T17:47:07.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.751+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=7C8952ISVPCZ type=del 2024-09-12T17:47:07.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.751+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=ABZWK01R91NA type=write size=971235 2024-09-12T17:47:07.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.755+0000 7f68bc0598c0 -1 < no bi entry to suggest for operation key=6J677S46BXS4 tag=2QGR2BSDPPJO type=del size=1570222: (2) No such file or directory 2024-09-12T17:47:07.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.755+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=VXD8UCVKSHWF type=del size=707803 2024-09-12T17:47:07.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.759+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~NT315K2S5D2X.0 size=1048576 2024-09-12T17:47:07.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.763+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~NT315K2S5D2X.1 size=205397 2024-09-12T17:47:07.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.767+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=NT315K2S5D2X tag=D6MDQX7U0BAQ type=write size=2302549 2024-09-12T17:47:07.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.775+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~MNACPCPH6R1E.0 size=1048576 2024-09-12T17:47:07.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.775+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~MNACPCPH6R1E.1 size=588064 2024-09-12T17:47:07.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.775+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=MNACPCPH6R1E tag=PVMYS21ULW9L type=write size=2685216 2024-09-12T17:47:07.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.779+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=BMUHVJEDXISZ type=del 2024-09-12T17:47:07.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.783+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=83WFR2KRP770 type=del size=3627361 2024-09-12T17:47:07.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.783+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=09R52SDZK3TA type=del 2024-09-12T17:47:07.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.787+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~DNNKC1OOXDLZ.0 size=1048576 2024-09-12T17:47:07.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.791+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~DNNKC1OOXDLZ.1 size=368439 2024-09-12T17:47:07.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.791+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=DNNKC1OOXDLZ tag=XYL20QU6SW37 type=write size=2465591 2024-09-12T17:47:07.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.795+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~XKNYWESUS0TY.0 size=742657 2024-09-12T17:47:07.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.799+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=XKNYWESUS0TY tag=14WHXK3N19S5 type=write size=1791233 2024-09-12T17:47:07.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.803+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~WMA40OD3HRCN.0 size=1048576 2024-09-12T17:47:07.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.807+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~WMA40OD3HRCN.1 size=744146 2024-09-12T17:47:07.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.807+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=WMA40OD3HRCN tag=QWEW6RMFZIPQ type=write size=2841298 2024-09-12T17:47:07.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.815+0000 7f68bc0598c0 1 < suggested update operation key=6J677S46BXS4 tag=X2R7CUO4J1BA type=del size=2749559 2024-09-12T17:47:07.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.819+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~C6H9Q807540Z.0 size=1048576 2024-09-12T17:47:07.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.823+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~C6H9Q807540Z.1 size=819117 2024-09-12T17:47:07.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.823+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=C6H9Q807540Z tag=D0C0N56NP7KR type=write size=2916269 2024-09-12T17:47:07.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.823+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=BB8Z2RQJJGMP type=del 2024-09-12T17:47:07.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.827+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=M9Z71TP1XNS1 type=write size=220958 2024-09-12T17:47:07.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.831+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=Z62SYLRQIG48 type=del 2024-09-12T17:47:07.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.835+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=JUVG0FNBD1SR type=write size=795351 2024-09-12T17:47:07.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.835+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=RDUHLG21T7YI type=del 2024-09-12T17:47:07.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.839+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=UVNIY8TSG49L type=del size=2938610 2024-09-12T17:47:07.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.843+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=273RFZO9BD7L type=del 2024-09-12T17:47:07.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.847+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~KLN9469L9UB0.0 size=1048576 2024-09-12T17:47:07.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.851+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~KLN9469L9UB0.1 size=1048576 2024-09-12T17:47:07.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.851+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~KLN9469L9UB0.2 size=315582 2024-09-12T17:47:07.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.851+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=KLN9469L9UB0 tag=SXDDD8BYX34Q type=write size=3461310 2024-09-12T17:47:07.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.855+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=LDQZ2RUYG36Q type=del 2024-09-12T17:47:07.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.859+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~1ZLNS8PJ6L5F.0 size=1048576 2024-09-12T17:47:07.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.863+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~1ZLNS8PJ6L5F.1 size=775251 2024-09-12T17:47:07.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.863+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=1ZLNS8PJ6L5F tag=D830M1C1MLY1 type=write size=2872403 2024-09-12T17:47:07.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.867+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~01UK72IU9S8L.0 size=1048576 2024-09-12T17:47:07.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.871+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~01UK72IU9S8L.1 size=644018 2024-09-12T17:47:07.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.875+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=01UK72IU9S8L tag=IQ2W0655H4WC type=write size=2741170 2024-09-12T17:47:07.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.879+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=49P4WDET0Q2T type=del size=3336166 2024-09-12T17:47:07.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.879+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~Z0IV8L77JKZV.0 size=1048576 2024-09-12T17:47:07.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.883+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~Z0IV8L77JKZV.1 size=18917 2024-09-12T17:47:07.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.887+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=Z0IV8L77JKZV tag=O5BG023AYFX2 type=write size=2116069 2024-09-12T17:47:07.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.895+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~63J96WIBEWE9.0 size=1048576 2024-09-12T17:47:07.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.899+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~63J96WIBEWE9.1 size=694795 2024-09-12T17:47:07.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.899+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=63J96WIBEWE9 tag=HK37E54EOS9C type=write size=2791947 2024-09-12T17:47:07.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.899+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~6936H6K0PVT7.0 size=140741 2024-09-12T17:47:07.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.907+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=6936H6K0PVT7 tag=2884YUKOMTN8 type=write size=1189317 2024-09-12T17:47:07.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.911+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=BYEZW7DR2VAK type=write size=548584 2024-09-12T17:47:07.916 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.911+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=CA874RU2RP2G type=del 2024-09-12T17:47:07.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.915+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=P04X03KEWSSL type=del size=3614858 2024-09-12T17:47:07.923 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.919+0000 7f68bc0598c0 1 < completed write operation key=UOW521GPXBQ0 tag=ABZWK01R91NA type=write size=971235 2024-09-12T17:47:07.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.927+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~0U1PCJHD5PF9.0 size=1048576 2024-09-12T17:47:07.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.927+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~0U1PCJHD5PF9.1 size=464661 2024-09-12T17:47:07.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.927+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=0U1PCJHD5PF9 tag=USU043PM0266 type=write size=2561813 2024-09-12T17:47:07.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.931+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=VXD8UCVKSHWF type=del 2024-09-12T17:47:07.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.935+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=M57P5XMC00ID type=del size=3216919 2024-09-12T17:47:07.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.935+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~MNACPCPH6R1E.0 size=1048576 2024-09-12T17:47:07.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.939+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~MNACPCPH6R1E.1 size=588064 2024-09-12T17:47:07.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.947+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=MNACPCPH6R1E tag=PVMYS21ULW9L type=write size=2685216 2024-09-12T17:47:07.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.951+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=XH9FFBM4CR70 type=del size=2969855 2024-09-12T17:47:07.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.955+0000 7f68bc0598c0 1 < suggested remove operation key=UMQLPH9XGWRZ tag=83WFR2KRP770 type=del 2024-09-12T17:47:07.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.959+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=3UIQMLHWUBF1 type=del size=3335840 2024-09-12T17:47:07.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.967+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~DNNKC1OOXDLZ.0 size=1048576 2024-09-12T17:47:07.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.967+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~DNNKC1OOXDLZ.1 size=368439 2024-09-12T17:47:07.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.975+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=DNNKC1OOXDLZ tag=XYL20QU6SW37 type=write size=2465591 2024-09-12T17:47:07.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.979+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~SUIF5SRN43PR.0 size=1048576 2024-09-12T17:47:07.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.983+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~SUIF5SRN43PR.1 size=1048576 2024-09-12T17:47:07.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.987+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~SUIF5SRN43PR.2 size=263901 2024-09-12T17:47:07.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.987+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=SUIF5SRN43PR tag=I11EASULOXOY type=write size=3409629 2024-09-12T17:47:07.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.987+0000 7f68bc0598c0 1 < canceled part key=_multipart_6SUA9FBDU69A.2~WMA40OD3HRCN.0 size=1048576 2024-09-12T17:47:07.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.991+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~WMA40OD3HRCN.1 size=744146 2024-09-12T17:47:07.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.995+0000 7f68bc0598c0 1 < canceled multipart upload key=6SUA9FBDU69A upload=WMA40OD3HRCN tag=QWEW6RMFZIPQ type=write size=2841298 2024-09-12T17:47:08.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:07.999+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=HAY4NHS9MND4 type=del size=3373590 2024-09-12T17:47:08.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.003+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~C6H9Q807540Z.0 size=1048576 2024-09-12T17:47:08.008 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.003+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~C6H9Q807540Z.1 size=819117 2024-09-12T17:47:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.007+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=C6H9Q807540Z tag=D0C0N56NP7KR type=write size=2916269 2024-09-12T17:47:08.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.011+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=0EW1NIE62QU0 type=write size=28269 2024-09-12T17:47:08.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.015+0000 7f68bc0598c0 1 < canceled operation key=BKAT5SGAC5Z8 tag=M9Z71TP1XNS1 type=write size=220958 2024-09-12T17:47:08.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.019+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~ALSL1FYZZJU3.0 size=1048576 2024-09-12T17:47:08.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.023+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~ALSL1FYZZJU3.1 size=741970 2024-09-12T17:47:08.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.023+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=ALSL1FYZZJU3 tag=FZ59SUCXXISW type=write size=2839122 2024-09-12T17:47:08.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.027+0000 7f68bc0598c0 1 < completed write operation key=HGY9WK7MKCYS tag=JUVG0FNBD1SR type=write size=795351 2024-09-12T17:47:08.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.031+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=78XL0140U4P5 type=del size=609619 2024-09-12T17:47:08.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.031+0000 7f68bc0598c0 1 < canceled operation key=SBQGW2EK6I1J tag=UVNIY8TSG49L type=del size=2938610 2024-09-12T17:47:08.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.035+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=FYU5HYDJC4E3 type=del size=3463958 2024-09-12T17:47:08.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.039+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~KLN9469L9UB0.0 size=1048576 2024-09-12T17:47:08.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.043+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~KLN9469L9UB0.1 size=1048576 2024-09-12T17:47:08.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.043+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~KLN9469L9UB0.2 size=315582 2024-09-12T17:47:08.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.051+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=KLN9469L9UB0 tag=SXDDD8BYX34Q type=write size=3461310 2024-09-12T17:47:08.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.051+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=J4V2JZR0S1W0 type=del size=3401634 2024-09-12T17:47:08.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.055+0000 7f68bc0598c0 1 < canceled part key=_multipart_OG0V0I1SDHG5.2~1ZLNS8PJ6L5F.0 size=1048576 2024-09-12T17:47:08.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.055+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~1ZLNS8PJ6L5F.1 size=775251 2024-09-12T17:47:08.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.059+0000 7f68bc0598c0 1 < canceled multipart upload key=OG0V0I1SDHG5 upload=1ZLNS8PJ6L5F tag=D830M1C1MLY1 type=write size=2872403 2024-09-12T17:47:08.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.067+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=PQ2TN6FEAGEF type=del size=2573839 2024-09-12T17:47:08.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.071+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=49P4WDET0Q2T type=del 2024-09-12T17:47:08.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.071+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=YW7YMAP7MVDK type=del size=3477778 2024-09-12T17:47:08.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.075+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~63J96WIBEWE9.0 size=1048576 2024-09-12T17:47:08.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.079+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~63J96WIBEWE9.1 size=694795 2024-09-12T17:47:08.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.083+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=63J96WIBEWE9 tag=HK37E54EOS9C type=write size=2791947 2024-09-12T17:47:08.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.087+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=Q6IB2NIYUQZY type=write size=671636 2024-09-12T17:47:08.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.091+0000 7f68bc0598c0 1 < canceled operation key=9846YLKC8P8S tag=BYEZW7DR2VAK type=write size=548584 2024-09-12T17:47:08.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.091+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=46DM4LKBX99X type=del size=1684394 2024-09-12T17:47:08.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.095+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=P04X03KEWSSL type=del 2024-09-12T17:47:08.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.099+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=6ONECMM66RUC type=write size=836461 2024-09-12T17:47:08.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.103+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~0U1PCJHD5PF9.0 size=1048576 2024-09-12T17:47:08.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.103+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~0U1PCJHD5PF9.1 size=464661 2024-09-12T17:47:08.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.107+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=0U1PCJHD5PF9 tag=USU043PM0266 type=write size=2561813 2024-09-12T17:47:08.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.111+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=TRYMFXSW40M2 type=del size=871477 2024-09-12T17:47:08.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.115+0000 7f68bc0598c0 1 < suggested remove operation key=OG0V0I1SDHG5 tag=M57P5XMC00ID type=del 2024-09-12T17:47:08.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.119+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=YURLICCLYVS0 type=del size=1569041 2024-09-12T17:47:08.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.123+0000 7f68bc0598c0 1 < canceled operation key=P8T1VX1XFJ31 tag=XH9FFBM4CR70 type=del size=2969855 2024-09-12T17:47:08.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.127+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=9IEZIY858EQ0 type=write size=878142 2024-09-12T17:47:08.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.127+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=3UIQMLHWUBF1 type=del 2024-09-12T17:47:08.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.131+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=JB35G4HWQG20 type=del size=850078 2024-09-12T17:47:08.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.135+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~SUIF5SRN43PR.0 size=1048576 2024-09-12T17:47:08.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.135+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~SUIF5SRN43PR.1 size=1048576 2024-09-12T17:47:08.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.139+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~SUIF5SRN43PR.2 size=263901 2024-09-12T17:47:08.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.143+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=SUIF5SRN43PR tag=I11EASULOXOY type=write size=3409629 2024-09-12T17:47:08.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.147+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=XOI286T8KPMI type=del size=3051014 2024-09-12T17:47:08.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.151+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=HAY4NHS9MND4 type=del 2024-09-12T17:47:08.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.151+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=BALCP3L5ECT6 type=write size=714191 2024-09-12T17:47:08.163 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.159+0000 7f68bc0598c0 1 < suggested remove operation key=P8T1VX1XFJ31 tag=0EW1NIE62QU0 type=write 2024-09-12T17:47:08.166 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.163+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=R3SYRRJOB7L5 type=write size=902554 2024-09-12T17:47:08.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.167+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~ALSL1FYZZJU3.0 size=1048576 2024-09-12T17:47:08.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.167+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~ALSL1FYZZJU3.1 size=741970 2024-09-12T17:47:08.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.171+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=ALSL1FYZZJU3 tag=FZ59SUCXXISW type=write size=2839122 2024-09-12T17:47:08.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.175+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=JWLGAAILKFQG type=del size=1474066 2024-09-12T17:47:08.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.183+0000 7f68bc0598c0 1 < suggested update operation key=2129SG6US3LI tag=78XL0140U4P5 type=del size=609619 2024-09-12T17:47:08.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.187+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=TFAQKP9M9ZRC type=del size=3213026 2024-09-12T17:47:08.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.191+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=FYU5HYDJC4E3 type=del 2024-09-12T17:47:08.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.195+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~26US6SY37NOC.0 size=53091 2024-09-12T17:47:08.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.195+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=26US6SY37NOC tag=5CIEH8P9PGZF type=write size=1101667 2024-09-12T17:47:08.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.199+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=J4V2JZR0S1W0 type=del 2024-09-12T17:47:08.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.203+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~CG07GWAYTY4H.0 size=1048576 2024-09-12T17:47:08.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.207+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~CG07GWAYTY4H.1 size=1048576 2024-09-12T17:47:08.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~CG07GWAYTY4H.2 size=224105 2024-09-12T17:47:08.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.211+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=CG07GWAYTY4H tag=OE8GVM8V5NN8 type=write size=3369833 2024-09-12T17:47:08.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.211+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=PQ2TN6FEAGEF type=del 2024-09-12T17:47:08.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.219+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~O30F10P4U5O4.0 size=1048576 2024-09-12T17:47:08.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.219+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~O30F10P4U5O4.1 size=891313 2024-09-12T17:47:08.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.219+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=O30F10P4U5O4 tag=TH5JIGSMFR33 type=write size=2988465 2024-09-12T17:47:08.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.223+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=YW7YMAP7MVDK type=del 2024-09-12T17:47:08.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.227+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~TF36BEDF96PI.0 size=740766 2024-09-12T17:47:08.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.227+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=TF36BEDF96PI tag=5SETQ5330OJ6 type=write size=1789342 2024-09-12T17:47:08.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.231+0000 7f68bc0598c0 1 < canceled operation key=9XK00RPA6Q38 tag=Q6IB2NIYUQZY type=write size=671636 2024-09-12T17:47:08.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.235+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=S9HFZF7Q3N3F type=del size=2692261 2024-09-12T17:47:08.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.239+0000 7f68bc0598c0 1 < canceled operation key=9846YLKC8P8S tag=46DM4LKBX99X type=del size=1684394 2024-09-12T17:47:08.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.243+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~JJSYHGHLMSMC.0 size=1048576 2024-09-12T17:47:08.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.243+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~JJSYHGHLMSMC.1 size=1048576 2024-09-12T17:47:08.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.247+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~JJSYHGHLMSMC.2 size=292441 2024-09-12T17:47:08.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.247+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=JJSYHGHLMSMC tag=WMQV3MKXMBD9 type=write size=3438169 2024-09-12T17:47:08.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.251+0000 7f68bc0598c0 1 < suggested update operation key=UOW521GPXBQ0 tag=6ONECMM66RUC type=write size=836461 2024-09-12T17:47:08.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.259+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~K26EB94SYQ56.0 size=33667 2024-09-12T17:47:08.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.259+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=K26EB94SYQ56 tag=QH00OVQPQ9F3 type=write size=1082243 2024-09-12T17:47:08.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.263+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=TRYMFXSW40M2 type=del size=871477 2024-09-12T17:47:08.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.267+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=KG3TR6ONALWQ type=del size=1201089 2024-09-12T17:47:08.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.271+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=YURLICCLYVS0 type=del 2024-09-12T17:47:08.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.275+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=4F9FL5CXL8QL type=del size=2974027 2024-09-12T17:47:08.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.275+0000 7f68bc0598c0 1 < completed write operation key=XGJSQJ2IXJDK tag=9IEZIY858EQ0 type=write size=878142 2024-09-12T17:47:08.285 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.283+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~W8P472CHWZ6U.0 size=283935 2024-09-12T17:47:08.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.283+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=W8P472CHWZ6U tag=PXGSRKEM5U36 type=write size=1332511 2024-09-12T17:47:08.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.283+0000 7f68bc0598c0 1 < canceled operation key=9XK00RPA6Q38 tag=JB35G4HWQG20 type=del size=850078 2024-09-12T17:47:08.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.287+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=03IOLW20CBX0 type=write size=1042135 2024-09-12T17:47:08.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.291+0000 7f68bc0598c0 -1 < failed to complete operation key=2129SG6US3LI tag=XOI286T8KPMI type=del size=3051014: (22) Invalid argument 2024-09-12T17:47:08.299 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.295+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~DAS4Z1E7P3DA.0 size=1048576 2024-09-12T17:47:08.302 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.299+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~DAS4Z1E7P3DA.1 size=1048576 2024-09-12T17:47:08.304 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.299+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~DAS4Z1E7P3DA.2 size=157215 2024-09-12T17:47:08.304 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.299+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=DAS4Z1E7P3DA tag=Z3G057W7YYJO type=write size=3302943 2024-09-12T17:47:08.307 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.303+0000 7f68bc0598c0 1 < completed write operation key=XGJSQJ2IXJDK tag=BALCP3L5ECT6 type=write size=714191 2024-09-12T17:47:08.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.307+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~RX8SJ85X7BYN.0 size=169882 2024-09-12T17:47:08.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.307+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=RX8SJ85X7BYN tag=9UU7TV9GMGXR type=write size=1218458 2024-09-12T17:47:08.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.311+0000 7f68bc0598c0 1 < completed write operation key=4R9ENKMRB1GT tag=R3SYRRJOB7L5 type=write size=902554 2024-09-12T17:47:08.322 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.319+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~A1B3QW1CUXAS.0 size=1048576 2024-09-12T17:47:08.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.319+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~A1B3QW1CUXAS.1 size=1048576 2024-09-12T17:47:08.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.323+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~A1B3QW1CUXAS.2 size=607986 2024-09-12T17:47:08.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.323+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=A1B3QW1CUXAS tag=Q3ZJG5C3S74Z type=write size=3753714 2024-09-12T17:47:08.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.327+0000 7f68bc0598c0 1 < suggested update operation key=3JPRQXKB5K3W tag=JWLGAAILKFQG type=del size=1474066 2024-09-12T17:47:08.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.331+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=XYX5OR0R31NA type=write size=246357 2024-09-12T17:47:08.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.339+0000 7f68bc0598c0 1 < suggested remove operation key=0XFYVNU2Q7KO tag=TFAQKP9M9ZRC type=del 2024-09-12T17:47:08.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.343+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~PRJL4CKFOXV7.0 size=1048576 2024-09-12T17:47:08.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.347+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~PRJL4CKFOXV7.1 size=477737 2024-09-12T17:47:08.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.347+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=PRJL4CKFOXV7 tag=LUGSDKBC5SZ9 type=write size=2574889 2024-09-12T17:47:08.356 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.351+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~26US6SY37NOC.0 size=53091 2024-09-12T17:47:08.360 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.355+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=26US6SY37NOC tag=5CIEH8P9PGZF type=write size=1101667 2024-09-12T17:47:08.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.359+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=WTVZA0WMD7LB type=del size=2519741 2024-09-12T17:47:08.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.363+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~CG07GWAYTY4H.0 size=1048576 2024-09-12T17:47:08.369 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.363+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~CG07GWAYTY4H.1 size=1048576 2024-09-12T17:47:08.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.367+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~CG07GWAYTY4H.2 size=224105 2024-09-12T17:47:08.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.371+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=CG07GWAYTY4H tag=OE8GVM8V5NN8 type=write size=3369833 2024-09-12T17:47:08.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.379+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~2Q6IS718UX0Q.0 size=1048576 2024-09-12T17:47:08.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.379+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~2Q6IS718UX0Q.1 size=1048576 2024-09-12T17:47:08.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.383+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~2Q6IS718UX0Q.2 size=492086 2024-09-12T17:47:08.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.383+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=2Q6IS718UX0Q tag=58LW1FL770G6 type=write size=3637814 2024-09-12T17:47:08.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.387+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~O30F10P4U5O4.0 size=1048576 2024-09-12T17:47:08.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.387+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~O30F10P4U5O4.1 size=891313 2024-09-12T17:47:08.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.391+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=O30F10P4U5O4 tag=TH5JIGSMFR33 type=write size=2988465 2024-09-12T17:47:08.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.395+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=CK2TQZH35RG1 type=del size=657927 2024-09-12T17:47:08.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.399+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~TF36BEDF96PI.0 size=740766 2024-09-12T17:47:08.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.403+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=TF36BEDF96PI tag=5SETQ5330OJ6 type=write size=1789342 2024-09-12T17:47:08.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.407+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=EK66PYUMVOUN type=del size=411411 2024-09-12T17:47:08.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.411+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=S9HFZF7Q3N3F type=del 2024-09-12T17:47:08.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.411+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=DO63L30P2982 type=del size=712657 2024-09-12T17:47:08.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.415+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~JJSYHGHLMSMC.0 size=1048576 2024-09-12T17:47:08.421 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.419+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~JJSYHGHLMSMC.1 size=1048576 2024-09-12T17:47:08.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.419+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~JJSYHGHLMSMC.2 size=292441 2024-09-12T17:47:08.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.427+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=JJSYHGHLMSMC tag=WMQV3MKXMBD9 type=write size=3438169 2024-09-12T17:47:08.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.431+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=FF6ENS9SBY3Y type=write size=559842 2024-09-12T17:47:08.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.431+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~K26EB94SYQ56.0 size=33667 2024-09-12T17:47:08.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.435+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=K26EB94SYQ56 tag=QH00OVQPQ9F3 type=write size=1082243 2024-09-12T17:47:08.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.439+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=EYHTSZFTPSXR type=write size=476305 2024-09-12T17:47:08.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.443+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=KG3TR6ONALWQ type=del 2024-09-12T17:47:08.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.443+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=K1QH5SZSCPFB type=write size=904513 2024-09-12T17:47:08.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.447+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=4F9FL5CXL8QL type=del 2024-09-12T17:47:08.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.451+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~1ZB7C4J86FM4.0 size=1048576 2024-09-12T17:47:08.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.455+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~1ZB7C4J86FM4.1 size=856404 2024-09-12T17:47:08.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.455+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=1ZB7C4J86FM4 tag=R24F82RLYCNY type=write size=2953556 2024-09-12T17:47:08.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.455+0000 7f68bc0598c0 1 < canceled part key=_multipart_MRS3KW2H5AKK.2~W8P472CHWZ6U.0 size=283935 2024-09-12T17:47:08.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.459+0000 7f68bc0598c0 1 < canceled multipart upload key=MRS3KW2H5AKK upload=W8P472CHWZ6U tag=PXGSRKEM5U36 type=write size=1332511 2024-09-12T17:47:08.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.463+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=C2OJLFC763UA type=del size=3141563 2024-09-12T17:47:08.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.463+0000 7f68bc0598c0 1 < completed write operation key=RTY1OT2PSAAY tag=03IOLW20CBX0 type=write size=1042135 2024-09-12T17:47:08.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.467+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=5JUKEQ2LM048 type=del size=1175500 2024-09-12T17:47:08.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.471+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~DAS4Z1E7P3DA.0 size=1048576 2024-09-12T17:47:08.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.471+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~DAS4Z1E7P3DA.1 size=1048576 2024-09-12T17:47:08.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.475+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~DAS4Z1E7P3DA.2 size=157215 2024-09-12T17:47:08.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.479+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=DAS4Z1E7P3DA tag=Z3G057W7YYJO type=write size=3302943 2024-09-12T17:47:08.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.483+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=6NHY2MFJ5R03 type=del size=2949937 2024-09-12T17:47:08.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.487+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~RX8SJ85X7BYN.0 size=169882 2024-09-12T17:47:08.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.491+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=RX8SJ85X7BYN tag=9UU7TV9GMGXR type=write size=1218458 2024-09-12T17:47:08.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.495+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=B543SUBWCO6U type=del size=2327525 2024-09-12T17:47:08.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.495+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~A1B3QW1CUXAS.0 size=1048576 2024-09-12T17:47:08.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.499+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~A1B3QW1CUXAS.1 size=1048576 2024-09-12T17:47:08.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.499+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~A1B3QW1CUXAS.2 size=607986 2024-09-12T17:47:08.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.507+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=A1B3QW1CUXAS tag=Q3ZJG5C3S74Z type=write size=3753714 2024-09-12T17:47:08.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.511+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~J637Z774THHU.0 size=1048576 2024-09-12T17:47:08.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.515+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~J637Z774THHU.1 size=1048576 2024-09-12T17:47:08.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.515+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~J637Z774THHU.2 size=257993 2024-09-12T17:47:08.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.515+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=J637Z774THHU tag=MFO34Q1VEMGB type=write size=3403721 2024-09-12T17:47:08.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.519+0000 7f68bc0598c0 1 < completed write operation key=QGO5SPFPT548 tag=XYX5OR0R31NA type=write size=246357 2024-09-12T17:47:08.527 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.523+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=4T5FRWJWJ1LM type=del size=3727211 2024-09-12T17:47:08.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.527+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~PRJL4CKFOXV7.0 size=1048576 2024-09-12T17:47:08.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.527+0000 7f68bc0598c0 1 < canceled part key=_multipart_XGJSQJ2IXJDK.2~PRJL4CKFOXV7.1 size=477737 2024-09-12T17:47:08.535 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.531+0000 7f68bc0598c0 1 < canceled multipart upload key=XGJSQJ2IXJDK upload=PRJL4CKFOXV7 tag=LUGSDKBC5SZ9 type=write size=2574889 2024-09-12T17:47:08.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.535+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~IPXCJ2EYG2HQ.0 size=28355 2024-09-12T17:47:08.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.535+0000 7f68bc0598c0 1 > prepared multipart upload key=2129SG6US3LI upload=IPXCJ2EYG2HQ tag=P9MOTLJFGTXU type=write size=1076931 2024-09-12T17:47:08.543 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.539+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=WTVZA0WMD7LB type=del 2024-09-12T17:47:08.546 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.543+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=1J2U64OTSQGH type=write size=912151 2024-09-12T17:47:08.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.547+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~2Q6IS718UX0Q.0 size=1048576 2024-09-12T17:47:08.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.547+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~2Q6IS718UX0Q.1 size=1048576 2024-09-12T17:47:08.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.551+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~2Q6IS718UX0Q.2 size=492086 2024-09-12T17:47:08.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.555+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=2Q6IS718UX0Q tag=58LW1FL770G6 type=write size=3637814 2024-09-12T17:47:08.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.559+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=SU3XVRC3N7U1 type=del size=3706767 2024-09-12T17:47:08.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.563+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=CK2TQZH35RG1 type=del 2024-09-12T17:47:08.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.567+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~J0DM0QB6CNYA.0 size=1048576 2024-09-12T17:47:08.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.567+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~J0DM0QB6CNYA.1 size=1048576 2024-09-12T17:47:08.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.571+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~J0DM0QB6CNYA.2 size=943919 2024-09-12T17:47:08.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.571+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=J0DM0QB6CNYA tag=B7VH586BWYZP type=write size=4089647 2024-09-12T17:47:08.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.575+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=EK66PYUMVOUN type=del 2024-09-12T17:47:08.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.575+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=LCUNV8P8RO0L type=del size=3529827 2024-09-12T17:47:08.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.579+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=DO63L30P2982 type=del 2024-09-12T17:47:08.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.583+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=HK5DJ63ZE0IK type=del size=2707333 2024-09-12T17:47:08.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.583+0000 7f68bc0598c0 1 < completed write operation key=6SUA9FBDU69A tag=FF6ENS9SBY3Y type=write size=559842 2024-09-12T17:47:08.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.587+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=FP6ROPXQGOQH type=del size=90572 2024-09-12T17:47:08.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.595+0000 7f68bc0598c0 1 < suggested remove operation key=9846YLKC8P8S tag=EYHTSZFTPSXR type=write 2024-09-12T17:47:08.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.595+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=5RXQ30VGU4W4 type=del size=3288746 2024-09-12T17:47:08.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.599+0000 7f68bc0598c0 1 < completed write operation key=2129SG6US3LI tag=K1QH5SZSCPFB type=write size=904513 2024-09-12T17:47:08.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.603+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=WF1PD63XKCUS type=del size=1852083 2024-09-12T17:47:08.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.607+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~1ZB7C4J86FM4.0 size=1048576 2024-09-12T17:47:08.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.607+0000 7f68bc0598c0 1 < canceled part key=_multipart_NLPTU26RO70S.2~1ZB7C4J86FM4.1 size=856404 2024-09-12T17:47:08.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.611+0000 7f68bc0598c0 1 < canceled multipart upload key=NLPTU26RO70S upload=1ZB7C4J86FM4 tag=R24F82RLYCNY type=write size=2953556 2024-09-12T17:47:08.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.615+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~SYHHO098Q7EH.0 size=1048576 2024-09-12T17:47:08.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.623+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~SYHHO098Q7EH.1 size=754045 2024-09-12T17:47:08.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.623+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=SYHHO098Q7EH tag=UH0RZ473PYGQ type=write size=2851197 2024-09-12T17:47:08.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.623+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=C2OJLFC763UA type=del 2024-09-12T17:47:08.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.627+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=CDMTZO69YFJ4 type=del size=1399636 2024-09-12T17:47:08.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.631+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=5JUKEQ2LM048 type=del 2024-09-12T17:47:08.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.631+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=POFW8X8MCHCT type=write size=729487 2024-09-12T17:47:08.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.635+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=6NHY2MFJ5R03 type=del 2024-09-12T17:47:08.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.639+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~UWDJT6VT0A47.0 size=1048576 2024-09-12T17:47:08.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.643+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~UWDJT6VT0A47.1 size=615197 2024-09-12T17:47:08.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.643+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=UWDJT6VT0A47 tag=2KTLYX4B5MNC type=write size=2712349 2024-09-12T17:47:08.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.647+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=B543SUBWCO6U type=del 2024-09-12T17:47:08.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.647+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=VP8ZRD2CX5W9 type=write size=578283 2024-09-12T17:47:08.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.651+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~J637Z774THHU.0 size=1048576 2024-09-12T17:47:08.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.655+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~J637Z774THHU.1 size=1048576 2024-09-12T17:47:08.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.655+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~J637Z774THHU.2 size=257993 2024-09-12T17:47:08.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.663+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=J637Z774THHU tag=MFO34Q1VEMGB type=write size=3403721 2024-09-12T17:47:08.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.667+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~30TMMSK06CGN.0 size=1048576 2024-09-12T17:47:08.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.671+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~30TMMSK06CGN.1 size=1048576 2024-09-12T17:47:08.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.671+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~30TMMSK06CGN.2 size=167560 2024-09-12T17:47:08.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.671+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=30TMMSK06CGN tag=31CQJOUZ1GXN type=write size=3313288 2024-09-12T17:47:08.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.675+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=4T5FRWJWJ1LM type=del 2024-09-12T17:47:08.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.679+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=7DIAZ0NYX2SS type=del size=3640819 2024-09-12T17:47:08.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.683+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~IPXCJ2EYG2HQ.0 size=28355 2024-09-12T17:47:08.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.687+0000 7f68bc0598c0 1 < completed multipart upload key=2129SG6US3LI upload=IPXCJ2EYG2HQ tag=P9MOTLJFGTXU type=write size=1076931 2024-09-12T17:47:08.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.691+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=2W9PGHSDF7AX type=del size=270401 2024-09-12T17:47:08.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.695+0000 7f68bc0598c0 1 < completed write operation key=MRS3KW2H5AKK tag=1J2U64OTSQGH type=write size=912151 2024-09-12T17:47:08.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.695+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=43ICTYL43NDJ type=del size=3920539 2024-09-12T17:47:08.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.699+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=SU3XVRC3N7U1 type=del 2024-09-12T17:47:08.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.703+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~D207EEW2BMGW.0 size=1039067 2024-09-12T17:47:08.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.703+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=D207EEW2BMGW tag=MHLG0XQI1C3O type=write size=2087643 2024-09-12T17:47:08.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.707+0000 7f68bc0598c0 1 < canceled part key=_multipart_7XH1E2GEH9O2.2~J0DM0QB6CNYA.0 size=1048576 2024-09-12T17:47:08.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.707+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~J0DM0QB6CNYA.1 size=1048576 2024-09-12T17:47:08.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.711+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~J0DM0QB6CNYA.2 size=943919 2024-09-12T17:47:08.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.715+0000 7f68bc0598c0 1 < canceled multipart upload key=7XH1E2GEH9O2 upload=J0DM0QB6CNYA tag=B7VH586BWYZP type=write size=4089647 2024-09-12T17:47:08.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.719+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~0P61BZ26PS2B.0 size=606155 2024-09-12T17:47:08.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.719+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=0P61BZ26PS2B tag=DTFTZTKUR2G7 type=write size=1654731 2024-09-12T17:47:08.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.723+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=LCUNV8P8RO0L type=del 2024-09-12T17:47:08.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.727+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~IE3Q9DZBOKN3.0 size=1048576 2024-09-12T17:47:08.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.731+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~IE3Q9DZBOKN3.1 size=1048576 2024-09-12T17:47:08.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.731+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~IE3Q9DZBOKN3.2 size=95193 2024-09-12T17:47:08.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.731+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=IE3Q9DZBOKN3 tag=056JE46EGPC0 type=write size=3240921 2024-09-12T17:47:08.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.735+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=HK5DJ63ZE0IK type=del 2024-09-12T17:47:08.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.743+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~EGFB68VRLBOC.0 size=1048576 2024-09-12T17:47:08.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.743+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~EGFB68VRLBOC.1 size=572036 2024-09-12T17:47:08.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.743+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=EGFB68VRLBOC tag=2PNLPQ6XWMWP type=write size=2669188 2024-09-12T17:47:08.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.747+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=FP6ROPXQGOQH type=del 2024-09-12T17:47:08.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.751+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~X65BZV0CPCYH.0 size=1048576 2024-09-12T17:47:08.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.755+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~X65BZV0CPCYH.1 size=1048576 2024-09-12T17:47:08.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.759+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~X65BZV0CPCYH.2 size=910642 2024-09-12T17:47:08.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.759+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=X65BZV0CPCYH tag=U4E7ZGHH62MT type=write size=4056370 2024-09-12T17:47:08.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.759+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=5RXQ30VGU4W4 type=del 2024-09-12T17:47:08.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.767+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~WJ1YTDGCFF1C.0 size=699408 2024-09-12T17:47:08.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.767+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=WJ1YTDGCFF1C tag=R14FB5KPPBYW type=write size=1747984 2024-09-12T17:47:08.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.771+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=WF1PD63XKCUS type=del 2024-09-12T17:47:08.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.775+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=DQVK191T3HOK type=del size=1456866 2024-09-12T17:47:08.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.775+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~SYHHO098Q7EH.0 size=1048576 2024-09-12T17:47:08.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.779+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~SYHHO098Q7EH.1 size=754045 2024-09-12T17:47:08.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.783+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=SYHHO098Q7EH tag=UH0RZ473PYGQ type=write size=2851197 2024-09-12T17:47:08.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.787+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=5KBKGB5LHHOU type=del size=154583 2024-09-12T17:47:08.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.795+0000 7f68bc0598c0 1 < suggested remove operation key=UMQLPH9XGWRZ tag=CDMTZO69YFJ4 type=del 2024-09-12T17:47:08.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.799+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~CNV68TACVM4A.0 size=1048576 2024-09-12T17:47:08.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.803+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~CNV68TACVM4A.1 size=1048576 2024-09-12T17:47:08.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.807+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~CNV68TACVM4A.2 size=275397 2024-09-12T17:47:08.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.807+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=CNV68TACVM4A tag=KJP8BU8O3A3I type=write size=3421125 2024-09-12T17:47:08.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.807+0000 7f68bc0598c0 1 < canceled operation key=RTY1OT2PSAAY tag=POFW8X8MCHCT type=write size=729487 2024-09-12T17:47:08.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.811+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=3SDH9SO3XUM7 type=write size=917190 2024-09-12T17:47:08.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.815+0000 7f68bc0598c0 1 < canceled part key=_multipart_HGY9WK7MKCYS.2~UWDJT6VT0A47.0 size=1048576 2024-09-12T17:47:08.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.815+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~UWDJT6VT0A47.1 size=615197 2024-09-12T17:47:08.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.819+0000 7f68bc0598c0 1 < canceled multipart upload key=HGY9WK7MKCYS upload=UWDJT6VT0A47 tag=2KTLYX4B5MNC type=write size=2712349 2024-09-12T17:47:08.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.823+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=OXT4G6VWCZXJ type=del size=3513921 2024-09-12T17:47:08.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.831+0000 7f68bc0598c0 1 < suggested update operation key=2129SG6US3LI tag=VP8ZRD2CX5W9 type=write size=578283 2024-09-12T17:47:08.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.835+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=VD1BCUBJ4IN0 type=del size=1850671 2024-09-12T17:47:08.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.835+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~30TMMSK06CGN.0 size=1048576 2024-09-12T17:47:08.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.839+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~30TMMSK06CGN.1 size=1048576 2024-09-12T17:47:08.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.843+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~30TMMSK06CGN.2 size=167560 2024-09-12T17:47:08.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.847+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=30TMMSK06CGN tag=31CQJOUZ1GXN type=write size=3313288 2024-09-12T17:47:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.851+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=U1DWRYA0XC4S type=del size=1386685 2024-09-12T17:47:08.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.855+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=7DIAZ0NYX2SS type=del 2024-09-12T17:47:08.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.859+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=O1U94080UHIM type=del size=1323231 2024-09-12T17:47:08.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.859+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=2W9PGHSDF7AX type=del 2024-09-12T17:47:08.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.863+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=O4XN5BQ78EQQ type=del size=3562077 2024-09-12T17:47:08.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.867+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=43ICTYL43NDJ type=del 2024-09-12T17:47:08.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.871+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=OE6Y0OPVXDAH type=del size=1917058 2024-09-12T17:47:08.877 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.875+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~D207EEW2BMGW.0 size=1039067 2024-09-12T17:47:08.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.879+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=D207EEW2BMGW tag=MHLG0XQI1C3O type=write size=2087643 2024-09-12T17:47:08.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.883+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=JGBFB7R2GOP9 type=del size=997811 2024-09-12T17:47:08.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.887+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~0P61BZ26PS2B.0 size=606155 2024-09-12T17:47:08.895 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.891+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=0P61BZ26PS2B tag=DTFTZTKUR2G7 type=write size=1654731 2024-09-12T17:47:08.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.895+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~GEYJ19T9LWKQ.0 size=1048576 2024-09-12T17:47:08.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.899+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~GEYJ19T9LWKQ.1 size=932232 2024-09-12T17:47:08.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.899+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=GEYJ19T9LWKQ tag=O43UNRYBIMW1 type=write size=3029384 2024-09-12T17:47:08.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.903+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~IE3Q9DZBOKN3.0 size=1048576 2024-09-12T17:47:08.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.907+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~IE3Q9DZBOKN3.1 size=1048576 2024-09-12T17:47:08.916 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.911+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~IE3Q9DZBOKN3.2 size=95193 2024-09-12T17:47:08.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.919+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=IE3Q9DZBOKN3 tag=056JE46EGPC0 type=write size=3240921 2024-09-12T17:47:08.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.923+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~VPQM0D5XFTX4.0 size=741376 2024-09-12T17:47:08.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.923+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=VPQM0D5XFTX4 tag=TVQ2NPE6J1V6 type=write size=1789952 2024-09-12T17:47:08.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.927+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~EGFB68VRLBOC.0 size=1048576 2024-09-12T17:47:08.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.931+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~EGFB68VRLBOC.1 size=572036 2024-09-12T17:47:08.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.935+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=EGFB68VRLBOC tag=2PNLPQ6XWMWP type=write size=2669188 2024-09-12T17:47:08.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.939+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=4RX9EB78JIG6 type=del size=1474492 2024-09-12T17:47:08.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.943+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~X65BZV0CPCYH.0 size=1048576 2024-09-12T17:47:08.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.943+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~X65BZV0CPCYH.1 size=1048576 2024-09-12T17:47:08.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.947+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~X65BZV0CPCYH.2 size=910642 2024-09-12T17:47:08.956 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.951+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=X65BZV0CPCYH tag=U4E7ZGHH62MT type=write size=4056370 2024-09-12T17:47:08.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.959+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~6TW5ONBTV3U2.0 size=257209 2024-09-12T17:47:08.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.959+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=6TW5ONBTV3U2 tag=F64NO7W0J9AM type=write size=1305785 2024-09-12T17:47:08.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.963+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~WJ1YTDGCFF1C.0 size=699408 2024-09-12T17:47:08.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.967+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=WJ1YTDGCFF1C tag=R14FB5KPPBYW type=write size=1747984 2024-09-12T17:47:08.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.971+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=UEI9OVOC9J07 type=write size=305259 2024-09-12T17:47:08.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.971+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=DQVK191T3HOK type=del 2024-09-12T17:47:08.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.979+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~1GYR1M5KLOA1.0 size=1048576 2024-09-12T17:47:08.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.983+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~1GYR1M5KLOA1.1 size=1048576 2024-09-12T17:47:08.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.983+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~1GYR1M5KLOA1.2 size=142057 2024-09-12T17:47:08.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.983+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=1GYR1M5KLOA1 tag=LDYI9GXV0P4X type=write size=3287785 2024-09-12T17:47:08.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.987+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=5KBKGB5LHHOU type=del 2024-09-12T17:47:08.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.991+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=T3F313MLWCRD type=del size=1830404 2024-09-12T17:47:08.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.995+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~CNV68TACVM4A.0 size=1048576 2024-09-12T17:47:09.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.995+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~CNV68TACVM4A.1 size=1048576 2024-09-12T17:47:09.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:08.999+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~CNV68TACVM4A.2 size=275397 2024-09-12T17:47:09.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.003+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=CNV68TACVM4A tag=KJP8BU8O3A3I type=write size=3421125 2024-09-12T17:47:09.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.011+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~M9L4QZSYTSBW.0 size=724728 2024-09-12T17:47:09.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.011+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=M9L4QZSYTSBW tag=E9NU0Z6PY3UP type=write size=1773304 2024-09-12T17:47:09.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.015+0000 7f68bc0598c0 1 < completed write operation key=WPQ755ODAFNT tag=3SDH9SO3XUM7 type=write size=917190 2024-09-12T17:47:09.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.019+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~OYIA9BODLG6L.0 size=1048576 2024-09-12T17:47:09.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.023+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~OYIA9BODLG6L.1 size=695799 2024-09-12T17:47:09.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.023+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=OYIA9BODLG6L tag=2RLUITDR231B type=write size=2792951 2024-09-12T17:47:09.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.027+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=OXT4G6VWCZXJ type=del 2024-09-12T17:47:09.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.031+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=OMT4VWLV9KFJ type=del size=2572224 2024-09-12T17:47:09.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.035+0000 7f68bc0598c0 1 < canceled operation key=W8JEQ5NOIE6O tag=VD1BCUBJ4IN0 type=del size=1850671 2024-09-12T17:47:09.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.039+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=VKVSJF5EC3BQ type=del size=639550 2024-09-12T17:47:09.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.043+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=U1DWRYA0XC4S type=del 2024-09-12T17:47:09.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.043+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=QVO2HUX5V3EF type=write size=874152 2024-09-12T17:47:09.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.047+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=O1U94080UHIM type=del 2024-09-12T17:47:09.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.051+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=FRWXRDU2UDOJ type=del size=845276 2024-09-12T17:47:09.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.055+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=O4XN5BQ78EQQ type=del 2024-09-12T17:47:09.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.059+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=GGS8FDY10F14 type=del size=906419 2024-09-12T17:47:09.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.063+0000 7f68bc0598c0 1 < canceled operation key=MRS3KW2H5AKK tag=OE6Y0OPVXDAH type=del size=1917058 2024-09-12T17:47:09.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.063+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=4Y9GH5SKQNVZ type=del size=813905 2024-09-12T17:47:09.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.067+0000 7f68bc0598c0 1 < canceled operation key=MRS3KW2H5AKK tag=JGBFB7R2GOP9 type=del size=997811 2024-09-12T17:47:09.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.071+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=OV3JNMXGQIJM type=del size=3849825 2024-09-12T17:47:09.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.075+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~GEYJ19T9LWKQ.0 size=1048576 2024-09-12T17:47:09.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.079+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~GEYJ19T9LWKQ.1 size=932232 2024-09-12T17:47:09.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.083+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=GEYJ19T9LWKQ tag=O43UNRYBIMW1 type=write size=3029384 2024-09-12T17:47:09.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.087+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~4ZGKEC8YHWEH.0 size=30550 2024-09-12T17:47:09.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.087+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=4ZGKEC8YHWEH tag=4HM8EOGAOLF1 type=write size=1079126 2024-09-12T17:47:09.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.091+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~VPQM0D5XFTX4.0 size=741376 2024-09-12T17:47:09.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.099+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=VPQM0D5XFTX4 tag=TVQ2NPE6J1V6 type=write size=1789952 2024-09-12T17:47:09.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.103+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~OW764QRMN6YO.0 size=1048576 2024-09-12T17:47:09.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.107+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~OW764QRMN6YO.1 size=1048576 2024-09-12T17:47:09.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.107+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~OW764QRMN6YO.2 size=873754 2024-09-12T17:47:09.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.107+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=OW764QRMN6YO tag=1JUFWP9BKJ07 type=write size=4019482 2024-09-12T17:47:09.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.111+0000 7f68bc0598c0 1 < canceled operation key=9XK00RPA6Q38 tag=4RX9EB78JIG6 type=del size=1474492 2024-09-12T17:47:09.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.119+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~M3MIM9PHSPYD.0 size=1048576 2024-09-12T17:47:09.124 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.119+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~M3MIM9PHSPYD.1 size=1048576 2024-09-12T17:47:09.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.123+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~M3MIM9PHSPYD.2 size=143954 2024-09-12T17:47:09.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.123+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=M3MIM9PHSPYD tag=E11QHJ4UDFR4 type=write size=3289682 2024-09-12T17:47:09.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.127+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~6TW5ONBTV3U2.0 size=257209 2024-09-12T17:47:09.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.131+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=6TW5ONBTV3U2 tag=F64NO7W0J9AM type=write size=1305785 2024-09-12T17:47:09.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.135+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=MXEZC0VI2GOJ type=del size=3702580 2024-09-12T17:47:09.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.139+0000 7f68bc0598c0 1 < completed write operation key=7XH1E2GEH9O2 tag=UEI9OVOC9J07 type=write size=305259 2024-09-12T17:47:09.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.143+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~SU0X50HIJ97Q.0 size=1048576 2024-09-12T17:47:09.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.147+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~SU0X50HIJ97Q.1 size=434419 2024-09-12T17:47:09.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.147+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=SU0X50HIJ97Q tag=0LAGCDTMNDTY type=write size=2531571 2024-09-12T17:47:09.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.151+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~1GYR1M5KLOA1.0 size=1048576 2024-09-12T17:47:09.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.151+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~1GYR1M5KLOA1.1 size=1048576 2024-09-12T17:47:09.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.151+0000 7f68bc0598c0 1 < canceled part key=_multipart_FC3K0QN3TAWH.2~1GYR1M5KLOA1.2 size=142057 2024-09-12T17:47:09.161 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.159+0000 7f68bc0598c0 1 < canceled multipart upload key=FC3K0QN3TAWH upload=1GYR1M5KLOA1 tag=LDYI9GXV0P4X type=write size=3287785 2024-09-12T17:47:09.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.159+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=EA2L0Y03UNHX type=del size=2934475 2024-09-12T17:47:09.168 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.163+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=T3F313MLWCRD type=del 2024-09-12T17:47:09.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~8GVG26GR6OW1.0 size=710334 2024-09-12T17:47:09.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.171+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=8GVG26GR6OW1 tag=TYOG8TP6K5Y8 type=write size=1758910 2024-09-12T17:47:09.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.171+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~M9L4QZSYTSBW.0 size=724728 2024-09-12T17:47:09.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.179+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=M9L4QZSYTSBW tag=E9NU0Z6PY3UP type=write size=1773304 2024-09-12T17:47:09.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.179+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=DCNMH00SPMJC type=del size=429036 2024-09-12T17:47:09.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.183+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~OYIA9BODLG6L.0 size=1048576 2024-09-12T17:47:09.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.187+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~OYIA9BODLG6L.1 size=695799 2024-09-12T17:47:09.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.191+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=OYIA9BODLG6L tag=2RLUITDR231B type=write size=2792951 2024-09-12T17:47:09.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.195+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=28QE7UKXQ8R3 type=del size=3971437 2024-09-12T17:47:09.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.199+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=OMT4VWLV9KFJ type=del 2024-09-12T17:47:09.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.207+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~SS7OLJW1BQ61.0 size=415234 2024-09-12T17:47:09.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.207+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=SS7OLJW1BQ61 tag=RZ0E4R6ELT3I type=write size=1463810 2024-09-12T17:47:09.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.215+0000 7f68bc0598c0 1 < suggested update operation key=RTY1OT2PSAAY tag=VKVSJF5EC3BQ type=del size=639550 2024-09-12T17:47:09.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.223+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~AALNL1JT9XHI.0 size=887464 2024-09-12T17:47:09.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.223+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=AALNL1JT9XHI tag=BWRHFZ0URGC1 type=write size=1936040 2024-09-12T17:47:09.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.223+0000 7f68bc0598c0 1 < completed write operation key=BKAT5SGAC5Z8 tag=QVO2HUX5V3EF type=write size=874152 2024-09-12T17:47:09.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.227+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=A1XSNFI4E6FF type=del size=1915491 2024-09-12T17:47:09.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.231+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=FRWXRDU2UDOJ type=del 2024-09-12T17:47:09.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.235+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=RY4GZKCEHFZN type=del size=3544569 2024-09-12T17:47:09.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.239+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=GGS8FDY10F14 type=del 2024-09-12T17:47:09.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.243+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=GLCU79K3FIR0 type=del size=469596 2024-09-12T17:47:09.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.243+0000 7f68bc0598c0 1 < canceled operation key=SBQGW2EK6I1J tag=4Y9GH5SKQNVZ type=del size=813905 2024-09-12T17:47:09.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.247+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=QK644UKGOTBO type=del size=1638960 2024-09-12T17:47:09.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.251+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=OV3JNMXGQIJM type=del 2024-09-12T17:47:09.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.255+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=AI5CGMH0HNYT type=del size=3681772 2024-09-12T17:47:09.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.259+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~4ZGKEC8YHWEH.0 size=30550 2024-09-12T17:47:09.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.263+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=4ZGKEC8YHWEH tag=4HM8EOGAOLF1 type=write size=1079126 2024-09-12T17:47:09.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.267+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=29WA2OOO37DP type=write size=150314 2024-09-12T17:47:09.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.271+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~OW764QRMN6YO.0 size=1048576 2024-09-12T17:47:09.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.271+0000 7f68bc0598c0 1 < canceled part key=_multipart_W8JEQ5NOIE6O.2~OW764QRMN6YO.1 size=1048576 2024-09-12T17:47:09.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.271+0000 7f68bc0598c0 1 < canceled part key=_multipart_W8JEQ5NOIE6O.2~OW764QRMN6YO.2 size=873754 2024-09-12T17:47:09.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.279+0000 7f68bc0598c0 1 < canceled multipart upload key=W8JEQ5NOIE6O upload=OW764QRMN6YO tag=1JUFWP9BKJ07 type=write size=4019482 2024-09-12T17:47:09.284 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.279+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=1WPIR3G4AW3L type=del size=2902752 2024-09-12T17:47:09.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.283+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~M3MIM9PHSPYD.0 size=1048576 2024-09-12T17:47:09.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.287+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~M3MIM9PHSPYD.1 size=1048576 2024-09-12T17:47:09.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.291+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~M3MIM9PHSPYD.2 size=143954 2024-09-12T17:47:09.299 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.295+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=M3MIM9PHSPYD tag=E11QHJ4UDFR4 type=write size=3289682 2024-09-12T17:47:09.302 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.299+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=RVDI1VWZLLI1 type=del size=4139485 2024-09-12T17:47:09.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.303+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=MXEZC0VI2GOJ type=del 2024-09-12T17:47:09.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.303+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=32494VJ8FS50 type=del size=2489141 2024-09-12T17:47:09.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.307+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~SU0X50HIJ97Q.0 size=1048576 2024-09-12T17:47:09.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.311+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~SU0X50HIJ97Q.1 size=434419 2024-09-12T17:47:09.320 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.315+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=SU0X50HIJ97Q tag=0LAGCDTMNDTY type=write size=2531571 2024-09-12T17:47:09.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.319+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=424JMMIRSQQS type=del size=1266373 2024-09-12T17:47:09.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.323+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=EA2L0Y03UNHX type=del 2024-09-12T17:47:09.334 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.331+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~NSIUAPR4TNO0.0 size=955988 2024-09-12T17:47:09.334 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.331+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=NSIUAPR4TNO0 tag=GGXKBV3LYZ5B type=write size=2004564 2024-09-12T17:47:09.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.335+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~8GVG26GR6OW1.0 size=710334 2024-09-12T17:47:09.343 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.339+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=8GVG26GR6OW1 tag=TYOG8TP6K5Y8 type=write size=1758910 2024-09-12T17:47:09.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.343+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=GCP01GRN4H4Y type=del size=65740 2024-09-12T17:47:09.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.347+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=DCNMH00SPMJC type=del 2024-09-12T17:47:09.356 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.351+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~0GCTF2DKDGIZ.0 size=1048576 2024-09-12T17:47:09.358 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.355+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~0GCTF2DKDGIZ.1 size=56309 2024-09-12T17:47:09.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.355+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=0GCTF2DKDGIZ tag=ITEHF115TQXT type=write size=2153461 2024-09-12T17:47:09.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.359+0000 7f68bc0598c0 1 < suggested remove operation key=8P0EWBVO0BQD tag=28QE7UKXQ8R3 type=del 2024-09-12T17:47:09.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.363+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=ZG4YXWXZFBMF type=write size=470269 2024-09-12T17:47:09.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.367+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~SS7OLJW1BQ61.0 size=415234 2024-09-12T17:47:09.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.375+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=SS7OLJW1BQ61 tag=RZ0E4R6ELT3I type=write size=1463810 2024-09-12T17:47:09.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.379+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~ST53CX2W5KZT.0 size=1048576 2024-09-12T17:47:09.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.383+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~ST53CX2W5KZT.1 size=1048576 2024-09-12T17:47:09.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.383+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~ST53CX2W5KZT.2 size=762052 2024-09-12T17:47:09.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.383+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=ST53CX2W5KZT tag=44BCPS6I7RID type=write size=3907780 2024-09-12T17:47:09.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.387+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~AALNL1JT9XHI.0 size=887464 2024-09-12T17:47:09.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.391+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=AALNL1JT9XHI tag=BWRHFZ0URGC1 type=write size=1936040 2024-09-12T17:47:09.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.395+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=HRSYDCZEORN7 type=del size=3438331 2024-09-12T17:47:09.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.399+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=A1XSNFI4E6FF type=del 2024-09-12T17:47:09.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.403+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~R36LR4242ZCQ.0 size=1048576 2024-09-12T17:47:09.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.407+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~R36LR4242ZCQ.1 size=1048576 2024-09-12T17:47:09.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.411+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~R36LR4242ZCQ.2 size=672729 2024-09-12T17:47:09.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.411+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=R36LR4242ZCQ tag=KLPVPCPEAERM type=write size=3818457 2024-09-12T17:47:09.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.411+0000 7f68bc0598c0 1 < canceled operation key=RTY1OT2PSAAY tag=RY4GZKCEHFZN type=del size=3544569 2024-09-12T17:47:09.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.415+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=CV1CI1503RL7 type=write size=884421 2024-09-12T17:47:09.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.419+0000 7f68bc0598c0 1 < canceled operation key=HGY9WK7MKCYS tag=GLCU79K3FIR0 type=del size=469596 2024-09-12T17:47:09.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.427+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~0I2PS19WWW0J.0 size=1012167 2024-09-12T17:47:09.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.427+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=0I2PS19WWW0J tag=YXPTQ9NTTRR9 type=write size=2060743 2024-09-12T17:47:09.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.431+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=QK644UKGOTBO type=del 2024-09-12T17:47:09.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.435+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=EBA0CNGJHLSR type=del size=36286 2024-09-12T17:47:09.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.439+0000 7f68bc0598c0 1 < suggested update operation key=P8T1VX1XFJ31 tag=AI5CGMH0HNYT type=del size=3681772 2024-09-12T17:47:09.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.443+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~UDSBWGKYMPSB.0 size=1048576 2024-09-12T17:47:09.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.447+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~UDSBWGKYMPSB.1 size=1048576 2024-09-12T17:47:09.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.451+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~UDSBWGKYMPSB.2 size=808843 2024-09-12T17:47:09.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.451+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=UDSBWGKYMPSB tag=RQWSOJ1NVOG3 type=write size=3954571 2024-09-12T17:47:09.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.455+0000 7f68bc0598c0 1 < completed write operation key=9846YLKC8P8S tag=29WA2OOO37DP type=write size=150314 2024-09-12T17:47:09.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~KVKW0DE9IUOQ.0 size=874963 2024-09-12T17:47:09.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.459+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=KVKW0DE9IUOQ tag=WG286KUC82H2 type=write size=1923539 2024-09-12T17:47:09.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.463+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=1WPIR3G4AW3L type=del 2024-09-12T17:47:09.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.467+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=TTW66OPSECRK type=del size=4170722 2024-09-12T17:47:09.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.471+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=RVDI1VWZLLI1 type=del 2024-09-12T17:47:09.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.479+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~XFA15PZTLD5Z.0 size=1048576 2024-09-12T17:47:09.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.479+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~XFA15PZTLD5Z.1 size=1048576 2024-09-12T17:47:09.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.483+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~XFA15PZTLD5Z.2 size=287670 2024-09-12T17:47:09.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.483+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=XFA15PZTLD5Z tag=KR3K8J4PZ31H type=write size=3433398 2024-09-12T17:47:09.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.487+0000 7f68bc0598c0 1 < canceled operation key=57O6H52NHYOL tag=32494VJ8FS50 type=del size=2489141 2024-09-12T17:47:09.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.491+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=M6KAJS8LI3RF type=write size=577929 2024-09-12T17:47:09.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.495+0000 7f68bc0598c0 1 < suggested remove operation key=7XH1E2GEH9O2 tag=424JMMIRSQQS type=del 2024-09-12T17:47:09.505 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.499+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~OTK2EFU37Y9P.0 size=1048576 2024-09-12T17:47:09.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.503+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~OTK2EFU37Y9P.1 size=379360 2024-09-12T17:47:09.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.503+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=OTK2EFU37Y9P tag=QNQO02H2BLK5 type=write size=2476512 2024-09-12T17:47:09.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.507+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~NSIUAPR4TNO0.0 size=955988 2024-09-12T17:47:09.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.511+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=NSIUAPR4TNO0 tag=GGXKBV3LYZ5B type=write size=2004564 2024-09-12T17:47:09.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.515+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~LF1P8QV0DGH9.0 size=1048576 2024-09-12T17:47:09.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.519+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~LF1P8QV0DGH9.1 size=495991 2024-09-12T17:47:09.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.519+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=LF1P8QV0DGH9 tag=8RKTGY6173D0 type=write size=2593143 2024-09-12T17:47:09.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.523+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=GCP01GRN4H4Y type=del 2024-09-12T17:47:09.535 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.531+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~JLH7DPCDROGB.0 size=755937 2024-09-12T17:47:09.535 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.531+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=JLH7DPCDROGB tag=LMVPSADSD1GS type=write size=1804513 2024-09-12T17:47:09.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.535+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~0GCTF2DKDGIZ.0 size=1048576 2024-09-12T17:47:09.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.535+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~0GCTF2DKDGIZ.1 size=56309 2024-09-12T17:47:09.545 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.543+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=0GCTF2DKDGIZ tag=ITEHF115TQXT type=write size=2153461 2024-09-12T17:47:09.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.543+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=1DL3SEUBRR98 type=del size=1036592 2024-09-12T17:47:09.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.547+0000 7f68bc0598c0 1 < completed write operation key=RTY1OT2PSAAY tag=ZG4YXWXZFBMF type=write size=470269 2024-09-12T17:47:09.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.551+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=KRZI9UGHW7N9 type=write size=134636 2024-09-12T17:47:09.558 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.555+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~ST53CX2W5KZT.0 size=1048576 2024-09-12T17:47:09.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.555+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~ST53CX2W5KZT.1 size=1048576 2024-09-12T17:47:09.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.559+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~ST53CX2W5KZT.2 size=762052 2024-09-12T17:47:09.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.563+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=ST53CX2W5KZT tag=44BCPS6I7RID type=write size=3907780 2024-09-12T17:47:09.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.567+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=XQSWQ7VL2B85 type=del size=162190 2024-09-12T17:47:09.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.567+0000 7f68bc0598c0 -1 < failed to complete operation key=7XH1E2GEH9O2 tag=HRSYDCZEORN7 type=del size=3438331: (22) Invalid argument 2024-09-12T17:47:09.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.575+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~0QSIZBQHOSTH.0 size=1048576 2024-09-12T17:47:09.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.575+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~0QSIZBQHOSTH.1 size=1048576 2024-09-12T17:47:09.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.579+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~0QSIZBQHOSTH.2 size=221698 2024-09-12T17:47:09.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.579+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=0QSIZBQHOSTH tag=TJF2SHY2N374 type=write size=3367426 2024-09-12T17:47:09.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.583+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~R36LR4242ZCQ.0 size=1048576 2024-09-12T17:47:09.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.583+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~R36LR4242ZCQ.1 size=1048576 2024-09-12T17:47:09.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.587+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~R36LR4242ZCQ.2 size=672729 2024-09-12T17:47:09.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.591+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=R36LR4242ZCQ tag=KLPVPCPEAERM type=write size=3818457 2024-09-12T17:47:09.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.595+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=D4R1U0IVJE29 type=del size=2781173 2024-09-12T17:47:09.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.599+0000 7f68bc0598c0 -1 < failed to complete operation key=7XH1E2GEH9O2 tag=CV1CI1503RL7 type=write size=884421: (22) Invalid argument 2024-09-12T17:47:09.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.599+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=W69T0ETYG44W type=write size=960106 2024-09-12T17:47:09.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.603+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~0I2PS19WWW0J.0 size=1012167 2024-09-12T17:47:09.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.607+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=0I2PS19WWW0J tag=YXPTQ9NTTRR9 type=write size=2060743 2024-09-12T17:47:09.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.615+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~9AXW9E4EAY5Z.0 size=486638 2024-09-12T17:47:09.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.615+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=9AXW9E4EAY5Z tag=WURP5XXMTAM6 type=write size=1535214 2024-09-12T17:47:09.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.615+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=EBA0CNGJHLSR type=del 2024-09-12T17:47:09.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.619+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=UHHAIIMKPX88 type=del size=3411499 2024-09-12T17:47:09.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.623+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~UDSBWGKYMPSB.0 size=1048576 2024-09-12T17:47:09.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.627+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~UDSBWGKYMPSB.1 size=1048576 2024-09-12T17:47:09.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.627+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~UDSBWGKYMPSB.2 size=808843 2024-09-12T17:47:09.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.631+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=UDSBWGKYMPSB tag=RQWSOJ1NVOG3 type=write size=3954571 2024-09-12T17:47:09.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.639+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~2NB6TA3D9BS9.0 size=1048576 2024-09-12T17:47:09.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.639+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~2NB6TA3D9BS9.1 size=1048576 2024-09-12T17:47:09.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.643+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~2NB6TA3D9BS9.2 size=1047701 2024-09-12T17:47:09.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.643+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=2NB6TA3D9BS9 tag=76R71IYB0QVP type=write size=4193429 2024-09-12T17:47:09.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.647+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~KVKW0DE9IUOQ.0 size=874963 2024-09-12T17:47:09.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.651+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=KVKW0DE9IUOQ tag=WG286KUC82H2 type=write size=1923539 2024-09-12T17:47:09.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.655+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=H8AIL0FA1I9Z type=del size=3975394 2024-09-12T17:47:09.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.659+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=TTW66OPSECRK type=del 2024-09-12T17:47:09.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.663+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=UJW8D3MCJR1F type=del size=655720 2024-09-12T17:47:09.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.667+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~XFA15PZTLD5Z.0 size=1048576 2024-09-12T17:47:09.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.671+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~XFA15PZTLD5Z.1 size=1048576 2024-09-12T17:47:09.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.671+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~XFA15PZTLD5Z.2 size=287670 2024-09-12T17:47:09.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.679+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=XFA15PZTLD5Z tag=KR3K8J4PZ31H type=write size=3433398 2024-09-12T17:47:09.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.683+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=5XHGRGA1ZNNR type=write size=363910 2024-09-12T17:47:09.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.687+0000 7f68bc0598c0 1 < completed write operation key=HGY9WK7MKCYS tag=M6KAJS8LI3RF type=write size=577929 2024-09-12T17:47:09.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.691+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~6KGUYHQ46H6M.0 size=1048576 2024-09-12T17:47:09.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.695+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~6KGUYHQ46H6M.1 size=644515 2024-09-12T17:47:09.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.695+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=6KGUYHQ46H6M tag=3NYSBUPKLHV1 type=write size=2741667 2024-09-12T17:47:09.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.699+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~OTK2EFU37Y9P.0 size=1048576 2024-09-12T17:47:09.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.699+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~OTK2EFU37Y9P.1 size=379360 2024-09-12T17:47:09.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.703+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=OTK2EFU37Y9P tag=QNQO02H2BLK5 type=write size=2476512 2024-09-12T17:47:09.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.707+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=762QUPE2WVR9 type=del size=3588401 2024-09-12T17:47:09.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.707+0000 7f68bc0598c0 1 < canceled part key=_multipart_FC3K0QN3TAWH.2~LF1P8QV0DGH9.0 size=1048576 2024-09-12T17:47:09.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.711+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~LF1P8QV0DGH9.1 size=495991 2024-09-12T17:47:09.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.715+0000 7f68bc0598c0 1 < canceled multipart upload key=FC3K0QN3TAWH upload=LF1P8QV0DGH9 tag=8RKTGY6173D0 type=write size=2593143 2024-09-12T17:47:09.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.723+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~VM0NU8LIHSDU.0 size=1048576 2024-09-12T17:47:09.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.723+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~VM0NU8LIHSDU.1 size=1048576 2024-09-12T17:47:09.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.727+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~VM0NU8LIHSDU.2 size=288960 2024-09-12T17:47:09.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.727+0000 7f68bc0598c0 1 > prepared multipart upload key=2129SG6US3LI upload=VM0NU8LIHSDU tag=OL3SV6OCDHZW type=write size=3434688 2024-09-12T17:47:09.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.731+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~JLH7DPCDROGB.0 size=755937 2024-09-12T17:47:09.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.735+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=JLH7DPCDROGB tag=LMVPSADSD1GS type=write size=1804513 2024-09-12T17:47:09.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.743+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~YVSD9FB54Y8T.0 size=512698 2024-09-12T17:47:09.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.743+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=YVSD9FB54Y8T tag=4JSJT2EAW9KP type=write size=1561274 2024-09-12T17:47:09.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.747+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=1DL3SEUBRR98 type=del 2024-09-12T17:47:09.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.747+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=9SG9RUT13MST type=del size=4111779 2024-09-12T17:47:09.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.755+0000 7f68bc0598c0 1 < suggested update operation key=UMQLPH9XGWRZ tag=KRZI9UGHW7N9 type=write size=134636 2024-09-12T17:47:09.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.763+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~BXIL41Q0HO5W.0 size=1048576 2024-09-12T17:47:09.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.763+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~BXIL41Q0HO5W.1 size=1048576 2024-09-12T17:47:09.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.767+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~BXIL41Q0HO5W.2 size=368905 2024-09-12T17:47:09.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.767+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=BXIL41Q0HO5W tag=M78E36LNNLIQ type=write size=3514633 2024-09-12T17:47:09.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.771+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=XQSWQ7VL2B85 type=del 2024-09-12T17:47:09.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.771+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=H31HPGW7PTDO type=del size=3621306 2024-09-12T17:47:09.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.775+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~0QSIZBQHOSTH.0 size=1048576 2024-09-12T17:47:09.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.779+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~0QSIZBQHOSTH.1 size=1048576 2024-09-12T17:47:09.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.783+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~0QSIZBQHOSTH.2 size=221698 2024-09-12T17:47:09.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.787+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=0QSIZBQHOSTH tag=TJF2SHY2N374 type=write size=3367426 2024-09-12T17:47:09.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.791+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=JBKZ7SHGV3PA type=del size=2133483 2024-09-12T17:47:09.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.791+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=D4R1U0IVJE29 type=del 2024-09-12T17:47:09.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.799+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~RWT52T9FC2TU.0 size=907488 2024-09-12T17:47:09.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.799+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=RWT52T9FC2TU tag=DJKR79A25P85 type=write size=1956064 2024-09-12T17:47:09.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.803+0000 7f68bc0598c0 1 < completed write operation key=HGY9WK7MKCYS tag=W69T0ETYG44W type=write size=960106 2024-09-12T17:47:09.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.803+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=59EWBWLQIJRS type=del size=2169629 2024-09-12T17:47:09.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.807+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~9AXW9E4EAY5Z.0 size=486638 2024-09-12T17:47:09.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.819+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=9AXW9E4EAY5Z tag=WURP5XXMTAM6 type=write size=1535214 2024-09-12T17:47:09.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.819+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=935I7M63UCK3 type=del size=1132275 2024-09-12T17:47:09.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.827+0000 7f68bc0598c0 1 < suggested remove operation key=WUGDIFCHNL90 tag=UHHAIIMKPX88 type=del 2024-09-12T17:47:09.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.831+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=8143W6EZEYDQ type=del size=707433 2024-09-12T17:47:09.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.835+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~2NB6TA3D9BS9.0 size=1048576 2024-09-12T17:47:09.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.835+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~2NB6TA3D9BS9.1 size=1048576 2024-09-12T17:47:09.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.839+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~2NB6TA3D9BS9.2 size=1047701 2024-09-12T17:47:09.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.843+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=2NB6TA3D9BS9 tag=76R71IYB0QVP type=write size=4193429 2024-09-12T17:47:09.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.847+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=405WRMT4S5D6 type=del size=2208412 2024-09-12T17:47:09.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.851+0000 7f68bc0598c0 1 < canceled operation key=DMJZUQJ7IY60 tag=H8AIL0FA1I9Z type=del size=3975394 2024-09-12T17:47:09.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.855+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=S3GF81IFPEGM type=del size=1349213 2024-09-12T17:47:09.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.859+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=UJW8D3MCJR1F type=del 2024-09-12T17:47:09.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.863+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~NYSAFS37J3MC.0 size=1048576 2024-09-12T17:47:09.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.867+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~NYSAFS37J3MC.1 size=1048576 2024-09-12T17:47:09.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.867+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~NYSAFS37J3MC.2 size=653013 2024-09-12T17:47:09.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.867+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=NYSAFS37J3MC tag=S20VET66N1E6 type=write size=3798741 2024-09-12T17:47:09.877 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.875+0000 7f68bc0598c0 1 < suggested remove operation key=2129SG6US3LI tag=5XHGRGA1ZNNR type=write 2024-09-12T17:47:09.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.875+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=VQ2AF7G79VJ0 type=del size=3965408 2024-09-12T17:47:09.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.879+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~6KGUYHQ46H6M.0 size=1048576 2024-09-12T17:47:09.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.883+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~6KGUYHQ46H6M.1 size=644515 2024-09-12T17:47:09.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.887+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=6KGUYHQ46H6M tag=3NYSBUPKLHV1 type=write size=2741667 2024-09-12T17:47:09.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.891+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=S7MIUHL80JHD type=del size=1430179 2024-09-12T17:47:09.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.895+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=762QUPE2WVR9 type=del 2024-09-12T17:47:09.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.895+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=RC8TTAUWZBNO type=del size=1117207 2024-09-12T17:47:09.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.899+0000 7f68bc0598c0 1 < canceled part key=_multipart_2129SG6US3LI.2~VM0NU8LIHSDU.0 size=1048576 2024-09-12T17:47:09.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.899+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~VM0NU8LIHSDU.1 size=1048576 2024-09-12T17:47:09.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.903+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~VM0NU8LIHSDU.2 size=288960 2024-09-12T17:47:09.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.907+0000 7f68bc0598c0 1 < canceled multipart upload key=2129SG6US3LI upload=VM0NU8LIHSDU tag=OL3SV6OCDHZW type=write size=3434688 2024-09-12T17:47:09.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.911+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~QMSKEV7MJRC5.0 size=332990 2024-09-12T17:47:09.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.911+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=QMSKEV7MJRC5 tag=61ZWZXOHPLLO type=write size=1381566 2024-09-12T17:47:09.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.915+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~YVSD9FB54Y8T.0 size=512698 2024-09-12T17:47:09.925 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.923+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=YVSD9FB54Y8T tag=4JSJT2EAW9KP type=write size=1561274 2024-09-12T17:47:09.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.923+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=XVLLZATDPXK9 type=del size=1673251 2024-09-12T17:47:09.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.927+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=9SG9RUT13MST type=del 2024-09-12T17:47:09.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.931+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=2V6TMTEGJK4Z type=del size=159724 2024-09-12T17:47:09.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.935+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~BXIL41Q0HO5W.0 size=1048576 2024-09-12T17:47:09.940 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.935+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~BXIL41Q0HO5W.1 size=1048576 2024-09-12T17:47:09.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.939+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~BXIL41Q0HO5W.2 size=368905 2024-09-12T17:47:09.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.943+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=BXIL41Q0HO5W tag=M78E36LNNLIQ type=write size=3514633 2024-09-12T17:47:09.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.951+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~DMS05IRVL70B.0 size=817824 2024-09-12T17:47:09.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.951+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=DMS05IRVL70B tag=5KMQRLWL04QO type=write size=1866400 2024-09-12T17:47:09.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.955+0000 7f68bc0598c0 1 < suggested remove operation key=SBQGW2EK6I1J tag=H31HPGW7PTDO type=del 2024-09-12T17:47:09.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.963+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~OJ32C2FZXWIP.0 size=1048576 2024-09-12T17:47:09.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.967+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~OJ32C2FZXWIP.1 size=1048576 2024-09-12T17:47:09.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.967+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~OJ32C2FZXWIP.2 size=219690 2024-09-12T17:47:09.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.967+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=OJ32C2FZXWIP tag=A62RJ41GUV8W type=write size=3365418 2024-09-12T17:47:09.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.975+0000 7f68bc0598c0 1 < suggested remove operation key=W8JEQ5NOIE6O tag=JBKZ7SHGV3PA type=del 2024-09-12T17:47:09.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.979+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~ZF7E61USSFQZ.0 size=1048576 2024-09-12T17:47:09.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.983+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~ZF7E61USSFQZ.1 size=1048576 2024-09-12T17:47:09.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.987+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~ZF7E61USSFQZ.2 size=955698 2024-09-12T17:47:09.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.987+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=ZF7E61USSFQZ tag=62COW9YBN1GU type=write size=4101426 2024-09-12T17:47:09.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.991+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~RWT52T9FC2TU.0 size=907488 2024-09-12T17:47:09.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.995+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=RWT52T9FC2TU tag=DJKR79A25P85 type=write size=1956064 2024-09-12T17:47:10.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.999+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~RCSL7MO6U7NK.0 size=841569 2024-09-12T17:47:10.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:09.999+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=RCSL7MO6U7NK tag=1ZY0P6NWVZ6S type=write size=1890145 2024-09-12T17:47:10.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.007+0000 7f68bc0598c0 1 < suggested remove operation key=8P0EWBVO0BQD tag=59EWBWLQIJRS type=del 2024-09-12T17:47:10.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.007+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=7LF2201IWUPS type=write size=242312 2024-09-12T17:47:10.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.011+0000 7f68bc0598c0 1 < canceled operation key=6SUA9FBDU69A tag=935I7M63UCK3 type=del size=1132275 2024-09-12T17:47:10.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.011+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=6FZC64HV7ZNU type=del size=286026 2024-09-12T17:47:10.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.015+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=8143W6EZEYDQ type=del 2024-09-12T17:47:10.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.015+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=QKI1KIDZ709K type=del size=162344 2024-09-12T17:47:10.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.023+0000 7f68bc0598c0 1 < suggested remove operation key=BKAT5SGAC5Z8 tag=405WRMT4S5D6 type=del 2024-09-12T17:47:10.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.023+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=VQN6NXIFLXKL type=del size=2728990 2024-09-12T17:47:10.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.027+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=S3GF81IFPEGM type=del 2024-09-12T17:47:10.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.031+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=INGR641U3S04 type=write size=124725 2024-09-12T17:47:10.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.031+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~NYSAFS37J3MC.0 size=1048576 2024-09-12T17:47:10.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.035+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~NYSAFS37J3MC.1 size=1048576 2024-09-12T17:47:10.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.035+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~NYSAFS37J3MC.2 size=653013 2024-09-12T17:47:10.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.039+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=NYSAFS37J3MC tag=S20VET66N1E6 type=write size=3798741 2024-09-12T17:47:10.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.043+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=MJFZO1MKA223 type=del size=4137013 2024-09-12T17:47:10.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.043+0000 7f68bc0598c0 1 < canceled operation key=P8T1VX1XFJ31 tag=VQ2AF7G79VJ0 type=del size=3965408 2024-09-12T17:47:10.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.047+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=2DG46TQYE7NO type=write size=828597 2024-09-12T17:47:10.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.047+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=S7MIUHL80JHD type=del 2024-09-12T17:47:10.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.051+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=Q5GL2H8IGHJI type=del size=1894045 2024-09-12T17:47:10.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.051+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=RC8TTAUWZBNO type=del 2024-09-12T17:47:10.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.055+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=QO1R6GG4Z14O type=del size=3234451 2024-09-12T17:47:10.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.059+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~QMSKEV7MJRC5.0 size=332990 2024-09-12T17:47:10.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.063+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=QMSKEV7MJRC5 tag=61ZWZXOHPLLO type=write size=1381566 2024-09-12T17:47:10.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.067+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=9BVO8BLYUV05 type=del size=3659399 2024-09-12T17:47:10.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.067+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=XVLLZATDPXK9 type=del 2024-09-12T17:47:10.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.071+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~8BVGSIPUYFE1.0 size=1048576 2024-09-12T17:47:10.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.075+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~8BVGSIPUYFE1.1 size=858923 2024-09-12T17:47:10.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.075+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=8BVGSIPUYFE1 tag=M445J5P4IQOM type=write size=2956075 2024-09-12T17:47:10.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.079+0000 7f68bc0598c0 1 < suggested update operation key=7XH1E2GEH9O2 tag=2V6TMTEGJK4Z type=del size=159724 2024-09-12T17:47:10.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.083+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=NC59H26PSGDD type=del size=985223 2024-09-12T17:47:10.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.087+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~DMS05IRVL70B.0 size=817824 2024-09-12T17:47:10.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.091+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=DMS05IRVL70B tag=5KMQRLWL04QO type=write size=1866400 2024-09-12T17:47:10.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.095+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=MFLYTV0Q36SR type=del size=3483958 2024-09-12T17:47:10.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.095+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~OJ32C2FZXWIP.0 size=1048576 2024-09-12T17:47:10.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.099+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~OJ32C2FZXWIP.1 size=1048576 2024-09-12T17:47:10.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.099+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~OJ32C2FZXWIP.2 size=219690 2024-09-12T17:47:10.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.103+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=OJ32C2FZXWIP tag=A62RJ41GUV8W type=write size=3365418 2024-09-12T17:47:10.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.111+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~FF5T2N5VXLAL.0 size=1048576 2024-09-12T17:47:10.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.111+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~FF5T2N5VXLAL.1 size=1048576 2024-09-12T17:47:10.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.111+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~FF5T2N5VXLAL.2 size=531843 2024-09-12T17:47:10.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.111+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=FF5T2N5VXLAL tag=KLAV8LJV4O2H type=write size=3677571 2024-09-12T17:47:10.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.115+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~ZF7E61USSFQZ.0 size=1048576 2024-09-12T17:47:10.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.119+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~ZF7E61USSFQZ.1 size=1048576 2024-09-12T17:47:10.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.119+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~ZF7E61USSFQZ.2 size=955698 2024-09-12T17:47:10.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.123+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=ZF7E61USSFQZ tag=62COW9YBN1GU type=write size=4101426 2024-09-12T17:47:10.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.127+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~GGGPH4F9LMND.0 size=811478 2024-09-12T17:47:10.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.127+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=GGGPH4F9LMND tag=2G63O3U28ZP9 type=write size=1860054 2024-09-12T17:47:10.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.131+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~RCSL7MO6U7NK.0 size=841569 2024-09-12T17:47:10.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.135+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=RCSL7MO6U7NK tag=1ZY0P6NWVZ6S type=write size=1890145 2024-09-12T17:47:10.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.139+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~QO2Z60W5Z3SP.0 size=1048576 2024-09-12T17:47:10.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.143+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~QO2Z60W5Z3SP.1 size=1048576 2024-09-12T17:47:10.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.143+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~QO2Z60W5Z3SP.2 size=309622 2024-09-12T17:47:10.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.143+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=QO2Z60W5Z3SP tag=ZP3VKY5J2N6Z type=write size=3455350 2024-09-12T17:47:10.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.147+0000 7f68bc0598c0 1 < completed write operation key=0XFYVNU2Q7KO tag=7LF2201IWUPS type=write size=242312 2024-09-12T17:47:10.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.151+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~BKR8FNZKMZKX.0 size=1048576 2024-09-12T17:47:10.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.151+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~BKR8FNZKMZKX.1 size=1048576 2024-09-12T17:47:10.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.155+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~BKR8FNZKMZKX.2 size=649155 2024-09-12T17:47:10.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.155+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=BKR8FNZKMZKX tag=BF2IUBJUEUVF type=write size=3794883 2024-09-12T17:47:10.161 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.159+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=6FZC64HV7ZNU type=del 2024-09-12T17:47:10.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.159+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=CU4QC1PORZPV type=del size=814256 2024-09-12T17:47:10.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.163+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=QKI1KIDZ709K type=del 2024-09-12T17:47:10.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~QAR0D94PN6MU.0 size=1048576 2024-09-12T17:47:10.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~QAR0D94PN6MU.1 size=39040 2024-09-12T17:47:10.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.171+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=QAR0D94PN6MU tag=IJX2EDHDW3UK type=write size=2136192 2024-09-12T17:47:10.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.179+0000 7f68bc0598c0 1 < suggested remove operation key=8P0EWBVO0BQD tag=VQN6NXIFLXKL type=del 2024-09-12T17:47:10.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.183+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~QV085D7L0274.0 size=1048576 2024-09-12T17:47:10.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.187+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~QV085D7L0274.1 size=403231 2024-09-12T17:47:10.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.187+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=QV085D7L0274 tag=7NGGK154YQ3Z type=write size=2500383 2024-09-12T17:47:10.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.191+0000 7f68bc0598c0 1 < completed write operation key=2129SG6US3LI tag=INGR641U3S04 type=write size=124725 2024-09-12T17:47:10.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.191+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=OLNVK76E8WRG type=del size=71521 2024-09-12T17:47:10.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.195+0000 7f68bc0598c0 -1 < failed to complete operation key=7XH1E2GEH9O2 tag=MJFZO1MKA223 type=del size=4137013: (22) Invalid argument 2024-09-12T17:47:10.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.199+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=LUL1ZLQZSFNF type=del size=1974256 2024-09-12T17:47:10.205 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.203+0000 7f68bc0598c0 1 < completed write operation key=6SUA9FBDU69A tag=2DG46TQYE7NO type=write size=828597 2024-09-12T17:47:10.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.207+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~74JAGYAICL8T.0 size=313756 2024-09-12T17:47:10.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.207+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=74JAGYAICL8T tag=NZ8QRX953JCC type=write size=1362332 2024-09-12T17:47:10.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.207+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=Q5GL2H8IGHJI type=del 2024-09-12T17:47:10.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.211+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=809VPL54LIVF type=write size=527408 2024-09-12T17:47:10.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.215+0000 7f68bc0598c0 1 < suggested remove operation key=QGO5SPFPT548 tag=QO1R6GG4Z14O type=del 2024-09-12T17:47:10.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.219+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=KZ5DAJUBBVZY type=del size=3287015 2024-09-12T17:47:10.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.219+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=9BVO8BLYUV05 type=del 2024-09-12T17:47:10.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.223+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=1D1CK5H5EIRG type=write size=921827 2024-09-12T17:47:10.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.227+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~8BVGSIPUYFE1.0 size=1048576 2024-09-12T17:47:10.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.227+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~8BVGSIPUYFE1.1 size=858923 2024-09-12T17:47:10.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.231+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=8BVGSIPUYFE1 tag=M445J5P4IQOM type=write size=2956075 2024-09-12T17:47:10.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.235+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~FER5W9NCP9J2.0 size=1048576 2024-09-12T17:47:10.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.239+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~FER5W9NCP9J2.1 size=1048576 2024-09-12T17:47:10.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.239+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~FER5W9NCP9J2.2 size=263729 2024-09-12T17:47:10.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.239+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=FER5W9NCP9J2 tag=P4VF7H3PA341 type=write size=3409457 2024-09-12T17:47:10.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.243+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=NC59H26PSGDD type=del 2024-09-12T17:47:10.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.247+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~2UZ00CW4KVBZ.0 size=1048576 2024-09-12T17:47:10.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.247+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~2UZ00CW4KVBZ.1 size=1048576 2024-09-12T17:47:10.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.251+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~2UZ00CW4KVBZ.2 size=883295 2024-09-12T17:47:10.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.251+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=2UZ00CW4KVBZ tag=0QKI4WU1NO7S type=write size=4029023 2024-09-12T17:47:10.259 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.255+0000 7f68bc0598c0 1 < suggested update operation key=NLPTU26RO70S tag=MFLYTV0Q36SR type=del size=3483958 2024-09-12T17:47:10.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.259+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~8N2EYMKFZEPJ.0 size=1048576 2024-09-12T17:47:10.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.263+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~8N2EYMKFZEPJ.1 size=166029 2024-09-12T17:47:10.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.263+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=8N2EYMKFZEPJ tag=DQ9MDUVJ2GB7 type=write size=2263181 2024-09-12T17:47:10.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.263+0000 7f68bc0598c0 1 < canceled part key=_multipart_S0B1RP89NO44.2~FF5T2N5VXLAL.0 size=1048576 2024-09-12T17:47:10.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.263+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~FF5T2N5VXLAL.1 size=1048576 2024-09-12T17:47:10.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.263+0000 7f68bc0598c0 1 < canceled part key=_multipart_S0B1RP89NO44.2~FF5T2N5VXLAL.2 size=531843 2024-09-12T17:47:10.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.267+0000 7f68bc0598c0 1 < canceled multipart upload key=S0B1RP89NO44 upload=FF5T2N5VXLAL tag=KLAV8LJV4O2H type=write size=3677571 2024-09-12T17:47:10.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.275+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~B346ELOWYY2O.0 size=1048576 2024-09-12T17:47:10.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.275+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~B346ELOWYY2O.1 size=948849 2024-09-12T17:47:10.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.275+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=B346ELOWYY2O tag=VCTN6CQU0LJO type=write size=3046001 2024-09-12T17:47:10.282 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.279+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~GGGPH4F9LMND.0 size=811478 2024-09-12T17:47:10.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.283+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=GGGPH4F9LMND tag=2G63O3U28ZP9 type=write size=1860054 2024-09-12T17:47:10.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.283+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=MNN8IOD03A1N type=write size=98156 2024-09-12T17:47:10.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.287+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~QO2Z60W5Z3SP.0 size=1048576 2024-09-12T17:47:10.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.291+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~QO2Z60W5Z3SP.1 size=1048576 2024-09-12T17:47:10.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.291+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~QO2Z60W5Z3SP.2 size=309622 2024-09-12T17:47:10.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.299+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=QO2Z60W5Z3SP tag=ZP3VKY5J2N6Z type=write size=3455350 2024-09-12T17:47:10.303 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.299+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=LP6UNK3AZS1L type=del size=4078180 2024-09-12T17:47:10.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.303+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~BKR8FNZKMZKX.0 size=1048576 2024-09-12T17:47:10.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.303+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~BKR8FNZKMZKX.1 size=1048576 2024-09-12T17:47:10.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.307+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~BKR8FNZKMZKX.2 size=649155 2024-09-12T17:47:10.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.311+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=BKR8FNZKMZKX tag=BF2IUBJUEUVF type=write size=3794883 2024-09-12T17:47:10.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.315+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=B91ZVXEFN37B type=del size=2131252 2024-09-12T17:47:10.320 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.315+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=CU4QC1PORZPV type=del 2024-09-12T17:47:10.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.319+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=QULMIVD101DL type=del size=1004513 2024-09-12T17:47:10.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.323+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~QAR0D94PN6MU.0 size=1048576 2024-09-12T17:47:10.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.327+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~QAR0D94PN6MU.1 size=39040 2024-09-12T17:47:10.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.335+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=QAR0D94PN6MU tag=IJX2EDHDW3UK type=write size=2136192 2024-09-12T17:47:10.339 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.335+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=6KH8G2FSRP61 type=del size=31725 2024-09-12T17:47:10.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.339+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~QV085D7L0274.0 size=1048576 2024-09-12T17:47:10.345 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.339+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~QV085D7L0274.1 size=403231 2024-09-12T17:47:10.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.343+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=QV085D7L0274 tag=7NGGK154YQ3Z type=write size=2500383 2024-09-12T17:47:10.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.351+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~R0SX3IFAE3NH.0 size=1048576 2024-09-12T17:47:10.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.351+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~R0SX3IFAE3NH.1 size=815540 2024-09-12T17:47:10.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.351+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=R0SX3IFAE3NH tag=821CF88AT41B type=write size=2912692 2024-09-12T17:47:10.358 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.355+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=OLNVK76E8WRG type=del 2024-09-12T17:47:10.360 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.355+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=AGO2N3265CHQ type=del size=642023 2024-09-12T17:47:10.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.359+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=LUL1ZLQZSFNF type=del 2024-09-12T17:47:10.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.363+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=NPG1WMQGGXVY type=del size=3395446 2024-09-12T17:47:10.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.363+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~74JAGYAICL8T.0 size=313756 2024-09-12T17:47:10.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.367+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=74JAGYAICL8T tag=NZ8QRX953JCC type=write size=1362332 2024-09-12T17:47:10.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.371+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=WWFWH8B1IVWD type=write size=217246 2024-09-12T17:47:10.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.375+0000 7f68bc0598c0 1 < completed write operation key=DMJZUQJ7IY60 tag=809VPL54LIVF type=write size=527408 2024-09-12T17:47:10.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.379+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~61B3V4ANZEOT.0 size=382429 2024-09-12T17:47:10.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.379+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=61B3V4ANZEOT tag=5VQIRDKBFDMH type=write size=1431005 2024-09-12T17:47:10.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.383+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=KZ5DAJUBBVZY type=del 2024-09-12T17:47:10.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.387+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=FZUQD6LO0SV2 type=write size=27192 2024-09-12T17:47:10.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.387+0000 7f68bc0598c0 1 < completed write operation key=MRS3KW2H5AKK tag=1D1CK5H5EIRG type=write size=921827 2024-09-12T17:47:10.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.391+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=AMLZX4HXVQNR type=del size=427046 2024-09-12T17:47:10.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.395+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~FER5W9NCP9J2.0 size=1048576 2024-09-12T17:47:10.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.399+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~FER5W9NCP9J2.1 size=1048576 2024-09-12T17:47:10.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.399+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~FER5W9NCP9J2.2 size=263729 2024-09-12T17:47:10.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.403+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=FER5W9NCP9J2 tag=P4VF7H3PA341 type=write size=3409457 2024-09-12T17:47:10.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.407+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=ZBWZTVMQ89W1 type=del size=2338767 2024-09-12T17:47:10.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.407+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~2UZ00CW4KVBZ.0 size=1048576 2024-09-12T17:47:10.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.411+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~2UZ00CW4KVBZ.1 size=1048576 2024-09-12T17:47:10.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.411+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~2UZ00CW4KVBZ.2 size=883295 2024-09-12T17:47:10.421 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.415+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=2UZ00CW4KVBZ tag=0QKI4WU1NO7S type=write size=4029023 2024-09-12T17:47:10.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.419+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=6ZCA3LPPULHC type=del size=2178070 2024-09-12T17:47:10.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.423+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~8N2EYMKFZEPJ.0 size=1048576 2024-09-12T17:47:10.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.423+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~8N2EYMKFZEPJ.1 size=166029 2024-09-12T17:47:10.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.427+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=8N2EYMKFZEPJ tag=DQ9MDUVJ2GB7 type=write size=2263181 2024-09-12T17:47:10.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.431+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=HEPG89YU8CHC type=write size=582532 2024-09-12T17:47:10.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.431+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~B346ELOWYY2O.0 size=1048576 2024-09-12T17:47:10.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.435+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~B346ELOWYY2O.1 size=948849 2024-09-12T17:47:10.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.439+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=B346ELOWYY2O tag=VCTN6CQU0LJO type=write size=3046001 2024-09-12T17:47:10.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.443+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~046WXP1MD7SW.0 size=1048576 2024-09-12T17:47:10.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.443+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~046WXP1MD7SW.1 size=1048576 2024-09-12T17:47:10.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.447+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~046WXP1MD7SW.2 size=631318 2024-09-12T17:47:10.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.447+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=046WXP1MD7SW tag=7TWH3L9XZMGI type=write size=3777046 2024-09-12T17:47:10.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.447+0000 7f68bc0598c0 1 < completed write operation key=9846YLKC8P8S tag=MNN8IOD03A1N type=write size=98156 2024-09-12T17:47:10.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.451+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=QB9SVRKWUCTK type=del size=516466 2024-09-12T17:47:10.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.455+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=LP6UNK3AZS1L type=del 2024-09-12T17:47:10.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~0N9IXUTA0752.0 size=1048576 2024-09-12T17:47:10.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~0N9IXUTA0752.1 size=1048576 2024-09-12T17:47:10.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~0N9IXUTA0752.2 size=859512 2024-09-12T17:47:10.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.459+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=0N9IXUTA0752 tag=F46Q4I1CLXDT type=write size=4005240 2024-09-12T17:47:10.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.463+0000 7f68bc0598c0 1 < canceled operation key=P8T1VX1XFJ31 tag=B91ZVXEFN37B type=del size=2131252 2024-09-12T17:47:10.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.463+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=E4YVGTSPU1TL type=del size=2035401 2024-09-12T17:47:10.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.471+0000 7f68bc0598c0 1 < suggested update operation key=S0B1RP89NO44 tag=QULMIVD101DL type=del size=1004513 2024-09-12T17:47:10.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.475+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~45JR1GOPPZYZ.0 size=1048576 2024-09-12T17:47:10.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.475+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~45JR1GOPPZYZ.1 size=7359 2024-09-12T17:47:10.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.475+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=45JR1GOPPZYZ tag=YONWZOMIREVR type=write size=2104511 2024-09-12T17:47:10.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.479+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=6KH8G2FSRP61 type=del 2024-09-12T17:47:10.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.479+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=H6X63SXCRRFX type=write size=157604 2024-09-12T17:47:10.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.483+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~R0SX3IFAE3NH.0 size=1048576 2024-09-12T17:47:10.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.483+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~R0SX3IFAE3NH.1 size=815540 2024-09-12T17:47:10.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.487+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=R0SX3IFAE3NH tag=821CF88AT41B type=write size=2912692 2024-09-12T17:47:10.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.491+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=BTXZFWQDKM9O type=del size=4137251 2024-09-12T17:47:10.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.491+0000 7f68bc0598c0 1 < canceled operation key=2129SG6US3LI tag=AGO2N3265CHQ type=del size=642023 2024-09-12T17:47:10.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.495+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~9J24KH9UGNP8.0 size=1048576 2024-09-12T17:47:10.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.499+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~9J24KH9UGNP8.1 size=681201 2024-09-12T17:47:10.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.499+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=9J24KH9UGNP8 tag=EBDIC0QFXIWQ type=write size=2778353 2024-09-12T17:47:10.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.499+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=NPG1WMQGGXVY type=del 2024-09-12T17:47:10.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.503+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=NBCZVXRY5Y3S type=del size=841131 2024-09-12T17:47:10.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.503+0000 7f68bc0598c0 1 < completed write operation key=UOW521GPXBQ0 tag=WWFWH8B1IVWD type=write size=217246 2024-09-12T17:47:10.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.507+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=QMZYYZZ7TMPT type=del size=611468 2024-09-12T17:47:10.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.511+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~61B3V4ANZEOT.0 size=382429 2024-09-12T17:47:10.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.515+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=61B3V4ANZEOT tag=5VQIRDKBFDMH type=write size=1431005 2024-09-12T17:47:10.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.515+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=KNW049LMHDRQ type=del size=2098369 2024-09-12T17:47:10.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.519+0000 7f68bc0598c0 1 < completed write operation key=6SUA9FBDU69A tag=FZUQD6LO0SV2 type=write size=27192 2024-09-12T17:47:10.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.523+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~NLUSXZDXG261.0 size=1048576 2024-09-12T17:47:10.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.523+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~NLUSXZDXG261.1 size=132279 2024-09-12T17:47:10.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.523+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=NLUSXZDXG261 tag=XEKTDMUGVOMU type=write size=2229431 2024-09-12T17:47:10.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.527+0000 7f68bc0598c0 1 < suggested update operation key=XGJSQJ2IXJDK tag=AMLZX4HXVQNR type=del size=427046 2024-09-12T17:47:10.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.531+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=L2RDW5YY0UIK type=del size=1528986 2024-09-12T17:47:10.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.531+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=ZBWZTVMQ89W1 type=del 2024-09-12T17:47:10.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.535+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=DHQ6NK8PC7GW type=write size=346801 2024-09-12T17:47:10.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.539+0000 7f68bc0598c0 -1 < failed to complete operation key=XGJSQJ2IXJDK tag=6ZCA3LPPULHC type=del size=2178070: (22) Invalid argument 2024-09-12T17:47:10.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.539+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=WL674CFHJ36B type=del size=2314958 2024-09-12T17:47:10.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.543+0000 7f68bc0598c0 1 < suggested update operation key=0XFYVNU2Q7KO tag=HEPG89YU8CHC type=write size=582532 2024-09-12T17:47:10.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.547+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=T87IWO3AZ6KH type=del size=3706363 2024-09-12T17:47:10.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.551+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~046WXP1MD7SW.0 size=1048576 2024-09-12T17:47:10.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.551+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~046WXP1MD7SW.1 size=1048576 2024-09-12T17:47:10.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.551+0000 7f68bc0598c0 1 < canceled part key=_multipart_57O6H52NHYOL.2~046WXP1MD7SW.2 size=631318 2024-09-12T17:47:10.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.559+0000 7f68bc0598c0 1 < canceled multipart upload key=57O6H52NHYOL upload=046WXP1MD7SW tag=7TWH3L9XZMGI type=write size=3777046 2024-09-12T17:47:10.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.559+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=TOHUJME5L0U5 type=write size=1039345 2024-09-12T17:47:10.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.563+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=QB9SVRKWUCTK type=del 2024-09-12T17:47:10.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.567+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=A0DS4YGXP09S type=write size=945148 2024-09-12T17:47:10.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.567+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~0N9IXUTA0752.0 size=1048576 2024-09-12T17:47:10.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.571+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~0N9IXUTA0752.1 size=1048576 2024-09-12T17:47:10.575 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.571+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~0N9IXUTA0752.2 size=859512 2024-09-12T17:47:10.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.575+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=0N9IXUTA0752 tag=F46Q4I1CLXDT type=write size=4005240 2024-09-12T17:47:10.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.579+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=X5INWLJNQ2Z6 type=del size=3931070 2024-09-12T17:47:10.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.579+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=E4YVGTSPU1TL type=del 2024-09-12T17:47:10.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.583+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=CLRGEFC8BIRO type=del size=4627 2024-09-12T17:47:10.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.583+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~45JR1GOPPZYZ.0 size=1048576 2024-09-12T17:47:10.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.587+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~45JR1GOPPZYZ.1 size=7359 2024-09-12T17:47:10.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.591+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=45JR1GOPPZYZ tag=YONWZOMIREVR type=write size=2104511 2024-09-12T17:47:10.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.595+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~MKTVIM7DGRTX.0 size=1048576 2024-09-12T17:47:10.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.595+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~MKTVIM7DGRTX.1 size=1048576 2024-09-12T17:47:10.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.599+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~MKTVIM7DGRTX.2 size=44123 2024-09-12T17:47:10.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.599+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=MKTVIM7DGRTX tag=MIW8EOI9W2E7 type=write size=3189851 2024-09-12T17:47:10.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.603+0000 7f68bc0598c0 1 < canceled operation key=QGO5SPFPT548 tag=H6X63SXCRRFX type=write size=157604 2024-09-12T17:47:10.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~UO017LFVR9UH.0 size=1048576 2024-09-12T17:47:10.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~UO017LFVR9UH.1 size=1048576 2024-09-12T17:47:10.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.611+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~UO017LFVR9UH.2 size=834010 2024-09-12T17:47:10.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.611+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=UO017LFVR9UH tag=6TY9IR4DKKUI type=write size=3979738 2024-09-12T17:47:10.616 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.611+0000 7f68bc0598c0 1 < canceled operation key=W8JEQ5NOIE6O tag=BTXZFWQDKM9O type=del size=4137251 2024-09-12T17:47:10.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.615+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=LVP7JYR7W9PJ type=del size=1187487 2024-09-12T17:47:10.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.615+0000 7f68bc0598c0 1 < canceled part key=_multipart_OG0V0I1SDHG5.2~9J24KH9UGNP8.0 size=1048576 2024-09-12T17:47:10.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.619+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~9J24KH9UGNP8.1 size=681201 2024-09-12T17:47:10.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.623+0000 7f68bc0598c0 1 < canceled multipart upload key=OG0V0I1SDHG5 upload=9J24KH9UGNP8 tag=EBDIC0QFXIWQ type=write size=2778353 2024-09-12T17:47:10.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.623+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=R6N62PJ0RRZX type=del size=415182 2024-09-12T17:47:10.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.627+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=NBCZVXRY5Y3S type=del 2024-09-12T17:47:10.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.635+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~L5WU6VMIQRJ8.0 size=832686 2024-09-12T17:47:10.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.635+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=L5WU6VMIQRJ8 tag=QH42CF35U3A4 type=write size=1881262 2024-09-12T17:47:10.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.639+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=QMZYYZZ7TMPT type=del 2024-09-12T17:47:10.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.639+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=ALBL9D9BBB8Y type=del size=2850493 2024-09-12T17:47:10.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.643+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=KNW049LMHDRQ type=del 2024-09-12T17:47:10.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.647+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=PAB3JB2SNFRA type=write size=694704 2024-09-12T17:47:10.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.647+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~NLUSXZDXG261.0 size=1048576 2024-09-12T17:47:10.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.651+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~NLUSXZDXG261.1 size=132279 2024-09-12T17:47:10.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.655+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=NLUSXZDXG261 tag=XEKTDMUGVOMU type=write size=2229431 2024-09-12T17:47:10.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.659+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~PE6T83K0ZXLG.0 size=1048576 2024-09-12T17:47:10.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.659+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~PE6T83K0ZXLG.1 size=1048576 2024-09-12T17:47:10.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.663+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~PE6T83K0ZXLG.2 size=630957 2024-09-12T17:47:10.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.663+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=PE6T83K0ZXLG tag=DZ60NGSJBK3W type=write size=3776685 2024-09-12T17:47:10.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.663+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=L2RDW5YY0UIK type=del 2024-09-12T17:47:10.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.667+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=0YQ5Q21UGQYZ type=del size=1546374 2024-09-12T17:47:10.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.671+0000 7f68bc0598c0 1 < completed write operation key=UMQLPH9XGWRZ tag=DHQ6NK8PC7GW type=write size=346801 2024-09-12T17:47:10.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.675+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=XYRTC2A6HFVB type=write size=5582 2024-09-12T17:47:10.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.675+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=WL674CFHJ36B type=del 2024-09-12T17:47:10.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.679+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=6F8ED6DL3GYG type=del size=2953764 2024-09-12T17:47:10.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.683+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=T87IWO3AZ6KH type=del 2024-09-12T17:47:10.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.687+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=ZI8TMY0R1MWL type=write size=828503 2024-09-12T17:47:10.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.687+0000 7f68bc0598c0 1 < completed write operation key=2129SG6US3LI tag=TOHUJME5L0U5 type=write size=1039345 2024-09-12T17:47:10.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.691+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=YXH79H20XS2A type=write size=521587 2024-09-12T17:47:10.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.695+0000 7f68bc0598c0 1 < completed write operation key=W8JEQ5NOIE6O tag=A0DS4YGXP09S type=write size=945148 2024-09-12T17:47:10.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.699+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~7106JY3P36RN.0 size=826620 2024-09-12T17:47:10.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.699+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=7106JY3P36RN tag=K1ZEEDZ70RNR type=write size=1875196 2024-09-12T17:47:10.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.703+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=X5INWLJNQ2Z6 type=del 2024-09-12T17:47:10.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.707+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=0HVH5G2RI6QG type=del size=2841533 2024-09-12T17:47:10.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.707+0000 7f68bc0598c0 1 < canceled operation key=3JPRQXKB5K3W tag=CLRGEFC8BIRO type=del size=4627 2024-09-12T17:47:10.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.711+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=62JB7B15LUQC type=del size=166543 2024-09-12T17:47:10.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.711+0000 7f68bc0598c0 1 < canceled part key=_multipart_3JPRQXKB5K3W.2~MKTVIM7DGRTX.0 size=1048576 2024-09-12T17:47:10.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.715+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~MKTVIM7DGRTX.1 size=1048576 2024-09-12T17:47:10.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.715+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~MKTVIM7DGRTX.2 size=44123 2024-09-12T17:47:10.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.723+0000 7f68bc0598c0 1 < canceled multipart upload key=3JPRQXKB5K3W upload=MKTVIM7DGRTX tag=MIW8EOI9W2E7 type=write size=3189851 2024-09-12T17:47:10.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.727+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~2R2T7MRBGPSD.0 size=949156 2024-09-12T17:47:10.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.727+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=2R2T7MRBGPSD tag=A5VHRMZ1C9NL type=write size=1997732 2024-09-12T17:47:10.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.731+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~UO017LFVR9UH.0 size=1048576 2024-09-12T17:47:10.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.731+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~UO017LFVR9UH.1 size=1048576 2024-09-12T17:47:10.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.735+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~UO017LFVR9UH.2 size=834010 2024-09-12T17:47:10.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.739+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=UO017LFVR9UH tag=6TY9IR4DKKUI type=write size=3979738 2024-09-12T17:47:10.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.747+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~9EJTTTHMGIC0.0 size=1048576 2024-09-12T17:47:10.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.747+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~9EJTTTHMGIC0.1 size=359628 2024-09-12T17:47:10.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.747+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=9EJTTTHMGIC0 tag=Q233MJKN7JZX type=write size=2456780 2024-09-12T17:47:10.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.751+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=LVP7JYR7W9PJ type=del 2024-09-12T17:47:10.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.755+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=8BTQDO1ZXBG4 type=del size=2426354 2024-09-12T17:47:10.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.759+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=R6N62PJ0RRZX type=del 2024-09-12T17:47:10.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.759+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=K3MO328898BI type=write size=518020 2024-09-12T17:47:10.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.763+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~L5WU6VMIQRJ8.0 size=832686 2024-09-12T17:47:10.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.767+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=L5WU6VMIQRJ8 tag=QH42CF35U3A4 type=write size=1881262 2024-09-12T17:47:10.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.771+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=L8I8CQ0G11MW type=write size=193719 2024-09-12T17:47:10.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.775+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=ALBL9D9BBB8Y type=del 2024-09-12T17:47:10.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.775+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=6YI4KREDGAJI type=write size=518009 2024-09-12T17:47:10.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.779+0000 7f68bc0598c0 1 < completed write operation key=WUGDIFCHNL90 tag=PAB3JB2SNFRA type=write size=694704 2024-09-12T17:47:10.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.783+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=2ZW9C4FPQM9K type=del size=2194509 2024-09-12T17:47:10.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.787+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~PE6T83K0ZXLG.0 size=1048576 2024-09-12T17:47:10.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.787+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~PE6T83K0ZXLG.1 size=1048576 2024-09-12T17:47:10.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.791+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~PE6T83K0ZXLG.2 size=630957 2024-09-12T17:47:10.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.795+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=PE6T83K0ZXLG tag=DZ60NGSJBK3W type=write size=3776685 2024-09-12T17:47:10.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.799+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=JWWM8LKSPE13 type=del size=2839778 2024-09-12T17:47:10.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.803+0000 7f68bc0598c0 1 < canceled operation key=WUGDIFCHNL90 tag=0YQ5Q21UGQYZ type=del size=1546374 2024-09-12T17:47:10.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.807+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~H04W2OI8DT6W.0 size=1013758 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.807+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=H04W2OI8DT6W tag=BP9NBBE227FP type=write size=2062334 2024-09-12T17:47:10.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.811+0000 7f68bc0598c0 1 < completed write operation key=KW3VWTA43PBM tag=XYRTC2A6HFVB type=write size=5582 2024-09-12T17:47:10.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.819+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=OMHL7EAAO7UC type=del size=2915448 2024-09-12T17:47:10.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.819+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=6F8ED6DL3GYG type=del 2024-09-12T17:47:10.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.823+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=IWVUG98MK01K type=write size=275677 2024-09-12T17:47:10.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.827+0000 7f68bc0598c0 1 < completed write operation key=MRS3KW2H5AKK tag=ZI8TMY0R1MWL type=write size=828503 2024-09-12T17:47:10.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.831+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=33SCBIVWO006 type=del size=2702007 2024-09-12T17:47:10.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.831+0000 7f68bc0598c0 1 < canceled operation key=F4F4P4L8K5D9 tag=YXH79H20XS2A type=write size=521587 2024-09-12T17:47:10.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.835+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=LW4V6SNAZEPJ type=del size=71101 2024-09-12T17:47:10.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.839+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~7106JY3P36RN.0 size=826620 2024-09-12T17:47:10.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.843+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=7106JY3P36RN tag=K1ZEEDZ70RNR type=write size=1875196 2024-09-12T17:47:10.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.847+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=SBY7MXHQCD2N type=del size=662609 2024-09-12T17:47:10.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.847+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=0HVH5G2RI6QG type=del 2024-09-12T17:47:10.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.851+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=HUW3PBA24UHT type=del size=1603940 2024-09-12T17:47:10.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.855+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=62JB7B15LUQC type=del 2024-09-12T17:47:10.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.859+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=B7BY3CHBL64N type=del size=2483319 2024-09-12T17:47:10.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.859+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~2R2T7MRBGPSD.0 size=949156 2024-09-12T17:47:10.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.867+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=2R2T7MRBGPSD tag=A5VHRMZ1C9NL type=write size=1997732 2024-09-12T17:47:10.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.871+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~EESR5Q5DL1XC.0 size=981627 2024-09-12T17:47:10.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.871+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=EESR5Q5DL1XC tag=0M22FKAUF9JK type=write size=2030203 2024-09-12T17:47:10.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.875+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~9EJTTTHMGIC0.0 size=1048576 2024-09-12T17:47:10.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.875+0000 7f68bc0598c0 1 < canceled part key=_multipart_UMQLPH9XGWRZ.2~9EJTTTHMGIC0.1 size=359628 2024-09-12T17:47:10.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.879+0000 7f68bc0598c0 1 < canceled multipart upload key=UMQLPH9XGWRZ upload=9EJTTTHMGIC0 tag=Q233MJKN7JZX type=write size=2456780 2024-09-12T17:47:10.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.883+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=E8DQ0H9313PS type=del size=2484273 2024-09-12T17:47:10.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.887+0000 7f68bc0598c0 1 < suggested remove operation key=WPQ755ODAFNT tag=8BTQDO1ZXBG4 type=del 2024-09-12T17:47:10.895 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.891+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=EJC8UARVU2AM type=del size=353025 2024-09-12T17:47:10.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.895+0000 7f68bc0598c0 1 < completed write operation key=XGJSQJ2IXJDK tag=K3MO328898BI type=write size=518020 2024-09-12T17:47:10.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.899+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~IXR7LR2JF9ZP.0 size=1039983 2024-09-12T17:47:10.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.899+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=IXR7LR2JF9ZP tag=8ZRJ3MKW3D8Y type=write size=2088559 2024-09-12T17:47:10.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.903+0000 7f68bc0598c0 -1 < failed to complete operation key=WPQ755ODAFNT tag=L8I8CQ0G11MW type=write size=193719: (22) Invalid argument 2024-09-12T17:47:10.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.907+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=1WK0XNC8B44H type=del size=2967887 2024-09-12T17:47:10.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.911+0000 7f68bc0598c0 1 < completed write operation key=MRS3KW2H5AKK tag=6YI4KREDGAJI type=write size=518009 2024-09-12T17:47:10.916 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.911+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=EKYHPU8COERA type=del size=2129657 2024-09-12T17:47:10.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.915+0000 7f68bc0598c0 1 < canceled operation key=OG0V0I1SDHG5 tag=2ZW9C4FPQM9K type=del size=2194509 2024-09-12T17:47:10.921 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.919+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=0W4IO1ORZ1S8 type=write size=788253 2024-09-12T17:47:10.924 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.919+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=JWWM8LKSPE13 type=del 2024-09-12T17:47:10.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.923+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=BXADBRGR4G4Z type=del size=3226417 2024-09-12T17:47:10.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.927+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~H04W2OI8DT6W.0 size=1013758 2024-09-12T17:47:10.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.931+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=H04W2OI8DT6W tag=BP9NBBE227FP type=write size=2062334 2024-09-12T17:47:10.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.935+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=2EUR9AY1TJJ8 type=del size=610666 2024-09-12T17:47:10.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.939+0000 7f68bc0598c0 1 < suggested remove operation key=NLPTU26RO70S tag=OMHL7EAAO7UC type=del 2024-09-12T17:47:10.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.943+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=6SXSF8666PLG type=del size=968277 2024-09-12T17:47:10.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.947+0000 7f68bc0598c0 1 < completed write operation key=DMJZUQJ7IY60 tag=IWVUG98MK01K type=write size=275677 2024-09-12T17:47:10.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.947+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=Y44XFWVQUB9K type=del size=3400448 2024-09-12T17:47:10.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.951+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=33SCBIVWO006 type=del 2024-09-12T17:47:10.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.955+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=13WFT9BWC817 type=del size=2941718 2024-09-12T17:47:10.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.955+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=LW4V6SNAZEPJ type=del 2024-09-12T17:47:10.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.959+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=GG6BF92AFCJ0 type=del size=2054296 2024-09-12T17:47:10.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.963+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=SBY7MXHQCD2N type=del 2024-09-12T17:47:10.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.963+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=IXRJL2D8F16W type=write size=308668 2024-09-12T17:47:10.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.967+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=HUW3PBA24UHT type=del 2024-09-12T17:47:10.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.971+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=V9HBYK7ABGFQ type=del size=2070806 2024-09-12T17:47:10.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.971+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=B7BY3CHBL64N type=del 2024-09-12T17:47:10.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.979+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~QVR5T5GNV6A9.0 size=1048576 2024-09-12T17:47:10.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.979+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~QVR5T5GNV6A9.1 size=602466 2024-09-12T17:47:10.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.979+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=QVR5T5GNV6A9 tag=XYTY1I8FAJFB type=write size=2699618 2024-09-12T17:47:10.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.983+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~EESR5Q5DL1XC.0 size=981627 2024-09-12T17:47:10.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.991+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=EESR5Q5DL1XC tag=0M22FKAUF9JK type=write size=2030203 2024-09-12T17:47:10.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.995+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=CH32580C4G5A type=del size=115872 2024-09-12T17:47:11.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:10.995+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=E8DQ0H9313PS type=del 2024-09-12T17:47:11.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.003+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~GC511GTPGFH3.0 size=1048576 2024-09-12T17:47:11.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.007+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~GC511GTPGFH3.1 size=1048576 2024-09-12T17:47:11.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.007+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~GC511GTPGFH3.2 size=692690 2024-09-12T17:47:11.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.007+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=GC511GTPGFH3 tag=C2Y9MVVJ4RUT type=write size=3838418 2024-09-12T17:47:11.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.011+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=EJC8UARVU2AM type=del 2024-09-12T17:47:11.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.015+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=L5OC7VUZ2UW2 type=del size=2306903 2024-09-12T17:47:11.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.015+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~IXR7LR2JF9ZP.0 size=1039983 2024-09-12T17:47:11.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.023+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=IXR7LR2JF9ZP tag=8ZRJ3MKW3D8Y type=write size=2088559 2024-09-12T17:47:11.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.027+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~Q4F9G0K24OB1.0 size=1048576 2024-09-12T17:47:11.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.031+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~Q4F9G0K24OB1.1 size=418769 2024-09-12T17:47:11.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.031+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=Q4F9G0K24OB1 tag=2OTGKGJMZXYI type=write size=2515921 2024-09-12T17:47:11.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.031+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=1WK0XNC8B44H type=del 2024-09-12T17:47:11.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.035+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=URORCI3PBF41 type=del size=2606028 2024-09-12T17:47:11.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.043+0000 7f68bc0598c0 1 < suggested remove operation key=6J677S46BXS4 tag=EKYHPU8COERA type=del 2024-09-12T17:47:11.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.047+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=OIHXYRZ70NCD type=del size=2733068 2024-09-12T17:47:11.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.051+0000 7f68bc0598c0 1 < suggested remove operation key=7XH1E2GEH9O2 tag=0W4IO1ORZ1S8 type=write 2024-09-12T17:47:11.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.055+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=F17BLU36B898 type=del size=2379483 2024-09-12T17:47:11.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.059+0000 7f68bc0598c0 1 < suggested remove operation key=6SUA9FBDU69A tag=BXADBRGR4G4Z type=del 2024-09-12T17:47:11.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.063+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=JKSWN9P9E2F3 type=del size=2757844 2024-09-12T17:47:11.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.067+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=2EUR9AY1TJJ8 type=del 2024-09-12T17:47:11.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.071+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~UHE84GHU4JL5.0 size=1048576 2024-09-12T17:47:11.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.071+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~UHE84GHU4JL5.1 size=44458 2024-09-12T17:47:11.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.071+0000 7f68bc0598c0 1 > prepared multipart upload key=BKAT5SGAC5Z8 upload=UHE84GHU4JL5 tag=11W3DKNAE04B type=write size=2141610 2024-09-12T17:47:11.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.075+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=6SXSF8666PLG type=del 2024-09-12T17:47:11.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.079+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=WVBN7TUB4H4Y type=del size=932529 2024-09-12T17:47:11.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.079+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=Y44XFWVQUB9K type=del 2024-09-12T17:47:11.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.083+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=M9FICZPVD1TT type=del size=1989261 2024-09-12T17:47:11.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.087+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=13WFT9BWC817 type=del 2024-09-12T17:47:11.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.091+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~W98MSPH693ZU.0 size=1048576 2024-09-12T17:47:11.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.091+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~W98MSPH693ZU.1 size=1048576 2024-09-12T17:47:11.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.095+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~W98MSPH693ZU.2 size=554006 2024-09-12T17:47:11.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.095+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=W98MSPH693ZU tag=1U1JFQ6WK3D2 type=write size=3699734 2024-09-12T17:47:11.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.103+0000 7f68bc0598c0 1 < suggested remove operation key=XGJSQJ2IXJDK tag=GG6BF92AFCJ0 type=del 2024-09-12T17:47:11.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.103+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=F7S5IN90G7RQ type=write size=260603 2024-09-12T17:47:11.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.107+0000 7f68bc0598c0 1 < suggested remove operation key=8P0EWBVO0BQD tag=IXRJL2D8F16W type=write 2024-09-12T17:47:11.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.111+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=WSYK1Y9KIF8M type=write size=221449 2024-09-12T17:47:11.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.115+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=V9HBYK7ABGFQ type=del 2024-09-12T17:47:11.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.115+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=Y1932DOUYYRJ type=write size=586150 2024-09-12T17:47:11.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.119+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~QVR5T5GNV6A9.0 size=1048576 2024-09-12T17:47:11.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.123+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~QVR5T5GNV6A9.1 size=602466 2024-09-12T17:47:11.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.127+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=QVR5T5GNV6A9 tag=XYTY1I8FAJFB type=write size=2699618 2024-09-12T17:47:11.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.131+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~G4SM1LT6O86M.0 size=573459 2024-09-12T17:47:11.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.131+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=G4SM1LT6O86M tag=PZWK7720HHIU type=write size=1622035 2024-09-12T17:47:11.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.135+0000 7f68bc0598c0 -1 < failed to complete operation key=8P0EWBVO0BQD tag=CH32580C4G5A type=del size=115872: (22) Invalid argument 2024-09-12T17:47:11.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.139+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~PM7JH0Z6KREM.0 size=1048576 2024-09-12T17:47:11.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.143+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~PM7JH0Z6KREM.1 size=1048576 2024-09-12T17:47:11.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.143+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~PM7JH0Z6KREM.2 size=641676 2024-09-12T17:47:11.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.143+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=PM7JH0Z6KREM tag=JNNGJJ7S8NW3 type=write size=3787404 2024-09-12T17:47:11.149 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.147+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~GC511GTPGFH3.0 size=1048576 2024-09-12T17:47:11.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.147+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~GC511GTPGFH3.1 size=1048576 2024-09-12T17:47:11.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.147+0000 7f68bc0598c0 1 < canceled part key=_multipart_4R9ENKMRB1GT.2~GC511GTPGFH3.2 size=692690 2024-09-12T17:47:11.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.151+0000 7f68bc0598c0 1 < canceled multipart upload key=4R9ENKMRB1GT upload=GC511GTPGFH3 tag=C2Y9MVVJ4RUT type=write size=3838418 2024-09-12T17:47:11.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.155+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=JITSB5L0B2TE type=del size=3015786 2024-09-12T17:47:11.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.155+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=L5OC7VUZ2UW2 type=del 2024-09-12T17:47:11.165 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.163+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~YTCHUXBA37UZ.0 size=474452 2024-09-12T17:47:11.165 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.163+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=YTCHUXBA37UZ tag=386ROOC3ZEF1 type=write size=1523028 2024-09-12T17:47:11.166 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.163+0000 7f68bc0598c0 1 < canceled part key=_multipart_S0B1RP89NO44.2~Q4F9G0K24OB1.0 size=1048576 2024-09-12T17:47:11.168 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.163+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~Q4F9G0K24OB1.1 size=418769 2024-09-12T17:47:11.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.167+0000 7f68bc0598c0 1 < canceled multipart upload key=S0B1RP89NO44 upload=Q4F9G0K24OB1 tag=2OTGKGJMZXYI type=write size=2515921 2024-09-12T17:47:11.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.171+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=CWQ5EP0FIU0Y type=del size=1354861 2024-09-12T17:47:11.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.175+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=URORCI3PBF41 type=del 2024-09-12T17:47:11.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.175+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=D23WAAFQ9NO2 type=del size=3692047 2024-09-12T17:47:11.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.179+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=OIHXYRZ70NCD type=del 2024-09-12T17:47:11.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.183+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~90G0E0IDWRIM.0 size=1048576 2024-09-12T17:47:11.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.183+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~90G0E0IDWRIM.1 size=1048576 2024-09-12T17:47:11.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.187+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~90G0E0IDWRIM.2 size=979748 2024-09-12T17:47:11.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.187+0000 7f68bc0598c0 1 > prepared multipart upload key=BKAT5SGAC5Z8 upload=90G0E0IDWRIM tag=YLMW3WEEJ27G type=write size=4125476 2024-09-12T17:47:11.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.187+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=F17BLU36B898 type=del 2024-09-12T17:47:11.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.191+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=QFWNNMTNL146 type=write size=532567 2024-09-12T17:47:11.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.195+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=JKSWN9P9E2F3 type=del 2024-09-12T17:47:11.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.199+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~STQ8CW1TK8C3.0 size=1048576 2024-09-12T17:47:11.205 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.199+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~STQ8CW1TK8C3.1 size=1048576 2024-09-12T17:47:11.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.203+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~STQ8CW1TK8C3.2 size=33882 2024-09-12T17:47:11.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.203+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=STQ8CW1TK8C3 tag=MAREF2G6SUGX type=write size=3179610 2024-09-12T17:47:11.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.207+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~UHE84GHU4JL5.0 size=1048576 2024-09-12T17:47:11.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.207+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~UHE84GHU4JL5.1 size=44458 2024-09-12T17:47:11.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.215+0000 7f68bc0598c0 1 < completed multipart upload key=BKAT5SGAC5Z8 upload=UHE84GHU4JL5 tag=11W3DKNAE04B type=write size=2141610 2024-09-12T17:47:11.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.215+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=0MAUL6ZLUA6S type=del size=77455 2024-09-12T17:47:11.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.219+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=WVBN7TUB4H4Y type=del 2024-09-12T17:47:11.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.223+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=Z76KEHQNLHR4 type=write size=855290 2024-09-12T17:47:11.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.223+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=M9FICZPVD1TT type=del 2024-09-12T17:47:11.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.227+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=27P71DNR2JLB type=write size=731648 2024-09-12T17:47:11.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.227+0000 7f68bc0598c0 1 < canceled part key=_multipart_6SUA9FBDU69A.2~W98MSPH693ZU.0 size=1048576 2024-09-12T17:47:11.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.227+0000 7f68bc0598c0 1 < canceled part key=_multipart_6SUA9FBDU69A.2~W98MSPH693ZU.1 size=1048576 2024-09-12T17:47:11.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.231+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~W98MSPH693ZU.2 size=554006 2024-09-12T17:47:11.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.235+0000 7f68bc0598c0 1 < canceled multipart upload key=6SUA9FBDU69A upload=W98MSPH693ZU tag=1U1JFQ6WK3D2 type=write size=3699734 2024-09-12T17:47:11.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.239+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~EWM1COB5SZSF.0 size=1048576 2024-09-12T17:47:11.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.243+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~EWM1COB5SZSF.1 size=1048576 2024-09-12T17:47:11.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.247+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~EWM1COB5SZSF.2 size=580520 2024-09-12T17:47:11.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.247+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=EWM1COB5SZSF tag=UBXTQS22MVT3 type=write size=3726248 2024-09-12T17:47:11.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.251+0000 7f68bc0598c0 1 < suggested remove operation key=BKAT5SGAC5Z8 tag=F7S5IN90G7RQ type=write 2024-09-12T17:47:11.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.255+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=RKH1U934E2AY type=del size=2931554 2024-09-12T17:47:11.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.259+0000 7f68bc0598c0 1 < canceled operation key=06W7N11O7F1I tag=WSYK1Y9KIF8M type=write size=221449 2024-09-12T17:47:11.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.259+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=QHO2K71C8U4C type=del size=3973534 2024-09-12T17:47:11.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.267+0000 7f68bc0598c0 1 < suggested remove operation key=8P0EWBVO0BQD tag=Y1932DOUYYRJ type=write 2024-09-12T17:47:11.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.267+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=K3346HWR39TJ type=del size=988073 2024-09-12T17:47:11.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.271+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~G4SM1LT6O86M.0 size=573459 2024-09-12T17:47:11.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.275+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=G4SM1LT6O86M tag=PZWK7720HHIU type=write size=1622035 2024-09-12T17:47:11.283 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.279+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=RSHLSTSSH5RJ type=del size=2188982 2024-09-12T17:47:11.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.283+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~PM7JH0Z6KREM.0 size=1048576 2024-09-12T17:47:11.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.283+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~PM7JH0Z6KREM.1 size=1048576 2024-09-12T17:47:11.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.287+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~PM7JH0Z6KREM.2 size=641676 2024-09-12T17:47:11.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.295+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=PM7JH0Z6KREM tag=JNNGJJ7S8NW3 type=write size=3787404 2024-09-12T17:47:11.303 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.299+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~KNCWPYFW04M1.0 size=1048576 2024-09-12T17:47:11.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.303+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~KNCWPYFW04M1.1 size=1048576 2024-09-12T17:47:11.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.303+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~KNCWPYFW04M1.2 size=989849 2024-09-12T17:47:11.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.303+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=KNCWPYFW04M1 tag=8NQSB69WQ0WF type=write size=4135577 2024-09-12T17:47:11.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.307+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=JITSB5L0B2TE type=del 2024-09-12T17:47:11.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.315+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~OOVL1J99SKF8.0 size=1048576 2024-09-12T17:47:11.320 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.315+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~OOVL1J99SKF8.1 size=49512 2024-09-12T17:47:11.320 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.315+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=OOVL1J99SKF8 tag=PUQVDCVK9FWG type=write size=2146664 2024-09-12T17:47:11.321 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.315+0000 7f68bc0598c0 1 < canceled part key=_multipart_QGO5SPFPT548.2~YTCHUXBA37UZ.0 size=474452 2024-09-12T17:47:11.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.319+0000 7f68bc0598c0 1 < canceled multipart upload key=QGO5SPFPT548 upload=YTCHUXBA37UZ tag=386ROOC3ZEF1 type=write size=1523028 2024-09-12T17:47:11.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.327+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~5XK9N8EHR0YE.0 size=1048576 2024-09-12T17:47:11.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.327+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~5XK9N8EHR0YE.1 size=464814 2024-09-12T17:47:11.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.327+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=5XK9N8EHR0YE tag=C3F5EX72BHZV type=write size=2561966 2024-09-12T17:47:11.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.331+0000 7f68bc0598c0 1 < canceled operation key=WPQ755ODAFNT tag=CWQ5EP0FIU0Y type=del size=1354861 2024-09-12T17:47:11.339 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.335+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=TI8IY3J0O71C type=del size=2886217 2024-09-12T17:47:11.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.339+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=D23WAAFQ9NO2 type=del 2024-09-12T17:47:11.344 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.339+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=8W0IF212MWUV type=del size=411057 2024-09-12T17:47:11.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.343+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~90G0E0IDWRIM.0 size=1048576 2024-09-12T17:47:11.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.347+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~90G0E0IDWRIM.1 size=1048576 2024-09-12T17:47:11.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.347+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~90G0E0IDWRIM.2 size=979748 2024-09-12T17:47:11.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.355+0000 7f68bc0598c0 1 < completed multipart upload key=BKAT5SGAC5Z8 upload=90G0E0IDWRIM tag=YLMW3WEEJ27G type=write size=4125476 2024-09-12T17:47:11.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.363+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~X1CTX6KXTE3K.0 size=651601 2024-09-12T17:47:11.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.363+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=X1CTX6KXTE3K tag=8ESKGP8H38QM type=write size=1700177 2024-09-12T17:47:11.370 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.367+0000 7f68bc0598c0 1 < completed write operation key=0XFYVNU2Q7KO tag=QFWNNMTNL146 type=write size=532567 2024-09-12T17:47:11.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.371+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~U2SAFVQC8HEZ.0 size=412224 2024-09-12T17:47:11.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.371+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=U2SAFVQC8HEZ tag=GLCJR5KFHL6M type=write size=1460800 2024-09-12T17:47:11.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.375+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~STQ8CW1TK8C3.0 size=1048576 2024-09-12T17:47:11.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.379+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~STQ8CW1TK8C3.1 size=1048576 2024-09-12T17:47:11.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.379+0000 7f68bc0598c0 1 < canceled part key=_multipart_XGJSQJ2IXJDK.2~STQ8CW1TK8C3.2 size=33882 2024-09-12T17:47:11.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.383+0000 7f68bc0598c0 1 < canceled multipart upload key=XGJSQJ2IXJDK upload=STQ8CW1TK8C3 tag=MAREF2G6SUGX type=write size=3179610 2024-09-12T17:47:11.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.387+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=I9T2HUUJ3GJI type=write size=921719 2024-09-12T17:47:11.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.395+0000 7f68bc0598c0 1 < suggested remove operation key=WUGDIFCHNL90 tag=0MAUL6ZLUA6S type=del 2024-09-12T17:47:11.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.399+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=71CG1K4Y0YWC type=write size=985240 2024-09-12T17:47:11.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.403+0000 7f68bc0598c0 1 < suggested remove operation key=9846YLKC8P8S tag=Z76KEHQNLHR4 type=write 2024-09-12T17:47:11.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.407+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=655TBLQY0MJM type=del size=3489759 2024-09-12T17:47:11.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.411+0000 7f68bc0598c0 -1 < failed to complete operation key=9846YLKC8P8S tag=27P71DNR2JLB type=write size=731648: (22) Invalid argument 2024-09-12T17:47:11.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.415+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~B7WASRK82JAI.0 size=495807 2024-09-12T17:47:11.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.415+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=B7WASRK82JAI tag=3ZPBCC21HNR5 type=write size=1544383 2024-09-12T17:47:11.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.419+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~EWM1COB5SZSF.0 size=1048576 2024-09-12T17:47:11.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.423+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~EWM1COB5SZSF.1 size=1048576 2024-09-12T17:47:11.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.423+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~EWM1COB5SZSF.2 size=580520 2024-09-12T17:47:11.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.427+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=EWM1COB5SZSF tag=UBXTQS22MVT3 type=write size=3726248 2024-09-12T17:47:11.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.431+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=Y26Y3GBK3AGG type=del size=3725284 2024-09-12T17:47:11.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.435+0000 7f68bc0598c0 -1 < failed to complete operation key=8P0EWBVO0BQD tag=RKH1U934E2AY type=del size=2931554: (22) Invalid argument 2024-09-12T17:47:11.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.439+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~VKF5B3ZVAM7N.0 size=986795 2024-09-12T17:47:11.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.439+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=VKF5B3ZVAM7N tag=2W5GYE6NPI3Q type=write size=2035371 2024-09-12T17:47:11.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.443+0000 7f68bc0598c0 1 < canceled operation key=6J677S46BXS4 tag=QHO2K71C8U4C type=del size=3973534 2024-09-12T17:47:11.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.447+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=EAT46TVI5A2D type=del size=3804069 2024-09-12T17:47:11.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.447+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=K3346HWR39TJ type=del 2024-09-12T17:47:11.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.451+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=GESFZQAJR8HU type=write size=804845 2024-09-12T17:47:11.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.451+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=RSHLSTSSH5RJ type=del 2024-09-12T17:47:11.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.455+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=2TTB81WKOP55 type=del size=2467368 2024-09-12T17:47:11.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.459+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~KNCWPYFW04M1.0 size=1048576 2024-09-12T17:47:11.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.459+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~KNCWPYFW04M1.1 size=1048576 2024-09-12T17:47:11.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.463+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~KNCWPYFW04M1.2 size=989849 2024-09-12T17:47:11.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.467+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=KNCWPYFW04M1 tag=8NQSB69WQ0WF type=write size=4135577 2024-09-12T17:47:11.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.471+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=2J0GC452J0O1 type=del size=2667876 2024-09-12T17:47:11.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.471+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~OOVL1J99SKF8.0 size=1048576 2024-09-12T17:47:11.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.475+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~OOVL1J99SKF8.1 size=49512 2024-09-12T17:47:11.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.479+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=OOVL1J99SKF8 tag=PUQVDCVK9FWG type=write size=2146664 2024-09-12T17:47:11.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.487+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~17Y5ZEIDB3BX.0 size=1048576 2024-09-12T17:47:11.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.487+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~17Y5ZEIDB3BX.1 size=153994 2024-09-12T17:47:11.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.487+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=17Y5ZEIDB3BX tag=NLJUTGXG8YLO type=write size=2251146 2024-09-12T17:47:11.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.491+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~5XK9N8EHR0YE.0 size=1048576 2024-09-12T17:47:11.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.495+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~5XK9N8EHR0YE.1 size=464814 2024-09-12T17:47:11.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.499+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=5XK9N8EHR0YE tag=C3F5EX72BHZV type=write size=2561966 2024-09-12T17:47:11.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.503+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~VETCOIC5RLO0.0 size=1048576 2024-09-12T17:47:11.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.503+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~VETCOIC5RLO0.1 size=1048576 2024-09-12T17:47:11.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.507+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~VETCOIC5RLO0.2 size=929481 2024-09-12T17:47:11.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.507+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=VETCOIC5RLO0 tag=K5VIB3F470HQ type=write size=4075209 2024-09-12T17:47:11.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.507+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=TI8IY3J0O71C type=del 2024-09-12T17:47:11.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.511+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=3TUEHYB9EL1J type=del size=2467865 2024-09-12T17:47:11.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.515+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=8W0IF212MWUV type=del 2024-09-12T17:47:11.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.519+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=FQAF9ZOIHL20 type=del size=4111158 2024-09-12T17:47:11.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.519+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~X1CTX6KXTE3K.0 size=651601 2024-09-12T17:47:11.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.523+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=X1CTX6KXTE3K tag=8ESKGP8H38QM type=write size=1700177 2024-09-12T17:47:11.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.527+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=2PMKBIBX6A0O type=write size=915670 2024-09-12T17:47:11.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.527+0000 7f68bc0598c0 1 < canceled part key=_multipart_3JPRQXKB5K3W.2~U2SAFVQC8HEZ.0 size=412224 2024-09-12T17:47:11.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.535+0000 7f68bc0598c0 1 < canceled multipart upload key=3JPRQXKB5K3W upload=U2SAFVQC8HEZ tag=GLCJR5KFHL6M type=write size=1460800 2024-09-12T17:47:11.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.539+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~FOQLJ0X4ROC9.0 size=1048576 2024-09-12T17:47:11.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.539+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~FOQLJ0X4ROC9.1 size=936292 2024-09-12T17:47:11.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.539+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=FOQLJ0X4ROC9 tag=7QJCKLX7N60J type=write size=3033444 2024-09-12T17:47:11.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.543+0000 7f68bc0598c0 1 < completed write operation key=RTY1OT2PSAAY tag=I9T2HUUJ3GJI type=write size=921719 2024-09-12T17:47:11.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.547+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~JH353G9AGS9V.0 size=876470 2024-09-12T17:47:11.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.547+0000 7f68bc0598c0 1 > prepared multipart upload key=2129SG6US3LI upload=JH353G9AGS9V tag=PD8NTRPK4AP8 type=write size=1925046 2024-09-12T17:47:11.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.551+0000 7f68bc0598c0 1 < completed write operation key=BKAT5SGAC5Z8 tag=71CG1K4Y0YWC type=write size=985240 2024-09-12T17:47:11.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.555+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=FLSNOK7HP1SG type=del size=315224 2024-09-12T17:47:11.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.555+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=655TBLQY0MJM type=del 2024-09-12T17:47:11.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.559+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=Z4A51M92FBN1 type=del size=3854093 2024-09-12T17:47:11.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.559+0000 7f68bc0598c0 1 < completed part key=_multipart_FC3K0QN3TAWH.2~B7WASRK82JAI.0 size=495807 2024-09-12T17:47:11.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.567+0000 7f68bc0598c0 1 < completed multipart upload key=FC3K0QN3TAWH upload=B7WASRK82JAI tag=3ZPBCC21HNR5 type=write size=1544383 2024-09-12T17:47:11.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.567+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=HZL0T8O0LY2Q type=del size=2433380 2024-09-12T17:47:11.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.571+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=Y26Y3GBK3AGG type=del 2024-09-12T17:47:11.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.575+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=Y0CC2ISWD27Y type=del size=4018231 2024-09-12T17:47:11.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.575+0000 7f68bc0598c0 1 < canceled part key=_multipart_6J677S46BXS4.2~VKF5B3ZVAM7N.0 size=986795 2024-09-12T17:47:11.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.579+0000 7f68bc0598c0 1 < canceled multipart upload key=6J677S46BXS4 upload=VKF5B3ZVAM7N tag=2W5GYE6NPI3Q type=write size=2035371 2024-09-12T17:47:11.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.579+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=S4S53D1FH56I type=write size=543810 2024-09-12T17:47:11.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.583+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=EAT46TVI5A2D type=del 2024-09-12T17:47:11.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.587+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~7N51WJQ6NP5J.0 size=1048576 2024-09-12T17:47:11.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.591+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~7N51WJQ6NP5J.1 size=862004 2024-09-12T17:47:11.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.591+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=7N51WJQ6NP5J tag=MBMNURKUR71C type=write size=2959156 2024-09-12T17:47:11.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.595+0000 7f68bc0598c0 1 < completed write operation key=7XH1E2GEH9O2 tag=GESFZQAJR8HU type=write size=804845 2024-09-12T17:47:11.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.595+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=RHH68OMEWFDE type=del size=1151407 2024-09-12T17:47:11.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.599+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=2TTB81WKOP55 type=del 2024-09-12T17:47:11.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.603+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~85MP8HVLT297.0 size=1048576 2024-09-12T17:47:11.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~85MP8HVLT297.1 size=1048576 2024-09-12T17:47:11.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~85MP8HVLT297.2 size=310172 2024-09-12T17:47:11.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.607+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=85MP8HVLT297 tag=7VAIFG2P9WW3 type=write size=3455900 2024-09-12T17:47:11.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.611+0000 7f68bc0598c0 1 < canceled operation key=P8T1VX1XFJ31 tag=2J0GC452J0O1 type=del size=2667876 2024-09-12T17:47:11.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.615+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~N1HGQ8AU9LTA.0 size=919978 2024-09-12T17:47:11.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.615+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=N1HGQ8AU9LTA tag=13AKCPIG1DSV type=write size=1968554 2024-09-12T17:47:11.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.619+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~17Y5ZEIDB3BX.0 size=1048576 2024-09-12T17:47:11.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.623+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~17Y5ZEIDB3BX.1 size=153994 2024-09-12T17:47:11.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.631+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=17Y5ZEIDB3BX tag=NLJUTGXG8YLO type=write size=2251146 2024-09-12T17:47:11.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.635+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~SO4ZRX1WQJER.0 size=1048576 2024-09-12T17:47:11.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.639+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~SO4ZRX1WQJER.1 size=1048576 2024-09-12T17:47:11.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.639+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~SO4ZRX1WQJER.2 size=517966 2024-09-12T17:47:11.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.639+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=SO4ZRX1WQJER tag=VFTH5IJ0VLOF type=write size=3663694 2024-09-12T17:47:11.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.643+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~VETCOIC5RLO0.0 size=1048576 2024-09-12T17:47:11.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.647+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~VETCOIC5RLO0.1 size=1048576 2024-09-12T17:47:11.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.647+0000 7f68bc0598c0 1 < canceled part key=_multipart_0XFYVNU2Q7KO.2~VETCOIC5RLO0.2 size=929481 2024-09-12T17:47:11.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.651+0000 7f68bc0598c0 1 < canceled multipart upload key=0XFYVNU2Q7KO upload=VETCOIC5RLO0 tag=K5VIB3F470HQ type=write size=4075209 2024-09-12T17:47:11.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.655+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=LB8UZ17J2DYZ type=del size=2391420 2024-09-12T17:47:11.663 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.659+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=3TUEHYB9EL1J type=del 2024-09-12T17:47:11.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.667+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~CJD5ANIRY05L.0 size=664990 2024-09-12T17:47:11.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.667+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=CJD5ANIRY05L tag=UAV1FCF1V2SS type=write size=1713566 2024-09-12T17:47:11.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.671+0000 7f68bc0598c0 1 < canceled operation key=3JPRQXKB5K3W tag=FQAF9ZOIHL20 type=del size=4111158 2024-09-12T17:47:11.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.671+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=XQUTPJ6JZCIZ type=write size=980138 2024-09-12T17:47:11.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.675+0000 7f68bc0598c0 1 < completed write operation key=FC3K0QN3TAWH tag=2PMKBIBX6A0O type=write size=915670 2024-09-12T17:47:11.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.683+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~77HNFQMA4FWL.0 size=1048576 2024-09-12T17:47:11.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.683+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~77HNFQMA4FWL.1 size=1048576 2024-09-12T17:47:11.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.687+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~77HNFQMA4FWL.2 size=340517 2024-09-12T17:47:11.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.687+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=77HNFQMA4FWL tag=FR79C3TV23C3 type=write size=3486245 2024-09-12T17:47:11.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.691+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~FOQLJ0X4ROC9.0 size=1048576 2024-09-12T17:47:11.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.695+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~FOQLJ0X4ROC9.1 size=936292 2024-09-12T17:47:11.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.699+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=FOQLJ0X4ROC9 tag=7QJCKLX7N60J type=write size=3033444 2024-09-12T17:47:11.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.703+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=EM704J5WJC32 type=del size=380759 2024-09-12T17:47:11.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.707+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~JH353G9AGS9V.0 size=876470 2024-09-12T17:47:11.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.711+0000 7f68bc0598c0 1 < completed multipart upload key=2129SG6US3LI upload=JH353G9AGS9V tag=PD8NTRPK4AP8 type=write size=1925046 2024-09-12T17:47:11.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.715+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~6GY5MKFI6MRQ.0 size=1048576 2024-09-12T17:47:11.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.719+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~6GY5MKFI6MRQ.1 size=246819 2024-09-12T17:47:11.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.719+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=6GY5MKFI6MRQ tag=J9CGYXFA8BGG type=write size=2343971 2024-09-12T17:47:11.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.723+0000 7f68bc0598c0 1 < suggested update operation key=WPQ755ODAFNT tag=FLSNOK7HP1SG type=del size=315224 2024-09-12T17:47:11.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.727+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=K9YM3EDIQ7MD type=write size=402499 2024-09-12T17:47:11.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.727+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=Z4A51M92FBN1 type=del 2024-09-12T17:47:11.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.731+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=FN94OU8KHXEM type=del size=3454214 2024-09-12T17:47:11.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.735+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=HZL0T8O0LY2Q type=del 2024-09-12T17:47:11.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~L6FZDY33AX5U.0 size=389620 2024-09-12T17:47:11.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.739+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=L6FZDY33AX5U tag=BECMIMAG651J type=write size=1438196 2024-09-12T17:47:11.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.743+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=Y0CC2ISWD27Y type=del 2024-09-12T17:47:11.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.747+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~NJL4BR5MSS7C.0 size=492916 2024-09-12T17:47:11.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.747+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=NJL4BR5MSS7C tag=JZJXIDRNE29O type=write size=1541492 2024-09-12T17:47:11.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.751+0000 7f68bc0598c0 1 < completed write operation key=3JPRQXKB5K3W tag=S4S53D1FH56I type=write size=543810 2024-09-12T17:47:11.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.751+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=92FTC6VV817C type=del size=2525095 2024-09-12T17:47:11.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.755+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~7N51WJQ6NP5J.0 size=1048576 2024-09-12T17:47:11.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.759+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~7N51WJQ6NP5J.1 size=862004 2024-09-12T17:47:11.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.763+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=7N51WJQ6NP5J tag=MBMNURKUR71C type=write size=2959156 2024-09-12T17:47:11.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.771+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~16OIZYETBNHR.0 size=1048576 2024-09-12T17:47:11.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.771+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~16OIZYETBNHR.1 size=21579 2024-09-12T17:47:11.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.771+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=16OIZYETBNHR tag=3CL854ORSL95 type=write size=2118731 2024-09-12T17:47:11.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.775+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=RHH68OMEWFDE type=del 2024-09-12T17:47:11.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.779+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~ARBCFZBR993U.0 size=1048576 2024-09-12T17:47:11.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.783+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~ARBCFZBR993U.1 size=156441 2024-09-12T17:47:11.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.783+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=ARBCFZBR993U tag=6TEP4P9M9MYQ type=write size=2253593 2024-09-12T17:47:11.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.787+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~85MP8HVLT297.0 size=1048576 2024-09-12T17:47:11.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.787+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~85MP8HVLT297.1 size=1048576 2024-09-12T17:47:11.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.791+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~85MP8HVLT297.2 size=310172 2024-09-12T17:47:11.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.795+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=85MP8HVLT297 tag=7VAIFG2P9WW3 type=write size=3455900 2024-09-12T17:47:11.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.799+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=GJSUR1NZFR7X type=del size=1141898 2024-09-12T17:47:11.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.803+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~N1HGQ8AU9LTA.0 size=919978 2024-09-12T17:47:11.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.807+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=N1HGQ8AU9LTA tag=13AKCPIG1DSV type=write size=1968554 2024-09-12T17:47:11.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.811+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=J92J25F0SO4E type=write size=427675 2024-09-12T17:47:11.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.811+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~SO4ZRX1WQJER.0 size=1048576 2024-09-12T17:47:11.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.815+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~SO4ZRX1WQJER.1 size=1048576 2024-09-12T17:47:11.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.819+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~SO4ZRX1WQJER.2 size=517966 2024-09-12T17:47:11.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.823+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=SO4ZRX1WQJER tag=VFTH5IJ0VLOF type=write size=3663694 2024-09-12T17:47:11.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.827+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~B1J7126891EE.0 size=119905 2024-09-12T17:47:11.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.827+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=B1J7126891EE tag=7F5QM0AQ85BX type=write size=1168481 2024-09-12T17:47:11.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.827+0000 7f68bc0598c0 1 < canceled operation key=OG0V0I1SDHG5 tag=LB8UZ17J2DYZ type=del size=2391420 2024-09-12T17:47:11.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.831+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=WSV3B9G32DFC type=del size=3841018 2024-09-12T17:47:11.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.835+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~CJD5ANIRY05L.0 size=664990 2024-09-12T17:47:11.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.839+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=CJD5ANIRY05L tag=UAV1FCF1V2SS type=write size=1713566 2024-09-12T17:47:11.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.839+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=3RWTA2FOW158 type=del size=2375490 2024-09-12T17:47:11.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.847+0000 7f68bc0598c0 1 < suggested remove operation key=NLPTU26RO70S tag=XQUTPJ6JZCIZ type=write 2024-09-12T17:47:11.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.847+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=33Z176CRB4BV type=del size=2721604 2024-09-12T17:47:11.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.851+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~77HNFQMA4FWL.0 size=1048576 2024-09-12T17:47:11.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.851+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~77HNFQMA4FWL.1 size=1048576 2024-09-12T17:47:11.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.855+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~77HNFQMA4FWL.2 size=340517 2024-09-12T17:47:11.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.859+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=77HNFQMA4FWL tag=FR79C3TV23C3 type=write size=3486245 2024-09-12T17:47:11.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.863+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=XSFPHNGXGZ6H type=del size=3306553 2024-09-12T17:47:11.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.863+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=EM704J5WJC32 type=del 2024-09-12T17:47:11.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.867+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=FV38LWBSDPYR type=del size=443764 2024-09-12T17:47:11.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.871+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~6GY5MKFI6MRQ.0 size=1048576 2024-09-12T17:47:11.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.871+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~6GY5MKFI6MRQ.1 size=246819 2024-09-12T17:47:11.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.875+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=6GY5MKFI6MRQ tag=J9CGYXFA8BGG type=write size=2343971 2024-09-12T17:47:11.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.879+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=Q13AADGRRPEX type=del size=2388229 2024-09-12T17:47:11.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.887+0000 7f68bc0598c0 1 < suggested update operation key=3JPRQXKB5K3W tag=K9YM3EDIQ7MD type=write size=402499 2024-09-12T17:47:11.895 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~FV10MOCIFM3J.0 size=1048576 2024-09-12T17:47:11.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.895+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~FV10MOCIFM3J.1 size=774170 2024-09-12T17:47:11.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.895+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=FV10MOCIFM3J tag=SAUJ1GCTUXRA type=write size=2871322 2024-09-12T17:47:11.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.903+0000 7f68bc0598c0 1 < suggested remove operation key=DMJZUQJ7IY60 tag=FN94OU8KHXEM type=del 2024-09-12T17:47:11.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.907+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=9EVZMN1JBOHP type=del size=1243728 2024-09-12T17:47:11.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.907+0000 7f68bc0598c0 1 < canceled part key=_multipart_57O6H52NHYOL.2~L6FZDY33AX5U.0 size=389620 2024-09-12T17:47:11.916 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.911+0000 7f68bc0598c0 1 < canceled multipart upload key=57O6H52NHYOL upload=L6FZDY33AX5U tag=BECMIMAG651J type=write size=1438196 2024-09-12T17:47:11.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.915+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=MK9OPXDBTI3K type=del size=1460745 2024-09-12T17:47:11.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.919+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~NJL4BR5MSS7C.0 size=492916 2024-09-12T17:47:11.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.923+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=NJL4BR5MSS7C tag=JZJXIDRNE29O type=write size=1541492 2024-09-12T17:47:11.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.927+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=J4BO3VVSFB5K type=del size=3507495 2024-09-12T17:47:11.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.927+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=92FTC6VV817C type=del 2024-09-12T17:47:11.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.931+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=LSYO0AXEMTRO type=del size=1211544 2024-09-12T17:47:11.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.935+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~16OIZYETBNHR.0 size=1048576 2024-09-12T17:47:11.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.939+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~16OIZYETBNHR.1 size=21579 2024-09-12T17:47:11.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.943+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=16OIZYETBNHR tag=3CL854ORSL95 type=write size=2118731 2024-09-12T17:47:11.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.947+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=70OH8IL70644 type=del size=2502410 2024-09-12T17:47:11.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.947+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~ARBCFZBR993U.0 size=1048576 2024-09-12T17:47:11.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.951+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~ARBCFZBR993U.1 size=156441 2024-09-12T17:47:11.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.955+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=ARBCFZBR993U tag=6TEP4P9M9MYQ type=write size=2253593 2024-09-12T17:47:11.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.959+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=ZZEAE75F0ZOF type=del size=3432394 2024-09-12T17:47:11.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.963+0000 7f68bc0598c0 1 < canceled operation key=P8T1VX1XFJ31 tag=GJSUR1NZFR7X type=del size=1141898 2024-09-12T17:47:11.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.967+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=3VOEUAD13I71 type=write size=803261 2024-09-12T17:47:11.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.971+0000 7f68bc0598c0 1 < completed write operation key=OG0V0I1SDHG5 tag=J92J25F0SO4E type=write size=427675 2024-09-12T17:47:11.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.975+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=CLJDONWWQ78A type=del size=809743 2024-09-12T17:47:11.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.975+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~B1J7126891EE.0 size=119905 2024-09-12T17:47:11.986 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.983+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=B1J7126891EE tag=7F5QM0AQ85BX type=write size=1168481 2024-09-12T17:47:11.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.987+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=39IN1N62ONPU type=del size=1178187 2024-09-12T17:47:11.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.991+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=WSV3B9G32DFC type=del 2024-09-12T17:47:11.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.991+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=LL25HGHO0V2Y type=del size=426979 2024-09-12T17:47:12.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:11.995+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=3RWTA2FOW158 type=del 2024-09-12T17:47:12.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.003+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~6FO1FN499NED.0 size=213423 2024-09-12T17:47:12.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.003+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=6FO1FN499NED tag=EJU2JRLLVVF0 type=write size=1261999 2024-09-12T17:47:12.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.007+0000 7f68bc0598c0 1 < canceled operation key=UOW521GPXBQ0 tag=33Z176CRB4BV type=del size=2721604 2024-09-12T17:47:12.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.011+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~KKODW5YF9RXT.0 size=1048576 2024-09-12T17:47:12.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.015+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~KKODW5YF9RXT.1 size=1048576 2024-09-12T17:47:12.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.019+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~KKODW5YF9RXT.2 size=154437 2024-09-12T17:47:12.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.019+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=KKODW5YF9RXT tag=XLNLV47IECFG type=write size=3300165 2024-09-12T17:47:12.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.023+0000 7f68bc0598c0 1 < suggested remove operation key=NLPTU26RO70S tag=XSFPHNGXGZ6H type=del 2024-09-12T17:47:12.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.027+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=GYGTMHO0RGCV type=del size=2234798 2024-09-12T17:47:12.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.031+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=FV38LWBSDPYR type=del 2024-09-12T17:47:12.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.035+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=UFPXANV26P4F type=del size=340911 2024-09-12T17:47:12.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.039+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=Q13AADGRRPEX type=del 2024-09-12T17:47:12.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.043+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=HPQWJJKGBTXV type=del size=2649619 2024-09-12T17:47:12.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.043+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~FV10MOCIFM3J.0 size=1048576 2024-09-12T17:47:12.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.047+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~FV10MOCIFM3J.1 size=774170 2024-09-12T17:47:12.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.055+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=FV10MOCIFM3J tag=SAUJ1GCTUXRA type=write size=2871322 2024-09-12T17:47:12.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.055+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=I1MU7EIGKXGT type=del size=1370009 2024-09-12T17:47:12.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.059+0000 7f68bc0598c0 1 < canceled operation key=UOW521GPXBQ0 tag=9EVZMN1JBOHP type=del size=1243728 2024-09-12T17:47:12.071 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.067+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~H2IKY10JEELE.0 size=808538 2024-09-12T17:47:12.071 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.067+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=H2IKY10JEELE tag=ZRHRIYLF1A3Q type=write size=1857114 2024-09-12T17:47:12.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.075+0000 7f68bc0598c0 1 < suggested update operation key=7XH1E2GEH9O2 tag=MK9OPXDBTI3K type=del size=1460745 2024-09-12T17:47:12.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.075+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=NDH9MO5FELZJ type=del size=3317379 2024-09-12T17:47:12.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.083+0000 7f68bc0598c0 1 < suggested update operation key=F4F4P4L8K5D9 tag=J4BO3VVSFB5K type=del size=3507495 2024-09-12T17:47:12.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.091+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~JIMMZ59XAH6D.0 size=1018515 2024-09-12T17:47:12.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.091+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=JIMMZ59XAH6D tag=975OAA29OHSC type=write size=2067091 2024-09-12T17:47:12.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.091+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=LSYO0AXEMTRO type=del 2024-09-12T17:47:12.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.099+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~OBBZL4AJP9XX.0 size=1048576 2024-09-12T17:47:12.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.103+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~OBBZL4AJP9XX.1 size=523378 2024-09-12T17:47:12.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.103+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=OBBZL4AJP9XX tag=MVIPL43446XE type=write size=2620530 2024-09-12T17:47:12.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.107+0000 7f68bc0598c0 1 < suggested remove operation key=0XFYVNU2Q7KO tag=70OH8IL70644 type=del 2024-09-12T17:47:12.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.111+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=NMR1ONS1RDO8 type=del size=673146 2024-09-12T17:47:12.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.115+0000 7f68bc0598c0 1 < canceled operation key=OG0V0I1SDHG5 tag=ZZEAE75F0ZOF type=del size=3432394 2024-09-12T17:47:12.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.119+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=9KIRN7ZMNIR9 type=del size=1871132 2024-09-12T17:47:12.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.127+0000 7f68bc0598c0 1 < suggested update operation key=4R9ENKMRB1GT tag=3VOEUAD13I71 type=write size=803261 2024-09-12T17:47:12.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.127+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=OMR0BOTHEAA9 type=del size=700737 2024-09-12T17:47:12.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.131+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=CLJDONWWQ78A type=del 2024-09-12T17:47:12.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.135+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=RNM3SHK4AVJ2 type=del size=2496028 2024-09-12T17:47:12.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.139+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=39IN1N62ONPU type=del 2024-09-12T17:47:12.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.143+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=5Q8UPEL68LH5 type=del size=751559 2024-09-12T17:47:12.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.147+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=LL25HGHO0V2Y type=del 2024-09-12T17:47:12.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.151+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=I1PF23FHCGD8 type=del size=896826 2024-09-12T17:47:12.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.151+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~6FO1FN499NED.0 size=213423 2024-09-12T17:47:12.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.159+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=6FO1FN499NED tag=EJU2JRLLVVF0 type=write size=1261999 2024-09-12T17:47:12.165 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.163+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=OXAZYQVSI4HN type=del size=218973 2024-09-12T17:47:12.168 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.163+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~KKODW5YF9RXT.0 size=1048576 2024-09-12T17:47:12.171 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.167+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~KKODW5YF9RXT.1 size=1048576 2024-09-12T17:47:12.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.171+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~KKODW5YF9RXT.2 size=154437 2024-09-12T17:47:12.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.175+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=KKODW5YF9RXT tag=XLNLV47IECFG type=write size=3300165 2024-09-12T17:47:12.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.179+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=3HHGTN10HOXO type=del size=2258716 2024-09-12T17:47:12.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.187+0000 7f68bc0598c0 1 < suggested remove operation key=XGJSQJ2IXJDK tag=GYGTMHO0RGCV type=del 2024-09-12T17:47:12.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.187+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=ZBHFZTRRAM8L type=del size=1043300 2024-09-12T17:47:12.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.191+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=UFPXANV26P4F type=del 2024-09-12T17:47:12.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.199+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~6FA2EY4XWOC7.0 size=1048576 2024-09-12T17:47:12.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.199+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~6FA2EY4XWOC7.1 size=1048576 2024-09-12T17:47:12.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.203+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~6FA2EY4XWOC7.2 size=391103 2024-09-12T17:47:12.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.203+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=6FA2EY4XWOC7 tag=4Z20XOUEUT20 type=write size=3536831 2024-09-12T17:47:12.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.207+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=HPQWJJKGBTXV type=del 2024-09-12T17:47:12.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.211+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=EQK0K3YR1D6C type=write size=4428 2024-09-12T17:47:12.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.219+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=I1MU7EIGKXGT type=del 2024-09-12T17:47:12.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.223+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~0VT8N1UJEG5R.0 size=840959 2024-09-12T17:47:12.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.223+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=0VT8N1UJEG5R tag=OQJJEQC9A8PN type=write size=1889535 2024-09-12T17:47:12.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.227+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~H2IKY10JEELE.0 size=808538 2024-09-12T17:47:12.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.231+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=H2IKY10JEELE tag=ZRHRIYLF1A3Q type=write size=1857114 2024-09-12T17:47:12.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.235+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=KLOAMYVRJHI7 type=write size=662079 2024-09-12T17:47:12.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.239+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=NDH9MO5FELZJ type=del 2024-09-12T17:47:12.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.243+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=D78HWFATM6LU type=del size=379914 2024-09-12T17:47:12.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.247+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~JIMMZ59XAH6D.0 size=1018515 2024-09-12T17:47:12.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.251+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=JIMMZ59XAH6D tag=975OAA29OHSC type=write size=2067091 2024-09-12T17:47:12.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.259+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~49IYLJCJ3LD9.0 size=1048576 2024-09-12T17:47:12.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.259+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~49IYLJCJ3LD9.1 size=979555 2024-09-12T17:47:12.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.259+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=49IYLJCJ3LD9 tag=9WAATJHCYSX9 type=write size=3076707 2024-09-12T17:47:12.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.263+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~OBBZL4AJP9XX.0 size=1048576 2024-09-12T17:47:12.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.267+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~OBBZL4AJP9XX.1 size=523378 2024-09-12T17:47:12.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.271+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=OBBZL4AJP9XX tag=MVIPL43446XE type=write size=2620530 2024-09-12T17:47:12.282 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.279+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~Z7BF1QNSYUYS.0 size=1048576 2024-09-12T17:47:12.285 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.283+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~Z7BF1QNSYUYS.1 size=257928 2024-09-12T17:47:12.285 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.283+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=Z7BF1QNSYUYS tag=03X6MT6PBL1Z type=write size=2355080 2024-09-12T17:47:12.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.283+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=NMR1ONS1RDO8 type=del 2024-09-12T17:47:12.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.287+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=6BAF9KEK3DS0 type=del size=536233 2024-09-12T17:47:12.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.291+0000 7f68bc0598c0 -1 < failed to complete operation key=4R9ENKMRB1GT tag=9KIRN7ZMNIR9 type=del size=1871132: (22) Invalid argument 2024-09-12T17:47:12.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.295+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=P2IUTR9WA660 type=del size=676214 2024-09-12T17:47:12.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.299+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=OMR0BOTHEAA9 type=del 2024-09-12T17:47:12.304 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.299+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=61LWRCZCSOB5 type=del size=159564 2024-09-12T17:47:12.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.307+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=RNM3SHK4AVJ2 type=del size=2496028 2024-09-12T17:47:12.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.311+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=UI0K479AE73I type=del size=3196245 2024-09-12T17:47:12.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.311+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=5Q8UPEL68LH5 type=del 2024-09-12T17:47:12.320 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.315+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=3U43163UHPTQ type=del size=1570755 2024-09-12T17:47:12.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.319+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=I1PF23FHCGD8 type=del 2024-09-12T17:47:12.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.323+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=Y3XFA53VGY46 type=del size=3576211 2024-09-12T17:47:12.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.327+0000 7f68bc0598c0 1 < suggested remove operation key=NLPTU26RO70S tag=OXAZYQVSI4HN type=del 2024-09-12T17:47:12.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.331+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=ZUOQGZ1C6PCP type=del size=3937820 2024-09-12T17:47:12.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.335+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=3HHGTN10HOXO type=del 2024-09-12T17:47:12.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.339+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=JNTOON78EZVO type=del size=22068 2024-09-12T17:47:12.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.343+0000 7f68bc0598c0 1 < suggested remove operation key=P8T1VX1XFJ31 tag=ZBHFZTRRAM8L type=del 2024-09-12T17:47:12.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.347+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~QGKSCNH84SZB.0 size=1048576 2024-09-12T17:47:12.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.351+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~QGKSCNH84SZB.1 size=1011503 2024-09-12T17:47:12.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.351+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=QGKSCNH84SZB tag=O8UWOLQVISCM type=write size=3108655 2024-09-12T17:47:12.358 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.355+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~6FA2EY4XWOC7.0 size=1048576 2024-09-12T17:47:12.360 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.355+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~6FA2EY4XWOC7.1 size=1048576 2024-09-12T17:47:12.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.359+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~6FA2EY4XWOC7.2 size=391103 2024-09-12T17:47:12.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.363+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=6FA2EY4XWOC7 tag=4Z20XOUEUT20 type=write size=3536831 2024-09-12T17:47:12.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.371+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~0GO77V40E36F.0 size=83729 2024-09-12T17:47:12.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.371+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=0GO77V40E36F tag=GVHK2V67P5C8 type=write size=1132305 2024-09-12T17:47:12.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.371+0000 7f68bc0598c0 1 < completed write operation key=WPQ755ODAFNT tag=EQK0K3YR1D6C type=write size=4428 2024-09-12T17:47:12.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.379+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~8JCT5ZHMSZ1M.0 size=1048576 2024-09-12T17:47:12.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.379+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~8JCT5ZHMSZ1M.1 size=1048576 2024-09-12T17:47:12.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.383+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~8JCT5ZHMSZ1M.2 size=663895 2024-09-12T17:47:12.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.383+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=8JCT5ZHMSZ1M tag=OWKQ644OFCVA type=write size=3809623 2024-09-12T17:47:12.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.387+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~0VT8N1UJEG5R.0 size=840959 2024-09-12T17:47:12.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.391+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=0VT8N1UJEG5R tag=OQJJEQC9A8PN type=write size=1889535 2024-09-12T17:47:12.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.391+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=8HJR0UXUYNKN type=del size=1123401 2024-09-12T17:47:12.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.395+0000 7f68bc0598c0 1 < completed write operation key=HGY9WK7MKCYS tag=KLOAMYVRJHI7 type=write size=662079 2024-09-12T17:47:12.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.399+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~UJUFOGDKXF1G.0 size=1048576 2024-09-12T17:47:12.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.403+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~UJUFOGDKXF1G.1 size=90725 2024-09-12T17:47:12.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.403+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=UJUFOGDKXF1G tag=QIS2606K3QVF type=write size=2187877 2024-09-12T17:47:12.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.407+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=D78HWFATM6LU type=del 2024-09-12T17:47:12.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.407+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=7LLW151QQHTQ type=del size=2958549 2024-09-12T17:47:12.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.411+0000 7f68bc0598c0 1 < canceled part key=_multipart_FC3K0QN3TAWH.2~49IYLJCJ3LD9.0 size=1048576 2024-09-12T17:47:12.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.411+0000 7f68bc0598c0 1 < canceled part key=_multipart_FC3K0QN3TAWH.2~49IYLJCJ3LD9.1 size=979555 2024-09-12T17:47:12.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.415+0000 7f68bc0598c0 1 < canceled multipart upload key=FC3K0QN3TAWH upload=49IYLJCJ3LD9 tag=9WAATJHCYSX9 type=write size=3076707 2024-09-12T17:47:12.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.419+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=XSCOQMMYJHEC type=del size=1616441 2024-09-12T17:47:12.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.423+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~Z7BF1QNSYUYS.0 size=1048576 2024-09-12T17:47:12.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.423+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~Z7BF1QNSYUYS.1 size=257928 2024-09-12T17:47:12.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.431+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=Z7BF1QNSYUYS tag=03X6MT6PBL1Z type=write size=2355080 2024-09-12T17:47:12.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.439+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~UWZDDYK3IDL7.0 size=959312 2024-09-12T17:47:12.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.439+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=UWZDDYK3IDL7 tag=08H9V0HD06PU type=write size=2007888 2024-09-12T17:47:12.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.439+0000 7f68bc0598c0 -1 < failed to complete operation key=P8T1VX1XFJ31 tag=6BAF9KEK3DS0 type=del size=536233: (22) Invalid argument 2024-09-12T17:47:12.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.447+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~WADGEO6JDTQ9.0 size=1048576 2024-09-12T17:47:12.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.447+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~WADGEO6JDTQ9.1 size=1048576 2024-09-12T17:47:12.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.451+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~WADGEO6JDTQ9.2 size=211782 2024-09-12T17:47:12.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.451+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=WADGEO6JDTQ9 tag=K9C2MST6MC2J type=write size=3357510 2024-09-12T17:47:12.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.451+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=P2IUTR9WA660 type=del 2024-09-12T17:47:12.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.455+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=JEJW5OVMRQWF type=del size=2317318 2024-09-12T17:47:12.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.459+0000 7f68bc0598c0 -1 < failed to complete operation key=NLPTU26RO70S tag=61LWRCZCSOB5 type=del size=159564: (22) Invalid argument 2024-09-12T17:47:12.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.459+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=SIIR8V04U9IZ type=del size=3852979 2024-09-12T17:47:12.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.467+0000 7f68bc0598c0 1 < suggested update operation key=6J677S46BXS4 tag=UI0K479AE73I type=del size=3196245 2024-09-12T17:47:12.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.467+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=UD1LLN39YDN0 type=del size=3848948 2024-09-12T17:47:12.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.471+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=3U43163UHPTQ type=del 2024-09-12T17:47:12.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.475+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~GFJH5H9UGAY3.0 size=1048576 2024-09-12T17:47:12.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.479+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~GFJH5H9UGAY3.1 size=330000 2024-09-12T17:47:12.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.479+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=GFJH5H9UGAY3 tag=C3P16L76I0OX type=write size=2427152 2024-09-12T17:47:12.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.483+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=Y3XFA53VGY46 type=del 2024-09-12T17:47:12.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.487+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~FA7JE31BVW7Y.0 size=1048576 2024-09-12T17:47:12.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.487+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~FA7JE31BVW7Y.1 size=1048576 2024-09-12T17:47:12.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.491+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~FA7JE31BVW7Y.2 size=140845 2024-09-12T17:47:12.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.491+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=FA7JE31BVW7Y tag=FEHND9HI7N5B type=write size=3286573 2024-09-12T17:47:12.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.495+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=ZUOQGZ1C6PCP type=del 2024-09-12T17:47:12.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.495+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=CS7M67P6H6U2 type=write size=803366 2024-09-12T17:47:12.503 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.499+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=JNTOON78EZVO type=del 2024-09-12T17:47:12.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.507+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=00RLLTD4L7DH type=write size=748694 2024-09-12T17:47:12.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.507+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~QGKSCNH84SZB.0 size=1048576 2024-09-12T17:47:12.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.511+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~QGKSCNH84SZB.1 size=1011503 2024-09-12T17:47:12.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.515+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=QGKSCNH84SZB tag=O8UWOLQVISCM type=write size=3108655 2024-09-12T17:47:12.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.519+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=NPVOMDGJY553 type=write size=200458 2024-09-12T17:47:12.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.519+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~0GO77V40E36F.0 size=83729 2024-09-12T17:47:12.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.527+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=0GO77V40E36F tag=GVHK2V67P5C8 type=write size=1132305 2024-09-12T17:47:12.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.531+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~WKE1QVLVSHI7.0 size=1048576 2024-09-12T17:47:12.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.531+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~WKE1QVLVSHI7.1 size=600815 2024-09-12T17:47:12.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.531+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=WKE1QVLVSHI7 tag=1PXZ4HDQUWIR type=write size=2697967 2024-09-12T17:47:12.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.535+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~8JCT5ZHMSZ1M.0 size=1048576 2024-09-12T17:47:12.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.539+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~8JCT5ZHMSZ1M.1 size=1048576 2024-09-12T17:47:12.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.539+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~8JCT5ZHMSZ1M.2 size=663895 2024-09-12T17:47:12.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.547+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=8JCT5ZHMSZ1M tag=OWKQ644OFCVA type=write size=3809623 2024-09-12T17:47:12.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.551+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=ND52IMNLRVOT type=del size=2423590 2024-09-12T17:47:12.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.551+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=8HJR0UXUYNKN type=del 2024-09-12T17:47:12.558 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.555+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=V08QJRZ3ASXM type=del size=2085832 2024-09-12T17:47:12.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.555+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~UJUFOGDKXF1G.0 size=1048576 2024-09-12T17:47:12.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.559+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~UJUFOGDKXF1G.1 size=90725 2024-09-12T17:47:12.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.563+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=UJUFOGDKXF1G tag=QIS2606K3QVF type=write size=2187877 2024-09-12T17:47:12.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.567+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=CLC64NTQ025L type=del size=2522362 2024-09-12T17:47:12.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.571+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=7LLW151QQHTQ type=del 2024-09-12T17:47:12.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.571+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=S2KESAUL6CZL type=del size=2692046 2024-09-12T17:47:12.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.579+0000 7f68bc0598c0 1 < suggested remove operation key=BKAT5SGAC5Z8 tag=XSCOQMMYJHEC type=del 2024-09-12T17:47:12.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.583+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=JVI7Y06QG9FI type=del size=2198618 2024-09-12T17:47:12.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.583+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~UWZDDYK3IDL7.0 size=959312 2024-09-12T17:47:12.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.587+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=UWZDDYK3IDL7 tag=08H9V0HD06PU type=write size=2007888 2024-09-12T17:47:12.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.591+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=1PJ8LJD1P5AE type=del size=212209 2024-09-12T17:47:12.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.595+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~WADGEO6JDTQ9.0 size=1048576 2024-09-12T17:47:12.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.599+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~WADGEO6JDTQ9.1 size=1048576 2024-09-12T17:47:12.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.599+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~WADGEO6JDTQ9.2 size=211782 2024-09-12T17:47:12.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.603+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=WADGEO6JDTQ9 tag=K9C2MST6MC2J type=write size=3357510 2024-09-12T17:47:12.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.607+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=K3MX1B86SKY1 type=del size=977408 2024-09-12T17:47:12.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.611+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=JEJW5OVMRQWF type=del 2024-09-12T17:47:12.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.615+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~XD4IEYU3YHW5.0 size=1046961 2024-09-12T17:47:12.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.615+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=XD4IEYU3YHW5 tag=YHSF11WZKEKA type=write size=2095537 2024-09-12T17:47:12.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.619+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=SIIR8V04U9IZ type=del 2024-09-12T17:47:12.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.623+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~03BSFM10VPB2.0 size=1048576 2024-09-12T17:47:12.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.627+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~03BSFM10VPB2.1 size=526085 2024-09-12T17:47:12.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.627+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=03BSFM10VPB2 tag=7U4R8NHVSGT3 type=write size=2623237 2024-09-12T17:47:12.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.631+0000 7f68bc0598c0 1 < canceled operation key=KW3VWTA43PBM tag=UD1LLN39YDN0 type=del size=3848948 2024-09-12T17:47:12.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.635+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~T720FL3JTQYU.0 size=1048576 2024-09-12T17:47:12.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.635+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~T720FL3JTQYU.1 size=1048576 2024-09-12T17:47:12.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.639+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~T720FL3JTQYU.2 size=359071 2024-09-12T17:47:12.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.639+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=T720FL3JTQYU tag=56V0NH550R47 type=write size=3504799 2024-09-12T17:47:12.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.643+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~GFJH5H9UGAY3.0 size=1048576 2024-09-12T17:47:12.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.643+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~GFJH5H9UGAY3.1 size=330000 2024-09-12T17:47:12.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.651+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=GFJH5H9UGAY3 tag=C3P16L76I0OX type=write size=2427152 2024-09-12T17:47:12.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.651+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=G05VUBZNQ5NY type=del size=1766133 2024-09-12T17:47:12.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.655+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~FA7JE31BVW7Y.0 size=1048576 2024-09-12T17:47:12.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.655+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~FA7JE31BVW7Y.1 size=1048576 2024-09-12T17:47:12.663 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.659+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~FA7JE31BVW7Y.2 size=140845 2024-09-12T17:47:12.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.663+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=FA7JE31BVW7Y tag=FEHND9HI7N5B type=write size=3286573 2024-09-12T17:47:12.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.667+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~7F7LC6UASMUA.0 size=1048576 2024-09-12T17:47:12.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.671+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~7F7LC6UASMUA.1 size=1048576 2024-09-12T17:47:12.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.675+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~7F7LC6UASMUA.2 size=728833 2024-09-12T17:47:12.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.675+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=7F7LC6UASMUA tag=NAQJHHUL1UGV type=write size=3874561 2024-09-12T17:47:12.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.675+0000 7f68bc0598c0 1 < completed write operation key=S0B1RP89NO44 tag=CS7M67P6H6U2 type=write size=803366 2024-09-12T17:47:12.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.679+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=03RINEYLJSUT type=del size=826382 2024-09-12T17:47:12.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.683+0000 7f68bc0598c0 1 < completed write operation key=NLPTU26RO70S tag=00RLLTD4L7DH type=write size=748694 2024-09-12T17:47:12.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.687+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~UQ3BXLDMOOPD.0 size=1048576 2024-09-12T17:47:12.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.691+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~UQ3BXLDMOOPD.1 size=1048576 2024-09-12T17:47:12.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.691+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~UQ3BXLDMOOPD.2 size=193617 2024-09-12T17:47:12.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.691+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=UQ3BXLDMOOPD tag=JHZE6P029BHS type=write size=3339345 2024-09-12T17:47:12.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.695+0000 7f68bc0598c0 1 < completed write operation key=6J677S46BXS4 tag=NPVOMDGJY553 type=write size=200458 2024-09-12T17:47:12.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.699+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~GYIA3GE2NALZ.0 size=230987 2024-09-12T17:47:12.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.699+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=GYIA3GE2NALZ tag=RR3WR2TWWISE type=write size=1279563 2024-09-12T17:47:12.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.703+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~WKE1QVLVSHI7.0 size=1048576 2024-09-12T17:47:12.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.707+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~WKE1QVLVSHI7.1 size=600815 2024-09-12T17:47:12.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.711+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=WKE1QVLVSHI7 tag=1PXZ4HDQUWIR type=write size=2697967 2024-09-12T17:47:12.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.715+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~3QPTFAQ0UP0I.0 size=309408 2024-09-12T17:47:12.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.715+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=3QPTFAQ0UP0I tag=U6EEITJ6MMLY type=write size=1357984 2024-09-12T17:47:12.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.719+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=ND52IMNLRVOT type=del 2024-09-12T17:47:12.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.719+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=QDP98G0NE2BY type=del size=1705866 2024-09-12T17:47:12.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.727+0000 7f68bc0598c0 1 < suggested remove operation key=6J677S46BXS4 tag=V08QJRZ3ASXM type=del 2024-09-12T17:47:12.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.727+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=GIGRPUZA2SC2 type=write size=582103 2024-09-12T17:47:12.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.731+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=CLC64NTQ025L type=del 2024-09-12T17:47:12.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.735+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~1CBRON7OVW6Y.0 size=1048576 2024-09-12T17:47:12.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~1CBRON7OVW6Y.1 size=478995 2024-09-12T17:47:12.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.739+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=1CBRON7OVW6Y tag=CMJLPW8RTI44 type=write size=2576147 2024-09-12T17:47:12.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.743+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=S2KESAUL6CZL type=del 2024-09-12T17:47:12.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.743+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=25KZHANR1CGR type=del size=3674824 2024-09-12T17:47:12.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.747+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=JVI7Y06QG9FI type=del 2024-09-12T17:47:12.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.751+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~6LOCQZ52A1WP.0 size=1048576 2024-09-12T17:47:12.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.755+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~6LOCQZ52A1WP.1 size=1048576 2024-09-12T17:47:12.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.755+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~6LOCQZ52A1WP.2 size=986758 2024-09-12T17:47:12.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.755+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=6LOCQZ52A1WP tag=SCGBPAAP31WV type=write size=4132486 2024-09-12T17:47:12.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.759+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=1PJ8LJD1P5AE type=del 2024-09-12T17:47:12.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.763+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=99OFQBI6V89L type=del size=709307 2024-09-12T17:47:12.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.767+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=K3MX1B86SKY1 type=del 2024-09-12T17:47:12.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.771+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=SFV0ZSOKCAWZ type=write size=464248 2024-09-12T17:47:12.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.775+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~XD4IEYU3YHW5.0 size=1046961 2024-09-12T17:47:12.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.779+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=XD4IEYU3YHW5 tag=YHSF11WZKEKA type=write size=2095537 2024-09-12T17:47:12.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.779+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=21LE7ZEZS1QB type=del size=32301 2024-09-12T17:47:12.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.783+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~03BSFM10VPB2.0 size=1048576 2024-09-12T17:47:12.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.787+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~03BSFM10VPB2.1 size=526085 2024-09-12T17:47:12.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.791+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=03BSFM10VPB2 tag=7U4R8NHVSGT3 type=write size=2623237 2024-09-12T17:47:12.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.795+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~34BKKL91AWQ9.0 size=1048576 2024-09-12T17:47:12.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.795+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~34BKKL91AWQ9.1 size=1048576 2024-09-12T17:47:12.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.799+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~34BKKL91AWQ9.2 size=235354 2024-09-12T17:47:12.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.799+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=34BKKL91AWQ9 tag=RDRI3S4SYIVX type=write size=3381082 2024-09-12T17:47:12.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.803+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~T720FL3JTQYU.0 size=1048576 2024-09-12T17:47:12.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.803+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~T720FL3JTQYU.1 size=1048576 2024-09-12T17:47:12.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.807+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~T720FL3JTQYU.2 size=359071 2024-09-12T17:47:12.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.811+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=T720FL3JTQYU tag=56V0NH550R47 type=write size=3504799 2024-09-12T17:47:12.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.815+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~75Z6E2EC0EU0.0 size=114004 2024-09-12T17:47:12.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.815+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=75Z6E2EC0EU0 tag=75968NAY52LF type=write size=1162580 2024-09-12T17:47:12.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.819+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=G05VUBZNQ5NY type=del 2024-09-12T17:47:12.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.819+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=C5LK2K6W2GEA type=del size=2105696 2024-09-12T17:47:12.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.823+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~7F7LC6UASMUA.0 size=1048576 2024-09-12T17:47:12.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.827+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~7F7LC6UASMUA.1 size=1048576 2024-09-12T17:47:12.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.827+0000 7f68bc0598c0 1 < canceled part key=_multipart_06W7N11O7F1I.2~7F7LC6UASMUA.2 size=728833 2024-09-12T17:47:12.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.831+0000 7f68bc0598c0 1 < canceled multipart upload key=06W7N11O7F1I upload=7F7LC6UASMUA tag=NAQJHHUL1UGV type=write size=3874561 2024-09-12T17:47:12.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.831+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=NTOZ3M5NUTAR type=del size=1844525 2024-09-12T17:47:12.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.835+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=03RINEYLJSUT type=del 2024-09-12T17:47:12.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.835+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=8JN7OY589KEI type=del size=4175544 2024-09-12T17:47:12.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.839+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~UQ3BXLDMOOPD.0 size=1048576 2024-09-12T17:47:12.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.839+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~UQ3BXLDMOOPD.1 size=1048576 2024-09-12T17:47:12.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.839+0000 7f68bc0598c0 1 < canceled part key=_multipart_OG0V0I1SDHG5.2~UQ3BXLDMOOPD.2 size=193617 2024-09-12T17:47:12.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.843+0000 7f68bc0598c0 1 < canceled multipart upload key=OG0V0I1SDHG5 upload=UQ3BXLDMOOPD tag=JHZE6P029BHS type=write size=3339345 2024-09-12T17:47:12.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.847+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=KBNVWDPWV8G8 type=del size=1809347 2024-09-12T17:47:12.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.847+0000 7f68bc0598c0 1 < canceled part key=_multipart_SBQGW2EK6I1J.2~GYIA3GE2NALZ.0 size=230987 2024-09-12T17:47:12.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.851+0000 7f68bc0598c0 1 < canceled multipart upload key=SBQGW2EK6I1J upload=GYIA3GE2NALZ tag=RR3WR2TWWISE type=write size=1279563 2024-09-12T17:47:12.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.855+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~U6P2TTOADE6T.0 size=1048576 2024-09-12T17:47:12.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.859+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~U6P2TTOADE6T.1 size=102646 2024-09-12T17:47:12.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.859+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=U6P2TTOADE6T tag=BN4WO9ELRAX1 type=write size=2199798 2024-09-12T17:47:12.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.859+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~3QPTFAQ0UP0I.0 size=309408 2024-09-12T17:47:12.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.863+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=3QPTFAQ0UP0I tag=U6EEITJ6MMLY type=write size=1357984 2024-09-12T17:47:12.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.867+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=NST9B9SU2ZL0 type=del size=681974 2024-09-12T17:47:12.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.871+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=QDP98G0NE2BY type=del 2024-09-12T17:47:12.877 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.871+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=JDVHHKII27XF type=del size=2569626 2024-09-12T17:47:12.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.875+0000 7f68bc0598c0 1 < completed write operation key=6J677S46BXS4 tag=GIGRPUZA2SC2 type=write size=582103 2024-09-12T17:47:12.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.879+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=1RSHT5PNS9JA type=del size=1717320 2024-09-12T17:47:12.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.879+0000 7f68bc0598c0 1 < canceled part key=_multipart_S0B1RP89NO44.2~1CBRON7OVW6Y.0 size=1048576 2024-09-12T17:47:12.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.883+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~1CBRON7OVW6Y.1 size=478995 2024-09-12T17:47:12.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.887+0000 7f68bc0598c0 1 < canceled multipart upload key=S0B1RP89NO44 upload=1CBRON7OVW6Y tag=CMJLPW8RTI44 type=write size=2576147 2024-09-12T17:47:12.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~K74KWA0NOG58.0 size=1048576 2024-09-12T17:47:12.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.895+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~K74KWA0NOG58.1 size=470712 2024-09-12T17:47:12.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.895+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=K74KWA0NOG58 tag=IBQROCRXZD2L type=write size=2567864 2024-09-12T17:47:12.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.895+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=25KZHANR1CGR type=del 2024-09-12T17:47:12.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.903+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~5CUGOWT4VREE.0 size=1048576 2024-09-12T17:47:12.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.903+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~5CUGOWT4VREE.1 size=1048576 2024-09-12T17:47:12.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.907+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~5CUGOWT4VREE.2 size=881019 2024-09-12T17:47:12.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.907+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=5CUGOWT4VREE tag=R2O04T0K2E3I type=write size=4026747 2024-09-12T17:47:12.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.907+0000 7f68bc0598c0 1 < canceled part key=_multipart_MRS3KW2H5AKK.2~6LOCQZ52A1WP.0 size=1048576 2024-09-12T17:47:12.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.907+0000 7f68bc0598c0 1 < canceled part key=_multipart_MRS3KW2H5AKK.2~6LOCQZ52A1WP.1 size=1048576 2024-09-12T17:47:12.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.907+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~6LOCQZ52A1WP.2 size=986758 2024-09-12T17:47:12.918 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.915+0000 7f68bc0598c0 1 < canceled multipart upload key=MRS3KW2H5AKK upload=6LOCQZ52A1WP tag=SCGBPAAP31WV type=write size=4132486 2024-09-12T17:47:12.921 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.915+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=8EWP6A059CAA type=del size=3505413 2024-09-12T17:47:12.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.923+0000 7f68bc0598c0 1 < suggested update operation key=UOW521GPXBQ0 tag=99OFQBI6V89L type=del size=709307 2024-09-12T17:47:12.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.927+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=ANBVY6XZYBEU type=del size=1034386 2024-09-12T17:47:12.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.927+0000 7f68bc0598c0 1 < completed write operation key=2129SG6US3LI tag=SFV0ZSOKCAWZ type=write size=464248 2024-09-12T17:47:12.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.931+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=8YU2VJ2DIL5H type=write size=981635 2024-09-12T17:47:12.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.935+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=21LE7ZEZS1QB type=del 2024-09-12T17:47:12.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.939+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=FRRR5ZCV3MJ3 type=write size=542677 2024-09-12T17:47:12.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.939+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~34BKKL91AWQ9.0 size=1048576 2024-09-12T17:47:12.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.943+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~34BKKL91AWQ9.1 size=1048576 2024-09-12T17:47:12.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.947+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~34BKKL91AWQ9.2 size=235354 2024-09-12T17:47:12.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.951+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=34BKKL91AWQ9 tag=RDRI3S4SYIVX type=write size=3381082 2024-09-12T17:47:12.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.955+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=HXW83NYIBM6B type=write size=210313 2024-09-12T17:47:12.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.955+0000 7f68bc0598c0 1 < canceled part key=_multipart_KW3VWTA43PBM.2~75Z6E2EC0EU0.0 size=114004 2024-09-12T17:47:12.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.959+0000 7f68bc0598c0 1 < canceled multipart upload key=KW3VWTA43PBM upload=75Z6E2EC0EU0 tag=75968NAY52LF type=write size=1162580 2024-09-12T17:47:12.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.963+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=K9MDESE51V04 type=del size=1801949 2024-09-12T17:47:12.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.967+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=C5LK2K6W2GEA type=del 2024-09-12T17:47:12.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.967+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=RNXTBFLL3NSJ type=del size=2593000 2024-09-12T17:47:12.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.975+0000 7f68bc0598c0 1 < suggested update operation key=UMQLPH9XGWRZ tag=NTOZ3M5NUTAR type=del size=1844525 2024-09-12T17:47:12.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.979+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=KXUXWOZ0ZKA8 type=del size=1924273 2024-09-12T17:47:12.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.979+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=8JN7OY589KEI type=del 2024-09-12T17:47:12.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.983+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=ZJ0X4PG6VOTD type=write size=233995 2024-09-12T17:47:12.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.987+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=KBNVWDPWV8G8 type=del 2024-09-12T17:47:12.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.991+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~EWJII8Z0J8AJ.0 size=1048576 2024-09-12T17:47:12.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.995+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~EWJII8Z0J8AJ.1 size=1048576 2024-09-12T17:47:13.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.995+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~EWJII8Z0J8AJ.2 size=582481 2024-09-12T17:47:13.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.995+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=EWJII8Z0J8AJ tag=M23K6381X35A type=write size=3728209 2024-09-12T17:47:13.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:12.999+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~U6P2TTOADE6T.0 size=1048576 2024-09-12T17:47:13.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.003+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~U6P2TTOADE6T.1 size=102646 2024-09-12T17:47:13.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.007+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=U6P2TTOADE6T tag=BN4WO9ELRAX1 type=write size=2199798 2024-09-12T17:47:13.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.011+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~P1MGQGIBP0PT.0 size=1048576 2024-09-12T17:47:13.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.015+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~P1MGQGIBP0PT.1 size=926828 2024-09-12T17:47:13.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.015+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=P1MGQGIBP0PT tag=YJPTA2LS2IQS type=write size=3023980 2024-09-12T17:47:13.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.015+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=NST9B9SU2ZL0 type=del 2024-09-12T17:47:13.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.019+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=XLBTVW2KWNY0 type=del size=3029769 2024-09-12T17:47:13.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.027+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=JDVHHKII27XF type=del 2024-09-12T17:47:13.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.031+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~FLD7RX1F53BQ.0 size=1048576 2024-09-12T17:47:13.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.035+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~FLD7RX1F53BQ.1 size=1048576 2024-09-12T17:47:13.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.039+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~FLD7RX1F53BQ.2 size=1020265 2024-09-12T17:47:13.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.039+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=FLD7RX1F53BQ tag=12H7YQ45NII9 type=write size=4165993 2024-09-12T17:47:13.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.039+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=1RSHT5PNS9JA type=del 2024-09-12T17:47:13.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.043+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=U3OR48F4JCWQ type=del size=1701374 2024-09-12T17:47:13.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.047+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~K74KWA0NOG58.0 size=1048576 2024-09-12T17:47:13.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.047+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~K74KWA0NOG58.1 size=470712 2024-09-12T17:47:13.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.055+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=K74KWA0NOG58 tag=IBQROCRXZD2L type=write size=2567864 2024-09-12T17:47:13.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.055+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=ZTK68T8IF421 type=del size=3346702 2024-09-12T17:47:13.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.059+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~5CUGOWT4VREE.0 size=1048576 2024-09-12T17:47:13.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.063+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~5CUGOWT4VREE.1 size=1048576 2024-09-12T17:47:13.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.063+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~5CUGOWT4VREE.2 size=881019 2024-09-12T17:47:13.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.067+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=5CUGOWT4VREE tag=R2O04T0K2E3I type=write size=4026747 2024-09-12T17:47:13.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.071+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=BDO4AD6GFYO0 type=del size=353621 2024-09-12T17:47:13.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.079+0000 7f68bc0598c0 1 < suggested remove operation key=9XK00RPA6Q38 tag=8EWP6A059CAA type=del 2024-09-12T17:47:13.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.083+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~XY4AC4C1N2WV.0 size=1048576 2024-09-12T17:47:13.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.083+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~XY4AC4C1N2WV.1 size=318428 2024-09-12T17:47:13.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.083+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=XY4AC4C1N2WV tag=21JMIQMZAV7B type=write size=2415580 2024-09-12T17:47:13.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.087+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=ANBVY6XZYBEU type=del 2024-09-12T17:47:13.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.091+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=ZP25XICM0HTB type=del size=2255824 2024-09-12T17:47:13.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.095+0000 7f68bc0598c0 1 < completed write operation key=F4F4P4L8K5D9 tag=8YU2VJ2DIL5H type=write size=981635 2024-09-12T17:47:13.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.099+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~PO7ZFNFS03V6.0 size=1048576 2024-09-12T17:47:13.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.099+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~PO7ZFNFS03V6.1 size=150412 2024-09-12T17:47:13.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.099+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=PO7ZFNFS03V6 tag=9Y9LQ391CL0C type=write size=2247564 2024-09-12T17:47:13.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.103+0000 7f68bc0598c0 1 < completed write operation key=3JPRQXKB5K3W tag=FRRR5ZCV3MJ3 type=write size=542677 2024-09-12T17:47:13.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.107+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=X26CHA2QGN3L type=write size=1000745 2024-09-12T17:47:13.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.111+0000 7f68bc0598c0 1 < suggested remove operation key=NLPTU26RO70S tag=HXW83NYIBM6B type=write 2024-09-12T17:47:13.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.115+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=01GXUPT4W0L7 type=del size=2614856 2024-09-12T17:47:13.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.119+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=K9MDESE51V04 type=del 2024-09-12T17:47:13.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.123+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~5O1X02450AGN.0 size=1048576 2024-09-12T17:47:13.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.127+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~5O1X02450AGN.1 size=1048576 2024-09-12T17:47:13.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.131+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~5O1X02450AGN.2 size=94119 2024-09-12T17:47:13.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.131+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=5O1X02450AGN tag=OG0NHFFWI5W8 type=write size=3239847 2024-09-12T17:47:13.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.131+0000 7f68bc0598c0 1 < canceled operation key=2129SG6US3LI tag=RNXTBFLL3NSJ type=del size=2593000 2024-09-12T17:47:13.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.135+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=DTMKXPK0SUKS type=del size=216786 2024-09-12T17:47:13.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.139+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=KXUXWOZ0ZKA8 type=del 2024-09-12T17:47:13.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.143+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=SX0JCOBRV8K3 type=del size=1624301 2024-09-12T17:47:13.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.143+0000 7f68bc0598c0 -1 < failed to complete operation key=9XK00RPA6Q38 tag=ZJ0X4PG6VOTD type=write size=233995: (22) Invalid argument 2024-09-12T17:47:13.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.147+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=WT5MNX4HI3LB type=del size=927545 2024-09-12T17:47:13.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.151+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~EWJII8Z0J8AJ.0 size=1048576 2024-09-12T17:47:13.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.151+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~EWJII8Z0J8AJ.1 size=1048576 2024-09-12T17:47:13.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.155+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~EWJII8Z0J8AJ.2 size=582481 2024-09-12T17:47:13.165 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.159+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=EWJII8Z0J8AJ tag=M23K6381X35A type=write size=3728209 2024-09-12T17:47:13.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.167+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~RKLFRWDF18FY.0 size=1048576 2024-09-12T17:47:13.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~RKLFRWDF18FY.1 size=1048576 2024-09-12T17:47:13.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~RKLFRWDF18FY.2 size=101100 2024-09-12T17:47:13.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.171+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=RKLFRWDF18FY tag=MPKDMY12AUO7 type=write size=3246828 2024-09-12T17:47:13.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.175+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~P1MGQGIBP0PT.0 size=1048576 2024-09-12T17:47:13.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.179+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~P1MGQGIBP0PT.1 size=926828 2024-09-12T17:47:13.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.183+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=P1MGQGIBP0PT tag=YJPTA2LS2IQS type=write size=3023980 2024-09-12T17:47:13.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.187+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=0EQM593V5JWW type=write size=104347 2024-09-12T17:47:13.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.191+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=XLBTVW2KWNY0 type=del 2024-09-12T17:47:13.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.195+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=97D49ZQ9HEZN type=del size=948256 2024-09-12T17:47:13.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.195+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~FLD7RX1F53BQ.0 size=1048576 2024-09-12T17:47:13.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.199+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~FLD7RX1F53BQ.1 size=1048576 2024-09-12T17:47:13.205 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.203+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~FLD7RX1F53BQ.2 size=1020265 2024-09-12T17:47:13.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.207+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=FLD7RX1F53BQ tag=12H7YQ45NII9 type=write size=4165993 2024-09-12T17:47:13.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.211+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=01MUNEEN2K6J type=del size=4075462 2024-09-12T17:47:13.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.211+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=U3OR48F4JCWQ type=del 2024-09-12T17:47:13.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.219+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~R16SZFD9GMYD.0 size=930230 2024-09-12T17:47:13.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.219+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=R16SZFD9GMYD tag=YOGN2FZR1BQM type=write size=1978806 2024-09-12T17:47:13.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.223+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=ZTK68T8IF421 type=del 2024-09-12T17:47:13.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.223+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=US9N8O3FK07G type=del size=4115379 2024-09-12T17:47:13.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.227+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=BDO4AD6GFYO0 type=del 2024-09-12T17:47:13.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.231+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=EN10GJEMRRQ1 type=write size=458080 2024-09-12T17:47:13.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.235+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~XY4AC4C1N2WV.0 size=1048576 2024-09-12T17:47:13.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.235+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~XY4AC4C1N2WV.1 size=318428 2024-09-12T17:47:13.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.243+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=XY4AC4C1N2WV tag=21JMIQMZAV7B type=write size=2415580 2024-09-12T17:47:13.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.243+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=UKE6GUQAAUB8 type=del size=3564230 2024-09-12T17:47:13.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.247+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=ZP25XICM0HTB type=del 2024-09-12T17:47:13.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.251+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=BMRO10BOF5Y2 type=del size=387549 2024-09-12T17:47:13.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.255+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~PO7ZFNFS03V6.0 size=1048576 2024-09-12T17:47:13.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.259+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~PO7ZFNFS03V6.1 size=150412 2024-09-12T17:47:13.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.263+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=PO7ZFNFS03V6 tag=9Y9LQ391CL0C type=write size=2247564 2024-09-12T17:47:13.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.267+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~NA7SSCWGX36I.0 size=1048576 2024-09-12T17:47:13.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.271+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~NA7SSCWGX36I.1 size=1048576 2024-09-12T17:47:13.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.271+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~NA7SSCWGX36I.2 size=398027 2024-09-12T17:47:13.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.271+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=NA7SSCWGX36I tag=7N3J488HKTR4 type=write size=3543755 2024-09-12T17:47:13.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.275+0000 7f68bc0598c0 1 < completed write operation key=QGO5SPFPT548 tag=X26CHA2QGN3L type=write size=1000745 2024-09-12T17:47:13.284 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.279+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~IVAP2HXUM8S5.0 size=1048576 2024-09-12T17:47:13.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.283+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~IVAP2HXUM8S5.1 size=1048576 2024-09-12T17:47:13.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.283+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~IVAP2HXUM8S5.2 size=621499 2024-09-12T17:47:13.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.283+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=IVAP2HXUM8S5 tag=0XKPW6PDEP8H type=write size=3767227 2024-09-12T17:47:13.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.291+0000 7f68bc0598c0 1 < suggested update operation key=S0B1RP89NO44 tag=01GXUPT4W0L7 type=del size=2614856 2024-09-12T17:47:13.299 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.295+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=6EYP4TBK8VSI type=del size=3041870 2024-09-12T17:47:13.302 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.299+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~5O1X02450AGN.0 size=1048576 2024-09-12T17:47:13.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.299+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~5O1X02450AGN.1 size=1048576 2024-09-12T17:47:13.307 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.303+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~5O1X02450AGN.2 size=94119 2024-09-12T17:47:13.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.311+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=5O1X02450AGN tag=OG0NHFFWI5W8 type=write size=3239847 2024-09-12T17:47:13.320 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.315+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=X0GW68KKMKHA type=del size=522416 2024-09-12T17:47:13.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.323+0000 7f68bc0598c0 1 < suggested remove operation key=S0B1RP89NO44 tag=DTMKXPK0SUKS type=del 2024-09-12T17:47:13.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.331+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~Q7S36BBB881M.0 size=451347 2024-09-12T17:47:13.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.331+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=Q7S36BBB881M tag=QGWEM2VHRQAK type=write size=1499923 2024-09-12T17:47:13.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.331+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=SX0JCOBRV8K3 type=del 2024-09-12T17:47:13.340 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.335+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=RJIEUIMSGH9B type=del size=4024550 2024-09-12T17:47:13.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.343+0000 7f68bc0598c0 1 < suggested remove operation key=QGO5SPFPT548 tag=WT5MNX4HI3LB type=del 2024-09-12T17:47:13.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.347+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=HOVV14NB4AGB type=del size=3219654 2024-09-12T17:47:13.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.351+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~RKLFRWDF18FY.0 size=1048576 2024-09-12T17:47:13.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.351+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~RKLFRWDF18FY.1 size=1048576 2024-09-12T17:47:13.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.351+0000 7f68bc0598c0 1 < canceled part key=_multipart_3JPRQXKB5K3W.2~RKLFRWDF18FY.2 size=101100 2024-09-12T17:47:13.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.359+0000 7f68bc0598c0 1 < canceled multipart upload key=3JPRQXKB5K3W upload=RKLFRWDF18FY tag=MPKDMY12AUO7 type=write size=3246828 2024-09-12T17:47:13.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.363+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~3WZXWMBKVD8M.0 size=1048576 2024-09-12T17:47:13.370 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.367+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~3WZXWMBKVD8M.1 size=412460 2024-09-12T17:47:13.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.367+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=3WZXWMBKVD8M tag=US1K4C2DRHWE type=write size=2509612 2024-09-12T17:47:13.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.371+0000 7f68bc0598c0 1 < completed write operation key=7XH1E2GEH9O2 tag=0EQM593V5JWW type=write size=104347 2024-09-12T17:47:13.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.375+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=NBEH072S7AK3 type=del size=380418 2024-09-12T17:47:13.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.375+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=97D49ZQ9HEZN type=del 2024-09-12T17:47:13.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.383+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~1AO9U8OXDM2B.0 size=496999 2024-09-12T17:47:13.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.383+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=1AO9U8OXDM2B tag=XJVR2BJK7IFR type=write size=1545575 2024-09-12T17:47:13.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.383+0000 7f68bc0598c0 -1 < no bi entry to suggest for operation key=S0B1RP89NO44 tag=01MUNEEN2K6J type=del size=4075462: (2) No such file or directory 2024-09-12T17:47:13.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.391+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~QWHFG3GXAR7K.0 size=1048576 2024-09-12T17:47:13.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.395+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~QWHFG3GXAR7K.1 size=1048576 2024-09-12T17:47:13.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.395+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~QWHFG3GXAR7K.2 size=499043 2024-09-12T17:47:13.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.395+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=QWHFG3GXAR7K tag=H0C3PP4E0L23 type=write size=3644771 2024-09-12T17:47:13.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.399+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~R16SZFD9GMYD.0 size=930230 2024-09-12T17:47:13.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.403+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=R16SZFD9GMYD tag=YOGN2FZR1BQM type=write size=1978806 2024-09-12T17:47:13.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.407+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=TC6PPDQ20LLF type=del size=1791936 2024-09-12T17:47:13.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.411+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=US9N8O3FK07G type=del 2024-09-12T17:47:13.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.415+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=832SJ7AT4A6J type=del size=1864730 2024-09-12T17:47:13.421 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.419+0000 7f68bc0598c0 -1 < failed to complete operation key=S0B1RP89NO44 tag=EN10GJEMRRQ1 type=write size=458080: (22) Invalid argument 2024-09-12T17:47:13.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.419+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=41CJKYQKHO0P type=del size=208461 2024-09-12T17:47:13.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.423+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=UKE6GUQAAUB8 type=del 2024-09-12T17:47:13.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.427+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=LXU7WN6DBXG6 type=del size=3869041 2024-09-12T17:47:13.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.431+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=BMRO10BOF5Y2 type=del 2024-09-12T17:47:13.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.435+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~T3WTI422D85N.0 size=1048576 2024-09-12T17:47:13.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.439+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~T3WTI422D85N.1 size=1048576 2024-09-12T17:47:13.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.443+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~T3WTI422D85N.2 size=559630 2024-09-12T17:47:13.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.443+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=T3WTI422D85N tag=A71KL6NKEOE0 type=write size=3705358 2024-09-12T17:47:13.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.443+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~NA7SSCWGX36I.0 size=1048576 2024-09-12T17:47:13.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.447+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~NA7SSCWGX36I.1 size=1048576 2024-09-12T17:47:13.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.451+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~NA7SSCWGX36I.2 size=398027 2024-09-12T17:47:13.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.455+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=NA7SSCWGX36I tag=7N3J488HKTR4 type=write size=3543755 2024-09-12T17:47:13.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.459+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=K0GBPGY7WF37 type=del size=2508697 2024-09-12T17:47:13.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.459+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~IVAP2HXUM8S5.0 size=1048576 2024-09-12T17:47:13.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.463+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~IVAP2HXUM8S5.1 size=1048576 2024-09-12T17:47:13.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.467+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~IVAP2HXUM8S5.2 size=621499 2024-09-12T17:47:13.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.471+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=IVAP2HXUM8S5 tag=0XKPW6PDEP8H type=write size=3767227 2024-09-12T17:47:13.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.475+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~DWD0K8GL68MO.0 size=1048576 2024-09-12T17:47:13.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.479+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~DWD0K8GL68MO.1 size=806329 2024-09-12T17:47:13.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.479+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=DWD0K8GL68MO tag=3S9NE0ZC66M3 type=write size=2903481 2024-09-12T17:47:13.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.483+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=6EYP4TBK8VSI type=del 2024-09-12T17:47:13.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.487+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~2VTB5EX3B9KG.0 size=366909 2024-09-12T17:47:13.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.487+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=2VTB5EX3B9KG tag=DJ0Y0MP5YRVD type=write size=1415485 2024-09-12T17:47:13.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.491+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=X0GW68KKMKHA type=del 2024-09-12T17:47:13.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.495+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~7C2Y5QWV7H1V.0 size=1048576 2024-09-12T17:47:13.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.499+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~7C2Y5QWV7H1V.1 size=1048576 2024-09-12T17:47:13.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.499+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~7C2Y5QWV7H1V.2 size=636621 2024-09-12T17:47:13.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.499+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=7C2Y5QWV7H1V tag=1H5X3IJAK318 type=write size=3782349 2024-09-12T17:47:13.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.503+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~Q7S36BBB881M.0 size=451347 2024-09-12T17:47:13.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.507+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=Q7S36BBB881M tag=QGWEM2VHRQAK type=write size=1499923 2024-09-12T17:47:13.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.511+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=QQKBO3SLEE8D type=del size=2849936 2024-09-12T17:47:13.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.515+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=RJIEUIMSGH9B type=del 2024-09-12T17:47:13.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.515+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=633241YGUC4G type=del size=3284989 2024-09-12T17:47:13.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.519+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=HOVV14NB4AGB type=del 2024-09-12T17:47:13.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.523+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~V5WJ266T9JKA.0 size=1048576 2024-09-12T17:47:13.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.527+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~V5WJ266T9JKA.1 size=182402 2024-09-12T17:47:13.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.527+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=V5WJ266T9JKA tag=D6Q46M1M2LFH type=write size=2279554 2024-09-12T17:47:13.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.527+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~3WZXWMBKVD8M.0 size=1048576 2024-09-12T17:47:13.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.531+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~3WZXWMBKVD8M.1 size=412460 2024-09-12T17:47:13.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.535+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=3WZXWMBKVD8M tag=US1K4C2DRHWE type=write size=2509612 2024-09-12T17:47:13.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.539+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=GWH2Q0XUS8YP type=write size=392852 2024-09-12T17:47:13.546 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.543+0000 7f68bc0598c0 1 < suggested update operation key=9846YLKC8P8S tag=NBEH072S7AK3 type=del size=380418 2024-09-12T17:47:13.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.547+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=K0ELC4UQXV5H type=del size=2544482 2024-09-12T17:47:13.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.547+0000 7f68bc0598c0 1 < canceled part key=_multipart_KW3VWTA43PBM.2~1AO9U8OXDM2B.0 size=496999 2024-09-12T17:47:13.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.551+0000 7f68bc0598c0 1 < canceled multipart upload key=KW3VWTA43PBM upload=1AO9U8OXDM2B tag=XJVR2BJK7IFR type=write size=1545575 2024-09-12T17:47:13.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.551+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=DGOEKT1X0QKH type=write size=413191 2024-09-12T17:47:13.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.555+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~QWHFG3GXAR7K.0 size=1048576 2024-09-12T17:47:13.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.559+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~QWHFG3GXAR7K.1 size=1048576 2024-09-12T17:47:13.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.559+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~QWHFG3GXAR7K.2 size=499043 2024-09-12T17:47:13.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.567+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=QWHFG3GXAR7K tag=H0C3PP4E0L23 type=write size=3644771 2024-09-12T17:47:13.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.567+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=9RS7UVDZ2JVM type=del size=1489781 2024-09-12T17:47:13.575 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.571+0000 7f68bc0598c0 1 < canceled operation key=W8JEQ5NOIE6O tag=TC6PPDQ20LLF type=del size=1791936 2024-09-12T17:47:13.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.575+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~LNHLOMA4XXIE.0 size=1048576 2024-09-12T17:47:13.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.579+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~LNHLOMA4XXIE.1 size=182777 2024-09-12T17:47:13.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.579+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=LNHLOMA4XXIE tag=1D19UCSFJNND type=write size=2279929 2024-09-12T17:47:13.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.583+0000 7f68bc0598c0 1 < canceled operation key=XGJSQJ2IXJDK tag=832SJ7AT4A6J type=del size=1864730 2024-09-12T17:47:13.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.587+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~B5M0BY7R6BKC.0 size=96235 2024-09-12T17:47:13.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.587+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=B5M0BY7R6BKC tag=4U8UM9JVSRNA type=write size=1144811 2024-09-12T17:47:13.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.591+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=41CJKYQKHO0P type=del 2024-09-12T17:47:13.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.599+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=URZF398V0NKQ type=del size=1907320 2024-09-12T17:47:13.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.603+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=LXU7WN6DBXG6 type=del 2024-09-12T17:47:13.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.603+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=13D4XSLK5JEW type=del size=564931 2024-09-12T17:47:13.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.607+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~T3WTI422D85N.0 size=1048576 2024-09-12T17:47:13.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.611+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~T3WTI422D85N.1 size=1048576 2024-09-12T17:47:13.616 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.611+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~T3WTI422D85N.2 size=559630 2024-09-12T17:47:13.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.619+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=T3WTI422D85N tag=A71KL6NKEOE0 type=write size=3705358 2024-09-12T17:47:13.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.623+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=30FIZYEOAX8T type=del size=127481 2024-09-12T17:47:13.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.623+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=K0GBPGY7WF37 type=del 2024-09-12T17:47:13.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.627+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=X8E9NTJX6IQI type=del size=1804451 2024-09-12T17:47:13.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.631+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~DWD0K8GL68MO.0 size=1048576 2024-09-12T17:47:13.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.631+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~DWD0K8GL68MO.1 size=806329 2024-09-12T17:47:13.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.639+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=DWD0K8GL68MO tag=3S9NE0ZC66M3 type=write size=2903481 2024-09-12T17:47:13.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.639+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=ZBHHM2X89JKO type=del size=3665794 2024-09-12T17:47:13.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.643+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~2VTB5EX3B9KG.0 size=366909 2024-09-12T17:47:13.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.647+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=2VTB5EX3B9KG tag=DJ0Y0MP5YRVD type=write size=1415485 2024-09-12T17:47:13.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.651+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=8GIROBXF010F type=del size=3680906 2024-09-12T17:47:13.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.655+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~7C2Y5QWV7H1V.0 size=1048576 2024-09-12T17:47:13.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.659+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~7C2Y5QWV7H1V.1 size=1048576 2024-09-12T17:47:13.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.659+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~7C2Y5QWV7H1V.2 size=636621 2024-09-12T17:47:13.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.667+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=7C2Y5QWV7H1V tag=1H5X3IJAK318 type=write size=3782349 2024-09-12T17:47:13.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.671+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~B3EFLL63UR0B.0 size=1048576 2024-09-12T17:47:13.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.675+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~B3EFLL63UR0B.1 size=900123 2024-09-12T17:47:13.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.675+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=B3EFLL63UR0B tag=KVY6FKQG7PZQ type=write size=2997275 2024-09-12T17:47:13.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.675+0000 7f68bc0598c0 -1 < failed to complete operation key=9846YLKC8P8S tag=QQKBO3SLEE8D type=del size=2849936: (22) Invalid argument 2024-09-12T17:47:13.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.679+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=J7JB0GJEZD1I type=write size=336779 2024-09-12T17:47:13.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.683+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=633241YGUC4G type=del 2024-09-12T17:47:13.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.683+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=ELSIC8JNEZO5 type=del size=2269057 2024-09-12T17:47:13.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.687+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~V5WJ266T9JKA.0 size=1048576 2024-09-12T17:47:13.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.687+0000 7f68bc0598c0 1 < canceled part key=_multipart_RTY1OT2PSAAY.2~V5WJ266T9JKA.1 size=182402 2024-09-12T17:47:13.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.691+0000 7f68bc0598c0 1 < canceled multipart upload key=RTY1OT2PSAAY upload=V5WJ266T9JKA tag=D6Q46M1M2LFH type=write size=2279554 2024-09-12T17:47:13.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.695+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=BS6V4VER54U5 type=write size=569848 2024-09-12T17:47:13.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.699+0000 7f68bc0598c0 1 < completed write operation key=HGY9WK7MKCYS tag=GWH2Q0XUS8YP type=write size=392852 2024-09-12T17:47:13.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.703+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~MVJ4QSF52FZ3.0 size=520293 2024-09-12T17:47:13.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.703+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=MVJ4QSF52FZ3 tag=U73ZQFFB63RF type=write size=1568869 2024-09-12T17:47:13.710 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.707+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=K0ELC4UQXV5H type=del 2024-09-12T17:47:13.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.711+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=DWFZN962OJRH type=del size=3845781 2024-09-12T17:47:13.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.715+0000 7f68bc0598c0 1 < completed write operation key=FC3K0QN3TAWH tag=DGOEKT1X0QKH type=write size=413191 2024-09-12T17:47:13.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.719+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~GJ9SFLGAE715.0 size=1048576 2024-09-12T17:47:13.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.723+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~GJ9SFLGAE715.1 size=1048576 2024-09-12T17:47:13.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.723+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~GJ9SFLGAE715.2 size=22676 2024-09-12T17:47:13.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.723+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=GJ9SFLGAE715 tag=DJEPUHK3U53X type=write size=3168404 2024-09-12T17:47:13.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.727+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=9RS7UVDZ2JVM type=del 2024-09-12T17:47:13.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.731+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~2CPZF6CPOA6K.0 size=280145 2024-09-12T17:47:13.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.731+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=2CPZF6CPOA6K tag=LCHJW3UAC8A1 type=write size=1328721 2024-09-12T17:47:13.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.735+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~LNHLOMA4XXIE.0 size=1048576 2024-09-12T17:47:13.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.735+0000 7f68bc0598c0 1 < canceled part key=_multipart_0XFYVNU2Q7KO.2~LNHLOMA4XXIE.1 size=182777 2024-09-12T17:47:13.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.739+0000 7f68bc0598c0 1 < canceled multipart upload key=0XFYVNU2Q7KO upload=LNHLOMA4XXIE tag=1D19UCSFJNND type=write size=2279929 2024-09-12T17:47:13.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.743+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=T4YTFEGR5P18 type=del size=2985234 2024-09-12T17:47:13.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.743+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~B5M0BY7R6BKC.0 size=96235 2024-09-12T17:47:13.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.751+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=B5M0BY7R6BKC tag=4U8UM9JVSRNA type=write size=1144811 2024-09-12T17:47:13.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.751+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=TC69PVEMU4Z3 type=write size=119755 2024-09-12T17:47:13.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.755+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=URZF398V0NKQ type=del 2024-09-12T17:47:13.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.759+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~6MOXZKXEFQBP.0 size=632780 2024-09-12T17:47:13.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.759+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=6MOXZKXEFQBP tag=TGJWO99I5N7O type=write size=1681356 2024-09-12T17:47:13.769 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.767+0000 7f68bc0598c0 1 < suggested remove operation key=BKAT5SGAC5Z8 tag=13D4XSLK5JEW type=del 2024-09-12T17:47:13.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.767+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=0LS7C2TELJ3C type=del size=2893940 2024-09-12T17:47:13.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.771+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=30FIZYEOAX8T type=del 2024-09-12T17:47:13.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.775+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~ACJ7WKN50RQ7.0 size=159056 2024-09-12T17:47:13.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.775+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=ACJ7WKN50RQ7 tag=IX0ELE5EH0PH type=write size=1207632 2024-09-12T17:47:13.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.779+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=X8E9NTJX6IQI type=del 2024-09-12T17:47:13.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.783+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=ET7I8LKR5CR4 type=del size=482616 2024-09-12T17:47:13.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.787+0000 7f68bc0598c0 1 < suggested update operation key=WPQ755ODAFNT tag=ZBHHM2X89JKO type=del size=3665794 2024-09-12T17:47:13.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.791+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=OMZNOYO2LYC3 type=write size=962740 2024-09-12T17:47:13.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.799+0000 7f68bc0598c0 1 < suggested remove operation key=UMQLPH9XGWRZ tag=8GIROBXF010F type=del 2024-09-12T17:47:13.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.803+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~PPXCIVPJ3TC2.0 size=113600 2024-09-12T17:47:13.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.803+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=PPXCIVPJ3TC2 tag=RO5S8MRRRG5X type=write size=1162176 2024-09-12T17:47:13.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.807+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~B3EFLL63UR0B.0 size=1048576 2024-09-12T17:47:13.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.811+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~B3EFLL63UR0B.1 size=900123 2024-09-12T17:47:13.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.815+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=B3EFLL63UR0B tag=KVY6FKQG7PZQ type=write size=2997275 2024-09-12T17:47:13.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.819+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=QV7I86EBMMFE type=del size=2130031 2024-09-12T17:47:13.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.819+0000 7f68bc0598c0 -1 < failed to complete operation key=BKAT5SGAC5Z8 tag=J7JB0GJEZD1I type=write size=336779: (22) Invalid argument 2024-09-12T17:47:13.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.823+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=WEHJSECD2K16 type=del size=2722994 2024-09-12T17:47:13.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.827+0000 7f68bc0598c0 1 < canceled operation key=DMJZUQJ7IY60 tag=ELSIC8JNEZO5 type=del size=2269057 2024-09-12T17:47:13.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.831+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~J50L1H5YPE1Y.0 size=1048576 2024-09-12T17:47:13.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~J50L1H5YPE1Y.1 size=1017835 2024-09-12T17:47:13.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.835+0000 7f68bc0598c0 1 > prepared multipart upload key=BKAT5SGAC5Z8 upload=J50L1H5YPE1Y tag=ZDF5DK9VGKK3 type=write size=3114987 2024-09-12T17:47:13.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.835+0000 7f68bc0598c0 1 < completed write operation key=6J677S46BXS4 tag=BS6V4VER54U5 type=write size=569848 2024-09-12T17:47:13.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.839+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~B4J3YHDKXBZ1.0 size=1048576 2024-09-12T17:47:13.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.843+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~B4J3YHDKXBZ1.1 size=933221 2024-09-12T17:47:13.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.843+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=B4J3YHDKXBZ1 tag=FXGRB8IKSEES type=write size=3030373 2024-09-12T17:47:13.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.847+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~MVJ4QSF52FZ3.0 size=520293 2024-09-12T17:47:13.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.851+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=MVJ4QSF52FZ3 tag=U73ZQFFB63RF type=write size=1568869 2024-09-12T17:47:13.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.855+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=KO1WA1OR2S9Q type=del size=1903326 2024-09-12T17:47:13.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.855+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=DWFZN962OJRH type=del 2024-09-12T17:47:13.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.859+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=XRJWRBYNNVSP type=del size=2170566 2024-09-12T17:47:13.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.859+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~GJ9SFLGAE715.0 size=1048576 2024-09-12T17:47:13.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.863+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~GJ9SFLGAE715.1 size=1048576 2024-09-12T17:47:13.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.863+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~GJ9SFLGAE715.2 size=22676 2024-09-12T17:47:13.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.871+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=GJ9SFLGAE715 tag=DJEPUHK3U53X type=write size=3168404 2024-09-12T17:47:13.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.875+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=EDGFSQ24YLAT type=del size=1050495 2024-09-12T17:47:13.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.875+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~2CPZF6CPOA6K.0 size=280145 2024-09-12T17:47:13.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.879+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=2CPZF6CPOA6K tag=LCHJW3UAC8A1 type=write size=1328721 2024-09-12T17:47:13.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.883+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~TWVCJVO08FWM.0 size=432682 2024-09-12T17:47:13.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.883+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=TWVCJVO08FWM tag=L56F8279NSMY type=write size=1481258 2024-09-12T17:47:13.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.887+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=T4YTFEGR5P18 type=del 2024-09-12T17:47:13.895 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~8DQ03KW9DN1V.0 size=1048576 2024-09-12T17:47:13.896 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~8DQ03KW9DN1V.1 size=1048576 2024-09-12T17:47:13.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.895+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~8DQ03KW9DN1V.2 size=299058 2024-09-12T17:47:13.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.895+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=8DQ03KW9DN1V tag=DD1GP00XSQ7U type=write size=3444786 2024-09-12T17:47:13.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.899+0000 7f68bc0598c0 1 < completed write operation key=HGY9WK7MKCYS tag=TC69PVEMU4Z3 type=write size=119755 2024-09-12T17:47:13.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.899+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=H20ZH0JN4MWA type=del size=3381354 2024-09-12T17:47:13.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.903+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~6MOXZKXEFQBP.0 size=632780 2024-09-12T17:47:13.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.907+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=6MOXZKXEFQBP tag=TGJWO99I5N7O type=write size=1681356 2024-09-12T17:47:13.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.911+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~Y3PTEF6MSBJO.0 size=126639 2024-09-12T17:47:13.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.911+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=Y3PTEF6MSBJO tag=HZEVSPT66ADK type=write size=1175215 2024-09-12T17:47:13.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.915+0000 7f68bc0598c0 1 < canceled operation key=3JPRQXKB5K3W tag=0LS7C2TELJ3C type=del size=2893940 2024-09-12T17:47:13.925 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.923+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~83WVXLFB4ENC.0 size=1048576 2024-09-12T17:47:13.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.923+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~83WVXLFB4ENC.1 size=67409 2024-09-12T17:47:13.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.923+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=83WVXLFB4ENC tag=KHBZ5HHY7JF3 type=write size=2164561 2024-09-12T17:47:13.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.927+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~ACJ7WKN50RQ7.0 size=159056 2024-09-12T17:47:13.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.931+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=ACJ7WKN50RQ7 tag=IX0ELE5EH0PH type=write size=1207632 2024-09-12T17:47:13.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.935+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~G8VXQ7840NGP.0 size=1000723 2024-09-12T17:47:13.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.935+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=G8VXQ7840NGP tag=BQY1M7MM4GF6 type=write size=2049299 2024-09-12T17:47:13.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.939+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=ET7I8LKR5CR4 type=del 2024-09-12T17:47:13.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.943+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=UK0E43JOATQX type=del size=1326556 2024-09-12T17:47:13.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.947+0000 7f68bc0598c0 1 < suggested remove operation key=RTY1OT2PSAAY tag=OMZNOYO2LYC3 type=write 2024-09-12T17:47:13.956 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.951+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=9W7G3QO90FA3 type=del size=733676 2024-09-12T17:47:13.959 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.955+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~PPXCIVPJ3TC2.0 size=113600 2024-09-12T17:47:13.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.959+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=PPXCIVPJ3TC2 tag=RO5S8MRRRG5X type=write size=1162176 2024-09-12T17:47:13.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.967+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~ZQR4ZK76X42L.0 size=49674 2024-09-12T17:47:13.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.967+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=ZQR4ZK76X42L tag=98A9SDCVJ1OC type=write size=1098250 2024-09-12T17:47:13.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.971+0000 7f68bc0598c0 1 < suggested remove operation key=NLPTU26RO70S tag=QV7I86EBMMFE type=del 2024-09-12T17:47:13.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.975+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=PG9K8J7UR0KA type=del size=3928629 2024-09-12T17:47:13.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.979+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=WEHJSECD2K16 type=del 2024-09-12T17:47:13.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.983+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~D8I69WHIE5FN.0 size=749174 2024-09-12T17:47:13.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.983+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=D8I69WHIE5FN tag=R3D9F8CV6N19 type=write size=1797750 2024-09-12T17:47:13.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.987+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~J50L1H5YPE1Y.0 size=1048576 2024-09-12T17:47:13.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.991+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~J50L1H5YPE1Y.1 size=1017835 2024-09-12T17:47:13.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.995+0000 7f68bc0598c0 1 < completed multipart upload key=BKAT5SGAC5Z8 upload=J50L1H5YPE1Y tag=ZDF5DK9VGKK3 type=write size=3114987 2024-09-12T17:47:14.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.999+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~2E0EUHB7EKJL.0 size=948303 2024-09-12T17:47:14.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.999+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=2E0EUHB7EKJL tag=D7YMG490H4OS type=write size=1996879 2024-09-12T17:47:14.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.999+0000 7f68bc0598c0 1 < canceled part key=_multipart_FC3K0QN3TAWH.2~B4J3YHDKXBZ1.0 size=1048576 2024-09-12T17:47:14.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:13.999+0000 7f68bc0598c0 1 < canceled part key=_multipart_FC3K0QN3TAWH.2~B4J3YHDKXBZ1.1 size=933221 2024-09-12T17:47:14.008 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.003+0000 7f68bc0598c0 1 < canceled multipart upload key=FC3K0QN3TAWH upload=B4J3YHDKXBZ1 tag=FXGRB8IKSEES type=write size=3030373 2024-09-12T17:47:14.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.007+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=3AF92HHJ2BN0 type=write size=921346 2024-09-12T17:47:14.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.011+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=KO1WA1OR2S9Q type=del 2024-09-12T17:47:14.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.015+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~710W92N75K30.0 size=1048576 2024-09-12T17:47:14.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.019+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~710W92N75K30.1 size=1048576 2024-09-12T17:47:14.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.019+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~710W92N75K30.2 size=177082 2024-09-12T17:47:14.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.019+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=710W92N75K30 tag=6D4CPX6D738Q type=write size=3322810 2024-09-12T17:47:14.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.023+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=XRJWRBYNNVSP type=del 2024-09-12T17:47:14.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.031+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~7RBFY1IS1USB.0 size=251857 2024-09-12T17:47:14.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.031+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=7RBFY1IS1USB tag=9OYU1IVQKZK6 type=write size=1300433 2024-09-12T17:47:14.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.031+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=EDGFSQ24YLAT type=del 2024-09-12T17:47:14.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.039+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~FUE22156IJ9I.0 size=1048576 2024-09-12T17:47:14.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.039+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~FUE22156IJ9I.1 size=1048576 2024-09-12T17:47:14.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.043+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~FUE22156IJ9I.2 size=934207 2024-09-12T17:47:14.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.043+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=FUE22156IJ9I tag=WO6GJNIZGX51 type=write size=4079935 2024-09-12T17:47:14.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.043+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~TWVCJVO08FWM.0 size=432682 2024-09-12T17:47:14.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.051+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=TWVCJVO08FWM tag=L56F8279NSMY type=write size=1481258 2024-09-12T17:47:14.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~8INL9VQQ6KRV.0 size=1048576 2024-09-12T17:47:14.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~8INL9VQQ6KRV.1 size=1048576 2024-09-12T17:47:14.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.059+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~8INL9VQQ6KRV.2 size=810846 2024-09-12T17:47:14.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.059+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=8INL9VQQ6KRV tag=58XW5O05UXAU type=write size=3956574 2024-09-12T17:47:14.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.063+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~8DQ03KW9DN1V.0 size=1048576 2024-09-12T17:47:14.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.063+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~8DQ03KW9DN1V.1 size=1048576 2024-09-12T17:47:14.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.067+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~8DQ03KW9DN1V.2 size=299058 2024-09-12T17:47:14.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.071+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=8DQ03KW9DN1V tag=DD1GP00XSQ7U type=write size=3444786 2024-09-12T17:47:14.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.075+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=PGSA5MCHLB1Z type=del size=1147775 2024-09-12T17:47:14.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.079+0000 7f68bc0598c0 1 < suggested remove operation key=QGO5SPFPT548 tag=H20ZH0JN4MWA type=del 2024-09-12T17:47:14.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.083+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=N5FAMPGR32FW type=del size=584183 2024-09-12T17:47:14.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.087+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~Y3PTEF6MSBJO.0 size=126639 2024-09-12T17:47:14.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.091+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=Y3PTEF6MSBJO tag=HZEVSPT66ADK type=write size=1175215 2024-09-12T17:47:14.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.095+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=4UPUFKDZ3B35 type=del size=3366810 2024-09-12T17:47:14.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.095+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~83WVXLFB4ENC.0 size=1048576 2024-09-12T17:47:14.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.099+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~83WVXLFB4ENC.1 size=67409 2024-09-12T17:47:14.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.103+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=83WVXLFB4ENC tag=KHBZ5HHY7JF3 type=write size=2164561 2024-09-12T17:47:14.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.107+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~W8QL4QDFSRVA.0 size=1048576 2024-09-12T17:47:14.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.111+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~W8QL4QDFSRVA.1 size=1048576 2024-09-12T17:47:14.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.111+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~W8QL4QDFSRVA.2 size=868383 2024-09-12T17:47:14.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.111+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=W8QL4QDFSRVA tag=3WQ3TKC56WYU type=write size=4014111 2024-09-12T17:47:14.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.115+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~G8VXQ7840NGP.0 size=1000723 2024-09-12T17:47:14.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.119+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=G8VXQ7840NGP tag=BQY1M7MM4GF6 type=write size=2049299 2024-09-12T17:47:14.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.123+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~OW296IXGT3O3.0 size=339623 2024-09-12T17:47:14.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.123+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=OW296IXGT3O3 tag=4GH0IC7G463W type=write size=1388199 2024-09-12T17:47:14.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.123+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=UK0E43JOATQX type=del 2024-09-12T17:47:14.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.131+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=TW86M1U2DDP0 type=del size=1601382 2024-09-12T17:47:14.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.135+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=9W7G3QO90FA3 type=del 2024-09-12T17:47:14.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.139+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~I0SU3H132KQJ.0 size=829609 2024-09-12T17:47:14.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.139+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=I0SU3H132KQJ tag=C3FAQYNDICRO type=write size=1878185 2024-09-12T17:47:14.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.143+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~ZQR4ZK76X42L.0 size=49674 2024-09-12T17:47:14.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.147+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=ZQR4ZK76X42L tag=98A9SDCVJ1OC type=write size=1098250 2024-09-12T17:47:14.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.151+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=HNUNE67PJXVD type=del size=2122405 2024-09-12T17:47:14.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.151+0000 7f68bc0598c0 1 < canceled operation key=7XH1E2GEH9O2 tag=PG9K8J7UR0KA type=del size=3928629 2024-09-12T17:47:14.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.159+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~VBZ1U7EDQ9Z7.0 size=30803 2024-09-12T17:47:14.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.159+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=VBZ1U7EDQ9Z7 tag=UHOULO9W9OXE type=write size=1079379 2024-09-12T17:47:14.165 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.163+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~D8I69WHIE5FN.0 size=749174 2024-09-12T17:47:14.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.167+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=D8I69WHIE5FN tag=R3D9F8CV6N19 type=write size=1797750 2024-09-12T17:47:14.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~3BUFYQSX6ST1.0 size=1048576 2024-09-12T17:47:14.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.175+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~3BUFYQSX6ST1.1 size=75037 2024-09-12T17:47:14.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.175+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=3BUFYQSX6ST1 tag=KB339AS549F6 type=write size=2172189 2024-09-12T17:47:14.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.175+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~2E0EUHB7EKJL.0 size=948303 2024-09-12T17:47:14.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.179+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=2E0EUHB7EKJL tag=D7YMG490H4OS type=write size=1996879 2024-09-12T17:47:14.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.183+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=O1KVZRDARN1E type=del size=2132627 2024-09-12T17:47:14.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.187+0000 7f68bc0598c0 1 < completed write operation key=9846YLKC8P8S tag=3AF92HHJ2BN0 type=write size=921346 2024-09-12T17:47:14.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.191+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~KPDBJYIYP625.0 size=605023 2024-09-12T17:47:14.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.191+0000 7f68bc0598c0 1 > prepared multipart upload key=2129SG6US3LI upload=KPDBJYIYP625 tag=H8A7B9102USS type=write size=1653599 2024-09-12T17:47:14.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.195+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~710W92N75K30.0 size=1048576 2024-09-12T17:47:14.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.195+0000 7f68bc0598c0 1 < canceled part key=_multipart_W8JEQ5NOIE6O.2~710W92N75K30.1 size=1048576 2024-09-12T17:47:14.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.199+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~710W92N75K30.2 size=177082 2024-09-12T17:47:14.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.203+0000 7f68bc0598c0 1 < canceled multipart upload key=W8JEQ5NOIE6O upload=710W92N75K30 tag=6D4CPX6D738Q type=write size=3322810 2024-09-12T17:47:14.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~EY43GNY3RHTD.0 size=1048576 2024-09-12T17:47:14.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~EY43GNY3RHTD.1 size=1048576 2024-09-12T17:47:14.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.215+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~EY43GNY3RHTD.2 size=642289 2024-09-12T17:47:14.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.215+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=EY43GNY3RHTD tag=FEVR3L025M9H type=write size=3788017 2024-09-12T17:47:14.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.219+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~7RBFY1IS1USB.0 size=251857 2024-09-12T17:47:14.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.223+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=7RBFY1IS1USB tag=9OYU1IVQKZK6 type=write size=1300433 2024-09-12T17:47:14.230 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.227+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=OZSH1BFDNNCY type=del size=1438480 2024-09-12T17:47:14.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.231+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~FUE22156IJ9I.0 size=1048576 2024-09-12T17:47:14.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.231+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~FUE22156IJ9I.1 size=1048576 2024-09-12T17:47:14.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.235+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~FUE22156IJ9I.2 size=934207 2024-09-12T17:47:14.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.239+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=FUE22156IJ9I tag=WO6GJNIZGX51 type=write size=4079935 2024-09-12T17:47:14.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.243+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=9GCT3EQ8BIX3 type=del size=2219905 2024-09-12T17:47:14.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.243+0000 7f68bc0598c0 1 < canceled part key=_multipart_XGJSQJ2IXJDK.2~8INL9VQQ6KRV.0 size=1048576 2024-09-12T17:47:14.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.247+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~8INL9VQQ6KRV.1 size=1048576 2024-09-12T17:47:14.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.247+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~8INL9VQQ6KRV.2 size=810846 2024-09-12T17:47:14.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.255+0000 7f68bc0598c0 1 < canceled multipart upload key=XGJSQJ2IXJDK upload=8INL9VQQ6KRV tag=58XW5O05UXAU type=write size=3956574 2024-09-12T17:47:14.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.255+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=M8TMOKGTTBHL type=del size=1130728 2024-09-12T17:47:14.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.259+0000 7f68bc0598c0 1 < canceled operation key=9846YLKC8P8S tag=PGSA5MCHLB1Z type=del size=1147775 2024-09-12T17:47:14.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.263+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=WX4EVGUD1KC1 type=del size=1955325 2024-09-12T17:47:14.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.267+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=N5FAMPGR32FW type=del 2024-09-12T17:47:14.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.271+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=ULFX8BAMJVHO type=del size=348515 2024-09-12T17:47:14.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.271+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=4UPUFKDZ3B35 type=del 2024-09-12T17:47:14.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.275+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=WUBFD75VCESO type=del size=4068210 2024-09-12T17:47:14.283 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.279+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~W8QL4QDFSRVA.0 size=1048576 2024-09-12T17:47:14.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.283+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~W8QL4QDFSRVA.1 size=1048576 2024-09-12T17:47:14.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.287+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~W8QL4QDFSRVA.2 size=868383 2024-09-12T17:47:14.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.291+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=W8QL4QDFSRVA tag=3WQ3TKC56WYU type=write size=4014111 2024-09-12T17:47:14.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.295+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=1RU4OVAZ2L5E type=del size=3929267 2024-09-12T17:47:14.300 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.295+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~OW296IXGT3O3.0 size=339623 2024-09-12T17:47:14.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.303+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=OW296IXGT3O3 tag=4GH0IC7G463W type=write size=1388199 2024-09-12T17:47:14.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.303+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=3UPRPVMMOQZS type=write size=957036 2024-09-12T17:47:14.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.307+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=TW86M1U2DDP0 type=del 2024-09-12T17:47:14.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.311+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=HCH1LBH8ZMJF type=del size=1924945 2024-09-12T17:47:14.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.315+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~I0SU3H132KQJ.0 size=829609 2024-09-12T17:47:14.322 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.319+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=I0SU3H132KQJ tag=C3FAQYNDICRO type=write size=1878185 2024-09-12T17:47:14.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.323+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=626237GN0D6J type=del size=2021564 2024-09-12T17:47:14.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.323+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=HNUNE67PJXVD type=del 2024-09-12T17:47:14.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.327+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=99RBPC7YGAQZ type=write size=625776 2024-09-12T17:47:14.334 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.331+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~VBZ1U7EDQ9Z7.0 size=30803 2024-09-12T17:47:14.339 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.335+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=VBZ1U7EDQ9Z7 tag=UHOULO9W9OXE type=write size=1079379 2024-09-12T17:47:14.345 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.343+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~2JHRPC1BGCOQ.0 size=1048576 2024-09-12T17:47:14.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.343+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~2JHRPC1BGCOQ.1 size=1048576 2024-09-12T17:47:14.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.347+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~2JHRPC1BGCOQ.2 size=953757 2024-09-12T17:47:14.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.347+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=2JHRPC1BGCOQ tag=4WRI3Z135I6V type=write size=4099485 2024-09-12T17:47:14.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.347+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~3BUFYQSX6ST1.0 size=1048576 2024-09-12T17:47:14.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.347+0000 7f68bc0598c0 1 < canceled part key=_multipart_7XH1E2GEH9O2.2~3BUFYQSX6ST1.1 size=75037 2024-09-12T17:47:14.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.355+0000 7f68bc0598c0 1 < canceled multipart upload key=7XH1E2GEH9O2 upload=3BUFYQSX6ST1 tag=KB339AS549F6 type=write size=2172189 2024-09-12T17:47:14.360 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.355+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=IW5BFUJM1J9O type=del size=1058872 2024-09-12T17:47:14.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.359+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=O1KVZRDARN1E type=del 2024-09-12T17:47:14.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.363+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=Z9MWXCJSPCJT type=write size=512370 2024-09-12T17:47:14.369 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.367+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~KPDBJYIYP625.0 size=605023 2024-09-12T17:47:14.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.371+0000 7f68bc0598c0 1 < completed multipart upload key=2129SG6US3LI upload=KPDBJYIYP625 tag=H8A7B9102USS type=write size=1653599 2024-09-12T17:47:14.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.375+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~F0AI8JF7DU2K.0 size=730021 2024-09-12T17:47:14.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.375+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=F0AI8JF7DU2K tag=4T8H4W7D0DZ1 type=write size=1778597 2024-09-12T17:47:14.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.375+0000 7f68bc0598c0 1 < canceled part key=_multipart_F4F4P4L8K5D9.2~EY43GNY3RHTD.0 size=1048576 2024-09-12T17:47:14.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.379+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~EY43GNY3RHTD.1 size=1048576 2024-09-12T17:47:14.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.383+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~EY43GNY3RHTD.2 size=642289 2024-09-12T17:47:14.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.387+0000 7f68bc0598c0 1 < canceled multipart upload key=F4F4P4L8K5D9 upload=EY43GNY3RHTD tag=FEVR3L025M9H type=write size=3788017 2024-09-12T17:47:14.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.391+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=U4HRSPJ36PNX type=del size=986360 2024-09-12T17:47:14.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.395+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=OZSH1BFDNNCY type=del 2024-09-12T17:47:14.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.399+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~J2W3I043N9RQ.0 size=1048576 2024-09-12T17:47:14.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.399+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~J2W3I043N9RQ.1 size=775335 2024-09-12T17:47:14.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.399+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=J2W3I043N9RQ tag=06W067ONW6QH type=write size=2872487 2024-09-12T17:47:14.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.403+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=9GCT3EQ8BIX3 type=del 2024-09-12T17:47:14.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.407+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=DXKLVLM75IJN type=del size=1665400 2024-09-12T17:47:14.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.411+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=M8TMOKGTTBHL type=del 2024-09-12T17:47:14.418 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.415+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=6JZLC7PAJVN2 type=del size=996882 2024-09-12T17:47:14.421 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.419+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=WX4EVGUD1KC1 type=del 2024-09-12T17:47:14.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.419+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=UW3J2BFKLKDR type=del size=93442 2024-09-12T17:47:14.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.423+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=ULFX8BAMJVHO type=del 2024-09-12T17:47:14.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.427+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~78TV62BBHKEA.0 size=1048576 2024-09-12T17:47:14.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.431+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~78TV62BBHKEA.1 size=1048576 2024-09-12T17:47:14.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.431+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~78TV62BBHKEA.2 size=64105 2024-09-12T17:47:14.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.431+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=78TV62BBHKEA tag=I5JG3JDT53JE type=write size=3209833 2024-09-12T17:47:14.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.435+0000 7f68bc0598c0 1 < canceled operation key=8P0EWBVO0BQD tag=WUBFD75VCESO type=del size=4068210 2024-09-12T17:47:14.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.439+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~POQ0DGLUVLUB.0 size=1048576 2024-09-12T17:47:14.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.443+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~POQ0DGLUVLUB.1 size=1048576 2024-09-12T17:47:14.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.443+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~POQ0DGLUVLUB.2 size=554032 2024-09-12T17:47:14.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.443+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=POQ0DGLUVLUB tag=MD185K0KBSSM type=write size=3699760 2024-09-12T17:47:14.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.447+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=1RU4OVAZ2L5E type=del 2024-09-12T17:47:14.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.451+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~GRY93WIRO536.0 size=1048576 2024-09-12T17:47:14.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.455+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~GRY93WIRO536.1 size=1048576 2024-09-12T17:47:14.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.455+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~GRY93WIRO536.2 size=1040482 2024-09-12T17:47:14.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.455+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=GRY93WIRO536 tag=F1O0H7JHMHI8 type=write size=4186210 2024-09-12T17:47:14.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.459+0000 7f68bc0598c0 1 < completed write operation key=DMJZUQJ7IY60 tag=3UPRPVMMOQZS type=write size=957036 2024-09-12T17:47:14.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.463+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=7RW9FQL95TGS type=del size=1803519 2024-09-12T17:47:14.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.463+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=HCH1LBH8ZMJF type=del 2024-09-12T17:47:14.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.467+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=X9ACNSWXKYRR type=del size=2666339 2024-09-12T17:47:14.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.471+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=626237GN0D6J type=del 2024-09-12T17:47:14.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.471+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=1KYYBGUDNQ24 type=write size=305768 2024-09-12T17:47:14.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.475+0000 7f68bc0598c0 1 < completed write operation key=UMQLPH9XGWRZ tag=99RBPC7YGAQZ type=write size=625776 2024-09-12T17:47:14.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.479+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~YJXHA02E03S2.0 size=1048576 2024-09-12T17:47:14.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.483+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~YJXHA02E03S2.1 size=1048576 2024-09-12T17:47:14.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.483+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~YJXHA02E03S2.2 size=1015214 2024-09-12T17:47:14.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.483+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=YJXHA02E03S2 tag=OFZEU8FB3I4I type=write size=4160942 2024-09-12T17:47:14.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.487+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~2JHRPC1BGCOQ.0 size=1048576 2024-09-12T17:47:14.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.491+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~2JHRPC1BGCOQ.1 size=1048576 2024-09-12T17:47:14.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.491+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~2JHRPC1BGCOQ.2 size=953757 2024-09-12T17:47:14.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.495+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=2JHRPC1BGCOQ tag=4WRI3Z135I6V type=write size=4099485 2024-09-12T17:47:14.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.499+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~V1W1OBT07KXO.0 size=1048576 2024-09-12T17:47:14.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.503+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~V1W1OBT07KXO.1 size=140113 2024-09-12T17:47:14.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.503+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=V1W1OBT07KXO tag=RUODJJKL7KQA type=write size=2237265 2024-09-12T17:47:14.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.507+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=IW5BFUJM1J9O type=del 2024-09-12T17:47:14.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.511+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~X5772LLLXRVK.0 size=885558 2024-09-12T17:47:14.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.511+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=X5772LLLXRVK tag=35DIRWOFM5CI type=write size=1934134 2024-09-12T17:47:14.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.515+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=Z9MWXCJSPCJT type=write size=512370 2024-09-12T17:47:14.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.519+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=AOPLWUCSD8FX type=del size=1558410 2024-09-12T17:47:14.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.523+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~F0AI8JF7DU2K.0 size=730021 2024-09-12T17:47:14.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.527+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=F0AI8JF7DU2K tag=4T8H4W7D0DZ1 type=write size=1778597 2024-09-12T17:47:14.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.531+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~FDENCYQQSBDI.0 size=1048576 2024-09-12T17:47:14.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.531+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~FDENCYQQSBDI.1 size=397068 2024-09-12T17:47:14.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.531+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=FDENCYQQSBDI tag=INMPRQ5APMPH type=write size=2494220 2024-09-12T17:47:14.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.535+0000 7f68bc0598c0 1 < canceled operation key=OG0V0I1SDHG5 tag=U4HRSPJ36PNX type=del size=986360 2024-09-12T17:47:14.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.535+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=5JLERIDW2VV6 type=del size=1069364 2024-09-12T17:47:14.543 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.539+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~J2W3I043N9RQ.0 size=1048576 2024-09-12T17:47:14.545 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.539+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~J2W3I043N9RQ.1 size=775335 2024-09-12T17:47:14.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.543+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=J2W3I043N9RQ tag=06W067ONW6QH type=write size=2872487 2024-09-12T17:47:14.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.547+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~JLV4YXQKFJDU.0 size=1048576 2024-09-12T17:47:14.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.551+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~JLV4YXQKFJDU.1 size=709166 2024-09-12T17:47:14.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.551+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=JLV4YXQKFJDU tag=BCD5TCL3IL07 type=write size=2806318 2024-09-12T17:47:14.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.555+0000 7f68bc0598c0 1 < suggested remove operation key=FC3K0QN3TAWH tag=DXKLVLM75IJN type=del 2024-09-12T17:47:14.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.559+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~CS3WZF8JM2Y5.0 size=624283 2024-09-12T17:47:14.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.559+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=CS3WZF8JM2Y5 tag=SZZV38EA8L53 type=write size=1672859 2024-09-12T17:47:14.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.563+0000 7f68bc0598c0 1 < suggested remove operation key=3JPRQXKB5K3W tag=6JZLC7PAJVN2 type=del 2024-09-12T17:47:14.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.567+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=CMKQJRIU25VS type=del size=1532920 2024-09-12T17:47:14.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.567+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=UW3J2BFKLKDR type=del 2024-09-12T17:47:14.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.571+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=4WM9XSCTC20C type=del size=1263299 2024-09-12T17:47:14.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.571+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~78TV62BBHKEA.0 size=1048576 2024-09-12T17:47:14.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.575+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~78TV62BBHKEA.1 size=1048576 2024-09-12T17:47:14.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.575+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~78TV62BBHKEA.2 size=64105 2024-09-12T17:47:14.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.579+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=78TV62BBHKEA tag=I5JG3JDT53JE type=write size=3209833 2024-09-12T17:47:14.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.583+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=UDQTFN08TCPC type=del size=4174061 2024-09-12T17:47:14.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.583+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~POQ0DGLUVLUB.0 size=1048576 2024-09-12T17:47:14.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.587+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~POQ0DGLUVLUB.1 size=1048576 2024-09-12T17:47:14.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.587+0000 7f68bc0598c0 1 < canceled part key=_multipart_P8T1VX1XFJ31.2~POQ0DGLUVLUB.2 size=554032 2024-09-12T17:47:14.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.591+0000 7f68bc0598c0 1 < canceled multipart upload key=P8T1VX1XFJ31 upload=POQ0DGLUVLUB tag=MD185K0KBSSM type=write size=3699760 2024-09-12T17:47:14.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.595+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~B70V0FG3U1A1.0 size=1048576 2024-09-12T17:47:14.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.595+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~B70V0FG3U1A1.1 size=1048576 2024-09-12T17:47:14.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.599+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~B70V0FG3U1A1.2 size=294486 2024-09-12T17:47:14.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.599+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=B70V0FG3U1A1 tag=AVI6LMM9W6YC type=write size=3440214 2024-09-12T17:47:14.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.599+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~GRY93WIRO536.0 size=1048576 2024-09-12T17:47:14.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.603+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~GRY93WIRO536.1 size=1048576 2024-09-12T17:47:14.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.603+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~GRY93WIRO536.2 size=1040482 2024-09-12T17:47:14.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.607+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=GRY93WIRO536 tag=F1O0H7JHMHI8 type=write size=4186210 2024-09-12T17:47:14.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.611+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~R6VGQP30PCFX.0 size=1048576 2024-09-12T17:47:14.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.615+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~R6VGQP30PCFX.1 size=1048576 2024-09-12T17:47:14.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.615+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~R6VGQP30PCFX.2 size=821678 2024-09-12T17:47:14.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.615+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=R6VGQP30PCFX tag=9QMJCJYUJ6IL type=write size=3967406 2024-09-12T17:47:14.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.619+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=7RW9FQL95TGS type=del 2024-09-12T17:47:14.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.623+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~ASTE14Z9GZ9B.0 size=1048576 2024-09-12T17:47:14.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.623+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~ASTE14Z9GZ9B.1 size=285760 2024-09-12T17:47:14.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.623+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=ASTE14Z9GZ9B tag=Y7K5OK4FA0B8 type=write size=2382912 2024-09-12T17:47:14.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.627+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=X9ACNSWXKYRR type=del 2024-09-12T17:47:14.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.627+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=17QY7DQS4JZD type=del size=3617679 2024-09-12T17:47:14.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.631+0000 7f68bc0598c0 1 < canceled operation key=QGO5SPFPT548 tag=1KYYBGUDNQ24 type=write size=305768 2024-09-12T17:47:14.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.631+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=2IJRTQ2KV98K type=del size=1512304 2024-09-12T17:47:14.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.635+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~YJXHA02E03S2.0 size=1048576 2024-09-12T17:47:14.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.639+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~YJXHA02E03S2.1 size=1048576 2024-09-12T17:47:14.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.643+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~YJXHA02E03S2.2 size=1015214 2024-09-12T17:47:14.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.647+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=YJXHA02E03S2 tag=OFZEU8FB3I4I type=write size=4160942 2024-09-12T17:47:14.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.647+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=UNKR43RP10TG type=del size=4096456 2024-09-12T17:47:14.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.651+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~V1W1OBT07KXO.0 size=1048576 2024-09-12T17:47:14.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.651+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~V1W1OBT07KXO.1 size=140113 2024-09-12T17:47:14.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.655+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=V1W1OBT07KXO tag=RUODJJKL7KQA type=write size=2237265 2024-09-12T17:47:14.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.659+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=3AR7PRKE1CYL type=del size=1011861 2024-09-12T17:47:14.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.659+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~X5772LLLXRVK.0 size=885558 2024-09-12T17:47:14.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.663+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=X5772LLLXRVK tag=35DIRWOFM5CI type=write size=1934134 2024-09-12T17:47:14.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.667+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=21YCUE92UNWL type=del size=2070665 2024-09-12T17:47:14.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.671+0000 7f68bc0598c0 1 < suggested update operation key=XGJSQJ2IXJDK tag=AOPLWUCSD8FX type=del size=1558410 2024-09-12T17:47:14.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.675+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=QTA821UEJFMY type=del size=3184609 2024-09-12T17:47:14.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.679+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~FDENCYQQSBDI.0 size=1048576 2024-09-12T17:47:14.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.679+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~FDENCYQQSBDI.1 size=397068 2024-09-12T17:47:14.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.683+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=FDENCYQQSBDI tag=INMPRQ5APMPH type=write size=2494220 2024-09-12T17:47:14.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.687+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~N4FCT2P5EJO7.0 size=1048576 2024-09-12T17:47:14.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.691+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~N4FCT2P5EJO7.1 size=934141 2024-09-12T17:47:14.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.691+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=N4FCT2P5EJO7 tag=FW4EAY9L9ROK type=write size=3031293 2024-09-12T17:47:14.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.691+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=5JLERIDW2VV6 type=del 2024-09-12T17:47:14.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.695+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~DND3BPF1C6V4.0 size=1048576 2024-09-12T17:47:14.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.699+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~DND3BPF1C6V4.1 size=1048576 2024-09-12T17:47:14.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.699+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~DND3BPF1C6V4.2 size=997511 2024-09-12T17:47:14.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.699+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=DND3BPF1C6V4 tag=MTF0X5S5SA86 type=write size=4143239 2024-09-12T17:47:14.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.703+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~JLV4YXQKFJDU.0 size=1048576 2024-09-12T17:47:14.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.703+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~JLV4YXQKFJDU.1 size=709166 2024-09-12T17:47:14.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.707+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=JLV4YXQKFJDU tag=BCD5TCL3IL07 type=write size=2806318 2024-09-12T17:47:14.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.711+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=44IRJEGKRA77 type=del size=3470204 2024-09-12T17:47:14.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.715+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~CS3WZF8JM2Y5.0 size=624283 2024-09-12T17:47:14.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.719+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=CS3WZF8JM2Y5 tag=SZZV38EA8L53 type=write size=1672859 2024-09-12T17:47:14.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.719+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=E867J7VWLAEZ type=del size=2052527 2024-09-12T17:47:14.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.723+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=CMKQJRIU25VS type=del 2024-09-12T17:47:14.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.727+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~A9Y137M1MBG5.0 size=1048576 2024-09-12T17:47:14.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.727+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~A9Y137M1MBG5.1 size=1048576 2024-09-12T17:47:14.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.731+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~A9Y137M1MBG5.2 size=653670 2024-09-12T17:47:14.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.731+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=A9Y137M1MBG5 tag=0LGOOWI7PS96 type=write size=3799398 2024-09-12T17:47:14.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.735+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=4WM9XSCTC20C type=del 2024-09-12T17:47:14.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~EJVZ7NEU931S.0 size=1048576 2024-09-12T17:47:14.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~EJVZ7NEU931S.1 size=1048576 2024-09-12T17:47:14.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.743+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~EJVZ7NEU931S.2 size=975291 2024-09-12T17:47:14.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.743+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=EJVZ7NEU931S tag=7228DJJ0TJ9V type=write size=4121019 2024-09-12T17:47:14.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.743+0000 7f68bc0598c0 1 < canceled operation key=57O6H52NHYOL tag=UDQTFN08TCPC type=del size=4174061 2024-09-12T17:47:14.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.747+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~MLPS0EBA7LHN.0 size=436441 2024-09-12T17:47:14.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.747+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=MLPS0EBA7LHN tag=Q1A3D48CBL8B type=write size=1485017 2024-09-12T17:47:14.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.751+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~B70V0FG3U1A1.0 size=1048576 2024-09-12T17:47:14.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.751+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~B70V0FG3U1A1.1 size=1048576 2024-09-12T17:47:14.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.755+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~B70V0FG3U1A1.2 size=294486 2024-09-12T17:47:14.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.759+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=B70V0FG3U1A1 tag=AVI6LMM9W6YC type=write size=3440214 2024-09-12T17:47:14.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.763+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~ZOEBB4VU01Y4.0 size=1048576 2024-09-12T17:47:14.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.767+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~ZOEBB4VU01Y4.1 size=525701 2024-09-12T17:47:14.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.767+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=ZOEBB4VU01Y4 tag=8PG969E98108 type=write size=2622853 2024-09-12T17:47:14.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.771+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~R6VGQP30PCFX.0 size=1048576 2024-09-12T17:47:14.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.771+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~R6VGQP30PCFX.1 size=1048576 2024-09-12T17:47:14.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.775+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~R6VGQP30PCFX.2 size=821678 2024-09-12T17:47:14.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.779+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=R6VGQP30PCFX tag=9QMJCJYUJ6IL type=write size=3967406 2024-09-12T17:47:14.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.783+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~FQPMITPQM4EB.0 size=1048576 2024-09-12T17:47:14.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.783+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~FQPMITPQM4EB.1 size=1048576 2024-09-12T17:47:14.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.787+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~FQPMITPQM4EB.2 size=442575 2024-09-12T17:47:14.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.787+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=FQPMITPQM4EB tag=RHD47AHG1ZSL type=write size=3588303 2024-09-12T17:47:14.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.787+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~ASTE14Z9GZ9B.0 size=1048576 2024-09-12T17:47:14.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.791+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~ASTE14Z9GZ9B.1 size=285760 2024-09-12T17:47:14.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.795+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=ASTE14Z9GZ9B tag=Y7K5OK4FA0B8 type=write size=2382912 2024-09-12T17:47:14.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.795+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=4THD4LIA22U4 type=del size=2785909 2024-09-12T17:47:14.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.799+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=17QY7DQS4JZD type=del 2024-09-12T17:47:14.804 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.799+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=355BLVXLR288 type=del size=2367648 2024-09-12T17:47:14.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.803+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=2IJRTQ2KV98K type=del 2024-09-12T17:47:14.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.803+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=I1P4XSV0O2WT type=del size=3591651 2024-09-12T17:47:14.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.807+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=UNKR43RP10TG type=del 2024-09-12T17:47:14.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.811+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=4CDPF72EP7VZ type=del size=1876606 2024-09-12T17:47:14.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.811+0000 7f68bc0598c0 1 < canceled operation key=BKAT5SGAC5Z8 tag=3AR7PRKE1CYL type=del size=1011861 2024-09-12T17:47:14.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.815+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=OGQ8H8JV1Q27 type=del size=3665913 2024-09-12T17:47:14.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.815+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=21YCUE92UNWL type=del 2024-09-12T17:47:14.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.819+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=IIWQELB89ON8 type=del size=3725960 2024-09-12T17:47:14.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.823+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=QTA821UEJFMY type=del size=3184609 2024-09-12T17:47:14.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.827+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=8QO3UWMA8K4J type=del size=283055 2024-09-12T17:47:14.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.827+0000 7f68bc0598c0 1 < canceled part key=_multipart_9XK00RPA6Q38.2~N4FCT2P5EJO7.0 size=1048576 2024-09-12T17:47:14.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.827+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~N4FCT2P5EJO7.1 size=934141 2024-09-12T17:47:14.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.831+0000 7f68bc0598c0 1 < canceled multipart upload key=9XK00RPA6Q38 upload=N4FCT2P5EJO7 tag=FW4EAY9L9ROK type=write size=3031293 2024-09-12T17:47:14.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~BI3S0IJT7O6K.0 size=16616 2024-09-12T17:47:14.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.835+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=BI3S0IJT7O6K tag=NSNNLIIT6OF1 type=write size=1065192 2024-09-12T17:47:14.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.839+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~DND3BPF1C6V4.0 size=1048576 2024-09-12T17:47:14.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.839+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~DND3BPF1C6V4.1 size=1048576 2024-09-12T17:47:14.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.843+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~DND3BPF1C6V4.2 size=997511 2024-09-12T17:47:14.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.847+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=DND3BPF1C6V4 tag=MTF0X5S5SA86 type=write size=4143239 2024-09-12T17:47:14.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.847+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=Y2QU8K8NILNZ type=del size=2032842 2024-09-12T17:47:14.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.851+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=44IRJEGKRA77 type=del 2024-09-12T17:47:14.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.855+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~IX2H6I6JE5PR.0 size=1048576 2024-09-12T17:47:14.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.859+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~IX2H6I6JE5PR.1 size=1002324 2024-09-12T17:47:14.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.859+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=IX2H6I6JE5PR tag=X36UT701UTT0 type=write size=3099476 2024-09-12T17:47:14.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.863+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=E867J7VWLAEZ type=del 2024-09-12T17:47:14.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.867+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=72FPNUULU1XD type=del size=2751575 2024-09-12T17:47:14.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.867+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~A9Y137M1MBG5.0 size=1048576 2024-09-12T17:47:14.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.871+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~A9Y137M1MBG5.1 size=1048576 2024-09-12T17:47:14.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.871+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~A9Y137M1MBG5.2 size=653670 2024-09-12T17:47:14.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.875+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=A9Y137M1MBG5 tag=0LGOOWI7PS96 type=write size=3799398 2024-09-12T17:47:14.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.879+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~FBV4LSKBU7A9.0 size=1048576 2024-09-12T17:47:14.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.883+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~FBV4LSKBU7A9.1 size=65732 2024-09-12T17:47:14.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.883+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=FBV4LSKBU7A9 tag=1ROFR7NUCWEN type=write size=2162884 2024-09-12T17:47:14.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.883+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~EJVZ7NEU931S.0 size=1048576 2024-09-12T17:47:14.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.883+0000 7f68bc0598c0 1 < canceled part key=_multipart_0XFYVNU2Q7KO.2~EJVZ7NEU931S.1 size=1048576 2024-09-12T17:47:14.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.887+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~EJVZ7NEU931S.2 size=975291 2024-09-12T17:47:14.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.891+0000 7f68bc0598c0 1 < canceled multipart upload key=0XFYVNU2Q7KO upload=EJVZ7NEU931S tag=7228DJJ0TJ9V type=write size=4121019 2024-09-12T17:47:14.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.895+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~0VZYHVPPQWW7.0 size=662430 2024-09-12T17:47:14.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.895+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=0VZYHVPPQWW7 tag=43OT4GE2T4LN type=write size=1711006 2024-09-12T17:47:14.902 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.899+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~MLPS0EBA7LHN.0 size=436441 2024-09-12T17:47:14.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.903+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=MLPS0EBA7LHN tag=Q1A3D48CBL8B type=write size=1485017 2024-09-12T17:47:14.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.907+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=2NSZC7H71E3E type=del size=642927 2024-09-12T17:47:14.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.907+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~ZOEBB4VU01Y4.0 size=1048576 2024-09-12T17:47:14.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.911+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~ZOEBB4VU01Y4.1 size=525701 2024-09-12T17:47:14.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.915+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=ZOEBB4VU01Y4 tag=8PG969E98108 type=write size=2622853 2024-09-12T17:47:14.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.915+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=N3SWQEHPP3QC type=del size=1901633 2024-09-12T17:47:14.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.919+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~FQPMITPQM4EB.0 size=1048576 2024-09-12T17:47:14.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.919+0000 7f68bc0598c0 1 < canceled part key=_multipart_6J677S46BXS4.2~FQPMITPQM4EB.1 size=1048576 2024-09-12T17:47:14.924 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.919+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~FQPMITPQM4EB.2 size=442575 2024-09-12T17:47:14.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.923+0000 7f68bc0598c0 1 < canceled multipart upload key=6J677S46BXS4 upload=FQPMITPQM4EB tag=RHD47AHG1ZSL type=write size=3588303 2024-09-12T17:47:14.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.927+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~UZZ827LERSL4.0 size=1048576 2024-09-12T17:47:14.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.931+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~UZZ827LERSL4.1 size=599636 2024-09-12T17:47:14.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.931+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=UZZ827LERSL4 tag=73S8QSKAM018 type=write size=2696788 2024-09-12T17:47:14.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.935+0000 7f68bc0598c0 1 < suggested update operation key=DMJZUQJ7IY60 tag=4THD4LIA22U4 type=del size=2785909 2024-09-12T17:47:14.940 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.935+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=92Z5Y3U1IYLE type=del size=553419 2024-09-12T17:47:14.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.943+0000 7f68bc0598c0 1 < suggested remove operation key=06W7N11O7F1I tag=355BLVXLR288 type=del 2024-09-12T17:47:14.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.943+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=XMDXM38YY5Q3 type=del size=1724334 2024-09-12T17:47:14.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.947+0000 7f68bc0598c0 1 < canceled operation key=SBQGW2EK6I1J tag=I1P4XSV0O2WT type=del size=3591651 2024-09-12T17:47:14.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.951+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=NENPK5H61YQY type=del size=405438 2024-09-12T17:47:14.957 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.951+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=4CDPF72EP7VZ type=del 2024-09-12T17:47:14.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.959+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~WQAGPPEOJZN7.0 size=1048576 2024-09-12T17:47:14.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.959+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~WQAGPPEOJZN7.1 size=1048576 2024-09-12T17:47:14.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.963+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~WQAGPPEOJZN7.2 size=852014 2024-09-12T17:47:14.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.963+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=WQAGPPEOJZN7 tag=KRTTKMLT9TAH type=write size=3997742 2024-09-12T17:47:14.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.967+0000 7f68bc0598c0 -1 < failed to complete operation key=DMJZUQJ7IY60 tag=OGQ8H8JV1Q27 type=del size=3665913: (22) Invalid argument 2024-09-12T17:47:14.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.967+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=AZYAFAZO6GC9 type=del size=479552 2024-09-12T17:47:14.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.971+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=IIWQELB89ON8 type=del 2024-09-12T17:47:14.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.975+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~ZIW8CQZFOQHA.0 size=1048576 2024-09-12T17:47:14.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.979+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~ZIW8CQZFOQHA.1 size=352975 2024-09-12T17:47:14.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.979+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=ZIW8CQZFOQHA tag=A180PEWIPBGJ type=write size=2450127 2024-09-12T17:47:14.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.983+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=8QO3UWMA8K4J type=del 2024-09-12T17:47:14.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.987+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~S0RV8MHHIKUW.0 size=1048576 2024-09-12T17:47:14.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.987+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~S0RV8MHHIKUW.1 size=1048576 2024-09-12T17:47:14.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.991+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~S0RV8MHHIKUW.2 size=908945 2024-09-12T17:47:14.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.991+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=S0RV8MHHIKUW tag=O0XOSDK52SHG type=write size=4054673 2024-09-12T17:47:14.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.995+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~BI3S0IJT7O6K.0 size=16616 2024-09-12T17:47:15.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:14.999+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=BI3S0IJT7O6K tag=NSNNLIIT6OF1 type=write size=1065192 2024-09-12T17:47:15.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.003+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~SUNY33NOPJUN.0 size=1048576 2024-09-12T17:47:15.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.007+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~SUNY33NOPJUN.1 size=711778 2024-09-12T17:47:15.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.007+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=SUNY33NOPJUN tag=9J4TK3OH90XJ type=write size=2808930 2024-09-12T17:47:15.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.007+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=Y2QU8K8NILNZ type=del 2024-09-12T17:47:15.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.011+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=FNV70A3CIEPF type=del size=2966397 2024-09-12T17:47:15.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.015+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~IX2H6I6JE5PR.0 size=1048576 2024-09-12T17:47:15.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.015+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~IX2H6I6JE5PR.1 size=1002324 2024-09-12T17:47:15.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.019+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=IX2H6I6JE5PR tag=X36UT701UTT0 type=write size=3099476 2024-09-12T17:47:15.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.023+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=MMJC7X3PMA1K type=del size=946590 2024-09-12T17:47:15.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.027+0000 7f68bc0598c0 -1 < failed to complete operation key=06W7N11O7F1I tag=72FPNUULU1XD type=del size=2751575: (22) Invalid argument 2024-09-12T17:47:15.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.027+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=9U9TE464CN1S type=del size=1586458 2024-09-12T17:47:15.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.031+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~FBV4LSKBU7A9.0 size=1048576 2024-09-12T17:47:15.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.035+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~FBV4LSKBU7A9.1 size=65732 2024-09-12T17:47:15.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.039+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=FBV4LSKBU7A9 tag=1ROFR7NUCWEN type=write size=2162884 2024-09-12T17:47:15.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.039+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=2VDW2ZJ0Z2P2 type=write size=774261 2024-09-12T17:47:15.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.043+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~0VZYHVPPQWW7.0 size=662430 2024-09-12T17:47:15.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.051+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=0VZYHVPPQWW7 tag=43OT4GE2T4LN type=write size=1711006 2024-09-12T17:47:15.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~48TG6WRXGQL0.0 size=1048576 2024-09-12T17:47:15.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~48TG6WRXGQL0.1 size=249156 2024-09-12T17:47:15.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.055+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=48TG6WRXGQL0 tag=3XI4OGCUZN2J type=write size=2346308 2024-09-12T17:47:15.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.059+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=2NSZC7H71E3E type=del 2024-09-12T17:47:15.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.063+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=XA6WY392SR7T type=del size=1424741 2024-09-12T17:47:15.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.063+0000 7f68bc0598c0 -1 < failed to complete operation key=DMJZUQJ7IY60 tag=N3SWQEHPP3QC type=del size=1901633: (22) Invalid argument 2024-09-12T17:47:15.074 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.071+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~0UWJ799CMMZT.0 size=154978 2024-09-12T17:47:15.074 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.071+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=0UWJ799CMMZT tag=Z7LNKW9RFD7H type=write size=1203554 2024-09-12T17:47:15.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.071+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~UZZ827LERSL4.0 size=1048576 2024-09-12T17:47:15.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.075+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~UZZ827LERSL4.1 size=599636 2024-09-12T17:47:15.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.079+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=UZZ827LERSL4 tag=73S8QSKAM018 type=write size=2696788 2024-09-12T17:47:15.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.083+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=RBE7A138QC8D type=del size=2153598 2024-09-12T17:47:15.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.087+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=92Z5Y3U1IYLE type=del 2024-09-12T17:47:15.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.091+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=RFZ3MFZNZ3A3 type=del size=2202812 2024-09-12T17:47:15.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.095+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=XMDXM38YY5Q3 type=del 2024-09-12T17:47:15.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.095+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=GK3K77MH20DJ type=del size=3405238 2024-09-12T17:47:15.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.099+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=NENPK5H61YQY type=del 2024-09-12T17:47:15.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.103+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=5IMOMNWFH4PK type=write size=990984 2024-09-12T17:47:15.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.107+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~WQAGPPEOJZN7.0 size=1048576 2024-09-12T17:47:15.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.115+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~WQAGPPEOJZN7.1 size=1048576 2024-09-12T17:47:15.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.115+0000 7f68bc0598c0 1 < canceled part key=_multipart_SBQGW2EK6I1J.2~WQAGPPEOJZN7.2 size=852014 2024-09-12T17:47:15.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.119+0000 7f68bc0598c0 1 < canceled multipart upload key=SBQGW2EK6I1J upload=WQAGPPEOJZN7 tag=KRTTKMLT9TAH type=write size=3997742 2024-09-12T17:47:15.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.123+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=UA2YOR4NZ133 type=write size=141404 2024-09-12T17:47:15.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.127+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=AZYAFAZO6GC9 type=del 2024-09-12T17:47:15.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.131+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=B349F8TTE4SR type=del size=2133883 2024-09-12T17:47:15.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.131+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~ZIW8CQZFOQHA.0 size=1048576 2024-09-12T17:47:15.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.135+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~ZIW8CQZFOQHA.1 size=352975 2024-09-12T17:47:15.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.143+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=ZIW8CQZFOQHA tag=A180PEWIPBGJ type=write size=2450127 2024-09-12T17:47:15.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.143+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=DY1P3NLMG4FG type=del size=1700608 2024-09-12T17:47:15.152 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.147+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~S0RV8MHHIKUW.0 size=1048576 2024-09-12T17:47:15.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.151+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~S0RV8MHHIKUW.1 size=1048576 2024-09-12T17:47:15.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.155+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~S0RV8MHHIKUW.2 size=908945 2024-09-12T17:47:15.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.159+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=S0RV8MHHIKUW tag=O0XOSDK52SHG type=write size=4054673 2024-09-12T17:47:15.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.167+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~ID2WO12KUC20.0 size=1048576 2024-09-12T17:47:15.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~ID2WO12KUC20.1 size=1048576 2024-09-12T17:47:15.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~ID2WO12KUC20.2 size=484454 2024-09-12T17:47:15.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.171+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=ID2WO12KUC20 tag=4AXHWFHHHJQM type=write size=3630182 2024-09-12T17:47:15.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.171+0000 7f68bc0598c0 1 < canceled part key=_multipart_XGJSQJ2IXJDK.2~SUNY33NOPJUN.0 size=1048576 2024-09-12T17:47:15.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.175+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~SUNY33NOPJUN.1 size=711778 2024-09-12T17:47:15.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.183+0000 7f68bc0598c0 1 < canceled multipart upload key=XGJSQJ2IXJDK upload=SUNY33NOPJUN tag=9J4TK3OH90XJ type=write size=2808930 2024-09-12T17:47:15.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.187+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=AX9QMA0X2QQK type=del size=774500 2024-09-12T17:47:15.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.191+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=FNV70A3CIEPF type=del 2024-09-12T17:47:15.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.191+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=NEMRN5ZFQHSD type=del size=3105451 2024-09-12T17:47:15.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.195+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=MMJC7X3PMA1K type=del 2024-09-12T17:47:15.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.199+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=53DLJJ2QM9YP type=del size=1815248 2024-09-12T17:47:15.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.203+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=9U9TE464CN1S type=del 2024-09-12T17:47:15.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.207+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=NG23GIWC2Y9F type=del size=3963142 2024-09-12T17:47:15.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.211+0000 7f68bc0598c0 1 < completed write operation key=HGY9WK7MKCYS tag=2VDW2ZJ0Z2P2 type=write size=774261 2024-09-12T17:47:15.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.215+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=4XFI6VYYP5OV type=del size=2801906 2024-09-12T17:47:15.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.219+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~48TG6WRXGQL0.0 size=1048576 2024-09-12T17:47:15.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.219+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~48TG6WRXGQL0.1 size=249156 2024-09-12T17:47:15.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.227+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=48TG6WRXGQL0 tag=3XI4OGCUZN2J type=write size=2346308 2024-09-12T17:47:15.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.227+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=4JJUX2NA2GP0 type=write size=151342 2024-09-12T17:47:15.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.235+0000 7f68bc0598c0 1 < suggested remove operation key=06W7N11O7F1I tag=XA6WY392SR7T type=del 2024-09-12T17:47:15.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.239+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=7R7BMC8VZY8T type=write size=1039789 2024-09-12T17:47:15.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.243+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~0UWJ799CMMZT.0 size=154978 2024-09-12T17:47:15.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.247+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=0UWJ799CMMZT tag=Z7LNKW9RFD7H type=write size=1203554 2024-09-12T17:47:15.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.251+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=BCLT0PPNBC2T type=del size=1804410 2024-09-12T17:47:15.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.255+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=RBE7A138QC8D type=del 2024-09-12T17:47:15.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.259+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=I6O36IUDOXGC type=write size=254114 2024-09-12T17:47:15.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.263+0000 7f68bc0598c0 1 < suggested remove operation key=S0B1RP89NO44 tag=RFZ3MFZNZ3A3 type=del 2024-09-12T17:47:15.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.271+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~JMWZZOXR8JWF.0 size=1048576 2024-09-12T17:47:15.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.271+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~JMWZZOXR8JWF.1 size=1048576 2024-09-12T17:47:15.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.275+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~JMWZZOXR8JWF.2 size=638965 2024-09-12T17:47:15.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.275+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=JMWZZOXR8JWF tag=PU71SS0WZX71 type=write size=3784693 2024-09-12T17:47:15.282 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.279+0000 7f68bc0598c0 1 < canceled operation key=UMQLPH9XGWRZ tag=GK3K77MH20DJ type=del size=3405238 2024-09-12T17:47:15.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.283+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~K7CSE4EN59T8.0 size=349934 2024-09-12T17:47:15.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.283+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=K7CSE4EN59T8 tag=MVAZY8BVN502 type=write size=1398510 2024-09-12T17:47:15.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.287+0000 7f68bc0598c0 1 < canceled operation key=DMJZUQJ7IY60 tag=5IMOMNWFH4PK type=write size=990984 2024-09-12T17:47:15.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.291+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=SKFD2X0RGQ4R type=del size=4051953 2024-09-12T17:47:15.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.295+0000 7f68bc0598c0 1 < completed write operation key=7XH1E2GEH9O2 tag=UA2YOR4NZ133 type=write size=141404 2024-09-12T17:47:15.300 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.295+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=H138ZBJ64U3M type=write size=436493 2024-09-12T17:47:15.303 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.299+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=B349F8TTE4SR type=del 2024-09-12T17:47:15.309 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.307+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~SL0VKC067B4B.0 size=1048576 2024-09-12T17:47:15.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.307+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~SL0VKC067B4B.1 size=842182 2024-09-12T17:47:15.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.307+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=SL0VKC067B4B tag=OELYN7BVPJHD type=write size=2939334 2024-09-12T17:47:15.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.315+0000 7f68bc0598c0 1 < suggested remove operation key=QGO5SPFPT548 tag=DY1P3NLMG4FG type=del 2024-09-12T17:47:15.321 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.319+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=IGMG4HG46CVE type=del size=586450 2024-09-12T17:47:15.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.319+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~ID2WO12KUC20.0 size=1048576 2024-09-12T17:47:15.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.323+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~ID2WO12KUC20.1 size=1048576 2024-09-12T17:47:15.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.327+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~ID2WO12KUC20.2 size=484454 2024-09-12T17:47:15.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.331+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=ID2WO12KUC20 tag=4AXHWFHHHJQM type=write size=3630182 2024-09-12T17:47:15.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.335+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=WG5XCC5S3RY4 type=del size=58302 2024-09-12T17:47:15.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.343+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=AX9QMA0X2QQK type=del size=774500 2024-09-12T17:47:15.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.347+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=BNW2GNG28RPP type=del size=3320631 2024-09-12T17:47:15.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.355+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=NEMRN5ZFQHSD type=del size=3105451 2024-09-12T17:47:15.360 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.355+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=FIFM807ZZ3RE type=del size=1718626 2024-09-12T17:47:15.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.363+0000 7f68bc0598c0 1 < suggested remove operation key=7XH1E2GEH9O2 tag=53DLJJ2QM9YP type=del 2024-09-12T17:47:15.370 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.367+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=O7BIMYQAUT11 type=del size=503617 2024-09-12T17:47:15.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.371+0000 7f68bc0598c0 1 < canceled operation key=NLPTU26RO70S tag=NG23GIWC2Y9F type=del size=3963142 2024-09-12T17:47:15.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.375+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~EVACS4KX4107.0 size=1048576 2024-09-12T17:47:15.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.379+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~EVACS4KX4107.1 size=1048576 2024-09-12T17:47:15.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.379+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~EVACS4KX4107.2 size=897202 2024-09-12T17:47:15.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.379+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=EVACS4KX4107 tag=ASJO0PN5Z6OQ type=write size=4042930 2024-09-12T17:47:15.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.383+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=4XFI6VYYP5OV type=del 2024-09-12T17:47:15.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.387+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=RAKZ84VLXZX1 type=del size=4176572 2024-09-12T17:47:15.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.391+0000 7f68bc0598c0 1 < suggested remove operation key=XGJSQJ2IXJDK tag=4JJUX2NA2GP0 type=write 2024-09-12T17:47:15.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.395+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=PDLC2SBEBRZD type=del size=834748 2024-09-12T17:47:15.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.399+0000 7f68bc0598c0 1 < completed write operation key=0XFYVNU2Q7KO tag=7R7BMC8VZY8T type=write size=1039789 2024-09-12T17:47:15.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.407+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~JB23VNE3U0CE.0 size=358443 2024-09-12T17:47:15.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.407+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=JB23VNE3U0CE tag=67EX8VNFPVSH type=write size=1407019 2024-09-12T17:47:15.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.407+0000 7f68bc0598c0 1 < canceled operation key=NLPTU26RO70S tag=BCLT0PPNBC2T type=del size=1804410 2024-09-12T17:47:15.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.411+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=PFNATH2Y4WR6 type=del size=2503246 2024-09-12T17:47:15.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.419+0000 7f68bc0598c0 1 < suggested update operation key=UOW521GPXBQ0 tag=I6O36IUDOXGC type=write size=254114 2024-09-12T17:47:15.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.423+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~COLSD1WRWSCJ.0 size=1048576 2024-09-12T17:47:15.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.431+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~COLSD1WRWSCJ.1 size=1048576 2024-09-12T17:47:15.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.435+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~COLSD1WRWSCJ.2 size=113463 2024-09-12T17:47:15.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.435+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=COLSD1WRWSCJ tag=GV3XVOFW5XP0 type=write size=3259191 2024-09-12T17:47:15.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.439+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~JMWZZOXR8JWF.0 size=1048576 2024-09-12T17:47:15.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.439+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~JMWZZOXR8JWF.1 size=1048576 2024-09-12T17:47:15.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.443+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~JMWZZOXR8JWF.2 size=638965 2024-09-12T17:47:15.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.447+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=JMWZZOXR8JWF tag=PU71SS0WZX71 type=write size=3784693 2024-09-12T17:47:15.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.455+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~MK1W1YMF3T5D.0 size=708789 2024-09-12T17:47:15.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.455+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=MK1W1YMF3T5D tag=PW3JNQHF9X2D type=write size=1757365 2024-09-12T17:47:15.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.459+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~K7CSE4EN59T8.0 size=349934 2024-09-12T17:47:15.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.463+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=K7CSE4EN59T8 tag=MVAZY8BVN502 type=write size=1398510 2024-09-12T17:47:15.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.471+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~T6UIX9QX784Y.0 size=825960 2024-09-12T17:47:15.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.471+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=T6UIX9QX784Y tag=GKK4KSSVSU2X type=write size=1874536 2024-09-12T17:47:15.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.471+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=SKFD2X0RGQ4R type=del 2024-09-12T17:47:15.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.479+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~6ICQCW4OAA9P.0 size=223581 2024-09-12T17:47:15.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.479+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=6ICQCW4OAA9P tag=3T6XB6A8LPQA type=write size=1272157 2024-09-12T17:47:15.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.479+0000 7f68bc0598c0 1 < completed write operation key=MRS3KW2H5AKK tag=H138ZBJ64U3M type=write size=436493 2024-09-12T17:47:15.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.483+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=ISR7SUKVKFCK type=write size=1022105 2024-09-12T17:47:15.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.487+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~SL0VKC067B4B.0 size=1048576 2024-09-12T17:47:15.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.491+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~SL0VKC067B4B.1 size=842182 2024-09-12T17:47:15.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.495+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=SL0VKC067B4B tag=OELYN7BVPJHD type=write size=2939334 2024-09-12T17:47:15.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.499+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=KW4MES97WCSS type=del size=2028860 2024-09-12T17:47:15.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.499+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=IGMG4HG46CVE type=del 2024-09-12T17:47:15.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.503+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=21M8673SQSAH type=del size=4098437 2024-09-12T17:47:15.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.507+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=WG5XCC5S3RY4 type=del 2024-09-12T17:47:15.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.507+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=YF1NY0XH1ASW type=del size=1952027 2024-09-12T17:47:15.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.511+0000 7f68bc0598c0 -1 < failed to complete operation key=UOW521GPXBQ0 tag=BNW2GNG28RPP type=del size=3320631: (22) Invalid argument 2024-09-12T17:47:15.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.515+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=8CGW3ZBXIS0S type=del size=3007658 2024-09-12T17:47:15.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.515+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=FIFM807ZZ3RE type=del 2024-09-12T17:47:15.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.519+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=K2H249O1NWEG type=del size=637278 2024-09-12T17:47:15.527 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.523+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=O7BIMYQAUT11 type=del 2024-09-12T17:47:15.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.527+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~X01BJURGSG8D.0 size=1048576 2024-09-12T17:47:15.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.531+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~X01BJURGSG8D.1 size=201481 2024-09-12T17:47:15.535 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.531+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=X01BJURGSG8D tag=RUZBJ0ZBEQPM type=write size=2298633 2024-09-12T17:47:15.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.535+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~EVACS4KX4107.0 size=1048576 2024-09-12T17:47:15.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.535+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~EVACS4KX4107.1 size=1048576 2024-09-12T17:47:15.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.539+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~EVACS4KX4107.2 size=897202 2024-09-12T17:47:15.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.543+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=EVACS4KX4107 tag=ASJO0PN5Z6OQ type=write size=4042930 2024-09-12T17:47:15.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.547+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~RG51ZYX3V44J.0 size=207882 2024-09-12T17:47:15.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.547+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=RG51ZYX3V44J tag=A9168CNCT4WM type=write size=1256458 2024-09-12T17:47:15.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.551+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=RAKZ84VLXZX1 type=del 2024-09-12T17:47:15.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.555+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=QDYY4GWEMB4K type=del size=718790 2024-09-12T17:47:15.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.555+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=PDLC2SBEBRZD type=del 2024-09-12T17:47:15.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.559+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~GENN0811JL1I.0 size=188187 2024-09-12T17:47:15.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.559+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=GENN0811JL1I tag=BH6X30EILL2B type=write size=1236763 2024-09-12T17:47:15.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.563+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~JB23VNE3U0CE.0 size=358443 2024-09-12T17:47:15.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.567+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=JB23VNE3U0CE tag=67EX8VNFPVSH type=write size=1407019 2024-09-12T17:47:15.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.571+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~DWJK3S65QVBF.0 size=1048576 2024-09-12T17:47:15.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.575+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~DWJK3S65QVBF.1 size=1048576 2024-09-12T17:47:15.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.575+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~DWJK3S65QVBF.2 size=309824 2024-09-12T17:47:15.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.575+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=DWJK3S65QVBF tag=FMZO5PSONA7E type=write size=3455552 2024-09-12T17:47:15.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.579+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=PFNATH2Y4WR6 type=del 2024-09-12T17:47:15.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.583+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=3IFWDNIH5OQD type=del size=1175118 2024-09-12T17:47:15.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.583+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~COLSD1WRWSCJ.0 size=1048576 2024-09-12T17:47:15.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.587+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~COLSD1WRWSCJ.1 size=1048576 2024-09-12T17:47:15.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.591+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~COLSD1WRWSCJ.2 size=113463 2024-09-12T17:47:15.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.595+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=COLSD1WRWSCJ tag=GV3XVOFW5XP0 type=write size=3259191 2024-09-12T17:47:15.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.599+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=733B30BFNUER type=del size=171783 2024-09-12T17:47:15.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.599+0000 7f68bc0598c0 1 < canceled part key=_multipart_F4F4P4L8K5D9.2~MK1W1YMF3T5D.0 size=708789 2024-09-12T17:47:15.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.603+0000 7f68bc0598c0 1 < canceled multipart upload key=F4F4P4L8K5D9 upload=MK1W1YMF3T5D tag=PW3JNQHF9X2D type=write size=1757365 2024-09-12T17:47:15.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.607+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=TEOMKF8UHK4Z type=del size=269120 2024-09-12T17:47:15.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.611+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~T6UIX9QX784Y.0 size=825960 2024-09-12T17:47:15.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.615+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=T6UIX9QX784Y tag=GKK4KSSVSU2X type=write size=1874536 2024-09-12T17:47:15.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.619+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~2RE23XN06HJ5.0 size=1048576 2024-09-12T17:47:15.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.623+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~2RE23XN06HJ5.1 size=1048576 2024-09-12T17:47:15.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.623+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~2RE23XN06HJ5.2 size=421626 2024-09-12T17:47:15.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.623+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=2RE23XN06HJ5 tag=ZYXHEPNVXDVW type=write size=3567354 2024-09-12T17:47:15.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.627+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~6ICQCW4OAA9P.0 size=223581 2024-09-12T17:47:15.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.631+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=6ICQCW4OAA9P tag=3T6XB6A8LPQA type=write size=1272157 2024-09-12T17:47:15.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.635+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~LZ6O13OGJ55K.0 size=924116 2024-09-12T17:47:15.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.635+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=LZ6O13OGJ55K tag=CHL5TJLPIO2Q type=write size=1972692 2024-09-12T17:47:15.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.639+0000 7f68bc0598c0 1 < completed write operation key=OG0V0I1SDHG5 tag=ISR7SUKVKFCK type=write size=1022105 2024-09-12T17:47:15.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.643+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=2U8WPY4X9YCA type=del size=3738989 2024-09-12T17:47:15.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.647+0000 7f68bc0598c0 1 < suggested remove operation key=3JPRQXKB5K3W tag=KW4MES97WCSS type=del 2024-09-12T17:47:15.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.651+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=8YZB8P6KQ2KA type=del size=3945952 2024-09-12T17:47:15.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.655+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=21M8673SQSAH type=del 2024-09-12T17:47:15.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.655+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=LW6LMBUJPW4B type=write size=711660 2024-09-12T17:47:15.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.663+0000 7f68bc0598c0 1 < suggested update operation key=P8T1VX1XFJ31 tag=YF1NY0XH1ASW type=del size=1952027 2024-09-12T17:47:15.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.663+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=GZDWYNYLGLGZ type=del size=431967 2024-09-12T17:47:15.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.667+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=8CGW3ZBXIS0S type=del 2024-09-12T17:47:15.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.675+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~3T1AZORA80JP.0 size=740617 2024-09-12T17:47:15.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.675+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=3T1AZORA80JP tag=KQWJHL2W0BW9 type=write size=1789193 2024-09-12T17:47:15.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.675+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=K2H249O1NWEG type=del 2024-09-12T17:47:15.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.683+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~X5WLY7UZCLTT.0 size=1048576 2024-09-12T17:47:15.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.683+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~X5WLY7UZCLTT.1 size=451905 2024-09-12T17:47:15.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.683+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=X5WLY7UZCLTT tag=YPWN6M1V0LEQ type=write size=2549057 2024-09-12T17:47:15.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.687+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~X01BJURGSG8D.0 size=1048576 2024-09-12T17:47:15.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.687+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~X01BJURGSG8D.1 size=201481 2024-09-12T17:47:15.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.691+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=X01BJURGSG8D tag=RUZBJ0ZBEQPM type=write size=2298633 2024-09-12T17:47:15.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.699+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~22WSQWK3GCM2.0 size=1048576 2024-09-12T17:47:15.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.703+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~22WSQWK3GCM2.1 size=813938 2024-09-12T17:47:15.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.703+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=22WSQWK3GCM2 tag=RHO19KE47ZWA type=write size=2911090 2024-09-12T17:47:15.710 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.707+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~RG51ZYX3V44J.0 size=207882 2024-09-12T17:47:15.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.711+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=RG51ZYX3V44J tag=A9168CNCT4WM type=write size=1256458 2024-09-12T17:47:15.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.715+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~X0BD0ZL6YC3G.0 size=265025 2024-09-12T17:47:15.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.715+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=X0BD0ZL6YC3G tag=KI6ZRKPHII86 type=write size=1313601 2024-09-12T17:47:15.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.719+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=QDYY4GWEMB4K type=del 2024-09-12T17:47:15.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.723+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=JIPXLRF19B7X type=del size=598924 2024-09-12T17:47:15.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.727+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~GENN0811JL1I.0 size=188187 2024-09-12T17:47:15.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.731+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=GENN0811JL1I tag=BH6X30EILL2B type=write size=1236763 2024-09-12T17:47:15.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.735+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=Q9AQI61JXPZS type=del size=1117284 2024-09-12T17:47:15.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.739+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~DWJK3S65QVBF.0 size=1048576 2024-09-12T17:47:15.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.739+0000 7f68bc0598c0 1 < canceled part key=_multipart_6SUA9FBDU69A.2~DWJK3S65QVBF.1 size=1048576 2024-09-12T17:47:15.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.739+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~DWJK3S65QVBF.2 size=309824 2024-09-12T17:47:15.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.743+0000 7f68bc0598c0 1 < canceled multipart upload key=6SUA9FBDU69A upload=DWJK3S65QVBF tag=FMZO5PSONA7E type=write size=3455552 2024-09-12T17:47:15.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.747+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=I192L2VR0MQJ type=write size=663463 2024-09-12T17:47:15.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.751+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=3IFWDNIH5OQD type=del 2024-09-12T17:47:15.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.755+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~X957WXSVS1AI.0 size=1048576 2024-09-12T17:47:15.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.759+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~X957WXSVS1AI.1 size=390805 2024-09-12T17:47:15.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.759+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=X957WXSVS1AI tag=MEKIU55EGSL6 type=write size=2487957 2024-09-12T17:47:15.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.759+0000 7f68bc0598c0 1 < canceled operation key=57O6H52NHYOL tag=733B30BFNUER type=del size=171783 2024-09-12T17:47:15.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.763+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=3K716V70S0EY type=del size=1087066 2024-09-12T17:47:15.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.767+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=TEOMKF8UHK4Z type=del 2024-09-12T17:47:15.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.771+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~2RGZS2RMLJF2.0 size=222968 2024-09-12T17:47:15.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.771+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=2RGZS2RMLJF2 tag=KQI7MK1ZEG1I type=write size=1271544 2024-09-12T17:47:15.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.775+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~2RE23XN06HJ5.0 size=1048576 2024-09-12T17:47:15.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.775+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~2RE23XN06HJ5.1 size=1048576 2024-09-12T17:47:15.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.779+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~2RE23XN06HJ5.2 size=421626 2024-09-12T17:47:15.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.783+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=2RE23XN06HJ5 tag=ZYXHEPNVXDVW type=write size=3567354 2024-09-12T17:47:15.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.787+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~VDMMQK5M9NA3.0 size=1048576 2024-09-12T17:47:15.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.787+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~VDMMQK5M9NA3.1 size=1048576 2024-09-12T17:47:15.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.791+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~VDMMQK5M9NA3.2 size=175138 2024-09-12T17:47:15.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.791+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=VDMMQK5M9NA3 tag=X36682VR1JPU type=write size=3320866 2024-09-12T17:47:15.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.791+0000 7f68bc0598c0 1 < canceled part key=_multipart_6J677S46BXS4.2~LZ6O13OGJ55K.0 size=924116 2024-09-12T17:47:15.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.795+0000 7f68bc0598c0 1 < canceled multipart upload key=6J677S46BXS4 upload=LZ6O13OGJ55K tag=CHL5TJLPIO2Q type=write size=1972692 2024-09-12T17:47:15.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.799+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=0VMT51Y7VWFT type=del size=2292464 2024-09-12T17:47:15.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.803+0000 7f68bc0598c0 1 < suggested update operation key=OG0V0I1SDHG5 tag=2U8WPY4X9YCA type=del size=3738989 2024-09-12T17:47:15.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.807+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~PYXLYGNMKZQP.0 size=1048576 2024-09-12T17:47:15.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.811+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~PYXLYGNMKZQP.1 size=1048576 2024-09-12T17:47:15.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.811+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~PYXLYGNMKZQP.2 size=1022735 2024-09-12T17:47:15.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.811+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=PYXLYGNMKZQP tag=RHD098SVNVWX type=write size=4168463 2024-09-12T17:47:15.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.815+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=8YZB8P6KQ2KA type=del 2024-09-12T17:47:15.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.815+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=YOYEG4CQZHH0 type=del size=915337 2024-09-12T17:47:15.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.819+0000 7f68bc0598c0 1 < completed write operation key=8P0EWBVO0BQD tag=LW6LMBUJPW4B type=write size=711660 2024-09-12T17:47:15.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.823+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~ZP7Y37YFYFWH.0 size=1048576 2024-09-12T17:47:15.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.827+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~ZP7Y37YFYFWH.1 size=95091 2024-09-12T17:47:15.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.827+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=ZP7Y37YFYFWH tag=IOFWURYG3B9L type=write size=2192243 2024-09-12T17:47:15.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.827+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=GZDWYNYLGLGZ type=del 2024-09-12T17:47:15.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.831+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=V38IEP3W6Q0J type=del size=649360 2024-09-12T17:47:15.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.831+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~3T1AZORA80JP.0 size=740617 2024-09-12T17:47:15.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.835+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=3T1AZORA80JP tag=KQWJHL2W0BW9 type=write size=1789193 2024-09-12T17:47:15.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.839+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=QNPK2DXX6TS8 type=del size=2125118 2024-09-12T17:47:15.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.843+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~X5WLY7UZCLTT.0 size=1048576 2024-09-12T17:47:15.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.843+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~X5WLY7UZCLTT.1 size=451905 2024-09-12T17:47:15.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.851+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=X5WLY7UZCLTT tag=YPWN6M1V0LEQ type=write size=2549057 2024-09-12T17:47:15.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.851+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=528FG57OSV7O type=write size=741608 2024-09-12T17:47:15.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.855+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~22WSQWK3GCM2.0 size=1048576 2024-09-12T17:47:15.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.859+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~22WSQWK3GCM2.1 size=813938 2024-09-12T17:47:15.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.863+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=22WSQWK3GCM2 tag=RHO19KE47ZWA type=write size=2911090 2024-09-12T17:47:15.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.867+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=8GOJ73DP1433 type=del size=2376716 2024-09-12T17:47:15.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.871+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~X0BD0ZL6YC3G.0 size=265025 2024-09-12T17:47:15.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.875+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=X0BD0ZL6YC3G tag=KI6ZRKPHII86 type=write size=1313601 2024-09-12T17:47:15.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.879+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~WVADO2Z229Q1.0 size=1048576 2024-09-12T17:47:15.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.883+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~WVADO2Z229Q1.1 size=1048576 2024-09-12T17:47:15.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.883+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~WVADO2Z229Q1.2 size=774886 2024-09-12T17:47:15.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.883+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=WVADO2Z229Q1 tag=WP05RNMW673M type=write size=3920614 2024-09-12T17:47:15.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.887+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=JIPXLRF19B7X type=del 2024-09-12T17:47:15.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.891+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=89L5RXS63F4O type=del size=1770647 2024-09-12T17:47:15.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.895+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=Q9AQI61JXPZS type=del 2024-09-12T17:47:15.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.895+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=NVPMZO1K2KUR type=write size=779992 2024-09-12T17:47:15.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.899+0000 7f68bc0598c0 1 < completed write operation key=KW3VWTA43PBM tag=I192L2VR0MQJ type=write size=663463 2024-09-12T17:47:15.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.903+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=WYFZ1UC5NDFC type=del size=455708 2024-09-12T17:47:15.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.907+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~X957WXSVS1AI.0 size=1048576 2024-09-12T17:47:15.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.907+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~X957WXSVS1AI.1 size=390805 2024-09-12T17:47:15.916 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.911+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=X957WXSVS1AI tag=MEKIU55EGSL6 type=write size=2487957 2024-09-12T17:47:15.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.915+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=0MZ2XVUH1FBE type=del size=2830633 2024-09-12T17:47:15.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.919+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=3K716V70S0EY type=del 2024-09-12T17:47:15.925 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.923+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=EDIBZOZJG09O type=write size=983339 2024-09-12T17:47:15.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.923+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~2RGZS2RMLJF2.0 size=222968 2024-09-12T17:47:15.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.927+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=2RGZS2RMLJF2 tag=KQI7MK1ZEG1I type=write size=1271544 2024-09-12T17:47:15.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.931+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~55OZ9S0WQEP5.0 size=727319 2024-09-12T17:47:15.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.931+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=55OZ9S0WQEP5 tag=ASXH3BQBD4UG type=write size=1775895 2024-09-12T17:47:15.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.935+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~VDMMQK5M9NA3.0 size=1048576 2024-09-12T17:47:15.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.939+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~VDMMQK5M9NA3.1 size=1048576 2024-09-12T17:47:15.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.939+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~VDMMQK5M9NA3.2 size=175138 2024-09-12T17:47:15.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.943+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=VDMMQK5M9NA3 tag=X36682VR1JPU type=write size=3320866 2024-09-12T17:47:15.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.947+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=TTC76OTDNS52 type=write size=152578 2024-09-12T17:47:15.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.955+0000 7f68bc0598c0 1 < suggested remove operation key=KW3VWTA43PBM tag=0VMT51Y7VWFT type=del 2024-09-12T17:47:15.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.963+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~UAU2HMJQD1YH.0 size=1048576 2024-09-12T17:47:15.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.967+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~UAU2HMJQD1YH.1 size=691669 2024-09-12T17:47:15.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.967+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=UAU2HMJQD1YH tag=G62WTX9R7WND type=write size=2788821 2024-09-12T17:47:15.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.967+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~PYXLYGNMKZQP.0 size=1048576 2024-09-12T17:47:15.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.971+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~PYXLYGNMKZQP.1 size=1048576 2024-09-12T17:47:15.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.975+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~PYXLYGNMKZQP.2 size=1022735 2024-09-12T17:47:15.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.979+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=PYXLYGNMKZQP tag=RHD098SVNVWX type=write size=4168463 2024-09-12T17:47:15.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.979+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=C3B8IPC6KJ47 type=del size=4001930 2024-09-12T17:47:15.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.983+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=YOYEG4CQZHH0 type=del 2024-09-12T17:47:15.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.987+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=MN9GRCSJMM5P type=del size=1034801 2024-09-12T17:47:15.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.991+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~ZP7Y37YFYFWH.0 size=1048576 2024-09-12T17:47:15.996 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.991+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~ZP7Y37YFYFWH.1 size=95091 2024-09-12T17:47:16.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:15.999+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=ZP7Y37YFYFWH tag=IOFWURYG3B9L type=write size=2192243 2024-09-12T17:47:16.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.003+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~MOKSGIB52ONU.0 size=475495 2024-09-12T17:47:16.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.003+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=MOKSGIB52ONU tag=SW275AJ92UJ1 type=write size=1524071 2024-09-12T17:47:16.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.011+0000 7f68bc0598c0 1 < suggested update operation key=8P0EWBVO0BQD tag=V38IEP3W6Q0J type=del size=649360 2024-09-12T17:47:16.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.015+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~6I5O5B0YL3Y0.0 size=1048576 2024-09-12T17:47:16.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.015+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~6I5O5B0YL3Y0.1 size=1048576 2024-09-12T17:47:16.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.019+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~6I5O5B0YL3Y0.2 size=224152 2024-09-12T17:47:16.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.019+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=6I5O5B0YL3Y0 tag=4YH1Y5SFW18D type=write size=3369880 2024-09-12T17:47:16.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.023+0000 7f68bc0598c0 -1 < failed to complete operation key=KW3VWTA43PBM tag=QNPK2DXX6TS8 type=del size=2125118: (22) Invalid argument 2024-09-12T17:47:16.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.027+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=L0GY8YGJSV4T type=del size=1097099 2024-09-12T17:47:16.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.027+0000 7f68bc0598c0 1 < completed write operation key=7XH1E2GEH9O2 tag=528FG57OSV7O type=write size=741608 2024-09-12T17:47:16.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.031+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=IKGUZWI4NC9M type=del size=545115 2024-09-12T17:47:16.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.035+0000 7f68bc0598c0 1 < canceled operation key=0XFYVNU2Q7KO tag=8GOJ73DP1433 type=del size=2376716 2024-09-12T17:47:16.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.039+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~S9F1Z3WLLMY2.0 size=513121 2024-09-12T17:47:16.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.039+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=S9F1Z3WLLMY2 tag=6YD3ZUNEK27Z type=write size=1561697 2024-09-12T17:47:16.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.043+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~WVADO2Z229Q1.0 size=1048576 2024-09-12T17:47:16.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.043+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~WVADO2Z229Q1.1 size=1048576 2024-09-12T17:47:16.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.047+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~WVADO2Z229Q1.2 size=774886 2024-09-12T17:47:16.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.051+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=WVADO2Z229Q1 tag=WP05RNMW673M type=write size=3920614 2024-09-12T17:47:16.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.059+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~D55GVAR1T94J.0 size=1048576 2024-09-12T17:47:16.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.059+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~D55GVAR1T94J.1 size=277997 2024-09-12T17:47:16.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.059+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=D55GVAR1T94J tag=TD8V3WF6GQ8Z type=write size=2375149 2024-09-12T17:47:16.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.063+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=89L5RXS63F4O type=del 2024-09-12T17:47:16.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.067+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=AVBK34B0Y406 type=del size=4166285 2024-09-12T17:47:16.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.071+0000 7f68bc0598c0 1 < suggested update operation key=S0B1RP89NO44 tag=NVPMZO1K2KUR type=write size=779992 2024-09-12T17:47:16.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.075+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=0Y5QTPLD3F07 type=write size=274656 2024-09-12T17:47:16.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.079+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=WYFZ1UC5NDFC type=del 2024-09-12T17:47:16.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.083+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~OTALKS231NLB.0 size=1048576 2024-09-12T17:47:16.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.087+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~OTALKS231NLB.1 size=1048576 2024-09-12T17:47:16.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.087+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~OTALKS231NLB.2 size=61415 2024-09-12T17:47:16.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.087+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=OTALKS231NLB tag=EAJRT6TJJ3A9 type=write size=3207143 2024-09-12T17:47:16.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.095+0000 7f68bc0598c0 1 < suggested remove operation key=3JPRQXKB5K3W tag=0MZ2XVUH1FBE type=del 2024-09-12T17:47:16.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.099+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=RDO83MMA2MS5 type=del size=2036499 2024-09-12T17:47:16.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.103+0000 7f68bc0598c0 1 < completed write operation key=0XFYVNU2Q7KO tag=EDIBZOZJG09O type=write size=983339 2024-09-12T17:47:16.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.103+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=70C3A7DY71U2 type=del size=818811 2024-09-12T17:47:16.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.107+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~55OZ9S0WQEP5.0 size=727319 2024-09-12T17:47:16.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.111+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=55OZ9S0WQEP5 tag=ASXH3BQBD4UG type=write size=1775895 2024-09-12T17:47:16.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.115+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=BTRPMUKYF96B type=del size=1099629 2024-09-12T17:47:16.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.119+0000 7f68bc0598c0 1 < completed write operation key=7XH1E2GEH9O2 tag=TTC76OTDNS52 type=write size=152578 2024-09-12T17:47:16.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.123+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=L11Q40VQC9A3 type=del size=1792898 2024-09-12T17:47:16.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.127+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~UAU2HMJQD1YH.0 size=1048576 2024-09-12T17:47:16.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.127+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~UAU2HMJQD1YH.1 size=691669 2024-09-12T17:47:16.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.135+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=UAU2HMJQD1YH tag=G62WTX9R7WND type=write size=2788821 2024-09-12T17:47:16.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.139+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=PM21QCDZ4QVL type=del size=1252818 2024-09-12T17:47:16.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.139+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=C3B8IPC6KJ47 type=del 2024-09-12T17:47:16.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.143+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=V8PYP312P5LN type=del size=1171666 2024-09-12T17:47:16.149 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.147+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=MN9GRCSJMM5P type=del 2024-09-12T17:47:16.152 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.147+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=RTY5CIP7A266 type=write size=333053 2024-09-12T17:47:16.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.151+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~MOKSGIB52ONU.0 size=475495 2024-09-12T17:47:16.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.155+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=MOKSGIB52ONU tag=SW275AJ92UJ1 type=write size=1524071 2024-09-12T17:47:16.161 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.159+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=V70QWHLN1I4T type=del size=2229359 2024-09-12T17:47:16.163 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.159+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~6I5O5B0YL3Y0.0 size=1048576 2024-09-12T17:47:16.165 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.163+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~6I5O5B0YL3Y0.1 size=1048576 2024-09-12T17:47:16.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.163+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~6I5O5B0YL3Y0.2 size=224152 2024-09-12T17:47:16.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.167+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=6I5O5B0YL3Y0 tag=4YH1Y5SFW18D type=write size=3369880 2024-09-12T17:47:16.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~ET5RWTS0ZLK6.0 size=1048576 2024-09-12T17:47:16.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.175+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~ET5RWTS0ZLK6.1 size=257574 2024-09-12T17:47:16.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.175+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=ET5RWTS0ZLK6 tag=31RP6A2BLHW7 type=write size=2354726 2024-09-12T17:47:16.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.179+0000 7f68bc0598c0 1 < suggested update operation key=6SUA9FBDU69A tag=L0GY8YGJSV4T type=del size=1097099 2024-09-12T17:47:16.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.183+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~5U8HNT41JP8L.0 size=668438 2024-09-12T17:47:16.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.183+0000 7f68bc0598c0 1 > prepared multipart upload key=BKAT5SGAC5Z8 upload=5U8HNT41JP8L tag=DTFM5Z2PVOQG type=write size=1717014 2024-09-12T17:47:16.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.187+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=IKGUZWI4NC9M type=del 2024-09-12T17:47:16.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.191+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=PDGO6RZ0F8VO type=write size=754947 2024-09-12T17:47:16.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.191+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~S9F1Z3WLLMY2.0 size=513121 2024-09-12T17:47:16.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.199+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=S9F1Z3WLLMY2 tag=6YD3ZUNEK27Z type=write size=1561697 2024-09-12T17:47:16.205 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.199+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=CRCJLX5W58EY type=del size=4038800 2024-09-12T17:47:16.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.203+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~D55GVAR1T94J.0 size=1048576 2024-09-12T17:47:16.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.207+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~D55GVAR1T94J.1 size=277997 2024-09-12T17:47:16.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.211+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=D55GVAR1T94J tag=TD8V3WF6GQ8Z type=write size=2375149 2024-09-12T17:47:16.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.215+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=MQ8J6P2VY254 type=write size=1005200 2024-09-12T17:47:16.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.219+0000 7f68bc0598c0 1 < canceled operation key=WPQ755ODAFNT tag=AVBK34B0Y406 type=del size=4166285 2024-09-12T17:47:16.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.223+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~9L9SER5NH8S4.0 size=312504 2024-09-12T17:47:16.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.223+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=9L9SER5NH8S4 tag=JFY197ZGU4SD type=write size=1361080 2024-09-12T17:47:16.230 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.227+0000 7f68bc0598c0 1 < completed write operation key=7XH1E2GEH9O2 tag=0Y5QTPLD3F07 type=write size=274656 2024-09-12T17:47:16.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.231+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=XK66C99BYSNG type=del size=3082733 2024-09-12T17:47:16.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.235+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~OTALKS231NLB.0 size=1048576 2024-09-12T17:47:16.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.239+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~OTALKS231NLB.1 size=1048576 2024-09-12T17:47:16.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.239+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~OTALKS231NLB.2 size=61415 2024-09-12T17:47:16.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.243+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=OTALKS231NLB tag=EAJRT6TJJ3A9 type=write size=3207143 2024-09-12T17:47:16.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.247+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=LF6U2VLUHMK5 type=del size=2629171 2024-09-12T17:47:16.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.251+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=RDO83MMA2MS5 type=del 2024-09-12T17:47:16.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.255+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=INW0ZTJW56F6 type=del size=1950288 2024-09-12T17:47:16.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.259+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=70C3A7DY71U2 type=del 2024-09-12T17:47:16.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.259+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=U8B11B7YQOEO type=write size=652363 2024-09-12T17:47:16.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.263+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=BTRPMUKYF96B type=del 2024-09-12T17:47:16.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.267+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=RM3E0FOJ40TE type=del size=3845133 2024-09-12T17:47:16.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.267+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=L11Q40VQC9A3 type=del 2024-09-12T17:47:16.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.271+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=Q59U6KPFU6FX type=del size=3768797 2024-09-12T17:47:16.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.275+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=PM21QCDZ4QVL type=del 2024-09-12T17:47:16.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.283+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~GNAAGNUYMMXO.0 size=1048576 2024-09-12T17:47:16.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.283+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~GNAAGNUYMMXO.1 size=1048576 2024-09-12T17:47:16.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.287+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~GNAAGNUYMMXO.2 size=219206 2024-09-12T17:47:16.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.287+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=GNAAGNUYMMXO tag=QWQ4HQRPJ0QM type=write size=3364934 2024-09-12T17:47:16.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.291+0000 7f68bc0598c0 1 < suggested remove operation key=S0B1RP89NO44 tag=V8PYP312P5LN type=del 2024-09-12T17:47:16.300 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.295+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=FONLH1J5W0S5 type=write size=33357 2024-09-12T17:47:16.302 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.299+0000 7f68bc0598c0 1 < completed write operation key=9846YLKC8P8S tag=RTY5CIP7A266 type=write size=333053 2024-09-12T17:47:16.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.303+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~L1AJQQYZ7QTG.0 size=545531 2024-09-12T17:47:16.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.303+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=L1AJQQYZ7QTG tag=JINF6DQ6K2WN type=write size=1594107 2024-09-12T17:47:16.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.311+0000 7f68bc0598c0 1 < suggested remove operation key=2129SG6US3LI tag=V70QWHLN1I4T type=del 2024-09-12T17:47:16.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.315+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=0KHG3U3Q8YZJ type=del size=3614186 2024-09-12T17:47:16.320 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.315+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~ET5RWTS0ZLK6.0 size=1048576 2024-09-12T17:47:16.320 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.315+0000 7f68bc0598c0 1 < canceled part key=_multipart_9846YLKC8P8S.2~ET5RWTS0ZLK6.1 size=257574 2024-09-12T17:47:16.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.319+0000 7f68bc0598c0 1 < canceled multipart upload key=9846YLKC8P8S upload=ET5RWTS0ZLK6 tag=31RP6A2BLHW7 type=write size=2354726 2024-09-12T17:47:16.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.327+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~MFDGWZ5AB43P.0 size=1048576 2024-09-12T17:47:16.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.327+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~MFDGWZ5AB43P.1 size=1048576 2024-09-12T17:47:16.334 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.331+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~MFDGWZ5AB43P.2 size=324486 2024-09-12T17:47:16.334 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.331+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=MFDGWZ5AB43P tag=CI9MJNZ8LYVE type=write size=3470214 2024-09-12T17:47:16.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.335+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~5U8HNT41JP8L.0 size=668438 2024-09-12T17:47:16.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.339+0000 7f68bc0598c0 1 < completed multipart upload key=BKAT5SGAC5Z8 upload=5U8HNT41JP8L tag=DTFM5Z2PVOQG type=write size=1717014 2024-09-12T17:47:16.345 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.343+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=O1MXOT99JVEB type=del size=3549331 2024-09-12T17:47:16.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.343+0000 7f68bc0598c0 1 < completed write operation key=UOW521GPXBQ0 tag=PDGO6RZ0F8VO type=write size=754947 2024-09-12T17:47:16.351 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.347+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=XMTHZ5JE4VIB type=del size=3144287 2024-09-12T17:47:16.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.351+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=CRCJLX5W58EY type=del 2024-09-12T17:47:16.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.351+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=HYOJTMJ30RGA type=del size=1771842 2024-09-12T17:47:16.360 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.355+0000 7f68bc0598c0 1 < canceled operation key=FC3K0QN3TAWH tag=MQ8J6P2VY254 type=write size=1005200 2024-09-12T17:47:16.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.363+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~BL62ZJD0KQYQ.0 size=1048576 2024-09-12T17:47:16.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.363+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~BL62ZJD0KQYQ.1 size=1048576 2024-09-12T17:47:16.370 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.367+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~BL62ZJD0KQYQ.2 size=776663 2024-09-12T17:47:16.370 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.367+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=BL62ZJD0KQYQ tag=5AISWLG2UWCC type=write size=3922391 2024-09-12T17:47:16.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.371+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~9L9SER5NH8S4.0 size=312504 2024-09-12T17:47:16.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.375+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=9L9SER5NH8S4 tag=JFY197ZGU4SD type=write size=1361080 2024-09-12T17:47:16.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.379+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=04YL0EUZZKJ3 type=del size=110514 2024-09-12T17:47:16.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.379+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=XK66C99BYSNG type=del 2024-09-12T17:47:16.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.383+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=5UORV0L5EYUD type=del size=676944 2024-09-12T17:47:16.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.391+0000 7f68bc0598c0 1 < suggested remove operation key=XGJSQJ2IXJDK tag=LF6U2VLUHMK5 type=del 2024-09-12T17:47:16.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.395+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=FRIV55TTABSD type=write size=937102 2024-09-12T17:47:16.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.399+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=INW0ZTJW56F6 type=del 2024-09-12T17:47:16.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.403+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=7EA4JSFVVPC0 type=del size=770715 2024-09-12T17:47:16.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.403+0000 7f68bc0598c0 -1 < no bi entry to suggest for operation key=2129SG6US3LI tag=U8B11B7YQOEO type=write size=652363: (2) No such file or directory 2024-09-12T17:47:16.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.407+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=83W5O0BK6JX3 type=del size=63022 2024-09-12T17:47:16.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.411+0000 7f68bc0598c0 1 < canceled operation key=DMJZUQJ7IY60 tag=RM3E0FOJ40TE type=del size=3845133 2024-09-12T17:47:16.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.411+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=E0VLCT6UV55S type=write size=154114 2024-09-12T17:47:16.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.415+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=Q59U6KPFU6FX type=del 2024-09-12T17:47:16.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.423+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~8A8KI7891K4R.0 size=1048576 2024-09-12T17:47:16.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.427+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~8A8KI7891K4R.1 size=24395 2024-09-12T17:47:16.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.427+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=8A8KI7891K4R tag=SXAFG55N7RMM type=write size=2121547 2024-09-12T17:47:16.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.427+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~GNAAGNUYMMXO.0 size=1048576 2024-09-12T17:47:16.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.431+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~GNAAGNUYMMXO.1 size=1048576 2024-09-12T17:47:16.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.435+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~GNAAGNUYMMXO.2 size=219206 2024-09-12T17:47:16.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.439+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=GNAAGNUYMMXO tag=QWQ4HQRPJ0QM type=write size=3364934 2024-09-12T17:47:16.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.443+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=VZ0WGB5CHIPG type=del size=2514489 2024-09-12T17:47:16.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.447+0000 7f68bc0598c0 1 < suggested update operation key=OG0V0I1SDHG5 tag=FONLH1J5W0S5 type=write size=33357 2024-09-12T17:47:16.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.455+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~9NIL1XY9EUK5.0 size=1048576 2024-09-12T17:47:16.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.455+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~9NIL1XY9EUK5.1 size=1048576 2024-09-12T17:47:16.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~9NIL1XY9EUK5.2 size=687890 2024-09-12T17:47:16.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.459+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=9NIL1XY9EUK5 tag=TSJB5QR0996X type=write size=3833618 2024-09-12T17:47:16.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.463+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~L1AJQQYZ7QTG.0 size=545531 2024-09-12T17:47:16.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.467+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=L1AJQQYZ7QTG tag=JINF6DQ6K2WN type=write size=1594107 2024-09-12T17:47:16.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.471+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=IKI40FKIWJB6 type=del size=543813 2024-09-12T17:47:16.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.471+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=0KHG3U3Q8YZJ type=del 2024-09-12T17:47:16.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.475+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=EM6Q6P22FOLG type=write size=775540 2024-09-12T17:47:16.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.479+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~MFDGWZ5AB43P.0 size=1048576 2024-09-12T17:47:16.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.483+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~MFDGWZ5AB43P.1 size=1048576 2024-09-12T17:47:16.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.483+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~MFDGWZ5AB43P.2 size=324486 2024-09-12T17:47:16.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.487+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=MFDGWZ5AB43P tag=CI9MJNZ8LYVE type=write size=3470214 2024-09-12T17:47:16.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.491+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=T1OGMRCDE3SM type=del size=2099145 2024-09-12T17:47:16.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.495+0000 7f68bc0598c0 1 < canceled operation key=DMJZUQJ7IY60 tag=O1MXOT99JVEB type=del size=3549331 2024-09-12T17:47:16.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.503+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~3FCDMRR5G7HO.0 size=372797 2024-09-12T17:47:16.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.503+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=3FCDMRR5G7HO tag=EKVJSD1SASJX type=write size=1421373 2024-09-12T17:47:16.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.503+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=XMTHZ5JE4VIB type=del 2024-09-12T17:47:16.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.511+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~OSN8QV2BX0N2.0 size=611743 2024-09-12T17:47:16.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.511+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=OSN8QV2BX0N2 tag=MJYTYEMQ7R4B type=write size=1660319 2024-09-12T17:47:16.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.515+0000 7f68bc0598c0 -1 < failed to complete operation key=OG0V0I1SDHG5 tag=HYOJTMJ30RGA type=del size=1771842: (22) Invalid argument 2024-09-12T17:47:16.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.515+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=WIOOCLPU6HCY type=del size=2261032 2024-09-12T17:47:16.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.519+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~BL62ZJD0KQYQ.0 size=1048576 2024-09-12T17:47:16.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.523+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~BL62ZJD0KQYQ.1 size=1048576 2024-09-12T17:47:16.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.527+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~BL62ZJD0KQYQ.2 size=776663 2024-09-12T17:47:16.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.535+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=BL62ZJD0KQYQ tag=5AISWLG2UWCC type=write size=3922391 2024-09-12T17:47:16.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.539+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~FELKDJ49USH1.0 size=1048576 2024-09-12T17:47:16.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.543+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~FELKDJ49USH1.1 size=355280 2024-09-12T17:47:16.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.543+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=FELKDJ49USH1 tag=79XKJZEXRHIA type=write size=2452432 2024-09-12T17:47:16.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.547+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=04YL0EUZZKJ3 type=del 2024-09-12T17:47:16.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.551+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~CVC2I7BHKMGK.0 size=1048576 2024-09-12T17:47:16.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.555+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~CVC2I7BHKMGK.1 size=335245 2024-09-12T17:47:16.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.555+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=CVC2I7BHKMGK tag=NWI19T87VKZX type=write size=2432397 2024-09-12T17:47:16.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.559+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=5UORV0L5EYUD type=del 2024-09-12T17:47:16.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.559+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=T3AT7PCM70HO type=del size=389954 2024-09-12T17:47:16.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.563+0000 7f68bc0598c0 1 < completed write operation key=FC3K0QN3TAWH tag=FRIV55TTABSD type=write size=937102 2024-09-12T17:47:16.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.567+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=RZY339FCPH9D type=del size=2563092 2024-09-12T17:47:16.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.571+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=7EA4JSFVVPC0 type=del 2024-09-12T17:47:16.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.575+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=ALGW16KVT3RK type=del size=3167027 2024-09-12T17:47:16.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.579+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=83W5O0BK6JX3 type=del 2024-09-12T17:47:16.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.579+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=61ZOGJ4U82JG type=write size=979510 2024-09-12T17:47:16.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.583+0000 7f68bc0598c0 1 < completed write operation key=3JPRQXKB5K3W tag=E0VLCT6UV55S type=write size=154114 2024-09-12T17:47:16.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.587+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=8XY0V2EQGKYX type=write size=173054 2024-09-12T17:47:16.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.587+0000 7f68bc0598c0 1 < canceled part key=_multipart_8P0EWBVO0BQD.2~8A8KI7891K4R.0 size=1048576 2024-09-12T17:47:16.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.591+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~8A8KI7891K4R.1 size=24395 2024-09-12T17:47:16.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.595+0000 7f68bc0598c0 1 < canceled multipart upload key=8P0EWBVO0BQD upload=8A8KI7891K4R tag=SXAFG55N7RMM type=write size=2121547 2024-09-12T17:47:16.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.599+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=LT81HSRVUDEH type=write size=346213 2024-09-12T17:47:16.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.603+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=VZ0WGB5CHIPG type=del 2024-09-12T17:47:16.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~YUAL57DLLN65.0 size=1048576 2024-09-12T17:47:16.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.611+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~YUAL57DLLN65.1 size=133587 2024-09-12T17:47:16.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.611+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=YUAL57DLLN65 tag=87JMLIWCGIW9 type=write size=2230739 2024-09-12T17:47:16.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.615+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~9NIL1XY9EUK5.0 size=1048576 2024-09-12T17:47:16.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.615+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~9NIL1XY9EUK5.1 size=1048576 2024-09-12T17:47:16.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.615+0000 7f68bc0598c0 1 < canceled part key=_multipart_UOW521GPXBQ0.2~9NIL1XY9EUK5.2 size=687890 2024-09-12T17:47:16.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.623+0000 7f68bc0598c0 1 < canceled multipart upload key=UOW521GPXBQ0 upload=9NIL1XY9EUK5 tag=TSJB5QR0996X type=write size=3833618 2024-09-12T17:47:16.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.627+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~4HEVRSQH09Y1.0 size=1045052 2024-09-12T17:47:16.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.627+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=4HEVRSQH09Y1 tag=KFNR4YAUCNLK type=write size=2093628 2024-09-12T17:47:16.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.631+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=IKI40FKIWJB6 type=del 2024-09-12T17:47:16.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.635+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~TY1XL06IAOMH.0 size=1048576 2024-09-12T17:47:16.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.639+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~TY1XL06IAOMH.1 size=1048576 2024-09-12T17:47:16.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.643+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~TY1XL06IAOMH.2 size=706773 2024-09-12T17:47:16.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.643+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=TY1XL06IAOMH tag=2D0BCS14R0LF type=write size=3852501 2024-09-12T17:47:16.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.647+0000 7f68bc0598c0 1 < suggested remove operation key=WUGDIFCHNL90 tag=EM6Q6P22FOLG type=write 2024-09-12T17:47:16.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.651+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=RT362F4CL3BL type=del size=656834 2024-09-12T17:47:16.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.655+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=T1OGMRCDE3SM type=del 2024-09-12T17:47:16.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.663+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~R0FO3MNXFPNY.0 size=1048576 2024-09-12T17:47:16.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.663+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~R0FO3MNXFPNY.1 size=1048576 2024-09-12T17:47:16.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.667+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~R0FO3MNXFPNY.2 size=72794 2024-09-12T17:47:16.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.667+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=R0FO3MNXFPNY tag=V1XV0W0E0W7H type=write size=3218522 2024-09-12T17:47:16.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.671+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~3FCDMRR5G7HO.0 size=372797 2024-09-12T17:47:16.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.675+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=3FCDMRR5G7HO tag=EKVJSD1SASJX type=write size=1421373 2024-09-12T17:47:16.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.679+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=UMI52A175K4X type=del size=2500054 2024-09-12T17:47:16.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.683+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~OSN8QV2BX0N2.0 size=611743 2024-09-12T17:47:16.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.687+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=OSN8QV2BX0N2 tag=MJYTYEMQ7R4B type=write size=1660319 2024-09-12T17:47:16.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.691+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=3ROQO2WX9SGT type=write size=112684 2024-09-12T17:47:16.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.691+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=WIOOCLPU6HCY type=del 2024-09-12T17:47:16.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.699+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~AHNDY8FVES20.0 size=1048576 2024-09-12T17:47:16.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.699+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~AHNDY8FVES20.1 size=1048576 2024-09-12T17:47:16.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.703+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~AHNDY8FVES20.2 size=891360 2024-09-12T17:47:16.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.703+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=AHNDY8FVES20 tag=QRK74LRGIKXI type=write size=4037088 2024-09-12T17:47:16.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.707+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~FELKDJ49USH1.0 size=1048576 2024-09-12T17:47:16.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.707+0000 7f68bc0598c0 1 < canceled part key=_multipart_8P0EWBVO0BQD.2~FELKDJ49USH1.1 size=355280 2024-09-12T17:47:16.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.711+0000 7f68bc0598c0 1 < canceled multipart upload key=8P0EWBVO0BQD upload=FELKDJ49USH1 tag=79XKJZEXRHIA type=write size=2452432 2024-09-12T17:47:16.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.715+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~8BVLIBYDLWBT.0 size=6716 2024-09-12T17:47:16.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.715+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=8BVLIBYDLWBT tag=2X3OKR423GU0 type=write size=1055292 2024-09-12T17:47:16.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.719+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~CVC2I7BHKMGK.0 size=1048576 2024-09-12T17:47:16.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.723+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~CVC2I7BHKMGK.1 size=335245 2024-09-12T17:47:16.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.727+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=CVC2I7BHKMGK tag=NWI19T87VKZX type=write size=2432397 2024-09-12T17:47:16.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.735+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~QQ762L1877MH.0 size=435549 2024-09-12T17:47:16.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.735+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=QQ762L1877MH tag=9BK4MAJAK630 type=write size=1484125 2024-09-12T17:47:16.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.739+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=T3AT7PCM70HO type=del 2024-09-12T17:47:16.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.743+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~4GNES3DEO0M4.0 size=659702 2024-09-12T17:47:16.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.743+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=4GNES3DEO0M4 tag=HISECGTDTR2J type=write size=1708278 2024-09-12T17:47:16.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.747+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=RZY339FCPH9D type=del 2024-09-12T17:47:16.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.751+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=KRM7W6HKBDCH type=del size=2517773 2024-09-12T17:47:16.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.759+0000 7f68bc0598c0 1 < suggested remove operation key=4R9ENKMRB1GT tag=ALGW16KVT3RK type=del 2024-09-12T17:47:16.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.763+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=5AJ98CF4WOOI type=del size=4008508 2024-09-12T17:47:16.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.771+0000 7f68bc0598c0 1 < suggested update operation key=QGO5SPFPT548 tag=61ZOGJ4U82JG type=write size=979510 2024-09-12T17:47:16.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.775+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=207VSHX2KWOF type=del size=3955977 2024-09-12T17:47:16.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.775+0000 7f68bc0598c0 1 < canceled operation key=3JPRQXKB5K3W tag=8XY0V2EQGKYX type=write size=173054 2024-09-12T17:47:16.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.779+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=JSTFJABFTSID type=del size=275796 2024-09-12T17:47:16.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.783+0000 7f68bc0598c0 1 < completed write operation key=HGY9WK7MKCYS tag=LT81HSRVUDEH type=write size=346213 2024-09-12T17:47:16.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.791+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~Q4JEGXVS1CUL.0 size=1048576 2024-09-12T17:47:16.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.791+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~Q4JEGXVS1CUL.1 size=270409 2024-09-12T17:47:16.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.791+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=Q4JEGXVS1CUL tag=Q8K8U0VYU050 type=write size=2367561 2024-09-12T17:47:16.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.795+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~YUAL57DLLN65.0 size=1048576 2024-09-12T17:47:16.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.799+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~YUAL57DLLN65.1 size=133587 2024-09-12T17:47:16.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.803+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=YUAL57DLLN65 tag=87JMLIWCGIW9 type=write size=2230739 2024-09-12T17:47:16.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.807+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=D4DVM9GVEO6V type=del size=1124616 2024-09-12T17:47:16.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.811+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~4HEVRSQH09Y1.0 size=1045052 2024-09-12T17:47:16.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.815+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=4HEVRSQH09Y1 tag=KFNR4YAUCNLK type=write size=2093628 2024-09-12T17:47:16.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.823+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~EVOZV43CI0O7.0 size=1048576 2024-09-12T17:47:16.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.823+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~EVOZV43CI0O7.1 size=861630 2024-09-12T17:47:16.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.823+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=EVOZV43CI0O7 tag=WK8CU4CP63UA type=write size=2958782 2024-09-12T17:47:16.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.827+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~TY1XL06IAOMH.0 size=1048576 2024-09-12T17:47:16.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.835+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~TY1XL06IAOMH.1 size=1048576 2024-09-12T17:47:16.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.839+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~TY1XL06IAOMH.2 size=706773 2024-09-12T17:47:16.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.843+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=TY1XL06IAOMH tag=2D0BCS14R0LF type=write size=3852501 2024-09-12T17:47:16.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.847+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=27WP4EFYBIUW type=del size=770639 2024-09-12T17:47:16.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.851+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=RT362F4CL3BL type=del 2024-09-12T17:47:16.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.855+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~NUU3W8PWVZ2P.0 size=1048576 2024-09-12T17:47:16.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.859+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~NUU3W8PWVZ2P.1 size=739786 2024-09-12T17:47:16.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.859+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=NUU3W8PWVZ2P tag=B13WLL0K32LQ type=write size=2836938 2024-09-12T17:47:16.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.859+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~R0FO3MNXFPNY.0 size=1048576 2024-09-12T17:47:16.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.863+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~R0FO3MNXFPNY.1 size=1048576 2024-09-12T17:47:16.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.867+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~R0FO3MNXFPNY.2 size=72794 2024-09-12T17:47:16.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.871+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=R0FO3MNXFPNY tag=V1XV0W0E0W7H type=write size=3218522 2024-09-12T17:47:16.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.879+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~XLXNKBRB240O.0 size=498167 2024-09-12T17:47:16.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.879+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=XLXNKBRB240O tag=RB00SBKE9UN2 type=write size=1546743 2024-09-12T17:47:16.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.879+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=UMI52A175K4X type=del 2024-09-12T17:47:16.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.883+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=S06JMEI9AC49 type=del size=3896343 2024-09-12T17:47:16.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.887+0000 7f68bc0598c0 1 < completed write operation key=SBQGW2EK6I1J tag=3ROQO2WX9SGT type=write size=112684 2024-09-12T17:47:16.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.891+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=Q83KWII73XOF type=del size=3103894 2024-09-12T17:47:16.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.895+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~AHNDY8FVES20.0 size=1048576 2024-09-12T17:47:16.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.895+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~AHNDY8FVES20.1 size=1048576 2024-09-12T17:47:16.902 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.899+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~AHNDY8FVES20.2 size=891360 2024-09-12T17:47:16.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.903+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=AHNDY8FVES20 tag=QRK74LRGIKXI type=write size=4037088 2024-09-12T17:47:16.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.907+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=VNITOQR8PI2E type=del size=2521412 2024-09-12T17:47:16.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.911+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~8BVLIBYDLWBT.0 size=6716 2024-09-12T17:47:16.918 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.915+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=8BVLIBYDLWBT tag=2X3OKR423GU0 type=write size=1055292 2024-09-12T17:47:16.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.919+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=W0ZTCOF1NXF0 type=del size=2918548 2024-09-12T17:47:16.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.919+0000 7f68bc0598c0 1 < canceled part key=_multipart_MRS3KW2H5AKK.2~QQ762L1877MH.0 size=435549 2024-09-12T17:47:16.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.923+0000 7f68bc0598c0 1 < canceled multipart upload key=MRS3KW2H5AKK upload=QQ762L1877MH tag=9BK4MAJAK630 type=write size=1484125 2024-09-12T17:47:16.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.927+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=TSDX2M8KWI14 type=del size=2480827 2024-09-12T17:47:16.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.931+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~4GNES3DEO0M4.0 size=659702 2024-09-12T17:47:16.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.935+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=4GNES3DEO0M4 tag=HISECGTDTR2J type=write size=1708278 2024-09-12T17:47:16.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.939+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=1IRFM93VMM3A type=write size=503971 2024-09-12T17:47:16.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.943+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=KRM7W6HKBDCH type=del 2024-09-12T17:47:16.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.947+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~UCU2L7COJ78L.0 size=1048576 2024-09-12T17:47:16.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.951+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~UCU2L7COJ78L.1 size=703057 2024-09-12T17:47:16.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.951+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=UCU2L7COJ78L tag=JRTFWHH4VBE8 type=write size=2800209 2024-09-12T17:47:16.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.955+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=5AJ98CF4WOOI type=del 2024-09-12T17:47:16.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.959+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~41NTB6U82ORD.0 size=1048576 2024-09-12T17:47:16.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.963+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~41NTB6U82ORD.1 size=754645 2024-09-12T17:47:16.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.963+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=41NTB6U82ORD tag=FD0RTGEPN9VE type=write size=2851797 2024-09-12T17:47:16.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.971+0000 7f68bc0598c0 1 < suggested update operation key=6J677S46BXS4 tag=207VSHX2KWOF type=del size=3955977 2024-09-12T17:47:16.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.975+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~65HBABOLCO5E.0 size=741471 2024-09-12T17:47:16.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.975+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=65HBABOLCO5E tag=CAMUDG62AYOA type=write size=1790047 2024-09-12T17:47:16.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.979+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=JSTFJABFTSID type=del 2024-09-12T17:47:16.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.983+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=AZ139DJZ30GS type=del size=3870583 2024-09-12T17:47:16.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.987+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~Q4JEGXVS1CUL.0 size=1048576 2024-09-12T17:47:16.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.987+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~Q4JEGXVS1CUL.1 size=270409 2024-09-12T17:47:16.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.995+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=Q4JEGXVS1CUL tag=Q8K8U0VYU050 type=write size=2367561 2024-09-12T17:47:17.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.995+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=82YD9LMJE1L1 type=write size=864675 2024-09-12T17:47:17.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:16.999+0000 7f68bc0598c0 1 < canceled operation key=UMQLPH9XGWRZ tag=D4DVM9GVEO6V type=del size=1124616 2024-09-12T17:47:17.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.007+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~1DFMY1XM0VMW.0 size=1048576 2024-09-12T17:47:17.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.011+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~1DFMY1XM0VMW.1 size=1048576 2024-09-12T17:47:17.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.011+0000 7f68bc0598c0 1 > prepared part key=_multipart_9846YLKC8P8S.2~1DFMY1XM0VMW.2 size=377891 2024-09-12T17:47:17.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.011+0000 7f68bc0598c0 1 > prepared multipart upload key=9846YLKC8P8S upload=1DFMY1XM0VMW tag=CSBWM4NPR1FR type=write size=3523619 2024-09-12T17:47:17.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.015+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~EVOZV43CI0O7.0 size=1048576 2024-09-12T17:47:17.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.019+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~EVOZV43CI0O7.1 size=861630 2024-09-12T17:47:17.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.023+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=EVOZV43CI0O7 tag=WK8CU4CP63UA type=write size=2958782 2024-09-12T17:47:17.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.027+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=EB6DIOLEC82S type=write size=966837 2024-09-12T17:47:17.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.031+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=27WP4EFYBIUW type=del 2024-09-12T17:47:17.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.035+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=24RTVCLSMAVS type=write size=334628 2024-09-12T17:47:17.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.035+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~NUU3W8PWVZ2P.0 size=1048576 2024-09-12T17:47:17.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.039+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~NUU3W8PWVZ2P.1 size=739786 2024-09-12T17:47:17.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.043+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=NUU3W8PWVZ2P tag=B13WLL0K32LQ type=write size=2836938 2024-09-12T17:47:17.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.051+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~7HXKSDHH3ODW.0 size=1048576 2024-09-12T17:47:17.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.051+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~7HXKSDHH3ODW.1 size=459003 2024-09-12T17:47:17.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.051+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=7HXKSDHH3ODW tag=7DPDZVS28CN5 type=write size=2556155 2024-09-12T17:47:17.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.055+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~XLXNKBRB240O.0 size=498167 2024-09-12T17:47:17.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.059+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=XLXNKBRB240O tag=RB00SBKE9UN2 type=write size=1546743 2024-09-12T17:47:17.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.067+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~LH2WVI1WZM5G.0 size=1048576 2024-09-12T17:47:17.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.067+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~LH2WVI1WZM5G.1 size=364775 2024-09-12T17:47:17.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.067+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=LH2WVI1WZM5G tag=TX382MSDY9LK type=write size=2461927 2024-09-12T17:47:17.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.071+0000 7f68bc0598c0 -1 < failed to complete operation key=6J677S46BXS4 tag=S06JMEI9AC49 type=del size=3896343: (22) Invalid argument 2024-09-12T17:47:17.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.075+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=A2XLMF7DVOLG type=del size=15475 2024-09-12T17:47:17.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.079+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=Q83KWII73XOF type=del 2024-09-12T17:47:17.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.079+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=ZWFLY6S9WSQP type=write size=477109 2024-09-12T17:47:17.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.083+0000 7f68bc0598c0 1 < canceled operation key=9XK00RPA6Q38 tag=VNITOQR8PI2E type=del size=2521412 2024-09-12T17:47:17.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.091+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~3WY12LVNB7PD.0 size=1048576 2024-09-12T17:47:17.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.091+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~3WY12LVNB7PD.1 size=1048576 2024-09-12T17:47:17.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.095+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~3WY12LVNB7PD.2 size=700339 2024-09-12T17:47:17.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.095+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=3WY12LVNB7PD tag=B6O5B23R79DA type=write size=3846067 2024-09-12T17:47:17.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.099+0000 7f68bc0598c0 -1 < failed to complete operation key=6J677S46BXS4 tag=W0ZTCOF1NXF0 type=del size=2918548: (22) Invalid argument 2024-09-12T17:47:17.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.103+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=0GPEEIW58WSJ type=del size=2799109 2024-09-12T17:47:17.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.107+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=TSDX2M8KWI14 type=del 2024-09-12T17:47:17.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.107+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=1H6609ODGB2L type=del size=2357987 2024-09-12T17:47:17.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.115+0000 7f68bc0598c0 1 < suggested remove operation key=9XK00RPA6Q38 tag=1IRFM93VMM3A type=write 2024-09-12T17:47:17.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.119+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=EV3NKB4XX2F9 type=del size=1061750 2024-09-12T17:47:17.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.123+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~UCU2L7COJ78L.0 size=1048576 2024-09-12T17:47:17.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.123+0000 7f68bc0598c0 1 < canceled part key=_multipart_9XK00RPA6Q38.2~UCU2L7COJ78L.1 size=703057 2024-09-12T17:47:17.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.127+0000 7f68bc0598c0 1 < canceled multipart upload key=9XK00RPA6Q38 upload=UCU2L7COJ78L tag=JRTFWHH4VBE8 type=write size=2800209 2024-09-12T17:47:17.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.139+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~BI4XLR9JZR59.0 size=1048576 2024-09-12T17:47:17.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.143+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~BI4XLR9JZR59.1 size=1048576 2024-09-12T17:47:17.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.143+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~BI4XLR9JZR59.2 size=1030956 2024-09-12T17:47:17.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.143+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=BI4XLR9JZR59 tag=P9NIENU7M3XL type=write size=4176684 2024-09-12T17:47:17.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.147+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~41NTB6U82ORD.0 size=1048576 2024-09-12T17:47:17.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.151+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~41NTB6U82ORD.1 size=754645 2024-09-12T17:47:17.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.155+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=41NTB6U82ORD tag=FD0RTGEPN9VE type=write size=2851797 2024-09-12T17:47:17.163 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.159+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=5VSWX3TBQHW8 type=del size=3684580 2024-09-12T17:47:17.166 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.163+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~65HBABOLCO5E.0 size=741471 2024-09-12T17:47:17.171 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.167+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=65HBABOLCO5E tag=CAMUDG62AYOA type=write size=1790047 2024-09-12T17:47:17.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.175+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~GICLJA2IN97C.0 size=1048576 2024-09-12T17:47:17.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.175+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~GICLJA2IN97C.1 size=828210 2024-09-12T17:47:17.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.175+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=GICLJA2IN97C tag=FGWZVKTGPR3E type=write size=2925362 2024-09-12T17:47:17.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.179+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=AZ139DJZ30GS type=del 2024-09-12T17:47:17.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.183+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=N42IRL15BZW7 type=del size=3802563 2024-09-12T17:47:17.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.187+0000 7f68bc0598c0 1 < completed write operation key=3JPRQXKB5K3W tag=82YD9LMJE1L1 type=write size=864675 2024-09-12T17:47:17.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.191+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=BVBPUZAFTDOA type=del size=435702 2024-09-12T17:47:17.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.195+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~1DFMY1XM0VMW.0 size=1048576 2024-09-12T17:47:17.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.195+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~1DFMY1XM0VMW.1 size=1048576 2024-09-12T17:47:17.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.199+0000 7f68bc0598c0 1 < completed part key=_multipart_9846YLKC8P8S.2~1DFMY1XM0VMW.2 size=377891 2024-09-12T17:47:17.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.203+0000 7f68bc0598c0 1 < completed multipart upload key=9846YLKC8P8S upload=1DFMY1XM0VMW tag=CSBWM4NPR1FR type=write size=3523619 2024-09-12T17:47:17.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.207+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=A89KD78GTNRA type=del size=1454985 2024-09-12T17:47:17.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.211+0000 7f68bc0598c0 1 < completed write operation key=UMQLPH9XGWRZ tag=EB6DIOLEC82S type=write size=966837 2024-09-12T17:47:17.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.219+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~7UTNLZFKYIXR.0 size=400334 2024-09-12T17:47:17.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.219+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=7UTNLZFKYIXR tag=PJ8NZJDBK08T type=write size=1448910 2024-09-12T17:47:17.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.223+0000 7f68bc0598c0 1 < completed write operation key=RTY1OT2PSAAY tag=24RTVCLSMAVS type=write size=334628 2024-09-12T17:47:17.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.227+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~9NZY5S4RGO7Y.0 size=1048576 2024-09-12T17:47:17.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.231+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~9NZY5S4RGO7Y.1 size=1048576 2024-09-12T17:47:17.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.235+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~9NZY5S4RGO7Y.2 size=470493 2024-09-12T17:47:17.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.235+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=9NZY5S4RGO7Y tag=UTZ398S0JHBT type=write size=3616221 2024-09-12T17:47:17.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.239+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~7HXKSDHH3ODW.0 size=1048576 2024-09-12T17:47:17.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.239+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~7HXKSDHH3ODW.1 size=459003 2024-09-12T17:47:17.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.247+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=7HXKSDHH3ODW tag=7DPDZVS28CN5 type=write size=2556155 2024-09-12T17:47:17.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.251+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=MUO2J2Z8LBE8 type=del size=995457 2024-09-12T17:47:17.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.255+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~LH2WVI1WZM5G.0 size=1048576 2024-09-12T17:47:17.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.255+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~LH2WVI1WZM5G.1 size=364775 2024-09-12T17:47:17.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.263+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=LH2WVI1WZM5G tag=TX382MSDY9LK type=write size=2461927 2024-09-12T17:47:17.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.267+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~WPAKU6P0N24B.0 size=562911 2024-09-12T17:47:17.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.267+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=WPAKU6P0N24B tag=DGCI800PDRDP type=write size=1611487 2024-09-12T17:47:17.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.271+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=A2XLMF7DVOLG type=del 2024-09-12T17:47:17.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.275+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=KB1AADV4G1IY type=del size=3313807 2024-09-12T17:47:17.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.279+0000 7f68bc0598c0 1 < completed write operation key=06W7N11O7F1I tag=ZWFLY6S9WSQP type=write size=477109 2024-09-12T17:47:17.285 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.283+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=D99NGX8O0MXX type=del size=4017428 2024-09-12T17:47:17.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.283+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~3WY12LVNB7PD.0 size=1048576 2024-09-12T17:47:17.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.287+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~3WY12LVNB7PD.1 size=1048576 2024-09-12T17:47:17.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.291+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~3WY12LVNB7PD.2 size=700339 2024-09-12T17:47:17.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.299+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=3WY12LVNB7PD tag=B6O5B23R79DA type=write size=3846067 2024-09-12T17:47:17.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.303+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=EVGR15XIYVID type=del size=3677508 2024-09-12T17:47:17.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.303+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=0GPEEIW58WSJ type=del 2024-09-12T17:47:17.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.307+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=7KNEXEUTRODW type=write size=283701 2024-09-12T17:47:17.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.311+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=1H6609ODGB2L type=del 2024-09-12T17:47:17.321 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.319+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~7WINXJ6F1V8S.0 size=1048576 2024-09-12T17:47:17.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.319+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~7WINXJ6F1V8S.1 size=574883 2024-09-12T17:47:17.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.319+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=7WINXJ6F1V8S tag=2ZYU6WXOWUS2 type=write size=2672035 2024-09-12T17:47:17.331 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.327+0000 7f68bc0598c0 1 < suggested remove operation key=W8JEQ5NOIE6O tag=EV3NKB4XX2F9 type=del 2024-09-12T17:47:17.334 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.331+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=AJDIO2M3TPM8 type=del size=1345665 2024-09-12T17:47:17.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.335+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~BI4XLR9JZR59.0 size=1048576 2024-09-12T17:47:17.340 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.335+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~BI4XLR9JZR59.1 size=1048576 2024-09-12T17:47:17.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.339+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~BI4XLR9JZR59.2 size=1030956 2024-09-12T17:47:17.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.343+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=BI4XLR9JZR59 tag=P9NIENU7M3XL type=write size=4176684 2024-09-12T17:47:17.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.347+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=L38A8XY7VYKP type=del size=3696243 2024-09-12T17:47:17.356 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.351+0000 7f68bc0598c0 1 < suggested remove operation key=OG0V0I1SDHG5 tag=5VSWX3TBQHW8 type=del 2024-09-12T17:47:17.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.359+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~VLONB4KFH4P2.0 size=660997 2024-09-12T17:47:17.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.359+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=VLONB4KFH4P2 tag=LE4IF45BL50U type=write size=1709573 2024-09-12T17:47:17.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.359+0000 7f68bc0598c0 1 < canceled part key=_multipart_9XK00RPA6Q38.2~GICLJA2IN97C.0 size=1048576 2024-09-12T17:47:17.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.359+0000 7f68bc0598c0 1 < canceled part key=_multipart_9XK00RPA6Q38.2~GICLJA2IN97C.1 size=828210 2024-09-12T17:47:17.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.363+0000 7f68bc0598c0 1 < canceled multipart upload key=9XK00RPA6Q38 upload=GICLJA2IN97C tag=FGWZVKTGPR3E type=write size=2925362 2024-09-12T17:47:17.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.367+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=OK7VTPPW81Y8 type=del size=1629098 2024-09-12T17:47:17.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.375+0000 7f68bc0598c0 1 < suggested remove operation key=06W7N11O7F1I tag=N42IRL15BZW7 type=del 2024-09-12T17:47:17.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.379+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=1DWAN00O887Y type=write size=166395 2024-09-12T17:47:17.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.383+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=BVBPUZAFTDOA type=del 2024-09-12T17:47:17.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.387+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=YZT41EV1CB8S type=write size=640795 2024-09-12T17:47:17.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.391+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=A89KD78GTNRA type=del 2024-09-12T17:47:17.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.391+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=Y38BTHJNJD6K type=del size=3221391 2024-09-12T17:47:17.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.395+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~7UTNLZFKYIXR.0 size=400334 2024-09-12T17:47:17.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.403+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=7UTNLZFKYIXR tag=PJ8NZJDBK08T type=write size=1448910 2024-09-12T17:47:17.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.403+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=USSIN32OY8QX type=del size=931168 2024-09-12T17:47:17.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.407+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~9NZY5S4RGO7Y.0 size=1048576 2024-09-12T17:47:17.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.411+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~9NZY5S4RGO7Y.1 size=1048576 2024-09-12T17:47:17.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.415+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~9NZY5S4RGO7Y.2 size=470493 2024-09-12T17:47:17.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.419+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=9NZY5S4RGO7Y tag=UTZ398S0JHBT type=write size=3616221 2024-09-12T17:47:17.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.423+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=KI8TZFJHG2XW type=del size=4127966 2024-09-12T17:47:17.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.427+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=MUO2J2Z8LBE8 type=del 2024-09-12T17:47:17.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.435+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~U5GFH9U39YVF.0 size=295481 2024-09-12T17:47:17.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.435+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=U5GFH9U39YVF tag=N0MTN8YU7LMQ type=write size=1344057 2024-09-12T17:47:17.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.439+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~WPAKU6P0N24B.0 size=562911 2024-09-12T17:47:17.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.447+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=WPAKU6P0N24B tag=DGCI800PDRDP type=write size=1611487 2024-09-12T17:47:17.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.455+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~XW6KVC7CIMX7.0 size=1048576 2024-09-12T17:47:17.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~XW6KVC7CIMX7.1 size=949695 2024-09-12T17:47:17.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.459+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=XW6KVC7CIMX7 tag=4S0HURLEN65K type=write size=3046847 2024-09-12T17:47:17.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.463+0000 7f68bc0598c0 1 < suggested update operation key=F4F4P4L8K5D9 tag=KB1AADV4G1IY type=del size=3313807 2024-09-12T17:47:17.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.467+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=ARU1R9ZNMEHG type=del size=2687019 2024-09-12T17:47:17.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.471+0000 7f68bc0598c0 1 < suggested update operation key=RTY1OT2PSAAY tag=D99NGX8O0MXX type=del size=4017428 2024-09-12T17:47:17.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.479+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~UF8SK4BI39ZC.0 size=1048576 2024-09-12T17:47:17.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.479+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~UF8SK4BI39ZC.1 size=1011380 2024-09-12T17:47:17.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.479+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=UF8SK4BI39ZC tag=PLQA2ZBSTVO1 type=write size=3108532 2024-09-12T17:47:17.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.483+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=EVGR15XIYVID type=del 2024-09-12T17:47:17.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.487+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=5KSPV025XHFQ type=write size=934862 2024-09-12T17:47:17.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.491+0000 7f68bc0598c0 1 < completed write operation key=DMJZUQJ7IY60 tag=7KNEXEUTRODW type=write size=283701 2024-09-12T17:47:17.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.495+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~FQ0FDT6VUPBB.0 size=764969 2024-09-12T17:47:17.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.495+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=FQ0FDT6VUPBB tag=G0DB8W0RX0A4 type=write size=1813545 2024-09-12T17:47:17.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.499+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~7WINXJ6F1V8S.0 size=1048576 2024-09-12T17:47:17.505 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.503+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~7WINXJ6F1V8S.1 size=574883 2024-09-12T17:47:17.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.507+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=7WINXJ6F1V8S tag=2ZYU6WXOWUS2 type=write size=2672035 2024-09-12T17:47:17.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.511+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~EO70OSXC0ND7.0 size=43266 2024-09-12T17:47:17.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.511+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=EO70OSXC0ND7 tag=8ZG7CLR11PK7 type=write size=1091842 2024-09-12T17:47:17.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.515+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=AJDIO2M3TPM8 type=del 2024-09-12T17:47:17.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.519+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=0AKNZ870ZH9X type=del size=3988432 2024-09-12T17:47:17.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.523+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=L38A8XY7VYKP type=del 2024-09-12T17:47:17.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.523+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=2NM35NUXEELR type=del size=943873 2024-09-12T17:47:17.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.527+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~VLONB4KFH4P2.0 size=660997 2024-09-12T17:47:17.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.535+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=VLONB4KFH4P2 tag=LE4IF45BL50U type=write size=1709573 2024-09-12T17:47:17.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.535+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=527XD7K75UAU type=del size=2125619 2024-09-12T17:47:17.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.539+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=OK7VTPPW81Y8 type=del 2024-09-12T17:47:17.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.547+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~OCC9NLKM6E8K.0 size=631786 2024-09-12T17:47:17.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.547+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=OCC9NLKM6E8K tag=0RTF8OZLTPPN type=write size=1680362 2024-09-12T17:47:17.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.551+0000 7f68bc0598c0 1 < suggested remove operation key=6J677S46BXS4 tag=1DWAN00O887Y type=write 2024-09-12T17:47:17.558 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.555+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=P3VA1W4H49U3 type=del size=3321746 2024-09-12T17:47:17.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.559+0000 7f68bc0598c0 1 < completed write operation key=UOW521GPXBQ0 tag=YZT41EV1CB8S type=write size=640795 2024-09-12T17:47:17.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.559+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=BRQU5SH5JK9E type=del size=185073 2024-09-12T17:47:17.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.567+0000 7f68bc0598c0 1 < suggested update operation key=WUGDIFCHNL90 tag=Y38BTHJNJD6K type=del size=3221391 2024-09-12T17:47:17.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.571+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~EM171TZLWEBZ.0 size=1048576 2024-09-12T17:47:17.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.575+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~EM171TZLWEBZ.1 size=1048576 2024-09-12T17:47:17.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.579+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~EM171TZLWEBZ.2 size=100557 2024-09-12T17:47:17.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.579+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=EM171TZLWEBZ tag=TDK46TLQGLMB type=write size=3246285 2024-09-12T17:47:17.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.583+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=USSIN32OY8QX type=del 2024-09-12T17:47:17.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.583+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=Y7MHITGZQ56O type=del size=3602789 2024-09-12T17:47:17.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.587+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=KI8TZFJHG2XW type=del 2024-09-12T17:47:17.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.591+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=0POGMAOOV0XK type=del size=3808376 2024-09-12T17:47:17.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.595+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~U5GFH9U39YVF.0 size=295481 2024-09-12T17:47:17.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.599+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=U5GFH9U39YVF tag=N0MTN8YU7LMQ type=write size=1344057 2024-09-12T17:47:17.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~LTE8O2TUB4DZ.0 size=328548 2024-09-12T17:47:17.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.607+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=LTE8O2TUB4DZ tag=N9Y4CAU4F4O6 type=write size=1377124 2024-09-12T17:47:17.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.611+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~XW6KVC7CIMX7.0 size=1048576 2024-09-12T17:47:17.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.611+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~XW6KVC7CIMX7.1 size=949695 2024-09-12T17:47:17.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.619+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=XW6KVC7CIMX7 tag=4S0HURLEN65K type=write size=3046847 2024-09-12T17:47:17.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.623+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~D26Q9P4HQR9N.0 size=1048576 2024-09-12T17:47:17.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.627+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~D26Q9P4HQR9N.1 size=283958 2024-09-12T17:47:17.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.627+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=D26Q9P4HQR9N tag=4H1NNXGY2744 type=write size=2381110 2024-09-12T17:47:17.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.631+0000 7f68bc0598c0 -1 < failed to complete operation key=WUGDIFCHNL90 tag=ARU1R9ZNMEHG type=del size=2687019: (22) Invalid argument 2024-09-12T17:47:17.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.631+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=013F5A2X7Z5A type=write size=63770 2024-09-12T17:47:17.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.631+0000 7f68bc0598c0 1 < canceled part key=_multipart_P8T1VX1XFJ31.2~UF8SK4BI39ZC.0 size=1048576 2024-09-12T17:47:17.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.635+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~UF8SK4BI39ZC.1 size=1011380 2024-09-12T17:47:17.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.639+0000 7f68bc0598c0 1 < canceled multipart upload key=P8T1VX1XFJ31 upload=UF8SK4BI39ZC tag=PLQA2ZBSTVO1 type=write size=3108532 2024-09-12T17:47:17.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.647+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~9YNZFCTEU8UL.0 size=983457 2024-09-12T17:47:17.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.647+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=9YNZFCTEU8UL tag=BQ4PMXZZV0G2 type=write size=2032033 2024-09-12T17:47:17.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.651+0000 7f68bc0598c0 1 < completed write operation key=BKAT5SGAC5Z8 tag=5KSPV025XHFQ type=write size=934862 2024-09-12T17:47:17.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.659+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~4AB3PWEUQ8UP.0 size=719784 2024-09-12T17:47:17.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.659+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=4AB3PWEUQ8UP tag=DPXXH6UM8N2U type=write size=1768360 2024-09-12T17:47:17.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.659+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~FQ0FDT6VUPBB.0 size=764969 2024-09-12T17:47:17.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.667+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=FQ0FDT6VUPBB tag=G0DB8W0RX0A4 type=write size=1813545 2024-09-12T17:47:17.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.671+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~V0G9QH950BVQ.0 size=634413 2024-09-12T17:47:17.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.671+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=V0G9QH950BVQ tag=4PBGDVRM6S2X type=write size=1682989 2024-09-12T17:47:17.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.675+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~EO70OSXC0ND7.0 size=43266 2024-09-12T17:47:17.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.679+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=EO70OSXC0ND7 tag=8ZG7CLR11PK7 type=write size=1091842 2024-09-12T17:47:17.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.683+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=FCIVOI4DJFUB type=del size=3686607 2024-09-12T17:47:17.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.687+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=0AKNZ870ZH9X type=del 2024-09-12T17:47:17.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.691+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=TGPK1130XRTA type=del size=1891089 2024-09-12T17:47:17.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.691+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=2NM35NUXEELR type=del 2024-09-12T17:47:17.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.695+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=DY4NBT6SZQ4W type=del size=917401 2024-09-12T17:47:17.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.699+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=527XD7K75UAU type=del 2024-09-12T17:47:17.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.703+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=990BITNF2VD0 type=del size=1690635 2024-09-12T17:47:17.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.703+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~OCC9NLKM6E8K.0 size=631786 2024-09-12T17:47:17.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.711+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=OCC9NLKM6E8K tag=0RTF8OZLTPPN type=write size=1680362 2024-09-12T17:47:17.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.715+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~0H7T3AZO9RM9.0 size=1048576 2024-09-12T17:47:17.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.719+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~0H7T3AZO9RM9.1 size=256445 2024-09-12T17:47:17.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.719+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=0H7T3AZO9RM9 tag=DI5FP512DE6O type=write size=2353597 2024-09-12T17:47:17.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.719+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=P3VA1W4H49U3 type=del 2024-09-12T17:47:17.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.723+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=N8LDGBSLC2UB type=write size=619710 2024-09-12T17:47:17.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.727+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=BRQU5SH5JK9E type=del 2024-09-12T17:47:17.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.731+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=NEK7UGX54XNX type=del size=523131 2024-09-12T17:47:17.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.731+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~EM171TZLWEBZ.0 size=1048576 2024-09-12T17:47:17.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.735+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~EM171TZLWEBZ.1 size=1048576 2024-09-12T17:47:17.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.739+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~EM171TZLWEBZ.2 size=100557 2024-09-12T17:47:17.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.743+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=EM171TZLWEBZ tag=TDK46TLQGLMB type=write size=3246285 2024-09-12T17:47:17.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.751+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~8MESQ0TQVU3U.0 size=1048576 2024-09-12T17:47:17.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.755+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~8MESQ0TQVU3U.1 size=478989 2024-09-12T17:47:17.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.755+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=8MESQ0TQVU3U tag=091NJSOTCD1P type=write size=2576141 2024-09-12T17:47:17.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.759+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=Y7MHITGZQ56O type=del 2024-09-12T17:47:17.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.763+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~Z9ZBGWORDJI0.0 size=1048576 2024-09-12T17:47:17.769 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.767+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~Z9ZBGWORDJI0.1 size=1048576 2024-09-12T17:47:17.771 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.767+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~Z9ZBGWORDJI0.2 size=989248 2024-09-12T17:47:17.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.767+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=Z9ZBGWORDJI0 tag=3EIQRGP21IUL type=write size=4134976 2024-09-12T17:47:17.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.771+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=0POGMAOOV0XK type=del 2024-09-12T17:47:17.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.775+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=Q8XYMXR3DQ6F type=del size=643814 2024-09-12T17:47:17.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.775+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~LTE8O2TUB4DZ.0 size=328548 2024-09-12T17:47:17.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.779+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=LTE8O2TUB4DZ tag=N9Y4CAU4F4O6 type=write size=1377124 2024-09-12T17:47:17.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.787+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~0TQ48GTVIAN2.0 size=980624 2024-09-12T17:47:17.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.787+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=0TQ48GTVIAN2 tag=AXOQX6FQHU0K type=write size=2029200 2024-09-12T17:47:17.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.787+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~D26Q9P4HQR9N.0 size=1048576 2024-09-12T17:47:17.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.791+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~D26Q9P4HQR9N.1 size=283958 2024-09-12T17:47:17.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.795+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=D26Q9P4HQR9N tag=4H1NNXGY2744 type=write size=2381110 2024-09-12T17:47:17.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.799+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=MUQ3CSY9IPM2 type=del size=2263093 2024-09-12T17:47:17.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.803+0000 7f68bc0598c0 1 < completed write operation key=BKAT5SGAC5Z8 tag=013F5A2X7Z5A type=write size=63770 2024-09-12T17:47:17.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.807+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=MP5TFICGWNBJ type=del size=3466481 2024-09-12T17:47:17.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.811+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~9YNZFCTEU8UL.0 size=983457 2024-09-12T17:47:17.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.815+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=9YNZFCTEU8UL tag=BQ4PMXZZV0G2 type=write size=2032033 2024-09-12T17:47:17.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.815+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=I58U8R9OWZ1J type=del size=2889298 2024-09-12T17:47:17.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.819+0000 7f68bc0598c0 1 < canceled part key=_multipart_3JPRQXKB5K3W.2~4AB3PWEUQ8UP.0 size=719784 2024-09-12T17:47:17.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.823+0000 7f68bc0598c0 1 < canceled multipart upload key=3JPRQXKB5K3W upload=4AB3PWEUQ8UP tag=DPXXH6UM8N2U type=write size=1768360 2024-09-12T17:47:17.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.823+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=FO5VSQB1BI2S type=del size=545289 2024-09-12T17:47:17.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.827+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~V0G9QH950BVQ.0 size=634413 2024-09-12T17:47:17.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.831+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=V0G9QH950BVQ tag=4PBGDVRM6S2X type=write size=1682989 2024-09-12T17:47:17.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~GQD0QDYW362G.0 size=1048576 2024-09-12T17:47:17.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~GQD0QDYW362G.1 size=1048576 2024-09-12T17:47:17.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.839+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~GQD0QDYW362G.2 size=333631 2024-09-12T17:47:17.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.839+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=GQD0QDYW362G tag=0XE43DK33QHN type=write size=3479359 2024-09-12T17:47:17.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.843+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=FCIVOI4DJFUB type=del 2024-09-12T17:47:17.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.847+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~DZMIXPIOSJSO.0 size=1048576 2024-09-12T17:47:17.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.847+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~DZMIXPIOSJSO.1 size=1048576 2024-09-12T17:47:17.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.851+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~DZMIXPIOSJSO.2 size=902716 2024-09-12T17:47:17.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.851+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=DZMIXPIOSJSO tag=SSI8Z28I3QX3 type=write size=4048444 2024-09-12T17:47:17.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.851+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=TGPK1130XRTA type=del 2024-09-12T17:47:17.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.855+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=PVZR8XCA133S type=del size=173882 2024-09-12T17:47:17.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.855+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=DY4NBT6SZQ4W type=del 2024-09-12T17:47:17.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.859+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=YIAWYF9XOKJV type=write size=947600 2024-09-12T17:47:17.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.859+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=990BITNF2VD0 type=del 2024-09-12T17:47:17.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.863+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=02Z6JZGAH0J9 type=write size=110024 2024-09-12T17:47:17.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.863+0000 7f68bc0598c0 1 < canceled part key=_multipart_XGJSQJ2IXJDK.2~0H7T3AZO9RM9.0 size=1048576 2024-09-12T17:47:17.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.867+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~0H7T3AZO9RM9.1 size=256445 2024-09-12T17:47:17.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.871+0000 7f68bc0598c0 1 < canceled multipart upload key=XGJSQJ2IXJDK upload=0H7T3AZO9RM9 tag=DI5FP512DE6O type=write size=2353597 2024-09-12T17:47:17.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.871+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=OW1U0ZP3ZN7U type=write size=78550 2024-09-12T17:47:17.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.879+0000 7f68bc0598c0 1 < suggested update operation key=3JPRQXKB5K3W tag=N8LDGBSLC2UB type=write size=619710 2024-09-12T17:47:17.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.879+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=TFAO4PX54PEL type=del size=1005997 2024-09-12T17:47:17.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.883+0000 7f68bc0598c0 1 < suggested remove operation key=0XFYVNU2Q7KO tag=NEK7UGX54XNX type=del 2024-09-12T17:47:17.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~ZKOE54FJ2LII.0 size=1048576 2024-09-12T17:47:17.896 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~ZKOE54FJ2LII.1 size=1048576 2024-09-12T17:47:17.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.895+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~ZKOE54FJ2LII.2 size=854130 2024-09-12T17:47:17.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.895+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=ZKOE54FJ2LII tag=LS74MMP82NU6 type=write size=3999858 2024-09-12T17:47:17.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.895+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~8MESQ0TQVU3U.0 size=1048576 2024-09-12T17:47:17.902 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.899+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~8MESQ0TQVU3U.1 size=478989 2024-09-12T17:47:17.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.903+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=8MESQ0TQVU3U tag=091NJSOTCD1P type=write size=2576141 2024-09-12T17:47:17.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.907+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~KR1FPEVPLIP6.0 size=129918 2024-09-12T17:47:17.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.907+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=KR1FPEVPLIP6 tag=BB903RJL8Y5O type=write size=1178494 2024-09-12T17:47:17.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.911+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~Z9ZBGWORDJI0.0 size=1048576 2024-09-12T17:47:17.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.911+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~Z9ZBGWORDJI0.1 size=1048576 2024-09-12T17:47:17.916 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.911+0000 7f68bc0598c0 1 < canceled part key=_multipart_57O6H52NHYOL.2~Z9ZBGWORDJI0.2 size=989248 2024-09-12T17:47:17.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.915+0000 7f68bc0598c0 1 < canceled multipart upload key=57O6H52NHYOL upload=Z9ZBGWORDJI0 tag=3EIQRGP21IUL type=write size=4134976 2024-09-12T17:47:17.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.919+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=MF3XCND9BNNL type=del size=3537603 2024-09-12T17:47:17.924 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.919+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=Q8XYMXR3DQ6F type=del 2024-09-12T17:47:17.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.927+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~IQAJT75VSWHC.0 size=1022574 2024-09-12T17:47:17.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.927+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=IQAJT75VSWHC tag=GTYE7LPMT0Q3 type=write size=2071150 2024-09-12T17:47:17.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.927+0000 7f68bc0598c0 1 < canceled part key=_multipart_P8T1VX1XFJ31.2~0TQ48GTVIAN2.0 size=980624 2024-09-12T17:47:17.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.931+0000 7f68bc0598c0 1 < canceled multipart upload key=P8T1VX1XFJ31 upload=0TQ48GTVIAN2 tag=AXOQX6FQHU0K type=write size=2029200 2024-09-12T17:47:17.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.935+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~UTMMM14FBP4G.0 size=1048576 2024-09-12T17:47:17.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.935+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~UTMMM14FBP4G.1 size=1048576 2024-09-12T17:47:17.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.939+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~UTMMM14FBP4G.2 size=539556 2024-09-12T17:47:17.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.939+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=UTMMM14FBP4G tag=TL0BJQ97JE90 type=write size=3685284 2024-09-12T17:47:17.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.943+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=MUQ3CSY9IPM2 type=del 2024-09-12T17:47:17.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.947+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~C93HTYTYNIL8.0 size=1048576 2024-09-12T17:47:17.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.947+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~C93HTYTYNIL8.1 size=1048576 2024-09-12T17:47:17.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.951+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~C93HTYTYNIL8.2 size=73114 2024-09-12T17:47:17.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.951+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=C93HTYTYNIL8 tag=1UIVMUCUOXV4 type=write size=3218842 2024-09-12T17:47:17.957 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.955+0000 7f68bc0598c0 1 < canceled operation key=WPQ755ODAFNT tag=MP5TFICGWNBJ type=del size=3466481 2024-09-12T17:47:17.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.955+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=A217XJWUOHZU type=del size=3329045 2024-09-12T17:47:17.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.959+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=I58U8R9OWZ1J type=del 2024-09-12T17:47:17.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.963+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~28MADUH4T3F8.0 size=267745 2024-09-12T17:47:17.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.963+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=28MADUH4T3F8 tag=8SKODK8OFZXZ type=write size=1316321 2024-09-12T17:47:17.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.967+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=FO5VSQB1BI2S type=del 2024-09-12T17:47:17.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.971+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~835J9GS8519P.0 size=620596 2024-09-12T17:47:17.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.971+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=835J9GS8519P tag=DQDL2MUV4RRC type=write size=1669172 2024-09-12T17:47:17.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.975+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~GQD0QDYW362G.0 size=1048576 2024-09-12T17:47:17.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.979+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~GQD0QDYW362G.1 size=1048576 2024-09-12T17:47:17.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.979+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~GQD0QDYW362G.2 size=333631 2024-09-12T17:47:17.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.983+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=GQD0QDYW362G tag=0XE43DK33QHN type=write size=3479359 2024-09-12T17:47:17.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.987+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=YPJLJYD3SEGB type=del size=2639541 2024-09-12T17:47:17.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.991+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~DZMIXPIOSJSO.0 size=1048576 2024-09-12T17:47:17.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.995+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~DZMIXPIOSJSO.1 size=1048576 2024-09-12T17:47:18.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:17.999+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~DZMIXPIOSJSO.2 size=902716 2024-09-12T17:47:18.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.007+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=DZMIXPIOSJSO tag=SSI8Z28I3QX3 type=write size=4048444 2024-09-12T17:47:18.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.007+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=8H580276NL6O type=write size=921962 2024-09-12T17:47:18.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.015+0000 7f68bc0598c0 1 < suggested update operation key=QGO5SPFPT548 tag=PVZR8XCA133S type=del size=173882 2024-09-12T17:47:18.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.019+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~3386UN2TDSK6.0 size=1048576 2024-09-12T17:47:18.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.023+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~3386UN2TDSK6.1 size=1048576 2024-09-12T17:47:18.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.023+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~3386UN2TDSK6.2 size=657363 2024-09-12T17:47:18.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.023+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=3386UN2TDSK6 tag=U2Q68B7NN7GG type=write size=3803091 2024-09-12T17:47:18.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.027+0000 7f68bc0598c0 1 < completed write operation key=06W7N11O7F1I tag=YIAWYF9XOKJV type=write size=947600 2024-09-12T17:47:18.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.031+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=A2977AZCLXQT type=del size=2868539 2024-09-12T17:47:18.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.031+0000 7f68bc0598c0 -1 < failed to complete operation key=0XFYVNU2Q7KO tag=02Z6JZGAH0J9 type=write size=110024: (22) Invalid argument 2024-09-12T17:47:18.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.035+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=OSFTE9TFJRI7 type=del size=1783262 2024-09-12T17:47:18.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.039+0000 7f68bc0598c0 1 < completed write operation key=8P0EWBVO0BQD tag=OW1U0ZP3ZN7U type=write size=78550 2024-09-12T17:47:18.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.043+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=E8FFL2FO5ZHK type=del size=428013 2024-09-12T17:47:18.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.043+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=TFAO4PX54PEL type=del 2024-09-12T17:47:18.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.051+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~1P7FDMCSA6UW.0 size=1048576 2024-09-12T17:47:18.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.051+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~1P7FDMCSA6UW.1 size=621531 2024-09-12T17:47:18.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.051+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=1P7FDMCSA6UW tag=9PZPFO1XCP4O type=write size=2718683 2024-09-12T17:47:18.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.055+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~ZKOE54FJ2LII.0 size=1048576 2024-09-12T17:47:18.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.055+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~ZKOE54FJ2LII.1 size=1048576 2024-09-12T17:47:18.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.059+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~ZKOE54FJ2LII.2 size=854130 2024-09-12T17:47:18.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.063+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=ZKOE54FJ2LII tag=LS74MMP82NU6 type=write size=3999858 2024-09-12T17:47:18.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.071+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~YZ3A4VYDEYPD.0 size=1048576 2024-09-12T17:47:18.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.071+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~YZ3A4VYDEYPD.1 size=1048576 2024-09-12T17:47:18.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.075+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~YZ3A4VYDEYPD.2 size=51121 2024-09-12T17:47:18.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.075+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=YZ3A4VYDEYPD tag=9TZID4PS61S9 type=write size=3196849 2024-09-12T17:47:18.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.075+0000 7f68bc0598c0 1 < canceled part key=_multipart_KW3VWTA43PBM.2~KR1FPEVPLIP6.0 size=129918 2024-09-12T17:47:18.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.079+0000 7f68bc0598c0 1 < canceled multipart upload key=KW3VWTA43PBM upload=KR1FPEVPLIP6 tag=BB903RJL8Y5O type=write size=1178494 2024-09-12T17:47:18.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.083+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=S8AFFIF239Z2 type=del size=596522 2024-09-12T17:47:18.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.083+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=MF3XCND9BNNL type=del 2024-09-12T17:47:18.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.087+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=KQ13IPXZJOOI type=del size=3304924 2024-09-12T17:47:18.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.091+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~IQAJT75VSWHC.0 size=1022574 2024-09-12T17:47:18.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.095+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=IQAJT75VSWHC tag=GTYE7LPMT0Q3 type=write size=2071150 2024-09-12T17:47:18.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.099+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~477018LNBZBT.0 size=1048576 2024-09-12T17:47:18.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.103+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~477018LNBZBT.1 size=1048576 2024-09-12T17:47:18.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.103+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~477018LNBZBT.2 size=953162 2024-09-12T17:47:18.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.103+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=477018LNBZBT tag=V1H8R4QKK0S4 type=write size=4098890 2024-09-12T17:47:18.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.107+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~UTMMM14FBP4G.0 size=1048576 2024-09-12T17:47:18.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.111+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~UTMMM14FBP4G.1 size=1048576 2024-09-12T17:47:18.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.115+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~UTMMM14FBP4G.2 size=539556 2024-09-12T17:47:18.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.119+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=UTMMM14FBP4G tag=TL0BJQ97JE90 type=write size=3685284 2024-09-12T17:47:18.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.119+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=GG7KQBM8B5DP type=write size=619512 2024-09-12T17:47:18.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.123+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~C93HTYTYNIL8.0 size=1048576 2024-09-12T17:47:18.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.127+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~C93HTYTYNIL8.1 size=1048576 2024-09-12T17:47:18.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.131+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~C93HTYTYNIL8.2 size=73114 2024-09-12T17:47:18.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.135+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=C93HTYTYNIL8 tag=1UIVMUCUOXV4 type=write size=3218842 2024-09-12T17:47:18.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.139+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=F9EEWNILDRQ7 type=del size=1624517 2024-09-12T17:47:18.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.139+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=A217XJWUOHZU type=del 2024-09-12T17:47:18.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.143+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=R1QS5J8DQYJW type=del size=1449875 2024-09-12T17:47:18.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.147+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~28MADUH4T3F8.0 size=267745 2024-09-12T17:47:18.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.151+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=28MADUH4T3F8 tag=8SKODK8OFZXZ type=write size=1316321 2024-09-12T17:47:18.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.155+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~F4LUDX616AHB.0 size=1048576 2024-09-12T17:47:18.161 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.159+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~F4LUDX616AHB.1 size=1048576 2024-09-12T17:47:18.163 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.159+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~F4LUDX616AHB.2 size=807252 2024-09-12T17:47:18.163 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.159+0000 7f68bc0598c0 1 > prepared multipart upload key=BKAT5SGAC5Z8 upload=F4LUDX616AHB tag=IMUAYJE9794R type=write size=3952980 2024-09-12T17:47:18.163 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.159+0000 7f68bc0598c0 1 < canceled part key=_multipart_WPQ755ODAFNT.2~835J9GS8519P.0 size=620596 2024-09-12T17:47:18.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.163+0000 7f68bc0598c0 1 < canceled multipart upload key=WPQ755ODAFNT upload=835J9GS8519P tag=DQDL2MUV4RRC type=write size=1669172 2024-09-12T17:47:18.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.167+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=T27EAQ8997IH type=del size=83088 2024-09-12T17:47:18.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.171+0000 7f68bc0598c0 1 < suggested remove operation key=HGY9WK7MKCYS tag=YPJLJYD3SEGB type=del 2024-09-12T17:47:18.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.175+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=POUF02FO7DES type=write size=910415 2024-09-12T17:47:18.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.175+0000 7f68bc0598c0 1 < completed write operation key=W8JEQ5NOIE6O tag=8H580276NL6O type=write size=921962 2024-09-12T17:47:18.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.179+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~KRRBPWGVEGK7.0 size=424385 2024-09-12T17:47:18.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.179+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=KRRBPWGVEGK7 tag=1182MHZAS29W type=write size=1472961 2024-09-12T17:47:18.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.183+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~3386UN2TDSK6.0 size=1048576 2024-09-12T17:47:18.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.187+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~3386UN2TDSK6.1 size=1048576 2024-09-12T17:47:18.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.187+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~3386UN2TDSK6.2 size=657363 2024-09-12T17:47:18.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.191+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=3386UN2TDSK6 tag=U2Q68B7NN7GG type=write size=3803091 2024-09-12T17:47:18.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.195+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~3XLFPS2VIMKS.0 size=403629 2024-09-12T17:47:18.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.195+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=3XLFPS2VIMKS tag=74LX39GDMTLP type=write size=1452205 2024-09-12T17:47:18.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.199+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=A2977AZCLXQT type=del 2024-09-12T17:47:18.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.203+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=9W3ZVD16LEOU type=del size=2143762 2024-09-12T17:47:18.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.203+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=OSFTE9TFJRI7 type=del 2024-09-12T17:47:18.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.207+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~Q6PCTL4LN9EQ.0 size=1048576 2024-09-12T17:47:18.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~Q6PCTL4LN9EQ.1 size=1048576 2024-09-12T17:47:18.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~Q6PCTL4LN9EQ.2 size=350193 2024-09-12T17:47:18.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.211+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=Q6PCTL4LN9EQ tag=OCCG4QK8YAQQ type=write size=3495921 2024-09-12T17:47:18.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.215+0000 7f68bc0598c0 1 < suggested update operation key=7XH1E2GEH9O2 tag=E8FFL2FO5ZHK type=del size=428013 2024-09-12T17:47:18.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.219+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~HMISCMUR3IAV.0 size=1048576 2024-09-12T17:47:18.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.223+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~HMISCMUR3IAV.1 size=1048576 2024-09-12T17:47:18.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.223+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~HMISCMUR3IAV.2 size=75504 2024-09-12T17:47:18.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.223+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=HMISCMUR3IAV tag=A3RL61WN9OXU type=write size=3221232 2024-09-12T17:47:18.230 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.227+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~1P7FDMCSA6UW.0 size=1048576 2024-09-12T17:47:18.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.227+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~1P7FDMCSA6UW.1 size=621531 2024-09-12T17:47:18.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.235+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=1P7FDMCSA6UW tag=9PZPFO1XCP4O type=write size=2718683 2024-09-12T17:47:18.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.235+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=R1VPJQZSIE4N type=del size=1474619 2024-09-12T17:47:18.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.239+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~YZ3A4VYDEYPD.0 size=1048576 2024-09-12T17:47:18.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.239+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~YZ3A4VYDEYPD.1 size=1048576 2024-09-12T17:47:18.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.243+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~YZ3A4VYDEYPD.2 size=51121 2024-09-12T17:47:18.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.247+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=YZ3A4VYDEYPD tag=9TZID4PS61S9 type=write size=3196849 2024-09-12T17:47:18.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.251+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=UA1QZRO9205K type=del size=71142 2024-09-12T17:47:18.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.255+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=S8AFFIF239Z2 type=del 2024-09-12T17:47:18.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.255+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=NROPK8DAHJG7 type=del size=311882 2024-09-12T17:47:18.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.259+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=KQ13IPXZJOOI type=del 2024-09-12T17:47:18.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.263+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=7B7C3HIC4E4W type=del size=1437435 2024-09-12T17:47:18.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.263+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~477018LNBZBT.0 size=1048576 2024-09-12T17:47:18.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.263+0000 7f68bc0598c0 1 < canceled part key=_multipart_WUGDIFCHNL90.2~477018LNBZBT.1 size=1048576 2024-09-12T17:47:18.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.267+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~477018LNBZBT.2 size=953162 2024-09-12T17:47:18.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.271+0000 7f68bc0598c0 1 < canceled multipart upload key=WUGDIFCHNL90 upload=477018LNBZBT tag=V1H8R4QKK0S4 type=write size=4098890 2024-09-12T17:47:18.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.275+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=5KVNBX6DG2VW type=write size=154799 2024-09-12T17:47:18.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.275+0000 7f68bc0598c0 1 < canceled operation key=UOW521GPXBQ0 tag=GG7KQBM8B5DP type=write size=619512 2024-09-12T17:47:18.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.279+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=44QOVYHSD6LY type=del size=340179 2024-09-12T17:47:18.284 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.279+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=F9EEWNILDRQ7 type=del 2024-09-12T17:47:18.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.283+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=VHXLK9KBXUQO type=del size=2938813 2024-09-12T17:47:18.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.287+0000 7f68bc0598c0 1 < suggested update operation key=UMQLPH9XGWRZ tag=R1QS5J8DQYJW type=del size=1449875 2024-09-12T17:47:18.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.291+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=EKHC0IJT7PYH type=del size=2343308 2024-09-12T17:47:18.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.291+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~F4LUDX616AHB.0 size=1048576 2024-09-12T17:47:18.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.295+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~F4LUDX616AHB.1 size=1048576 2024-09-12T17:47:18.299 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.295+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~F4LUDX616AHB.2 size=807252 2024-09-12T17:47:18.303 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.299+0000 7f68bc0598c0 1 < completed multipart upload key=BKAT5SGAC5Z8 upload=F4LUDX616AHB tag=IMUAYJE9794R type=write size=3952980 2024-09-12T17:47:18.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.303+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=XAQ2BCBHJ2VA type=write size=881447 2024-09-12T17:47:18.309 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.307+0000 7f68bc0598c0 1 < suggested update operation key=XGJSQJ2IXJDK tag=T27EAQ8997IH type=del size=83088 2024-09-12T17:47:18.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.307+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=8M8Y6MHGR8HA type=del size=938328 2024-09-12T17:47:18.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.311+0000 7f68bc0598c0 1 < completed write operation key=FC3K0QN3TAWH tag=POUF02FO7DES type=write size=910415 2024-09-12T17:47:18.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.311+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=2D2FQXY3401K type=del size=673432 2024-09-12T17:47:18.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.315+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~KRRBPWGVEGK7.0 size=424385 2024-09-12T17:47:18.322 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.319+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=KRRBPWGVEGK7 tag=1182MHZAS29W type=write size=1472961 2024-09-12T17:47:18.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.319+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=EYIX1EZ65HVD type=write size=802814 2024-09-12T17:47:18.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.323+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~3XLFPS2VIMKS.0 size=403629 2024-09-12T17:47:18.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.327+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=3XLFPS2VIMKS tag=74LX39GDMTLP type=write size=1452205 2024-09-12T17:47:18.334 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.331+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~I3ZK16N9UG77.0 size=1048576 2024-09-12T17:47:18.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.331+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~I3ZK16N9UG77.1 size=210462 2024-09-12T17:47:18.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.331+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=I3ZK16N9UG77 tag=Z23FE1E5PDYN type=write size=2307614 2024-09-12T17:47:18.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.335+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=9W3ZVD16LEOU type=del 2024-09-12T17:47:18.343 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.339+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~A9IBVQ8ZQMKM.0 size=1048576 2024-09-12T17:47:18.345 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.343+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~A9IBVQ8ZQMKM.1 size=1048576 2024-09-12T17:47:18.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.343+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~A9IBVQ8ZQMKM.2 size=693495 2024-09-12T17:47:18.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.343+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=A9IBVQ8ZQMKM tag=VVXRBQ5BLF68 type=write size=3839223 2024-09-12T17:47:18.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.347+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~Q6PCTL4LN9EQ.0 size=1048576 2024-09-12T17:47:18.351 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.347+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~Q6PCTL4LN9EQ.1 size=1048576 2024-09-12T17:47:18.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.351+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~Q6PCTL4LN9EQ.2 size=350193 2024-09-12T17:47:18.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.355+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=Q6PCTL4LN9EQ tag=OCCG4QK8YAQQ type=write size=3495921 2024-09-12T17:47:18.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.355+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=QSGYDNJ509RP type=del size=827078 2024-09-12T17:47:18.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.359+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~HMISCMUR3IAV.0 size=1048576 2024-09-12T17:47:18.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.359+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~HMISCMUR3IAV.1 size=1048576 2024-09-12T17:47:18.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.363+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~HMISCMUR3IAV.2 size=75504 2024-09-12T17:47:18.370 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.367+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=HMISCMUR3IAV tag=A3RL61WN9OXU type=write size=3221232 2024-09-12T17:47:18.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.371+0000 7f68bc0598c0 1 > prepared part key=_multipart_BKAT5SGAC5Z8.2~R25GZMX070Y1.0 size=731406 2024-09-12T17:47:18.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.371+0000 7f68bc0598c0 1 > prepared multipart upload key=BKAT5SGAC5Z8 upload=R25GZMX070Y1 tag=FODCTCAM2VCJ type=write size=1779982 2024-09-12T17:47:18.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.375+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=R1VPJQZSIE4N type=del 2024-09-12T17:47:18.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.379+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~XOCVT8PB2UIY.0 size=276660 2024-09-12T17:47:18.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.379+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=XOCVT8PB2UIY tag=0VTHDUQ1VM5Y type=write size=1325236 2024-09-12T17:47:18.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.379+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=UA1QZRO9205K type=del 2024-09-12T17:47:18.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.383+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=AXRP7E70PYKT type=del size=407249 2024-09-12T17:47:18.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.383+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=NROPK8DAHJG7 type=del 2024-09-12T17:47:18.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.387+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=WJFRE5YIILPY type=del size=417799 2024-09-12T17:47:18.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.391+0000 7f68bc0598c0 1 < completed delete operation key=RTY1OT2PSAAY tag=7B7C3HIC4E4W type=del 2024-09-12T17:47:18.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.395+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=D0WCOUDBWT73 type=del size=3343872 2024-09-12T17:47:18.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.395+0000 7f68bc0598c0 1 < canceled operation key=WPQ755ODAFNT tag=5KVNBX6DG2VW type=write size=154799 2024-09-12T17:47:18.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.399+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=GNJWB51O4K98 type=del size=2054135 2024-09-12T17:47:18.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.403+0000 7f68bc0598c0 1 < canceled operation key=S0B1RP89NO44 tag=44QOVYHSD6LY type=del size=340179 2024-09-12T17:47:18.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.403+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=QFR0D1XKQ633 type=del size=1305505 2024-09-12T17:47:18.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.407+0000 7f68bc0598c0 1 < canceled operation key=6J677S46BXS4 tag=VHXLK9KBXUQO type=del size=2938813 2024-09-12T17:47:18.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.411+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=J04QTLCAW8C3 type=del size=2613311 2024-09-12T17:47:18.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.411+0000 7f68bc0598c0 1 < completed delete operation key=8P0EWBVO0BQD tag=EKHC0IJT7PYH type=del 2024-09-12T17:47:18.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.415+0000 7f68bc0598c0 1 > prepared part key=_multipart_HGY9WK7MKCYS.2~V3K5V29MKXH5.0 size=135247 2024-09-12T17:47:18.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.415+0000 7f68bc0598c0 1 > prepared multipart upload key=HGY9WK7MKCYS upload=V3K5V29MKXH5 tag=WAYRPJX0U43D type=write size=1183823 2024-09-12T17:47:18.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.419+0000 7f68bc0598c0 1 < completed write operation key=HGY9WK7MKCYS tag=XAQ2BCBHJ2VA type=write size=881447 2024-09-12T17:47:18.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.423+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=N17LAM0KVFZS type=del size=3759448 2024-09-12T17:47:18.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.423+0000 7f68bc0598c0 1 < canceled operation key=7XH1E2GEH9O2 tag=8M8Y6MHGR8HA type=del size=938328 2024-09-12T17:47:18.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.431+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~7H47CPRZ8CLY.0 size=1048576 2024-09-12T17:47:18.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.431+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~7H47CPRZ8CLY.1 size=454708 2024-09-12T17:47:18.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.431+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=7H47CPRZ8CLY tag=I7GDLN8OZNZ2 type=write size=2551860 2024-09-12T17:47:18.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.435+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=2D2FQXY3401K type=del 2024-09-12T17:47:18.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.439+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=VVSX1OE0RMV5 type=del size=2774912 2024-09-12T17:47:18.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.439+0000 7f68bc0598c0 1 < completed write operation key=XGJSQJ2IXJDK tag=EYIX1EZ65HVD type=write size=802814 2024-09-12T17:47:18.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.443+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=NZX0E7RZ0872 type=del size=1434966 2024-09-12T17:47:18.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.447+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~I3ZK16N9UG77.0 size=1048576 2024-09-12T17:47:18.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.447+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~I3ZK16N9UG77.1 size=210462 2024-09-12T17:47:18.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.455+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=I3ZK16N9UG77 tag=Z23FE1E5PDYN type=write size=2307614 2024-09-12T17:47:18.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~9NIATRU49W4C.0 size=208765 2024-09-12T17:47:18.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.459+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=9NIATRU49W4C tag=JQR07VCHLIZ0 type=write size=1257341 2024-09-12T17:47:18.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.463+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~A9IBVQ8ZQMKM.0 size=1048576 2024-09-12T17:47:18.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.463+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~A9IBVQ8ZQMKM.1 size=1048576 2024-09-12T17:47:18.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.467+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~A9IBVQ8ZQMKM.2 size=693495 2024-09-12T17:47:18.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.471+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=A9IBVQ8ZQMKM tag=VVXRBQ5BLF68 type=write size=3839223 2024-09-12T17:47:18.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.475+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~43ZG4EEMB70Y.0 size=1048576 2024-09-12T17:47:18.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.479+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~43ZG4EEMB70Y.1 size=552083 2024-09-12T17:47:18.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.479+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=43ZG4EEMB70Y tag=IDSCAQRKRZ10 type=write size=2649235 2024-09-12T17:47:18.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.479+0000 7f68bc0598c0 1 < canceled operation key=9846YLKC8P8S tag=QSGYDNJ509RP type=del size=827078 2024-09-12T17:47:18.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.487+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=XN0WKLMDJANM type=del size=4150856 2024-09-12T17:47:18.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.487+0000 7f68bc0598c0 1 < completed part key=_multipart_BKAT5SGAC5Z8.2~R25GZMX070Y1.0 size=731406 2024-09-12T17:47:18.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.491+0000 7f68bc0598c0 1 < completed multipart upload key=BKAT5SGAC5Z8 upload=R25GZMX070Y1 tag=FODCTCAM2VCJ type=write size=1779982 2024-09-12T17:47:18.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.499+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~VXM5A63UCJ0T.0 size=1048576 2024-09-12T17:47:18.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.499+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~VXM5A63UCJ0T.1 size=888525 2024-09-12T17:47:18.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.499+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=VXM5A63UCJ0T tag=ISOJ5XPLXE97 type=write size=2985677 2024-09-12T17:47:18.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.503+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~XOCVT8PB2UIY.0 size=276660 2024-09-12T17:47:18.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.507+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=XOCVT8PB2UIY tag=0VTHDUQ1VM5Y type=write size=1325236 2024-09-12T17:47:18.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.511+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=CK8QW51HGFDU type=write size=621645 2024-09-12T17:47:18.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.515+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=AXRP7E70PYKT type=del size=407249 2024-09-12T17:47:18.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.519+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~TILD4MN25WKQ.0 size=1048576 2024-09-12T17:47:18.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.523+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~TILD4MN25WKQ.1 size=1048576 2024-09-12T17:47:18.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.527+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~TILD4MN25WKQ.2 size=451280 2024-09-12T17:47:18.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.527+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=TILD4MN25WKQ tag=YQ51Q03DFW7J type=write size=3597008 2024-09-12T17:47:18.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.527+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=WJFRE5YIILPY type=del 2024-09-12T17:47:18.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.535+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~3T4C82PTMIR7.0 size=448168 2024-09-12T17:47:18.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.535+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=3T4C82PTMIR7 tag=55ZTD9LPQ52V type=write size=1496744 2024-09-12T17:47:18.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.535+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=D0WCOUDBWT73 type=del 2024-09-12T17:47:18.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.539+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=CQZ5WBM49PDC type=del size=3786646 2024-09-12T17:47:18.545 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.543+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=GNJWB51O4K98 type=del 2024-09-12T17:47:18.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.543+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=M3AYEID2ST2A type=del size=2840242 2024-09-12T17:47:18.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.547+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=QFR0D1XKQ633 type=del 2024-09-12T17:47:18.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.551+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~3NACL59IMAC8.0 size=593506 2024-09-12T17:47:18.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.551+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=3NACL59IMAC8 tag=0VCMN6LZ7LED type=write size=1642082 2024-09-12T17:47:18.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.559+0000 7f68bc0598c0 1 < suggested update operation key=7XH1E2GEH9O2 tag=J04QTLCAW8C3 type=del size=2613311 2024-09-12T17:47:18.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.563+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~YUVML7KBMXMZ.0 size=389431 2024-09-12T17:47:18.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.563+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=YUVML7KBMXMZ tag=D0RCQM9FW42K type=write size=1438007 2024-09-12T17:47:18.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.567+0000 7f68bc0598c0 1 < completed part key=_multipart_HGY9WK7MKCYS.2~V3K5V29MKXH5.0 size=135247 2024-09-12T17:47:18.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.571+0000 7f68bc0598c0 1 < completed multipart upload key=HGY9WK7MKCYS upload=V3K5V29MKXH5 tag=WAYRPJX0U43D type=write size=1183823 2024-09-12T17:47:18.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.571+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=RDD81QH6BI52 type=del size=2360041 2024-09-12T17:47:18.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.575+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=N17LAM0KVFZS type=del 2024-09-12T17:47:18.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.579+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=FCT2DX428P0C type=write size=415677 2024-09-12T17:47:18.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.579+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~7H47CPRZ8CLY.0 size=1048576 2024-09-12T17:47:18.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.579+0000 7f68bc0598c0 1 < canceled part key=_multipart_7XH1E2GEH9O2.2~7H47CPRZ8CLY.1 size=454708 2024-09-12T17:47:18.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.583+0000 7f68bc0598c0 1 < canceled multipart upload key=7XH1E2GEH9O2 upload=7H47CPRZ8CLY tag=I7GDLN8OZNZ2 type=write size=2551860 2024-09-12T17:47:18.593 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.591+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~L1V34ZH5C6CK.0 size=1048576 2024-09-12T17:47:18.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.591+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~L1V34ZH5C6CK.1 size=1048576 2024-09-12T17:47:18.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.595+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~L1V34ZH5C6CK.2 size=621932 2024-09-12T17:47:18.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.595+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=L1V34ZH5C6CK tag=QYQ6417M4PE6 type=write size=3767660 2024-09-12T17:47:18.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.595+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=VVSX1OE0RMV5 type=del 2024-09-12T17:47:18.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.599+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=N1HE9HZCXZZW type=del size=748698 2024-09-12T17:47:18.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.607+0000 7f68bc0598c0 1 < suggested remove operation key=FC3K0QN3TAWH tag=NZX0E7RZ0872 type=del 2024-09-12T17:47:18.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.607+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=WV01VZJBY22M type=del size=1096625 2024-09-12T17:47:18.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.611+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~9NIATRU49W4C.0 size=208765 2024-09-12T17:47:18.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.615+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=9NIATRU49W4C tag=JQR07VCHLIZ0 type=write size=1257341 2024-09-12T17:47:18.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.619+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~SFHLQ3M0SMP1.0 size=1048576 2024-09-12T17:47:18.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.619+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~SFHLQ3M0SMP1.1 size=336794 2024-09-12T17:47:18.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.619+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=SFHLQ3M0SMP1 tag=H6HD8L426USH type=write size=2433946 2024-09-12T17:47:18.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.623+0000 7f68bc0598c0 1 < canceled part key=_multipart_6J677S46BXS4.2~43ZG4EEMB70Y.0 size=1048576 2024-09-12T17:47:18.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.623+0000 7f68bc0598c0 1 < canceled part key=_multipart_6J677S46BXS4.2~43ZG4EEMB70Y.1 size=552083 2024-09-12T17:47:18.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.627+0000 7f68bc0598c0 1 < canceled multipart upload key=6J677S46BXS4 upload=43ZG4EEMB70Y tag=IDSCAQRKRZ10 type=write size=2649235 2024-09-12T17:47:18.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.627+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=V377PKU45NKG type=del size=2183117 2024-09-12T17:47:18.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.631+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=XN0WKLMDJANM type=del 2024-09-12T17:47:18.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.635+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=Q23XU74891P9 type=del size=511454 2024-09-12T17:47:18.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.635+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~VXM5A63UCJ0T.0 size=1048576 2024-09-12T17:47:18.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.639+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~VXM5A63UCJ0T.1 size=888525 2024-09-12T17:47:18.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.643+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=VXM5A63UCJ0T tag=ISOJ5XPLXE97 type=write size=2985677 2024-09-12T17:47:18.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.647+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~NSRM34F3J2HW.0 size=1048576 2024-09-12T17:47:18.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.651+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~NSRM34F3J2HW.1 size=1048576 2024-09-12T17:47:18.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.655+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~NSRM34F3J2HW.2 size=81020 2024-09-12T17:47:18.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.655+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=NSRM34F3J2HW tag=CUZDRJQDMBFT type=write size=3226748 2024-09-12T17:47:18.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.659+0000 7f68bc0598c0 1 < completed write operation key=OG0V0I1SDHG5 tag=CK8QW51HGFDU type=write size=621645 2024-09-12T17:47:18.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.663+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~V8TTI71P3D30.0 size=793129 2024-09-12T17:47:18.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.663+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=V8TTI71P3D30 tag=17Y5LS87XBII type=write size=1841705 2024-09-12T17:47:18.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.667+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~TILD4MN25WKQ.0 size=1048576 2024-09-12T17:47:18.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.671+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~TILD4MN25WKQ.1 size=1048576 2024-09-12T17:47:18.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.671+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~TILD4MN25WKQ.2 size=451280 2024-09-12T17:47:18.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.675+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=TILD4MN25WKQ tag=YQ51Q03DFW7J type=write size=3597008 2024-09-12T17:47:18.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.679+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=662MIX4QOST8 type=del size=1635494 2024-09-12T17:47:18.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.683+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~3T4C82PTMIR7.0 size=448168 2024-09-12T17:47:18.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.687+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=3T4C82PTMIR7 tag=55ZTD9LPQ52V type=write size=1496744 2024-09-12T17:47:18.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.691+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=QKMHJKHADWE5 type=del size=3361900 2024-09-12T17:47:18.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.695+0000 7f68bc0598c0 1 < suggested update operation key=3JPRQXKB5K3W tag=CQZ5WBM49PDC type=del size=3786646 2024-09-12T17:47:18.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.699+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=ADGY5VFX84D1 type=write size=100899 2024-09-12T17:47:18.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.703+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=M3AYEID2ST2A type=del 2024-09-12T17:47:18.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.707+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~PC6TBSGES0E8.0 size=600226 2024-09-12T17:47:18.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.707+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=PC6TBSGES0E8 tag=KPT00VSBJ4P7 type=write size=1648802 2024-09-12T17:47:18.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.707+0000 7f68bc0598c0 1 < canceled part key=_multipart_06W7N11O7F1I.2~3NACL59IMAC8.0 size=593506 2024-09-12T17:47:18.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.715+0000 7f68bc0598c0 1 < canceled multipart upload key=06W7N11O7F1I upload=3NACL59IMAC8 tag=0VCMN6LZ7LED type=write size=1642082 2024-09-12T17:47:18.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.715+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=AAVP0I5MUTNZ type=del size=2399938 2024-09-12T17:47:18.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.719+0000 7f68bc0598c0 1 < canceled part key=_multipart_WUGDIFCHNL90.2~YUVML7KBMXMZ.0 size=389431 2024-09-12T17:47:18.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.723+0000 7f68bc0598c0 1 < canceled multipart upload key=WUGDIFCHNL90 upload=YUVML7KBMXMZ tag=D0RCQM9FW42K type=write size=1438007 2024-09-12T17:47:18.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.727+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=BJN6C23YRJKC type=write size=609199 2024-09-12T17:47:19.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.727+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=RDD81QH6BI52 type=del 2024-09-12T17:47:19.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.731+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=00QRH1QNLAQ1 type=del size=1585028 2024-09-12T17:47:19.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.735+0000 7f68bc0598c0 1 < completed write operation key=9XK00RPA6Q38 tag=FCT2DX428P0C type=write size=415677 2024-09-12T17:47:19.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~M22U1HFYRTDH.0 size=1048576 2024-09-12T17:47:19.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.743+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~M22U1HFYRTDH.1 size=1048576 2024-09-12T17:47:19.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.747+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~M22U1HFYRTDH.2 size=716181 2024-09-12T17:47:19.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.747+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=M22U1HFYRTDH tag=VU29ACETEY37 type=write size=3861909 2024-09-12T17:47:19.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.751+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~L1V34ZH5C6CK.0 size=1048576 2024-09-12T17:47:19.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.755+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~L1V34ZH5C6CK.1 size=1048576 2024-09-12T17:47:19.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.755+0000 7f68bc0598c0 1 < canceled part key=_multipart_RTY1OT2PSAAY.2~L1V34ZH5C6CK.2 size=621932 2024-09-12T17:47:19.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.759+0000 7f68bc0598c0 1 < canceled multipart upload key=RTY1OT2PSAAY upload=L1V34ZH5C6CK tag=QYQ6417M4PE6 type=write size=3767660 2024-09-12T17:47:19.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.763+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=JF76342JYJ5R type=write size=150039 2024-09-12T17:47:19.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.767+0000 7f68bc0598c0 1 < canceled operation key=HGY9WK7MKCYS tag=N1HE9HZCXZZW type=del size=748698 2024-09-12T17:47:19.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.771+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~5M6ARDWVILG6.0 size=1048576 2024-09-12T17:47:19.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.775+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~5M6ARDWVILG6.1 size=1048576 2024-09-12T17:47:19.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.775+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~5M6ARDWVILG6.2 size=313997 2024-09-12T17:47:19.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.775+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=5M6ARDWVILG6 tag=76TFTMS9PRU8 type=write size=3459725 2024-09-12T17:47:19.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.779+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=WV01VZJBY22M type=del 2024-09-12T17:47:19.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.783+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~RPX9ISTF8N3F.0 size=793460 2024-09-12T17:47:19.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.783+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=RPX9ISTF8N3F tag=ZVTZXAS6SZUU type=write size=1842036 2024-09-12T17:47:19.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.787+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~SFHLQ3M0SMP1.0 size=1048576 2024-09-12T17:47:19.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.787+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~SFHLQ3M0SMP1.1 size=336794 2024-09-12T17:47:19.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.795+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=SFHLQ3M0SMP1 tag=H6HD8L426USH type=write size=2433946 2024-09-12T17:47:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.795+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=SCNQR3AVOQ89 type=del size=3486524 2024-09-12T17:47:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.799+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=V377PKU45NKG type=del 2024-09-12T17:47:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.803+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=BQT1LLDIZT9K type=del size=3882178 2024-09-12T17:47:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.807+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=Q23XU74891P9 type=del 2024-09-12T17:47:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.811+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~E5AESRS5VBX8.0 size=975117 2024-09-12T17:47:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.811+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=E5AESRS5VBX8 tag=2Y0PSCXDULTC type=write size=2023693 2024-09-12T17:47:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.815+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~NSRM34F3J2HW.0 size=1048576 2024-09-12T17:47:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.819+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~NSRM34F3J2HW.1 size=1048576 2024-09-12T17:47:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.819+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~NSRM34F3J2HW.2 size=81020 2024-09-12T17:47:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.827+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=NSRM34F3J2HW tag=CUZDRJQDMBFT type=write size=3226748 2024-09-12T17:47:19.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.827+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=I3GIRYFZT85V type=del size=3752064 2024-09-12T17:47:19.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.831+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~V8TTI71P3D30.0 size=793129 2024-09-12T17:47:19.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.835+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=V8TTI71P3D30 tag=17Y5LS87XBII type=write size=1841705 2024-09-12T17:47:19.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.839+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=U3STVT90ZKT3 type=del size=652256 2024-09-12T17:47:19.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.843+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=662MIX4QOST8 type=del 2024-09-12T17:47:19.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.847+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~1EAWORDVBMJ9.0 size=1048576 2024-09-12T17:47:19.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.851+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~1EAWORDVBMJ9.1 size=626791 2024-09-12T17:47:19.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.851+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=1EAWORDVBMJ9 tag=XWGZZ2TZK50T type=write size=2723943 2024-09-12T17:47:19.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.851+0000 7f68bc0598c0 1 < completed delete operation key=9846YLKC8P8S tag=QKMHJKHADWE5 type=del 2024-09-12T17:47:19.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.855+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=NUGMT3OOC99H type=del size=228062 2024-09-12T17:47:19.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.859+0000 7f68bc0598c0 1 < canceled operation key=MRS3KW2H5AKK tag=ADGY5VFX84D1 type=write size=100899 2024-09-12T17:47:19.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.863+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=ROZ1LU1KDF1F type=del size=2230494 2024-09-12T17:47:19.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.867+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~PC6TBSGES0E8.0 size=600226 2024-09-12T17:47:19.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.871+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=PC6TBSGES0E8 tag=KPT00VSBJ4P7 type=write size=1648802 2024-09-12T17:47:19.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.875+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=HBEMYWS6UY74 type=write size=960694 2024-09-12T17:47:19.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.879+0000 7f68bc0598c0 1 < canceled operation key=6SUA9FBDU69A tag=AAVP0I5MUTNZ type=del size=2399938 2024-09-12T17:47:19.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.879+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=1NHBXCRVELA5 type=write size=882564 2024-09-12T17:47:19.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.883+0000 7f68bc0598c0 1 < completed write operation key=MRS3KW2H5AKK tag=BJN6C23YRJKC type=write size=609199 2024-09-12T17:47:19.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~SV5FJXBW971F.0 size=419351 2024-09-12T17:47:19.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.891+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=SV5FJXBW971F tag=4HBO2VIOQ1DA type=write size=1467927 2024-09-12T17:47:19.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.891+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=00QRH1QNLAQ1 type=del 2024-09-12T17:47:19.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.899+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~7B4DOI9HT2UY.0 size=1048576 2024-09-12T17:47:19.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.899+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~7B4DOI9HT2UY.1 size=1048576 2024-09-12T17:47:19.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.903+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~7B4DOI9HT2UY.2 size=295196 2024-09-12T17:47:19.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.903+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=7B4DOI9HT2UY tag=LILS09XU6Y3W type=write size=3440924 2024-09-12T17:47:19.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.907+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~M22U1HFYRTDH.0 size=1048576 2024-09-12T17:47:19.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.907+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~M22U1HFYRTDH.1 size=1048576 2024-09-12T17:47:19.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.911+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~M22U1HFYRTDH.2 size=716181 2024-09-12T17:47:19.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.915+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=M22U1HFYRTDH tag=VU29ACETEY37 type=write size=3861909 2024-09-12T17:47:19.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.919+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~OPWA3PWBL3IM.0 size=1048576 2024-09-12T17:47:19.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.923+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~OPWA3PWBL3IM.1 size=1018188 2024-09-12T17:47:19.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.923+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=OPWA3PWBL3IM tag=USGNYNN8E9DG type=write size=3115340 2024-09-12T17:47:19.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.927+0000 7f68bc0598c0 1 < canceled operation key=QGO5SPFPT548 tag=JF76342JYJ5R type=write size=150039 2024-09-12T17:47:19.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.931+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~TVP6SD6LSCS0.0 size=919001 2024-09-12T17:47:19.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.931+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=TVP6SD6LSCS0 tag=F9E71WUUXD4O type=write size=1967577 2024-09-12T17:47:19.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.935+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~5M6ARDWVILG6.0 size=1048576 2024-09-12T17:47:19.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.935+0000 7f68bc0598c0 1 < canceled part key=_multipart_57O6H52NHYOL.2~5M6ARDWVILG6.1 size=1048576 2024-09-12T17:47:19.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.935+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~5M6ARDWVILG6.2 size=313997 2024-09-12T17:47:19.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.943+0000 7f68bc0598c0 1 < canceled multipart upload key=57O6H52NHYOL upload=5M6ARDWVILG6 tag=76TFTMS9PRU8 type=write size=3459725 2024-09-12T17:47:19.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.943+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=FADMY3TTBTA1 type=del size=2341566 2024-09-12T17:47:19.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.947+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~RPX9ISTF8N3F.0 size=793460 2024-09-12T17:47:19.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.951+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=RPX9ISTF8N3F tag=ZVTZXAS6SZUU type=write size=1842036 2024-09-12T17:47:19.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.955+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=HGZ51690W7NV type=del size=2886084 2024-09-12T17:47:19.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.963+0000 7f68bc0598c0 1 < suggested remove operation key=XGJSQJ2IXJDK tag=SCNQR3AVOQ89 type=del 2024-09-12T17:47:19.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.967+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=2Y5QKSYKPX2G type=del size=1370375 2024-09-12T17:47:19.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.971+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=BQT1LLDIZT9K type=del 2024-09-12T17:47:19.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.975+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~RLJPDKQI5RWR.0 size=1048576 2024-09-12T17:47:19.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.979+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~RLJPDKQI5RWR.1 size=1048576 2024-09-12T17:47:19.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.983+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~RLJPDKQI5RWR.2 size=1032550 2024-09-12T17:47:19.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.983+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=RLJPDKQI5RWR tag=4EAFB45Y8T43 type=write size=4178278 2024-09-12T17:47:19.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.983+0000 7f68bc0598c0 1 < canceled part key=_multipart_F4F4P4L8K5D9.2~E5AESRS5VBX8.0 size=975117 2024-09-12T17:47:19.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.987+0000 7f68bc0598c0 1 < canceled multipart upload key=F4F4P4L8K5D9 upload=E5AESRS5VBX8 tag=2Y0PSCXDULTC type=write size=2023693 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.995+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~FK4TYMC4M3KB.0 size=1048576 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.995+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~FK4TYMC4M3KB.1 size=1048576 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.999+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~FK4TYMC4M3KB.2 size=645703 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:18.999+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=FK4TYMC4M3KB tag=YNFB1A2VTXIJ type=write size=3791431 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.003+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=I3GIRYFZT85V type=del 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.007+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=PJTIX378HZ5W type=write size=159048 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.007+0000 7f68bc0598c0 1 < canceled operation key=RTY1OT2PSAAY tag=U3STVT90ZKT3 type=del size=652256 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.011+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=17GGMP67EECS type=del size=3662188 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.011+0000 7f68bc0598c0 1 < canceled part key=_multipart_WPQ755ODAFNT.2~1EAWORDVBMJ9.0 size=1048576 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.015+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~1EAWORDVBMJ9.1 size=626791 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.019+0000 7f68bc0598c0 1 < canceled multipart upload key=WPQ755ODAFNT upload=1EAWORDVBMJ9 tag=XWGZZ2TZK50T type=write size=2723943 2024-09-12T17:47:19.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.023+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=MBNUC2ZWEVPL type=del size=1842320 2024-09-12T17:47:19.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.027+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=NUGMT3OOC99H type=del 2024-09-12T17:47:19.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.027+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=0WK6X03C9XIX type=del size=4181442 2024-09-12T17:47:19.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.031+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=ROZ1LU1KDF1F type=del 2024-09-12T17:47:19.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.039+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=8YRIO2BTIQNK type=del size=2906650 2024-09-12T17:47:19.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.043+0000 7f68bc0598c0 1 < completed write operation key=W8JEQ5NOIE6O tag=HBEMYWS6UY74 type=write size=960694 2024-09-12T17:47:19.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.047+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=J5DUQG45MP5S type=write size=86785 2024-09-12T17:47:19.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.047+0000 7f68bc0598c0 1 < canceled operation key=MRS3KW2H5AKK tag=1NHBXCRVELA5 type=write size=882564 2024-09-12T17:47:19.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~UKGNHU3657MI.0 size=1048576 2024-09-12T17:47:19.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~UKGNHU3657MI.1 size=817962 2024-09-12T17:47:19.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.055+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=UKGNHU3657MI tag=TDGFO61C9ZM3 type=write size=2915114 2024-09-12T17:47:19.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.059+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~SV5FJXBW971F.0 size=419351 2024-09-12T17:47:19.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.063+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=SV5FJXBW971F tag=4HBO2VIOQ1DA type=write size=1467927 2024-09-12T17:47:19.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.067+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=ASG1N1YCNE44 type=del size=4174284 2024-09-12T17:47:19.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.071+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~7B4DOI9HT2UY.0 size=1048576 2024-09-12T17:47:19.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.075+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~7B4DOI9HT2UY.1 size=1048576 2024-09-12T17:47:19.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.075+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~7B4DOI9HT2UY.2 size=295196 2024-09-12T17:47:19.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.083+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=7B4DOI9HT2UY tag=LILS09XU6Y3W type=write size=3440924 2024-09-12T17:47:19.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.087+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~SVG3FQMFSUBP.0 size=1048576 2024-09-12T17:47:19.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.091+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~SVG3FQMFSUBP.1 size=249623 2024-09-12T17:47:19.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.091+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=SVG3FQMFSUBP tag=ADBGTK413XO5 type=write size=2346775 2024-09-12T17:47:19.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.091+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~OPWA3PWBL3IM.0 size=1048576 2024-09-12T17:47:19.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.095+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~OPWA3PWBL3IM.1 size=1018188 2024-09-12T17:47:19.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.099+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=OPWA3PWBL3IM tag=USGNYNN8E9DG type=write size=3115340 2024-09-12T17:47:19.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.103+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=ULV7OF5TTXRT type=del size=3282606 2024-09-12T17:47:19.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.103+0000 7f68bc0598c0 1 < canceled part key=_multipart_F4F4P4L8K5D9.2~TVP6SD6LSCS0.0 size=919001 2024-09-12T17:47:19.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.111+0000 7f68bc0598c0 1 < canceled multipart upload key=F4F4P4L8K5D9 upload=TVP6SD6LSCS0 tag=F9E71WUUXD4O type=write size=1967577 2024-09-12T17:47:19.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.115+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=JT8E8Y9G0SX2 type=del size=528067 2024-09-12T17:47:19.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.115+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=FADMY3TTBTA1 type=del 2024-09-12T17:47:19.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.123+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~KMQKV5KXIVDR.0 size=927656 2024-09-12T17:47:19.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.123+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=KMQKV5KXIVDR tag=NC4LX8UXCQKA type=write size=1976232 2024-09-12T17:47:19.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.127+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=HGZ51690W7NV type=del 2024-09-12T17:47:19.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.127+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=5VBTIY94DQU5 type=del size=1770641 2024-09-12T17:47:19.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.135+0000 7f68bc0598c0 1 < suggested remove operation key=P8T1VX1XFJ31 tag=2Y5QKSYKPX2G type=del 2024-09-12T17:47:19.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.139+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=0CATTRSPZZNS type=write size=67730 2024-09-12T17:47:19.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.143+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~RLJPDKQI5RWR.0 size=1048576 2024-09-12T17:47:19.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.143+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~RLJPDKQI5RWR.1 size=1048576 2024-09-12T17:47:19.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.147+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~RLJPDKQI5RWR.2 size=1032550 2024-09-12T17:47:19.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.151+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=RLJPDKQI5RWR tag=4EAFB45Y8T43 type=write size=4178278 2024-09-12T17:47:19.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.155+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=SXJENTJ14OC7 type=del size=2920394 2024-09-12T17:47:19.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.159+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~FK4TYMC4M3KB.0 size=1048576 2024-09-12T17:47:19.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.159+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~FK4TYMC4M3KB.1 size=1048576 2024-09-12T17:47:19.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.163+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~FK4TYMC4M3KB.2 size=645703 2024-09-12T17:47:19.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.167+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=FK4TYMC4M3KB tag=YNFB1A2VTXIJ type=write size=3791431 2024-09-12T17:47:19.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.171+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=X48R21VATAWB type=write size=7615 2024-09-12T17:47:19.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.175+0000 7f68bc0598c0 -1 < failed to complete operation key=P8T1VX1XFJ31 tag=PJTIX378HZ5W type=write size=159048: (22) Invalid argument 2024-09-12T17:47:19.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.179+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=MAEQXRN0RTDT type=del size=3139063 2024-09-12T17:47:19.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.183+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=17GGMP67EECS type=del 2024-09-12T17:47:19.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.187+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~EPO74EX318N1.0 size=1048576 2024-09-12T17:47:19.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.191+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~EPO74EX318N1.1 size=1048576 2024-09-12T17:47:19.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.191+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~EPO74EX318N1.2 size=357570 2024-09-12T17:47:19.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.191+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=EPO74EX318N1 tag=M8JQXIQBHC19 type=write size=3503298 2024-09-12T17:47:19.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.195+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=MBNUC2ZWEVPL type=del 2024-09-12T17:47:19.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.199+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=942RMK0JSFRB type=del size=965060 2024-09-12T17:47:19.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.203+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=0WK6X03C9XIX type=del 2024-09-12T17:47:19.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_6J677S46BXS4.2~QPVQ1E3R2YSJ.0 size=183257 2024-09-12T17:47:19.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.211+0000 7f68bc0598c0 1 > prepared multipart upload key=6J677S46BXS4 upload=QPVQ1E3R2YSJ tag=8WKGQKT3SP7M type=write size=1231833 2024-09-12T17:47:19.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.211+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=8YRIO2BTIQNK type=del 2024-09-12T17:47:19.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.215+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=OHP0ACUQXV3D type=del size=3330640 2024-09-12T17:47:19.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.223+0000 7f68bc0598c0 1 < suggested update operation key=UOW521GPXBQ0 tag=J5DUQG45MP5S type=write size=86785 2024-09-12T17:47:19.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.227+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=9B1SYMU97YVN type=del size=152218 2024-09-12T17:47:19.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.231+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~UKGNHU3657MI.0 size=1048576 2024-09-12T17:47:19.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.231+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~UKGNHU3657MI.1 size=817962 2024-09-12T17:47:19.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.239+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=UKGNHU3657MI tag=TDGFO61C9ZM3 type=write size=2915114 2024-09-12T17:47:19.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.247+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~J3102ZE2VNDX.0 size=301849 2024-09-12T17:47:19.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.247+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=J3102ZE2VNDX tag=1VT6WWZPKCC0 type=write size=1350425 2024-09-12T17:47:19.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.247+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=ASG1N1YCNE44 type=del 2024-09-12T17:47:19.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.251+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=Z2O18TSJR510 type=del size=3723164 2024-09-12T17:47:19.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.255+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~SVG3FQMFSUBP.0 size=1048576 2024-09-12T17:47:19.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.259+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~SVG3FQMFSUBP.1 size=249623 2024-09-12T17:47:19.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.263+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=SVG3FQMFSUBP tag=ADBGTK413XO5 type=write size=2346775 2024-09-12T17:47:19.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.267+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=VD90ZZ0MGCR7 type=del size=3753706 2024-09-12T17:47:19.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.275+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=ULV7OF5TTXRT type=del size=3282606 2024-09-12T17:47:19.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.279+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=1BC5ALZAD3NR type=del size=2340525 2024-09-12T17:47:19.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.279+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=JT8E8Y9G0SX2 type=del 2024-09-12T17:47:19.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.283+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=BIJNYN3JICUS type=del size=4032842 2024-09-12T17:47:19.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.287+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~KMQKV5KXIVDR.0 size=927656 2024-09-12T17:47:19.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.291+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=KMQKV5KXIVDR tag=NC4LX8UXCQKA type=write size=1976232 2024-09-12T17:47:19.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.299+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~XFSWRX7FP5LL.0 size=1048576 2024-09-12T17:47:19.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.299+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~XFSWRX7FP5LL.1 size=1048576 2024-09-12T17:47:19.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.303+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~XFSWRX7FP5LL.2 size=1023162 2024-09-12T17:47:19.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.303+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=XFSWRX7FP5LL tag=I17HPMA80M9V type=write size=4168890 2024-09-12T17:47:19.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.307+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=5VBTIY94DQU5 type=del 2024-09-12T17:47:19.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.307+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=SB34HZSU4FV4 type=write size=382540 2024-09-12T17:47:19.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.311+0000 7f68bc0598c0 1 < completed write operation key=WPQ755ODAFNT tag=0CATTRSPZZNS type=write size=67730 2024-09-12T17:47:19.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.315+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=LP1KLAY8F4V1 type=del size=2488890 2024-09-12T17:47:19.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.315+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=SXJENTJ14OC7 type=del 2024-09-12T17:47:19.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.323+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~FXWPJM553L61.0 size=1048576 2024-09-12T17:47:19.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.323+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~FXWPJM553L61.1 size=1048576 2024-09-12T17:47:19.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.327+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~FXWPJM553L61.2 size=121698 2024-09-12T17:47:19.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.327+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=FXWPJM553L61 tag=B8DT84NEACA3 type=write size=3267426 2024-09-12T17:47:19.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.327+0000 7f68bc0598c0 1 < completed write operation key=0XFYVNU2Q7KO tag=X48R21VATAWB type=write size=7615 2024-09-12T17:47:19.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.331+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=I163HCEWHH6H type=del size=2904412 2024-09-12T17:47:19.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.339+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=MAEQXRN0RTDT type=del 2024-09-12T17:47:19.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.343+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=3NNB2I9TPBVF type=del size=510216 2024-09-12T17:47:19.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.347+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~EPO74EX318N1.0 size=1048576 2024-09-12T17:47:19.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.347+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~EPO74EX318N1.1 size=1048576 2024-09-12T17:47:19.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.351+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~EPO74EX318N1.2 size=357570 2024-09-12T17:47:19.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.355+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=EPO74EX318N1 tag=M8JQXIQBHC19 type=write size=3503298 2024-09-12T17:47:19.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.359+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=KBYQWCFDXXYR type=del size=1338848 2024-09-12T17:47:19.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.363+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=942RMK0JSFRB type=del 2024-09-12T17:47:19.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.367+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=LYFE0XO97CX1 type=write size=947337 2024-09-12T17:47:19.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.367+0000 7f68bc0598c0 1 < completed part key=_multipart_6J677S46BXS4.2~QPVQ1E3R2YSJ.0 size=183257 2024-09-12T17:47:19.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.375+0000 7f68bc0598c0 1 < completed multipart upload key=6J677S46BXS4 upload=QPVQ1E3R2YSJ tag=8WKGQKT3SP7M type=write size=1231833 2024-09-12T17:47:19.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.379+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~UTJXV2NPWS2Q.0 size=334627 2024-09-12T17:47:19.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.379+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=UTJXV2NPWS2Q tag=SDOJQPSF6X5N type=write size=1383203 2024-09-12T17:47:19.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.383+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=OHP0ACUQXV3D type=del 2024-09-12T17:47:19.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.387+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=VO3K2A22F7WX type=del size=2499320 2024-09-12T17:47:19.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.391+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=9B1SYMU97YVN type=del 2024-09-12T17:47:19.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.395+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=JQM28ZK9HOLN type=del size=478087 2024-09-12T17:47:19.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.395+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~J3102ZE2VNDX.0 size=301849 2024-09-12T17:47:19.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.403+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=J3102ZE2VNDX tag=1VT6WWZPKCC0 type=write size=1350425 2024-09-12T17:47:19.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.407+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~K63IJ42TZ2DA.0 size=1048576 2024-09-12T17:47:19.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.411+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~K63IJ42TZ2DA.1 size=380315 2024-09-12T17:47:19.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.411+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=K63IJ42TZ2DA tag=H3410MQWU5TE type=write size=2477467 2024-09-12T17:47:19.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.415+0000 7f68bc0598c0 1 < canceled operation key=06W7N11O7F1I tag=Z2O18TSJR510 type=del size=3723164 2024-09-12T17:47:19.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.419+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=GQQRM4PPC240 type=del size=476491 2024-09-12T17:47:19.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.423+0000 7f68bc0598c0 1 < completed delete operation key=BKAT5SGAC5Z8 tag=VD90ZZ0MGCR7 type=del 2024-09-12T17:47:19.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.427+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=54OYJJBZ9QQ6 type=write size=733387 2024-09-12T17:47:19.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.427+0000 7f68bc0598c0 1 < canceled operation key=6J677S46BXS4 tag=1BC5ALZAD3NR type=del size=2340525 2024-09-12T17:47:19.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.431+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=YMS4BO5QPGMS type=del size=3717031 2024-09-12T17:47:19.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.435+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=BIJNYN3JICUS type=del 2024-09-12T17:47:19.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.439+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=70KJD0RZGIC4 type=del size=1067235 2024-09-12T17:47:19.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.443+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~XFSWRX7FP5LL.0 size=1048576 2024-09-12T17:47:19.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.447+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~XFSWRX7FP5LL.1 size=1048576 2024-09-12T17:47:19.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.447+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~XFSWRX7FP5LL.2 size=1023162 2024-09-12T17:47:19.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.455+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=XFSWRX7FP5LL tag=I17HPMA80M9V type=write size=4168890 2024-09-12T17:47:19.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.455+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=DWJGAX8EC8FJ type=del size=1305529 2024-09-12T17:47:19.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.463+0000 7f68bc0598c0 1 < suggested update operation key=HGY9WK7MKCYS tag=SB34HZSU4FV4 type=write size=382540 2024-09-12T17:47:19.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.467+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~39NY3UU0XZJP.0 size=1048576 2024-09-12T17:47:19.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.467+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~39NY3UU0XZJP.1 size=1048576 2024-09-12T17:47:19.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.471+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~39NY3UU0XZJP.2 size=948575 2024-09-12T17:47:19.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.471+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=39NY3UU0XZJP tag=GQ8Z3FAXQ7VB type=write size=4094303 2024-09-12T17:47:19.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.475+0000 7f68bc0598c0 1 < suggested remove operation key=0XFYVNU2Q7KO tag=LP1KLAY8F4V1 type=del 2024-09-12T17:47:19.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.475+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=YFE5BE7L3X2U type=del size=1799576 2024-09-12T17:47:19.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.479+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~FXWPJM553L61.0 size=1048576 2024-09-12T17:47:19.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.483+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~FXWPJM553L61.1 size=1048576 2024-09-12T17:47:19.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.483+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~FXWPJM553L61.2 size=121698 2024-09-12T17:47:19.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.487+0000 7f68bc0598c0 1 < completed multipart upload key=P8T1VX1XFJ31 upload=FXWPJM553L61 tag=B8DT84NEACA3 type=write size=3267426 2024-09-12T17:47:19.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.491+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=627E38YL4152 type=del size=2061726 2024-09-12T17:47:19.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.495+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=I163HCEWHH6H type=del 2024-09-12T17:47:19.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.495+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=H0T4T32J3KIF type=del size=2715815 2024-09-12T17:47:19.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.499+0000 7f68bc0598c0 1 < suggested remove operation key=F4F4P4L8K5D9 tag=3NNB2I9TPBVF type=del 2024-09-12T17:47:19.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.503+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=P53WS1MO2HW6 type=write size=516692 2024-09-12T17:47:19.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.507+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=KBYQWCFDXXYR type=del 2024-09-12T17:47:19.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.511+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~CERRJ52T7QAY.0 size=1048576 2024-09-12T17:47:19.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.515+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~CERRJ52T7QAY.1 size=1048576 2024-09-12T17:47:19.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.515+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~CERRJ52T7QAY.2 size=385844 2024-09-12T17:47:19.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.515+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=CERRJ52T7QAY tag=3YNYU0YSGLHM type=write size=3531572 2024-09-12T17:47:19.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.519+0000 7f68bc0598c0 1 < completed write operation key=BKAT5SGAC5Z8 tag=LYFE0XO97CX1 type=write size=947337 2024-09-12T17:47:19.527 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.523+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~80QNOL6SUVOD.0 size=1048576 2024-09-12T17:47:19.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.523+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~80QNOL6SUVOD.1 size=1048576 2024-09-12T17:47:19.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.527+0000 7f68bc0598c0 1 > prepared part key=_multipart_6SUA9FBDU69A.2~80QNOL6SUVOD.2 size=635810 2024-09-12T17:47:19.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.527+0000 7f68bc0598c0 1 > prepared multipart upload key=6SUA9FBDU69A upload=80QNOL6SUVOD tag=G5IYUQZPM1P3 type=write size=3781538 2024-09-12T17:47:19.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.531+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~UTJXV2NPWS2Q.0 size=334627 2024-09-12T17:47:19.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.535+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=UTJXV2NPWS2Q tag=SDOJQPSF6X5N type=write size=1383203 2024-09-12T17:47:19.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.539+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~7JEY9MZCELEC.0 size=1048576 2024-09-12T17:47:19.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.539+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~7JEY9MZCELEC.1 size=1048576 2024-09-12T17:47:19.546 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.543+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~7JEY9MZCELEC.2 size=728260 2024-09-12T17:47:19.546 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.543+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=7JEY9MZCELEC tag=7ECEO959ZP0Y type=write size=3873988 2024-09-12T17:47:19.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.543+0000 7f68bc0598c0 -1 < no bi entry to suggest for operation key=F4F4P4L8K5D9 tag=VO3K2A22F7WX type=del size=2499320: (2) No such file or directory 2024-09-12T17:47:19.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.547+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=P15XM0W7YAA8 type=del size=1742932 2024-09-12T17:47:19.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.547+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=JQM28ZK9HOLN type=del 2024-09-12T17:47:19.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.551+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=M87R14F1OYWU type=write size=160708 2024-09-12T17:47:19.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.555+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~K63IJ42TZ2DA.0 size=1048576 2024-09-12T17:47:19.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.555+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~K63IJ42TZ2DA.1 size=380315 2024-09-12T17:47:19.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.559+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=K63IJ42TZ2DA tag=H3410MQWU5TE type=write size=2477467 2024-09-12T17:47:19.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.563+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=7DO8M3SUWJD4 type=del size=1352402 2024-09-12T17:47:19.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.563+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=GQQRM4PPC240 type=del 2024-09-12T17:47:19.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.567+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=9UFFZ1S5Q3U7 type=write size=831487 2024-09-12T17:47:19.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.571+0000 7f68bc0598c0 1 < completed write operation key=BKAT5SGAC5Z8 tag=54OYJJBZ9QQ6 type=write size=733387 2024-09-12T17:47:19.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.571+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=8027A6V7OIEN type=del size=3899804 2024-09-12T17:47:19.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.575+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=YMS4BO5QPGMS type=del 2024-09-12T17:47:19.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.579+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=HGRV7C5DK9PW type=del size=36812 2024-09-12T17:47:19.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.583+0000 7f68bc0598c0 1 < suggested remove operation key=9XK00RPA6Q38 tag=70KJD0RZGIC4 type=del 2024-09-12T17:47:19.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.587+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=WHTB0CSBMRT2 type=del size=3031892 2024-09-12T17:47:19.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.587+0000 7f68bc0598c0 -1 < failed to complete operation key=HGY9WK7MKCYS tag=DWJGAX8EC8FJ type=del size=1305529: (22) Invalid argument 2024-09-12T17:47:19.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.591+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~797O9AF487KQ.0 size=1048576 2024-09-12T17:47:19.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.595+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~797O9AF487KQ.1 size=1048576 2024-09-12T17:47:19.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.599+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~797O9AF487KQ.2 size=363481 2024-09-12T17:47:19.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.599+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=797O9AF487KQ tag=VDZ1C9GAY1EJ type=write size=3509209 2024-09-12T17:47:19.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.599+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~39NY3UU0XZJP.0 size=1048576 2024-09-12T17:47:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.603+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~39NY3UU0XZJP.1 size=1048576 2024-09-12T17:47:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.603+0000 7f68bc0598c0 1 < canceled part key=_multipart_KW3VWTA43PBM.2~39NY3UU0XZJP.2 size=948575 2024-09-12T17:47:19.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.607+0000 7f68bc0598c0 1 < canceled multipart upload key=KW3VWTA43PBM upload=39NY3UU0XZJP tag=GQ8Z3FAXQ7VB type=write size=4094303 2024-09-12T17:47:19.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.611+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=8TTABRPBD7E5 type=del size=561573 2024-09-12T17:47:19.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.615+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=YFE5BE7L3X2U type=del 2024-09-12T17:47:19.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.615+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=W7PE38X20X04 type=del size=3052366 2024-09-12T17:47:19.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.623+0000 7f68bc0598c0 1 < suggested remove operation key=57O6H52NHYOL tag=627E38YL4152 type=del 2024-09-12T17:47:19.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.627+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~J6SMWVITIZU3.0 size=45936 2024-09-12T17:47:19.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.627+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=J6SMWVITIZU3 tag=RJQWZD1VSPGJ type=write size=1094512 2024-09-12T17:47:19.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.631+0000 7f68bc0598c0 1 < suggested remove operation key=MRS3KW2H5AKK tag=H0T4T32J3KIF type=del 2024-09-12T17:47:19.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.639+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~R3DBSCH9J7A4.0 size=1048576 2024-09-12T17:47:19.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.639+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~R3DBSCH9J7A4.1 size=1038255 2024-09-12T17:47:19.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.639+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=R3DBSCH9J7A4 tag=5OL3UFL16PVN type=write size=3135407 2024-09-12T17:47:19.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.643+0000 7f68bc0598c0 1 < completed write operation key=3JPRQXKB5K3W tag=P53WS1MO2HW6 type=write size=516692 2024-09-12T17:47:19.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.647+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=JUPBIOX1JHPY type=del size=1848860 2024-09-12T17:47:19.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.647+0000 7f68bc0598c0 1 < canceled part key=_multipart_MRS3KW2H5AKK.2~CERRJ52T7QAY.0 size=1048576 2024-09-12T17:47:19.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.647+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~CERRJ52T7QAY.1 size=1048576 2024-09-12T17:47:19.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.651+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~CERRJ52T7QAY.2 size=385844 2024-09-12T17:47:19.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.655+0000 7f68bc0598c0 1 < canceled multipart upload key=MRS3KW2H5AKK upload=CERRJ52T7QAY tag=3YNYU0YSGLHM type=write size=3531572 2024-09-12T17:47:19.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.655+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=TS2EHLH6BFGB type=del size=2495172 2024-09-12T17:47:19.663 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.659+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~80QNOL6SUVOD.0 size=1048576 2024-09-12T17:47:19.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.663+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~80QNOL6SUVOD.1 size=1048576 2024-09-12T17:47:19.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.663+0000 7f68bc0598c0 1 < completed part key=_multipart_6SUA9FBDU69A.2~80QNOL6SUVOD.2 size=635810 2024-09-12T17:47:19.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.667+0000 7f68bc0598c0 1 < completed multipart upload key=6SUA9FBDU69A upload=80QNOL6SUVOD tag=G5IYUQZPM1P3 type=write size=3781538 2024-09-12T17:47:19.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.671+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~IQYAUWX0TD00.0 size=510103 2024-09-12T17:47:19.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.671+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=IQYAUWX0TD00 tag=FQV6H6BR4LO6 type=write size=1558679 2024-09-12T17:47:19.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.675+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~7JEY9MZCELEC.0 size=1048576 2024-09-12T17:47:19.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.675+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~7JEY9MZCELEC.1 size=1048576 2024-09-12T17:47:19.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.679+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~7JEY9MZCELEC.2 size=728260 2024-09-12T17:47:19.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.683+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=7JEY9MZCELEC tag=7ECEO959ZP0Y type=write size=3873988 2024-09-12T17:47:19.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.683+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=A1TKPMHBQ9YU type=del size=2492681 2024-09-12T17:47:19.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.687+0000 7f68bc0598c0 -1 < failed to complete operation key=MRS3KW2H5AKK tag=P15XM0W7YAA8 type=del size=1742932: (22) Invalid argument 2024-09-12T17:47:19.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.691+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=JOX8ZATPIFAY type=write size=854275 2024-09-12T17:47:19.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.691+0000 7f68bc0598c0 1 < completed write operation key=WPQ755ODAFNT tag=M87R14F1OYWU type=write size=160708 2024-09-12T17:47:19.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.695+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=GM3Q2Z33V61A type=del size=1952977 2024-09-12T17:47:19.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.695+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=7DO8M3SUWJD4 type=del 2024-09-12T17:47:19.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.699+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=8U1K2FG47SLW type=del size=3542119 2024-09-12T17:47:19.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.703+0000 7f68bc0598c0 1 < completed write operation key=BKAT5SGAC5Z8 tag=9UFFZ1S5Q3U7 type=write size=831487 2024-09-12T17:47:19.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.703+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=93N3CL5RJMWT type=del size=1023499 2024-09-12T17:47:19.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.707+0000 7f68bc0598c0 1 < suggested remove operation key=6J677S46BXS4 tag=8027A6V7OIEN type=del 2024-09-12T17:47:19.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.711+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=2LY7ZU3PPFNG type=del size=1740842 2024-09-12T17:47:19.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.715+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=HGRV7C5DK9PW type=del size=36812 2024-09-12T17:47:19.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.719+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=QCYG83WF18Z3 type=del size=1288731 2024-09-12T17:47:19.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.719+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=WHTB0CSBMRT2 type=del 2024-09-12T17:47:19.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.723+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~0QXU90ZKQMJE.0 size=1048576 2024-09-12T17:47:19.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.727+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~0QXU90ZKQMJE.1 size=1048576 2024-09-12T17:47:19.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.727+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~0QXU90ZKQMJE.2 size=467043 2024-09-12T17:47:19.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.727+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=0QXU90ZKQMJE tag=60ZWWZJ0JWZP type=write size=3612771 2024-09-12T17:47:19.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.731+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~797O9AF487KQ.0 size=1048576 2024-09-12T17:47:19.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.731+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~797O9AF487KQ.1 size=1048576 2024-09-12T17:47:19.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.735+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~797O9AF487KQ.2 size=363481 2024-09-12T17:47:19.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.739+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=797O9AF487KQ tag=VDZ1C9GAY1EJ type=write size=3509209 2024-09-12T17:47:19.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.739+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=6IZP0OKA3T1E type=write size=692768 2024-09-12T17:47:19.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.743+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=8TTABRPBD7E5 type=del 2024-09-12T17:47:19.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.747+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~AVJ9HXULC3EO.0 size=441849 2024-09-12T17:47:19.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.747+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=AVJ9HXULC3EO tag=7303V1JTJ92W type=write size=1490425 2024-09-12T17:47:19.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.751+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=W7PE38X20X04 type=del 2024-09-12T17:47:19.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.755+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~YS3AXRGAM37D.0 size=126131 2024-09-12T17:47:19.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.755+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=YS3AXRGAM37D tag=FUFCH3UWXIBO type=write size=1174707 2024-09-12T17:47:19.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.755+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~J6SMWVITIZU3.0 size=45936 2024-09-12T17:47:19.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.759+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=J6SMWVITIZU3 tag=RJQWZD1VSPGJ type=write size=1094512 2024-09-12T17:47:19.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.763+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=CLRAG7L0JGNO type=del size=2687485 2024-09-12T17:47:19.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.763+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~R3DBSCH9J7A4.0 size=1048576 2024-09-12T17:47:19.769 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.767+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~R3DBSCH9J7A4.1 size=1038255 2024-09-12T17:47:19.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.771+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=R3DBSCH9J7A4 tag=5OL3UFL16PVN type=write size=3135407 2024-09-12T17:47:19.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.775+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~7C6UEDHVZC9Q.0 size=270915 2024-09-12T17:47:19.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.775+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=7C6UEDHVZC9Q tag=674C8S7X20EQ type=write size=1319491 2024-09-12T17:47:19.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.775+0000 7f68bc0598c0 1 < canceled operation key=BKAT5SGAC5Z8 tag=JUPBIOX1JHPY type=del size=1848860 2024-09-12T17:47:19.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.779+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=K9NRMT8W2YI3 type=del size=166442 2024-09-12T17:47:19.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.779+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=TS2EHLH6BFGB type=del 2024-09-12T17:47:19.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.783+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=P3MN0U04EWDE type=write size=267425 2024-09-12T17:47:19.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.783+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~IQYAUWX0TD00.0 size=510103 2024-09-12T17:47:19.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.787+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=IQYAUWX0TD00 tag=FQV6H6BR4LO6 type=write size=1558679 2024-09-12T17:47:19.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.791+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=XXWSPE0JRWNZ type=write size=884910 2024-09-12T17:47:19.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.791+0000 7f68bc0598c0 -1 < failed to complete operation key=W8JEQ5NOIE6O tag=A1TKPMHBQ9YU type=del size=2492681: (22) Invalid argument 2024-09-12T17:47:19.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.795+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=ELCH69AIE1UT type=del size=2778675 2024-09-12T17:47:19.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.799+0000 7f68bc0598c0 1 < completed write operation key=8P0EWBVO0BQD tag=JOX8ZATPIFAY type=write size=854275 2024-09-12T17:47:19.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.803+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~9639XCNW2RTI.0 size=1048576 2024-09-12T17:47:19.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.807+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~9639XCNW2RTI.1 size=1048576 2024-09-12T17:47:19.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.807+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~9639XCNW2RTI.2 size=509372 2024-09-12T17:47:19.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.807+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=9639XCNW2RTI tag=ZV68QX26XOP5 type=write size=3655100 2024-09-12T17:47:19.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.811+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=GM3Q2Z33V61A type=del 2024-09-12T17:47:19.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.811+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=4VJJGEDJG6ZL type=write size=675020 2024-09-12T17:47:19.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.815+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=8U1K2FG47SLW type=del 2024-09-12T17:47:19.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.819+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=PZX75Z7TT26R type=del size=4169636 2024-09-12T17:47:19.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.819+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=93N3CL5RJMWT type=del 2024-09-12T17:47:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.823+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=SISHFMH7J8UX type=del size=3738819 2024-09-12T17:47:19.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.827+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=2LY7ZU3PPFNG type=del 2024-09-12T17:47:19.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.827+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=VY9LZ1U6BVTZ type=del size=2379252 2024-09-12T17:47:19.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.831+0000 7f68bc0598c0 1 < suggested remove operation key=06W7N11O7F1I tag=QCYG83WF18Z3 type=del 2024-09-12T17:47:19.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.839+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=B9S9LLJN9THL type=del size=1642266 2024-09-12T17:47:19.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.843+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~0QXU90ZKQMJE.0 size=1048576 2024-09-12T17:47:19.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.843+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~0QXU90ZKQMJE.1 size=1048576 2024-09-12T17:47:19.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.847+0000 7f68bc0598c0 1 < completed part key=_multipart_7XH1E2GEH9O2.2~0QXU90ZKQMJE.2 size=467043 2024-09-12T17:47:19.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.851+0000 7f68bc0598c0 1 < completed multipart upload key=7XH1E2GEH9O2 upload=0QXU90ZKQMJE tag=60ZWWZJ0JWZP type=write size=3612771 2024-09-12T17:47:19.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.851+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=5VAA7LAI1299 type=del size=144502 2024-09-12T17:47:19.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.855+0000 7f68bc0598c0 1 < completed write operation key=WPQ755ODAFNT tag=6IZP0OKA3T1E type=write size=692768 2024-09-12T17:47:19.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.859+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~Z9MC002V4WJF.0 size=1048576 2024-09-12T17:47:19.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.863+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~Z9MC002V4WJF.1 size=1048576 2024-09-12T17:47:19.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.863+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~Z9MC002V4WJF.2 size=414659 2024-09-12T17:47:19.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.863+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=Z9MC002V4WJF tag=RS8TTWZPKAOX type=write size=3560387 2024-09-12T17:47:19.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.867+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~AVJ9HXULC3EO.0 size=441849 2024-09-12T17:47:19.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.871+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=AVJ9HXULC3EO tag=7303V1JTJ92W type=write size=1490425 2024-09-12T17:47:19.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.875+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~XZ2E2YRN4JAN.0 size=1048576 2024-09-12T17:47:19.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.879+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~XZ2E2YRN4JAN.1 size=17108 2024-09-12T17:47:19.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.879+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=XZ2E2YRN4JAN tag=ZIKCXM1JINZV type=write size=2114260 2024-09-12T17:47:19.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.883+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~YS3AXRGAM37D.0 size=126131 2024-09-12T17:47:19.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.887+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=YS3AXRGAM37D tag=FUFCH3UWXIBO type=write size=1174707 2024-09-12T17:47:19.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.891+0000 7f68bc0598c0 1 > prepared part key=_multipart_57O6H52NHYOL.2~8CO6L9VIJRIA.0 size=443406 2024-09-12T17:47:19.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.891+0000 7f68bc0598c0 1 > prepared multipart upload key=57O6H52NHYOL upload=8CO6L9VIJRIA tag=0ARU030FA9QN type=write size=1491982 2024-09-12T17:47:19.896 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.891+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=CLRAG7L0JGNO type=del 2024-09-12T17:47:19.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.895+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=8QSL2YSOP4RS type=del size=3383055 2024-09-12T17:47:19.902 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.899+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~7C6UEDHVZC9Q.0 size=270915 2024-09-12T17:47:19.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.903+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=7C6UEDHVZC9Q tag=674C8S7X20EQ type=write size=1319491 2024-09-12T17:47:19.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.907+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~8OUX2HT3R6IZ.0 size=579246 2024-09-12T17:47:19.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.907+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=8OUX2HT3R6IZ tag=ZW91C6IKVTCA type=write size=1627822 2024-09-12T17:47:19.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.911+0000 7f68bc0598c0 1 < suggested update operation key=7XH1E2GEH9O2 tag=K9NRMT8W2YI3 type=del size=166442 2024-09-12T17:47:19.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.915+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=9GC4W92R1UBW type=del size=2728737 2024-09-12T17:47:19.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.919+0000 7f68bc0598c0 1 < completed write operation key=HGY9WK7MKCYS tag=P3MN0U04EWDE type=write size=267425 2024-09-12T17:47:19.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.923+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~I2FG02B4Q2B8.0 size=1048576 2024-09-12T17:47:19.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.923+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~I2FG02B4Q2B8.1 size=1048576 2024-09-12T17:47:19.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.927+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~I2FG02B4Q2B8.2 size=727714 2024-09-12T17:47:19.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.927+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=I2FG02B4Q2B8 tag=WF2PYONTQDU1 type=write size=3873442 2024-09-12T17:47:19.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.931+0000 7f68bc0598c0 1 < completed write operation key=F4F4P4L8K5D9 tag=XXWSPE0JRWNZ type=write size=884910 2024-09-12T17:47:19.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.931+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=PLH821XTKC7J type=del size=4104077 2024-09-12T17:47:19.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.935+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=ELCH69AIE1UT type=del 2024-09-12T17:47:19.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.939+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=H0TTBRLH4K74 type=del size=3735998 2024-09-12T17:47:19.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.943+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~9639XCNW2RTI.0 size=1048576 2024-09-12T17:47:19.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.943+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~9639XCNW2RTI.1 size=1048576 2024-09-12T17:47:19.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.947+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~9639XCNW2RTI.2 size=509372 2024-09-12T17:47:19.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.951+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=9639XCNW2RTI tag=ZV68QX26XOP5 type=write size=3655100 2024-09-12T17:47:19.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.959+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~KUXL9SU7VLPL.0 size=1048576 2024-09-12T17:47:19.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.959+0000 7f68bc0598c0 1 > prepared part key=_multipart_SBQGW2EK6I1J.2~KUXL9SU7VLPL.1 size=389723 2024-09-12T17:47:19.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.959+0000 7f68bc0598c0 1 > prepared multipart upload key=SBQGW2EK6I1J upload=KUXL9SU7VLPL tag=0IMK39FNZVLT type=write size=2486875 2024-09-12T17:47:19.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.963+0000 7f68bc0598c0 1 < completed write operation key=6SUA9FBDU69A tag=4VJJGEDJG6ZL type=write size=675020 2024-09-12T17:47:19.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.967+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=AVSQBWA2LH4L type=del size=1479970 2024-09-12T17:47:19.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.967+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=PZX75Z7TT26R type=del 2024-09-12T17:47:19.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.975+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~9XD2AC33SNBC.0 size=1048576 2024-09-12T17:47:19.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.979+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~9XD2AC33SNBC.1 size=1048576 2024-09-12T17:47:19.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.979+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~9XD2AC33SNBC.2 size=152370 2024-09-12T17:47:19.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.979+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=9XD2AC33SNBC tag=MX4JWJQ0S9GL type=write size=3298098 2024-09-12T17:47:19.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.983+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=SISHFMH7J8UX type=del 2024-09-12T17:47:19.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.987+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~MBQ3A17YSVH9.0 size=1048576 2024-09-12T17:47:19.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.991+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~MBQ3A17YSVH9.1 size=1048576 2024-09-12T17:47:19.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.995+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~MBQ3A17YSVH9.2 size=611705 2024-09-12T17:47:19.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.995+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=MBQ3A17YSVH9 tag=O5A3FL9O02ZU type=write size=3757433 2024-09-12T17:47:20.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:19.995+0000 7f68bc0598c0 1 < canceled operation key=6SUA9FBDU69A tag=VY9LZ1U6BVTZ type=del size=2379252 2024-09-12T17:47:20.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.003+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~Z4R4F04VHUQY.0 size=730446 2024-09-12T17:47:20.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.003+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=Z4R4F04VHUQY tag=G68VRJJBJHLF type=write size=1779022 2024-09-12T17:47:20.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.007+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=B9S9LLJN9THL type=del 2024-09-12T17:47:20.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.007+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=923OZW7XMUCH type=del size=4059837 2024-09-12T17:47:20.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.011+0000 7f68bc0598c0 1 < completed delete operation key=NLPTU26RO70S tag=5VAA7LAI1299 type=del 2024-09-12T17:47:20.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.015+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=Q6BC1HI3H7E2 type=del size=2926641 2024-09-12T17:47:20.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.019+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~Z9MC002V4WJF.0 size=1048576 2024-09-12T17:47:20.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.019+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~Z9MC002V4WJF.1 size=1048576 2024-09-12T17:47:20.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.023+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~Z9MC002V4WJF.2 size=414659 2024-09-12T17:47:20.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.027+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=Z9MC002V4WJF tag=RS8TTWZPKAOX type=write size=3560387 2024-09-12T17:47:20.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.031+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=X1MTNAL3KLDW type=del size=801741 2024-09-12T17:47:20.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.035+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~XZ2E2YRN4JAN.0 size=1048576 2024-09-12T17:47:20.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.035+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~XZ2E2YRN4JAN.1 size=17108 2024-09-12T17:47:20.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.039+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=XZ2E2YRN4JAN tag=ZIKCXM1JINZV type=write size=2114260 2024-09-12T17:47:20.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.043+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=A9B2N1Q9K50X type=del size=3402249 2024-09-12T17:47:20.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.047+0000 7f68bc0598c0 1 < completed part key=_multipart_57O6H52NHYOL.2~8CO6L9VIJRIA.0 size=443406 2024-09-12T17:47:20.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.051+0000 7f68bc0598c0 1 < completed multipart upload key=57O6H52NHYOL upload=8CO6L9VIJRIA tag=0ARU030FA9QN type=write size=1491982 2024-09-12T17:47:20.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.055+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~S8N28BWAHR7Z.0 size=1043000 2024-09-12T17:47:20.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.055+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=S8N28BWAHR7Z tag=OY2HH8DRSM4D type=write size=2091576 2024-09-12T17:47:20.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.059+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=8QSL2YSOP4RS type=del 2024-09-12T17:47:20.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.063+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~FUZ1VQDTTCWC.0 size=897221 2024-09-12T17:47:20.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.063+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=FUZ1VQDTTCWC tag=CNSW80YGDTUA type=write size=1945797 2024-09-12T17:47:20.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.067+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~8OUX2HT3R6IZ.0 size=579246 2024-09-12T17:47:20.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.071+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=8OUX2HT3R6IZ tag=ZW91C6IKVTCA type=write size=1627822 2024-09-12T17:47:20.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.079+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~WDIAGTLE76N1.0 size=1048576 2024-09-12T17:47:20.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.079+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~WDIAGTLE76N1.1 size=738272 2024-09-12T17:47:20.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.079+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=WDIAGTLE76N1 tag=KC4K9BQXO60L type=write size=2835424 2024-09-12T17:47:20.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.083+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=9GC4W92R1UBW type=del 2024-09-12T17:47:20.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.087+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=ZQHT326T1YIZ type=write size=718223 2024-09-12T17:47:20.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.087+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~I2FG02B4Q2B8.0 size=1048576 2024-09-12T17:47:20.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.091+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~I2FG02B4Q2B8.1 size=1048576 2024-09-12T17:47:20.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.095+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~I2FG02B4Q2B8.2 size=727714 2024-09-12T17:47:20.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.103+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=I2FG02B4Q2B8 tag=WF2PYONTQDU1 type=write size=3873442 2024-09-12T17:47:20.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.107+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=M897CU3AG44K type=write size=226726 2024-09-12T17:47:20.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.111+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=PLH821XTKC7J type=del 2024-09-12T17:47:20.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.115+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~SPHXONSXBT7E.0 size=1048576 2024-09-12T17:47:20.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.115+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~SPHXONSXBT7E.1 size=1048576 2024-09-12T17:47:20.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.119+0000 7f68bc0598c0 1 > prepared part key=_multipart_F4F4P4L8K5D9.2~SPHXONSXBT7E.2 size=280358 2024-09-12T17:47:20.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.119+0000 7f68bc0598c0 1 > prepared multipart upload key=F4F4P4L8K5D9 upload=SPHXONSXBT7E tag=5BOMP8BLHHKD type=write size=3426086 2024-09-12T17:47:20.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.119+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=H0TTBRLH4K74 type=del 2024-09-12T17:47:20.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.123+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~30XX67W98C1T.0 size=1048576 2024-09-12T17:47:20.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.127+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~30XX67W98C1T.1 size=1048576 2024-09-12T17:47:20.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.127+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~30XX67W98C1T.2 size=91593 2024-09-12T17:47:20.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.127+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=30XX67W98C1T tag=EE0I6Q92WT01 type=write size=3237321 2024-09-12T17:47:20.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.131+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~KUXL9SU7VLPL.0 size=1048576 2024-09-12T17:47:20.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.131+0000 7f68bc0598c0 1 < completed part key=_multipart_SBQGW2EK6I1J.2~KUXL9SU7VLPL.1 size=389723 2024-09-12T17:47:20.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.135+0000 7f68bc0598c0 1 < completed multipart upload key=SBQGW2EK6I1J upload=KUXL9SU7VLPL tag=0IMK39FNZVLT type=write size=2486875 2024-09-12T17:47:20.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.139+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=YYUOUTPK2MH0 type=write size=1036422 2024-09-12T17:47:20.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.143+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=AVSQBWA2LH4L type=del 2024-09-12T17:47:20.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.143+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=02CLNKJ6GQJO type=del size=3875028 2024-09-12T17:47:20.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.147+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~9XD2AC33SNBC.0 size=1048576 2024-09-12T17:47:20.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.147+0000 7f68bc0598c0 1 < canceled part key=_multipart_MRS3KW2H5AKK.2~9XD2AC33SNBC.1 size=1048576 2024-09-12T17:47:20.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.151+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~9XD2AC33SNBC.2 size=152370 2024-09-12T17:47:20.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.155+0000 7f68bc0598c0 1 < canceled multipart upload key=MRS3KW2H5AKK upload=9XD2AC33SNBC tag=MX4JWJQ0S9GL type=write size=3298098 2024-09-12T17:47:20.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.155+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=J143DKBFOA5H type=del size=2407473 2024-09-12T17:47:20.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.159+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~MBQ3A17YSVH9.0 size=1048576 2024-09-12T17:47:20.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.159+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~MBQ3A17YSVH9.1 size=1048576 2024-09-12T17:47:20.166 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.163+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~MBQ3A17YSVH9.2 size=611705 2024-09-12T17:47:20.171 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.167+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=MBQ3A17YSVH9 tag=O5A3FL9O02ZU type=write size=3757433 2024-09-12T17:47:20.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.171+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=EGF3VBL6V6Y7 type=del size=2213559 2024-09-12T17:47:20.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.175+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~Z4R4F04VHUQY.0 size=730446 2024-09-12T17:47:20.181 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.179+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=Z4R4F04VHUQY tag=G68VRJJBJHLF type=write size=1779022 2024-09-12T17:47:20.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.179+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=EOEEHCADDTZ9 type=del size=3108893 2024-09-12T17:47:20.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.183+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=923OZW7XMUCH type=del 2024-09-12T17:47:20.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.187+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~624EJDET9QBF.0 size=1048576 2024-09-12T17:47:20.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.187+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~624EJDET9QBF.1 size=430378 2024-09-12T17:47:20.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.187+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=624EJDET9QBF tag=XG4HCU2WXSUY type=write size=2527530 2024-09-12T17:47:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.191+0000 7f68bc0598c0 1 < suggested remove operation key=WUGDIFCHNL90 tag=Q6BC1HI3H7E2 type=del 2024-09-12T17:47:20.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.195+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~1MB1IK8BG8JB.0 size=408328 2024-09-12T17:47:20.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.195+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=1MB1IK8BG8JB tag=9KS9WKR0TGIR type=write size=1456904 2024-09-12T17:47:20.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.199+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=X1MTNAL3KLDW type=del 2024-09-12T17:47:20.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.199+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=PKJI1QXOR94U type=del size=1782319 2024-09-12T17:47:20.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.203+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=A9B2N1Q9K50X type=del 2024-09-12T17:47:20.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.203+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=TGJE7IH1QAMK type=del size=1079206 2024-09-12T17:47:20.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.203+0000 7f68bc0598c0 1 < canceled part key=_multipart_FC3K0QN3TAWH.2~S8N28BWAHR7Z.0 size=1043000 2024-09-12T17:47:20.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.207+0000 7f68bc0598c0 1 < canceled multipart upload key=FC3K0QN3TAWH upload=S8N28BWAHR7Z tag=OY2HH8DRSM4D type=write size=2091576 2024-09-12T17:47:20.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.211+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~FDB4FBQBM87R.0 size=196476 2024-09-12T17:47:20.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.211+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=FDB4FBQBM87R tag=72UG5F2EWUTH type=write size=1245052 2024-09-12T17:47:20.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.215+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~FUZ1VQDTTCWC.0 size=897221 2024-09-12T17:47:20.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.219+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=FUZ1VQDTTCWC tag=CNSW80YGDTUA type=write size=1945797 2024-09-12T17:47:20.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.223+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=PO1BAP2I2NW7 type=del size=1061576 2024-09-12T17:47:20.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.223+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~WDIAGTLE76N1.0 size=1048576 2024-09-12T17:47:20.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.227+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~WDIAGTLE76N1.1 size=738272 2024-09-12T17:47:20.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.231+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=WDIAGTLE76N1 tag=KC4K9BQXO60L type=write size=2835424 2024-09-12T17:47:20.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.235+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~RWLSLFO4YXOI.0 size=1048576 2024-09-12T17:47:20.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.239+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~RWLSLFO4YXOI.1 size=1033680 2024-09-12T17:47:20.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.239+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=RWLSLFO4YXOI tag=VEVDMX1RXEE9 type=write size=3130832 2024-09-12T17:47:20.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.239+0000 7f68bc0598c0 1 < canceled operation key=57O6H52NHYOL tag=ZQHT326T1YIZ type=write size=718223 2024-09-12T17:47:20.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.243+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=ELG1448JY6N2 type=del size=644919 2024-09-12T17:47:20.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.247+0000 7f68bc0598c0 1 < suggested remove operation key=9XK00RPA6Q38 tag=M897CU3AG44K type=write 2024-09-12T17:47:20.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.251+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=XKFA362P9IZ8 type=del size=764599 2024-09-12T17:47:20.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.255+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~SPHXONSXBT7E.0 size=1048576 2024-09-12T17:47:20.259 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.255+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~SPHXONSXBT7E.1 size=1048576 2024-09-12T17:47:20.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.255+0000 7f68bc0598c0 1 < completed part key=_multipart_F4F4P4L8K5D9.2~SPHXONSXBT7E.2 size=280358 2024-09-12T17:47:20.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.259+0000 7f68bc0598c0 1 < completed multipart upload key=F4F4P4L8K5D9 upload=SPHXONSXBT7E tag=5BOMP8BLHHKD type=write size=3426086 2024-09-12T17:47:20.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.263+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=93LTNYQ8ER5M type=write size=313570 2024-09-12T17:47:20.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.263+0000 7f68bc0598c0 1 < canceled part key=_multipart_QGO5SPFPT548.2~30XX67W98C1T.0 size=1048576 2024-09-12T17:47:20.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.263+0000 7f68bc0598c0 1 < canceled part key=_multipart_QGO5SPFPT548.2~30XX67W98C1T.1 size=1048576 2024-09-12T17:47:20.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.267+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~30XX67W98C1T.2 size=91593 2024-09-12T17:47:20.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.271+0000 7f68bc0598c0 1 < canceled multipart upload key=QGO5SPFPT548 upload=30XX67W98C1T tag=EE0I6Q92WT01 type=write size=3237321 2024-09-12T17:47:20.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.275+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~62NZK3WOKVLK.0 size=1048576 2024-09-12T17:47:20.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.275+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~62NZK3WOKVLK.1 size=1048576 2024-09-12T17:47:20.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.279+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~62NZK3WOKVLK.2 size=211710 2024-09-12T17:47:20.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.279+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=62NZK3WOKVLK tag=HKQAS4OY4XDB type=write size=3357438 2024-09-12T17:47:20.283 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.279+0000 7f68bc0598c0 1 < completed write operation key=57O6H52NHYOL tag=YYUOUTPK2MH0 type=write size=1036422 2024-09-12T17:47:20.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.283+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=H7Y0H0D95A0O type=del size=4177853 2024-09-12T17:47:20.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.283+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=02CLNKJ6GQJO type=del 2024-09-12T17:47:20.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.287+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=BRAKO6R3G8BR type=del size=2702000 2024-09-12T17:47:20.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.291+0000 7f68bc0598c0 1 < canceled operation key=0XFYVNU2Q7KO tag=J143DKBFOA5H type=del size=2407473 2024-09-12T17:47:20.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.291+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=UMH8LB5HKRMN type=del size=2203116 2024-09-12T17:47:20.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.295+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=EGF3VBL6V6Y7 type=del 2024-09-12T17:47:20.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.299+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~6GDVB9792N22.0 size=1048576 2024-09-12T17:47:20.303 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.299+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~6GDVB9792N22.1 size=694868 2024-09-12T17:47:20.303 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.299+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=6GDVB9792N22 tag=BNG5OLGGT02Z type=write size=2792020 2024-09-12T17:47:20.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.303+0000 7f68bc0598c0 1 < canceled operation key=2129SG6US3LI tag=EOEEHCADDTZ9 type=del size=3108893 2024-09-12T17:47:20.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.307+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~WD9SW06FUQJQ.0 size=998919 2024-09-12T17:47:20.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.307+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=WD9SW06FUQJQ tag=8OUZ35T1FM7P type=write size=2047495 2024-09-12T17:47:20.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.307+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~624EJDET9QBF.0 size=1048576 2024-09-12T17:47:20.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.307+0000 7f68bc0598c0 1 < canceled part key=_multipart_9XK00RPA6Q38.2~624EJDET9QBF.1 size=430378 2024-09-12T17:47:20.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.311+0000 7f68bc0598c0 1 < canceled multipart upload key=9XK00RPA6Q38 upload=624EJDET9QBF tag=XG4HCU2WXSUY type=write size=2527530 2024-09-12T17:47:20.319 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.315+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=4ZFO3M0D39CF type=write size=710839 2024-09-12T17:47:20.321 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.319+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~1MB1IK8BG8JB.0 size=408328 2024-09-12T17:47:20.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.319+0000 7f68bc0598c0 1 < completed multipart upload key=KW3VWTA43PBM upload=1MB1IK8BG8JB tag=9KS9WKR0TGIR type=write size=1456904 2024-09-12T17:47:20.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.323+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=Y9K5J0QK8EFL type=write size=1029877 2024-09-12T17:47:20.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.327+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=PKJI1QXOR94U type=del 2024-09-12T17:47:20.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.331+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=CTHLLYQ4UW0G type=del size=3598369 2024-09-12T17:47:20.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.335+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=TGJE7IH1QAMK type=del 2024-09-12T17:47:20.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.339+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~GS1XVUSZRBRK.0 size=1048576 2024-09-12T17:47:20.344 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.339+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~GS1XVUSZRBRK.1 size=1048576 2024-09-12T17:47:20.345 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.343+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~GS1XVUSZRBRK.2 size=410031 2024-09-12T17:47:20.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.343+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=GS1XVUSZRBRK tag=XX8EL1EAD1BP type=write size=3555759 2024-09-12T17:47:20.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.343+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~FDB4FBQBM87R.0 size=196476 2024-09-12T17:47:20.351 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.347+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=FDB4FBQBM87R tag=72UG5F2EWUTH type=write size=1245052 2024-09-12T17:47:20.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.351+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=H1LWH8SDWSL0 type=del size=2470886 2024-09-12T17:47:20.356 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.351+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=PO1BAP2I2NW7 type=del 2024-09-12T17:47:20.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.355+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=AQ18LI9TT3GB type=del size=593787 2024-09-12T17:47:20.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.359+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~RWLSLFO4YXOI.0 size=1048576 2024-09-12T17:47:20.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.359+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~RWLSLFO4YXOI.1 size=1033680 2024-09-12T17:47:20.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.363+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=RWLSLFO4YXOI tag=VEVDMX1RXEE9 type=write size=3130832 2024-09-12T17:47:20.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.363+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=86EC1W9GO7EU type=del size=238038 2024-09-12T17:47:20.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.367+0000 7f68bc0598c0 1 < completed delete operation key=QGO5SPFPT548 tag=ELG1448JY6N2 type=del 2024-09-12T17:47:20.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.371+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=IESH1PHS5NGM type=del size=502546 2024-09-12T17:47:20.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.371+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=XKFA362P9IZ8 type=del 2024-09-12T17:47:20.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.375+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~O6HLQHPJOQ1U.0 size=817219 2024-09-12T17:47:20.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.375+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=O6HLQHPJOQ1U tag=WWVD8K5QKMKN type=write size=1865795 2024-09-12T17:47:20.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.379+0000 7f68bc0598c0 1 < completed write operation key=4R9ENKMRB1GT tag=93LTNYQ8ER5M type=write size=313570 2024-09-12T17:47:20.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.379+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=RZA2RW6C48X8 type=del size=2719902 2024-09-12T17:47:20.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.383+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~62NZK3WOKVLK.0 size=1048576 2024-09-12T17:47:20.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.387+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~62NZK3WOKVLK.1 size=1048576 2024-09-12T17:47:20.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.387+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~62NZK3WOKVLK.2 size=211710 2024-09-12T17:47:20.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.391+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=62NZK3WOKVLK tag=HKQAS4OY4XDB type=write size=3357438 2024-09-12T17:47:20.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.395+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=38YNYL8R2S2A type=del size=3489913 2024-09-12T17:47:20.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.399+0000 7f68bc0598c0 1 < suggested update operation key=8P0EWBVO0BQD tag=H7Y0H0D95A0O type=del size=4177853 2024-09-12T17:47:20.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.399+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=NNAPQ5T1NH8H type=del size=3618485 2024-09-12T17:47:20.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.403+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=BRAKO6R3G8BR type=del 2024-09-12T17:47:20.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.407+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=MKLD9HYH5SJB type=del size=2765762 2024-09-12T17:47:20.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.407+0000 7f68bc0598c0 1 < canceled operation key=BKAT5SGAC5Z8 tag=UMH8LB5HKRMN type=del size=2203116 2024-09-12T17:47:20.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.411+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=D715CWE5C2XK type=del size=3455227 2024-09-12T17:47:20.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.415+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~6GDVB9792N22.0 size=1048576 2024-09-12T17:47:20.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.415+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~6GDVB9792N22.1 size=694868 2024-09-12T17:47:20.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.419+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=6GDVB9792N22 tag=BNG5OLGGT02Z type=write size=2792020 2024-09-12T17:47:20.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.423+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=VW83LST5IO9Y type=write size=811947 2024-09-12T17:47:20.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.423+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~WD9SW06FUQJQ.0 size=998919 2024-09-12T17:47:20.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.427+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=WD9SW06FUQJQ tag=8OUZ35T1FM7P type=write size=2047495 2024-09-12T17:47:20.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.431+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=9F1T6KAUZ3H7 type=del size=3441423 2024-09-12T17:47:20.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.435+0000 7f68bc0598c0 1 < suggested update operation key=57O6H52NHYOL tag=4ZFO3M0D39CF type=write size=710839 2024-09-12T17:47:20.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.439+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=N9NJAPUW9VLX type=del size=843389 2024-09-12T17:47:20.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.439+0000 7f68bc0598c0 -1 < failed to complete operation key=57O6H52NHYOL tag=Y9K5J0QK8EFL type=write size=1029877: (22) Invalid argument 2024-09-12T17:47:20.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.443+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=XNOBJ1GJ980O type=del size=2871946 2024-09-12T17:47:20.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.447+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=CTHLLYQ4UW0G type=del 2024-09-12T17:47:20.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.447+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=ZKJR5N6H8WL4 type=del size=2034644 2024-09-12T17:47:20.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.451+0000 7f68bc0598c0 1 < canceled part key=_multipart_NLPTU26RO70S.2~GS1XVUSZRBRK.0 size=1048576 2024-09-12T17:47:20.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.451+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~GS1XVUSZRBRK.1 size=1048576 2024-09-12T17:47:20.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.455+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~GS1XVUSZRBRK.2 size=410031 2024-09-12T17:47:20.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.459+0000 7f68bc0598c0 1 < canceled multipart upload key=NLPTU26RO70S upload=GS1XVUSZRBRK tag=XX8EL1EAD1BP type=write size=3555759 2024-09-12T17:47:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.463+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~YKXEHBKJ37TJ.0 size=1048576 2024-09-12T17:47:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.463+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~YKXEHBKJ37TJ.1 size=1048576 2024-09-12T17:47:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.467+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~YKXEHBKJ37TJ.2 size=832834 2024-09-12T17:47:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.467+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=YKXEHBKJ37TJ tag=ZB8CCZXOTN6X type=write size=3978562 2024-09-12T17:47:20.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.471+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=H1LWH8SDWSL0 type=del 2024-09-12T17:47:20.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.475+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~7W5TPW28RHWJ.0 size=327842 2024-09-12T17:47:20.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.475+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=7W5TPW28RHWJ tag=ABFQ2H8QJ055 type=write size=1376418 2024-09-12T17:47:20.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.475+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=AQ18LI9TT3GB type=del 2024-09-12T17:47:20.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.479+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=WT82TSD8YJB5 type=del size=2596121 2024-09-12T17:47:20.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.483+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=86EC1W9GO7EU type=del 2024-09-12T17:47:20.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.483+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=C3PCNYDRRDKX type=del size=1308631 2024-09-12T17:47:20.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.487+0000 7f68bc0598c0 1 < completed delete operation key=HGY9WK7MKCYS tag=IESH1PHS5NGM type=del 2024-09-12T17:47:20.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.491+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~HH6KIH1RO9ZN.0 size=1048576 2024-09-12T17:47:20.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.495+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~HH6KIH1RO9ZN.1 size=1048576 2024-09-12T17:47:20.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.495+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~HH6KIH1RO9ZN.2 size=600948 2024-09-12T17:47:20.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.495+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=HH6KIH1RO9ZN tag=3SVUUWC6LYU2 type=write size=3746676 2024-09-12T17:47:20.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.499+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~O6HLQHPJOQ1U.0 size=817219 2024-09-12T17:47:20.505 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.499+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=O6HLQHPJOQ1U tag=WWVD8K5QKMKN type=write size=1865795 2024-09-12T17:47:20.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.503+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~D05KFID507FH.0 size=608508 2024-09-12T17:47:20.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.503+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=D05KFID507FH tag=C6Y8TQIKNVE5 type=write size=1657084 2024-09-12T17:47:20.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.511+0000 7f68bc0598c0 1 < suggested update operation key=W8JEQ5NOIE6O tag=RZA2RW6C48X8 type=del size=2719902 2024-09-12T17:47:20.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.511+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=CC716DCA7USP type=del size=2327727 2024-09-12T17:47:20.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.515+0000 7f68bc0598c0 1 < suggested remove operation key=4R9ENKMRB1GT tag=38YNYL8R2S2A type=del 2024-09-12T17:47:20.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.519+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~A3IFLXK107F8.0 size=1048576 2024-09-12T17:47:20.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.523+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~A3IFLXK107F8.1 size=1048576 2024-09-12T17:47:20.527 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.523+0000 7f68bc0598c0 1 > prepared part key=_multipart_9XK00RPA6Q38.2~A3IFLXK107F8.2 size=548955 2024-09-12T17:47:20.527 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.523+0000 7f68bc0598c0 1 > prepared multipart upload key=9XK00RPA6Q38 upload=A3IFLXK107F8 tag=YAXD06HHM2ZR type=write size=3694683 2024-09-12T17:47:20.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.527+0000 7f68bc0598c0 1 < canceled operation key=UOW521GPXBQ0 tag=NNAPQ5T1NH8H type=del size=3618485 2024-09-12T17:47:20.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.531+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~WSJR98W414XL.0 size=1048576 2024-09-12T17:47:20.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.531+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~WSJR98W414XL.1 size=1048576 2024-09-12T17:47:20.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.535+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~WSJR98W414XL.2 size=1005858 2024-09-12T17:47:20.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.535+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=WSJR98W414XL tag=K9FCNFWGWMSW type=write size=4151586 2024-09-12T17:47:20.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.535+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=MKLD9HYH5SJB type=del 2024-09-12T17:47:20.543 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.539+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=0Q0FCEW82V38 type=del size=1157060 2024-09-12T17:47:20.545 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.543+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=D715CWE5C2XK type=del 2024-09-12T17:47:20.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.543+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=UXQWIFF2JKVP type=write size=1007792 2024-09-12T17:47:20.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.547+0000 7f68bc0598c0 1 < completed write operation key=06W7N11O7F1I tag=VW83LST5IO9Y type=write size=811947 2024-09-12T17:47:20.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.551+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~KRCN3FIBHLZP.0 size=1048576 2024-09-12T17:47:20.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.555+0000 7f68bc0598c0 1 > prepared part key=_multipart_UMQLPH9XGWRZ.2~KRCN3FIBHLZP.1 size=601816 2024-09-12T17:47:20.558 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.555+0000 7f68bc0598c0 1 > prepared multipart upload key=UMQLPH9XGWRZ upload=KRCN3FIBHLZP tag=I59P3HOV1Y5V type=write size=2698968 2024-09-12T17:47:20.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.555+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=9F1T6KAUZ3H7 type=del 2024-09-12T17:47:20.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.559+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=FI7JLYNQ749Q type=del size=1617341 2024-09-12T17:47:20.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.563+0000 7f68bc0598c0 1 < suggested update operation key=FC3K0QN3TAWH tag=N9NJAPUW9VLX type=del size=843389 2024-09-12T17:47:20.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.563+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=WZ7HZHGDCLBV type=del size=548986 2024-09-12T17:47:20.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.567+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=XNOBJ1GJ980O type=del 2024-09-12T17:47:20.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.567+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=LSJJH3A878U8 type=write size=646428 2024-09-12T17:47:20.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.571+0000 7f68bc0598c0 1 < suggested remove operation key=3JPRQXKB5K3W tag=ZKJR5N6H8WL4 type=del 2024-09-12T17:47:20.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.575+0000 7f68bc0598c0 1 > prepared operation key=MRS3KW2H5AKK tag=CSJW5E5556BY type=del size=1382952 2024-09-12T17:47:20.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.575+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~YKXEHBKJ37TJ.0 size=1048576 2024-09-12T17:47:20.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.579+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~YKXEHBKJ37TJ.1 size=1048576 2024-09-12T17:47:20.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.579+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~YKXEHBKJ37TJ.2 size=832834 2024-09-12T17:47:20.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.583+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=YKXEHBKJ37TJ tag=ZB8CCZXOTN6X type=write size=3978562 2024-09-12T17:47:20.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.587+0000 7f68bc0598c0 1 > prepared operation key=RTY1OT2PSAAY tag=ORPQHE1SLGX7 type=del size=2089459 2024-09-12T17:47:20.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.587+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~7W5TPW28RHWJ.0 size=327842 2024-09-12T17:47:20.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.591+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=7W5TPW28RHWJ tag=ABFQ2H8QJ055 type=write size=1376418 2024-09-12T17:47:20.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.595+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~728V79Z4EAS6.0 size=1048576 2024-09-12T17:47:20.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.595+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~728V79Z4EAS6.1 size=1048576 2024-09-12T17:47:20.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.599+0000 7f68bc0598c0 1 > prepared part key=_multipart_KW3VWTA43PBM.2~728V79Z4EAS6.2 size=360830 2024-09-12T17:47:20.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.599+0000 7f68bc0598c0 1 > prepared multipart upload key=KW3VWTA43PBM upload=728V79Z4EAS6 tag=E1LWSPUJDL65 type=write size=3506558 2024-09-12T17:47:20.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.599+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=WT82TSD8YJB5 type=del 2024-09-12T17:47:20.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.603+0000 7f68bc0598c0 1 > prepared part key=_multipart_0XFYVNU2Q7KO.2~VJ41ISC5285R.0 size=352045 2024-09-12T17:47:20.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.603+0000 7f68bc0598c0 1 > prepared multipart upload key=0XFYVNU2Q7KO upload=VJ41ISC5285R tag=KJ3ENAS5TDGI type=write size=1400621 2024-09-12T17:47:20.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.607+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=C3PCNYDRRDKX type=del 2024-09-12T17:47:20.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.611+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=56U00T3YFFYK type=del size=3143058 2024-09-12T17:47:20.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.611+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~HH6KIH1RO9ZN.0 size=1048576 2024-09-12T17:47:20.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.615+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~HH6KIH1RO9ZN.1 size=1048576 2024-09-12T17:47:20.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.615+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~HH6KIH1RO9ZN.2 size=600948 2024-09-12T17:47:20.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.619+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=HH6KIH1RO9ZN tag=3SVUUWC6LYU2 type=write size=3746676 2024-09-12T17:47:20.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.623+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=5HH0KG4YX2EZ type=write size=892138 2024-09-12T17:47:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.623+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~D05KFID507FH.0 size=608508 2024-09-12T17:47:20.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.627+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=D05KFID507FH tag=C6Y8TQIKNVE5 type=write size=1657084 2024-09-12T17:47:20.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.627+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=2XXY63HAK8PL type=del size=3125755 2024-09-12T17:47:20.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.631+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=CC716DCA7USP type=del 2024-09-12T17:47:20.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.635+0000 7f68bc0598c0 1 > prepared operation key=0XFYVNU2Q7KO tag=4KFNAIFHXSKF type=del size=1720769 2024-09-12T17:47:20.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.635+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~A3IFLXK107F8.0 size=1048576 2024-09-12T17:47:20.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.639+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~A3IFLXK107F8.1 size=1048576 2024-09-12T17:47:20.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.639+0000 7f68bc0598c0 1 < completed part key=_multipart_9XK00RPA6Q38.2~A3IFLXK107F8.2 size=548955 2024-09-12T17:47:20.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.643+0000 7f68bc0598c0 1 < completed multipart upload key=9XK00RPA6Q38 upload=A3IFLXK107F8 tag=YAXD06HHM2ZR type=write size=3694683 2024-09-12T17:47:20.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.647+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=V7TQNW10VFNQ type=del size=2892772 2024-09-12T17:47:20.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.647+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~WSJR98W414XL.0 size=1048576 2024-09-12T17:47:20.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.651+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~WSJR98W414XL.1 size=1048576 2024-09-12T17:47:20.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.651+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~WSJR98W414XL.2 size=1005858 2024-09-12T17:47:20.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.655+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=WSJR98W414XL tag=K9FCNFWGWMSW type=write size=4151586 2024-09-12T17:47:20.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.655+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=OCM5UZ50DLOU type=del size=2239580 2024-09-12T17:47:20.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.659+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=0Q0FCEW82V38 type=del 2024-09-12T17:47:20.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.659+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=SEX7YFLGRCNW type=del size=1329376 2024-09-12T17:47:20.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.663+0000 7f68bc0598c0 1 < completed write operation key=XGJSQJ2IXJDK tag=UXQWIFF2JKVP type=write size=1007792 2024-09-12T17:47:20.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.667+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=AU1SJ4VTZRQF type=del size=1042401 2024-09-12T17:47:20.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.667+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~KRCN3FIBHLZP.0 size=1048576 2024-09-12T17:47:20.672 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.667+0000 7f68bc0598c0 1 < completed part key=_multipart_UMQLPH9XGWRZ.2~KRCN3FIBHLZP.1 size=601816 2024-09-12T17:47:20.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.671+0000 7f68bc0598c0 1 < completed multipart upload key=UMQLPH9XGWRZ upload=KRCN3FIBHLZP tag=I59P3HOV1Y5V type=write size=2698968 2024-09-12T17:47:20.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.675+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=KH1VYLB04M6Y type=del size=4149941 2024-09-12T17:47:20.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.675+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=FI7JLYNQ749Q type=del 2024-09-12T17:47:20.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.679+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=VLC4O2BP7AMQ type=del size=1576011 2024-09-12T17:47:20.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.679+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=WZ7HZHGDCLBV type=del 2024-09-12T17:47:20.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.683+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~YFVRW8S04RL2.0 size=1048576 2024-09-12T17:47:20.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.687+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~YFVRW8S04RL2.1 size=1048576 2024-09-12T17:47:20.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.687+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~YFVRW8S04RL2.2 size=964046 2024-09-12T17:47:20.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.687+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=YFVRW8S04RL2 tag=23PES758KE6Q type=write size=4109774 2024-09-12T17:47:20.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.691+0000 7f68bc0598c0 1 < suggested update operation key=UOW521GPXBQ0 tag=LSJJH3A878U8 type=write size=646428 2024-09-12T17:47:20.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.695+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~QTE358N5PBA2.0 size=1048576 2024-09-12T17:47:20.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.699+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~QTE358N5PBA2.1 size=1036867 2024-09-12T17:47:20.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.699+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=QTE358N5PBA2 tag=7SQ25IN21T1D type=write size=3134019 2024-09-12T17:47:20.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.699+0000 7f68bc0598c0 1 < completed delete operation key=MRS3KW2H5AKK tag=CSJW5E5556BY type=del 2024-09-12T17:47:20.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.703+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=VZ78H5NFWJSL type=del size=3312655 2024-09-12T17:47:20.711 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.707+0000 7f68bc0598c0 1 < suggested remove operation key=RTY1OT2PSAAY tag=ORPQHE1SLGX7 type=del 2024-09-12T17:47:20.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.711+0000 7f68bc0598c0 1 > prepared operation key=OG0V0I1SDHG5 tag=UOY2VQ5NFKOS type=del size=596066 2024-09-12T17:47:20.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.711+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~728V79Z4EAS6.0 size=1048576 2024-09-12T17:47:20.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.711+0000 7f68bc0598c0 1 < canceled part key=_multipart_KW3VWTA43PBM.2~728V79Z4EAS6.1 size=1048576 2024-09-12T17:47:20.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.715+0000 7f68bc0598c0 1 < completed part key=_multipart_KW3VWTA43PBM.2~728V79Z4EAS6.2 size=360830 2024-09-12T17:47:20.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.719+0000 7f68bc0598c0 1 < canceled multipart upload key=KW3VWTA43PBM upload=728V79Z4EAS6 tag=E1LWSPUJDL65 type=write size=3506558 2024-09-12T17:47:20.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.723+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~F425RQ0V72RH.0 size=1048576 2024-09-12T17:47:20.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.723+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~F425RQ0V72RH.1 size=1048576 2024-09-12T17:47:20.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.727+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~F425RQ0V72RH.2 size=782158 2024-09-12T17:47:20.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.727+0000 7f68bc0598c0 1 > prepared multipart upload key=2129SG6US3LI upload=F425RQ0V72RH tag=HJWZ2QR61AZ0 type=write size=3927886 2024-09-12T17:47:20.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.727+0000 7f68bc0598c0 1 < completed part key=_multipart_0XFYVNU2Q7KO.2~VJ41ISC5285R.0 size=352045 2024-09-12T17:47:20.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.731+0000 7f68bc0598c0 1 < completed multipart upload key=0XFYVNU2Q7KO upload=VJ41ISC5285R tag=KJ3ENAS5TDGI type=write size=1400621 2024-09-12T17:47:20.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.735+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~8PHSJE7NRWMK.0 size=1048576 2024-09-12T17:47:20.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~8PHSJE7NRWMK.1 size=1048576 2024-09-12T17:47:20.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.739+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~8PHSJE7NRWMK.2 size=814198 2024-09-12T17:47:20.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.739+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=8PHSJE7NRWMK tag=QRF7LC7YYIJN type=write size=3959926 2024-09-12T17:47:20.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.743+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=56U00T3YFFYK type=del 2024-09-12T17:47:20.747 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.743+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=R31UG21EK0V5 type=del size=637220 2024-09-12T17:47:20.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.747+0000 7f68bc0598c0 1 < completed write operation key=9846YLKC8P8S tag=5HH0KG4YX2EZ type=write size=892138 2024-09-12T17:47:20.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.747+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=SKPAO0BV8Y0H type=write size=378353 2024-09-12T17:47:20.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.751+0000 7f68bc0598c0 1 < suggested update operation key=WPQ755ODAFNT tag=2XXY63HAK8PL type=del size=3125755 2024-09-12T17:47:20.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.755+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=ZSVFT5052FG0 type=write size=269638 2024-09-12T17:47:20.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.759+0000 7f68bc0598c0 1 < completed delete operation key=0XFYVNU2Q7KO tag=4KFNAIFHXSKF type=del 2024-09-12T17:47:20.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.763+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~AYOM2OJAJG3R.0 size=1048576 2024-09-12T17:47:20.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.763+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~AYOM2OJAJG3R.1 size=1048576 2024-09-12T17:47:20.769 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.767+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~AYOM2OJAJG3R.2 size=223091 2024-09-12T17:47:20.769 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.767+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=AYOM2OJAJG3R tag=9FFB3J7WUGY7 type=write size=3368819 2024-09-12T17:47:20.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.767+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=V7TQNW10VFNQ type=del 2024-09-12T17:47:20.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.771+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=2PTJ0RPR38AP type=del size=770209 2024-09-12T17:47:20.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.775+0000 7f68bc0598c0 1 < suggested remove operation key=2129SG6US3LI tag=OCM5UZ50DLOU type=del 2024-09-12T17:47:20.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.775+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=5DZP05RMHK1X type=del size=573642 2024-09-12T17:47:20.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.779+0000 7f68bc0598c0 1 < suggested update operation key=SBQGW2EK6I1J tag=SEX7YFLGRCNW type=del size=1329376 2024-09-12T17:47:20.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.783+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~N5U3IX7WWVUU.0 size=537490 2024-09-12T17:47:20.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.783+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=N5U3IX7WWVUU tag=3YVBKY411QF4 type=write size=1586066 2024-09-12T17:47:20.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.787+0000 7f68bc0598c0 1 < suggested update operation key=8P0EWBVO0BQD tag=AU1SJ4VTZRQF type=del size=1042401 2024-09-12T17:47:20.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.791+0000 7f68bc0598c0 1 > prepared operation key=4R9ENKMRB1GT tag=2WXLSOHF2KX7 type=del size=953840 2024-09-12T17:47:20.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.791+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=KH1VYLB04M6Y type=del 2024-09-12T17:47:20.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.795+0000 7f68bc0598c0 1 > prepared operation key=6J677S46BXS4 tag=GSUH9I7ALYHL type=del size=4089974 2024-09-12T17:47:20.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.795+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=VLC4O2BP7AMQ type=del 2024-09-12T17:47:20.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.799+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~GWZ3GDJBYFA0.0 size=79541 2024-09-12T17:47:20.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.799+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=GWZ3GDJBYFA0 tag=W3NSU4OW7UN2 type=write size=1128117 2024-09-12T17:47:20.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.803+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~YFVRW8S04RL2.0 size=1048576 2024-09-12T17:47:20.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.803+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~YFVRW8S04RL2.1 size=1048576 2024-09-12T17:47:20.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.807+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~YFVRW8S04RL2.2 size=964046 2024-09-12T17:47:20.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.811+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=YFVRW8S04RL2 tag=23PES758KE6Q type=write size=4109774 2024-09-12T17:47:20.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.811+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=LYGPN3SAOBXN type=del size=946667 2024-09-12T17:47:20.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.815+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~QTE358N5PBA2.0 size=1048576 2024-09-12T17:47:20.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.815+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~QTE358N5PBA2.1 size=1036867 2024-09-12T17:47:20.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.819+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=QTE358N5PBA2 tag=7SQ25IN21T1D type=write size=3134019 2024-09-12T17:47:20.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.823+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~0B3836P4BI0T.0 size=1048576 2024-09-12T17:47:20.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.827+0000 7f68bc0598c0 1 > prepared part key=_multipart_4R9ENKMRB1GT.2~0B3836P4BI0T.1 size=907661 2024-09-12T17:47:20.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.827+0000 7f68bc0598c0 1 > prepared multipart upload key=4R9ENKMRB1GT upload=0B3836P4BI0T tag=G72I7DGAWHJJ type=write size=3004813 2024-09-12T17:47:20.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.827+0000 7f68bc0598c0 1 < canceled operation key=S0B1RP89NO44 tag=VZ78H5NFWJSL type=del size=3312655 2024-09-12T17:47:20.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.831+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=P56Y0OQ4F78X type=write size=619211 2024-09-12T17:47:20.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.831+0000 7f68bc0598c0 1 < completed delete operation key=OG0V0I1SDHG5 tag=UOY2VQ5NFKOS type=del 2024-09-12T17:47:20.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.835+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=NRX1TH63TF16 type=del size=2127478 2024-09-12T17:47:20.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.839+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~F425RQ0V72RH.0 size=1048576 2024-09-12T17:47:20.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.839+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~F425RQ0V72RH.1 size=1048576 2024-09-12T17:47:20.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.839+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~F425RQ0V72RH.2 size=782158 2024-09-12T17:47:20.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.843+0000 7f68bc0598c0 1 < completed multipart upload key=2129SG6US3LI upload=F425RQ0V72RH tag=HJWZ2QR61AZ0 type=write size=3927886 2024-09-12T17:47:20.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.847+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=T1HEM97XKCV6 type=write size=780674 2024-09-12T17:47:20.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.851+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~8PHSJE7NRWMK.0 size=1048576 2024-09-12T17:47:20.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.851+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~8PHSJE7NRWMK.1 size=1048576 2024-09-12T17:47:20.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.855+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~8PHSJE7NRWMK.2 size=814198 2024-09-12T17:47:20.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.859+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=8PHSJE7NRWMK tag=QRF7LC7YYIJN type=write size=3959926 2024-09-12T17:47:20.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.863+0000 7f68bc0598c0 1 > prepared operation key=XGJSQJ2IXJDK tag=S1S2A12FHH3I type=del size=1002654 2024-09-12T17:47:20.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.867+0000 7f68bc0598c0 -1 < failed to complete operation key=SBQGW2EK6I1J tag=R31UG21EK0V5 type=del size=637220: (22) Invalid argument 2024-09-12T17:47:20.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.871+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~5SBOHPGCTV2K.0 size=1048576 2024-09-12T17:47:20.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.871+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~5SBOHPGCTV2K.1 size=1048576 2024-09-12T17:47:20.877 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.875+0000 7f68bc0598c0 1 > prepared part key=_multipart_W8JEQ5NOIE6O.2~5SBOHPGCTV2K.2 size=43466 2024-09-12T17:47:20.877 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.875+0000 7f68bc0598c0 1 > prepared multipart upload key=W8JEQ5NOIE6O upload=5SBOHPGCTV2K tag=L2QSRXQ5CAW8 type=write size=3189194 2024-09-12T17:47:20.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.875+0000 7f68bc0598c0 1 < completed write operation key=7XH1E2GEH9O2 tag=SKPAO0BV8Y0H type=write size=378353 2024-09-12T17:47:20.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.879+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=XHY0XN585W2B type=del size=2246155 2024-09-12T17:47:20.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.879+0000 7f68bc0598c0 1 < completed write operation key=3JPRQXKB5K3W tag=ZSVFT5052FG0 type=write size=269638 2024-09-12T17:47:20.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.883+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~6J9M8N7QCX69.0 size=1048576 2024-09-12T17:47:20.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.887+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~6J9M8N7QCX69.1 size=1048576 2024-09-12T17:47:20.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.887+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~6J9M8N7QCX69.2 size=114300 2024-09-12T17:47:20.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.887+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=6J9M8N7QCX69 tag=YXUF9FD3TC72 type=write size=3260028 2024-09-12T17:47:20.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.891+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~AYOM2OJAJG3R.0 size=1048576 2024-09-12T17:47:20.896 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.891+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~AYOM2OJAJG3R.1 size=1048576 2024-09-12T17:47:20.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.895+0000 7f68bc0598c0 1 < completed part key=_multipart_UOW521GPXBQ0.2~AYOM2OJAJG3R.2 size=223091 2024-09-12T17:47:20.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.899+0000 7f68bc0598c0 1 < completed multipart upload key=UOW521GPXBQ0 upload=AYOM2OJAJG3R tag=9FFB3J7WUGY7 type=write size=3368819 2024-09-12T17:47:20.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.903+0000 7f68bc0598c0 1 > prepared part key=_multipart_3JPRQXKB5K3W.2~8WANLP9DUD9Z.0 size=254626 2024-09-12T17:47:20.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.903+0000 7f68bc0598c0 1 > prepared multipart upload key=3JPRQXKB5K3W upload=8WANLP9DUD9Z tag=UZOM6WR1WO5G type=write size=1303202 2024-09-12T17:47:20.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.907+0000 7f68bc0598c0 1 < completed delete operation key=UMQLPH9XGWRZ tag=2PTJ0RPR38AP type=del 2024-09-12T17:47:20.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.911+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~ERUB0VHN58XC.0 size=1048576 2024-09-12T17:47:20.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.911+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~ERUB0VHN58XC.1 size=1048576 2024-09-12T17:47:20.918 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.915+0000 7f68bc0598c0 1 > prepared part key=_multipart_UOW521GPXBQ0.2~ERUB0VHN58XC.2 size=636116 2024-09-12T17:47:20.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.915+0000 7f68bc0598c0 1 > prepared multipart upload key=UOW521GPXBQ0 upload=ERUB0VHN58XC tag=PQGZOGECNWNB type=write size=3781844 2024-09-12T17:47:20.921 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.919+0000 7f68bc0598c0 -1 < failed to complete operation key=8P0EWBVO0BQD tag=5DZP05RMHK1X type=del size=573642: (22) Invalid argument 2024-09-12T17:47:20.923 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.919+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=Q8MDNYDNJY59 type=write size=937554 2024-09-12T17:47:20.925 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.923+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~N5U3IX7WWVUU.0 size=537490 2024-09-12T17:47:20.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.927+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=N5U3IX7WWVUU tag=3YVBKY411QF4 type=write size=1586066 2024-09-12T17:47:20.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.927+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=J21B64JFQDU9 type=del size=300701 2024-09-12T17:47:20.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.931+0000 7f68bc0598c0 1 < completed delete operation key=4R9ENKMRB1GT tag=2WXLSOHF2KX7 type=del 2024-09-12T17:47:20.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.935+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~7GP91Z61J9QR.0 size=1048576 2024-09-12T17:47:20.940 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.935+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~7GP91Z61J9QR.1 size=1048576 2024-09-12T17:47:20.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.939+0000 7f68bc0598c0 1 > prepared part key=_multipart_MRS3KW2H5AKK.2~7GP91Z61J9QR.2 size=839447 2024-09-12T17:47:20.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.939+0000 7f68bc0598c0 1 > prepared multipart upload key=MRS3KW2H5AKK upload=7GP91Z61J9QR tag=JSEXVN44M7WS type=write size=3985175 2024-09-12T17:47:20.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.943+0000 7f68bc0598c0 1 < completed delete operation key=6J677S46BXS4 tag=GSUH9I7ALYHL type=del 2024-09-12T17:47:20.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.947+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~VZA2SNUV4HVY.0 size=1048576 2024-09-12T17:47:20.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.951+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~VZA2SNUV4HVY.1 size=1048576 2024-09-12T17:47:20.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.951+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~VZA2SNUV4HVY.2 size=158676 2024-09-12T17:47:20.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.951+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=VZA2SNUV4HVY tag=TUANRYEZCZUB type=write size=3304404 2024-09-12T17:47:20.957 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.955+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~GWZ3GDJBYFA0.0 size=79541 2024-09-12T17:47:20.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.959+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=GWZ3GDJBYFA0 tag=W3NSU4OW7UN2 type=write size=1128117 2024-09-12T17:47:20.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.959+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=GJH030JHX1KG type=del size=2106463 2024-09-12T17:47:20.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.963+0000 7f68bc0598c0 1 < completed delete operation key=W8JEQ5NOIE6O tag=LYGPN3SAOBXN type=del 2024-09-12T17:47:20.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.967+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=XNCSGV0152MB type=write size=710563 2024-09-12T17:47:20.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.967+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~0B3836P4BI0T.0 size=1048576 2024-09-12T17:47:20.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.971+0000 7f68bc0598c0 1 < completed part key=_multipart_4R9ENKMRB1GT.2~0B3836P4BI0T.1 size=907661 2024-09-12T17:47:20.980 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.975+0000 7f68bc0598c0 1 < completed multipart upload key=4R9ENKMRB1GT upload=0B3836P4BI0T tag=G72I7DGAWHJJ type=write size=3004813 2024-09-12T17:47:20.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.979+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=2RDQC34JF2IJ type=del size=3379860 2024-09-12T17:47:20.986 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.983+0000 7f68bc0598c0 1 < completed write operation key=BKAT5SGAC5Z8 tag=P56Y0OQ4F78X type=write size=619211 2024-09-12T17:47:20.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.987+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=JI7NLZ0RQEC0 type=del size=578897 2024-09-12T17:47:20.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.991+0000 7f68bc0598c0 1 < suggested update operation key=2129SG6US3LI tag=NRX1TH63TF16 type=del size=2127478 2024-09-12T17:47:20.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.995+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=1NTMX36WI1LY type=del size=937389 2024-09-12T17:47:21.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.995+0000 7f68bc0598c0 1 < completed write operation key=7XH1E2GEH9O2 tag=T1HEM97XKCV6 type=write size=780674 2024-09-12T17:47:21.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:20.999+0000 7f68bc0598c0 1 > prepared operation key=F4F4P4L8K5D9 tag=5EJ5A3J1CSMA type=del size=856613 2024-09-12T17:47:21.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.003+0000 7f68bc0598c0 1 < completed delete operation key=XGJSQJ2IXJDK tag=S1S2A12FHH3I type=del 2024-09-12T17:47:21.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.011+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~IAC4EWYKY62Z.0 size=1048576 2024-09-12T17:47:21.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.011+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~IAC4EWYKY62Z.1 size=64988 2024-09-12T17:47:21.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.011+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=IAC4EWYKY62Z tag=B7QREDSXZ05M type=write size=2162140 2024-09-12T17:47:21.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.015+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~5SBOHPGCTV2K.0 size=1048576 2024-09-12T17:47:21.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.019+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~5SBOHPGCTV2K.1 size=1048576 2024-09-12T17:47:21.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.023+0000 7f68bc0598c0 1 < completed part key=_multipart_W8JEQ5NOIE6O.2~5SBOHPGCTV2K.2 size=43466 2024-09-12T17:47:21.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.027+0000 7f68bc0598c0 1 < completed multipart upload key=W8JEQ5NOIE6O upload=5SBOHPGCTV2K tag=L2QSRXQ5CAW8 type=write size=3189194 2024-09-12T17:47:21.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.035+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~IH5CH8S88ZOX.0 size=1048576 2024-09-12T17:47:21.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.035+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~IH5CH8S88ZOX.1 size=1048576 2024-09-12T17:47:21.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.039+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~IH5CH8S88ZOX.2 size=345818 2024-09-12T17:47:21.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.039+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=IH5CH8S88ZOX tag=O7SOXV415OAQ type=write size=3491546 2024-09-12T17:47:21.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.043+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=XHY0XN585W2B type=del 2024-09-12T17:47:21.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.047+0000 7f68bc0598c0 1 > prepared operation key=NLPTU26RO70S tag=06R4G4BDACKF type=write size=152594 2024-09-12T17:47:21.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.047+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~6J9M8N7QCX69.0 size=1048576 2024-09-12T17:47:21.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.051+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~6J9M8N7QCX69.1 size=1048576 2024-09-12T17:47:21.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.055+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~6J9M8N7QCX69.2 size=114300 2024-09-12T17:47:21.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.059+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=6J9M8N7QCX69 tag=YXUF9FD3TC72 type=write size=3260028 2024-09-12T17:47:21.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.067+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~BYC3SV5J0P7P.0 size=1048576 2024-09-12T17:47:21.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.067+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~BYC3SV5J0P7P.1 size=1048576 2024-09-12T17:47:21.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.071+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~BYC3SV5J0P7P.2 size=260259 2024-09-12T17:47:21.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.071+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=BYC3SV5J0P7P tag=OHWSVXSX3WWS type=write size=3405987 2024-09-12T17:47:21.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.075+0000 7f68bc0598c0 1 < completed part key=_multipart_3JPRQXKB5K3W.2~8WANLP9DUD9Z.0 size=254626 2024-09-12T17:47:21.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.079+0000 7f68bc0598c0 1 < completed multipart upload key=3JPRQXKB5K3W upload=8WANLP9DUD9Z tag=UZOM6WR1WO5G type=write size=1303202 2024-09-12T17:47:21.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.083+0000 7f68bc0598c0 1 > prepared operation key=QGO5SPFPT548 tag=RW3H56DR8006 type=write size=40520 2024-09-12T17:47:21.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.083+0000 7f68bc0598c0 1 < canceled part key=_multipart_UOW521GPXBQ0.2~ERUB0VHN58XC.0 size=1048576 2024-09-12T17:47:21.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.083+0000 7f68bc0598c0 1 < canceled part key=_multipart_UOW521GPXBQ0.2~ERUB0VHN58XC.1 size=1048576 2024-09-12T17:47:21.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.083+0000 7f68bc0598c0 1 < canceled part key=_multipart_UOW521GPXBQ0.2~ERUB0VHN58XC.2 size=636116 2024-09-12T17:47:21.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.087+0000 7f68bc0598c0 1 < canceled multipart upload key=UOW521GPXBQ0 upload=ERUB0VHN58XC tag=PQGZOGECNWNB type=write size=3781844 2024-09-12T17:47:21.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.091+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=ZGGP4HVCRTZV type=del size=1581713 2024-09-12T17:47:21.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.095+0000 7f68bc0598c0 1 < completed write operation key=KW3VWTA43PBM tag=Q8MDNYDNJY59 type=write size=937554 2024-09-12T17:47:21.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.099+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=KXWRYK491OPT type=del size=2220810 2024-09-12T17:47:21.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.103+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=J21B64JFQDU9 type=del 2024-09-12T17:47:21.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.107+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~M9LM4VI5HDSJ.0 size=1048576 2024-09-12T17:47:21.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.111+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~M9LM4VI5HDSJ.1 size=930528 2024-09-12T17:47:21.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.111+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=M9LM4VI5HDSJ tag=MSFUVIY6AYAG type=write size=3027680 2024-09-12T17:47:21.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.115+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~7GP91Z61J9QR.0 size=1048576 2024-09-12T17:47:21.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.115+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~7GP91Z61J9QR.1 size=1048576 2024-09-12T17:47:21.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.119+0000 7f68bc0598c0 1 < completed part key=_multipart_MRS3KW2H5AKK.2~7GP91Z61J9QR.2 size=839447 2024-09-12T17:47:21.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.123+0000 7f68bc0598c0 1 < completed multipart upload key=MRS3KW2H5AKK upload=7GP91Z61J9QR tag=JSEXVN44M7WS type=write size=3985175 2024-09-12T17:47:21.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.131+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~ASRTJ1B3C41I.0 size=1048576 2024-09-12T17:47:21.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.131+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~ASRTJ1B3C41I.1 size=1048576 2024-09-12T17:47:21.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.135+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~ASRTJ1B3C41I.2 size=1034571 2024-09-12T17:47:21.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.135+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=ASRTJ1B3C41I tag=QJUNU8ZQOHA2 type=write size=4180299 2024-09-12T17:47:21.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.139+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~VZA2SNUV4HVY.0 size=1048576 2024-09-12T17:47:21.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.139+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~VZA2SNUV4HVY.1 size=1048576 2024-09-12T17:47:21.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.143+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~VZA2SNUV4HVY.2 size=158676 2024-09-12T17:47:21.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.147+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=VZA2SNUV4HVY tag=TUANRYEZCZUB type=write size=3304404 2024-09-12T17:47:21.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.151+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=O0KXZZGGJKQH type=del size=419352 2024-09-12T17:47:21.161 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.159+0000 7f68bc0598c0 1 < suggested update operation key=FC3K0QN3TAWH tag=GJH030JHX1KG type=del size=2106463 2024-09-12T17:47:21.166 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.163+0000 7f68bc0598c0 1 > prepared part key=_multipart_NLPTU26RO70S.2~57994VZ93UWW.0 size=681145 2024-09-12T17:47:21.166 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.163+0000 7f68bc0598c0 1 > prepared multipart upload key=NLPTU26RO70S upload=57994VZ93UWW tag=GEE8RZQWDBU6 type=write size=1729721 2024-09-12T17:47:21.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.167+0000 7f68bc0598c0 1 < completed write operation key=3JPRQXKB5K3W tag=XNCSGV0152MB type=write size=710563 2024-09-12T17:47:21.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.171+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~JXD0EL72PONE.0 size=1048576 2024-09-12T17:47:21.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.175+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~JXD0EL72PONE.1 size=1048576 2024-09-12T17:47:21.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.175+0000 7f68bc0598c0 1 > prepared part key=_multipart_P8T1VX1XFJ31.2~JXD0EL72PONE.2 size=385630 2024-09-12T17:47:21.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.175+0000 7f68bc0598c0 1 > prepared multipart upload key=P8T1VX1XFJ31 upload=JXD0EL72PONE tag=W0S7P3GKEXZ1 type=write size=3531358 2024-09-12T17:47:21.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.179+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=2RDQC34JF2IJ type=del 2024-09-12T17:47:21.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.183+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=KQR9URLE4D64 type=del size=1277645 2024-09-12T17:47:21.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.187+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=JI7NLZ0RQEC0 type=del 2024-09-12T17:47:21.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.187+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=RTQFQ3BX3L3F type=write size=116505 2024-09-12T17:47:21.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.191+0000 7f68bc0598c0 1 < completed delete operation key=DMJZUQJ7IY60 tag=1NTMX36WI1LY type=del 2024-09-12T17:47:21.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.199+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~PKJ2P1NKQRNP.0 size=1048576 2024-09-12T17:47:21.205 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.203+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~PKJ2P1NKQRNP.1 size=1048576 2024-09-12T17:47:21.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.203+0000 7f68bc0598c0 1 > prepared part key=_multipart_DMJZUQJ7IY60.2~PKJ2P1NKQRNP.2 size=635581 2024-09-12T17:47:21.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.203+0000 7f68bc0598c0 1 > prepared multipart upload key=DMJZUQJ7IY60 upload=PKJ2P1NKQRNP tag=XC31J8KXLIM8 type=write size=3781309 2024-09-12T17:47:21.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.207+0000 7f68bc0598c0 1 < completed delete operation key=F4F4P4L8K5D9 tag=5EJ5A3J1CSMA type=del 2024-09-12T17:47:21.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.211+0000 7f68bc0598c0 1 > prepared operation key=57O6H52NHYOL tag=YWS1A6BTVNRQ type=del size=1793428 2024-09-12T17:47:21.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.215+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~IAC4EWYKY62Z.0 size=1048576 2024-09-12T17:47:21.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.219+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~IAC4EWYKY62Z.1 size=64988 2024-09-12T17:47:21.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.223+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=IAC4EWYKY62Z tag=B7QREDSXZ05M type=write size=2162140 2024-09-12T17:47:21.230 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.227+0000 7f68bc0598c0 1 > prepared operation key=WPQ755ODAFNT tag=FCCJW8AQYP93 type=del size=1161967 2024-09-12T17:47:21.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.227+0000 7f68bc0598c0 1 < canceled part key=_multipart_RTY1OT2PSAAY.2~IH5CH8S88ZOX.0 size=1048576 2024-09-12T17:47:21.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.231+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~IH5CH8S88ZOX.1 size=1048576 2024-09-12T17:47:21.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.231+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~IH5CH8S88ZOX.2 size=345818 2024-09-12T17:47:21.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.239+0000 7f68bc0598c0 1 < canceled multipart upload key=RTY1OT2PSAAY upload=IH5CH8S88ZOX tag=O7SOXV415OAQ type=write size=3491546 2024-09-12T17:47:21.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.243+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~GW4Q5UHKN191.0 size=1048576 2024-09-12T17:47:21.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.247+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~GW4Q5UHKN191.1 size=1048576 2024-09-12T17:47:21.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.247+0000 7f68bc0598c0 1 > prepared part key=_multipart_WUGDIFCHNL90.2~GW4Q5UHKN191.2 size=845186 2024-09-12T17:47:21.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.247+0000 7f68bc0598c0 1 > prepared multipart upload key=WUGDIFCHNL90 upload=GW4Q5UHKN191 tag=OFLH7O2OWJLW type=write size=3990914 2024-09-12T17:47:21.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.251+0000 7f68bc0598c0 1 < completed write operation key=NLPTU26RO70S tag=06R4G4BDACKF type=write size=152594 2024-09-12T17:47:21.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.255+0000 7f68bc0598c0 1 > prepared operation key=2129SG6US3LI tag=YQ621E16EUBU type=del size=3530008 2024-09-12T17:47:21.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.259+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~BYC3SV5J0P7P.0 size=1048576 2024-09-12T17:47:21.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.259+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~BYC3SV5J0P7P.1 size=1048576 2024-09-12T17:47:21.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.263+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~BYC3SV5J0P7P.2 size=260259 2024-09-12T17:47:21.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.271+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=BYC3SV5J0P7P tag=OHWSVXSX3WWS type=write size=3405987 2024-09-12T17:47:21.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.275+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=K6UTVHX2080M type=del size=702011 2024-09-12T17:47:21.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.279+0000 7f68bc0598c0 1 < completed write operation key=QGO5SPFPT548 tag=RW3H56DR8006 type=write size=40520 2024-09-12T17:47:21.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.283+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~CBISUNANU5TQ.0 size=1048576 2024-09-12T17:47:21.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.287+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~CBISUNANU5TQ.1 size=509261 2024-09-12T17:47:21.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.287+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=CBISUNANU5TQ tag=ZP8B9FP1V3CQ type=write size=2606413 2024-09-12T17:47:21.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.287+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=ZGGP4HVCRTZV type=del 2024-09-12T17:47:21.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.291+0000 7f68bc0598c0 1 > prepared operation key=7XH1E2GEH9O2 tag=GEYH169MX3PN type=del size=3931360 2024-09-12T17:47:21.299 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.295+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=KXWRYK491OPT type=del 2024-09-12T17:47:21.302 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.299+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=FPT3GO676O52 type=del size=3363939 2024-09-12T17:47:21.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.303+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~M9LM4VI5HDSJ.0 size=1048576 2024-09-12T17:47:21.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.303+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~M9LM4VI5HDSJ.1 size=930528 2024-09-12T17:47:21.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.311+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=M9LM4VI5HDSJ tag=MSFUVIY6AYAG type=write size=3027680 2024-09-12T17:47:21.320 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.315+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~6MCUNDGYHRQR.0 size=1048576 2024-09-12T17:47:21.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.319+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~6MCUNDGYHRQR.1 size=1048576 2024-09-12T17:47:21.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.323+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~6MCUNDGYHRQR.2 size=257434 2024-09-12T17:47:21.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.323+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=6MCUNDGYHRQR tag=3AKOJFCCMLT5 type=write size=3403162 2024-09-12T17:47:21.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.327+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~ASRTJ1B3C41I.0 size=1048576 2024-09-12T17:47:21.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.327+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~ASRTJ1B3C41I.1 size=1048576 2024-09-12T17:47:21.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.331+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~ASRTJ1B3C41I.2 size=1034571 2024-09-12T17:47:21.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.339+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=ASRTJ1B3C41I tag=QJUNU8ZQOHA2 type=write size=4180299 2024-09-12T17:47:21.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.343+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~JIU69J710XYX.0 size=1048576 2024-09-12T17:47:21.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.347+0000 7f68bc0598c0 1 > prepared part key=_multipart_WPQ755ODAFNT.2~JIU69J710XYX.1 size=265512 2024-09-12T17:47:21.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.347+0000 7f68bc0598c0 1 > prepared multipart upload key=WPQ755ODAFNT upload=JIU69J710XYX tag=LGP6I1LPQ401 type=write size=2362664 2024-09-12T17:47:21.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.351+0000 7f68bc0598c0 1 < completed delete operation key=6SUA9FBDU69A tag=O0KXZZGGJKQH type=del 2024-09-12T17:47:21.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.355+0000 7f68bc0598c0 1 > prepared part key=_multipart_8P0EWBVO0BQD.2~1RNFM2GWGLSZ.0 size=655166 2024-09-12T17:47:21.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.355+0000 7f68bc0598c0 1 > prepared multipart upload key=8P0EWBVO0BQD upload=1RNFM2GWGLSZ tag=9G7Q4X9GB9LB type=write size=1703742 2024-09-12T17:47:21.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.359+0000 7f68bc0598c0 1 < completed part key=_multipart_NLPTU26RO70S.2~57994VZ93UWW.0 size=681145 2024-09-12T17:47:21.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.363+0000 7f68bc0598c0 1 < completed multipart upload key=NLPTU26RO70S upload=57994VZ93UWW tag=GEE8RZQWDBU6 type=write size=1729721 2024-09-12T17:47:21.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.367+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=PN4WU4IWYV5H type=del size=1644444 2024-09-12T17:47:21.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.371+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~JXD0EL72PONE.0 size=1048576 2024-09-12T17:47:21.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.371+0000 7f68bc0598c0 1 < canceled part key=_multipart_P8T1VX1XFJ31.2~JXD0EL72PONE.1 size=1048576 2024-09-12T17:47:21.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.375+0000 7f68bc0598c0 1 < completed part key=_multipart_P8T1VX1XFJ31.2~JXD0EL72PONE.2 size=385630 2024-09-12T17:47:21.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.379+0000 7f68bc0598c0 1 < canceled multipart upload key=P8T1VX1XFJ31 upload=JXD0EL72PONE tag=W0S7P3GKEXZ1 type=write size=3531358 2024-09-12T17:47:21.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.383+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~A2JB8NB2CZRZ.0 size=1048576 2024-09-12T17:47:21.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.387+0000 7f68bc0598c0 1 > prepared part key=_multipart_06W7N11O7F1I.2~A2JB8NB2CZRZ.1 size=331435 2024-09-12T17:47:21.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.387+0000 7f68bc0598c0 1 > prepared multipart upload key=06W7N11O7F1I upload=A2JB8NB2CZRZ tag=IWXOO93TJL5Z type=write size=2428587 2024-09-12T17:47:21.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.391+0000 7f68bc0598c0 1 < completed delete operation key=FC3K0QN3TAWH tag=KQR9URLE4D64 type=del 2024-09-12T17:47:21.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.395+0000 7f68bc0598c0 1 > prepared operation key=P8T1VX1XFJ31 tag=PNEAGREZP9J3 type=del size=1834802 2024-09-12T17:47:21.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.399+0000 7f68bc0598c0 1 < completed write operation key=9846YLKC8P8S tag=RTQFQ3BX3L3F type=write size=116505 2024-09-12T17:47:21.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.403+0000 7f68bc0598c0 1 > prepared operation key=KW3VWTA43PBM tag=63XS3V2RWIPO type=del size=4178115 2024-09-12T17:47:21.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.403+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~PKJ2P1NKQRNP.0 size=1048576 2024-09-12T17:47:21.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.407+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~PKJ2P1NKQRNP.1 size=1048576 2024-09-12T17:47:21.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.411+0000 7f68bc0598c0 1 < completed part key=_multipart_DMJZUQJ7IY60.2~PKJ2P1NKQRNP.2 size=635581 2024-09-12T17:47:21.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.415+0000 7f68bc0598c0 1 < completed multipart upload key=DMJZUQJ7IY60 upload=PKJ2P1NKQRNP tag=XC31J8KXLIM8 type=write size=3781309 2024-09-12T17:47:21.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.419+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=N1YLS7UKIWZ8 type=del size=914887 2024-09-12T17:47:21.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.423+0000 7f68bc0598c0 1 < completed delete operation key=57O6H52NHYOL tag=YWS1A6BTVNRQ type=del 2024-09-12T17:47:21.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.427+0000 7f68bc0598c0 1 > prepared operation key=3JPRQXKB5K3W tag=ASBPAW1TJ3BW type=del size=468816 2024-09-12T17:47:21.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.431+0000 7f68bc0598c0 1 < completed delete operation key=WPQ755ODAFNT tag=FCCJW8AQYP93 type=del 2024-09-12T17:47:21.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.435+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=C7AV62PM69A4 type=del size=364217 2024-09-12T17:47:21.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.439+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~GW4Q5UHKN191.0 size=1048576 2024-09-12T17:47:21.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.443+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~GW4Q5UHKN191.1 size=1048576 2024-09-12T17:47:21.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.443+0000 7f68bc0598c0 1 < completed part key=_multipart_WUGDIFCHNL90.2~GW4Q5UHKN191.2 size=845186 2024-09-12T17:47:21.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.451+0000 7f68bc0598c0 1 < completed multipart upload key=WUGDIFCHNL90 upload=GW4Q5UHKN191 tag=OFLH7O2OWJLW type=write size=3990914 2024-09-12T17:47:21.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~1SAA0GAYIGA5.0 size=1048576 2024-09-12T17:47:21.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.459+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~1SAA0GAYIGA5.1 size=1048576 2024-09-12T17:47:21.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.463+0000 7f68bc0598c0 1 > prepared part key=_multipart_XGJSQJ2IXJDK.2~1SAA0GAYIGA5.2 size=336024 2024-09-12T17:47:21.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.463+0000 7f68bc0598c0 1 > prepared multipart upload key=XGJSQJ2IXJDK upload=1SAA0GAYIGA5 tag=U1Y0YIK6Y9KD type=write size=3481752 2024-09-12T17:47:21.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.467+0000 7f68bc0598c0 1 < completed delete operation key=2129SG6US3LI tag=YQ621E16EUBU type=del 2024-09-12T17:47:21.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.471+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=9BFXUL57NQH5 type=del size=813299 2024-09-12T17:47:21.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.471+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=K6UTVHX2080M type=del 2024-09-12T17:47:21.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.475+0000 7f68bc0598c0 1 > prepared operation key=UMQLPH9XGWRZ tag=BX9VMTY7MPI5 type=del size=2269831 2024-09-12T17:47:21.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.479+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~CBISUNANU5TQ.0 size=1048576 2024-09-12T17:47:21.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.483+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~CBISUNANU5TQ.1 size=509261 2024-09-12T17:47:21.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.487+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=CBISUNANU5TQ tag=ZP8B9FP1V3CQ type=write size=2606413 2024-09-12T17:47:21.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.491+0000 7f68bc0598c0 1 > prepared part key=_multipart_OG0V0I1SDHG5.2~W45GPCMO3BCY.0 size=243126 2024-09-12T17:47:21.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.491+0000 7f68bc0598c0 1 > prepared multipart upload key=OG0V0I1SDHG5 upload=W45GPCMO3BCY tag=XIHDV828EWG3 type=write size=1291702 2024-09-12T17:47:21.499 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.495+0000 7f68bc0598c0 1 < completed delete operation key=7XH1E2GEH9O2 tag=GEYH169MX3PN type=del 2024-09-12T17:47:21.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.499+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~XWCZBAQML7C3.0 size=1048576 2024-09-12T17:47:21.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.503+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~XWCZBAQML7C3.1 size=1048576 2024-09-12T17:47:21.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.507+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~XWCZBAQML7C3.2 size=455406 2024-09-12T17:47:21.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.507+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=XWCZBAQML7C3 tag=KIU9KCEPNWZO type=write size=3601134 2024-09-12T17:47:21.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.507+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=FPT3GO676O52 type=del 2024-09-12T17:47:21.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.511+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=QGY5YW7A24Y6 type=del size=2211613 2024-09-12T17:47:21.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.515+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~6MCUNDGYHRQR.0 size=1048576 2024-09-12T17:47:21.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.519+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~6MCUNDGYHRQR.1 size=1048576 2024-09-12T17:47:21.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.519+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~6MCUNDGYHRQR.2 size=257434 2024-09-12T17:47:21.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.527+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=6MCUNDGYHRQR tag=3AKOJFCCMLT5 type=write size=3403162 2024-09-12T17:47:21.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.527+0000 7f68bc0598c0 1 > prepared operation key=UOW521GPXBQ0 tag=2QE5LQHUOD0O type=write size=893317 2024-09-12T17:47:21.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.531+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~JIU69J710XYX.0 size=1048576 2024-09-12T17:47:21.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.535+0000 7f68bc0598c0 1 < completed part key=_multipart_WPQ755ODAFNT.2~JIU69J710XYX.1 size=265512 2024-09-12T17:47:21.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.539+0000 7f68bc0598c0 1 < completed multipart upload key=WPQ755ODAFNT upload=JIU69J710XYX tag=LGP6I1LPQ401 type=write size=2362664 2024-09-12T17:47:21.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.547+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~2223HTQZMJWD.0 size=1048576 2024-09-12T17:47:21.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.547+0000 7f68bc0598c0 1 > prepared part key=_multipart_QGO5SPFPT548.2~2223HTQZMJWD.1 size=340234 2024-09-12T17:47:21.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.547+0000 7f68bc0598c0 1 > prepared multipart upload key=QGO5SPFPT548 upload=2223HTQZMJWD tag=Z0AKCXG6TWB7 type=write size=2437386 2024-09-12T17:47:21.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.551+0000 7f68bc0598c0 1 < completed part key=_multipart_8P0EWBVO0BQD.2~1RNFM2GWGLSZ.0 size=655166 2024-09-12T17:47:21.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.555+0000 7f68bc0598c0 1 < completed multipart upload key=8P0EWBVO0BQD upload=1RNFM2GWGLSZ tag=9G7Q4X9GB9LB type=write size=1703742 2024-09-12T17:47:21.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.559+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=JZG67I8XXZ9B type=del size=4019011 2024-09-12T17:47:21.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.567+0000 7f68bc0598c0 1 < suggested update operation key=UMQLPH9XGWRZ tag=PN4WU4IWYV5H type=del size=1644444 2024-09-12T17:47:21.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.575+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~US7D5VMWUIH8.0 size=1048576 2024-09-12T17:47:21.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.579+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~US7D5VMWUIH8.1 size=1048576 2024-09-12T17:47:21.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.579+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~US7D5VMWUIH8.2 size=156903 2024-09-12T17:47:21.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.579+0000 7f68bc0598c0 1 > prepared multipart upload key=2129SG6US3LI upload=US7D5VMWUIH8 tag=M626ZA6TSMD3 type=write size=3302631 2024-09-12T17:47:21.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.583+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~A2JB8NB2CZRZ.0 size=1048576 2024-09-12T17:47:21.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.587+0000 7f68bc0598c0 1 < completed part key=_multipart_06W7N11O7F1I.2~A2JB8NB2CZRZ.1 size=331435 2024-09-12T17:47:21.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.591+0000 7f68bc0598c0 1 < completed multipart upload key=06W7N11O7F1I upload=A2JB8NB2CZRZ tag=IWXOO93TJL5Z type=write size=2428587 2024-09-12T17:47:21.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.595+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=7PNBUBRTFZ70 type=del size=2458279 2024-09-12T17:47:21.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.595+0000 7f68bc0598c0 1 < completed delete operation key=P8T1VX1XFJ31 tag=PNEAGREZP9J3 type=del 2024-09-12T17:47:21.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.603+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~ZICGWE0AXW3X.0 size=1048576 2024-09-12T17:47:21.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~ZICGWE0AXW3X.1 size=1048576 2024-09-12T17:47:21.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.607+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~ZICGWE0AXW3X.2 size=419620 2024-09-12T17:47:21.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.607+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=ZICGWE0AXW3X tag=RX6JCR7WRHEF type=write size=3565348 2024-09-12T17:47:21.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.611+0000 7f68bc0598c0 1 < completed delete operation key=KW3VWTA43PBM tag=63XS3V2RWIPO type=del 2024-09-12T17:47:21.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.615+0000 7f68bc0598c0 1 > prepared operation key=S0B1RP89NO44 tag=4RNJVAHQZOS4 type=del size=3040274 2024-09-12T17:47:21.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.619+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=N1YLS7UKIWZ8 type=del 2024-09-12T17:47:21.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.619+0000 7f68bc0598c0 1 > prepared operation key=W8JEQ5NOIE6O tag=DADVS4M553QU type=write size=436328 2024-09-12T17:47:21.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.623+0000 7f68bc0598c0 1 < completed delete operation key=3JPRQXKB5K3W tag=ASBPAW1TJ3BW type=del 2024-09-12T17:47:21.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.631+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~W8GUO94OVKXP.0 size=1048576 2024-09-12T17:47:21.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.631+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~W8GUO94OVKXP.1 size=135717 2024-09-12T17:47:21.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.631+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=W8GUO94OVKXP tag=GSPNHGNXPWDM type=write size=2232869 2024-09-12T17:47:21.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.635+0000 7f68bc0598c0 1 < completed delete operation key=SBQGW2EK6I1J tag=C7AV62PM69A4 type=del 2024-09-12T17:47:21.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.639+0000 7f68bc0598c0 1 > prepared operation key=06W7N11O7F1I tag=MZ75L3QOUUDA type=del size=1293036 2024-09-12T17:47:21.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.643+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~1SAA0GAYIGA5.0 size=1048576 2024-09-12T17:47:21.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.647+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~1SAA0GAYIGA5.1 size=1048576 2024-09-12T17:47:21.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.647+0000 7f68bc0598c0 1 < completed part key=_multipart_XGJSQJ2IXJDK.2~1SAA0GAYIGA5.2 size=336024 2024-09-12T17:47:21.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.655+0000 7f68bc0598c0 1 < completed multipart upload key=XGJSQJ2IXJDK upload=1SAA0GAYIGA5 tag=U1Y0YIK6Y9KD type=write size=3481752 2024-09-12T17:47:21.663 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.659+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~W6FCR4YW223K.0 size=1048576 2024-09-12T17:47:21.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.663+0000 7f68bc0598c0 1 > prepared part key=_multipart_2129SG6US3LI.2~W6FCR4YW223K.1 size=985848 2024-09-12T17:47:21.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.663+0000 7f68bc0598c0 1 > prepared multipart upload key=2129SG6US3LI upload=W6FCR4YW223K tag=I7478HW5L1Q6 type=write size=3083000 2024-09-12T17:47:21.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.667+0000 7f68bc0598c0 1 < completed delete operation key=UOW521GPXBQ0 tag=9BFXUL57NQH5 type=del 2024-09-12T17:47:21.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.671+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~CJ0PKDVHH0OP.0 size=1048576 2024-09-12T17:47:21.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.675+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~CJ0PKDVHH0OP.1 size=1048576 2024-09-12T17:47:21.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.675+0000 7f68bc0598c0 1 > prepared part key=_multipart_S0B1RP89NO44.2~CJ0PKDVHH0OP.2 size=34895 2024-09-12T17:47:21.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.675+0000 7f68bc0598c0 1 > prepared multipart upload key=S0B1RP89NO44 upload=CJ0PKDVHH0OP tag=C9WCBM6TD7GP type=write size=3180623 2024-09-12T17:47:21.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.683+0000 7f68bc0598c0 1 < suggested update operation key=UMQLPH9XGWRZ tag=BX9VMTY7MPI5 type=del size=2269831 2024-09-12T17:47:21.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.687+0000 7f68bc0598c0 1 > prepared operation key=6SUA9FBDU69A tag=SN6S9UXVJ3MW type=del size=3706723 2024-09-12T17:47:21.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.687+0000 7f68bc0598c0 1 < completed part key=_multipart_OG0V0I1SDHG5.2~W45GPCMO3BCY.0 size=243126 2024-09-12T17:47:21.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.695+0000 7f68bc0598c0 1 < completed multipart upload key=OG0V0I1SDHG5 upload=W45GPCMO3BCY tag=XIHDV828EWG3 type=write size=1291702 2024-09-12T17:47:21.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.699+0000 7f68bc0598c0 1 > prepared part key=_multipart_7XH1E2GEH9O2.2~1VMKDGJZH2IH.0 size=24493 2024-09-12T17:47:21.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.699+0000 7f68bc0598c0 1 > prepared multipart upload key=7XH1E2GEH9O2 upload=1VMKDGJZH2IH tag=4S0A0TP6QDXX type=write size=1073069 2024-09-12T17:47:21.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.703+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~XWCZBAQML7C3.0 size=1048576 2024-09-12T17:47:21.711 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.707+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~XWCZBAQML7C3.1 size=1048576 2024-09-12T17:47:21.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.711+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~XWCZBAQML7C3.2 size=455406 2024-09-12T17:47:21.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.715+0000 7f68bc0598c0 1 < completed multipart upload key=S0B1RP89NO44 upload=XWCZBAQML7C3 tag=KIU9KCEPNWZO type=write size=3601134 2024-09-12T17:47:21.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.719+0000 7f68bc0598c0 1 > prepared operation key=9XK00RPA6Q38 tag=0D8X5BHBMQT3 type=del size=4046835 2024-09-12T17:47:21.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.723+0000 7f68bc0598c0 1 < completed delete operation key=WUGDIFCHNL90 tag=QGY5YW7A24Y6 type=del 2024-09-12T17:47:21.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.727+0000 7f68bc0598c0 1 > prepared operation key=HGY9WK7MKCYS tag=G0523RMWD0W7 type=del size=287064 2024-09-12T17:47:21.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.731+0000 7f68bc0598c0 1 < canceled operation key=UOW521GPXBQ0 tag=2QE5LQHUOD0O type=write size=893317 2024-09-12T17:47:21.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.735+0000 7f68bc0598c0 1 > prepared operation key=DMJZUQJ7IY60 tag=C2Y1W2SEQB29 type=del size=3949588 2024-09-12T17:47:21.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.739+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~2223HTQZMJWD.0 size=1048576 2024-09-12T17:47:21.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.739+0000 7f68bc0598c0 1 < completed part key=_multipart_QGO5SPFPT548.2~2223HTQZMJWD.1 size=340234 2024-09-12T17:47:21.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.747+0000 7f68bc0598c0 1 < completed multipart upload key=QGO5SPFPT548 upload=2223HTQZMJWD tag=Z0AKCXG6TWB7 type=write size=2437386 2024-09-12T17:47:21.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.751+0000 7f68bc0598c0 1 > prepared operation key=8P0EWBVO0BQD tag=C668QX6463RM type=del size=4137725 2024-09-12T17:47:21.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.755+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=JZG67I8XXZ9B type=del 2024-09-12T17:47:21.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.759+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=I71HFUTNDU6U type=del size=1304903 2024-09-12T17:47:21.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.763+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~US7D5VMWUIH8.0 size=1048576 2024-09-12T17:47:21.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.763+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~US7D5VMWUIH8.1 size=1048576 2024-09-12T17:47:21.771 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.767+0000 7f68bc0598c0 1 < completed part key=_multipart_2129SG6US3LI.2~US7D5VMWUIH8.2 size=156903 2024-09-12T17:47:21.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.771+0000 7f68bc0598c0 1 < completed multipart upload key=2129SG6US3LI upload=US7D5VMWUIH8 tag=M626ZA6TSMD3 type=write size=3302631 2024-09-12T17:47:21.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.775+0000 7f68bc0598c0 1 > prepared operation key=SBQGW2EK6I1J tag=2GQ0XYV95YCZ type=del size=1147169 2024-09-12T17:47:21.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.779+0000 7f68bc0598c0 1 < completed delete operation key=9XK00RPA6Q38 tag=7PNBUBRTFZ70 type=del 2024-09-12T17:47:21.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.783+0000 7f68bc0598c0 1 > prepared operation key=WUGDIFCHNL90 tag=NEHDD3EK96YZ type=del size=120558 2024-09-12T17:47:21.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.783+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~ZICGWE0AXW3X.0 size=1048576 2024-09-12T17:47:21.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.783+0000 7f68bc0598c0 1 < canceled part key=_multipart_S0B1RP89NO44.2~ZICGWE0AXW3X.1 size=1048576 2024-09-12T17:47:21.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.787+0000 7f68bc0598c0 1 < completed part key=_multipart_S0B1RP89NO44.2~ZICGWE0AXW3X.2 size=419620 2024-09-12T17:47:21.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.791+0000 7f68bc0598c0 1 < canceled multipart upload key=S0B1RP89NO44 upload=ZICGWE0AXW3X tag=RX6JCR7WRHEF type=write size=3565348 2024-09-12T17:47:21.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.795+0000 7f68bc0598c0 1 > prepared operation key=FC3K0QN3TAWH tag=GFWBHYJEB2OZ type=write size=709738 2024-09-12T17:47:21.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.799+0000 7f68bc0598c0 1 < completed delete operation key=S0B1RP89NO44 tag=4RNJVAHQZOS4 type=del 2024-09-12T17:47:21.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.803+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~ISDY25CNGQGX.0 size=1048576 2024-09-12T17:47:21.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.807+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~ISDY25CNGQGX.1 size=1048576 2024-09-12T17:47:21.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.811+0000 7f68bc0598c0 1 > prepared part key=_multipart_RTY1OT2PSAAY.2~ISDY25CNGQGX.2 size=566445 2024-09-12T17:47:21.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.811+0000 7f68bc0598c0 1 > prepared multipart upload key=RTY1OT2PSAAY upload=ISDY25CNGQGX tag=HUWIJKBDI51C type=write size=3712173 2024-09-12T17:47:21.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.811+0000 7f68bc0598c0 1 < completed write operation key=W8JEQ5NOIE6O tag=DADVS4M553QU type=write size=436328 2024-09-12T17:47:21.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.815+0000 7f68bc0598c0 1 > prepared operation key=9846YLKC8P8S tag=LHR5B8IJ5SPB type=del size=3096515 2024-09-12T17:47:21.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.819+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~W8GUO94OVKXP.0 size=1048576 2024-09-12T17:47:21.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.823+0000 7f68bc0598c0 1 < completed part key=_multipart_RTY1OT2PSAAY.2~W8GUO94OVKXP.1 size=135717 2024-09-12T17:47:21.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.827+0000 7f68bc0598c0 1 < completed multipart upload key=RTY1OT2PSAAY upload=W8GUO94OVKXP tag=GSPNHGNXPWDM type=write size=2232869 2024-09-12T17:47:21.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~9KPE6A46MRZT.0 size=1048576 2024-09-12T17:47:21.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.835+0000 7f68bc0598c0 1 > prepared part key=_multipart_FC3K0QN3TAWH.2~9KPE6A46MRZT.1 size=865265 2024-09-12T17:47:21.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.835+0000 7f68bc0598c0 1 > prepared multipart upload key=FC3K0QN3TAWH upload=9KPE6A46MRZT tag=3H7QH4CQ9FT2 type=write size=2962417 2024-09-12T17:47:21.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.839+0000 7f68bc0598c0 1 < completed delete operation key=06W7N11O7F1I tag=MZ75L3QOUUDA type=del 2024-09-12T17:47:21.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:47:21.843+0000 7f68bc0598c0 1 > prepared operation key=BKAT5SGAC5Z8 tag=ASD494O3GW2O type=del size=1818495 2024-09-12T17:47:21.846 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] cls_rgw_stats.simulate (20181 ms) 2024-09-12T17:47:21.846 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 1 test from cls_rgw_stats (20181 ms total) 2024-09-12T17:47:21.847 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:47:21.847 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:47:22.477 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 1 test from 1 test suite ran. (22690 ms total) 2024-09-12T17:47:22.477 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 1 test. 2024-09-12T17:47:22.484 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:47:22.485 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:47:22.538 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T17:47:22.539 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T17:47:22.539 DEBUG:teuthology.orchestra.run.smithi157:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T17:47:22.603 INFO:tasks.workunit.client.0.smithi157.stdout:Running main() from gmock_main.cc 2024-09-12T17:47:22.603 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T17:47:22.603 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:47:24.478 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 31 tests from CmpOmap 2024-09-12T17:47:24.478 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T17:47:24.501 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (23 ms) 2024-09-12T17:47:24.501 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T17:47:24.526 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (25 ms) 2024-09-12T17:47:24.526 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T17:47:24.533 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (7 ms) 2024-09-12T17:47:24.533 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T17:47:24.538 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (5 ms) 2024-09-12T17:47:24.538 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T17:47:24.553 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_str (14 ms) 2024-09-12T17:47:24.553 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T17:47:24.567 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_u64 (15 ms) 2024-09-12T17:47:24.567 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T17:47:24.574 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (6 ms) 2024-09-12T17:47:24.574 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T17:47:24.582 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (8 ms) 2024-09-12T17:47:24.582 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T17:47:24.591 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (8 ms) 2024-09-12T17:47:24.591 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T17:47:24.602 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (11 ms) 2024-09-12T17:47:24.602 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T17:47:24.604 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-09-12T17:47:24.604 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T17:47:24.606 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (2 ms) 2024-09-12T17:47:24.606 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T17:47:24.621 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (15 ms) 2024-09-12T17:47:24.621 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T17:47:24.639 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (18 ms) 2024-09-12T17:47:24.639 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T17:47:24.654 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (15 ms) 2024-09-12T17:47:24.654 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T17:47:24.669 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (15 ms) 2024-09-12T17:47:24.669 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T17:47:24.689 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_set_vals_str (20 ms) 2024-09-12T17:47:24.689 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T17:47:24.709 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (20 ms) 2024-09-12T17:47:24.709 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T17:47:24.716 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (8 ms) 2024-09-12T17:47:24.717 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T17:47:24.722 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (6 ms) 2024-09-12T17:47:24.723 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T17:47:24.725 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-09-12T17:47:24.725 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T17:47:24.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-12T17:47:24.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T17:47:24.745 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (17 ms) 2024-09-12T17:47:24.745 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T17:47:24.761 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (16 ms) 2024-09-12T17:47:24.761 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T17:47:24.780 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (19 ms) 2024-09-12T17:47:24.780 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T17:47:24.801 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (22 ms) 2024-09-12T17:47:24.801 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T17:47:24.807 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (5 ms) 2024-09-12T17:47:24.807 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T17:47:24.814 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-12T17:47:24.814 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T17:47:24.816 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-12T17:47:24.817 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T17:47:24.819 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T17:47:24.819 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T17:47:24.839 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (20 ms) 2024-09-12T17:47:24.839 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 31 tests from CmpOmap (361 ms total) 2024-09-12T17:47:24.839 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:47:24.839 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:47:25.496 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 31 tests from 1 test suite ran. (2893 ms total) 2024-09-12T17:47:25.496 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 31 tests. 2024-09-12T17:47:25.502 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:47:25.502 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:47:25.558 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T17:47:25.559 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T17:47:25.560 DEBUG:teuthology.orchestra.run.smithi157:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T17:47:25.625 INFO:tasks.workunit.client.0.smithi157.stdout:Running main() from gmock_main.cc 2024-09-12T17:47:25.625 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:47:25.625 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:47:25.625 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T17:47:25.625 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T17:47:28.557 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2932 ms) 2024-09-12T17:47:28.557 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T17:47:31.606 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3049 ms) 2024-09-12T17:47:31.606 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T17:47:34.643 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.Reserve (3037 ms) 2024-09-12T17:47:34.643 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T17:47:37.651 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3009 ms) 2024-09-12T17:47:37.652 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T17:47:41.697 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.Commit (4046 ms) 2024-09-12T17:47:41.698 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T17:47:45.753 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.Stats (4046 ms) 2024-09-12T17:47:45.753 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T17:47:49.795 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4051 ms) 2024-09-12T17:47:49.796 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T17:47:52.821 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.Abort (3026 ms) 2024-09-12T17:47:52.821 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T17:47:55.847 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.ReserveError (3026 ms) 2024-09-12T17:47:55.847 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T17:47:58.892 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.CommitError (3045 ms) 2024-09-12T17:47:58.892 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T17:48:01.914 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.AbortError (3023 ms) 2024-09-12T17:48:01.915 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T17:48:04.981 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3062 ms) 2024-09-12T17:48:04.981 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T17:48:08.012 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3036 ms) 2024-09-12T17:48:08.013 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T17:48:11.037 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3025 ms) 2024-09-12T17:48:11.038 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T17:48:14.084 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3046 ms) 2024-09-12T17:48:14.084 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T17:48:17.145 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3058 ms) 2024-09-12T17:48:17.145 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T17:48:20.165 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3023 ms) 2024-09-12T17:48:20.165 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T17:48:23.186 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.Cleanup (3022 ms) 2024-09-12T17:48:23.187 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T17:48:35.487 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12300 ms) 2024-09-12T17:48:35.487 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T17:48:40.550 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5063 ms) 2024-09-12T17:48:40.550 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T17:48:54.508 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13959 ms) 2024-09-12T17:48:54.508 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T17:49:00.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6053 ms) 2024-09-12T17:49:00.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T17:49:10.515 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (9953 ms) 2024-09-12T17:49:10.515 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T17:49:20.522 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10008 ms) 2024-09-12T17:49:20.522 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 24 tests from TestCls2PCQueue (114898 ms total) 2024-09-12T17:49:20.522 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:49:20.522 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:49:20.522 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 24 tests from 1 test suite ran. (114898 ms total) 2024-09-12T17:49:20.522 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 24 tests. 2024-09-12T17:49:20.530 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:49:20.530 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:49:20.585 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T17:49:20.587 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T17:49:20.587 DEBUG:teuthology.orchestra.run.smithi157:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T17:49:20.667 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:20.667 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:20.667 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:49:20.667 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:49:22.520 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 4 tests from ClsAccount 2024-09-12T17:49:22.521 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsAccount.add 2024-09-12T17:49:22.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsAccount.add (41 ms) 2024-09-12T17:49:22.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsAccount.get 2024-09-12T17:49:22.572 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsAccount.get (10 ms) 2024-09-12T17:49:22.572 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsAccount.rm 2024-09-12T17:49:22.655 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsAccount.rm (83 ms) 2024-09-12T17:49:22.655 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] ClsAccount.list 2024-09-12T17:49:22.699 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] ClsAccount.list (44 ms) 2024-09-12T17:49:22.699 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 4 tests from ClsAccount (178 ms total) 2024-09-12T17:49:22.699 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:49:22.699 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:49:23.528 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 4 tests from 1 test suite ran. (2861 ms total) 2024-09-12T17:49:23.528 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 4 tests. 2024-09-12T17:49:23.533 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:49:23.533 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:49:23.589 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T17:49:23.590 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T17:49:23.590 DEBUG:teuthology.orchestra.run.smithi157:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T17:49:23.664 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:23.664 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:23.665 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T17:49:23.665 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:49:25.540 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T17:49:25.541 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T17:49:25.582 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] rgw_gc_log.init_existing_queue (43 ms) 2024-09-12T17:49:25.582 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T17:49:25.587 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] rgw_gc_log.init_existing_omap (5 ms) 2024-09-12T17:49:25.588 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T17:49:25.594 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (6 ms) 2024-09-12T17:49:25.594 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T17:49:25.596 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-12T17:49:25.596 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T17:49:25.602 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] rgw_gc_log.defer1_after_init (6 ms) 2024-09-12T17:49:25.602 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T17:49:25.605 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-12T17:49:25.605 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 6 tests from rgw_gc_log (66 ms total) 2024-09-12T17:49:25.605 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:49:25.605 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:49:26.564 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 6 tests from 1 test suite ran. (2899 ms total) 2024-09-12T17:49:26.564 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 6 tests. 2024-09-12T17:49:26.573 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:49:26.574 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:49:26.629 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T17:49:26.630 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T17:49:26.630 DEBUG:teuthology.orchestra.run.smithi157:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T17:49:26.703 INFO:tasks.workunit.client.0.smithi157.stdout:Running main() from gmock_main.cc 2024-09-12T17:49:26.703 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:49:26.703 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:49:26.703 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T17:49:26.703 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T17:49:26.703 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns= i= 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns= i= 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns= i= 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout: "obj1": { 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.704 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.705 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.706 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.706 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.706 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.706 INFO:tasks.workunit.client.0.smithi157.stdout: "obj2": { 2024-09-12T17:49:26.706 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.706 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.706 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.706 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.706 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.706 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.706 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.707 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.707 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.707 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.707 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.707 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.707 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.707 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.707 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.707 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3": { 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.708 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3-2": { 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.709 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.710 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.711 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.711 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns=ns i= 2024-09-12T17:49:26.711 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.711 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.711 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns=ns i= 2024-09-12T17:49:26.711 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.711 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj 2024-09-12T17:49:26.711 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns=ns i= 2024-09-12T17:49:26.711 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.711 INFO:tasks.workunit.client.0.smithi157.stdout: "obj1": { 2024-09-12T17:49:26.711 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.712 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: "obj2": { 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.713 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3": { 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.714 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.715 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3-2": { 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.716 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns= i=v1 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.717 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns= i=v1 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns= i=v1 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout: "obj1": { 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.718 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: "obj2": { 2024-09-12T17:49:26.719 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.720 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.720 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.720 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.720 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.720 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.720 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.720 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.720 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.720 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.720 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.720 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.721 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.721 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.721 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.721 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.721 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.721 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3": { 2024-09-12T17:49:26.721 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.721 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.721 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.722 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.723 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3-2": { 2024-09-12T17:49:26.723 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.723 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.723 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.723 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.723 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.723 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.723 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.723 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.723 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.723 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.724 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: _obj[v1] 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout: "obj1": { 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.725 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.726 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.726 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.726 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.726 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.726 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.726 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.726 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.726 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.726 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.726 INFO:tasks.workunit.client.0.smithi157.stdout: "obj2": { 2024-09-12T17:49:26.726 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.727 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.727 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.727 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.727 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.727 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.727 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.727 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.727 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.727 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.727 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.728 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.728 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.728 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.728 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.728 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.728 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.728 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3": { 2024-09-12T17:49:26.728 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.728 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.728 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.728 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.729 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3-2": { 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.730 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_obj", 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns= i= 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.731 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns= i= 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns= i= 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout: "obj1": { 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.732 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: "obj2": { 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.733 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.734 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.735 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.735 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.735 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3": { 2024-09-12T17:49:26.735 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.735 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.735 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.735 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.735 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.735 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.735 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3-2": { 2024-09-12T17:49:26.736 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.737 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns=ns i= 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns=ns i= 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj 2024-09-12T17:49:26.738 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns=ns i= 2024-09-12T17:49:26.739 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.739 INFO:tasks.workunit.client.0.smithi157.stdout: "obj1": { 2024-09-12T17:49:26.739 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.739 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.739 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.739 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.739 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.739 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.740 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.740 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.740 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.740 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.740 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.740 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.740 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.741 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.741 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.741 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.741 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.741 INFO:tasks.workunit.client.0.smithi157.stdout: "obj2": { 2024-09-12T17:49:26.741 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.742 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.742 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.742 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.742 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.743 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.743 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.743 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.743 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.744 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.744 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.744 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.744 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.744 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.744 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3": { 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.745 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3-2": { 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.746 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.747 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.748 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.748 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.748 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns= i=v1 2024-09-12T17:49:26.748 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.748 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.748 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns= i=v1 2024-09-12T17:49:26.748 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.748 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.748 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns= i=v1 2024-09-12T17:49:26.749 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.749 INFO:tasks.workunit.client.0.smithi157.stdout: "obj1": { 2024-09-12T17:49:26.749 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.749 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.749 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.749 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.749 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.749 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.749 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.749 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: "obj2": { 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.750 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.751 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3": { 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.752 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.753 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.753 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.753 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.753 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.753 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.753 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.753 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3-2": { 2024-09-12T17:49:26.753 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.753 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.753 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.754 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout:parsed: obj[v1] 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout: "obj1": { 2024-09-12T17:49:26.755 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.756 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.756 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.756 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.756 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.756 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.756 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.756 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.756 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.756 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: "obj2": { 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.757 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3": { 2024-09-12T17:49:26.758 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.759 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: "obj3-2": { 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.760 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "obj", 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "v1", 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.761 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.762 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.763 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker_myobj", 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.764 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.765 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.766 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.767 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.768 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker_myobj", 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.769 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.770 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.771 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.772 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.773 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.774 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.775 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.776 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.777 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.778 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.779 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.780 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.781 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.782 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.783 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.784 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.785 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.786 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.787 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.788 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.789 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.790 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.791 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.792 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.793 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.794 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.795 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.796 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.797 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.798 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.799 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker___myobj", 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj" 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.800 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.801 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.802 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.803 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker___myobj", 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj" 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.804 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.805 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.806 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.807 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.808 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.809 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.810 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.811 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.812 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.813 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.814 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.815 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.816 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:49:26.817 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj" 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.818 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.819 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.819 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.819 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.819 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.819 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.819 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.819 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.819 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.819 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.819 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.820 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.821 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj" 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.822 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.823 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.824 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.825 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.826 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.827 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.827 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.827 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.827 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:49:26.827 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.827 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.827 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.827 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.827 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.827 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.828 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.828 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.828 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.828 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.828 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.828 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.828 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.828 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.828 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.828 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.828 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.829 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.830 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.831 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.832 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.833 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.834 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.835 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.836 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.836 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.836 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.836 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.836 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.836 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.836 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.836 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.836 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker___myobj_", 2024-09-12T17:49:26.836 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj_" 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.837 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.838 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.839 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.840 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker___myobj_", 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj_" 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.841 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.842 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.843 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.844 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.845 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.846 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.847 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.848 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.849 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.850 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.851 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.852 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.853 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj_" 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.854 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.855 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.856 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.857 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.858 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj_" 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.859 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.860 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.861 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.862 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": "default-placement.data", 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.863 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "test", 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": "", 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": "" 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.866 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.866 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.866 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.866 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.866 INFO:tasks.workunit.client.0.smithi157.stdout: "obj": { 2024-09-12T17:49:26.866 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.866 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.866 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.866 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.866 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.867 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.868 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.869 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker_myobj", 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.870 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.871 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker_myobj 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker_myobj", 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.872 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.873 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker_myobj 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.874 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.875 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.876 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.876 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.876 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T17:49:26.876 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.876 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.876 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.876 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:49:26.877 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.877 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.877 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.877 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.877 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.877 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.877 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.877 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.877 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.877 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.878 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.879 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.880 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.881 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.882 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.883 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.884 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:49:26.885 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.886 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "myobj", 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.887 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker___myobj", 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj" 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.888 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker___myobj 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.889 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker___myobj", 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj" 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.890 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker___myobj 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.891 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.892 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.893 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.894 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.895 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj" 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.896 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.897 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj" 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.898 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.899 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.900 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.901 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.902 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj", 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.903 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker___myobj_", 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj_" 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.904 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.905 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker___myobj_", 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj_" 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.906 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.907 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.908 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.909 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.910 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.911 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "", 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj_" 2024-09-12T17:49:26.912 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.913 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:49:26.914 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "marker__myobj_" 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.915 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "" 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj": { 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.916 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj": { 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.917 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout: "raw_obj2": { 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout: "pool": ".data-pool", 2024-09-12T17:49:26.918 INFO:tasks.workunit.client.0.smithi157.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout: "loc": "" 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout: "new_obj2": { 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket": { 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "ebtest", 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout: "marker": "marker", 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_id": "bucket-id", 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout: "tenant": "", 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout: "explicit_placement": { 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout: "data_pool": ".data-pool", 2024-09-12T17:49:26.919 INFO:tasks.workunit.client.0.smithi157.stdout: "data_extra_pool": "", 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout: "index_pool": ".index-pool" 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout: "key": { 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout: "name": "_myobj_", 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout: "instance": "inst", 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout: "ns": "ns" 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T17:49:26.920 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:49:26.921 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:49:26.921 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T17:49:26.921 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 4 tests. 2024-09-12T17:49:26.921 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:49:26.921 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:49:26.936 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T17:49:26.937 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T17:49:26.937 DEBUG:teuthology.orchestra.run.smithi157:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T17:49:27.183 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:27.183 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:27.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.414+0000 7f8359114640 0 --2- 172.21.15.157:0/2296331662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd9eb3f090 0x55fd9ec26e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:49:27.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.438+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.438+0000 7f835ae0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:27.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.442+0000 7f835ae0d9c0 20 realm 2024-09-12T17:49:27.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.442+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.442+0000 7f835ae0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:27.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.442+0000 7f835ae0d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:27.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.442+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.442+0000 7f835ae0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:27.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.442+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.442+0000 7f835ae0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:27.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.442+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.442+0000 7f835ae0d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:27.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.442+0000 7f835ae0d9c0 20 searching for the correct realm 2024-09-12T17:49:27.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.446+0000 7f8358913640 0 -- 172.21.15.157:0/4279849272 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f83500c4040 msgr2=0x7f83500db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:27.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.454+0000 7f8358112640 0 -- 172.21.15.157:0/4279849272 >> [v2:172.21.15.157:6800/2182114182,v1:172.21.15.157:6801/2182114182] conn(0x55fd9ece3bb0 msgr2=0x55fd9ece5fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:27.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:49:27.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:27.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:27.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:49:27.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:27.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:27.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:27.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:27.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:27.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 zone default found 2024-09-12T17:49:27.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 4 Realm: () 2024-09-12T17:49:27.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:49:27.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:49:27.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:27.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 zonegroup default 2024-09-12T17:49:27.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:27.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.466+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.470+0000 7f835ae0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:27.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.470+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.470+0000 7f835ae0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:27.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.470+0000 7f835ae0d9c0 20 started sync module instance, tier type = 2024-09-12T17:49:27.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.470+0000 7f835ae0d9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:49:27.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.486+0000 7f835ae0d9c0 20 add_watcher() i=0 2024-09-12T17:49:27.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.486+0000 7f835ae0d9c0 20 add_watcher() i=1 2024-09-12T17:49:27.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.486+0000 7f835ae0d9c0 20 add_watcher() i=2 2024-09-12T17:49:27.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.486+0000 7f835ae0d9c0 20 add_watcher() i=3 2024-09-12T17:49:27.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.486+0000 7f835ae0d9c0 20 add_watcher() i=4 2024-09-12T17:49:27.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.486+0000 7f835ae0d9c0 20 add_watcher() i=5 2024-09-12T17:49:27.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.486+0000 7f835ae0d9c0 20 add_watcher() i=6 2024-09-12T17:49:27.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.486+0000 7f835ae0d9c0 20 add_watcher() i=7 2024-09-12T17:49:27.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.486+0000 7f835ae0d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:27.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f820efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:27.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:27.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:27.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 5 note: GC not initialized 2024-09-12T17:49:27.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f820dfe3640 20 reqs_thread_entry: start 2024-09-12T17:49:27.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:49:27.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 20 Filter name: none 2024-09-12T17:49:27.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f817f7fe640 20 reqs_thread_entry: start 2024-09-12T17:49:27.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T17:49:27.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:27.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T17:49:27.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:49:27.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T17:49:27.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:27.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T17:49:27.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:49:27.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 10 cache get: name=default.rgw.meta+users.keys+bOTgzZlfq+63ijJnFPGy71YEzTA= : miss 2024-09-12T17:49:27.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.490+0000 7f835ae0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:27.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.494+0000 7f835ae0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:27.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.494+0000 7f835ae0d9c0 10 cache put: name=default.rgw.meta+users.keys+bOTgzZlfq+63ijJnFPGy71YEzTA= info.flags=0x0 2024-09-12T17:49:27.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.494+0000 7f835ae0d9c0 10 adding default.rgw.meta+users.keys+bOTgzZlfq+63ijJnFPGy71YEzTA= to cache LRU end 2024-09-12T17:49:27.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.494+0000 7f835ae0d9c0 10 cache get: name=default.rgw.meta+users.keys+bOTgzZlfq+63ijJnFPGy71YEzTA= : hit (negative entry) 2024-09-12T17:49:27.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.494+0000 7f835ae0d9c0 10 cache get: name=default.rgw.meta+users.keys+bOTgzZlfq+63ijJnFPGy71YEzTA= : hit (negative entry) 2024-09-12T17:49:27.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.494+0000 7f835ae0d9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:49:27.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.494+0000 7f835ae0d9c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:49:27.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.494+0000 7f835ae0d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T17:49:27.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.498+0000 7f822ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824001 cookie 94547779437296 notifier 5282 bl.length()=697 2024-09-12T17:49:27.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.498+0000 7f822ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:49:27.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.498+0000 7f822ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:49:27.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.502+0000 7f835ae0d9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:49:27.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.502+0000 7f835ae0d9c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:49:27.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.502+0000 7f835ae0d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T17:49:27.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.502+0000 7f822ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824000 cookie 94547779434672 notifier 5282 bl.length()=194 2024-09-12T17:49:27.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.502+0000 7f822ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:49:27.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.502+0000 7f822ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:49:27.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.510+0000 7f835ae0d9c0 10 cache put: name=default.rgw.meta+users.keys+bOTgzZlfq+63ijJnFPGy71YEzTA= info.flags=0x7 2024-09-12T17:49:27.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.510+0000 7f835ae0d9c0 10 moving default.rgw.meta+users.keys+bOTgzZlfq+63ijJnFPGy71YEzTA= to cache LRU end 2024-09-12T17:49:27.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.510+0000 7f835ae0d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:bOTgzZlfq+63ijJnFPGy71YEzTA=, ofs0, ns] 2024-09-12T17:49:27.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.510+0000 7f822f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824000 cookie 94547779449024 notifier 5282 bl.length()=203 2024-09-12T17:49:27.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.510+0000 7f822f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+bOTgzZlfq+63ijJnFPGy71YEzTA= info.flags=0x7 2024-09-12T17:49:27.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.510+0000 7f822f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+bOTgzZlfq+63ijJnFPGy71YEzTA= to cache LRU end 2024-09-12T17:49:27.511 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:49:27.511 INFO:tasks.workunit.client.0.smithi157.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T17:49:27.511 INFO:tasks.workunit.client.0.smithi157.stdout: "display_name": "librgw test user", 2024-09-12T17:49:27.511 INFO:tasks.workunit.client.0.smithi157.stdout: "email": "librgw@example.com", 2024-09-12T17:49:27.511 INFO:tasks.workunit.client.0.smithi157.stdout: "suspended": 0, 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: "max_buckets": 1000, 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: "subusers": [], 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: "keys": [ 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: { 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: "user": "ceph-test-librgw-file", 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: "access_key": "bOTgzZlfq+63ijJnFPGy71YEzTA=", 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: "secret_key": "uD5HhBve1s0VAx2gvvcqvOBiVZAMQev6uRiMVEwoFj7lnUxYb/B7+A==", 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: "active": true, 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: "create_date": "2024-09-12T17:49:27.495928Z" 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: ], 2024-09-12T17:49:27.512 INFO:tasks.workunit.client.0.smithi157.stdout: "swift_keys": [], 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: "caps": [], 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: "default_placement": "", 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: "default_storage_class": "", 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: "placement_tags": [], 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_quota": { 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: "enabled": false, 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: "check_on_raw": false, 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size": -1, 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size_kb": 0, 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: "max_objects": -1 2024-09-12T17:49:27.513 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "user_quota": { 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "enabled": false, 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "check_on_raw": false, 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size": -1, 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size_kb": 0, 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "max_objects": -1 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "temp_url_keys": [], 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "type": "rgw", 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "mfa_ids": [], 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "account_id": "", 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "path": "/", 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "create_date": "2024-09-12T17:49:27.495905Z", 2024-09-12T17:49:27.514 INFO:tasks.workunit.client.0.smithi157.stdout: "tags": [], 2024-09-12T17:49:27.515 INFO:tasks.workunit.client.0.smithi157.stdout: "group_ids": [] 2024-09-12T17:49:27.515 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:49:27.515 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:49:27.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.514+0000 7f820efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:27.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.518+0000 7f835ae0d9c0 20 remove_watcher() i=0 2024-09-12T17:49:27.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.518+0000 7f835ae0d9c0 2 removed watcher, disabling cache 2024-09-12T17:49:27.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.518+0000 7f835ae0d9c0 20 remove_watcher() i=1 2024-09-12T17:49:27.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.522+0000 7f835ae0d9c0 20 remove_watcher() i=2 2024-09-12T17:49:27.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.522+0000 7f835ae0d9c0 20 remove_watcher() i=3 2024-09-12T17:49:27.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.526+0000 7f835ae0d9c0 20 remove_watcher() i=4 2024-09-12T17:49:27.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.526+0000 7f835ae0d9c0 20 remove_watcher() i=5 2024-09-12T17:49:27.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.530+0000 7f835ae0d9c0 20 remove_watcher() i=6 2024-09-12T17:49:27.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:27.530+0000 7f835ae0d9c0 20 remove_watcher() i=7 2024-09-12T17:49:27.543 INFO:tasks.workunit.client.0.smithi157.stdout:phase 1.1 2024-09-12T17:49:27.561 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:49:27.561 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:49:27.561 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:49:27.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:49:27.574 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:27.574 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:27.872 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (311 ms) 2024-09-12T17:49:27.872 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:49:27.874 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-09-12T17:49:27.875 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:49:27.875 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:49:27.875 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:49:27.890 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T17:49:27.898 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/f1 2024-09-12T17:49:27.906 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/f2 2024-09-12T17:49:27.913 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T17:49:27.920 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T17:49:27.928 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T17:49:27.935 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T17:49:27.942 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T17:49:27.950 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T17:49:27.957 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T17:49:27.964 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T17:49:27.971 INFO:tasks.workunit.client.0.smithi157.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T17:49:27.979 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SETUP_HIER1 (104 ms) 2024-09-12T17:49:27.979 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:49:28.238 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SETUP_DIRS1 (259 ms) 2024-09-12T17:49:28.238 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:49:28.238 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:49:28.238 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:49:28.283 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (45 ms) 2024-09-12T17:49:28.283 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:49:28.394 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (111 ms) 2024-09-12T17:49:28.394 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:49:28.394 INFO:tasks.workunit.client.0.smithi157.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T17:49:28.412 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (18 ms) 2024-09-12T17:49:28.412 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:49:28.412 INFO:tasks.workunit.client.0.smithi157.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T17:49:28.431 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (19 ms) 2024-09-12T17:49:28.431 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:49:28.431 INFO:tasks.workunit.client.0.smithi157.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:49:28.431 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:49:28.431 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:49:28.431 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:49:28.431 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:49:28.431 INFO:tasks.workunit.client.0.smithi157.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:49:28.432 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:49:28.434 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:49:28.434 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:49:28.437 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:49:28.437 INFO:tasks.workunit.client.0.smithi157.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:49:28.437 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:49:28.439 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:49:28.439 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:49:28.442 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:49:28.442 INFO:tasks.workunit.client.0.smithi157.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:49:28.442 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:49:28.445 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:49:28.445 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:49:28.447 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:49:28.447 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READ_DIRS1 (16 ms) 2024-09-12T17:49:28.447 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READF_SETUP1 (230 ms) 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:49:28.677 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:49:28.678 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:49:28.678 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:49:28.678 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:49:28.678 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:49:28.678 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:49:28.678 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:49:28.678 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:49:28.678 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:49:28.692 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:49:28.694 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:49:28.701 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:49:28.705 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:49:28.713 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:49:28.715 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:49:28.716 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:49:28.717 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:49:28.719 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:49:28.720 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:49:28.721 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:49:28.726 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:49:28.726 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:49:28.726 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:49:28.726 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:49:28.726 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:49:28.726 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.HIER1 (49 ms) 2024-09-12T17:49:28.726 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:49:28.726 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:49:28.726 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:49:28.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:49:28.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:49:28.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:49:28.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:49:28.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:49:28.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:49:28.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:49:28.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:49:28.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:49:28.727 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:49:28.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:28.726+0000 7fe28620ca80 -1 shutting down 2024-09-12T17:49:28.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:28.730+0000 7fe15ff5e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 55038, si_uid : 1000, si_addr0x3e80000d6fe, si_status0 2024-09-12T17:49:58.198 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (29472 ms) 2024-09-12T17:49:58.198 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 24 tests from LibRGW (30637 ms total) 2024-09-12T17:49:58.199 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:49:58.199 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:49:58.199 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 24 tests from 1 test suite ran. (30637 ms total) 2024-09-12T17:49:58.199 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 24 tests. 2024-09-12T17:49:58.209 INFO:tasks.workunit.client.0.smithi157.stdout:phase 1.2 2024-09-12T17:49:58.232 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:49:58.233 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:49:58.233 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:49:58.233 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:49:58.242 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:58.243 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:58.558 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (325 ms) 2024-09-12T17:49:58.558 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:49:58.560 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:49:58.560 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:49:58.560 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:49:58.561 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:49:58.562 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:49:58.563 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:49:58.564 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:49:58.564 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:49:58.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:58.562+0000 7feef3626a80 -1 shutting down 2024-09-12T17:49:58.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:49:58.562+0000 7fedcd378640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 55683, si_uid : 1000, si_addr0x3e80000d983, si_status0 2024-09-12T17:50:28.596 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (30036 ms) 2024-09-12T17:50:28.596 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 24 tests from LibRGW (30363 ms total) 2024-09-12T17:50:28.596 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:50:28.596 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:50:28.596 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 24 tests from 1 test suite ran. (30363 ms total) 2024-09-12T17:50:28.596 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 24 tests. 2024-09-12T17:50:28.604 INFO:tasks.workunit.client.0.smithi157.stdout:phase 1.3 2024-09-12T17:50:28.626 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:50:28.626 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:50:28.627 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:50:28.627 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:50:28.639 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:28.639 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:29.356 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (730 ms) 2024-09-12T17:50:29.356 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:50:29.358 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:50:29.358 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:50:29.358 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:50:29.358 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:50:29.365 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SETUP_HIER1 (7 ms) 2024-09-12T17:50:29.365 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:50:29.480 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SETUP_DIRS1 (114 ms) 2024-09-12T17:50:29.480 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:50:29.480 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:50:29.480 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:50:29.480 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:50:29.480 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:50:29.480 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:50:29.481 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:50:29.482 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:50:29.483 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:50:29.483 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:50:29.485 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:50:29.485 INFO:tasks.workunit.client.0.smithi157.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:50:29.486 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:50:29.488 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:50:29.488 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:50:29.490 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:50:29.490 INFO:tasks.workunit.client.0.smithi157.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:50:29.490 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:50:29.492 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:50:29.492 INFO:tasks.workunit.client.0.smithi157.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:50:29.495 INFO:tasks.workunit.client.0.smithi157.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:50:29.495 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READ_DIRS1 (15 ms) 2024-09-12T17:50:29.495 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:50:29.495 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:50:29.495 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:50:29.495 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:50:29.495 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:50:29.495 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:50:29.495 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:50:29.495 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:50:29.496 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:50:29.514 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:50:29.515 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:50:29.522 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:50:29.527 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:50:29.535 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:50:29.537 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:50:29.538 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:50:29.539 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:50:29.541 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:50:29.542 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:50:29.544 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:50:29.548 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:50:29.548 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:50:29.549 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:50:29.549 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:50:29.549 INFO:tasks.workunit.client.0.smithi157.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:50:29.549 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.HIER1 (54 ms) 2024-09-12T17:50:29.549 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:50:29.549 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:50:29.549 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:50:29.549 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:50:29.549 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:50:29.549 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:50:29.550 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:50:29.550 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:50:29.550 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:50:29.550 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:50:29.550 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:50:29.550 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:50:29.550 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:50:29.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:50:29.549+0000 7f36ee131a80 -1 shutting down 2024-09-12T17:50:29.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:50:29.553+0000 7f35c7e83640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56328, si_uid : 1000, si_addr0x3e80000dc08, si_status0 2024-09-12T17:50:59.751 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (30202 ms) 2024-09-12T17:50:59.751 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 24 tests from LibRGW (31124 ms total) 2024-09-12T17:50:59.751 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:50:59.751 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:50:59.751 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 24 tests from 1 test suite ran. (31124 ms total) 2024-09-12T17:50:59.751 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 24 tests. 2024-09-12T17:50:59.760 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2.1 2024-09-12T17:50:59.783 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:50:59.783 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:50:59.783 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:50:59.784 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:50:59.795 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:59.795 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:00.375 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (592 ms) 2024-09-12T17:51:00.376 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:51:00.377 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-09-12T17:51:00.377 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:51:00.392 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CREATE_BUCKET (14 ms) 2024-09-12T17:51:00.392 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:51:00.393 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:51:00.393 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:51:00.406 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave0 2024-09-12T17:51:00.424 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave1 2024-09-12T17:51:00.442 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave2 2024-09-12T17:51:00.458 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave3 2024-09-12T17:51:00.477 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave4 2024-09-12T17:51:00.498 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave5 2024-09-12T17:51:00.533 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave6 2024-09-12T17:51:00.557 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave7 2024-09-12T17:51:00.577 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave8 2024-09-12T17:51:00.601 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave9 2024-09-12T17:51:00.601 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (209 ms) 2024-09-12T17:51:00.601 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:51:01.092 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (491 ms) 2024-09-12T17:51:01.092 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:51:01.092 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:51:01.092 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:51:01.092 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:51:01.092 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:51:01.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:51:01.093+0000 7fe89bdbba80 -1 shutting down 2024-09-12T17:51:01.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:51:01.093+0000 7fe775b0d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56974, si_uid : 1000, si_addr0x3e80000de8e, si_status0 2024-09-12T17:51:30.711 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (29619 ms) 2024-09-12T17:51:30.712 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 9 tests from LibRGW (30928 ms total) 2024-09-12T17:51:30.712 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:51:30.712 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:51:30.712 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 9 tests from 1 test suite ran. (30928 ms total) 2024-09-12T17:51:30.712 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 9 tests. 2024-09-12T17:51:30.725 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2.2 2024-09-12T17:51:30.747 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:51:30.748 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:51:30.748 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:51:30.748 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:51:30.759 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:30.759 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:31.061 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (313 ms) 2024-09-12T17:51:31.062 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:51:31.063 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:51:31.063 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:51:31.063 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:51:31.063 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:51:31.096 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_BUCKET (33 ms) 2024-09-12T17:51:31.096 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:51:31.112 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave0 2024-09-12T17:51:31.130 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave1 2024-09-12T17:51:31.147 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave2 2024-09-12T17:51:31.163 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave3 2024-09-12T17:51:31.181 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave4 2024-09-12T17:51:31.197 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave5 2024-09-12T17:51:31.216 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave6 2024-09-12T17:51:31.234 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave7 2024-09-12T17:51:31.252 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave8 2024-09-12T17:51:31.272 INFO:tasks.workunit.client.0.smithi157.stdout:created: sorrydave9 2024-09-12T17:51:31.273 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (177 ms) 2024-09-12T17:51:31.273 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:51:31.699 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (426 ms) 2024-09-12T17:51:31.699 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:51:31.699 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:51:31.699 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:51:31.699 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:51:31.700 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:51:31.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:51:31.701+0000 7fed4b31aa80 -1 shutting down 2024-09-12T17:51:31.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:51:31.701+0000 7fec2506c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57622, si_uid : 1000, si_addr0x3e80000e116, si_status0 2024-09-12T17:52:01.108 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (29409 ms) 2024-09-12T17:52:01.109 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 9 tests from LibRGW (30360 ms total) 2024-09-12T17:52:01.109 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:52:01.109 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:52:01.109 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 9 tests from 1 test suite ran. (30360 ms total) 2024-09-12T17:52:01.109 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 9 tests. 2024-09-12T17:52:01.122 INFO:tasks.workunit.client.0.smithi157.stdout:phase 3.1 2024-09-12T17:52:01.462 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:52:01.462 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:52:01.462 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:52:01.462 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:52:01.471 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:01.471 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:01.726 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (265 ms) 2024-09-12T17:52:01.726 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:52:01.728 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:52:01.728 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:52:01.743 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CREATE_BUCKET (15 ms) 2024-09-12T17:52:01.743 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:52:01.749 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T17:52:01.749 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:52:01.750 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T17:52:01.751 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:52:01.817 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LARGE1 (67 ms) 2024-09-12T17:52:01.817 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:52:01.869 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LARGE2 (51 ms) 2024-09-12T17:52:01.869 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:52:01.869 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:52:01.869 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:52:01.869 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:52:01.869 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:52:01.869 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:52:01.869 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:52:01.869 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:52:01.869 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:52:01.870 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:52:01.870 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:52:01.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:52:01.868+0000 7fde486d8a80 -1 shutting down 2024-09-12T17:52:01.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:52:01.872+0000 7fdd2242a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58267, si_uid : 1000, si_addr0x3e80000e39b, si_status0 2024-09-12T17:52:32.080 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (30212 ms) 2024-09-12T17:52:32.081 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 13 tests from LibRGW (30619 ms total) 2024-09-12T17:52:32.081 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:52:32.081 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:52:32.081 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 13 tests from 1 test suite ran. (30619 ms total) 2024-09-12T17:52:32.081 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 13 tests. 2024-09-12T17:52:32.099 INFO:tasks.workunit.client.0.smithi157.stdout:phase 3.2 2024-09-12T17:52:32.441 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:52:32.441 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:52:32.441 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:52:32.441 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:52:32.449 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:32.449 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:33.201 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (761 ms) 2024-09-12T17:52:33.201 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:52:33.203 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:52:33.203 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:52:33.203 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:52:33.203 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:52:33.212 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (9 ms) 2024-09-12T17:52:33.212 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:52:33.216 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T17:52:33.216 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:52:33.285 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LARGE1 (69 ms) 2024-09-12T17:52:33.285 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:52:33.285 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T17:52:33.286 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:52:33.286 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:52:33.286 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:52:33.293 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_OBJECT (7 ms) 2024-09-12T17:52:33.293 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:52:33.335 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_BUCKET (42 ms) 2024-09-12T17:52:33.335 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:52:33.335 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:52:33.335 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:52:33.335 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:52:33.335 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:52:33.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:52:33.336+0000 7f1399852a80 -1 shutting down 2024-09-12T17:52:33.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:52:33.336+0000 7f12735a4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58912, si_uid : 1000, si_addr0x3e80000e620, si_status0 2024-09-12T17:53:03.222 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (29886 ms) 2024-09-12T17:53:03.760 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 13 tests from LibRGW (30781 ms total) 2024-09-12T17:53:03.760 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:53:03.760 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:53:03.760 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 13 tests from 1 test suite ran. (30781 ms total) 2024-09-12T17:53:03.760 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 13 tests. 2024-09-12T17:53:03.762 INFO:tasks.workunit.client.0.smithi157.stdout:phase 4.1 2024-09-12T17:53:03.762 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:53:03.762 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:53:03.762 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:53:03.762 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:53:03.762 INFO:tasks.workunit.client.0.smithi157.stdout:read i1: 64001 2024-09-12T17:53:03.762 INFO:tasks.workunit.client.0.smithi157.stdout:read s1: blunderbuss 2024-09-12T17:53:03.762 INFO:tasks.workunit.client.0.smithi157.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:53:03.762 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:53:03.763 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:03.763 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:03.764 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (292 ms) 2024-09-12T17:53:03.764 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:53:03.764 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:53:03.765 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:53:03.765 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (29 ms) 2024-09-12T17:53:03.765 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:53:04.871 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_0 2024-09-12T17:53:04.871 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_1 2024-09-12T17:53:04.871 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_2 2024-09-12T17:53:04.871 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_3 2024-09-12T17:53:04.871 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_4 2024-09-12T17:53:04.871 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_5 2024-09-12T17:53:04.871 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_6 2024-09-12T17:53:04.871 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_7 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_8 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_9 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_10 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_11 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_12 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_13 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_14 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_15 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_16 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_17 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_18 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_19 2024-09-12T17:53:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_20 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_21 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_22 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_23 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_24 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_25 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_26 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_27 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_28 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_29 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_30 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_31 2024-09-12T17:53:04.873 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_32 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_33 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_34 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_35 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_36 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_37 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_38 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_39 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_40 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_41 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_42 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_43 2024-09-12T17:53:04.874 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_44 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_45 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_46 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_47 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_48 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_49 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_50 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_51 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_52 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_53 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_54 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_55 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_56 2024-09-12T17:53:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_57 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_58 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_59 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_60 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_61 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_62 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_63 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_64 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_65 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_66 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_67 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_68 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_69 2024-09-12T17:53:04.876 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_70 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_71 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_72 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_73 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_74 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_75 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_76 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_77 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_78 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_79 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_80 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_81 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_82 2024-09-12T17:53:04.877 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_83 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_84 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_85 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_86 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_87 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_88 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_89 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_90 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_91 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_92 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_93 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_94 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_95 2024-09-12T17:53:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_96 2024-09-12T17:53:04.879 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_97 2024-09-12T17:53:04.879 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_98 2024-09-12T17:53:04.879 INFO:tasks.workunit.client.0.smithi157.stdout:created: dmarker:f_99 2024-09-12T17:53:04.879 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1285 ms) 2024-09-12T17:53:04.879 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:53:04.880 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:53:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:53:04.882 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:53:04.883 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:53:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:53:04.885 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:53:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:53:04.887 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:53:04.888 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_READDIR (9 ms) 2024-09-12T17:53:04.889 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:53:04.889 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:53:04.889 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:53:04.890 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:53:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:53:04.892 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:53:04.893 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:53:04.894 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:53:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:53:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER2_READDIR (6 ms) 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (1 ms) 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:53:04.897 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:53:04.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:53:04.887+0000 7fcee2417a80 -1 shutting down 2024-09-12T17:53:04.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:53:04.891+0000 7fcdbc169640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59557, si_uid : 1000, si_addr0x3e80000e8a5, si_status0 2024-09-12T17:53:33.966 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (29079 ms) 2024-09-12T17:53:33.967 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 11 tests from LibRGW (30703 ms total) 2024-09-12T17:53:33.967 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:53:33.967 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:53:33.967 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 11 tests from 1 test suite ran. (30703 ms total) 2024-09-12T17:53:33.967 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 11 tests. 2024-09-12T17:53:33.985 INFO:tasks.workunit.client.0.smithi157.stdout:phase 4.2 2024-09-12T17:53:34.006 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:53:34.007 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:53:34.007 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:53:34.007 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:53:34.007 INFO:tasks.workunit.client.0.smithi157.stdout:read i1: 64001 2024-09-12T17:53:34.007 INFO:tasks.workunit.client.0.smithi157.stdout:read s1: blunderbuss 2024-09-12T17:53:34.007 INFO:tasks.workunit.client.0.smithi157.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:53:34.007 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:53:34.022 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:34.023 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:34.521 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (517 ms) 2024-09-12T17:53:34.521 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:53:34.523 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:53:34.523 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:53:34.540 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (17 ms) 2024-09-12T17:53:34.540 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:53:34.540 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:53:34.540 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:53:34.541 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:53:34.541 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:53:34.547 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:53:34.547 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:53:34.547 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:53:34.547 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:53:34.547 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:53:34.547 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:53:34.547 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:53:34.547 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:53:34.547 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:53:34.547 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:53:34.547 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:53:34.548 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:53:34.548 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:53:34.548 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:53:34.548 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:53:34.548 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:53:34.548 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:53:34.548 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:53:34.548 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:53:34.548 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:53:34.549 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:53:34.549 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:53:34.549 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:53:34.549 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:53:34.549 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:53:34.549 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:53:34.549 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:53:34.549 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:53:34.549 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:53:34.550 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:53:34.550 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:53:34.550 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:53:34.550 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:53:34.550 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:53:34.550 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:53:34.550 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:53:34.550 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:53:34.551 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:53:34.551 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:53:34.551 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:53:34.551 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:53:34.551 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:53:34.551 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:53:34.551 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:53:34.551 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:53:34.552 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:53:34.552 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:53:34.552 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:53:34.552 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:53:34.552 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:53:34.552 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:53:34.552 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:53:34.552 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:53:34.553 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:53:34.553 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:53:34.553 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:53:34.553 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:53:34.553 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:53:34.553 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:53:34.553 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:53:34.553 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:53:34.554 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:53:34.554 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:53:34.554 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:53:34.555 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:53:34.555 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:53:34.555 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:53:34.555 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:53:34.555 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:53:34.555 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:53:34.555 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:53:34.555 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:53:34.556 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:53:34.556 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:53:34.556 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:53:34.556 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:53:34.556 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:53:34.556 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:53:34.556 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:53:34.556 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:53:34.557 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:53:34.557 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:53:34.557 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:53:34.557 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:53:34.557 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:53:34.557 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:53:34.557 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:53:34.557 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:53:34.558 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:53:34.558 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:53:34.558 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:53:34.558 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:53:34.558 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:53:34.558 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:53:34.558 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:53:34.558 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:53:34.558 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:53:34.559 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:53:34.559 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:53:34.559 INFO:tasks.workunit.client.0.smithi157.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:53:34.559 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER2_READDIR (7 ms) 2024-09-12T17:53:34.559 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:53:34.559 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:53:34.559 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:53:34.559 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:53:34.560 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:53:34.560 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:53:34.560 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:53:34.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:53:34.551+0000 7f0193301a80 -1 shutting down 2024-09-12T17:53:34.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:53:34.551+0000 7f006d053640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60202, si_uid : 1000, si_addr0x3e80000eb2a, si_status0 2024-09-12T17:54:04.841 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (30293 ms) 2024-09-12T17:54:04.841 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 11 tests from LibRGW (30836 ms total) 2024-09-12T17:54:04.841 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:54:04.841 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:54:04.841 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 11 tests from 1 test suite ran. (30836 ms total) 2024-09-12T17:54:04.842 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 11 tests. 2024-09-12T17:54:04.849 INFO:tasks.workunit.client.0.smithi157.stdout:phase 5.1 2024-09-12T17:54:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:54:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:54:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:54:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:54:04.892 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:04.893 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:05.439 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (558 ms) 2024-09-12T17:54:05.439 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:54:05.441 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:54:05.441 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:54:05.456 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CREATE_BUCKET (15 ms) 2024-09-12T17:54:05.456 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:54:05.461 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T17:54:05.461 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:54:05.461 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:54:05.461 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:54:05.463 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T17:54:05.463 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:54:05.463 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:54:05.463 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:54:05.470 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.PUT_OBJECT (7 ms) 2024-09-12T17:54:05.470 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:54:05.472 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-12T17:54:05.472 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:54:05.472 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:54:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:54:05.474 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:54:05.474 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:54:05.474 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:54:05.474 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:54:05.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:54:05.475+0000 7f910adeba80 -1 shutting down 2024-09-12T17:54:05.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:54:05.479+0000 7f8fe4b3d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60847, si_uid : 1000, si_addr0x3e80000edaf, si_status0 2024-09-12T17:54:35.500 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (30027 ms) 2024-09-12T17:54:35.500 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 19 tests from LibRGW (30618 ms total) 2024-09-12T17:54:35.500 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:54:35.500 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:54:35.500 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 19 tests from 1 test suite ran. (30618 ms total) 2024-09-12T17:54:35.501 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 19 tests. 2024-09-12T17:54:35.513 INFO:tasks.workunit.client.0.smithi157.stdout:phase 5.2 2024-09-12T17:54:35.546 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:54:35.546 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:54:35.546 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:54:35.546 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:54:35.554 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:35.554 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:35.838 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (292 ms) 2024-09-12T17:54:35.838 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:54:35.840 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:54:35.840 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:54:35.840 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:54:35.840 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:54:35.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-12T17:54:35.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:54:35.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:54:35.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:54:35.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T17:54:35.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:54:35.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:54:35.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:54:35.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T17:54:35.848 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:54:35.849 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T17:54:35.849 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:54:35.849 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:54:35.849 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:54:35.849 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:54:35.849 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:54:35.849 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:54:35.849 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:54:35.850 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:54:35.850 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:54:35.850 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:54:35.850 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:54:35.855 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_OBJECT (7 ms) 2024-09-12T17:54:35.855 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:54:35.881 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.DELETE_BUCKET (26 ms) 2024-09-12T17:54:35.881 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:54:35.881 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:54:35.881 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:54:35.881 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:54:35.882 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:54:35.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:54:35.882+0000 7f7500edba80 -1 shutting down 2024-09-12T17:54:35.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:54:35.886+0000 7f73dac2d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61492, si_uid : 1000, si_addr0x3e80000f034, si_status0 2024-09-12T17:55:06.078 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (30197 ms) 2024-09-12T17:55:06.078 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 19 tests from LibRGW (30532 ms total) 2024-09-12T17:55:06.078 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:55:06.078 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:55:06.079 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 19 tests from 1 test suite ran. (30532 ms total) 2024-09-12T17:55:06.079 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 19 tests. 2024-09-12T17:55:06.092 INFO:tasks.workunit.client.0.smithi157.stdout:phase 6.1 2024-09-12T17:55:06.115 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:55:06.115 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment set-up. 2024-09-12T17:55:06.115 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 10 tests from LibRGW 2024-09-12T17:55:06.115 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:55:06.124 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:06.124 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:06.671 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.INIT (556 ms) 2024-09-12T17:55:06.671 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:55:06.673 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:55:06.673 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T17:55:06.705 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CREATE_BUCKETS (32 ms) 2024-09-12T17:55:06.706 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T17:55:06.719 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (13 ms) 2024-09-12T17:55:06.719 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T17:55:06.763 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.TOPDIR_RENAME (44 ms) 2024-09-12T17:55:06.763 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T17:55:06.819 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SUBDIR_RENAME (57 ms) 2024-09-12T17:55:06.820 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T17:55:06.877 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (57 ms) 2024-09-12T17:55:06.877 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:55:06.877 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:55:06.877 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:55:06.878 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:55:06.878 INFO:tasks.workunit.client.0.smithi157.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:55:06.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:06.877+0000 7f67ed917a80 -1 shutting down 2024-09-12T17:55:06.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:06.881+0000 7f66c7669640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62140, si_uid : 1000, si_addr0x3e80000f2bc, si_status0 2024-09-12T17:55:37.036 INFO:tasks.workunit.client.0.smithi157.stdout:[ OK ] LibRGW.SHUTDOWN (30159 ms) 2024-09-12T17:55:37.037 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] 10 tests from LibRGW (30921 ms total) 2024-09-12T17:55:37.037 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:55:37.037 INFO:tasks.workunit.client.0.smithi157.stdout:[----------] Global test environment tear-down 2024-09-12T17:55:37.037 INFO:tasks.workunit.client.0.smithi157.stdout:[==========] 10 tests from 1 test suite ran. (30921 ms total) 2024-09-12T17:55:37.037 INFO:tasks.workunit.client.0.smithi157.stdout:[ PASSED ] 10 tests. 2024-09-12T17:55:37.048 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:55:37.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:55:37.064 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T17:55:37.065 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T17:55:37.065 DEBUG:teuthology.orchestra.run.smithi157:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T17:55:37.114 INFO:tasks.workunit.client.0.smithi157.stderr:+ [ -z ] 2024-09-12T17:55:37.115 INFO:tasks.workunit.client.0.smithi157.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:55:37.115 INFO:tasks.workunit.client.0.smithi157.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:55:37.115 INFO:tasks.workunit.client.0.smithi157.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T17:55:37.155 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:37.155 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:37.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.201+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.201+0000 7fc5825e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.201+0000 7fc5825e49c0 20 realm 2024-09-12T17:55:37.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.201+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.201+0000 7fc5825e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.201+0000 7fc5825e49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:37.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.201+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.201+0000 7fc5825e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.201+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.201+0000 7fc5825e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:37.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.201+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.205+0000 7fc5825e49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:37.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.205+0000 7fc5825e49c0 20 searching for the correct realm 2024-09-12T17:55:37.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.209+0000 7fc57f8e9640 0 -- 172.21.15.157:0/2090515521 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fc5740da930 msgr2=0x7fc5740f1450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:37.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.217+0000 7fc57f8e9640 0 -- 172.21.15.157:0/2090515521 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fc44807df70 msgr2=0x7fc4480803a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:37.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.221+0000 7fc5825e49c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:55:37.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.221+0000 7fc5825e49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:37.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.221+0000 7fc5825e49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:37.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.221+0000 7fc5825e49c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:55:37.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.221+0000 7fc5825e49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:37.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.221+0000 7fc5825e49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:37.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.221+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.221+0000 7fc5825e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.221+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:37.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:37.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 zone default found 2024-09-12T17:55:37.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 4 Realm: () 2024-09-12T17:55:37.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:55:37.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:55:37.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:37.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 zonegroup default 2024-09-12T17:55:37.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 started sync module instance, tier type = 2024-09-12T17:55:37.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.225+0000 7fc5825e49c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:55:37.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.241+0000 7fc5825e49c0 20 add_watcher() i=0 2024-09-12T17:55:37.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.241+0000 7fc5825e49c0 20 add_watcher() i=1 2024-09-12T17:55:37.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.241+0000 7fc5825e49c0 20 add_watcher() i=2 2024-09-12T17:55:37.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.241+0000 7fc5825e49c0 20 add_watcher() i=3 2024-09-12T17:55:37.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.241+0000 7fc5825e49c0 20 add_watcher() i=4 2024-09-12T17:55:37.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.241+0000 7fc5825e49c0 20 add_watcher() i=5 2024-09-12T17:55:37.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.241+0000 7fc5825e49c0 20 add_watcher() i=6 2024-09-12T17:55:37.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.241+0000 7fc5825e49c0 20 add_watcher() i=7 2024-09-12T17:55:37.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.241+0000 7fc5825e49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:37.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc436fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:37.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:37.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:37.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 5 note: GC not initialized 2024-09-12T17:55:37.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc435fdb640 20 reqs_thread_entry: start 2024-09-12T17:55:37.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 20 init_complete bucket index max shards: 1 2024-09-12T17:55:37.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 20 Filter name: none 2024-09-12T17:55:37.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc3a77fe640 20 reqs_thread_entry: start 2024-09-12T17:55:37.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T17:55:37.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.245+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T17:55:37.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:55:37.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:55:37.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:55:37.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:55:37.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:55:37.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc5825e49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T17:55:37.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc4577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824003 cookie 94184159845984 notifier 5507 bl.length()=677 2024-09-12T17:55:37.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc4577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:55:37.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.249+0000 7fc4577fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:55:37.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.253+0000 7fc5825e49c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:55:37.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.253+0000 7fc5825e49c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:55:37.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.253+0000 7fc5825e49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T17:55:37.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.253+0000 7fc4577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824011 cookie 94184159833840 notifier 5507 bl.length()=187 2024-09-12T17:55:37.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.253+0000 7fc4577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:55:37.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.253+0000 7fc4577fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:55:37.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.257+0000 7fc5825e49c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:55:37.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.257+0000 7fc5825e49c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:55:37.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.257+0000 7fc5825e49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T17:55:37.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.257+0000 7fc4577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824012 cookie 94184159833840 notifier 5507 bl.length()=197 2024-09-12T17:55:37.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.257+0000 7fc4577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:55:37.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.257+0000 7fc4577fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:55:37.259 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:55:37.259 INFO:tasks.workunit.client.0.smithi157.stdout: "user_id": "ceph-test-maven", 2024-09-12T17:55:37.259 INFO:tasks.workunit.client.0.smithi157.stdout: "display_name": "maven test user", 2024-09-12T17:55:37.259 INFO:tasks.workunit.client.0.smithi157.stdout: "email": "sigv4@example.com", 2024-09-12T17:55:37.259 INFO:tasks.workunit.client.0.smithi157.stdout: "suspended": 0, 2024-09-12T17:55:37.259 INFO:tasks.workunit.client.0.smithi157.stdout: "max_buckets": 1000, 2024-09-12T17:55:37.260 INFO:tasks.workunit.client.0.smithi157.stdout: "subusers": [], 2024-09-12T17:55:37.260 INFO:tasks.workunit.client.0.smithi157.stdout: "keys": [ 2024-09-12T17:55:37.260 INFO:tasks.workunit.client.0.smithi157.stdout: { 2024-09-12T17:55:37.260 INFO:tasks.workunit.client.0.smithi157.stdout: "user": "ceph-test-maven", 2024-09-12T17:55:37.260 INFO:tasks.workunit.client.0.smithi157.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T17:55:37.260 INFO:tasks.workunit.client.0.smithi157.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T17:55:37.260 INFO:tasks.workunit.client.0.smithi157.stdout: "active": true, 2024-09-12T17:55:37.260 INFO:tasks.workunit.client.0.smithi157.stdout: "create_date": "2024-09-12T17:55:37.251969Z" 2024-09-12T17:55:37.260 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:55:37.260 INFO:tasks.workunit.client.0.smithi157.stdout: ], 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "swift_keys": [], 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "caps": [], 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "default_placement": "", 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "default_storage_class": "", 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "placement_tags": [], 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_quota": { 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "enabled": false, 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "check_on_raw": false, 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size": -1, 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size_kb": 0, 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "max_objects": -1 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:55:37.261 INFO:tasks.workunit.client.0.smithi157.stdout: "user_quota": { 2024-09-12T17:55:37.262 INFO:tasks.workunit.client.0.smithi157.stdout: "enabled": false, 2024-09-12T17:55:37.262 INFO:tasks.workunit.client.0.smithi157.stdout: "check_on_raw": false, 2024-09-12T17:55:37.262 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size": -1, 2024-09-12T17:55:37.262 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size_kb": 0, 2024-09-12T17:55:37.262 INFO:tasks.workunit.client.0.smithi157.stdout: "max_objects": -1 2024-09-12T17:55:37.262 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:55:37.262 INFO:tasks.workunit.client.0.smithi157.stdout: "temp_url_keys": [], 2024-09-12T17:55:37.262 INFO:tasks.workunit.client.0.smithi157.stdout: "type": "rgw", 2024-09-12T17:55:37.262 INFO:tasks.workunit.client.0.smithi157.stdout: "mfa_ids": [], 2024-09-12T17:55:37.262 INFO:tasks.workunit.client.0.smithi157.stdout: "account_id": "", 2024-09-12T17:55:37.263 INFO:tasks.workunit.client.0.smithi157.stdout: "path": "/", 2024-09-12T17:55:37.263 INFO:tasks.workunit.client.0.smithi157.stdout: "create_date": "2024-09-12T17:55:37.251944Z", 2024-09-12T17:55:37.263 INFO:tasks.workunit.client.0.smithi157.stdout: "tags": [], 2024-09-12T17:55:37.263 INFO:tasks.workunit.client.0.smithi157.stdout: "group_ids": [] 2024-09-12T17:55:37.263 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:55:37.263 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:55:37.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.261+0000 7fc436fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:37.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.265+0000 7fc5825e49c0 20 remove_watcher() i=0 2024-09-12T17:55:37.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.265+0000 7fc5825e49c0 2 removed watcher, disabling cache 2024-09-12T17:55:37.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.269+0000 7fc5825e49c0 20 remove_watcher() i=1 2024-09-12T17:55:37.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.269+0000 7fc5825e49c0 20 remove_watcher() i=2 2024-09-12T17:55:37.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.273+0000 7fc5825e49c0 20 remove_watcher() i=3 2024-09-12T17:55:37.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.273+0000 7fc5825e49c0 20 remove_watcher() i=4 2024-09-12T17:55:37.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.277+0000 7fc5825e49c0 20 remove_watcher() i=5 2024-09-12T17:55:37.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.277+0000 7fc5825e49c0 20 remove_watcher() i=6 2024-09-12T17:55:37.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T17:55:37.277+0000 7fc5825e49c0 20 remove_watcher() i=7 2024-09-12T17:55:37.290 INFO:tasks.workunit.client.0.smithi157.stderr:+ [ -z ] 2024-09-12T17:55:37.290 INFO:tasks.workunit.client.0.smithi157.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T17:55:37.290 INFO:tasks.workunit.client.0.smithi157.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T17:55:37.291 INFO:tasks.workunit.client.0.smithi157.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi157.front.sepia.ceph.com:80 2024-09-12T17:55:37.291 INFO:tasks.workunit.client.0.smithi157.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T17:55:37.291 INFO:tasks.workunit.client.0.smithi157.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T17:55:37.291 INFO:tasks.workunit.client.0.smithi157.stderr:+ ./mvnw clean package 2024-09-12T17:55:37.296 INFO:tasks.workunit.client.0.smithi157.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:55:41.709 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Scanning for projects... 2024-09-12T17:55:41.869 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T17:55:41.974 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 52 kB/s) 2024-09-12T17:55:41.996 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T17:55:42.031 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 18/83 kB Progress (1): 19/83 kB Progress (1): 21/83 kB Progress (1): 22/83 kB Progress (1): 23/83 kB Progress (1): 25/83 kB Progress (1): 26/83 kB Progress (1): 27/83 kB Progress (1): 29/83 kB Progress (1): 30/83 kB Progress (1): 32/83 kB Progress (1): 33/83 kB Progress (1): 34/83 kB Progress (1): 36/83 kB Progress (1): 37/83 kB Progress (1): 38/83 kB Progress (1): 40/83 kB Progress (1): 41/83 kB Progress (1): 43/83 kB Progress (1): 44/83 kB Progress (1): 45/83 kB Progress (1): 47/83 kB Progress (1): 48/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.4 MB/s) 2024-09-12T17:55:42.044 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T17:55:42.067 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.3 MB/s) 2024-09-12T17:55:42.100 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:42.100 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:55:42.101 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:55:42.101 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] from pom.xml 2024-09-12T17:55:42.101 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:55:42.103 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T17:55:42.118 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T17:55:42.124 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T17:55:42.139 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-12T17:55:42.142 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T17:55:42.157 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-12T17:55:42.168 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T17:55:42.184 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-12T17:55:42.199 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T17:55:42.216 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-12T17:55:42.225 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T17:55:42.240 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-12T17:55:42.243 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T17:55:42.260 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 476 kB/s) 2024-09-12T17:55:42.262 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T17:55:42.277 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-09-12T17:55:42.280 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T17:55:42.295 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-12T17:55:42.300 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T17:55:42.315 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-09-12T17:55:42.322 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T17:55:42.336 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-12T17:55:42.343 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T17:55:42.359 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-12T17:55:42.370 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T17:55:42.387 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 313 kB/s) 2024-09-12T17:55:42.391 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T17:55:42.407 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 15/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-12T17:55:42.410 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T17:55:42.427 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 15/50 kB Progress (1): 31/50 kB Progress (1): 48/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-12T17:55:42.432 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T17:55:42.447 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-12T17:55:42.454 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T17:55:42.469 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-12T17:55:42.473 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T17:55:42.489 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-12T17:55:42.498 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T17:55:42.513 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 451 kB/s) 2024-09-12T17:55:42.516 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T17:55:42.531 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 619 kB/s) 2024-09-12T17:55:42.534 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T17:55:42.550 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.7 MB/s) 2024-09-12T17:55:42.554 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T17:55:42.568 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-12T17:55:42.575 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T17:55:42.591 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.8 MB/s) 2024-09-12T17:55:42.606 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T17:55:42.621 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-12T17:55:42.623 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T17:55:42.638 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-12T17:55:42.646 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T17:55:42.664 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.2 MB/s) 2024-09-12T17:55:42.675 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T17:55:42.692 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-09-12T17:55:42.695 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T17:55:42.710 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-12T17:55:42.712 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T17:55:42.727 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-12T17:55:42.732 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T17:55:42.750 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-12T17:55:42.754 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T17:55:42.775 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-12T17:55:42.776 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T17:55:42.787 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-12T17:55:42.792 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T17:55:42.807 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-12T17:55:42.812 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T17:55:42.827 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 239 kB/s) 2024-09-12T17:55:42.832 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T17:55:42.846 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-12T17:55:42.850 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T17:55:42.865 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-12T17:55:42.868 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T17:55:42.883 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-12T17:55:42.886 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T17:55:42.900 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-12T17:55:42.903 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T17:55:42.918 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-12T17:55:42.923 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T17:55:42.938 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 153 kB/s) 2024-09-12T17:55:42.942 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T17:55:42.958 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 182 kB/s) 2024-09-12T17:55:42.961 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T17:55:42.976 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-12T17:55:42.979 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T17:55:42.994 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 364 kB/s) 2024-09-12T17:55:42.998 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T17:55:43.014 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-12T17:55:43.019 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T17:55:43.034 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 293 kB/s) 2024-09-12T17:55:43.037 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T17:55:43.052 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-12T17:55:43.056 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T17:55:43.072 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 402 kB/s) 2024-09-12T17:55:43.076 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T17:55:43.092 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 404 kB/s) 2024-09-12T17:55:43.099 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T17:55:43.115 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-09-12T17:55:43.122 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T17:55:43.139 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 204 kB/s) 2024-09-12T17:55:43.148 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T17:55:43.163 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-09-12T17:55:43.167 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T17:55:43.183 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 111 kB/s) 2024-09-12T17:55:43.192 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T17:55:43.208 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 413 kB/s) 2024-09-12T17:55:43.212 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T17:55:43.229 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-09-12T17:55:43.235 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T17:55:43.253 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-09-12T17:55:43.259 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T17:55:43.277 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.0 MB/s) 2024-09-12T17:55:43.288 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T17:55:43.305 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 276 kB/s) 2024-09-12T17:55:43.310 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T17:55:43.326 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-09-12T17:55:43.336 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T17:55:43.354 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-09-12T17:55:43.361 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T17:55:43.379 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 37/68 kB Progress (1): 53/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.4 MB/s) 2024-09-12T17:55:43.404 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T17:55:43.421 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 922 kB/s) 2024-09-12T17:55:43.431 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T17:55:43.448 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 908 kB/s) 2024-09-12T17:55:43.453 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T17:55:43.473 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-09-12T17:55:43.483 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T17:55:43.499 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.1 MB/s) 2024-09-12T17:55:43.508 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T17:55:43.526 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-12T17:55:43.533 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T17:55:43.555 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.5 MB/s) 2024-09-12T17:55:43.576 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T17:55:43.594 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 213 kB/s) 2024-09-12T17:55:43.598 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T17:55:43.614 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 812 kB/s) 2024-09-12T17:55:43.621 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T17:55:43.637 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T17:55:43.642 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T17:55:43.658 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 187 kB/s) 2024-09-12T17:55:43.664 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T17:55:43.681 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 120 kB/s) 2024-09-12T17:55:43.686 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T17:55:43.705 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 142 kB/s) 2024-09-12T17:55:43.711 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T17:55:43.728 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-09-12T17:55:43.733 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T17:55:43.751 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 167 kB/s) 2024-09-12T17:55:43.758 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T17:55:43.774 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-09-12T17:55:43.781 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T17:55:43.798 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-09-12T17:55:43.806 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T17:55:43.823 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 64 kB/s) 2024-09-12T17:55:43.832 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T17:55:43.849 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 60 kB/s) 2024-09-12T17:55:43.856 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T17:55:43.873 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-09-12T17:55:43.878 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T17:55:43.895 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-12T17:55:43.901 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T17:55:43.917 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T17:55:43.923 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T17:55:43.940 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T17:55:43.946 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T17:55:43.964 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 168 kB/s) 2024-09-12T17:55:44.019 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T17:55:44.130 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 29 MB/s) 2024-09-12T17:55:44.134 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T17:55:44.134 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T17:55:44.134 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T17:55:44.135 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T17:55:44.135 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T17:55:44.160 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.7/71 kB Progress (1): 6.9/71 kB Progress (1): 11/71 kB Progress (1): 14/71 kB Progress (1): 21/71 kB Progress (1): 30/71 kB Progress (1): 47/71 kB Progress (1): 47/71 kB Progress (1): 63/71 kB Progress (1): 63/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 2.5 MB/s) 2024-09-12T17:55:44.160 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T17:55:44.174 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 401 kB/s) 2024-09-12T17:55:44.175 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T17:55:44.228 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/49 kB Progress (2): 1.4/49 kB | 1.4/35 kB Progress (2): 2.8/49 kB | 1.4/35 kB Progress (2): 2.8/49 kB | 2.8/35 kB Progress (2): 4.1/49 kB | 2.8/35 kB Progress (2): 4.1/49 kB | 4.1/35 kB Progress (2): 5.5/49 kB | 4.1/35 kB Progress (2): 5.5/49 kB | 5.5/35 kB Progress (2): 6.9/49 kB | 5.5/35 kB Progress (2): 6.9/49 kB | 6.9/35 kB Progress (2): 8.3/49 kB | 6.9/35 kB Progress (2): 8.3/49 kB | 8.3/35 kB Progress (2): 9.7/49 kB | 8.3/35 kB Progress (2): 9.7/49 kB | 9.7/35 kB Progress (2): 9.7/49 kB | 11/35 kB Progress (2): 11/49 kB | 11/35 kB Progress (2): 11/49 kB | 12/35 kB Progress (2): 11/49 kB | 14/35 kB Progress (2): 12/49 kB | 14/35 kB Progress (2): 12/49 kB | 15/35 kB Progress (2): 12/49 kB | 16/35 kB Progress (2): 14/49 kB | 16/35 kB Progress (2): 14/49 kB | 17/35 kB Progress (2): 15/49 kB | 17/35 kB Progress (2): 15/49 kB | 19/35 kB Progress (2): 17/49 kB | 19/35 kB Progress (2): 17/49 kB | 20/35 kB Progress (2): 18/49 kB | 20/35 kB Progress (2): 18/49 kB | 21/35 kB Progress (2): 19/49 kB | 21/35 kB Progress (2): 19/49 kB | 23/35 kB Progress (2): 21/49 kB | 23/35 kB Progress (2): 21/49 kB | 24/35 kB Progress (2): 22/49 kB | 24/35 kB Progress (2): 22/49 kB | 25/35 kB Progress (2): 23/49 kB | 25/35 kB Progress (2): 23/49 kB | 27/35 kB Progress (2): 25/49 kB | 27/35 kB Progress (2): 26/49 kB | 27/35 kB Progress (2): 28/49 kB | 27/35 kB Progress (2): 28/49 kB | 28/35 kB Progress (2): 29/49 kB | 28/35 kB Progress (2): 29/49 kB | 30/35 kB Progress (2): 30/49 kB | 30/35 kB Progress (2): 30/49 kB | 31/35 kB Progress (2): 32/49 kB | 31/35 kB Progress (2): 33/49 kB | 31/35 kB Progress (2): 33/49 kB | 32/35 kB Progress (2): 33/49 kB | 34/35 kB Progress (2): 34/49 kB | 34/35 kB Progress (2): 34/49 kB | 35/35 kB Progress (2): 36/49 kB | 35/35 kB Progress (2): 36/49 kB | 35 kB Progress (3): 36/49 kB | 35 kB | 16/782 kB Progress (3): 37/49 kB | 35 kB | 16/782 kB Progress (3): 37/49 kB | 35 kB | 33/782 kB Progress (3): 38/49 kB | 35 kB | 33/782 kB Progress (3): 38/49 kB | 35 kB | 49/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 606 kB/s) 2024-09-12T17:55:44.228 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T17:55:44.229 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 38/49 kB | 65/782 kB Progress (2): 38/49 kB | 82/782 kB Progress (2): 38/49 kB | 98/782 kB Progress (2): 38/49 kB | 115/782 kB Progress (2): 38/49 kB | 131/782 kB Progress (2): 38/49 kB | 147/782 kB Progress (2): 38/49 kB | 164/782 kB Progress (2): 38/49 kB | 180/782 kB Progress (2): 38/49 kB | 197/782 kB Progress (2): 38/49 kB | 213/782 kB Progress (2): 38/49 kB | 229/782 kB Progress (2): 38/49 kB | 246/782 kB Progress (2): 38/49 kB | 262/782 kB Progress (2): 38/49 kB | 278/782 kB Progress (2): 40/49 kB | 278/782 kB Progress (2): 40/49 kB | 295/782 kB Progress (2): 41/49 kB | 295/782 kB Progress (2): 41/49 kB | 311/782 kB Progress (2): 42/49 kB | 311/782 kB Progress (2): 44/49 kB | 311/782 kB Progress (2): 44/49 kB | 328/782 kB Progress (2): 45/49 kB | 328/782 kB Progress (3): 45/49 kB | 328/782 kB | 1.4/16 kB Progress (3): 45/49 kB | 344/782 kB | 1.4/16 kB Progress (3): 47/49 kB | 344/782 kB | 1.4/16 kB Progress (3): 47/49 kB | 344/782 kB | 2.8/16 kB Progress (3): 48/49 kB | 344/782 kB | 2.8/16 kB Progress (3): 48/49 kB | 344/782 kB | 4.1/16 kB Progress (3): 48/49 kB | 360/782 kB | 4.1/16 kB Progress (3): 49 kB | 360/782 kB | 4.1/16 kB Progress (4): 49 kB | 360/782 kB | 4.1/16 kB | 1.4/98 kB Progress (4): 49 kB | 360/782 kB | 5.5/16 kB | 1.4/98 kB Progress (4): 49 kB | 360/782 kB | 5.5/16 kB | 2.8/98 kB Progress (4): 49 kB | 377/782 kB | 5.5/16 kB | 2.8/98 kB Progress (4): 49 kB | 377/782 kB | 6.9/16 kB | 2.8/98 kB Progress (4): 49 kB | 377/782 kB | 6.9/16 kB | 4.1/98 kB Progress (4): 49 kB | 377/782 kB | 8.3/16 kB | 4.1/98 kB Progress (4): 49 kB | 393/782 kB | 8.3/16 kB | 4.1/98 kB Progress (4): 49 kB | 393/782 kB | 8.3/16 kB | 5.5/98 kB Progress (4): 49 kB | 393/782 kB | 9.7/16 kB | 5.5/98 kB Progress (4): 49 kB | 393/782 kB | 11/16 kB | 5.5/98 kB Progress (4): 49 kB | 393/782 kB | 11/16 kB | 6.9/98 kB Progress (4): 49 kB | 410/782 kB | 11/16 kB | 6.9/98 kB Progress (4): 49 kB | 410/782 kB | 11/16 kB | 8.3/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 769 kB/s) 2024-09-12T17:55:44.229 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (3): 410/782 kB | 12/16 kB | 8.3/98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T17:55:44.229 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (3): 410/782 kB | 14/16 kB | 8.3/98 kB Progress (3): 410/782 kB | 14/16 kB | 9.7/98 kB Progress (3): 426/782 kB | 14/16 kB | 9.7/98 kB Progress (3): 426/782 kB | 14/16 kB | 11/98 kB Progress (3): 426/782 kB | 15/16 kB | 11/98 kB Progress (3): 426/782 kB | 15/16 kB | 12/98 kB Progress (3): 426/782 kB | 16 kB | 12/98 kB Progress (3): 442/782 kB | 16 kB | 12/98 kB Progress (3): 442/782 kB | 16 kB | 14/98 kB Progress (3): 442/782 kB | 16 kB | 15/98 kB Progress (3): 459/782 kB | 16 kB | 15/98 kB Progress (3): 459/782 kB | 16 kB | 16/98 kB Progress (3): 459/782 kB | 16 kB | 18/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 236 kB/s) 2024-09-12T17:55:44.229 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 459/782 kB | 19/98 kB Progress (2): 475/782 kB | 19/98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T17:55:44.230 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 475/782 kB | 21/98 kB Progress (2): 475/782 kB | 22/98 kB Progress (2): 475/782 kB | 23/98 kB Progress (2): 491/782 kB | 23/98 kB Progress (2): 491/782 kB | 25/98 kB Progress (2): 491/782 kB | 26/98 kB Progress (2): 491/782 kB | 27/98 kB Progress (2): 508/782 kB | 27/98 kB Progress (2): 508/782 kB | 29/98 kB Progress (2): 508/782 kB | 30/98 kB Progress (2): 508/782 kB | 32/98 kB Progress (2): 524/782 kB | 32/98 kB Progress (2): 524/782 kB | 33/98 kB Progress (2): 524/782 kB | 34/98 kB Progress (2): 524/782 kB | 36/98 kB Progress (2): 541/782 kB | 36/98 kB Progress (2): 541/782 kB | 37/98 kB Progress (2): 541/782 kB | 38/98 kB Progress (2): 557/782 kB | 38/98 kB Progress (2): 573/782 kB | 38/98 kB Progress (2): 590/782 kB | 38/98 kB Progress (3): 590/782 kB | 38/98 kB | 1.4/11 kB Progress (3): 606/782 kB | 38/98 kB | 1.4/11 kB Progress (3): 606/782 kB | 38/98 kB | 2.8/11 kB Progress (3): 606/782 kB | 38/98 kB | 4.1/11 kB Progress (3): 606/782 kB | 38/98 kB | 5.5/11 kB Progress (3): 623/782 kB | 38/98 kB | 5.5/11 kB Progress (3): 623/782 kB | 38/98 kB | 6.9/11 kB Progress (3): 623/782 kB | 38/98 kB | 8.3/11 kB Progress (3): 623/782 kB | 38/98 kB | 9.7/11 kB Progress (3): 639/782 kB | 38/98 kB | 9.7/11 kB Progress (3): 639/782 kB | 38/98 kB | 11/11 kB Progress (3): 639/782 kB | 38/98 kB | 11 kB Progress (3): 655/782 kB | 38/98 kB | 11 kB Progress (3): 672/782 kB | 38/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 158 kB/s) 2024-09-12T17:55:44.230 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T17:55:44.230 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 688/782 kB | 38/98 kB Progress (2): 704/782 kB | 38/98 kB Progress (2): 721/782 kB | 38/98 kB Progress (2): 737/782 kB | 38/98 kB Progress (2): 737/782 kB | 40/98 kB Progress (2): 754/782 kB | 40/98 kB Progress (2): 754/782 kB | 41/98 kB Progress (2): 754/782 kB | 43/98 kB Progress (2): 754/782 kB | 44/98 kB Progress (2): 770/782 kB | 44/98 kB Progress (2): 770/782 kB | 45/98 kB Progress (2): 770/782 kB | 47/98 kB Progress (2): 770/782 kB | 48/98 kB Progress (2): 782 kB | 48/98 kB Progress (2): 782 kB | 49/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 10 MB/s) 2024-09-12T17:55:44.230 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T17:55:44.230 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 66/98 kB Progress (2): 66/98 kB | 1.4/205 kB Progress (2): 66/98 kB | 2.8/205 kB Progress (2): 66/98 kB | 4.1/205 kB Progress (2): 79/98 kB | 4.1/205 kB Progress (2): 79/98 kB | 5.5/205 kB Progress (2): 79/98 kB | 6.9/205 kB Progress (2): 79/98 kB | 8.3/205 kB Progress (2): 79/98 kB | 9.7/205 kB Progress (2): 79/98 kB | 11/205 kB Progress (2): 79/98 kB | 12/205 kB Progress (2): 79/98 kB | 14/205 kB Progress (2): 79/98 kB | 15/205 kB Progress (2): 79/98 kB | 16/205 kB Progress (3): 79/98 kB | 16/205 kB | 16/30 kB Progress (3): 79/98 kB | 16/205 kB | 30 kB Progress (3): 79/98 kB | 33/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 364 kB/s) 2024-09-12T17:55:44.231 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T17:55:44.231 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 95/98 kB | 33/205 kB Progress (2): 98 kB | 33/205 kB Progress (3): 98 kB | 33/205 kB | 1.4/81 kB Progress (3): 98 kB | 33/205 kB | 2.8/81 kB Progress (3): 98 kB | 33/205 kB | 4.1/81 kB Progress (3): 98 kB | 33/205 kB | 5.5/81 kB Progress (3): 98 kB | 33/205 kB | 6.9/81 kB Progress (3): 98 kB | 33/205 kB | 8.3/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.1 MB/s) 2024-09-12T17:55:44.231 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 33/205 kB | 9.7/81 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T17:55:44.238 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 33/205 kB | 11/81 kB Progress (2): 33/205 kB | 12/81 kB Progress (2): 33/205 kB | 14/81 kB Progress (2): 33/205 kB | 15/81 kB Progress (2): 33/205 kB | 16/81 kB Progress (2): 33/205 kB | 32/81 kB Progress (2): 33/205 kB | 49/81 kB Progress (3): 33/205 kB | 49/81 kB | 16/798 kB Progress (3): 49/205 kB | 49/81 kB | 16/798 kB Progress (3): 49/205 kB | 49/81 kB | 32/798 kB Progress (3): 49/205 kB | 49/81 kB | 49/798 kB Progress (3): 49/205 kB | 49/81 kB | 65/798 kB Progress (3): 64/205 kB | 49/81 kB | 65/798 kB Progress (3): 64/205 kB | 49/81 kB | 81/798 kB Progress (3): 64/205 kB | 49/81 kB | 98/798 kB Progress (3): 64/205 kB | 49/81 kB | 114/798 kB Progress (3): 64/205 kB | 49/81 kB | 130/798 kB Progress (3): 64/205 kB | 49/81 kB | 147/798 kB Progress (3): 80/205 kB | 49/81 kB | 147/798 kB Progress (3): 80/205 kB | 49/81 kB | 163/798 kB Progress (3): 80/205 kB | 49/81 kB | 180/798 kB Progress (3): 80/205 kB | 49/81 kB | 196/798 kB Progress (3): 80/205 kB | 49/81 kB | 212/798 kB Progress (3): 80/205 kB | 49/81 kB | 229/798 kB Progress (3): 97/205 kB | 49/81 kB | 229/798 kB Progress (3): 97/205 kB | 49/81 kB | 245/798 kB Progress (3): 97/205 kB | 49/81 kB | 262/798 kB Progress (3): 97/205 kB | 49/81 kB | 278/798 kB Progress (4): 97/205 kB | 49/81 kB | 278/798 kB | 6.9/13 kB Progress (4): 97/205 kB | 49/81 kB | 294/798 kB | 6.9/13 kB Progress (4): 97/205 kB | 49/81 kB | 294/798 kB | 12/13 kB Progress (4): 97/205 kB | 65/81 kB | 294/798 kB | 12/13 kB Progress (4): 97/205 kB | 65/81 kB | 294/798 kB | 13 kB Progress (4): 97/205 kB | 65/81 kB | 311/798 kB | 13 kB Progress (4): 97/205 kB | 65/81 kB | 327/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 136 kB/s) 2024-09-12T17:55:44.239 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (3): 97/205 kB | 81 kB | 327/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T17:55:44.239 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (3): 97/205 kB | 81 kB | 343/798 kB Progress (3): 97/205 kB | 81 kB | 360/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 821 kB/s) 2024-09-12T17:55:44.239 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T17:55:44.255 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 97/205 kB | 376/798 kB Progress (2): 97/205 kB | 393/798 kB Progress (2): 97/205 kB | 409/798 kB Progress (3): 97/205 kB | 409/798 kB | 16/182 kB Progress (3): 97/205 kB | 425/798 kB | 16/182 kB Progress (3): 97/205 kB | 425/798 kB | 33/182 kB Progress (3): 97/205 kB | 442/798 kB | 33/182 kB Progress (3): 97/205 kB | 458/798 kB | 33/182 kB Progress (3): 97/205 kB | 458/798 kB | 49/182 kB Progress (3): 113/205 kB | 458/798 kB | 49/182 kB Progress (3): 113/205 kB | 475/798 kB | 49/182 kB Progress (3): 113/205 kB | 491/798 kB | 49/182 kB Progress (3): 113/205 kB | 491/798 kB | 66/182 kB Progress (3): 113/205 kB | 507/798 kB | 66/182 kB Progress (3): 129/205 kB | 507/798 kB | 66/182 kB Progress (3): 129/205 kB | 507/798 kB | 82/182 kB Progress (3): 129/205 kB | 524/798 kB | 82/182 kB Progress (3): 146/205 kB | 524/798 kB | 82/182 kB Progress (4): 146/205 kB | 524/798 kB | 82/182 kB | 16/27 kB Progress (5): 146/205 kB | 524/798 kB | 82/182 kB | 16/27 kB | 16/151 kB Progress (5): 146/205 kB | 540/798 kB | 82/182 kB | 16/27 kB | 16/151 kB Progress (5): 162/205 kB | 540/798 kB | 82/182 kB | 16/27 kB | 16/151 kB Progress (5): 162/205 kB | 540/798 kB | 98/182 kB | 16/27 kB | 16/151 kB Progress (5): 162/205 kB | 540/798 kB | 98/182 kB | 27 kB | 16/151 kB Progress (5): 162/205 kB | 540/798 kB | 98/182 kB | 27 kB | 33/151 kB Progress (5): 162/205 kB | 556/798 kB | 98/182 kB | 27 kB | 33/151 kB Progress (5): 179/205 kB | 556/798 kB | 98/182 kB | 27 kB | 33/151 kB Progress (5): 179/205 kB | 556/798 kB | 115/182 kB | 27 kB | 33/151 kB Progress (5): 179/205 kB | 556/798 kB | 115/182 kB | 27 kB | 49/151 kB Progress (5): 179/205 kB | 573/798 kB | 115/182 kB | 27 kB | 49/151 kB Progress (5): 195/205 kB | 573/798 kB | 115/182 kB | 27 kB | 49/151 kB Progress (5): 195/205 kB | 573/798 kB | 131/182 kB | 27 kB | 49/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 235 kB/s) 2024-09-12T17:55:44.255 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (4): 195/205 kB | 573/798 kB | 131/182 kB | 62/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T17:55:44.256 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (4): 195/205 kB | 589/798 kB | 131/182 kB | 62/151 kB Progress (4): 195/205 kB | 589/798 kB | 147/182 kB | 62/151 kB Progress (4): 195/205 kB | 589/798 kB | 147/182 kB | 79/151 kB Progress (4): 195/205 kB | 606/798 kB | 147/182 kB | 79/151 kB Progress (4): 195/205 kB | 606/798 kB | 147/182 kB | 95/151 kB Progress (4): 205 kB | 606/798 kB | 147/182 kB | 95/151 kB Progress (4): 205 kB | 622/798 kB | 147/182 kB | 95/151 kB Progress (4): 205 kB | 622/798 kB | 147/182 kB | 111/151 kB Progress (4): 205 kB | 622/798 kB | 164/182 kB | 111/151 kB Progress (4): 205 kB | 638/798 kB | 164/182 kB | 111/151 kB Progress (4): 205 kB | 638/798 kB | 164/182 kB | 128/151 kB Progress (4): 205 kB | 638/798 kB | 180/182 kB | 128/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.7 MB/s) 2024-09-12T17:55:44.256 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (3): 638/798 kB | 182 kB | 128/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T17:55:44.257 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (3): 655/798 kB | 182 kB | 128/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.5 MB/s) 2024-09-12T17:55:44.257 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 671/798 kB | 128/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T17:55:44.260 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 688/798 kB | 128/151 kB Progress (2): 704/798 kB | 128/151 kB Progress (2): 720/798 kB | 128/151 kB Progress (2): 737/798 kB | 128/151 kB Progress (2): 753/798 kB | 128/151 kB Progress (2): 769/798 kB | 128/151 kB Progress (2): 786/798 kB | 128/151 kB Progress (2): 798 kB | 128/151 kB Progress (2): 798 kB | 144/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.4 MB/s) 2024-09-12T17:55:44.260 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T17:55:44.260 INFO:tasks.workunit.client.0.smithi157.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-12T17:55:44.260 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T17:55:44.269 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 228 kB/s) 2024-09-12T17:55:44.269 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T17:55:44.273 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/385 kB Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 66/385 kB Progress (1): 82/385 kB Progress (1): 98/385 kB Progress (1): 114/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (2): 164/385 kB | 13 kB Progress (2): 180/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 97 kB/s) 2024-09-12T17:55:44.273 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T17:55:44.275 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 196/385 kB Progress (1): 213/385 kB Progress (2): 213/385 kB | 16/75 kB Progress (2): 229/385 kB | 16/75 kB Progress (2): 229/385 kB | 32/75 kB Progress (2): 245/385 kB | 32/75 kB Progress (2): 262/385 kB | 32/75 kB Progress (2): 262/385 kB | 49/75 kB Progress (2): 278/385 kB | 49/75 kB Progress (2): 278/385 kB | 65/75 kB Progress (2): 295/385 kB | 65/75 kB Progress (2): 295/385 kB | 75 kB Progress (2): 311/385 kB | 75 kB Progress (3): 311/385 kB | 75 kB | 16/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 536 kB/s) 2024-09-12T17:55:44.275 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T17:55:44.283 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 311/385 kB | 33/780 kB Progress (2): 311/385 kB | 49/780 kB Progress (2): 311/385 kB | 66/780 kB Progress (2): 311/385 kB | 82/780 kB Progress (2): 311/385 kB | 98/780 kB Progress (2): 311/385 kB | 115/780 kB Progress (2): 311/385 kB | 131/780 kB Progress (2): 311/385 kB | 147/780 kB Progress (2): 311/385 kB | 164/780 kB Progress (2): 311/385 kB | 180/780 kB Progress (2): 311/385 kB | 197/780 kB Progress (2): 311/385 kB | 213/780 kB Progress (2): 311/385 kB | 229/780 kB Progress (2): 311/385 kB | 246/780 kB Progress (2): 311/385 kB | 256/780 kB Progress (2): 311/385 kB | 272/780 kB Progress (2): 311/385 kB | 289/780 kB Progress (2): 311/385 kB | 305/780 kB Progress (2): 311/385 kB | 321/780 kB Progress (2): 311/385 kB | 338/780 kB Progress (2): 311/385 kB | 354/780 kB Progress (2): 327/385 kB | 354/780 kB Progress (2): 327/385 kB | 370/780 kB Progress (2): 344/385 kB | 370/780 kB Progress (2): 344/385 kB | 387/780 kB Progress (2): 360/385 kB | 387/780 kB Progress (2): 360/385 kB | 403/780 kB Progress (2): 376/385 kB | 403/780 kB Progress (2): 376/385 kB | 420/780 kB Progress (2): 385 kB | 420/780 kB Progress (2): 385 kB | 436/780 kB Progress (2): 385 kB | 452/780 kB Progress (2): 385 kB | 469/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.6 MB/s) 2024-09-12T17:55:44.283 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T17:55:44.289 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 485/780 kB Progress (1): 502/780 kB Progress (1): 518/780 kB Progress (1): 534/780 kB Progress (2): 534/780 kB | 16/329 kB Progress (2): 551/780 kB | 16/329 kB Progress (2): 567/780 kB | 16/329 kB Progress (2): 583/780 kB | 16/329 kB Progress (2): 600/780 kB | 16/329 kB Progress (2): 600/780 kB | 33/329 kB Progress (2): 616/780 kB | 33/329 kB Progress (2): 633/780 kB | 33/329 kB Progress (2): 649/780 kB | 33/329 kB Progress (2): 665/780 kB | 33/329 kB Progress (2): 665/780 kB | 49/329 kB Progress (2): 682/780 kB | 49/329 kB Progress (2): 698/780 kB | 49/329 kB Progress (3): 698/780 kB | 49/329 kB | 15/501 kB Progress (3): 715/780 kB | 49/329 kB | 15/501 kB Progress (3): 715/780 kB | 49/329 kB | 31/501 kB Progress (3): 731/780 kB | 49/329 kB | 31/501 kB Progress (3): 731/780 kB | 49/329 kB | 48/501 kB Progress (3): 747/780 kB | 49/329 kB | 48/501 kB Progress (3): 747/780 kB | 66/329 kB | 48/501 kB Progress (3): 764/780 kB | 66/329 kB | 48/501 kB Progress (3): 764/780 kB | 66/329 kB | 64/501 kB Progress (3): 780/780 kB | 66/329 kB | 64/501 kB Progress (3): 780/780 kB | 66/329 kB | 81/501 kB Progress (3): 780 kB | 66/329 kB | 81/501 kB Progress (3): 780 kB | 66/329 kB | 97/501 kB Progress (3): 780 kB | 82/329 kB | 97/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.1 MB/s) 2024-09-12T17:55:44.289 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T17:55:44.298 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 82/329 kB | 113/501 kB Progress (2): 82/329 kB | 130/501 kB Progress (2): 82/329 kB | 146/501 kB Progress (2): 82/329 kB | 162/501 kB Progress (2): 82/329 kB | 179/501 kB Progress (3): 82/329 kB | 179/501 kB | 16/354 kB Progress (3): 82/329 kB | 195/501 kB | 16/354 kB Progress (3): 82/329 kB | 195/501 kB | 33/354 kB Progress (3): 82/329 kB | 210/501 kB | 33/354 kB Progress (3): 82/329 kB | 210/501 kB | 49/354 kB Progress (3): 82/329 kB | 227/501 kB | 49/354 kB Progress (3): 82/329 kB | 227/501 kB | 64/354 kB Progress (3): 82/329 kB | 227/501 kB | 81/354 kB Progress (3): 82/329 kB | 243/501 kB | 81/354 kB Progress (3): 82/329 kB | 243/501 kB | 97/354 kB Progress (3): 82/329 kB | 243/501 kB | 114/354 kB Progress (3): 82/329 kB | 243/501 kB | 130/354 kB Progress (3): 82/329 kB | 243/501 kB | 146/354 kB Progress (3): 82/329 kB | 243/501 kB | 163/354 kB Progress (3): 82/329 kB | 243/501 kB | 179/354 kB Progress (3): 82/329 kB | 243/501 kB | 195/354 kB Progress (3): 82/329 kB | 243/501 kB | 212/354 kB Progress (3): 98/329 kB | 243/501 kB | 212/354 kB Progress (3): 98/329 kB | 243/501 kB | 228/354 kB Progress (3): 98/329 kB | 243/501 kB | 245/354 kB Progress (3): 115/329 kB | 243/501 kB | 245/354 kB Progress (3): 115/329 kB | 243/501 kB | 261/354 kB Progress (3): 131/329 kB | 243/501 kB | 261/354 kB Progress (3): 131/329 kB | 243/501 kB | 277/354 kB Progress (3): 147/329 kB | 243/501 kB | 277/354 kB Progress (4): 147/329 kB | 243/501 kB | 277/354 kB | 16/41 kB Progress (4): 147/329 kB | 243/501 kB | 277/354 kB | 33/41 kB Progress (4): 147/329 kB | 243/501 kB | 277/354 kB | 41 kB Progress (4): 164/329 kB | 243/501 kB | 277/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 257 kB/s) 2024-09-12T17:55:44.298 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T17:55:44.304 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (3): 164/329 kB | 259/501 kB | 277/354 kB Progress (3): 164/329 kB | 276/501 kB | 277/354 kB Progress (3): 180/329 kB | 276/501 kB | 277/354 kB Progress (3): 180/329 kB | 292/501 kB | 277/354 kB Progress (3): 197/329 kB | 292/501 kB | 277/354 kB Progress (3): 197/329 kB | 309/501 kB | 277/354 kB Progress (3): 197/329 kB | 325/501 kB | 277/354 kB Progress (3): 213/329 kB | 325/501 kB | 277/354 kB Progress (3): 213/329 kB | 341/501 kB | 277/354 kB Progress (3): 213/329 kB | 358/501 kB | 277/354 kB Progress (3): 213/329 kB | 374/501 kB | 277/354 kB Progress (3): 229/329 kB | 374/501 kB | 277/354 kB Progress (3): 229/329 kB | 390/501 kB | 277/354 kB Progress (3): 229/329 kB | 407/501 kB | 277/354 kB Progress (3): 246/329 kB | 407/501 kB | 277/354 kB Progress (3): 256/329 kB | 407/501 kB | 277/354 kB Progress (3): 256/329 kB | 423/501 kB | 277/354 kB Progress (3): 256/329 kB | 440/501 kB | 277/354 kB Progress (3): 256/329 kB | 456/501 kB | 277/354 kB Progress (3): 272/329 kB | 456/501 kB | 277/354 kB Progress (3): 272/329 kB | 456/501 kB | 294/354 kB Progress (3): 272/329 kB | 472/501 kB | 294/354 kB Progress (3): 272/329 kB | 472/501 kB | 310/354 kB Progress (3): 272/329 kB | 489/501 kB | 310/354 kB Progress (4): 272/329 kB | 489/501 kB | 310/354 kB | 6.4 kB Progress (4): 272/329 kB | 501 kB | 310/354 kB | 6.4 kB Progress (4): 272/329 kB | 501 kB | 327/354 kB | 6.4 kB Progress (4): 272/329 kB | 501 kB | 343/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 38 kB/s) 2024-09-12T17:55:44.304 INFO:tasks.workunit.client.0.smithi157.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.0 MB/s) 2024-09-12T17:55:44.304 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T17:55:44.304 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T17:55:44.305 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 272/329 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.1 MB/s) 2024-09-12T17:55:44.305 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T17:55:44.308 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 289/329 kB Progress (1): 305/329 kB Progress (1): 321/329 kB Progress (1): 329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.9 MB/s) 2024-09-12T17:55:44.308 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T17:55:44.319 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 66/586 kB Progress (1): 82/586 kB Progress (1): 95/586 kB Progress (1): 111/586 kB Progress (1): 127/586 kB Progress (1): 144/586 kB Progress (1): 160/586 kB Progress (1): 176/586 kB Progress (1): 193/586 kB Progress (1): 209/586 kB Progress (1): 226/586 kB Progress (1): 242/586 kB Progress (1): 258/586 kB Progress (1): 275/586 kB Progress (1): 291/586 kB Progress (1): 308/586 kB Progress (1): 324/586 kB Progress (1): 340/586 kB Progress (2): 340/586 kB | 14 kB Progress (2): 357/586 kB | 14 kB Progress (2): 373/586 kB | 14 kB Progress (3): 373/586 kB | 14 kB | 16/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 79 kB/s) 2024-09-12T17:55:44.319 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T17:55:44.322 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 389/586 kB | 16/106 kB Progress (2): 389/586 kB | 32/106 kB Progress (3): 389/586 kB | 32/106 kB | 16/211 kB Progress (3): 406/586 kB | 32/106 kB | 16/211 kB Progress (3): 406/586 kB | 32/106 kB | 31/211 kB Progress (3): 406/586 kB | 49/106 kB | 31/211 kB Progress (3): 422/586 kB | 49/106 kB | 31/211 kB Progress (3): 422/586 kB | 49/106 kB | 48/211 kB Progress (3): 422/586 kB | 65/106 kB | 48/211 kB Progress (3): 439/586 kB | 65/106 kB | 48/211 kB Progress (3): 439/586 kB | 65/106 kB | 64/211 kB Progress (3): 455/586 kB | 65/106 kB | 64/211 kB Progress (3): 455/586 kB | 81/106 kB | 64/211 kB Progress (3): 455/586 kB | 81/106 kB | 81/211 kB Progress (3): 471/586 kB | 81/106 kB | 81/211 kB Progress (3): 471/586 kB | 81/106 kB | 94/211 kB Progress (3): 471/586 kB | 98/106 kB | 94/211 kB Progress (3): 488/586 kB | 98/106 kB | 94/211 kB Progress (3): 488/586 kB | 98/106 kB | 110/211 kB Progress (3): 488/586 kB | 106 kB | 110/211 kB Progress (3): 504/586 kB | 106 kB | 110/211 kB Progress (3): 504/586 kB | 106 kB | 127/211 kB Progress (3): 521/586 kB | 106 kB | 127/211 kB Progress (3): 537/586 kB | 106 kB | 127/211 kB Progress (3): 537/586 kB | 106 kB | 143/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 578 kB/s) 2024-09-12T17:55:44.323 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 553/586 kB | 143/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T17:55:44.323 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 553/586 kB | 159/211 kB Progress (3): 553/586 kB | 159/211 kB | 6.8 kB Progress (3): 570/586 kB | 159/211 kB | 6.8 kB Progress (3): 570/586 kB | 176/211 kB | 6.8 kB Progress (3): 586 kB | 176/211 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 37 kB/s) 2024-09-12T17:55:44.323 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 586 kB | 192/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T17:55:44.323 INFO:tasks.workunit.client.0.smithi157.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-12T17:55:44.323 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:55:44.323 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 208/211 kB Progress (1): 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-09-12T17:55:44.324 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T17:55:44.338 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (1): 115/245 kB Progress (1): 131/245 kB Progress (1): 147/245 kB Progress (1): 164/245 kB Progress (1): 177/245 kB Progress (1): 194/245 kB Progress (2): 194/245 kB | 16/205 kB Progress (2): 194/245 kB | 33/205 kB Progress (3): 194/245 kB | 33/205 kB | 16/16 kB Progress (3): 194/245 kB | 33/205 kB | 16 kB Progress (3): 194/245 kB | 49/205 kB | 16 kB Progress (3): 210/245 kB | 49/205 kB | 16 kB Progress (3): 210/245 kB | 66/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 83 kB/s) 2024-09-12T17:55:44.338 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (3): 210/245 kB | 66/205 kB | 6.4 kB Progress (3): 226/245 kB | 66/205 kB | 6.4 kB Progress (4): 226/245 kB | 66/205 kB | 6.4 kB | 15 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T17:55:44.338 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (4): 226/245 kB | 81/205 kB | 6.4 kB | 15 kB Progress (4): 243/245 kB | 81/205 kB | 6.4 kB | 15 kB Progress (4): 245 kB | 81/205 kB | 6.4 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 32 kB/s) 2024-09-12T17:55:44.338 INFO:tasks.workunit.client.0.smithi157.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 76 kB/s) 2024-09-12T17:55:44.338 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T17:55:44.339 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 245 kB | 98/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T17:55:44.339 INFO:tasks.workunit.client.0.smithi157.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T17:55:44.339 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T17:55:44.340 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 114/205 kB Progress (1): 130/205 kB Progress (1): 147/205 kB Progress (1): 163/205 kB Progress (1): 180/205 kB Progress (1): 196/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-12T17:55:44.353 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Progress (2): 23 kB | 16/17 kB Progress (3): 23 kB | 16/17 kB | 16/184 kB Progress (3): 23 kB | 17 kB | 16/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 106 kB/s) 2024-09-12T17:55:44.353 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 17 kB | 33/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 81 kB/s) 2024-09-12T17:55:44.354 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (2): 65/184 kB | 16/24 kB Progress (2): 81/184 kB | 16/24 kB Progress (2): 81/184 kB | 24 kB Progress (2): 98/184 kB | 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 112 kB/s) 2024-09-12T17:55:44.355 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 851 kB/s) 2024-09-12T17:55:44.374 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:44.374 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T17:55:44.381 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T17:55:44.395 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 416 kB/s) 2024-09-12T17:55:44.397 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T17:55:44.412 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-12T17:55:44.413 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T17:55:44.430 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-09-12T17:55:44.434 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T17:55:44.448 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-12T17:55:44.453 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T17:55:44.470 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-12T17:55:44.470 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T17:55:44.491 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-09-12T17:55:44.566 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:44.566 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:55:44.570 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T17:55:44.585 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-12T17:55:44.588 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T17:55:44.602 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.4 MB/s) 2024-09-12T17:55:44.606 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T17:55:44.621 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-12T17:55:44.624 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T17:55:44.639 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-12T17:55:44.643 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T17:55:44.658 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-12T17:55:44.661 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T17:55:44.678 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 189 kB/s) 2024-09-12T17:55:44.682 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T17:55:44.697 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-12T17:55:44.700 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T17:55:44.714 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T17:55:44.717 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T17:55:44.731 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T17:55:44.735 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T17:55:44.751 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 200 kB/s) 2024-09-12T17:55:44.754 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T17:55:44.769 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 522 kB/s) 2024-09-12T17:55:44.772 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T17:55:44.787 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 558 kB/s) 2024-09-12T17:55:44.790 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T17:55:44.805 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-12T17:55:44.809 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T17:55:44.824 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.3 MB/s) 2024-09-12T17:55:44.830 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T17:55:44.845 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-12T17:55:44.848 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T17:55:44.863 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-09-12T17:55:44.869 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T17:55:44.884 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-12T17:55:44.890 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T17:55:44.906 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.3 MB/s) 2024-09-12T17:55:44.906 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T17:55:44.907 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T17:55:44.907 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T17:55:44.907 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T17:55:44.907 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T17:55:44.922 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 166 kB/s) 2024-09-12T17:55:44.923 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 8.5 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-12T17:55:44.923 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T17:55:44.923 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T17:55:44.924 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 16/269 kB | 16/41 kB Progress (2): 33/269 kB | 16/41 kB Progress (2): 33/269 kB | 33/41 kB Progress (2): 33/269 kB | 41 kB Progress (2): 49/269 kB | 41 kB Progress (3): 49/269 kB | 41 kB | 16/55 kB Progress (3): 62/269 kB | 41 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.4 MB/s) 2024-09-12T17:55:44.925 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 62/269 kB | 32/55 kB Progress (2): 79/269 kB | 32/55 kB Progress (2): 79/269 kB | 49/55 kB Progress (2): 79/269 kB | 55 kB Progress (2): 95/269 kB | 55 kB Progress (2): 111/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.7 MB/s) 2024-09-12T17:55:44.931 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 128/269 kB Progress (1): 144/269 kB Progress (1): 161/269 kB Progress (1): 177/269 kB Progress (1): 193/269 kB Progress (1): 210/269 kB Progress (1): 226/269 kB Progress (1): 243/269 kB Progress (1): 259/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 10 MB/s) 2024-09-12T17:55:44.946 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/587 kB Progress (1): 33/587 kB Progress (1): 49/587 kB Progress (1): 64/587 kB Progress (2): 64/587 kB | 16/327 kB Progress (2): 80/587 kB | 16/327 kB Progress (2): 80/587 kB | 33/327 kB Progress (2): 97/587 kB | 33/327 kB Progress (2): 97/587 kB | 49/327 kB Progress (2): 113/587 kB | 49/327 kB Progress (2): 113/587 kB | 66/327 kB Progress (2): 129/587 kB | 66/327 kB Progress (2): 129/587 kB | 82/327 kB Progress (2): 146/587 kB | 82/327 kB Progress (2): 146/587 kB | 98/327 kB Progress (2): 162/587 kB | 98/327 kB Progress (2): 162/587 kB | 115/327 kB Progress (2): 179/587 kB | 115/327 kB Progress (2): 179/587 kB | 131/327 kB Progress (2): 195/587 kB | 131/327 kB Progress (2): 195/587 kB | 147/327 kB Progress (2): 211/587 kB | 147/327 kB Progress (2): 211/587 kB | 164/327 kB Progress (2): 228/587 kB | 164/327 kB Progress (2): 228/587 kB | 180/327 kB Progress (2): 244/587 kB | 180/327 kB Progress (2): 244/587 kB | 197/327 kB Progress (2): 261/587 kB | 197/327 kB Progress (2): 261/587 kB | 213/327 kB Progress (2): 277/587 kB | 213/327 kB Progress (2): 277/587 kB | 229/327 kB Progress (2): 293/587 kB | 229/327 kB Progress (2): 293/587 kB | 246/327 kB Progress (2): 310/587 kB | 246/327 kB Progress (2): 310/587 kB | 256/327 kB Progress (2): 326/587 kB | 256/327 kB Progress (2): 326/587 kB | 272/327 kB Progress (2): 342/587 kB | 272/327 kB Progress (2): 342/587 kB | 289/327 kB Progress (2): 359/587 kB | 289/327 kB Progress (2): 359/587 kB | 305/327 kB Progress (2): 375/587 kB | 305/327 kB Progress (2): 375/587 kB | 321/327 kB Progress (2): 375/587 kB | 327 kB Progress (2): 392/587 kB | 327 kB Progress (2): 408/587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.4 MB/s) 2024-09-12T17:55:44.951 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 424/587 kB Progress (1): 441/587 kB Progress (1): 457/587 kB Progress (1): 474/587 kB Progress (1): 490/587 kB Progress (1): 506/587 kB Progress (1): 523/587 kB Progress (1): 539/587 kB Progress (1): 555/587 kB Progress (1): 572/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-09-12T17:55:44.996 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:55:44.997 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:44.997 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:55:45.002 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T17:55:45.017 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-12T17:55:45.019 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T17:55:45.033 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-12T17:55:45.036 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T17:55:45.050 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-12T17:55:45.052 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T17:55:45.066 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-12T17:55:45.070 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T17:55:45.085 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-12T17:55:45.088 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T17:55:45.101 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-12T17:55:45.103 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T17:55:45.118 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T17:55:45.122 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T17:55:45.137 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-12T17:55:45.140 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T17:55:45.154 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-12T17:55:45.159 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T17:55:45.173 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-12T17:55:45.175 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T17:55:45.189 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-12T17:55:45.192 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T17:55:45.209 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.2 MB/s) 2024-09-12T17:55:45.210 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T17:55:45.225 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-12T17:55:45.228 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T17:55:45.243 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-12T17:55:45.245 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T17:55:45.260 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-12T17:55:45.262 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T17:55:45.277 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T17:55:45.280 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T17:55:45.294 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-12T17:55:45.296 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T17:55:45.311 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-12T17:55:45.316 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T17:55:45.330 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-09-12T17:55:45.333 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T17:55:45.348 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-09-12T17:55:45.350 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T17:55:45.365 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.7 MB/s) 2024-09-12T17:55:45.371 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T17:55:45.385 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-12T17:55:45.388 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T17:55:45.403 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-12T17:55:45.412 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T17:55:45.426 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-12T17:55:45.426 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T17:55:45.427 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T17:55:45.427 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T17:55:45.427 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T17:55:45.428 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T17:55:45.443 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/55 kB Progress (2): 16/55 kB | 16/122 kB Progress (2): 33/55 kB | 16/122 kB Progress (2): 33/55 kB | 33/122 kB Progress (2): 49/55 kB | 33/122 kB Progress (2): 55 kB | 33/122 kB Progress (3): 55 kB | 33/122 kB | 4.2 kB Progress (3): 55 kB | 49/122 kB | 4.2 kB Progress (3): 55 kB | 66/122 kB | 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-12T17:55:45.443 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T17:55:45.443 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 82/122 kB | 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 263 kB/s) 2024-09-12T17:55:45.443 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 82/122 kB | 15/27 kB Progress (2): 98/122 kB | 15/27 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T17:55:45.444 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 98/122 kB | 27 kB Progress (2): 115/122 kB | 27 kB Progress (3): 115/122 kB | 27 kB | 16/334 kB Progress (3): 122 kB | 27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-09-12T17:55:45.444 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 122 kB | 33/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T17:55:45.444 INFO:tasks.workunit.client.0.smithi157.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-12T17:55:45.448 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 49/334 kB Progress (1): 65/334 kB Progress (1): 82/334 kB Progress (1): 98/334 kB Progress (1): 114/334 kB Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 16 MB/s) 2024-09-12T17:55:45.456 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-12T17:55:45.458 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (2): 98/267 kB | 16/23 kB Progress (2): 98/267 kB | 23 kB Progress (2): 115/267 kB | 23 kB Progress (2): 131/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 760 kB/s) 2024-09-12T17:55:45.461 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.1 MB/s) 2024-09-12T17:55:45.568 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T17:55:45.568 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T17:55:46.685 INFO:tasks.workunit.client.0.smithi157.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:55:46.685 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:46.686 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:55:46.689 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:55:46.689 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:46.689 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:55:46.696 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T17:55:46.696 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T17:55:46.913 INFO:tasks.workunit.client.0.smithi157.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:55:46.913 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:46.913 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:55:46.920 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T17:55:46.934 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T17:55:46.938 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T17:55:46.953 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-12T17:55:46.957 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T17:55:46.972 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-12T17:55:46.975 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T17:55:46.989 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-12T17:55:46.993 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T17:55:47.007 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-09-12T17:55:47.011 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T17:55:47.025 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-12T17:55:47.030 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T17:55:47.050 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 88 kB/s) 2024-09-12T17:55:47.054 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T17:55:47.071 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 129 kB/s) 2024-09-12T17:55:47.073 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T17:55:47.088 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-12T17:55:47.091 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T17:55:47.106 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T17:55:47.109 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T17:55:47.124 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-12T17:55:47.128 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T17:55:47.143 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-12T17:55:47.145 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T17:55:47.159 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-12T17:55:47.163 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T17:55:47.178 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.3 MB/s) 2024-09-12T17:55:47.181 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T17:55:47.196 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-12T17:55:47.199 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T17:55:47.213 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 577 kB/s) 2024-09-12T17:55:47.216 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T17:55:47.231 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.8 MB/s) 2024-09-12T17:55:47.234 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T17:55:47.249 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 538 kB/s) 2024-09-12T17:55:47.253 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T17:55:47.267 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 145 kB/s) 2024-09-12T17:55:47.271 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T17:55:47.287 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 162 kB/s) 2024-09-12T17:55:47.291 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T17:55:47.305 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-12T17:55:47.306 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T17:55:47.320 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-12T17:55:47.323 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T17:55:47.336 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-12T17:55:47.338 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T17:55:47.352 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-12T17:55:47.354 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T17:55:47.368 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T17:55:47.371 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T17:55:47.386 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-12T17:55:47.388 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T17:55:47.402 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-12T17:55:47.404 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T17:55:47.418 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-12T17:55:47.421 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T17:55:47.435 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-12T17:55:47.438 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T17:55:47.452 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-12T17:55:47.457 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T17:55:47.471 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-12T17:55:47.475 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T17:55:47.490 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-12T17:55:47.493 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T17:55:47.507 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T17:55:47.511 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T17:55:47.525 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-12T17:55:47.527 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T17:55:47.541 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-12T17:55:47.544 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T17:55:47.559 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 418 kB/s) 2024-09-12T17:55:47.561 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T17:55:47.577 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.0 MB/s) 2024-09-12T17:55:47.580 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T17:55:47.595 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T17:55:47.598 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T17:55:47.612 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 987 kB/s) 2024-09-12T17:55:47.615 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T17:55:47.632 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 50 kB/s) 2024-09-12T17:55:47.633 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T17:55:47.646 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-12T17:55:47.649 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T17:55:47.664 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 527 kB/s) 2024-09-12T17:55:47.668 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T17:55:47.682 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 200 kB/s) 2024-09-12T17:55:47.687 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T17:55:47.702 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 283 kB/s) 2024-09-12T17:55:47.706 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T17:55:47.721 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-09-12T17:55:47.725 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T17:55:47.739 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 232 kB/s) 2024-09-12T17:55:47.743 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T17:55:47.759 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 684 kB/s) 2024-09-12T17:55:47.762 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T17:55:47.777 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 898 kB/s) 2024-09-12T17:55:47.779 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T17:55:47.794 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T17:55:47.797 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T17:55:47.811 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-12T17:55:47.814 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T17:55:47.830 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.7/6.1 kB Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 359 kB/s) 2024-09-12T17:55:47.833 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T17:55:47.847 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 489 kB/s) 2024-09-12T17:55:47.849 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T17:55:47.865 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-12T17:55:47.866 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T17:55:47.881 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 487 kB/s) 2024-09-12T17:55:47.884 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T17:55:47.900 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-12T17:55:47.902 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T17:55:47.918 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.6 MB/s) 2024-09-12T17:55:47.923 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T17:55:47.938 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-12T17:55:47.942 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T17:55:47.955 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-12T17:55:47.958 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T17:55:47.972 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-12T17:55:47.974 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T17:55:47.988 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-12T17:55:47.990 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T17:55:48.005 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.7 MB/s) 2024-09-12T17:55:48.009 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T17:55:48.023 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 158 kB/s) 2024-09-12T17:55:48.031 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T17:55:48.053 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 15 MB/s) 2024-09-12T17:55:48.053 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T17:55:48.053 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T17:55:48.054 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T17:55:48.054 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T17:55:48.054 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T17:55:48.069 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 849 kB/s) 2024-09-12T17:55:48.069 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T17:55:48.071 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Progress (2): 26 kB | 8.2 kB Progress (3): 26 kB | 8.2 kB | 16/171 kB Progress (4): 26 kB | 8.2 kB | 16/171 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-09-12T17:55:48.071 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (3): 8.2 kB | 16/171 kB | 32/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-12T17:55:48.071 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T17:55:48.073 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 16/171 kB | 49/118 kB Progress (2): 16/171 kB | 65/118 kB Progress (2): 16/171 kB | 81/118 kB Progress (2): 16/171 kB | 98/118 kB Progress (2): 16/171 kB | 114/118 kB Progress (2): 16/171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.2 MB/s) 2024-09-12T17:55:48.073 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T17:55:48.073 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 33/171 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T17:55:48.077 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 49/171 kB Progress (1): 64/171 kB Progress (1): 81/171 kB Progress (1): 97/171 kB Progress (1): 113/171 kB Progress (1): 130/171 kB Progress (1): 146/171 kB Progress (1): 163/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 7.1 MB/s) 2024-09-12T17:55:48.077 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T17:55:48.086 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 62/146 kB Progress (1): 79/146 kB Progress (1): 95/146 kB Progress (1): 112/146 kB Progress (1): 128/146 kB Progress (1): 144/146 kB Progress (1): 146 kB Progress (2): 146 kB | 16/61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.7 MB/s) 2024-09-12T17:55:48.086 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T17:55:48.088 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 33/61 kB Progress (1): 49/61 kB Progress (1): 61 kB Progress (2): 61 kB | 16/501 kB Progress (3): 61 kB | 16/501 kB | 16/136 kB Progress (3): 61 kB | 32/501 kB | 16/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.9 MB/s) 2024-09-12T17:55:48.088 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 49/501 kB | 16/136 kB Progress (2): 49/501 kB | 33/136 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T17:55:48.091 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 65/501 kB | 33/136 kB Progress (2): 65/501 kB | 49/136 kB Progress (2): 81/501 kB | 49/136 kB Progress (2): 81/501 kB | 65/136 kB Progress (2): 98/501 kB | 65/136 kB Progress (2): 114/501 kB | 65/136 kB Progress (2): 114/501 kB | 81/136 kB Progress (2): 130/501 kB | 81/136 kB Progress (2): 130/501 kB | 98/136 kB Progress (2): 147/501 kB | 98/136 kB Progress (2): 147/501 kB | 114/136 kB Progress (2): 163/501 kB | 114/136 kB Progress (2): 180/501 kB | 114/136 kB Progress (2): 180/501 kB | 130/136 kB Progress (2): 196/501 kB | 130/136 kB Progress (2): 196/501 kB | 136 kB Progress (2): 212/501 kB | 136 kB Progress (3): 212/501 kB | 136 kB | 16/58 kB Progress (3): 229/501 kB | 136 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.8 MB/s) 2024-09-12T17:55:48.094 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 245/501 kB | 16/58 kB Progress (2): 245/501 kB | 33/58 kB Progress (2): 262/501 kB | 33/58 kB Progress (2): 278/501 kB | 33/58 kB Progress (2): 278/501 kB | 49/58 kB Progress (2): 294/501 kB | 49/58 kB Progress (2): 294/501 kB | 58 kB Progress (2): 311/501 kB | 58 kB Progress (2): 327/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-12T17:55:48.095 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 393/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 475/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-12T17:55:48.102 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/124 kB Progress (1): 32/124 kB Progress (1): 49/124 kB Progress (1): 65/124 kB Progress (1): 81/124 kB Progress (1): 98/124 kB Progress (1): 114/124 kB Progress (2): 114/124 kB | 0/2.4 MB Progress (2): 124 kB | 0/2.4 MB Progress (2): 124 kB | 0/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-12T17:55:48.150 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 26 MB/s) 2024-09-12T17:55:48.238 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:48.238 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T17:55:48.241 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T17:55:48.255 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-12T17:55:48.257 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T17:55:48.273 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-12T17:55:48.273 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T17:55:48.287 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T17:55:48.289 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T17:55:48.304 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-12T17:55:48.308 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T17:55:48.322 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T17:55:48.324 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T17:55:48.339 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-12T17:55:48.341 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T17:55:48.355 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-12T17:55:48.358 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T17:55:48.372 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T17:55:48.374 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T17:55:48.388 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T17:55:48.392 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T17:55:48.406 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-12T17:55:48.408 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T17:55:48.422 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-12T17:55:48.424 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T17:55:48.438 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-12T17:55:48.440 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T17:55:48.454 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-12T17:55:48.460 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T17:55:48.474 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-12T17:55:48.475 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T17:55:48.475 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T17:55:48.475 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T17:55:48.484 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T17:55:48.484 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T17:55:48.490 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 15/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-12T17:55:48.490 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T17:55:48.501 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/211 kB Progress (2): 16/211 kB | 16/79 kB Progress (2): 33/211 kB | 16/79 kB Progress (3): 33/211 kB | 16/79 kB | 0/1.0 MB Progress (4): 33/211 kB | 16/79 kB | 0/1.0 MB | 16/58 kB Progress (4): 33/211 kB | 33/79 kB | 0/1.0 MB | 16/58 kB Progress (4): 49/211 kB | 33/79 kB | 0/1.0 MB | 16/58 kB Progress (4): 49/211 kB | 33/79 kB | 0/1.0 MB | 16/58 kB Progress (4): 49/211 kB | 33/79 kB | 0/1.0 MB | 31/58 kB Progress (4): 66/211 kB | 33/79 kB | 0/1.0 MB | 31/58 kB Progress (4): 66/211 kB | 33/79 kB | 0/1.0 MB | 31/58 kB Progress (4): 82/211 kB | 33/79 kB | 0/1.0 MB | 31/58 kB Progress (4): 82/211 kB | 33/79 kB | 0/1.0 MB | 48/58 kB Progress (4): 82/211 kB | 33/79 kB | 0.1/1.0 MB | 48/58 kB Progress (4): 82/211 kB | 49/79 kB | 0.1/1.0 MB | 48/58 kB Progress (4): 95/211 kB | 49/79 kB | 0.1/1.0 MB | 48/58 kB Progress (4): 95/211 kB | 49/79 kB | 0.1/1.0 MB | 48/58 kB Progress (4): 95/211 kB | 49/79 kB | 0.1/1.0 MB | 58 kB Progress (4): 95/211 kB | 49/79 kB | 0.1/1.0 MB | 58 kB Progress (4): 112/211 kB | 49/79 kB | 0.1/1.0 MB | 58 kB Progress (4): 112/211 kB | 66/79 kB | 0.1/1.0 MB | 58 kB Progress (4): 112/211 kB | 66/79 kB | 0.1/1.0 MB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 2.3 MB/s) 2024-09-12T17:55:48.501 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (3): 128/211 kB | 66/79 kB | 0.1/1.0 MB Progress (3): 128/211 kB | 66/79 kB | 0.1/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T17:55:48.501 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (3): 128/211 kB | 79 kB | 0.1/1.0 MB Progress (3): 128/211 kB | 79 kB | 0.1/1.0 MB Progress (3): 145/211 kB | 79 kB | 0.1/1.0 MB Progress (3): 145/211 kB | 79 kB | 0.2/1.0 MB Progress (3): 161/211 kB | 79 kB | 0.2/1.0 MB Progress (3): 161/211 kB | 79 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 2.9 MB/s) 2024-09-12T17:55:48.502 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 161/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 210/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.3/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 7.5 MB/s) 2024-09-12T17:55:48.506 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 0.3/1.0 MB Progress (2): 0.3/1.0 MB | 16/116 kB Progress (2): 0.3/1.0 MB | 16/116 kB Progress (2): 0.3/1.0 MB | 16/116 kB Progress (2): 0.3/1.0 MB | 33/116 kB Progress (2): 0.3/1.0 MB | 33/116 kB Progress (2): 0.3/1.0 MB | 49/116 kB Progress (2): 0.3/1.0 MB | 49/116 kB Progress (2): 0.3/1.0 MB | 49/116 kB Progress (2): 0.3/1.0 MB | 66/116 kB Progress (2): 0.4/1.0 MB | 66/116 kB Progress (2): 0.4/1.0 MB | 66/116 kB Progress (2): 0.4/1.0 MB | 82/116 kB Progress (2): 0.4/1.0 MB | 82/116 kB Progress (2): 0.4/1.0 MB | 98/116 kB Progress (2): 0.4/1.0 MB | 98/116 kB Progress (2): 0.4/1.0 MB | 98/116 kB Progress (2): 0.4/1.0 MB | 115/116 kB Progress (2): 0.4/1.0 MB | 116 kB Progress (2): 0.4/1.0 MB | 116 kB Progress (2): 0.5/1.0 MB | 116 kB Progress (2): 0.5/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-12T17:55:48.514 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 26 MB/s) 2024-09-12T17:55:48.521 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/267 kB Progress (1): 32/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 5.7 MB/s) 2024-09-12T17:55:48.740 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T17:55:48.779 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:55:48.779 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:55:48.779 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:55:48.780 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Total time: 7.110 s 2024-09-12T17:55:48.780 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Finished at: 2024-09-12T17:55:48Z 2024-09-12T17:55:48.780 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:55:48.821 INFO:tasks.workunit.client.0.smithi157.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T17:55:48.827 INFO:tasks.workunit.client.0.smithi157.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:55:49.887 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Scanning for projects... 2024-09-12T17:55:49.970 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:49.970 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:55:49.970 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:55:49.970 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] from pom.xml 2024-09-12T17:55:49.970 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:55:50.332 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:50.332 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:55:50.495 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:55:50.495 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:50.495 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:55:50.613 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:55:50.614 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:50.614 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:55:50.617 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:55:50.617 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:50.617 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:55:50.624 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:55:50.625 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:50.625 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:55:50.869 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T17:55:51.144 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T17:55:51.410 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 17 kB/s) 2024-09-12T17:55:51.422 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T17:55:51.441 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-09-12T17:55:51.448 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T17:55:51.468 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-09-12T17:55:51.474 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T17:55:51.492 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-12T17:55:51.496 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T17:55:51.512 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-12T17:55:51.516 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T17:55:51.532 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-12T17:55:51.536 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T17:55:51.553 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 157 kB/s) 2024-09-12T17:55:51.559 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T17:55:51.583 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-12T17:55:51.585 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T17:55:51.585 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T17:55:51.586 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T17:55:51.586 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T17:55:51.587 INFO:tasks.workunit.client.0.smithi157.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T17:55:51.610 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 650 kB/s) 2024-09-12T17:55:51.635 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (1): 5.5/7.7 kB Progress (2): 5.5/7.7 kB | 1.4/169 kB Progress (2): 6.9/7.7 kB | 1.4/169 kB Progress (2): 6.9/7.7 kB | 2.8/169 kB Progress (2): 7.7 kB | 2.8/169 kB Progress (2): 7.7 kB | 4.1/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 150 kB/s) 2024-09-12T17:55:51.678 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 4.1/169 kB | 1.4/103 kB Progress (2): 5.5/169 kB | 1.4/103 kB Progress (3): 5.5/169 kB | 1.4/103 kB | 1.4/189 kB Progress (3): 5.5/169 kB | 2.8/103 kB | 1.4/189 kB Progress (3): 5.5/169 kB | 2.8/103 kB | 2.8/189 kB Progress (3): 6.9/169 kB | 2.8/103 kB | 2.8/189 kB Progress (3): 6.9/169 kB | 2.8/103 kB | 4.1/189 kB Progress (3): 8.3/169 kB | 2.8/103 kB | 4.1/189 kB Progress (3): 8.3/169 kB | 4.1/103 kB | 4.1/189 kB Progress (3): 8.3/169 kB | 4.1/103 kB | 5.5/189 kB Progress (3): 9.7/169 kB | 4.1/103 kB | 5.5/189 kB Progress (3): 9.7/169 kB | 4.1/103 kB | 6.9/189 kB Progress (3): 11/169 kB | 4.1/103 kB | 6.9/189 kB Progress (3): 11/169 kB | 5.5/103 kB | 6.9/189 kB Progress (3): 11/169 kB | 5.5/103 kB | 8.3/189 kB Progress (3): 12/169 kB | 5.5/103 kB | 8.3/189 kB Progress (3): 12/169 kB | 5.5/103 kB | 9.7/189 kB Progress (3): 12/169 kB | 6.9/103 kB | 9.7/189 kB Progress (3): 12/169 kB | 6.9/103 kB | 11/189 kB Progress (3): 14/169 kB | 6.9/103 kB | 11/189 kB Progress (3): 14/169 kB | 6.9/103 kB | 12/189 kB Progress (3): 15/169 kB | 6.9/103 kB | 12/189 kB Progress (3): 15/169 kB | 8.3/103 kB | 12/189 kB Progress (3): 16/169 kB | 8.3/103 kB | 12/189 kB Progress (3): 16/169 kB | 8.3/103 kB | 14/189 kB Progress (3): 18/169 kB | 8.3/103 kB | 14/189 kB Progress (3): 18/169 kB | 9.7/103 kB | 14/189 kB Progress (3): 18/169 kB | 9.7/103 kB | 15/189 kB Progress (3): 19/169 kB | 9.7/103 kB | 15/189 kB Progress (3): 19/169 kB | 9.7/103 kB | 16/189 kB Progress (3): 21/169 kB | 9.7/103 kB | 16/189 kB Progress (3): 21/169 kB | 9.7/103 kB | 18/189 kB Progress (3): 22/169 kB | 9.7/103 kB | 18/189 kB Progress (3): 22/169 kB | 11/103 kB | 18/189 kB Progress (3): 23/169 kB | 11/103 kB | 18/189 kB Progress (3): 23/169 kB | 11/103 kB | 19/189 kB Progress (3): 23/169 kB | 11/103 kB | 21/189 kB Progress (3): 23/169 kB | 12/103 kB | 21/189 kB Progress (3): 25/169 kB | 12/103 kB | 21/189 kB Progress (3): 25/169 kB | 12/103 kB | 22/189 kB Progress (3): 26/169 kB | 12/103 kB | 22/189 kB Progress (3): 26/169 kB | 14/103 kB | 22/189 kB Progress (3): 26/169 kB | 14/103 kB | 23/189 kB Progress (3): 27/169 kB | 14/103 kB | 23/189 kB Progress (3): 27/169 kB | 14/103 kB | 25/189 kB Progress (3): 27/169 kB | 15/103 kB | 25/189 kB Progress (3): 29/169 kB | 15/103 kB | 25/189 kB Progress (3): 29/169 kB | 15/103 kB | 26/189 kB Progress (3): 30/169 kB | 15/103 kB | 26/189 kB Progress (3): 30/169 kB | 15/103 kB | 27/189 kB Progress (3): 30/169 kB | 16/103 kB | 27/189 kB Progress (3): 30/169 kB | 16/103 kB | 29/189 kB Progress (3): 32/169 kB | 16/103 kB | 29/189 kB Progress (3): 32/169 kB | 16/103 kB | 30/189 kB Progress (3): 33/169 kB | 16/103 kB | 30/189 kB Progress (3): 33/169 kB | 16/103 kB | 32/189 kB Progress (3): 34/169 kB | 16/103 kB | 32/189 kB Progress (3): 34/169 kB | 16/103 kB | 33/189 kB Progress (3): 36/169 kB | 16/103 kB | 33/189 kB Progress (3): 37/169 kB | 16/103 kB | 33/189 kB Progress (3): 37/169 kB | 16/103 kB | 34/189 kB Progress (3): 38/169 kB | 16/103 kB | 34/189 kB Progress (3): 38/169 kB | 16/103 kB | 36/189 kB Progress (3): 40/169 kB | 16/103 kB | 36/189 kB Progress (3): 40/169 kB | 32/103 kB | 36/189 kB Progress (3): 41/169 kB | 32/103 kB | 36/189 kB Progress (3): 41/169 kB | 32/103 kB | 37/189 kB Progress (3): 43/169 kB | 32/103 kB | 37/189 kB Progress (3): 43/169 kB | 32/103 kB | 38/189 kB Progress (3): 44/169 kB | 32/103 kB | 38/189 kB Progress (3): 44/169 kB | 32/103 kB | 40/189 kB Progress (3): 45/169 kB | 32/103 kB | 40/189 kB Progress (3): 45/169 kB | 32/103 kB | 41/189 kB Progress (3): 45/169 kB | 49/103 kB | 41/189 kB Progress (3): 45/169 kB | 49/103 kB | 43/189 kB Progress (3): 47/169 kB | 49/103 kB | 43/189 kB Progress (3): 47/169 kB | 49/103 kB | 44/189 kB Progress (3): 48/169 kB | 49/103 kB | 44/189 kB Progress (3): 48/169 kB | 49/103 kB | 45/189 kB Progress (3): 49/169 kB | 49/103 kB | 45/189 kB Progress (3): 49/169 kB | 65/103 kB | 45/189 kB Progress (3): 51/169 kB | 65/103 kB | 45/189 kB Progress (3): 51/169 kB | 65/103 kB | 47/189 kB Progress (3): 52/169 kB | 65/103 kB | 47/189 kB Progress (3): 52/169 kB | 65/103 kB | 48/189 kB Progress (3): 54/169 kB | 65/103 kB | 48/189 kB Progress (3): 54/169 kB | 65/103 kB | 49/189 kB Progress (3): 54/169 kB | 81/103 kB | 49/189 kB Progress (3): 55/169 kB | 81/103 kB | 49/189 kB Progress (3): 55/169 kB | 81/103 kB | 66/189 kB Progress (3): 56/169 kB | 81/103 kB | 66/189 kB Progress (3): 58/169 kB | 81/103 kB | 66/189 kB Progress (3): 58/169 kB | 81/103 kB | 82/189 kB Progress (3): 59/169 kB | 81/103 kB | 82/189 kB Progress (3): 61/169 kB | 81/103 kB | 82/189 kB Progress (3): 61/169 kB | 81/103 kB | 98/189 kB Progress (3): 61/169 kB | 81/103 kB | 98/189 kB Progress (3): 78/169 kB | 81/103 kB | 98/189 kB Progress (3): 94/169 kB | 81/103 kB | 98/189 kB Progress (3): 94/169 kB | 98/103 kB | 98/189 kB Progress (3): 94/169 kB | 103 kB | 98/189 kB Progress (3): 111/169 kB | 103 kB | 98/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.1 MB/s) 2024-09-12T17:55:51.683 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (2): 127/169 kB | 98/189 kB Progress (2): 143/169 kB | 98/189 kB Progress (2): 143/169 kB | 115/189 kB Progress (2): 160/169 kB | 115/189 kB Progress (2): 169 kB | 115/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.7 MB/s) 2024-09-12T17:55:51.695 INFO:tasks.workunit.client.0.smithi157.stdout:Progress (1): 131/189 kB Progress (1): 147/189 kB Progress (1): 164/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.7 MB/s) 2024-09-12T17:55:51.713 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:55:51.713 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:55:51.713 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] T E S T S 2024-09-12T17:55:51.713 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:55:52.436 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T17:55:52.513 INFO:tasks.workunit.client.0.smithi157.stdout:PutObjects.java: starting test run: 2024-09-12T17:55:52.513 INFO:tasks.workunit.client.0.smithi157.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:55:52.513 INFO:tasks.workunit.client.0.smithi157.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:55:52.514 INFO:tasks.workunit.client.0.smithi157.stdout: EndpointUrl=http://smithi157.front.sepia.ceph.com:80 2024-09-12T17:55:52.514 INFO:tasks.workunit.client.0.smithi157.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T17:55:52.711 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: Environment Variables Read 2024-09-12T17:55:53.011 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: S3 Client Initialized 2024-09-12T17:55:53.011 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: Generating File 2024-09-12T17:55:53.112 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: File Generated 2024-09-12T17:55:53.112 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: Generating File 2024-09-12T17:55:53.113 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: File Generated 2024-09-12T17:55:53.113 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: Generating File 2024-09-12T17:55:53.113 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: File Generated 2024-09-12T17:55:53.113 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: Generating File 2024-09-12T17:55:53.113 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: File Generated 2024-09-12T17:55:53.113 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: Generating File 2024-09-12T17:55:53.113 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: File Generated 2024-09-12T17:55:53.113 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: Generating File 2024-09-12T17:55:53.113 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: File Generated 2024-09-12T17:55:53.113 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: Generated Big Files 2024-09-12T17:55:53.518 INFO:tasks.workunit.client.0.smithi157.stdout:HeadBucketResponse() 2024-09-12T17:55:53.518 INFO:tasks.workunit.client.0.smithi157.stdout:sheik is ready 2024-09-12T17:55:53.518 INFO:tasks.workunit.client.0.smithi157.stdout:DEBUG: Test Bucket Created 2024-09-12T17:55:53.618 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T17:55:53.919 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T17:55:54.320 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T17:55:54.721 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T17:55:55.122 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T17:55:55.423 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T17:55:55.724 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T17:55:56.124 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T17:55:56.826 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T17:55:57.327 INFO:tasks.workunit.client.0.smithi157.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T17:56:02.344 INFO:tasks.workunit.client.0.smithi157.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T17:56:08.557 INFO:tasks.workunit.client.0.smithi157.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T17:56:48.301 INFO:tasks.workunit.client.0.smithi157.stdout:arg: file-0b 2024-09-12T17:56:48.302 INFO:tasks.workunit.client.0.smithi157.stdout:arg: file-8b 2024-09-12T17:56:48.303 INFO:tasks.workunit.client.0.smithi157.stdout:arg: file-200b 2024-09-12T17:56:48.305 INFO:tasks.workunit.client.0.smithi157.stdout:arg: file-21983b 2024-09-12T17:56:48.306 INFO:tasks.workunit.client.0.smithi157.stdout:arg: file-5519b 2024-09-12T17:56:48.307 INFO:tasks.workunit.client.0.smithi157.stdout:arg: file-204329b 2024-09-12T17:56:48.308 INFO:tasks.workunit.client.0.smithi157.stdout:arg: file-256k 2024-09-12T17:56:48.310 INFO:tasks.workunit.client.0.smithi157.stdout:arg: file-1m 2024-09-12T17:56:48.310 INFO:tasks.workunit.client.0.smithi157.stdout:arg: file-1038757b 2024-09-12T17:56:48.323 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T17:56:48.524 INFO:tasks.workunit.client.0.smithi157.stdout:PutObjectResponse 2024-09-12T17:56:48.624 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T17:56:48.724 INFO:tasks.workunit.client.0.smithi157.stdout:PutObjectResponse 2024-09-12T17:56:48.924 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T17:56:49.024 INFO:tasks.workunit.client.0.smithi157.stdout:PutObjectResponse 2024-09-12T17:56:49.125 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T17:56:49.325 INFO:tasks.workunit.client.0.smithi157.stdout:PutObjectResponse 2024-09-12T17:56:49.425 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T17:56:49.625 INFO:tasks.workunit.client.0.smithi157.stdout:PutObjectResponse 2024-09-12T17:56:49.726 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T17:56:49.929 INFO:tasks.workunit.client.0.smithi157.stdout:PutObjectResponse 2024-09-12T17:56:50.026 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T17:56:50.326 INFO:tasks.workunit.client.0.smithi157.stdout:PutObjectResponse 2024-09-12T17:56:50.427 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T17:56:50.927 INFO:tasks.workunit.client.0.smithi157.stdout:PutObjectResponse 2024-09-12T17:56:51.128 INFO:tasks.workunit.client.0.smithi157.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T17:56:51.628 INFO:tasks.workunit.client.0.smithi157.stdout:PutObjectResponse 2024-09-12T17:56:51.829 INFO:tasks.workunit.client.0.smithi157.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T17:56:55.334 INFO:tasks.workunit.client.0.smithi157.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T17:57:02.043 INFO:tasks.workunit.client.0.smithi157.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T17:57:43.768 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 111.3 s -- in io.ceph.jcksum.PutObjects 2024-09-12T17:57:43.796 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:57:43.796 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Results: 2024-09-12T17:57:43.797 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:57:43.797 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T17:57:43.797 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] 2024-09-12T17:57:43.799 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:57:43.799 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:57:43.799 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:57:43.799 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Total time: 01:53 min 2024-09-12T17:57:43.800 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] Finished at: 2024-09-12T17:57:43Z 2024-09-12T17:57:43.800 INFO:tasks.workunit.client.0.smithi157.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:57:43.819 INFO:tasks.workunit.client.0.smithi157.stderr:+ exit 2024-09-12T17:57:43.820 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:57:43.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:57:43.873 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T17:57:43.873 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:57:44.245 DEBUG:teuthology.parallel:result is None 2024-09-12T17:57:44.246 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:57:44.258 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:57:44.258 DEBUG:teuthology.orchestra.run.smithi157:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:57:44.307 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:57:44.307 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:57:44.319 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:57:44.319 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:57:44.319 DEBUG:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:57:44.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:57:44.355 INFO:teuthology.orchestra.run.smithi157.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:57:44.356 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:57:44.403 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:57:44.403 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:57:44.452 INFO:tasks.workunit:timeout=3h 2024-09-12T17:57:44.452 INFO:tasks.workunit:cleanup=True 2024-09-12T17:57:44.453 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:57:44.501 INFO:tasks.workunit.client.0.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:58:40.915 INFO:tasks.workunit.client.0.smithi157.stderr:Updating files: 97% (12332/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:58:41.795 INFO:tasks.workunit.client.0.smithi157.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:58:41.796 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:58:41.796 INFO:tasks.workunit.client.0.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:58:41.796 INFO:tasks.workunit.client.0.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:58:41.796 INFO:tasks.workunit.client.0.smithi157.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:58:41.796 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:58:41.796 INFO:tasks.workunit.client.0.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:58:41.796 INFO:tasks.workunit.client.0.smithi157.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:58:41.796 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:58:41.796 INFO:tasks.workunit.client.0.smithi157.stderr: git switch -c 2024-09-12T17:58:41.797 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:58:41.797 INFO:tasks.workunit.client.0.smithi157.stderr:Or undo this operation with: 2024-09-12T17:58:41.797 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:58:41.797 INFO:tasks.workunit.client.0.smithi157.stderr: git switch - 2024-09-12T17:58:41.797 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:58:41.797 INFO:tasks.workunit.client.0.smithi157.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:58:41.797 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T17:58:41.797 INFO:tasks.workunit.client.0.smithi157.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:58:41.806 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:58:41.853 INFO:tasks.workunit.client.0.smithi157.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:58:41.855 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:58:41.855 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:58:41.913 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:58:41.976 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:58:42.021 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:58:42.023 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:58:42.023 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:58:42.068 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:58:42.072 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:58:42.072 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:58:42.119 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T17:58:42.121 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T17:58:42.121 DEBUG:teuthology.orchestra.run.smithi157:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T17:58:42.175 INFO:tasks.workunit.client.0.smithi157.stdout:INFO: fully qualified domain name: smithi157.front.sepia.ceph.com 2024-09-12T17:58:42.175 INFO:tasks.workunit.client.0.smithi157.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T17:58:42.175 INFO:tasks.workunit.client.0.smithi157.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T17:58:45.519 INFO:tasks.workunit.client.0.smithi157.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:58:45.724 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting pip 2024-09-12T17:58:45.730 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:58:45.764 INFO:tasks.workunit.client.0.smithi157.stdout:Installing collected packages: pip 2024-09-12T17:58:45.764 INFO:tasks.workunit.client.0.smithi157.stdout: Attempting uninstall: pip 2024-09-12T17:58:45.765 INFO:tasks.workunit.client.0.smithi157.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:58:46.023 INFO:tasks.workunit.client.0.smithi157.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:58:46.029 INFO:tasks.workunit.client.0.smithi157.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:58:47.048 INFO:tasks.workunit.client.0.smithi157.stdout:Successfully installed pip-24.2 2024-09-12T17:58:48.124 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting boto3 2024-09-12T17:58:48.125 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:58:48.694 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:58:48.695 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:58:48.750 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:58:48.751 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:58:48.804 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:58:48.805 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:58:48.856 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:58:48.857 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:58:48.938 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:58:48.939 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:58:49.205 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:58:49.206 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:58:49.210 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:58:49.211 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:58:49.221 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:58:49.222 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:58:49.223 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:58:49.225 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:58:49.226 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:58:49.295 INFO:tasks.workunit.client.0.smithi157.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:58:50.557 INFO:tasks.workunit.client.0.smithi157.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:58:51.371 INFO:tasks.workunit.client.0.smithi157.stdout:INFO: creating user 2024-09-12T17:58:51.515 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2024-09-12T17:58:51.516 INFO:tasks.workunit.client.0.smithi157.stdout: "user_id": "testid", 2024-09-12T17:58:51.516 INFO:tasks.workunit.client.0.smithi157.stdout: "display_name": "M. Tester", 2024-09-12T17:58:51.516 INFO:tasks.workunit.client.0.smithi157.stdout: "email": "tester@ceph.com", 2024-09-12T17:58:51.516 INFO:tasks.workunit.client.0.smithi157.stdout: "suspended": 0, 2024-09-12T17:58:51.516 INFO:tasks.workunit.client.0.smithi157.stdout: "max_buckets": 1000, 2024-09-12T17:58:51.516 INFO:tasks.workunit.client.0.smithi157.stdout: "subusers": [], 2024-09-12T17:58:51.516 INFO:tasks.workunit.client.0.smithi157.stdout: "keys": [ 2024-09-12T17:58:51.516 INFO:tasks.workunit.client.0.smithi157.stdout: { 2024-09-12T17:58:51.516 INFO:tasks.workunit.client.0.smithi157.stdout: "user": "testid", 2024-09-12T17:58:51.516 INFO:tasks.workunit.client.0.smithi157.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T17:58:51.516 INFO:tasks.workunit.client.0.smithi157.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: "active": true, 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: "create_date": "2024-09-12T17:58:51.506734Z" 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: } 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: ], 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: "swift_keys": [], 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: "caps": [], 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: "default_placement": "", 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: "default_storage_class": "", 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: "placement_tags": [], 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: "bucket_quota": { 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: "enabled": false, 2024-09-12T17:58:51.517 INFO:tasks.workunit.client.0.smithi157.stdout: "check_on_raw": false, 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size": -1, 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size_kb": 0, 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: "max_objects": -1 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: "user_quota": { 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: "enabled": false, 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: "check_on_raw": false, 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size": -1, 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: "max_size_kb": 0, 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: "max_objects": -1 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: }, 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: "temp_url_keys": [], 2024-09-12T17:58:51.518 INFO:tasks.workunit.client.0.smithi157.stdout: "type": "rgw", 2024-09-12T17:58:51.519 INFO:tasks.workunit.client.0.smithi157.stdout: "mfa_ids": [], 2024-09-12T17:58:51.519 INFO:tasks.workunit.client.0.smithi157.stdout: "account_id": "", 2024-09-12T17:58:51.519 INFO:tasks.workunit.client.0.smithi157.stdout: "path": "/", 2024-09-12T17:58:51.519 INFO:tasks.workunit.client.0.smithi157.stdout: "create_date": "2024-09-12T17:58:51.506716Z", 2024-09-12T17:58:51.519 INFO:tasks.workunit.client.0.smithi157.stdout: "tags": [], 2024-09-12T17:58:51.519 INFO:tasks.workunit.client.0.smithi157.stdout: "group_ids": [] 2024-09-12T17:58:51.519 INFO:tasks.workunit.client.0.smithi157.stdout:} 2024-09-12T17:58:51.519 INFO:tasks.workunit.client.0.smithi157.stdout: 2024-09-12T17:58:51.959 INFO:tasks.workunit.client.0.smithi157.stderr:5+0 records in 2024-09-12T17:58:51.959 INFO:tasks.workunit.client.0.smithi157.stderr:5+0 records out 2024-09-12T17:58:51.959 INFO:tasks.workunit.client.0.smithi157.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0243018 s, 216 MB/s 2024-09-12T17:59:06.190 INFO:tasks.workunit.client.0.smithi157.stdout:bucket nams is reupload-bkt-113849 2024-09-12T17:59:06.190 INFO:tasks.workunit.client.0.smithi157.stdout:endpoint is http://smithi157.front.sepia.ceph.com:80 2024-09-12T17:59:06.190 INFO:tasks.workunit.client.0.smithi157.stdout:start UploadId=2~llAPhm28cKjp5d_AC-8dYoY4j_PmWWQ 2024-09-12T17:59:06.190 INFO:tasks.workunit.client.0.smithi157.stdout:phase 1 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.190 INFO:tasks.workunit.client.0.smithi157.stdout:phase 1 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 2} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:phase 2 uploaded part {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1} 2024-09-12T17:59:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:completing multipart upload, parts=[{'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 1}, {'ETag': '"5b1f1873c9fb821f9c96f4aa47064680"', 'PartNumber': 2}] 2024-09-12T17:59:07.708 INFO:tasks.workunit.client.0.smithi157.stdout:radosgw-admin bucket radoslist: 2024-09-12T17:59:07.708 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3_mpu_test4 2024-09-12T17:59:07.708 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3__multipart_mpu_test4.2~llAPhm28cKjp5d_AC-8dYoY4j_PmWWQ.2 2024-09-12T17:59:07.708 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3__multipart_mpu_test4.r6flfgm9q-tgovFXQb3LKgB0_3QYd3Yn.1 2024-09-12T17:59:07.708 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3__:rd-99IsL8U4AaJbf0f7w7HJTiDNjnuk_mpu_test4 2024-09-12T17:59:07.708 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3__shadow_mpu_test4.2~llAPhm28cKjp5d_AC-8dYoY4j_PmWWQ.2_1 2024-09-12T17:59:07.709 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3__shadow_mpu_test4.r6flfgm9q-tgovFXQb3LKgB0_3QYd3Yn.1_1 2024-09-12T17:59:07.796 INFO:tasks.workunit.client.0.smithi157.stdout:rados ls: 2024-09-12T17:59:07.796 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3_mpu_test4 2024-09-12T17:59:07.796 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3__multipart_mpu_test4.2~llAPhm28cKjp5d_AC-8dYoY4j_PmWWQ.2 2024-09-12T17:59:07.796 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3__multipart_mpu_test4.r6flfgm9q-tgovFXQb3LKgB0_3QYd3Yn.1 2024-09-12T17:59:07.796 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3__:rd-99IsL8U4AaJbf0f7w7HJTiDNjnuk_mpu_test4 2024-09-12T17:59:07.797 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3__shadow_mpu_test4.2~llAPhm28cKjp5d_AC-8dYoY4j_PmWWQ.2_1 2024-09-12T17:59:07.797 INFO:tasks.workunit.client.0.smithi157.stdout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3__shadow_mpu_test4.r6flfgm9q-tgovFXQb3LKgB0_3QYd3Yn.1_1 2024-09-12T17:59:07.893 INFO:tasks.workunit.client.0.smithi157.stdout:== PASSED == 2024-09-12T17:59:07.894 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:59:07.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:59:07.947 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T17:59:07.948 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:59:08.340 DEBUG:teuthology.parallel:result is None 2024-09-12T17:59:08.341 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:59:08.353 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:59:08.353 DEBUG:teuthology.orchestra.run.smithi157:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:59:08.399 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:59:08.399 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T17:59:08.413 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T17:59:08.413 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T17:59:08.413 INFO:tasks.ragweed:Using branch 'wip-rgw-meta-handlers' for ragweed 2024-09-12T17:59:08.413 DEBUG:teuthology.orchestra.run.smithi157:> git clone -b wip-rgw-meta-handlers https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:59:08.447 INFO:teuthology.orchestra.run.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:59:08.503 INFO:teuthology.orchestra.run.smithi157.stderr:fatal: Remote branch wip-rgw-meta-handlers not found in upstream origin 2024-09-12T17:59:08.504 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T17:59:08.505 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T17:59:08.506 DEBUG:teuthology.orchestra.run.smithi157:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:59:08.552 INFO:teuthology.orchestra.run.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:59:08.723 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T17:59:08.724 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T17:59:08.724 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key XFCGTILXZYNPHMESPSNN --secret BHKn5V8IXMwTNkfrWoLcKI3+mfqUAhuPUbSQQa/++gTTK5s/Zvuavw== --email ragweed.client.0+test@test.test --system false 2024-09-12T17:59:08.818 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:08.818 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:08.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.860+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:08.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 20 realm 2024-09-12T17:59:08.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:08.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:08.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:08.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:08.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:08.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.864+0000 7f44bca629c0 20 searching for the correct realm 2024-09-12T17:59:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.872+0000 7f44bad69640 0 -- 172.21.15.157:0/2829346456 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x5571203ba130 msgr2=0x5571203bc5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:08.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.876+0000 7f44ba568640 0 -- 172.21.15.157:0/2829346456 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f44a40fc630 msgr2=0x7f44a40a4a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.884+0000 7f44bca629c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:59:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.884+0000 7f44bca629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.884+0000 7f44bca629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.884+0000 7f44bca629c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:59:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.884+0000 7f44bca629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.884+0000 7f44bca629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.884+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.884+0000 7f44bca629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.884+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 zone default found 2024-09-12T17:59:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 4 Realm: () 2024-09-12T17:59:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:59:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:59:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 zonegroup default 2024-09-12T17:59:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:08.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:08.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:08.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 started sync module instance, tier type = 2024-09-12T17:59:08.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.888+0000 7f44bca629c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:59:08.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.904+0000 7f44bca629c0 20 add_watcher() i=0 2024-09-12T17:59:08.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.904+0000 7f44bca629c0 20 add_watcher() i=1 2024-09-12T17:59:08.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.904+0000 7f44bca629c0 20 add_watcher() i=2 2024-09-12T17:59:08.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.904+0000 7f44bca629c0 20 add_watcher() i=3 2024-09-12T17:59:08.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.904+0000 7f44bca629c0 20 add_watcher() i=4 2024-09-12T17:59:08.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.904+0000 7f44bca629c0 20 add_watcher() i=5 2024-09-12T17:59:08.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.904+0000 7f44bca629c0 20 add_watcher() i=6 2024-09-12T17:59:08.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.904+0000 7f44bca629c0 20 add_watcher() i=7 2024-09-12T17:59:08.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.904+0000 7f44bca629c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:08.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f4370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:08.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:08.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:08.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 5 note: GC not initialized 2024-09-12T17:59:08.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f42eb7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:08.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 20 init_complete bucket index max shards: 1 2024-09-12T17:59:08.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 20 Filter name: none 2024-09-12T17:59:08.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f42e97fa640 20 reqs_thread_entry: start 2024-09-12T17:59:08.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:59:08.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:08.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T17:59:08.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:59:08.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T17:59:08.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:08.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T17:59:08.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:59:08.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 10 cache get: name=default.rgw.meta+users.keys+XFCGTILXZYNPHMESPSNN : miss 2024-09-12T17:59:08.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:08.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:08.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 10 cache put: name=default.rgw.meta+users.keys+XFCGTILXZYNPHMESPSNN info.flags=0x0 2024-09-12T17:59:08.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 10 adding default.rgw.meta+users.keys+XFCGTILXZYNPHMESPSNN to cache LRU end 2024-09-12T17:59:08.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 10 cache get: name=default.rgw.meta+users.keys+XFCGTILXZYNPHMESPSNN : hit (negative entry) 2024-09-12T17:59:08.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.908+0000 7f44bca629c0 10 cache get: name=default.rgw.meta+users.keys+XFCGTILXZYNPHMESPSNN : hit (negative entry) 2024-09-12T17:59:08.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.912+0000 7f44bca629c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:59:08.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.912+0000 7f44bca629c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:59:08.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.912+0000 7f44bca629c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:59:08.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.912+0000 7f439dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725910 cookie 93944360450048 notifier 5606 bl.length()=675 2024-09-12T17:59:08.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.912+0000 7f439dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:59:08.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.912+0000 7f439dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:59:08.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.920+0000 7f44bca629c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:59:08.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.920+0000 7f44bca629c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:59:08.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.920+0000 7f44bca629c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:59:08.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.920+0000 7f439dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725902 cookie 93944360461216 notifier 5606 bl.length()=202 2024-09-12T17:59:08.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.920+0000 7f439dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:59:08.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.920+0000 7f439dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:59:08.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.924+0000 7f44bca629c0 10 cache put: name=default.rgw.meta+users.keys+XFCGTILXZYNPHMESPSNN info.flags=0x7 2024-09-12T17:59:08.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.924+0000 7f44bca629c0 10 moving default.rgw.meta+users.keys+XFCGTILXZYNPHMESPSNN to cache LRU end 2024-09-12T17:59:08.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.924+0000 7f44bca629c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:XFCGTILXZYNPHMESPSNN, ofs0, ns] 2024-09-12T17:59:08.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.924+0000 7f439dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725911 cookie 93944360452256 notifier 5606 bl.length()=190 2024-09-12T17:59:08.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.924+0000 7f439dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XFCGTILXZYNPHMESPSNN info.flags=0x7 2024-09-12T17:59:08.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.924+0000 7f439dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XFCGTILXZYNPHMESPSNN to cache LRU end 2024-09-12T17:59:08.929 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T17:59:08.929 INFO:teuthology.orchestra.run.smithi157.stdout: "user_id": "ragweed.client.0", 2024-09-12T17:59:08.929 INFO:teuthology.orchestra.run.smithi157.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T17:59:08.930 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T17:59:08.930 INFO:teuthology.orchestra.run.smithi157.stdout: "suspended": 0, 2024-09-12T17:59:08.930 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T17:59:08.930 INFO:teuthology.orchestra.run.smithi157.stdout: "subusers": [], 2024-09-12T17:59:08.930 INFO:teuthology.orchestra.run.smithi157.stdout: "keys": [ 2024-09-12T17:59:08.931 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T17:59:08.931 INFO:teuthology.orchestra.run.smithi157.stdout: "user": "ragweed.client.0", 2024-09-12T17:59:08.931 INFO:teuthology.orchestra.run.smithi157.stdout: "access_key": "XFCGTILXZYNPHMESPSNN", 2024-09-12T17:59:08.931 INFO:teuthology.orchestra.run.smithi157.stdout: "secret_key": "BHKn5V8IXMwTNkfrWoLcKI3+mfqUAhuPUbSQQa/++gTTK5s/Zvuavw==", 2024-09-12T17:59:08.931 INFO:teuthology.orchestra.run.smithi157.stdout: "active": true, 2024-09-12T17:59:08.931 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T17:59:08.914961Z" 2024-09-12T17:59:08.932 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-12T17:59:08.932 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T17:59:08.932 INFO:teuthology.orchestra.run.smithi157.stdout: "swift_keys": [], 2024-09-12T17:59:08.932 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": [], 2024-09-12T17:59:08.932 INFO:teuthology.orchestra.run.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T17:59:08.933 INFO:teuthology.orchestra.run.smithi157.stdout: "default_placement": "", 2024-09-12T17:59:08.933 INFO:teuthology.orchestra.run.smithi157.stdout: "default_storage_class": "", 2024-09-12T17:59:08.933 INFO:teuthology.orchestra.run.smithi157.stdout: "placement_tags": [], 2024-09-12T17:59:08.933 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T17:59:08.933 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T17:59:08.934 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T17:59:08.934 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T17:59:08.934 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T17:59:08.934 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T17:59:08.934 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T17:59:08.935 INFO:teuthology.orchestra.run.smithi157.stdout: "user_quota": { 2024-09-12T17:59:08.935 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T17:59:08.935 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T17:59:08.935 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T17:59:08.935 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T17:59:08.936 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T17:59:08.936 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T17:59:08.936 INFO:teuthology.orchestra.run.smithi157.stdout: "temp_url_keys": [], 2024-09-12T17:59:08.936 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "rgw", 2024-09-12T17:59:08.937 INFO:teuthology.orchestra.run.smithi157.stdout: "mfa_ids": [], 2024-09-12T17:59:08.937 INFO:teuthology.orchestra.run.smithi157.stdout: "account_id": "", 2024-09-12T17:59:08.937 INFO:teuthology.orchestra.run.smithi157.stdout: "path": "/", 2024-09-12T17:59:08.937 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T17:59:08.914930Z", 2024-09-12T17:59:08.937 INFO:teuthology.orchestra.run.smithi157.stdout: "tags": [], 2024-09-12T17:59:08.937 INFO:teuthology.orchestra.run.smithi157.stdout: "group_ids": [] 2024-09-12T17:59:08.938 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T17:59:08.938 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:59:08.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.928+0000 7f4370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:08.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.932+0000 7f44bca629c0 20 remove_watcher() i=0 2024-09-12T17:59:08.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.932+0000 7f44bca629c0 2 removed watcher, disabling cache 2024-09-12T17:59:08.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.936+0000 7f44bca629c0 20 remove_watcher() i=1 2024-09-12T17:59:08.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.940+0000 7f44bca629c0 20 remove_watcher() i=2 2024-09-12T17:59:08.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.940+0000 7f44bca629c0 20 remove_watcher() i=3 2024-09-12T17:59:08.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.944+0000 7f44bca629c0 20 remove_watcher() i=4 2024-09-12T17:59:08.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.944+0000 7f44bca629c0 20 remove_watcher() i=5 2024-09-12T17:59:08.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.944+0000 7f44bca629c0 20 remove_watcher() i=6 2024-09-12T17:59:08.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:08.948+0000 7f44bca629c0 20 remove_watcher() i=7 2024-09-12T17:59:08.964 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T17:59:08.965 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key EDWCPDWYGCAOBJDLBLQS --secret a7qOdYFYq51vOI3lfyWA93J9TX3wEk5wZFhznVrGW/YJsmTe1EzT4Q== --email sysuser.client.0+test@test.test --system true 2024-09-12T17:59:09.011 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:09.012 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:09.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.048+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.052+0000 7fd7067399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:09.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.052+0000 7fd7067399c0 20 realm 2024-09-12T17:59:09.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.052+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.052+0000 7fd7067399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:09.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.052+0000 7fd7067399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:09.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.052+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.052+0000 7fd7067399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:09.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.052+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.052+0000 7fd7067399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:09.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.052+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.056+0000 7fd7067399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:09.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.056+0000 7fd7067399c0 20 searching for the correct realm 2024-09-12T17:59:09.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.060+0000 7fd704a40640 0 -- 172.21.15.157:0/2005252049 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x55d605a28cf0 msgr2=0x55d605a2b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:09.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.064+0000 7fd70423f640 0 -- 172.21.15.157:0/2005252049 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fd6ec11f0c0 msgr2=0x7fd6ec007cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:09.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.072+0000 7fd7067399c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T17:59:09.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.072+0000 7fd7067399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:09.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.072+0000 7fd7067399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:09.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.072+0000 7fd7067399c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T17:59:09.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.072+0000 7fd7067399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:09.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.072+0000 7fd7067399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:09.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.072+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.072+0000 7fd7067399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:09.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.072+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:09.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:09.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 zone default found 2024-09-12T17:59:09.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 4 Realm: () 2024-09-12T17:59:09.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T17:59:09.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T17:59:09.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:09.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 zonegroup default 2024-09-12T17:59:09.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:09.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:09.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:09.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 started sync module instance, tier type = 2024-09-12T17:59:09.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.076+0000 7fd7067399c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T17:59:09.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.092+0000 7fd7067399c0 20 add_watcher() i=0 2024-09-12T17:59:09.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.092+0000 7fd7067399c0 20 add_watcher() i=1 2024-09-12T17:59:09.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.092+0000 7fd7067399c0 20 add_watcher() i=2 2024-09-12T17:59:09.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.092+0000 7fd7067399c0 20 add_watcher() i=3 2024-09-12T17:59:09.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.092+0000 7fd7067399c0 20 add_watcher() i=4 2024-09-12T17:59:09.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.092+0000 7fd7067399c0 20 add_watcher() i=5 2024-09-12T17:59:09.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.092+0000 7fd7067399c0 20 add_watcher() i=6 2024-09-12T17:59:09.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.092+0000 7fd7067399c0 20 add_watcher() i=7 2024-09-12T17:59:09.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.092+0000 7fd7067399c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:09.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd5bb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:09.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:09.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:09.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 5 note: GC not initialized 2024-09-12T17:59:09.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd5ba7dc640 20 reqs_thread_entry: start 2024-09-12T17:59:09.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 20 init_complete bucket index max shards: 1 2024-09-12T17:59:09.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 20 Filter name: none 2024-09-12T17:59:09.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd5b37fe640 20 reqs_thread_entry: start 2024-09-12T17:59:09.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:59:09.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:09.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T17:59:09.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:59:09.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T17:59:09.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.096+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:09.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T17:59:09.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:59:09.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 10 cache get: name=default.rgw.meta+users.keys+EDWCPDWYGCAOBJDLBLQS : miss 2024-09-12T17:59:09.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:09.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:09.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 10 cache put: name=default.rgw.meta+users.keys+EDWCPDWYGCAOBJDLBLQS info.flags=0x0 2024-09-12T17:59:09.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 10 adding default.rgw.meta+users.keys+EDWCPDWYGCAOBJDLBLQS to cache LRU end 2024-09-12T17:59:09.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 10 cache get: name=default.rgw.meta+users.keys+EDWCPDWYGCAOBJDLBLQS : hit (negative entry) 2024-09-12T17:59:09.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 10 cache get: name=default.rgw.meta+users.keys+EDWCPDWYGCAOBJDLBLQS : hit (negative entry) 2024-09-12T17:59:09.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:59:09.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:59:09.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.100+0000 7fd7067399c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:59:09.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.104+0000 7fd5db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725903 cookie 94377705907408 notifier 5967 bl.length()=675 2024-09-12T17:59:09.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.104+0000 7fd5db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:59:09.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.104+0000 7fd5db7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:59:09.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.108+0000 7fd7067399c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:59:09.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.108+0000 7fd7067399c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:59:09.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.108+0000 7fd7067399c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:59:09.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.108+0000 7fd5daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725912 cookie 94377705871568 notifier 5967 bl.length()=202 2024-09-12T17:59:09.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.108+0000 7fd5daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:59:09.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.108+0000 7fd5daffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:59:09.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.112+0000 7fd7067399c0 10 cache put: name=default.rgw.meta+users.keys+EDWCPDWYGCAOBJDLBLQS info.flags=0x7 2024-09-12T17:59:09.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.112+0000 7fd7067399c0 10 moving default.rgw.meta+users.keys+EDWCPDWYGCAOBJDLBLQS to cache LRU end 2024-09-12T17:59:09.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.112+0000 7fd7067399c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:EDWCPDWYGCAOBJDLBLQS, ofs0, ns] 2024-09-12T17:59:09.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.112+0000 7fd5db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725893 cookie 94377705922016 notifier 5967 bl.length()=190 2024-09-12T17:59:09.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.112+0000 7fd5db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EDWCPDWYGCAOBJDLBLQS info.flags=0x7 2024-09-12T17:59:09.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.112+0000 7fd5db7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EDWCPDWYGCAOBJDLBLQS to cache LRU end 2024-09-12T17:59:09.115 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T17:59:09.115 INFO:teuthology.orchestra.run.smithi157.stdout: "user_id": "sysuser.client.0", 2024-09-12T17:59:09.115 INFO:teuthology.orchestra.run.smithi157.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T17:59:09.115 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: "suspended": 0, 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: "subusers": [], 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: "keys": [ 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: "user": "sysuser.client.0", 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: "access_key": "EDWCPDWYGCAOBJDLBLQS", 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: "secret_key": "a7qOdYFYq51vOI3lfyWA93J9TX3wEk5wZFhznVrGW/YJsmTe1EzT4Q==", 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: "active": true, 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T17:59:09.104260Z" 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi157.stdout: "swift_keys": [], 2024-09-12T17:59:09.117 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": [], 2024-09-12T17:59:09.117 INFO:teuthology.orchestra.run.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T17:59:09.117 INFO:teuthology.orchestra.run.smithi157.stdout: "system": true, 2024-09-12T17:59:09.117 INFO:teuthology.orchestra.run.smithi157.stdout: "default_placement": "", 2024-09-12T17:59:09.117 INFO:teuthology.orchestra.run.smithi157.stdout: "default_storage_class": "", 2024-09-12T17:59:09.117 INFO:teuthology.orchestra.run.smithi157.stdout: "placement_tags": [], 2024-09-12T17:59:09.117 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T17:59:09.117 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T17:59:09.117 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T17:59:09.117 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T17:59:09.117 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "user_quota": { 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "temp_url_keys": [], 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "rgw", 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "mfa_ids": [], 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "account_id": "", 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi157.stdout: "path": "/", 2024-09-12T17:59:09.119 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T17:59:09.104241Z", 2024-09-12T17:59:09.119 INFO:teuthology.orchestra.run.smithi157.stdout: "tags": [], 2024-09-12T17:59:09.119 INFO:teuthology.orchestra.run.smithi157.stdout: "group_ids": [] 2024-09-12T17:59:09.119 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T17:59:09.119 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:59:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.116+0000 7fd5bb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:09.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.120+0000 7fd7067399c0 20 remove_watcher() i=0 2024-09-12T17:59:09.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.120+0000 7fd7067399c0 2 removed watcher, disabling cache 2024-09-12T17:59:09.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.124+0000 7fd7067399c0 20 remove_watcher() i=1 2024-09-12T17:59:09.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.124+0000 7fd7067399c0 20 remove_watcher() i=2 2024-09-12T17:59:09.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.128+0000 7fd7067399c0 20 remove_watcher() i=3 2024-09-12T17:59:09.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.128+0000 7fd7067399c0 20 remove_watcher() i=4 2024-09-12T17:59:09.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.132+0000 7fd7067399c0 20 remove_watcher() i=5 2024-09-12T17:59:09.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.132+0000 7fd7067399c0 20 remove_watcher() i=6 2024-09-12T17:59:09.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T17:59:09.132+0000 7fd7067399c0 20 remove_watcher() i=7 2024-09-12T17:59:09.149 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T17:59:09.150 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:59:09.150 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T17:59:09.250 INFO:tasks.ragweed:Configuring boto... 2024-09-12T17:59:09.250 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T17:59:09.250 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T17:59:09.352 DEBUG:teuthology.orchestra.run.smithi157:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T17:59:09.550 INFO:teuthology.orchestra.run.smithi157.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T17:59:09.737 INFO:teuthology.orchestra.run.smithi157.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T17:59:10.326 INFO:teuthology.orchestra.run.smithi157.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:59:12.987 INFO:teuthology.orchestra.run.smithi157.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T17:59:17.623 INFO:teuthology.orchestra.run.smithi157.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=6bc6851952b50ccbab9ff5212be676d47d18d84c76d140bc18dd505212294972,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T17:59:17.624 INFO:teuthology.orchestra.run.smithi157.stdout:py run-test-pre: PYTHONHASHSEED='609369680' 2024-09-12T17:59:17.624 INFO:teuthology.orchestra.run.smithi157.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T17:59:17.784 INFO:teuthology.orchestra.run.smithi157.stdout:============================= test session starts ============================== 2024-09-12T17:59:17.784 INFO:teuthology.orchestra.run.smithi157.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T17:59:17.785 INFO:teuthology.orchestra.run.smithi157.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:59:17.785 INFO:teuthology.orchestra.run.smithi157.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T17:59:17.946 INFO:teuthology.orchestra.run.smithi157.stdout:collecting ... collected 9 items 2024-09-12T17:59:17.946 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T17:59:22.454 INFO:teuthology.orchestra.run.smithi157.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T17:59:26.255 INFO:teuthology.orchestra.run.smithi157.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T17:59:29.707 INFO:teuthology.orchestra.run.smithi157.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T17:59:33.423 INFO:teuthology.orchestra.run.smithi157.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T17:59:37.150 INFO:teuthology.orchestra.run.smithi157.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T17:59:48.631 INFO:teuthology.orchestra.run.smithi157.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T17:59:57.592 INFO:teuthology.orchestra.run.smithi157.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T18:00:06.811 INFO:teuthology.orchestra.run.smithi157.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T18:00:23.127 INFO:teuthology.orchestra.run.smithi157.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T18:00:23.127 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:00:23.127 INFO:teuthology.orchestra.run.smithi157.stdout:=============================== warnings summary =============================== 2024-09-12T18:00:23.127 INFO:teuthology.orchestra.run.smithi157.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T18:00:23.127 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T18:00:23.127 INFO:teuthology.orchestra.run.smithi157.stdout: import imp 2024-09-12T18:00:23.128 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:00:23.128 INFO:teuthology.orchestra.run.smithi157.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T18:00:23.128 INFO:teuthology.orchestra.run.smithi157.stdout:=================== 9 passed, 1 warning in 65.34s (0:01:05) ==================== 2024-09-12T18:00:23.181 INFO:teuthology.orchestra.run.smithi157.stdout:___________________________________ summary ____________________________________ 2024-09-12T18:00:23.181 INFO:teuthology.orchestra.run.smithi157.stdout: py: commands succeeded 2024-09-12T18:00:23.181 INFO:teuthology.orchestra.run.smithi157.stdout: congratulations :) 2024-09-12T18:00:23.202 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T18:00:23.202 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T18:00:23.208 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T18:00:23.287 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:23.287 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:23.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.327+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 20 realm 2024-09-12T18:00:23.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:23.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:23.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:23.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.331+0000 7fe089d0d9c0 20 searching for the correct realm 2024-09-12T18:00:23.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.339+0000 7fe088014640 0 -- 172.21.15.157:0/3547285825 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fe07c0b63f0 msgr2=0x7fe07c0b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:00:23.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.555+0000 7fe087813640 0 -- 172.21.15.157:0/3547285825 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55770d7fff80 msgr2=0x55770d802370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:23.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.563+0000 7fe089d0d9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:00:23.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.563+0000 7fe089d0d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:23.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.563+0000 7fe089d0d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:23.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.563+0000 7fe089d0d9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:00:23.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.563+0000 7fe089d0d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:23.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.563+0000 7fe089d0d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:23.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.563+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.563+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.563+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:23.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:23.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 zone default found 2024-09-12T18:00:23.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 4 Realm: () 2024-09-12T18:00:23.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:00:23.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:00:23.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:23.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 zonegroup default 2024-09-12T18:00:23.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 started sync module instance, tier type = 2024-09-12T18:00:23.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.567+0000 7fe089d0d9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:00:23.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.591+0000 7fe089d0d9c0 20 add_watcher() i=0 2024-09-12T18:00:23.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.591+0000 7fe089d0d9c0 20 add_watcher() i=1 2024-09-12T18:00:23.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.591+0000 7fe089d0d9c0 20 add_watcher() i=2 2024-09-12T18:00:23.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.591+0000 7fe089d0d9c0 20 add_watcher() i=3 2024-09-12T18:00:23.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.591+0000 7fe089d0d9c0 20 add_watcher() i=4 2024-09-12T18:00:23.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.591+0000 7fe089d0d9c0 20 add_watcher() i=5 2024-09-12T18:00:23.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.591+0000 7fe089d0d9c0 20 add_watcher() i=6 2024-09-12T18:00:23.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.595+0000 7fe089d0d9c0 20 add_watcher() i=7 2024-09-12T18:00:23.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.595+0000 7fe089d0d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:23.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.599+0000 7fdf3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:23.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.599+0000 7fe089d0d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:23.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.599+0000 7fe089d0d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:23.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fdf3d7e2640 20 reqs_thread_entry: start 2024-09-12T18:00:23.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fe089d0d9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:00:23.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fe089d0d9c0 20 Filter name: none 2024-09-12T18:00:23.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fdf367fc640 20 reqs_thread_entry: start 2024-09-12T18:00:23.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T18:00:23.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T18:00:23.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T18:00:23.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fe089d0d9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T18:00:23.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:23.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4 : miss 2024-09-12T18:00:23.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.691+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T18:00:23.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4 info.flags=0x17 2024-09-12T18:00:23.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4 to cache LRU end 2024-09-12T18:00:23.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:23.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:23.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4 2024-09-12T18:00:23.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T18:00:23.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T18:00:23.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T18:00:23.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T18:00:23.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T18:00:23.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T18:00:23.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T18:00:23.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T18:00:23.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T18:00:23.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d62d190 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55770d8b8798 s->prefetch_data=0 2024-09-12T18:00:23.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 10 manifest: total_size = 7549 2024-09-12T18:00:23.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14015376779150380508 2024-09-12T18:00:23.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d62d190 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55770d8b8798 s->prefetch_data=0 2024-09-12T18:00:23.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d8b8798 2024-09-12T18:00:23.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.695+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4.0 2024-09-12T18:00:23.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.703+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:23.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.703+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=7549 stripe_ofs=7549 part_ofs=0 rule->part_size=0 2024-09-12T18:00:23.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.703+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14015376779150380508 2024-09-12T18:00:23.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.703+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.703+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.7P-ktxhtvwzGVB-O2W149Mlr2DfWwRn_0 2024-09-12T18:00:23.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.703+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:23.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.703+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.703+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14015376779150380508 2024-09-12T18:00:23.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.703+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T18:00:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.707+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d62d190 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55770d83dc18 s->prefetch_data=0 2024-09-12T18:00:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.707+0000 7fe089d0d9c0 10 manifest: total_size = 7553 2024-09-12T18:00:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.707+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4105333526654961927 2024-09-12T18:00:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.707+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d62d190 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55770d83dc18 s->prefetch_data=0 2024-09-12T18:00:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.707+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83dc18 2024-09-12T18:00:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.707+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4.0 2024-09-12T18:00:23.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.711+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:23.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.711+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=7553 stripe_ofs=7553 part_ofs=0 rule->part_size=0 2024-09-12T18:00:23.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.711+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4105333526654961927 2024-09-12T18:00:23.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.711+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.711+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.WB-EkMa4hIFJtW13IQzqY4SzciEM0h5_0 2024-09-12T18:00:23.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.711+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:23.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.711+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.711+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4105333526654961927 2024-09-12T18:00:23.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.715+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T18:00:23.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.715+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b98a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55770d83dc18 s->prefetch_data=0 2024-09-12T18:00:23.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.715+0000 7fe089d0d9c0 10 manifest: total_size = 7500 2024-09-12T18:00:23.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.715+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3423026360502821420 2024-09-12T18:00:23.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.715+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b98a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55770d83dc18 s->prefetch_data=0 2024-09-12T18:00:23.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.715+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83dc18 2024-09-12T18:00:23.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.715+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4.0 2024-09-12T18:00:23.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.719+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:23.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.719+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=7500 stripe_ofs=7500 part_ofs=0 rule->part_size=0 2024-09-12T18:00:23.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.719+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3423026360502821420 2024-09-12T18:00:23.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.719+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.719+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.BcW82FKeZryhoV2Avy6LMVHHW42arHF_0 2024-09-12T18:00:23.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.719+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:23.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.719+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.719+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3423026360502821420 2024-09-12T18:00:23.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.723+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T18:00:23.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.723+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8419d0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55770d843598 s->prefetch_data=0 2024-09-12T18:00:23.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.723+0000 7fe089d0d9c0 10 manifest: total_size = 7421 2024-09-12T18:00:23.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.723+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4391775437182898236 2024-09-12T18:00:23.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.723+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8419d0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55770d843598 s->prefetch_data=0 2024-09-12T18:00:23.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.723+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d843598 2024-09-12T18:00:23.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.723+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4.0 2024-09-12T18:00:23.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.731+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:23.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.731+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=7421 stripe_ofs=7421 part_ofs=0 rule->part_size=0 2024-09-12T18:00:23.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.731+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4391775437182898236 2024-09-12T18:00:23.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.731+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.731+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.1d1CbVJe3Nh7TkGnFnupSBLzGPm5vXQ_0 2024-09-12T18:00:23.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.731+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:23.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.731+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.731+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4391775437182898236 2024-09-12T18:00:23.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.735+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T18:00:23.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.735+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b9f60 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55770d843598 s->prefetch_data=0 2024-09-12T18:00:23.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.735+0000 7fe089d0d9c0 10 manifest: total_size = 13548 2024-09-12T18:00:23.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.735+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17136895435401302077 2024-09-12T18:00:23.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.735+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b9f60 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55770d843598 s->prefetch_data=0 2024-09-12T18:00:23.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.735+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d843598 2024-09-12T18:00:23.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.735+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4.0 2024-09-12T18:00:23.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.743+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:23.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.743+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=13548 stripe_ofs=13548 part_ofs=0 rule->part_size=0 2024-09-12T18:00:23.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.743+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17136895435401302077 2024-09-12T18:00:23.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.743+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.743+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.orx4Wn_vQZmPhkju9Y6nTPR0ELABxCL_0 2024-09-12T18:00:23.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.743+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:23.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.743+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.743+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17136895435401302077 2024-09-12T18:00:23.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.743+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T18:00:23.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.743+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d841b40 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55770d843598 s->prefetch_data=0 2024-09-12T18:00:23.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.747+0000 7fe089d0d9c0 10 manifest: total_size = 15906 2024-09-12T18:00:23.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.747+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7895694542691928652 2024-09-12T18:00:23.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.747+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d841b40 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55770d843598 s->prefetch_data=0 2024-09-12T18:00:23.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.747+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d843598 2024-09-12T18:00:23.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.747+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4.0 2024-09-12T18:00:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.751+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.751+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=15906 stripe_ofs=15906 part_ofs=0 rule->part_size=0 2024-09-12T18:00:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.751+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7895694542691928652 2024-09-12T18:00:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.751+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.751+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.B8-nrExFxz3Zxsaxx8cxIGHRngYdDY6_0 2024-09-12T18:00:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.751+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.751+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.751+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7895694542691928652 2024-09-12T18:00:23.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.755+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T18:00:23.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.755+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b9bc0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55770d843598 s->prefetch_data=0 2024-09-12T18:00:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.755+0000 7fe089d0d9c0 10 manifest: total_size = 5424 2024-09-12T18:00:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.755+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8695782655401351633 2024-09-12T18:00:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.755+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b9bc0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55770d843598 s->prefetch_data=0 2024-09-12T18:00:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.755+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d843598 2024-09-12T18:00:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.755+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4.0 2024-09-12T18:00:23.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.763+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:23.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.763+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5424 stripe_ofs=5424 part_ofs=0 rule->part_size=0 2024-09-12T18:00:23.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.763+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8695782655401351633 2024-09-12T18:00:23.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.763+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.763+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.dVs7ncFat1o0LtYBZ894v5YX_ly10W7_0 2024-09-12T18:00:23.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.763+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:23.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.763+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.763+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8695782655401351633 2024-09-12T18:00:23.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.767+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T18:00:23.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.767+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe08000a740 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55770d843088 s->prefetch_data=0 2024-09-12T18:00:23.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.767+0000 7fe089d0d9c0 10 manifest: total_size = 5332 2024-09-12T18:00:23.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.767+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8296622762564448588 2024-09-12T18:00:23.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.767+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe08000a740 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55770d843088 s->prefetch_data=0 2024-09-12T18:00:23.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.767+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d843088 2024-09-12T18:00:23.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.767+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4.0 2024-09-12T18:00:23.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.775+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:23.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.775+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5332 stripe_ofs=5332 part_ofs=0 rule->part_size=0 2024-09-12T18:00:23.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.775+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8296622762564448588 2024-09-12T18:00:23.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.775+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.775+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.hEIyVYIJbrSoKsNHnCQzbUkHVeeksz3_0 2024-09-12T18:00:23.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.775+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:23.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.775+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.775+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8296622762564448588 2024-09-12T18:00:23.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.775+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T18:00:23.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.779+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe08000ccb0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55770d845e18 s->prefetch_data=0 2024-09-12T18:00:23.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.779+0000 7fe089d0d9c0 10 manifest: total_size = 8749 2024-09-12T18:00:23.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.779+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18097607764368096550 2024-09-12T18:00:23.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.779+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe08000ccb0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55770d845e18 s->prefetch_data=0 2024-09-12T18:00:23.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.779+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d845e18 2024-09-12T18:00:23.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.779+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4.0 2024-09-12T18:00:23.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.783+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:23.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.783+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=8749 stripe_ofs=8749 part_ofs=0 rule->part_size=0 2024-09-12T18:00:23.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.783+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18097607764368096550 2024-09-12T18:00:23.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.783+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.783+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.wPhDQZG2ZQUAVszIiFgwP0Rc6cjFS8d_0 2024-09-12T18:00:23.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.783+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:23.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.783+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.783+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18097607764368096550 2024-09-12T18:00:23.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.787+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T18:00:23.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.787+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:23.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.787+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:23.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.787+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:23.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.787+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:23.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.787+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:23.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.787+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:23.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.787+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:23.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.791+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T18:00:23.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.791+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.795+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T18:00:23.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.795+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T18:00:23.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.795+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T18:00:23.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.795+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T18:00:23.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.795+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T18:00:23.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.799+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 93969815969200 notifier 6000 bl.length()=162 2024-09-12T18:00:23.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.803+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4 from cache 2024-09-12T18:00:23.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.803+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4, ofs0, ns] 2024-09-12T18:00:23.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.803+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 93969815969200 notifier 6000 bl.length()=219 2024-09-12T18:00:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.811+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4 : miss 2024-09-12T18:00:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.811+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.811+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.811+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4 info.flags=0x0 2024-09-12T18:00:23.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.811+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4 to cache LRU end 2024-09-12T18:00:23.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.815+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11 : miss 2024-09-12T18:00:23.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.815+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T18:00:23.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11 info.flags=0x17 2024-09-12T18:00:23.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11 to cache LRU end 2024-09-12T18:00:23.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:23.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:23.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11 2024-09-12T18:00:23.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T18:00:23.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b9690 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55770d843858 s->prefetch_data=0 2024-09-12T18:00:23.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 10 manifest: total_size = 1667 2024-09-12T18:00:23.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1708333290430433818 2024-09-12T18:00:23.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b9690 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55770d843858 s->prefetch_data=0 2024-09-12T18:00:23.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d843858 2024-09-12T18:00:23.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.819+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11.0 2024-09-12T18:00:23.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:00:23.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T18:00:23.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T18:00:23.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:00:23.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T18:00:23.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T18:00:23.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:00:23.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-09-12T18:00:23.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T18:00:23.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T18:00:23.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-09-12T18:00:23.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T18:00:23.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1708333290430433818 2024-09-12T18:00:23.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11__multipart_foo.2~Udygbt_thBZJCHxo6-eAQ-nLSXdEptF.1 2024-09-12T18:00:23.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T18:00:23.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11__multipart_foo.2~Udygbt_thBZJCHxo6-eAQ-nLSXdEptF.2 2024-09-12T18:00:23.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T18:00:23.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11__multipart_foo.2~Udygbt_thBZJCHxo6-eAQ-nLSXdEptF.3 2024-09-12T18:00:23.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T18:00:23.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11__multipart_foo.2~Udygbt_thBZJCHxo6-eAQ-nLSXdEptF.4 2024-09-12T18:00:23.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T18:00:23.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1708333290430433818 2024-09-12T18:00:23.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.827+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T18:00:23.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.831+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:23.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.831+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:23.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.831+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:23.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.831+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.831+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.831+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.831+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:23.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.835+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T18:00:23.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.835+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.835+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T18:00:23.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.835+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T18:00:23.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.835+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T18:00:23.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.839+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T18:00:23.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.839+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T18:00:23.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.839+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 93969816008800 notifier 6000 bl.length()=191 2024-09-12T18:00:23.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.843+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11 from cache 2024-09-12T18:00:23.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.843+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11, ofs0, ns] 2024-09-12T18:00:23.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.843+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 93969815967264 notifier 6000 bl.length()=249 2024-09-12T18:00:23.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.851+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11 : miss 2024-09-12T18:00:23.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.851+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.851+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.851+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11 info.flags=0x0 2024-09-12T18:00:23.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.851+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11 to cache LRU end 2024-09-12T18:00:23.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.859+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12 : miss 2024-09-12T18:00:23.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.859+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.859+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T18:00:23.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.859+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12 info.flags=0x17 2024-09-12T18:00:23.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.859+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12 to cache LRU end 2024-09-12T18:00:23.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.859+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:23.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.859+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:23.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.859+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12 2024-09-12T18:00:23.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.859+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T18:00:23.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.859+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83d1c0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55770d843758 s->prefetch_data=0 2024-09-12T18:00:23.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.863+0000 7fe089d0d9c0 10 manifest: total_size = 886297 2024-09-12T18:00:23.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.863+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5309216173189235130 2024-09-12T18:00:23.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.863+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83d1c0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55770d843758 s->prefetch_data=0 2024-09-12T18:00:23.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.863+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d843758 2024-09-12T18:00:23.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.863+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12.0 2024-09-12T18:00:23.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:23.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T18:00:23.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:23.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:23.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:23.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T18:00:23.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:23.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5309216173189235130 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12__multipart_foo.2~FmaJUOp2hb_J1QZChZffwszqPw4EG7q.1 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12__multipart_foo.2~FmaJUOp2hb_J1QZChZffwszqPw4EG7q.2 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12__multipart_foo.2~FmaJUOp2hb_J1QZChZffwszqPw4EG7q.3 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12__multipart_foo.2~FmaJUOp2hb_J1QZChZffwszqPw4EG7q.4 2024-09-12T18:00:23.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T18:00:23.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.867+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5309216173189235130 2024-09-12T18:00:23.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.871+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo 2024-09-12T18:00:23.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.871+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:23.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.871+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:23.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.871+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:23.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.871+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:23.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.871+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:23.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.871+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:23.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.871+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:23.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.875+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T18:00:23.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.875+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.879+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T18:00:23.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.879+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T18:00:23.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.879+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T18:00:23.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.883+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T18:00:23.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.883+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T18:00:23.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.883+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 93969815967264 notifier 6000 bl.length()=198 2024-09-12T18:00:23.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.891+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12 from cache 2024-09-12T18:00:23.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.891+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12, ofs0, ns] 2024-09-12T18:00:23.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.891+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464264 cookie 93969816017552 notifier 6000 bl.length()=256 2024-09-12T18:00:23.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.895+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12 : miss 2024-09-12T18:00:23.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.895+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.899+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.899+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12 info.flags=0x0 2024-09-12T18:00:23.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.899+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12 to cache LRU end 2024-09-12T18:00:23.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.903+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10 : miss 2024-09-12T18:00:23.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.903+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.903+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T18:00:23.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.903+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10 info.flags=0x17 2024-09-12T18:00:23.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.903+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10 to cache LRU end 2024-09-12T18:00:23.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.903+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:23.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.903+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:23.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.903+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10 2024-09-12T18:00:23.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.907+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo[C0a-wbpKXd8lebeuKrQqDJW8VyPPK2g] 2024-09-12T18:00:23.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.907+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10.0 2024-09-12T18:00:23.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.907+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe078012b10 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55770d8475f8 s->prefetch_data=0 2024-09-12T18:00:23.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.907+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to qs9mod3lbidpn3g06wwiy70r0n576ufm 2024-09-12T18:00:23.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.907+0000 7fe089d0d9c0 20 get_obj_state_impl: setting s->olh_tag to 3627m123oqf17f3jtwam0bdt7sic1ys3 2024-09-12T18:00:23.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.907+0000 7fe089d0d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3627m123oqf17f3jtwam0bdt7sic1ys3 2024-09-12T18:00:23.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.911+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10.0 2024-09-12T18:00:23.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.915+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10.0 2024-09-12T18:00:23.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.915+0000 7fe089d0d9c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T18:00:23.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.915+0000 7fe089d0d9c0 20 olh_log_entry: epoch=3 op=3 key=foo[C0a-wbpKXd8lebeuKrQqDJW8VyPPK2g] 2024-09-12T18:00:23.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.915+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe078012b10 obj=test-client.0-r-test-multipart-index-versioning.1:_:C0a-wbpKXd8lebeuKrQqDJW8VyPPK2g_foo state=0x55770d851e68 s->prefetch_data=0 2024-09-12T18:00:23.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.915+0000 7fe089d0d9c0 10 manifest: total_size = 886297 2024-09-12T18:00:23.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.915+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14233719631376618432 2024-09-12T18:00:23.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.915+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe078012b10 obj=test-client.0-r-test-multipart-index-versioning.1:_:C0a-wbpKXd8lebeuKrQqDJW8VyPPK2g_foo state=0x55770d851e68 s->prefetch_data=0 2024-09-12T18:00:23.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.915+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d851e68 2024-09-12T18:00:23.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.915+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10.0 2024-09-12T18:00:23.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:23.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T18:00:23.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:23.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:23.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:23.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T18:00:23.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:23.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14233719631376618432 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10__multipart_foo.2~-I9W2QPKNQcESzh0D9CCU6dk8p4umdk.1 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10__multipart_foo.2~-I9W2QPKNQcESzh0D9CCU6dk8p4umdk.2 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10__multipart_foo.2~-I9W2QPKNQcESzh0D9CCU6dk8p4umdk.3 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10__multipart_foo.2~-I9W2QPKNQcESzh0D9CCU6dk8p4umdk.4 2024-09-12T18:00:23.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T18:00:23.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.919+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14233719631376618432 2024-09-12T18:00:23.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.923+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo[C0a-wbpKXd8lebeuKrQqDJW8VyPPK2g] 2024-09-12T18:00:23.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.927+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe078012b10 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55770d8475f8 s->prefetch_data=0 2024-09-12T18:00:23.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.931+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10.0 2024-09-12T18:00:23.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.931+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10.0 2024-09-12T18:00:23.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.931+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:23.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.931+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:23.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.935+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:23.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.935+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:23.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.935+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:23.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.935+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:23.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.935+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:23.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.935+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T18:00:23.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.939+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.939+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T18:00:23.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.939+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T18:00:23.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.939+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T18:00:23.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.939+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T18:00:23.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.939+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T18:00:23.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.943+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464279 cookie 93969815967264 notifier 6000 bl.length()=193 2024-09-12T18:00:23.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.947+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10 from cache 2024-09-12T18:00:23.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.947+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10, ofs0, ns] 2024-09-12T18:00:23.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.947+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464273 cookie 93969816020528 notifier 6000 bl.length()=251 2024-09-12T18:00:23.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.955+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10 : miss 2024-09-12T18:00:23.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.955+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.955+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.955+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10 info.flags=0x0 2024-09-12T18:00:23.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.955+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10 to cache LRU end 2024-09-12T18:00:23.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9 : miss 2024-09-12T18:00:23.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:00:23.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9 info.flags=0x17 2024-09-12T18:00:23.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9 to cache LRU end 2024-09-12T18:00:23.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:23.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:23.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9 2024-09-12T18:00:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T18:00:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d841b40 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55770d8475f8 s->prefetch_data=0 2024-09-12T18:00:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 10 manifest: total_size = 886297 2024-09-12T18:00:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12711899203451162307 2024-09-12T18:00:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d841b40 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55770d8475f8 s->prefetch_data=0 2024-09-12T18:00:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d8475f8 2024-09-12T18:00:23.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.963+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9.0 2024-09-12T18:00:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T18:00:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T18:00:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-12T18:00:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T18:00:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T18:00:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12711899203451162307 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9__multipart_foo.2~CIELLqHRKtN5J5lkV1gBOeOI72VBrJC.1 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9__multipart_foo.2~CIELLqHRKtN5J5lkV1gBOeOI72VBrJC.2 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9__multipart_foo.2~CIELLqHRKtN5J5lkV1gBOeOI72VBrJC.3 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9__multipart_foo.2~CIELLqHRKtN5J5lkV1gBOeOI72VBrJC.4 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.971+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12711899203451162307 2024-09-12T18:00:23.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.975+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:23.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.975+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:23.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.975+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T18:00:23.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.975+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:23.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.975+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:23.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.975+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:23.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.975+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:23.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.975+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:23.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.979+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T18:00:23.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.979+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.979+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T18:00:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.979+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T18:00:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.979+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T18:00:23.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.983+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T18:00:23.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.983+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T18:00:23.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.983+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 93969816016368 notifier 6000 bl.length()=183 2024-09-12T18:00:23.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.991+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9 from cache 2024-09-12T18:00:23.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.991+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9, ofs0, ns] 2024-09-12T18:00:23.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.991+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 93969816022864 notifier 6000 bl.length()=240 2024-09-12T18:00:23.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.999+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9 : miss 2024-09-12T18:00:23.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.999+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.999+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.999+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9 info.flags=0x0 2024-09-12T18:00:23.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:23.999+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9 to cache LRU end 2024-09-12T18:00:24.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.003+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15 : miss 2024-09-12T18:00:24.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.003+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:00:24.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15 info.flags=0x17 2024-09-12T18:00:24.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15 to cache LRU end 2024-09-12T18:00:24.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:24.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:24.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15 2024-09-12T18:00:24.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:00:24.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T18:00:24.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T18:00:24.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T18:00:24.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:00:24.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T18:00:24.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T18:00:24.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T18:00:24.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:00:24.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T18:00:24.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T18:00:24.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T18:00:24.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d81af60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:24.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4836635434605221043 2024-09-12T18:00:24.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d81af60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.007+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4836635434605221043 2024-09-12T18:00:24.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tI7V6hCbybzws84g3_FjebN-7FsJh6X_0 2024-09-12T18:00:24.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T18:00:24.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tI7V6hCbybzws84g3_FjebN-7FsJh6X_1 2024-09-12T18:00:24.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T18:00:24.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.015+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4836635434605221043 2024-09-12T18:00:24.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.019+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d81af60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.019+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:00:24.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.019+0000 7fe089d0d9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:24.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.019+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11072432346249332788 2024-09-12T18:00:24.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.019+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d81af60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.019+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.019+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11072432346249332788 2024-09-12T18:00:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tI7V6hCbybzws84g3_FjebN-7FsJh6X_0 2024-09-12T18:00:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T18:00:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tI7V6hCbybzws84g3_FjebN-7FsJh6X_1 2024-09-12T18:00:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T18:00:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.023+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11072432346249332788 2024-09-12T18:00:24.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.027+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T18:00:24.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.027+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.027+0000 7fe089d0d9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:24.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.027+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _nTudEa9u8T0JL7KX2C4GR8PjFhdhWCv 2024-09-12T18:00:24.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.027+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.027+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.027+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _nTudEa9u8T0JL7KX2C4GR8PjFhdhWCv 2024-09-12T18:00:24.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.ugy72Nkpq9E286ogIE9ufVjnBgiLnE5_0 2024-09-12T18:00:24.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:00:24.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.ugy72Nkpq9E286ogIE9ufVjnBgiLnE5_1 2024-09-12T18:00:24.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T18:00:24.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.035+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _nTudEa9u8T0JL7KX2C4GR8PjFhdhWCv 2024-09-12T18:00:24.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.039+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T18:00:24.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.039+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe0780123c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.039+0000 7fe089d0d9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:24.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.039+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _JHgK-PZF0gQIJxKhGHtZyOAkwOKH_CB 2024-09-12T18:00:24.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.039+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe0780123c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.039+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.039+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _JHgK-PZF0gQIJxKhGHtZyOAkwOKH_CB 2024-09-12T18:00:24.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.Kb36t-GMa25HMfJJs7lmmfZ_4tbygXK_0 2024-09-12T18:00:24.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:00:24.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.Kb36t-GMa25HMfJJs7lmmfZ_4tbygXK_1 2024-09-12T18:00:24.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:00:24.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.043+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _JHgK-PZF0gQIJxKhGHtZyOAkwOKH_CB 2024-09-12T18:00:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.047+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T18:00:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.047+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07809ab40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.047+0000 7fe089d0d9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:24.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.047+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6005577817119425218 2024-09-12T18:00:24.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.047+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07809ab40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.047+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.047+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6005577817119425218 2024-09-12T18:00:24.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.u3Jo7s9yaoCghaVLjpGp4vAsmilIOHK_0 2024-09-12T18:00:24.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T18:00:24.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.u3Jo7s9yaoCghaVLjpGp4vAsmilIOHK_1 2024-09-12T18:00:24.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T18:00:24.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.055+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6005577817119425218 2024-09-12T18:00:24.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.059+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:00:24.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.059+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe0780123c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.059+0000 7fe089d0d9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:24.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.059+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _96qDY8LHcRkwZG42kvjA3j9S3nS0qcM 2024-09-12T18:00:24.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.059+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe0780123c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.059+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.059+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _96qDY8LHcRkwZG42kvjA3j9S3nS0qcM 2024-09-12T18:00:24.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tACtpTQxIBV3hFy10-alu68Fhu6azl3_0 2024-09-12T18:00:24.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:00:24.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tACtpTQxIBV3hFy10-alu68Fhu6azl3_1 2024-09-12T18:00:24.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T18:00:24.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.063+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _96qDY8LHcRkwZG42kvjA3j9S3nS0qcM 2024-09-12T18:00:24.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.067+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T18:00:24.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.067+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d81af60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.067+0000 7fe089d0d9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:24.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.067+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13455726753541873125 2024-09-12T18:00:24.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.067+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d81af60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.067+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.071+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13455726753541873125 2024-09-12T18:00:24.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.u3Jo7s9yaoCghaVLjpGp4vAsmilIOHK_0 2024-09-12T18:00:24.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T18:00:24.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.u3Jo7s9yaoCghaVLjpGp4vAsmilIOHK_1 2024-09-12T18:00:24.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T18:00:24.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.075+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13455726753541873125 2024-09-12T18:00:24.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.079+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T18:00:24.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.079+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe0780123c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.079+0000 7fe089d0d9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:24.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.079+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _V5ERKSxpxN4YuqcKISNPFvniG95HAJo 2024-09-12T18:00:24.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.079+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe0780123c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.079+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.079+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _V5ERKSxpxN4YuqcKISNPFvniG95HAJo 2024-09-12T18:00:24.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.rybvnvGK5tpnwPrVrJJwdxHKRxuthwh_0 2024-09-12T18:00:24.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:00:24.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.rybvnvGK5tpnwPrVrJJwdxHKRxuthwh_1 2024-09-12T18:00:24.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:00:24.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _V5ERKSxpxN4YuqcKISNPFvniG95HAJo 2024-09-12T18:00:24.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.087+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T18:00:24.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.091+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07809ab40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.091+0000 7fe089d0d9c0 10 manifest: total_size = 22651 2024-09-12T18:00:24.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.091+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.800373494044638957 2024-09-12T18:00:24.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.091+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07809ab40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.091+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.091+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.095+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.095+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.095+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.800373494044638957 2024-09-12T18:00:24.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.095+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.095+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.Y9WVgfhI7ZahU5r_UzWfOtcW2dYLF5d_0 2024-09-12T18:00:24.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.095+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:24.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.095+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.095+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.800373494044638957 2024-09-12T18:00:24.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.099+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:00:24.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.099+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe08000ccb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.099+0000 7fe089d0d9c0 10 manifest: total_size = 22651 2024-09-12T18:00:24.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.099+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _0Omh_XQD3CjGLtIWRxRpiK7TzsAwMTJ 2024-09-12T18:00:24.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.099+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe08000ccb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.099+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.099+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.107+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.107+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.107+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _0Omh_XQD3CjGLtIWRxRpiK7TzsAwMTJ 2024-09-12T18:00:24.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.107+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.107+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.S7dCserCLm0xE2ZBm_Wk-z-SxHpreD__0 2024-09-12T18:00:24.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.107+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:00:24.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.107+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.107+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _0Omh_XQD3CjGLtIWRxRpiK7TzsAwMTJ 2024-09-12T18:00:24.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.107+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T18:00:24.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.111+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.111+0000 7fe089d0d9c0 10 manifest: total_size = 22651 2024-09-12T18:00:24.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.111+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _n6B33euaEO0emj70od8Itnyg6nsyjq6 2024-09-12T18:00:24.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.111+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.111+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.111+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.115+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.115+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.115+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _n6B33euaEO0emj70od8Itnyg6nsyjq6 2024-09-12T18:00:24.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.115+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.115+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.FibpH2bNJQpIdDGl4jcfVpvvg0paDHi_0 2024-09-12T18:00:24.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.115+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:00:24.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.115+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.115+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _n6B33euaEO0emj70od8Itnyg6nsyjq6 2024-09-12T18:00:24.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.119+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T18:00:24.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.119+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe08000ccb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.119+0000 7fe089d0d9c0 10 manifest: total_size = 22651 2024-09-12T18:00:24.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.119+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9457996376369137693 2024-09-12T18:00:24.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.119+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe08000ccb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.119+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.119+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15.0 2024-09-12T18:00:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.127+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.127+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.127+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9457996376369137693 2024-09-12T18:00:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.127+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.127+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.Y9WVgfhI7ZahU5r_UzWfOtcW2dYLF5d_0 2024-09-12T18:00:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.127+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T18:00:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.127+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.127+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9457996376369137693 2024-09-12T18:00:24.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.131+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T18:00:24.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.131+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:24.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.131+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:24.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.131+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:24.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.131+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:24.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.131+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:24.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.131+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:24.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.131+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:24.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.135+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T18:00:24.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.135+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.135+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T18:00:24.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.135+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T18:00:24.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.135+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T18:00:24.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.139+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T18:00:24.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.139+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T18:00:24.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.139+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 93969815967264 notifier 6000 bl.length()=189 2024-09-12T18:00:24.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.147+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15 from cache 2024-09-12T18:00:24.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.147+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15, ofs0, ns] 2024-09-12T18:00:24.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.147+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 93969816020528 notifier 6000 bl.length()=247 2024-09-12T18:00:24.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.155+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15 : miss 2024-09-12T18:00:24.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.155+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.155+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.155+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15 info.flags=0x0 2024-09-12T18:00:24.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.155+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15 to cache LRU end 2024-09-12T18:00:24.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.159+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16 : miss 2024-09-12T18:00:24.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.159+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.159+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T18:00:24.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.159+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16 info.flags=0x17 2024-09-12T18:00:24.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.159+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16 to cache LRU end 2024-09-12T18:00:24.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.159+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:24.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.159+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:24.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.159+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T18:00:24.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T18:00:24.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d81d710 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:24.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9360549162407355637 2024-09-12T18:00:24.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d81d710 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.163+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9360549162407355637 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.1 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.1_1 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.2 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.2_1 2024-09-12T18:00:24.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T18:00:24.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.3 2024-09-12T18:00:24.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T18:00:24.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9360549162407355637 2024-09-12T18:00:24.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:00:24.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d84d6e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:24.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9546547041418684407 2024-09-12T18:00:24.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d84d6e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.171+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9546547041418684407 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.1 2024-09-12T18:00:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T18:00:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.1_1 2024-09-12T18:00:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T18:00:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.2 2024-09-12T18:00:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T18:00:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.2_1 2024-09-12T18:00:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T18:00:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.3 2024-09-12T18:00:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T18:00:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.179+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9546547041418684407 2024-09-12T18:00:24.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.183+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T18:00:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.187+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080026450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.187+0000 7fe089d0d9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:24.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.187+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _m1T5NDShuFK-yhss-SUMiVGDUuxEIMH 2024-09-12T18:00:24.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.187+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080026450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.187+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.187+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _m1T5NDShuFK-yhss-SUMiVGDUuxEIMH 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.E804Bo2i-7Infnks4KLwR8uHrBM0FAq_0 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.E804Bo2i-7Infnks4KLwR8uHrBM0FAq_1 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.E804Bo2i-7Infnks4KLwR8uHrBM0FAq_2 2024-09-12T18:00:24.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T18:00:24.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.191+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _m1T5NDShuFK-yhss-SUMiVGDUuxEIMH 2024-09-12T18:00:24.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.195+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T18:00:24.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.195+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.195+0000 7fe089d0d9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:24.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.195+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _O1wJfzLa9UmudiWNNqCoz9pOaPu1X3C 2024-09-12T18:00:24.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.195+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.195+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.195+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _O1wJfzLa9UmudiWNNqCoz9pOaPu1X3C 2024-09-12T18:00:24.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.Hij_XzkrRD0-aqWK2_9F6xVZN8eFVRf_0 2024-09-12T18:00:24.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:00:24.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.Hij_XzkrRD0-aqWK2_9F6xVZN8eFVRf_1 2024-09-12T18:00:24.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:00:24.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.Hij_XzkrRD0-aqWK2_9F6xVZN8eFVRf_2 2024-09-12T18:00:24.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T18:00:24.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _O1wJfzLa9UmudiWNNqCoz9pOaPu1X3C 2024-09-12T18:00:24.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080026450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.203+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T18:00:24.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.207+0000 7fe089d0d9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:24.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.207+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2177882473492277888 2024-09-12T18:00:24.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.207+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080026450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.207+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.207+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2177882473492277888 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.1 2024-09-12T18:00:24.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T18:00:24.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.1_1 2024-09-12T18:00:24.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T18:00:24.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.2 2024-09-12T18:00:24.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T18:00:24.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.2_1 2024-09-12T18:00:24.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T18:00:24.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.3 2024-09-12T18:00:24.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T18:00:24.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.211+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2177882473492277888 2024-09-12T18:00:24.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.215+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:00:24.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.215+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d844090 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.215+0000 7fe089d0d9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:24.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.215+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _cmgwKY5g0dKoX8RXyypuKyxm7pZvwcW 2024-09-12T18:00:24.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.215+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d844090 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.215+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.215+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _cmgwKY5g0dKoX8RXyypuKyxm7pZvwcW 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-pIjRffN24oxAicZ_RInpfnQrHock4j_0 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-pIjRffN24oxAicZ_RInpfnQrHock4j_1 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-pIjRffN24oxAicZ_RInpfnQrHock4j_2 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _cmgwKY5g0dKoX8RXyypuKyxm7pZvwcW 2024-09-12T18:00:24.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.223+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T18:00:24.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.227+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080026450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.227+0000 7fe089d0d9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:24.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.227+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2671897227266439626 2024-09-12T18:00:24.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.227+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080026450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.227+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.227+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:24.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2671897227266439626 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.1 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.1_1 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.2 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.2_1 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.3 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T18:00:24.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.231+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2671897227266439626 2024-09-12T18:00:24.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.235+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T18:00:24.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.235+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d84e8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.235+0000 7fe089d0d9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:24.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.235+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _uwUE0Z792PFvYfApzU8xDXiQRAoq-DK 2024-09-12T18:00:24.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.235+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d84e8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.235+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.235+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _uwUE0Z792PFvYfApzU8xDXiQRAoq-DK 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-iBB14pB5zz2ZHlmj49KNQOL9G_oYXm_0 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-iBB14pB5zz2ZHlmj49KNQOL9G_oYXm_1 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-iBB14pB5zz2ZHlmj49KNQOL9G_oYXm_2 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _uwUE0Z792PFvYfApzU8xDXiQRAoq-DK 2024-09-12T18:00:24.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.243+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T18:00:24.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.247+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07807ce10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.247+0000 7fe089d0d9c0 10 manifest: total_size = 45360 2024-09-12T18:00:24.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.247+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1919321402432304463 2024-09-12T18:00:24.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.247+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07807ce10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.247+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.247+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T18:00:24.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T18:00:24.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T18:00:24.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T18:00:24.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1919321402432304463 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.1 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.2 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.3 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T18:00:24.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.251+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1919321402432304463 2024-09-12T18:00:24.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.255+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:00:24.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.255+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080026450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.255+0000 7fe089d0d9c0 10 manifest: total_size = 45360 2024-09-12T18:00:24.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.255+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _KgGFnzkid6DvL1j-HPW6AYMWojPb56L 2024-09-12T18:00:24.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.255+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080026450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.255+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.255+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.263+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.263+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.263+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _KgGFnzkid6DvL1j-HPW6AYMWojPb56L 2024-09-12T18:00:24.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.263+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.263+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.leZkeyn77ZXNJUXo768Yr4V9tswImUD_0 2024-09-12T18:00:24.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.263+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:00:24.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.263+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.263+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _KgGFnzkid6DvL1j-HPW6AYMWojPb56L 2024-09-12T18:00:24.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.267+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T18:00:24.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.267+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07807ce10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.267+0000 7fe089d0d9c0 10 manifest: total_size = 45360 2024-09-12T18:00:24.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.267+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to _C02eXcyzs-m2MqW5RPCOMjINhptrNTF 2024-09-12T18:00:24.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.267+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07807ce10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.267+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.267+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.271+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.271+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.271+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _C02eXcyzs-m2MqW5RPCOMjINhptrNTF 2024-09-12T18:00:24.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.271+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.271+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.F8xJw9S4rhI7UaxJMIZEFi0STEANlAe_0 2024-09-12T18:00:24.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.271+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:00:24.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.271+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.271+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _C02eXcyzs-m2MqW5RPCOMjINhptrNTF 2024-09-12T18:00:24.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.275+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T18:00:24.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.275+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080026450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.279+0000 7fe089d0d9c0 10 manifest: total_size = 45360 2024-09-12T18:00:24.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.279+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7125599331851127597 2024-09-12T18:00:24.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.279+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080026450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55770d849e48 s->prefetch_data=0 2024-09-12T18:00:24.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.279+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d849e48 2024-09-12T18:00:24.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.279+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16.0 2024-09-12T18:00:24.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T18:00:24.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T18:00:24.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T18:00:24.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T18:00:24.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T18:00:24.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T18:00:24.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T18:00:24.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-09-12T18:00:24.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T18:00:24.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7125599331851127597 2024-09-12T18:00:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.1 2024-09-12T18:00:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T18:00:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.2 2024-09-12T18:00:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T18:00:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.3 2024-09-12T18:00:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T18:00:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.283+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7125599331851127597 2024-09-12T18:00:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.287+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T18:00:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.287+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.287+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:24.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.287+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:24.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.287+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:24.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.287+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:24.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.287+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:24.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.287+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:24.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.291+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T18:00:24.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.291+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.291+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T18:00:24.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.291+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T18:00:24.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.291+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T18:00:24.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.295+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T18:00:24.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.295+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T18:00:24.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.295+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 93969816011472 notifier 6000 bl.length()=199 2024-09-12T18:00:24.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.303+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16 from cache 2024-09-12T18:00:24.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.303+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16, ofs0, ns] 2024-09-12T18:00:24.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.303+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 93969815969200 notifier 6000 bl.length()=257 2024-09-12T18:00:24.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.307+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16 : miss 2024-09-12T18:00:24.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.307+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.311+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.311+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16 info.flags=0x0 2024-09-12T18:00:24.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.311+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16 to cache LRU end 2024-09-12T18:00:24.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14 : miss 2024-09-12T18:00:24.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T18:00:24.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14 info.flags=0x17 2024-09-12T18:00:24.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14 to cache LRU end 2024-09-12T18:00:24.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:24.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:24.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14 2024-09-12T18:00:24.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:00:24.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:00:24.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:00:24.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d81af60 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:24.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14548751455957159107 2024-09-12T18:00:24.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d81af60 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.315+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.319+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14.0 2024-09-12T18:00:24.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14548751455957159107 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-FROZEN.2~fiXN-rjJu18BsPI5mSmhHfplvIIWAUl.1 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__shadow_foo-FROZEN.2~fiXN-rjJu18BsPI5mSmhHfplvIIWAUl.1_1 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-FROZEN.2~fiXN-rjJu18BsPI5mSmhHfplvIIWAUl.2 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T18:00:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__shadow_foo-FROZEN.2~fiXN-rjJu18BsPI5mSmhHfplvIIWAUl.2_1 2024-09-12T18:00:24.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T18:00:24.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-FROZEN.2~fiXN-rjJu18BsPI5mSmhHfplvIIWAUl.3 2024-09-12T18:00:24.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T18:00:24.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.323+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14548751455957159107 2024-09-12T18:00:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.327+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:00:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.327+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55770d83e7f8 s->prefetch_data=0 2024-09-12T18:00:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.327+0000 7fe089d0d9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.327+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7634816290725527890 2024-09-12T18:00:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.327+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55770d83e7f8 s->prefetch_data=0 2024-09-12T18:00:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.327+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83e7f8 2024-09-12T18:00:24.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.327+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14.0 2024-09-12T18:00:24.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:24.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7634816290725527890 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-LUKEWARM.2~dzxm8DhaMEbf-LA4ixr7V5f59IMZbUC.1 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__shadow_foo-LUKEWARM.2~dzxm8DhaMEbf-LA4ixr7V5f59IMZbUC.1_1 2024-09-12T18:00:24.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T18:00:24.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-LUKEWARM.2~dzxm8DhaMEbf-LA4ixr7V5f59IMZbUC.2 2024-09-12T18:00:24.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T18:00:24.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__shadow_foo-LUKEWARM.2~dzxm8DhaMEbf-LA4ixr7V5f59IMZbUC.2_1 2024-09-12T18:00:24.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T18:00:24.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-LUKEWARM.2~dzxm8DhaMEbf-LA4ixr7V5f59IMZbUC.3 2024-09-12T18:00:24.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T18:00:24.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.331+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7634816290725527890 2024-09-12T18:00:24.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.335+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:00:24.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.335+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83a2a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55770d83e788 s->prefetch_data=0 2024-09-12T18:00:24.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.335+0000 7fe089d0d9c0 10 manifest: total_size = 1087 2024-09-12T18:00:24.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.335+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5719650509977574458 2024-09-12T18:00:24.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.335+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83a2a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55770d83e788 s->prefetch_data=0 2024-09-12T18:00:24.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.335+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83e788 2024-09-12T18:00:24.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.335+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14.0 2024-09-12T18:00:24.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:00:24.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T18:00:24.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T18:00:24.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:00:24.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T18:00:24.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T18:00:24.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5719650509977574458 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-STANDARD.2~qquJmApbaLjsJg1Kino-LHub8YVdDZn.1 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-STANDARD.2~qquJmApbaLjsJg1Kino-LHub8YVdDZn.2 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-STANDARD.2~qquJmApbaLjsJg1Kino-LHub8YVdDZn.3 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.343+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5719650509977574458 2024-09-12T18:00:24.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.347+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:00:24.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.347+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:24.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.347+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:24.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.347+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:24.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.347+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:24.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.347+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:24.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.347+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:24.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.347+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:24.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.351+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T18:00:24.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.351+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.351+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T18:00:24.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.351+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T18:00:24.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.351+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T18:00:24.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.355+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T18:00:24.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.355+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T18:00:24.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.355+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464276 cookie 93969816020528 notifier 6000 bl.length()=194 2024-09-12T18:00:24.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.359+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14 from cache 2024-09-12T18:00:24.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.359+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14, ofs0, ns] 2024-09-12T18:00:24.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.363+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 93969815969200 notifier 6000 bl.length()=252 2024-09-12T18:00:24.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.367+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14 : miss 2024-09-12T18:00:24.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.367+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.367+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.367+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14 info.flags=0x0 2024-09-12T18:00:24.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.367+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14 to cache LRU end 2024-09-12T18:00:24.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13 : miss 2024-09-12T18:00:24.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T18:00:24.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13 info.flags=0x17 2024-09-12T18:00:24.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13 to cache LRU end 2024-09-12T18:00:24.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:24.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:24.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13 2024-09-12T18:00:24.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:00:24.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:00:24.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:00:24.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d841ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 10 manifest: total_size = 10485760 2024-09-12T18:00:24.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11879739060539405566 2024-09-12T18:00:24.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d841ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.375+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13.0 2024-09-12T18:00:24.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11879739060539405566 2024-09-12T18:00:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.uyR-vTXcLTlk0GpE_ZylRstSaMSLKdQ_0 2024-09-12T18:00:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T18:00:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.uyR-vTXcLTlk0GpE_ZylRstSaMSLKdQ_1 2024-09-12T18:00:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T18:00:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.uyR-vTXcLTlk0GpE_ZylRstSaMSLKdQ_2 2024-09-12T18:00:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-12T18:00:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.383+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11879739060539405566 2024-09-12T18:00:24.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.387+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:00:24.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.387+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07809ab40 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.387+0000 7fe089d0d9c0 10 manifest: total_size = 10485760 2024-09-12T18:00:24.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.387+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2069971357412571216 2024-09-12T18:00:24.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.387+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07809ab40 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.387+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.387+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13.0 2024-09-12T18:00:24.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2069971357412571216 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.IIayQaw3647WUbzudZjdd7vCMDG4q1__0 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.IIayQaw3647WUbzudZjdd7vCMDG4q1__1 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.IIayQaw3647WUbzudZjdd7vCMDG4q1__2 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-12T18:00:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.391+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2069971357412571216 2024-09-12T18:00:24.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.395+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:00:24.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.395+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07807c210 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.399+0000 7fe089d0d9c0 10 manifest: total_size = 10485760 2024-09-12T18:00:24.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.399+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2450402505805135554 2024-09-12T18:00:24.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.399+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07807c210 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.399+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.399+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13.0 2024-09-12T18:00:24.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2450402505805135554 2024-09-12T18:00:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.lGcGxcUK2qhcoFZbUFoAXBQHZ91xVhL_0 2024-09-12T18:00:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T18:00:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.lGcGxcUK2qhcoFZbUFoAXBQHZ91xVhL_1 2024-09-12T18:00:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-09-12T18:00:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.lGcGxcUK2qhcoFZbUFoAXBQHZ91xVhL_2 2024-09-12T18:00:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 790 2024-09-12T18:00:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.403+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2450402505805135554 2024-09-12T18:00:24.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.407+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:00:24.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.407+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:24.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.407+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:24.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.407+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:24.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.407+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:24.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.407+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:24.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.407+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:24.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.407+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:24.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.411+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T18:00:24.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.411+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.411+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T18:00:24.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.411+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T18:00:24.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.411+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T18:00:24.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.415+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T18:00:24.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.415+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T18:00:24.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.415+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 93969815967264 notifier 6000 bl.length()=184 2024-09-12T18:00:24.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.419+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13 from cache 2024-09-12T18:00:24.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.419+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13, ofs0, ns] 2024-09-12T18:00:24.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.423+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464265 cookie 93969816017552 notifier 6000 bl.length()=242 2024-09-12T18:00:24.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.427+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13 : miss 2024-09-12T18:00:24.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.427+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.427+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.427+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13 info.flags=0x0 2024-09-12T18:00:24.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.427+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13 to cache LRU end 2024-09-12T18:00:24.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.431+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6 : miss 2024-09-12T18:00:24.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.431+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T18:00:24.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6 info.flags=0x17 2024-09-12T18:00:24.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6 to cache LRU end 2024-09-12T18:00:24.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:24.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:24.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6 2024-09-12T18:00:24.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T18:00:24.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T18:00:24.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T18:00:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T18:00:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b9690 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 10 manifest: total_size = 0 2024-09-12T18:00:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14646090283423544188 2024-09-12T18:00:24.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b9690 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.435+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6.0 2024-09-12T18:00:24.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.443+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b9690 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.443+0000 7fe089d0d9c0 10 manifest: total_size = 0 2024-09-12T18:00:24.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.443+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18297917370236756577 2024-09-12T18:00:24.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.443+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d8b9690 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.443+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.443+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6.0 2024-09-12T18:00:24.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.447+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T18:00:24.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.451+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.451+0000 7fe089d0d9c0 10 manifest: total_size = 0 2024-09-12T18:00:24.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.451+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6302107903086012457 2024-09-12T18:00:24.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.451+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.451+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.451+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6.0 2024-09-12T18:00:24.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.455+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T18:00:24.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.459+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.459+0000 7fe089d0d9c0 10 manifest: total_size = 0 2024-09-12T18:00:24.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.459+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18180957915617829229 2024-09-12T18:00:24.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.459+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.459+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.459+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6.0 2024-09-12T18:00:24.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.463+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T18:00:24.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.467+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:24.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.467+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:24.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.467+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T18:00:24.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.471+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:24.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.471+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:24.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.471+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:24.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.471+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:24.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.471+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:24.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.475+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T18:00:24.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.475+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.475+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T18:00:24.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.475+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T18:00:24.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.475+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T18:00:24.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.479+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T18:00:24.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.479+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T18:00:24.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.479+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464355 cookie 93969816008800 notifier 6000 bl.length()=181 2024-09-12T18:00:24.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.487+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6 from cache 2024-09-12T18:00:24.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.487+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6, ofs0, ns] 2024-09-12T18:00:24.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.487+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 93969816011472 notifier 6000 bl.length()=238 2024-09-12T18:00:24.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.495+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6 : miss 2024-09-12T18:00:24.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.495+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.495+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.495+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6 info.flags=0x0 2024-09-12T18:00:24.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.495+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6 to cache LRU end 2024-09-12T18:00:24.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.499+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7 : miss 2024-09-12T18:00:24.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.499+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T18:00:24.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7 info.flags=0x17 2024-09-12T18:00:24.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7 to cache LRU end 2024-09-12T18:00:24.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:24.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:24.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7 2024-09-12T18:00:24.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T18:00:24.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T18:00:24.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T18:00:24.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T18:00:24.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83cf00 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 10 manifest: total_size = 2078 2024-09-12T18:00:24.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13154565718140634223 2024-09-12T18:00:24.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83cf00 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.503+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7.0 2024-09-12T18:00:24.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.511+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.511+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.511+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13154565718140634223 2024-09-12T18:00:24.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.511+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.511+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7__shadow_._j7BrnJMCFujVlfdoeoLhdWKMjvsGqO_0 2024-09-12T18:00:24.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.511+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:24.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.511+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.511+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13154565718140634223 2024-09-12T18:00:24.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.515+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83cf00 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.515+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T18:00:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.515+0000 7fe089d0d9c0 10 manifest: total_size = 38 2024-09-12T18:00:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.515+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5388628401318038747 2024-09-12T18:00:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.515+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83cf00 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.515+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.515+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7.0 2024-09-12T18:00:24.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.519+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.519+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.519+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5388628401318038747 2024-09-12T18:00:24.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.519+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.519+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7__shadow_.IyJSG_ownPO8gbY6bxtsqKJXIpTGybK_0 2024-09-12T18:00:24.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.519+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:24.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.519+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.519+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5388628401318038747 2024-09-12T18:00:24.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.523+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T18:00:24.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.523+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83cf00 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.527+0000 7fe089d0d9c0 10 manifest: total_size = 524288 2024-09-12T18:00:24.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.527+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.529931046012667418 2024-09-12T18:00:24.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.527+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83cf00 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.527+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.527+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7.0 2024-09-12T18:00:24.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.531+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.531+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.531+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.529931046012667418 2024-09-12T18:00:24.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.531+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.531+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7__shadow_.dgfhdjBO5ug1aOcoK9jOy0HCpeB5d6V_0 2024-09-12T18:00:24.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.531+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-12T18:00:24.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.531+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.531+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.529931046012667418 2024-09-12T18:00:24.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.535+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T18:00:24.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.535+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83cf00 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.535+0000 7fe089d0d9c0 10 manifest: total_size = 524288 2024-09-12T18:00:24.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.535+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18193744509128343580 2024-09-12T18:00:24.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.535+0000 7fe089d0d9c0 20 get_obj_state: octx=0x55770d83cf00 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.535+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.535+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7.0 2024-09-12T18:00:24.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.543+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.543+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.543+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18193744509128343580 2024-09-12T18:00:24.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.543+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.543+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7__shadow_.HnAu8HXKyZ40rssOEMig-VHIZgkB6oX_0 2024-09-12T18:00:24.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.543+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:24.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.543+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.543+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18193744509128343580 2024-09-12T18:00:24.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.547+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T18:00:24.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.547+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:24.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.547+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:24.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.547+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:24.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.547+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:24.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.547+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:24.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.547+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:24.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.547+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:24.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.551+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T18:00:24.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.551+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.551+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T18:00:24.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.551+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T18:00:24.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.551+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T18:00:24.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.555+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T18:00:24.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.555+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T18:00:24.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.555+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464356 cookie 93969816008800 notifier 6000 bl.length()=181 2024-09-12T18:00:24.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.563+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7 from cache 2024-09-12T18:00:24.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.563+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7, ofs0, ns] 2024-09-12T18:00:24.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.563+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464276 cookie 93969816011472 notifier 6000 bl.length()=238 2024-09-12T18:00:24.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.571+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7 : miss 2024-09-12T18:00:24.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.571+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.571+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.571+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7 info.flags=0x0 2024-09-12T18:00:24.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.571+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7 to cache LRU end 2024-09-12T18:00:24.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.575+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8 : miss 2024-09-12T18:00:24.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.575+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T18:00:24.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8 info.flags=0x17 2024-09-12T18:00:24.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8 to cache LRU end 2024-09-12T18:00:24.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:24.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:24.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8 2024-09-12T18:00:24.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T18:00:24.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T18:00:24.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T18:00:24.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T18:00:24.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe0780123c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 10 manifest: total_size = 4134 2024-09-12T18:00:24.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4335810843076635339 2024-09-12T18:00:24.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe0780123c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.579+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8.0 2024-09-12T18:00:24.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.587+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.587+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.587+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4335810843076635339 2024-09-12T18:00:24.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.587+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.587+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8__shadow_._qqacsx7vpNn0pXcbTZ5-Rm-5AO26Z6_0 2024-09-12T18:00:24.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.587+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:24.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.587+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.587+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4335810843076635339 2024-09-12T18:00:24.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.591+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T18:00:24.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.591+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe0780123c0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.591+0000 7fe089d0d9c0 10 manifest: total_size = 49187 2024-09-12T18:00:24.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.591+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1209068449955984187 2024-09-12T18:00:24.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.591+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe0780123c0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.591+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.591+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8.0 2024-09-12T18:00:24.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.595+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.595+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.595+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1209068449955984187 2024-09-12T18:00:24.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.595+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.595+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8__shadow_.WMvtnx2kI7I3xhpWR6I1o9fXKvzdRCc_0 2024-09-12T18:00:24.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.595+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:24.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.595+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.595+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1209068449955984187 2024-09-12T18:00:24.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.599+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T18:00:24.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.599+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07807c210 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.603+0000 7fe089d0d9c0 10 manifest: total_size = 4134 2024-09-12T18:00:24.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.603+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5673654690284775691 2024-09-12T18:00:24.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.603+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe07807c210 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.603+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.603+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8.0 2024-09-12T18:00:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.607+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.607+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.607+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5673654690284775691 2024-09-12T18:00:24.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.607+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.607+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8__shadow_.YJwSntjMNd3EExcvh4i9h9lZDG2aRoH_0 2024-09-12T18:00:24.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.607+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:24.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.607+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.607+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5673654690284775691 2024-09-12T18:00:24.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.611+0000 7fdf667fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T18:00:24.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.611+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.611+0000 7fe089d0d9c0 10 manifest: total_size = 49187 2024-09-12T18:00:24.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.611+0000 7fe089d0d9c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6498230611073723961 2024-09-12T18:00:24.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.611+0000 7fe089d0d9c0 20 get_obj_state: octx=0x7fe080013ad0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55770d83c078 s->prefetch_data=0 2024-09-12T18:00:24.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.611+0000 7fe089d0d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55770d83c078 2024-09-12T18:00:24.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.611+0000 7fe089d0d9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8.0 2024-09-12T18:00:24.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.619+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:24.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.619+0000 7fe089d0d9c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T18:00:24.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.619+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6498230611073723961 2024-09-12T18:00:24.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.619+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:24.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.619+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8__shadow_.x-D1DmgV8uShrHg1zdHpcqQ0uZaAI7B_0 2024-09-12T18:00:24.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.619+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:24.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.619+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:24.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.619+0000 7fe089d0d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6498230611073723961 2024-09-12T18:00:24.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.619+0000 7fdf66ffd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T18:00:24.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.623+0000 7fe089d0d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:24.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.623+0000 7fe089d0d9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T18:00:24.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.623+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:24.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.623+0000 7fe089d0d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:24.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.623+0000 7fe089d0d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:24.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.623+0000 7fe089d0d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:24.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.623+0000 7fe089d0d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:24.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.627+0000 7fe089d0d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T18:00:24.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.627+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.627+0000 7fe089d0d9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T18:00:24.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.627+0000 7fe089d0d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T18:00:24.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.627+0000 7fe089d0d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T18:00:24.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.631+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T18:00:24.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.631+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T18:00:24.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.631+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464357 cookie 93969816008800 notifier 6000 bl.length()=181 2024-09-12T18:00:24.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.639+0000 7fe089d0d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8 from cache 2024-09-12T18:00:24.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.639+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8, ofs0, ns] 2024-09-12T18:00:24.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.639+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 93969816011472 notifier 6000 bl.length()=238 2024-09-12T18:00:24.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.647+0000 7fe089d0d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8 : miss 2024-09-12T18:00:24.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.647+0000 7fe089d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.647+0000 7fe089d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.647+0000 7fe089d0d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8 info.flags=0x0 2024-09-12T18:00:24.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.647+0000 7fe089d0d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8 to cache LRU end 2024-09-12T18:00:24.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.651+0000 7fe089d0d9c0 10 removing key index: XFCGTILXZYNPHMESPSNN 2024-09-12T18:00:24.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.655+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:XFCGTILXZYNPHMESPSNN, ofs0, ns] 2024-09-12T18:00:24.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.655+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 93969815969200 notifier 6000 bl.length()=170 2024-09-12T18:00:24.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.659+0000 7fe089d0d9c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T18:00:24.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.663+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T18:00:24.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.663+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 93969815967264 notifier 6000 bl.length()=182 2024-09-12T18:00:24.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.667+0000 7fe089d0d9c0 10 removing user buckets index 2024-09-12T18:00:24.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.671+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T18:00:24.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.671+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 93969816020528 notifier 6000 bl.length()=173 2024-09-12T18:00:24.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.671+0000 7fe089d0d9c0 10 removing user index: ragweed.client.0 2024-09-12T18:00:24.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.675+0000 7fe089d0d9c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T18:00:24.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.675+0000 7fe089d0d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T18:00:24.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.675+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464294 cookie 93969816016368 notifier 6000 bl.length()=165 2024-09-12T18:00:24.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.687+0000 7fdf3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:24.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.691+0000 7fe089d0d9c0 20 remove_watcher() i=0 2024-09-12T18:00:24.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.691+0000 7fe089d0d9c0 2 removed watcher, disabling cache 2024-09-12T18:00:24.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.695+0000 7fe089d0d9c0 20 remove_watcher() i=1 2024-09-12T18:00:24.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.699+0000 7fe089d0d9c0 20 remove_watcher() i=2 2024-09-12T18:00:24.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.699+0000 7fe089d0d9c0 20 remove_watcher() i=3 2024-09-12T18:00:24.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.703+0000 7fe089d0d9c0 20 remove_watcher() i=4 2024-09-12T18:00:24.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.703+0000 7fe089d0d9c0 20 remove_watcher() i=5 2024-09-12T18:00:24.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.707+0000 7fe089d0d9c0 20 remove_watcher() i=6 2024-09-12T18:00:24.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.707+0000 7fe089d0d9c0 20 remove_watcher() i=7 2024-09-12T18:00:24.725 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T18:00:24.802 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:24.803 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:24.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.847+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.847+0000 7f059268f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.847+0000 7f059268f9c0 20 realm 2024-09-12T18:00:24.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.847+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.847+0000 7f059268f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.847+0000 7f059268f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:24.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.847+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.847+0000 7f059268f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.847+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.851+0000 7f059268f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:24.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.851+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.851+0000 7f059268f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:24.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.851+0000 7f059268f9c0 20 searching for the correct realm 2024-09-12T18:00:24.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.855+0000 7f0590996640 0 -- 172.21.15.157:0/1626682946 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x56356bc66960 msgr2=0x56356bc68e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:24.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.863+0000 7f0590195640 0 -- 172.21.15.157:0/1626682946 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f0578053040 msgr2=0x7f0578034950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:00:24.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:00:24.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:24.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:24.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:00:24.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:24.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:24.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:24.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:24.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 zone default found 2024-09-12T18:00:24.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 4 Realm: () 2024-09-12T18:00:24.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:00:24.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:00:24.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:24.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 zonegroup default 2024-09-12T18:00:24.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 started sync module instance, tier type = 2024-09-12T18:00:24.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.871+0000 7f059268f9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:00:24.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.887+0000 7f059268f9c0 20 add_watcher() i=0 2024-09-12T18:00:24.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.887+0000 7f059268f9c0 20 add_watcher() i=1 2024-09-12T18:00:24.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.887+0000 7f059268f9c0 20 add_watcher() i=2 2024-09-12T18:00:24.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.887+0000 7f059268f9c0 20 add_watcher() i=3 2024-09-12T18:00:24.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.887+0000 7f059268f9c0 20 add_watcher() i=4 2024-09-12T18:00:24.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.887+0000 7f059268f9c0 20 add_watcher() i=5 2024-09-12T18:00:24.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.887+0000 7f059268f9c0 20 add_watcher() i=6 2024-09-12T18:00:24.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.891+0000 7f059268f9c0 20 add_watcher() i=7 2024-09-12T18:00:24.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.891+0000 7f059268f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:24.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.891+0000 7f0446fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:24.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.891+0000 7f059268f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:24.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.891+0000 7f059268f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:24.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.963+0000 7f0445fdb640 20 reqs_thread_entry: start 2024-09-12T18:00:24.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.963+0000 7f059268f9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:00:24.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.963+0000 7f059268f9c0 20 Filter name: none 2024-09-12T18:00:24.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.963+0000 7f03b77fe640 20 reqs_thread_entry: start 2024-09-12T18:00:24.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.963+0000 7f059268f9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T18:00:24.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.963+0000 7f059268f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.963+0000 7f059268f9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T18:00:24.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.963+0000 7f059268f9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T18:00:24.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.963+0000 7f059268f9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T18:00:24.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.963+0000 7f059268f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:24.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.967+0000 7f059268f9c0 10 removing key index: EDWCPDWYGCAOBJDLBLQS 2024-09-12T18:00:24.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.967+0000 7f059268f9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:EDWCPDWYGCAOBJDLBLQS, ofs0, ns] 2024-09-12T18:00:24.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.967+0000 7f04677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464266 cookie 94787441451072 notifier 6021 bl.length()=170 2024-09-12T18:00:24.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.971+0000 7f059268f9c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T18:00:24.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.971+0000 7f059268f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T18:00:24.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.971+0000 7f04677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 94787441443888 notifier 6021 bl.length()=182 2024-09-12T18:00:24.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.975+0000 7f059268f9c0 10 removing user buckets index 2024-09-12T18:00:24.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.979+0000 7f059268f9c0 10 removing user index: sysuser.client.0 2024-09-12T18:00:24.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.979+0000 7f059268f9c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T18:00:24.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.979+0000 7f059268f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T18:00:24.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.979+0000 7f0466ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94787441439552 notifier 6021 bl.length()=165 2024-09-12T18:00:24.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.983+0000 7f0446fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:24.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.987+0000 7f059268f9c0 20 remove_watcher() i=0 2024-09-12T18:00:24.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.987+0000 7f059268f9c0 2 removed watcher, disabling cache 2024-09-12T18:00:24.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.991+0000 7f059268f9c0 20 remove_watcher() i=1 2024-09-12T18:00:24.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.991+0000 7f059268f9c0 20 remove_watcher() i=2 2024-09-12T18:00:24.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.995+0000 7f059268f9c0 20 remove_watcher() i=3 2024-09-12T18:00:24.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.999+0000 7f059268f9c0 20 remove_watcher() i=4 2024-09-12T18:00:24.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.999+0000 7f059268f9c0 20 remove_watcher() i=5 2024-09-12T18:00:24.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:24.999+0000 7f059268f9c0 20 remove_watcher() i=6 2024-09-12T18:00:24.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:00:25.003+0000 7f059268f9c0 20 remove_watcher() i=7 2024-09-12T18:00:25.015 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T18:00:25.015 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T18:00:25.110 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:00:25.122 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:00:25.122 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:00:25.122 DEBUG:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:00:25.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:00:25.156 INFO:teuthology.orchestra.run.smithi157.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:00:25.156 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:00:25.203 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:00:25.203 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:00:25.251 INFO:tasks.workunit:timeout=3h 2024-09-12T18:00:25.251 INFO:tasks.workunit:cleanup=True 2024-09-12T18:00:25.251 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:01:23.772 INFO:tasks.workunit.client.0.smithi157.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T18:01:23.773 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:23.773 INFO:tasks.workunit.client.0.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:01:23.773 INFO:tasks.workunit.client.0.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:01:23.773 INFO:tasks.workunit.client.0.smithi157.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:01:23.773 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:23.773 INFO:tasks.workunit.client.0.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:01:23.773 INFO:tasks.workunit.client.0.smithi157.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:01:23.774 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:23.774 INFO:tasks.workunit.client.0.smithi157.stderr: git switch -c 2024-09-12T18:01:23.774 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:23.774 INFO:tasks.workunit.client.0.smithi157.stderr:Or undo this operation with: 2024-09-12T18:01:23.774 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:23.774 INFO:tasks.workunit.client.0.smithi157.stderr: git switch - 2024-09-12T18:01:23.774 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:23.774 INFO:tasks.workunit.client.0.smithi157.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:01:23.774 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:23.774 INFO:tasks.workunit.client.0.smithi157.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T18:01:23.781 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:01:23.827 INFO:tasks.workunit.client.0.smithi157.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:01:23.831 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:01:23.831 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:01:23.886 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:01:23.940 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:01:23.984 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:01:23.987 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:01:23.987 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:01:24.030 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:01:24.033 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T18:01:24.033 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:01:24.083 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T18:01:24.084 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T18:01:24.084 DEBUG:teuthology.orchestra.run.smithi157:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T18:01:24.134 INFO:tasks.workunit.client.0.smithi157.stderr:+ ulimit -c 0 2024-09-12T18:01:24.134 INFO:tasks.workunit.client.0.smithi157.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T18:01:24.135 INFO:tasks.workunit.client.0.smithi157.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:01:24.135 INFO:tasks.workunit.client.0.smithi157.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi157.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi157.stderr:++ deactivate nondestructive 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi157.stderr:++ hash -r 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi157.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi157.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi157.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi157.stderr:++ export VIRTUAL_ENV 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi157.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi157.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi157.stderr:++ export PATH 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -z '' ']' 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi157.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi157.stderr:++ PS1='(rgw) ' 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi157.stderr:++ export PS1 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi157.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi157.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi157.stderr:++ hash -r 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi157.stderr:+ pip install pip --upgrade 2024-09-12T18:01:27.445 INFO:tasks.workunit.client.0.smithi157.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T18:01:27.653 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting pip 2024-09-12T18:01:27.659 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:01:27.696 INFO:tasks.workunit.client.0.smithi157.stdout:Installing collected packages: pip 2024-09-12T18:01:27.696 INFO:tasks.workunit.client.0.smithi157.stdout: Attempting uninstall: pip 2024-09-12T18:01:27.696 INFO:tasks.workunit.client.0.smithi157.stdout: Found existing installation: pip 22.0.2 2024-09-12T18:01:27.975 INFO:tasks.workunit.client.0.smithi157.stdout: Uninstalling pip-22.0.2: 2024-09-12T18:01:27.981 INFO:tasks.workunit.client.0.smithi157.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T18:01:28.755 INFO:tasks.workunit.client.0.smithi157.stdout:Successfully installed pip-24.2 2024-09-12T18:01:28.820 INFO:tasks.workunit.client.0.smithi157.stderr:+ pip install boto3 2024-09-12T18:01:29.812 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting boto3 2024-09-12T18:01:29.813 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:01:30.368 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:01:30.369 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:01:30.421 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:01:30.422 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:01:30.458 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:01:30.459 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:01:30.501 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:01:30.502 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:01:30.572 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:01:30.573 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T18:01:30.807 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:01:30.808 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:01:30.812 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:01:30.813 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:01:30.823 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:01:30.824 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:01:30.825 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:01:30.827 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T18:01:30.829 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:01:30.895 INFO:tasks.workunit.client.0.smithi157.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:01:31.997 INFO:tasks.workunit.client.0.smithi157.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T18:01:32.191 INFO:tasks.workunit.client.0.smithi157.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T18:01:32.321 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T18:01:32.354 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:32.354 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:32.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.394+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 20 realm 2024-09-12T18:01:32.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:32.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:32.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:32.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.398+0000 7fdf5f18a9c0 20 searching for the correct realm 2024-09-12T18:01:32.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.406+0000 7fdf5d491640 0 -- 172.21.15.157:0/3062960994 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fdf50047040 msgr2=0x7fdf50047930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:32.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.622+0000 7fdf5cc90640 0 -- 172.21.15.157:0/3062960994 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55e67f5611c0 msgr2=0x55e67f5635b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:32.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.630+0000 7fdf5f18a9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:32.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.630+0000 7fdf5f18a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:32.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.630+0000 7fdf5f18a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:32.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.630+0000 7fdf5f18a9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:32.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.630+0000 7fdf5f18a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:32.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.630+0000 7fdf5f18a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:32.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.630+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.630+0000 7fdf5f18a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.630+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:32.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:32.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 zone default found 2024-09-12T18:01:32.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 4 Realm: () 2024-09-12T18:01:32.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:32.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:32.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:32.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 zonegroup default 2024-09-12T18:01:32.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 started sync module instance, tier type = 2024-09-12T18:01:32.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.634+0000 7fdf5f18a9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:32.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.658+0000 7fdf5f18a9c0 20 add_watcher() i=0 2024-09-12T18:01:32.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.658+0000 7fdf5f18a9c0 20 add_watcher() i=1 2024-09-12T18:01:32.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.658+0000 7fdf5f18a9c0 20 add_watcher() i=2 2024-09-12T18:01:32.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.658+0000 7fdf5f18a9c0 20 add_watcher() i=3 2024-09-12T18:01:32.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.658+0000 7fdf5f18a9c0 20 add_watcher() i=4 2024-09-12T18:01:32.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.658+0000 7fdf5f18a9c0 20 add_watcher() i=5 2024-09-12T18:01:32.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.658+0000 7fdf5f18a9c0 20 add_watcher() i=6 2024-09-12T18:01:32.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.662+0000 7fdf5f18a9c0 20 add_watcher() i=7 2024-09-12T18:01:32.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.662+0000 7fdf5f18a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:32.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.666+0000 7fde12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:32.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.666+0000 7fdf5f18a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:32.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.666+0000 7fdf5f18a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:32.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.666+0000 7fdf5f18a9c0 5 note: GC not initialized 2024-09-12T18:01:32.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.666+0000 7fde11fe3640 20 reqs_thread_entry: start 2024-09-12T18:01:32.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.666+0000 7fdf5f18a9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:32.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.666+0000 7fdf5f18a9c0 20 Filter name: none 2024-09-12T18:01:32.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.666+0000 7fdd837fe640 20 reqs_thread_entry: start 2024-09-12T18:01:32.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.666+0000 7fdf5f18a9c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T18:01:32.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.666+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T18:01:32.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T18:01:32.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T18:01:32.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T18:01:32.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T18:01:32.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T18:01:32.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T18:01:32.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T18:01:32.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T18:01:32.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.670+0000 7fdf5f18a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T18:01:32.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.674+0000 7fde33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 94448467245312 notifier 5681 bl.length()=569 2024-09-12T18:01:32.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.674+0000 7fde33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T18:01:32.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.674+0000 7fde33fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T18:01:32.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.674+0000 7fdf5f18a9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T18:01:32.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.674+0000 7fdf5f18a9c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T18:01:32.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.674+0000 7fdf5f18a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T18:01:32.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.678+0000 7fde33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464279 cookie 94448467241712 notifier 5681 bl.length()=180 2024-09-12T18:01:32.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.678+0000 7fde33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T18:01:32.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.678+0000 7fde33fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T18:01:32.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.678+0000 7fde12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:32.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.686+0000 7fdf5f18a9c0 20 remove_watcher() i=0 2024-09-12T18:01:32.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.686+0000 7fdf5f18a9c0 2 removed watcher, disabling cache 2024-09-12T18:01:32.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.686+0000 7fdf5f18a9c0 20 remove_watcher() i=1 2024-09-12T18:01:32.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.690+0000 7fdf5f18a9c0 20 remove_watcher() i=2 2024-09-12T18:01:32.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.694+0000 7fdf5f18a9c0 20 remove_watcher() i=3 2024-09-12T18:01:32.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.694+0000 7fdf5f18a9c0 20 remove_watcher() i=4 2024-09-12T18:01:32.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.698+0000 7fdf5f18a9c0 20 remove_watcher() i=5 2024-09-12T18:01:32.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.698+0000 7fdf5f18a9c0 20 remove_watcher() i=6 2024-09-12T18:01:32.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:32.698+0000 7fdf5f18a9c0 20 remove_watcher() i=7 2024-09-12T18:01:33.387 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard add 2024-09-12T18:01:33.388 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:33.388 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:33.421 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:33.421 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:33.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.466+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 20 realm 2024-09-12T18:01:33.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:33.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:33.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:33.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.470+0000 7fa8917909c0 20 searching for the correct realm 2024-09-12T18:01:33.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.478+0000 7fa88fa97640 0 -- 172.21.15.157:0/2887782883 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x564ed4c11260 msgr2=0x564ed4c13700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:33.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.482+0000 7fa88f296640 0 -- 172.21.15.157:0/2887782883 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fa8840e9910 msgr2=0x7fa8840db400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:33.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:33.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:33.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:33.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:33.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:33.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:33.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.489 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:33.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:33.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 zone default found 2024-09-12T18:01:33.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 4 Realm: () 2024-09-12T18:01:33.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:33.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:33.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:33.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 zonegroup default 2024-09-12T18:01:33.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.490+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.494+0000 7fa8917909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.494+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.494+0000 7fa8917909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.494+0000 7fa8917909c0 20 started sync module instance, tier type = 2024-09-12T18:01:33.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.494+0000 7fa8917909c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:33.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.510+0000 7fa8917909c0 20 add_watcher() i=0 2024-09-12T18:01:33.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.510+0000 7fa8917909c0 20 add_watcher() i=1 2024-09-12T18:01:33.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.510+0000 7fa8917909c0 20 add_watcher() i=2 2024-09-12T18:01:33.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.510+0000 7fa8917909c0 20 add_watcher() i=3 2024-09-12T18:01:33.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.510+0000 7fa8917909c0 20 add_watcher() i=4 2024-09-12T18:01:33.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.510+0000 7fa8917909c0 20 add_watcher() i=5 2024-09-12T18:01:33.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.510+0000 7fa8917909c0 20 add_watcher() i=6 2024-09-12T18:01:33.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.510+0000 7fa8917909c0 20 add_watcher() i=7 2024-09-12T18:01:33.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.510+0000 7fa8917909c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:33.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa7467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:33.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:33.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:33.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 5 note: GC not initialized 2024-09-12T18:01:33.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa7457e2640 20 reqs_thread_entry: start 2024-09-12T18:01:33.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:33.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 Filter name: none 2024-09-12T18:01:33.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa73effd640 20 reqs_thread_entry: start 2024-09-12T18:01:33.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:33.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:33.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:33.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:33.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.514+0000 7fa8917909c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.518+0000 7fa8917909c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:33.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.518+0000 7fa8917909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:33.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.518+0000 7fa7467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:33.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.522+0000 7fa8917909c0 20 remove_watcher() i=0 2024-09-12T18:01:33.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.522+0000 7fa8917909c0 2 removed watcher, disabling cache 2024-09-12T18:01:33.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.526+0000 7fa8917909c0 20 remove_watcher() i=1 2024-09-12T18:01:33.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.526+0000 7fa8917909c0 20 remove_watcher() i=2 2024-09-12T18:01:33.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.530+0000 7fa8917909c0 20 remove_watcher() i=3 2024-09-12T18:01:33.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.530+0000 7fa8917909c0 20 remove_watcher() i=4 2024-09-12T18:01:33.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.534+0000 7fa8917909c0 20 remove_watcher() i=5 2024-09-12T18:01:33.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.534+0000 7fa8917909c0 20 remove_watcher() i=6 2024-09-12T18:01:33.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.534+0000 7fa8917909c0 20 remove_watcher() i=7 2024-09-12T18:01:33.548 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:33.548 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:01:33.548 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: a-bucket id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T18:01:33.549 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:33.549 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-12T18:01:33.578 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:33.578 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:33.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.622+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 20 realm 2024-09-12T18:01:33.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:33.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:33.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:33.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.626+0000 7febf93b49c0 20 searching for the correct realm 2024-09-12T18:01:33.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.630+0000 7febf66b9640 0 -- 172.21.15.157:0/2023280096 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7febec121920 msgr2=0x7febec0f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:33.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:33.846+0000 7febf6eba640 0 -- 172.21.15.157:0/2023280096 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7febec0d62e0 msgr2=0x7febec114960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:34.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.062+0000 7febf93b49c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:34.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.062+0000 7febf93b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:34.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.062+0000 7febf93b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:34.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.062+0000 7febf93b49c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:34.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.062+0000 7febf93b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:34.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.062+0000 7febf93b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:34.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.062+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.062+0000 7febf93b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.062+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:34.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:34.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 zone default found 2024-09-12T18:01:34.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 4 Realm: () 2024-09-12T18:01:34.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:34.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:34.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:34.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 zonegroup default 2024-09-12T18:01:34.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 started sync module instance, tier type = 2024-09-12T18:01:34.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.066+0000 7febf93b49c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:34.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.090+0000 7febf93b49c0 20 add_watcher() i=0 2024-09-12T18:01:34.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.090+0000 7febf93b49c0 20 add_watcher() i=1 2024-09-12T18:01:34.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.090+0000 7febf93b49c0 20 add_watcher() i=2 2024-09-12T18:01:34.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.090+0000 7febf93b49c0 20 add_watcher() i=3 2024-09-12T18:01:34.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.090+0000 7febf93b49c0 20 add_watcher() i=4 2024-09-12T18:01:34.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.090+0000 7febf93b49c0 20 add_watcher() i=5 2024-09-12T18:01:34.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.090+0000 7febf93b49c0 20 add_watcher() i=6 2024-09-12T18:01:34.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.094+0000 7febf93b49c0 20 add_watcher() i=7 2024-09-12T18:01:34.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.094+0000 7febf93b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:34.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.098+0000 7feaad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:34.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.098+0000 7febf93b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:34.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.098+0000 7febf93b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:34.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.098+0000 7febf93b49c0 5 note: GC not initialized 2024-09-12T18:01:34.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.098+0000 7fea27fff640 20 reqs_thread_entry: start 2024-09-12T18:01:34.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.098+0000 7febf93b49c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:34.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.098+0000 7febf93b49c0 20 Filter name: none 2024-09-12T18:01:34.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7fea25ffb640 20 reqs_thread_entry: start 2024-09-12T18:01:34.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:34.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:34.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:34.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:34.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:01:34.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:34.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:34.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:34.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:34.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:34.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.102+0000 7febf93b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:01:34.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.106+0000 7feaad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:34.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.110+0000 7febf93b49c0 20 remove_watcher() i=0 2024-09-12T18:01:34.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.110+0000 7febf93b49c0 2 removed watcher, disabling cache 2024-09-12T18:01:34.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.114+0000 7febf93b49c0 20 remove_watcher() i=1 2024-09-12T18:01:34.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.114+0000 7febf93b49c0 20 remove_watcher() i=2 2024-09-12T18:01:34.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.118+0000 7febf93b49c0 20 remove_watcher() i=3 2024-09-12T18:01:34.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.118+0000 7febf93b49c0 20 remove_watcher() i=4 2024-09-12T18:01:34.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.122+0000 7febf93b49c0 20 remove_watcher() i=5 2024-09-12T18:01:34.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.122+0000 7febf93b49c0 20 remove_watcher() i=6 2024-09-12T18:01:34.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.122+0000 7febf93b49c0 20 remove_watcher() i=7 2024-09-12T18:01:34.139 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshard list 2024-09-12T18:01:34.164 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:34.164 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:34.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.210+0000 7f259f5969c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.210+0000 7f259f5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.210+0000 7f259f5969c0 20 realm 2024-09-12T18:01:34.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.210+0000 7f259f5969c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.210+0000 7f259f5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.210+0000 7f259f5969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:34.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.210+0000 7f259f5969c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.210+0000 7f259f5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.210+0000 7f259f5969c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.214+0000 7f259f5969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:34.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.214+0000 7f259f5969c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.214+0000 7f259f5969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:34.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.214+0000 7f259f5969c0 20 searching for the correct realm 2024-09-12T18:01:34.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.218+0000 7f259c89b640 0 -- 172.21.15.157:0/4180202748 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f25940e1040 msgr2=0x7f25940e1420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:34.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.226+0000 7f259c89b640 0 -- 172.21.15.157:0/4180202748 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f2468080900 msgr2=0x7f2468082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:34.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:34.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:34.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:34.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:34.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:34.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:34.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.234+0000 7f259f5969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 20 zone default found 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 4 Realm: () 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 20 zonegroup default 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 20 started sync module instance, tier type = 2024-09-12T18:01:34.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.238+0000 7f259f5969c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:34.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.254+0000 7f259f5969c0 20 add_watcher() i=0 2024-09-12T18:01:34.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.254+0000 7f259f5969c0 20 add_watcher() i=1 2024-09-12T18:01:34.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.254+0000 7f259f5969c0 20 add_watcher() i=2 2024-09-12T18:01:34.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.254+0000 7f259f5969c0 20 add_watcher() i=3 2024-09-12T18:01:34.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.254+0000 7f259f5969c0 20 add_watcher() i=4 2024-09-12T18:01:34.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.254+0000 7f259f5969c0 20 add_watcher() i=5 2024-09-12T18:01:34.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.254+0000 7f259f5969c0 20 add_watcher() i=6 2024-09-12T18:01:34.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.254+0000 7f259f5969c0 20 add_watcher() i=7 2024-09-12T18:01:34.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.254+0000 7f259f5969c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:34.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.258+0000 7f2453fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:34.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.258+0000 7f259f5969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:34.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.258+0000 7f259f5969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:34.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.258+0000 7f259f5969c0 5 note: GC not initialized 2024-09-12T18:01:34.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.258+0000 7f2452fe5640 20 reqs_thread_entry: start 2024-09-12T18:01:34.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.258+0000 7f259f5969c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:34.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.258+0000 7f259f5969c0 20 Filter name: none 2024-09-12T18:01:34.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.258+0000 7f2450fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:34.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.270+0000 7f2453fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:34.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.274+0000 7f259f5969c0 20 remove_watcher() i=0 2024-09-12T18:01:34.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.274+0000 7f259f5969c0 2 removed watcher, disabling cache 2024-09-12T18:01:34.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.274+0000 7f259f5969c0 20 remove_watcher() i=1 2024-09-12T18:01:34.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.278+0000 7f259f5969c0 20 remove_watcher() i=2 2024-09-12T18:01:34.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.278+0000 7f259f5969c0 20 remove_watcher() i=3 2024-09-12T18:01:34.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.282+0000 7f259f5969c0 20 remove_watcher() i=4 2024-09-12T18:01:34.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.282+0000 7f259f5969c0 20 remove_watcher() i=5 2024-09-12T18:01:34.282 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.282+0000 7f259f5969c0 20 remove_watcher() i=6 2024-09-12T18:01:34.283 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.286+0000 7f259f5969c0 20 remove_watcher() i=7 2024-09-12T18:01:34.298 INFO:tasks.workunit.client.0.smithi157.stderr:bucket name a-bucket 2024-09-12T18:01:34.298 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard process 2024-09-12T18:01:34.298 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:34.298 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshard process 2024-09-12T18:01:34.322 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:34.323 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:34.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.366+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 20 realm 2024-09-12T18:01:34.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:34.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.369 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:34.369 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.370 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:34.370 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.370+0000 7fa0d6a679c0 20 searching for the correct realm 2024-09-12T18:01:34.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.378+0000 7fa0d4d6e640 0 -- 172.21.15.157:0/1446271479 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x563484569010 msgr2=0x56348456b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:34.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.382+0000 7fa0d3d6c640 0 -- 172.21.15.157:0/1446271479 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fa0c80d9040 msgr2=0x7fa0c80b9960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:34.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.390+0000 7fa0d6a679c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:34.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.390+0000 7fa0d6a679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:34.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.390+0000 7fa0d6a679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:34.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.390+0000 7fa0d6a679c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:34.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.390+0000 7fa0d6a679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:34.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.390+0000 7fa0d6a679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:34.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.390+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.390+0000 7fa0d6a679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.390+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 zone default found 2024-09-12T18:01:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 4 Realm: () 2024-09-12T18:01:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 zonegroup default 2024-09-12T18:01:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 started sync module instance, tier type = 2024-09-12T18:01:34.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.394+0000 7fa0d6a679c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:34.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.410+0000 7fa0d6a679c0 20 add_watcher() i=0 2024-09-12T18:01:34.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.410+0000 7fa0d6a679c0 20 add_watcher() i=1 2024-09-12T18:01:34.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.410+0000 7fa0d6a679c0 20 add_watcher() i=2 2024-09-12T18:01:34.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.410+0000 7fa0d6a679c0 20 add_watcher() i=3 2024-09-12T18:01:34.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.410+0000 7fa0d6a679c0 20 add_watcher() i=4 2024-09-12T18:01:34.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.410+0000 7fa0d6a679c0 20 add_watcher() i=5 2024-09-12T18:01:34.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.410+0000 7fa0d6a679c0 20 add_watcher() i=6 2024-09-12T18:01:34.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.410+0000 7fa0d6a679c0 20 add_watcher() i=7 2024-09-12T18:01:34.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.410+0000 7fa0d6a679c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:34.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.410+0000 7f9f8afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:34.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.414+0000 7fa0d6a679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:34.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.414+0000 7fa0d6a679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:34.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.414+0000 7fa0d6a679c0 5 note: GC not initialized 2024-09-12T18:01:34.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.414+0000 7f9f89fdb640 20 reqs_thread_entry: start 2024-09-12T18:01:34.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.414+0000 7fa0d6a679c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:34.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.414+0000 7fa0d6a679c0 20 Filter name: none 2024-09-12T18:01:34.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.414+0000 7f9efb7fe640 20 reqs_thread_entry: start 2024-09-12T18:01:34.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.414+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000000 2024-09-12T18:01:34.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.418+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T18:01:34.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.418+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000001 2024-09-12T18:01:34.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.422+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T18:01:34.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.422+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000002 2024-09-12T18:01:34.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.426+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T18:01:34.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.426+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000003 2024-09-12T18:01:34.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.430+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T18:01:34.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.430+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000004 2024-09-12T18:01:34.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.438+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T18:01:34.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.438+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000005 2024-09-12T18:01:34.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.442+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T18:01:34.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.442+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000006 2024-09-12T18:01:34.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.442+0000 7fa0d6a679c0 20 process_entry resharding a-bucket 2024-09-12T18:01:34.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.442+0000 7fa0d6a679c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:34.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.442+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.442+0000 7fa0d6a679c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:34.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.442+0000 7fa0d6a679c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T18:01:34.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.442+0000 7fa0d6a679c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:34.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.442+0000 7fa0d6a679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:01:34.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.442+0000 7fa0d6a679c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.446+0000 7fa0d6a679c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:34.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.446+0000 7fa0d6a679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:34.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.446+0000 7fa0d6a679c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:34.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.446+0000 7fa0d6a679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:34.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.446+0000 7fa0d6a679c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:34.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.446+0000 7fa0d6a679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:01:34.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.454+0000 7fa0d6a679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:34.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.454+0000 7fa0d6a679c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:34.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.454+0000 7fa0d6a679c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:34.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.454+0000 7fa0d6a679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:01:34.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.454+0000 7f9fab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464285 cookie 94783558558240 notifier 6114 bl.length()=827 2024-09-12T18:01:34.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.454+0000 7f9fab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:34.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.454+0000 7f9fab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:34.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.454+0000 7f9fab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:34.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.458+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:01:34.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.458+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:01:34.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.458+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:01:34.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.458+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:01:34.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.462+0000 7fa0d6a679c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.0 2024-09-12T18:01:34.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.462+0000 7fa0d6a679c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.0 2024-09-12T18:01:34.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.462+0000 7fa0d6a679c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.1 2024-09-12T18:01:34.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.462+0000 7fa0d6a679c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.1 2024-09-12T18:01:34.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.462+0000 7fa0d6a679c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.0 2024-09-12T18:01:34.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.466+0000 7fa0d6a679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:01:34.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.466+0000 7fa0d6a679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:01:34.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.466+0000 7fa0d6a679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:34.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.466+0000 7fa0d6a679c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:34.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.466+0000 7fa0d6a679c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:34.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.466+0000 7fa0d6a679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:01:34.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.470+0000 7f9fab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94783558558240 notifier 6114 bl.length()=827 2024-09-12T18:01:34.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.470+0000 7f9fab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:34.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.470+0000 7f9fab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:34.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.470+0000 7f9fab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:34.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.470+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:01:34.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.470+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:01:34.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.470+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:01:34.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.470+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:01:34.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.474+0000 7fa0d6a679c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.0 2024-09-12T18:01:34.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.474+0000 7fa0d6a679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:01:34.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.474+0000 7fa0d6a679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:01:34.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.474+0000 7fa0d6a679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:34.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.474+0000 7fa0d6a679c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:34.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.474+0000 7fa0d6a679c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:34.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.474+0000 7fa0d6a679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:01:34.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.478+0000 7f9faaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94783558558240 notifier 6114 bl.length()=795 2024-09-12T18:01:34.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.478+0000 7f9faaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:34.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.478+0000 7f9faaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:34.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.478+0000 7f9faaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:34.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.478+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:01:34.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.478+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:01:34.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.478+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:01:34.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.478+0000 7fa0d6a679c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:01:34.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.482+0000 7fa0d6a679c0 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-12T18:01:34.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.482+0000 7fa0d6a679c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T18:01:34.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.490+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T18:01:34.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.490+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000007 2024-09-12T18:01:34.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.494+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T18:01:34.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.494+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000008 2024-09-12T18:01:34.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.498+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T18:01:34.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.498+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000009 2024-09-12T18:01:34.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.506+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T18:01:34.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.506+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000010 2024-09-12T18:01:34.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.510+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T18:01:34.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.510+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000011 2024-09-12T18:01:34.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.518+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T18:01:34.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.518+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000012 2024-09-12T18:01:34.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.526+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T18:01:34.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.526+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000013 2024-09-12T18:01:34.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.530+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T18:01:34.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.530+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000014 2024-09-12T18:01:34.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.534+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T18:01:34.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.534+0000 7fa0d6a679c0 20 processing logshard = reshard.0000000015 2024-09-12T18:01:34.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.542+0000 7fa0d6a679c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T18:01:34.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.542+0000 7f9f8afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:34.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.550+0000 7fa0d6a679c0 20 remove_watcher() i=0 2024-09-12T18:01:34.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.550+0000 7fa0d6a679c0 2 removed watcher, disabling cache 2024-09-12T18:01:34.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.550+0000 7fa0d6a679c0 20 remove_watcher() i=1 2024-09-12T18:01:34.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.554+0000 7fa0d6a679c0 20 remove_watcher() i=2 2024-09-12T18:01:34.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.558+0000 7fa0d6a679c0 20 remove_watcher() i=3 2024-09-12T18:01:34.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.558+0000 7fa0d6a679c0 20 remove_watcher() i=4 2024-09-12T18:01:34.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.562+0000 7fa0d6a679c0 20 remove_watcher() i=5 2024-09-12T18:01:34.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.562+0000 7fa0d6a679c0 20 remove_watcher() i=6 2024-09-12T18:01:34.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:34.566+0000 7fa0d6a679c0 20 remove_watcher() i=7 2024-09-12T18:01:39.590 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:39.624 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:39.624 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:39.672 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.674+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:39.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 20 realm 2024-09-12T18:01:39.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:39.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:39.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:39.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:39.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:39.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.678+0000 7f7d25ebb9c0 20 searching for the correct realm 2024-09-12T18:01:39.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.686+0000 7f7d239c1640 0 -- 172.21.15.157:0/1525516189 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f7d1c124780 msgr2=0x7f7d1c0e3e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:39.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.690+0000 7f7d239c1640 0 -- 172.21.15.157:0/1525516189 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f7d18048970 msgr2=0x7f7d1801c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:39.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.906+0000 7f7d25ebb9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:39.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.906+0000 7f7d25ebb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:39.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.906+0000 7f7d25ebb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:39.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.906+0000 7f7d25ebb9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:39.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.906+0000 7f7d25ebb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:39.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.906+0000 7f7d25ebb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:39.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.906+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.906+0000 7f7d25ebb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:39.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.906+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:39.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:39.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 20 zone default found 2024-09-12T18:01:39.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 4 Realm: () 2024-09-12T18:01:39.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:39.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:39.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:39.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 20 zonegroup default 2024-09-12T18:01:39.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:39.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:39.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.910+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.914+0000 7f7d25ebb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:39.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.914+0000 7f7d25ebb9c0 20 started sync module instance, tier type = 2024-09-12T18:01:39.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.914+0000 7f7d25ebb9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:39.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.934+0000 7f7d25ebb9c0 20 add_watcher() i=0 2024-09-12T18:01:39.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.934+0000 7f7d25ebb9c0 20 add_watcher() i=1 2024-09-12T18:01:39.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.934+0000 7f7d25ebb9c0 20 add_watcher() i=2 2024-09-12T18:01:39.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.934+0000 7f7d25ebb9c0 20 add_watcher() i=3 2024-09-12T18:01:39.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.934+0000 7f7d25ebb9c0 20 add_watcher() i=4 2024-09-12T18:01:39.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.934+0000 7f7d25ebb9c0 20 add_watcher() i=5 2024-09-12T18:01:39.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.938+0000 7f7d25ebb9c0 20 add_watcher() i=6 2024-09-12T18:01:39.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.938+0000 7f7d25ebb9c0 20 add_watcher() i=7 2024-09-12T18:01:39.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.938+0000 7f7d25ebb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:39.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.942+0000 7f7bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:39.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.942+0000 7f7d25ebb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:39.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.942+0000 7f7d25ebb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:39.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.942+0000 7f7d25ebb9c0 5 note: GC not initialized 2024-09-12T18:01:39.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.942+0000 7f7bd8fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:39.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:39.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 Filter name: none 2024-09-12T18:01:39.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7b527fc640 20 reqs_thread_entry: start 2024-09-12T18:01:39.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:39.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:39.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:39.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:39.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:39.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:39.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.946+0000 7f7d25ebb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:39.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.950+0000 7f7bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:39.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.954+0000 7f7d25ebb9c0 20 remove_watcher() i=0 2024-09-12T18:01:39.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.954+0000 7f7d25ebb9c0 2 removed watcher, disabling cache 2024-09-12T18:01:39.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.958+0000 7f7d25ebb9c0 20 remove_watcher() i=1 2024-09-12T18:01:39.957 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.958+0000 7f7d25ebb9c0 20 remove_watcher() i=2 2024-09-12T18:01:39.959 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.962+0000 7f7d25ebb9c0 20 remove_watcher() i=3 2024-09-12T18:01:39.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.962+0000 7f7d25ebb9c0 20 remove_watcher() i=4 2024-09-12T18:01:39.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.966+0000 7f7d25ebb9c0 20 remove_watcher() i=5 2024-09-12T18:01:39.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.966+0000 7f7d25ebb9c0 20 remove_watcher() i=6 2024-09-12T18:01:39.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:39.966+0000 7f7d25ebb9c0 20 remove_watcher() i=7 2024-09-12T18:01:39.982 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:39.982 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:01:39.983 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: a-bucket id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T18:01:39.983 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:39.983 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard add non empty bucket 2024-09-12T18:01:39.983 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:40.669 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:40.701 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:40.702 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:40.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.750+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.750+0000 7f0c98fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.750+0000 7f0c98fdc9c0 20 realm 2024-09-12T18:01:40.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.750+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.754+0000 7f0c98fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.754+0000 7f0c98fdc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:40.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.754+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.754+0000 7f0c98fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.754+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.754+0000 7f0c98fdc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:40.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.754+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.754+0000 7f0c98fdc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:40.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.754+0000 7f0c98fdc9c0 20 searching for the correct realm 2024-09-12T18:01:40.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.758+0000 7f0c962e1640 0 -- 172.21.15.157:0/3047130780 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f0c8c12c910 msgr2=0x7f0c8c0a9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:40.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:40.974+0000 7f0c96ae2640 0 -- 172.21.15.157:0/3047130780 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f0c8c0f36d0 msgr2=0x7f0c8c0be950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:41.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.190+0000 7f0c98fdc9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:41.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.190+0000 7f0c98fdc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:41.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.190+0000 7f0c98fdc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:41.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.190+0000 7f0c98fdc9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:41.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.190+0000 7f0c98fdc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:41.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.190+0000 7f0c98fdc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:41.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.190+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:41.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:41.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 zone default found 2024-09-12T18:01:41.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 4 Realm: () 2024-09-12T18:01:41.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:41.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:41.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:41.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 zonegroup default 2024-09-12T18:01:41.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.194+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.198+0000 7f0c98fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.198+0000 7f0c98fdc9c0 20 started sync module instance, tier type = 2024-09-12T18:01:41.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.198+0000 7f0c98fdc9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:41.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.218+0000 7f0c98fdc9c0 20 add_watcher() i=0 2024-09-12T18:01:41.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.218+0000 7f0c98fdc9c0 20 add_watcher() i=1 2024-09-12T18:01:41.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.218+0000 7f0c98fdc9c0 20 add_watcher() i=2 2024-09-12T18:01:41.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.218+0000 7f0c98fdc9c0 20 add_watcher() i=3 2024-09-12T18:01:41.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.218+0000 7f0c98fdc9c0 20 add_watcher() i=4 2024-09-12T18:01:41.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.218+0000 7f0c98fdc9c0 20 add_watcher() i=5 2024-09-12T18:01:41.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.218+0000 7f0c98fdc9c0 20 add_watcher() i=6 2024-09-12T18:01:41.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.218+0000 7f0c98fdc9c0 20 add_watcher() i=7 2024-09-12T18:01:41.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.218+0000 7f0c98fdc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:41.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.222+0000 7f0b4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:41.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.222+0000 7f0c98fdc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:41.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.222+0000 7f0c98fdc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:41.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.222+0000 7f0c98fdc9c0 5 note: GC not initialized 2024-09-12T18:01:41.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0ac7fff640 20 reqs_thread_entry: start 2024-09-12T18:01:41.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0c98fdc9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:41.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0c98fdc9c0 20 Filter name: none 2024-09-12T18:01:41.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0ac5ffb640 20 reqs_thread_entry: start 2024-09-12T18:01:41.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0c98fdc9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:41.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0c98fdc9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:41.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0c98fdc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:41.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0c98fdc9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:41.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.226+0000 7f0c98fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.230+0000 7f0c98fdc9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:41.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.230+0000 7f0c98fdc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:41.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.230+0000 7f0b4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:41.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.234+0000 7f0c98fdc9c0 20 remove_watcher() i=0 2024-09-12T18:01:41.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.234+0000 7f0c98fdc9c0 2 removed watcher, disabling cache 2024-09-12T18:01:41.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.238+0000 7f0c98fdc9c0 20 remove_watcher() i=1 2024-09-12T18:01:41.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.238+0000 7f0c98fdc9c0 20 remove_watcher() i=2 2024-09-12T18:01:41.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.242+0000 7f0c98fdc9c0 20 remove_watcher() i=3 2024-09-12T18:01:41.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.242+0000 7f0c98fdc9c0 20 remove_watcher() i=4 2024-09-12T18:01:41.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.246+0000 7f0c98fdc9c0 20 remove_watcher() i=5 2024-09-12T18:01:41.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.246+0000 7f0c98fdc9c0 20 remove_watcher() i=6 2024-09-12T18:01:41.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.250+0000 7f0c98fdc9c0 20 remove_watcher() i=7 2024-09-12T18:01:41.263 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:41.263 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:01:41.263 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: a-bucket id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-12T18:01:41.263 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:41.264 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-12T18:01:41.296 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:41.296 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:41.339 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.342+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.342+0000 7f1202b539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.342+0000 7f1202b539c0 20 realm 2024-09-12T18:01:41.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.342+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.342+0000 7f1202b539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.342+0000 7f1202b539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:41.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.342+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.342+0000 7f1202b539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.342+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.343 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.346+0000 7f1202b539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:41.343 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.346+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.344 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.346+0000 7f1202b539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:41.344 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.346+0000 7f1202b539c0 20 searching for the correct realm 2024-09-12T18:01:41.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.350+0000 7f1200e5a640 0 -- 172.21.15.157:0/804498904 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x559daa2775a0 msgr2=0x559daa279a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:41.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.358+0000 7f1200659640 0 -- 172.21.15.157:0/804498904 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f11f40c17a0 msgr2=0x7f11f40f7800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:41.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:41.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:41.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:41.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:41.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:41.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:41.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:41.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:41.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 zone default found 2024-09-12T18:01:41.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 4 Realm: () 2024-09-12T18:01:41.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:41.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:41.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:41.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 zonegroup default 2024-09-12T18:01:41.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 started sync module instance, tier type = 2024-09-12T18:01:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.366+0000 7f1202b539c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:41.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.382+0000 7f1202b539c0 20 add_watcher() i=0 2024-09-12T18:01:41.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.382+0000 7f1202b539c0 20 add_watcher() i=1 2024-09-12T18:01:41.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.382+0000 7f1202b539c0 20 add_watcher() i=2 2024-09-12T18:01:41.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.382+0000 7f1202b539c0 20 add_watcher() i=3 2024-09-12T18:01:41.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.382+0000 7f1202b539c0 20 add_watcher() i=4 2024-09-12T18:01:41.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.382+0000 7f1202b539c0 20 add_watcher() i=5 2024-09-12T18:01:41.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.382+0000 7f1202b539c0 20 add_watcher() i=6 2024-09-12T18:01:41.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.382+0000 7f1202b539c0 20 add_watcher() i=7 2024-09-12T18:01:41.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.382+0000 7f1202b539c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:41.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f10b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:41.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:41.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:41.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 5 note: GC not initialized 2024-09-12T18:01:41.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f10b5fdb640 20 reqs_thread_entry: start 2024-09-12T18:01:41.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:41.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 20 Filter name: none 2024-09-12T18:01:41.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f10277fe640 20 reqs_thread_entry: start 2024-09-12T18:01:41.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:41.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:41.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:41.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:41.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:01:41.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.386+0000 7f1202b539c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.390+0000 7f1202b539c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:41.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.390+0000 7f1202b539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:41.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.390+0000 7f1202b539c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:41.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.390+0000 7f1202b539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:41.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.390+0000 7f1202b539c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:41.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.390+0000 7f1202b539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:01:41.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.390+0000 7f10b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:41.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.394+0000 7f1202b539c0 20 remove_watcher() i=0 2024-09-12T18:01:41.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.394+0000 7f1202b539c0 2 removed watcher, disabling cache 2024-09-12T18:01:41.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.398+0000 7f1202b539c0 20 remove_watcher() i=1 2024-09-12T18:01:41.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.398+0000 7f1202b539c0 20 remove_watcher() i=2 2024-09-12T18:01:41.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.402+0000 7f1202b539c0 20 remove_watcher() i=3 2024-09-12T18:01:41.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.402+0000 7f1202b539c0 20 remove_watcher() i=4 2024-09-12T18:01:41.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.406+0000 7f1202b539c0 20 remove_watcher() i=5 2024-09-12T18:01:41.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.406+0000 7f1202b539c0 20 remove_watcher() i=6 2024-09-12T18:01:41.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.406+0000 7f1202b539c0 20 remove_watcher() i=7 2024-09-12T18:01:41.419 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshard list 2024-09-12T18:01:41.443 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:41.443 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:41.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.690+0000 7f84ba631640 0 --2- 172.21.15.157:0/2610449827 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5579d00cecc0 0x5579d00cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:01:41.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.694+0000 7f84bc32a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.694+0000 7f84bc32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.694+0000 7f84bc32a9c0 20 realm 2024-09-12T18:01:41.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.694+0000 7f84bc32a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.698+0000 7f84bc32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.698+0000 7f84bc32a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:41.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.698+0000 7f84bc32a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.698+0000 7f84bc32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.698+0000 7f84bc32a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.698+0000 7f84bc32a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:41.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.698+0000 7f84bc32a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.698+0000 7f84bc32a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:41.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.698+0000 7f84bc32a9c0 20 searching for the correct realm 2024-09-12T18:01:41.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.702+0000 7f84b9e30640 0 -- 172.21.15.157:0/2610449827 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f84b402d960 msgr2=0x7f84b40163f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:41.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.710+0000 7f84b962f640 0 -- 172.21.15.157:0/2610449827 >> [v2:172.21.15.157:6800/2182114182,v1:172.21.15.157:6801/2182114182] conn(0x5579d00f9d50 msgr2=0x5579d00fc140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:41.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.722+0000 7f84bc32a9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:41.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.722+0000 7f84bc32a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:41.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.722+0000 7f84bc32a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:41.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.722+0000 7f84bc32a9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:41.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.722+0000 7f84bc32a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:41.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.722+0000 7f84bc32a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:41.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.722+0000 7f84bc32a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.722+0000 7f84bc32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.722+0000 7f84bc32a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.722+0000 7f84bc32a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:41.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.722+0000 7f84bc32a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:41.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 20 zone default found 2024-09-12T18:01:41.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 4 Realm: () 2024-09-12T18:01:41.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:41.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:41.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:41.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 20 zonegroup default 2024-09-12T18:01:41.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 20 started sync module instance, tier type = 2024-09-12T18:01:41.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.726+0000 7f84bc32a9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:41.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.746+0000 7f84bc32a9c0 20 add_watcher() i=0 2024-09-12T18:01:41.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.746+0000 7f84bc32a9c0 20 add_watcher() i=1 2024-09-12T18:01:41.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.746+0000 7f84bc32a9c0 20 add_watcher() i=2 2024-09-12T18:01:41.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.746+0000 7f84bc32a9c0 20 add_watcher() i=3 2024-09-12T18:01:41.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.746+0000 7f84bc32a9c0 20 add_watcher() i=4 2024-09-12T18:01:41.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.746+0000 7f84bc32a9c0 20 add_watcher() i=5 2024-09-12T18:01:41.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.746+0000 7f84bc32a9c0 20 add_watcher() i=6 2024-09-12T18:01:41.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.746+0000 7f84bc32a9c0 20 add_watcher() i=7 2024-09-12T18:01:41.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.746+0000 7f84bc32a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:41.747 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.750+0000 7f836b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:41.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.750+0000 7f84bc32a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:41.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.750+0000 7f84bc32a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:41.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.750+0000 7f84bc32a9c0 5 note: GC not initialized 2024-09-12T18:01:41.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.750+0000 7f836a7fc640 20 reqs_thread_entry: start 2024-09-12T18:01:41.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.750+0000 7f84bc32a9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:41.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.750+0000 7f84bc32a9c0 20 Filter name: none 2024-09-12T18:01:41.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.750+0000 7f82dbfff640 20 reqs_thread_entry: start 2024-09-12T18:01:41.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.762+0000 7f836b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:41.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.766+0000 7f84bc32a9c0 20 remove_watcher() i=0 2024-09-12T18:01:41.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.766+0000 7f84bc32a9c0 2 removed watcher, disabling cache 2024-09-12T18:01:41.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.766+0000 7f84bc32a9c0 20 remove_watcher() i=1 2024-09-12T18:01:41.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.770+0000 7f84bc32a9c0 20 remove_watcher() i=2 2024-09-12T18:01:41.769 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.770+0000 7f84bc32a9c0 20 remove_watcher() i=3 2024-09-12T18:01:41.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.774+0000 7f84bc32a9c0 20 remove_watcher() i=4 2024-09-12T18:01:41.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.774+0000 7f84bc32a9c0 20 remove_watcher() i=5 2024-09-12T18:01:41.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.778+0000 7f84bc32a9c0 20 remove_watcher() i=6 2024-09-12T18:01:41.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.778+0000 7f84bc32a9c0 20 remove_watcher() i=7 2024-09-12T18:01:41.790 INFO:tasks.workunit.client.0.smithi157.stderr:bucket name a-bucket 2024-09-12T18:01:41.790 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard process non empty bucket 2024-09-12T18:01:41.790 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:41.791 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshard process 2024-09-12T18:01:41.815 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:41.815 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:41.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.862+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.862+0000 7f8b3986e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.862+0000 7f8b3986e9c0 20 realm 2024-09-12T18:01:41.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.862+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.862+0000 7f8b3986e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.862+0000 7f8b3986e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:41.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.862+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.862+0000 7f8b3986e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.862+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.866+0000 7f8b3986e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:41.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.866+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.866+0000 7f8b3986e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:41.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.866+0000 7f8b3986e9c0 20 searching for the correct realm 2024-09-12T18:01:41.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.870+0000 7f8b37b75640 0 -- 172.21.15.157:0/2743062894 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x55e7346c4d40 msgr2=0x55e7346c7200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:41.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.878+0000 7f8b37374640 0 -- 172.21.15.157:0/2743062894 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f8b2c06cfb0 msgr2=0x7f8b2c04ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:41.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:41.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:41.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:41.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:41.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:41.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:41.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 zone default found 2024-09-12T18:01:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 4 Realm: () 2024-09-12T18:01:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:41.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:41.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:41.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 zonegroup default 2024-09-12T18:01:41.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.886+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.890+0000 7f8b3986e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.890+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.890+0000 7f8b3986e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.890+0000 7f8b3986e9c0 20 started sync module instance, tier type = 2024-09-12T18:01:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.890+0000 7f8b3986e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:41.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.906+0000 7f8b3986e9c0 20 add_watcher() i=0 2024-09-12T18:01:41.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.906+0000 7f8b3986e9c0 20 add_watcher() i=1 2024-09-12T18:01:41.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.906+0000 7f8b3986e9c0 20 add_watcher() i=2 2024-09-12T18:01:41.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.906+0000 7f8b3986e9c0 20 add_watcher() i=3 2024-09-12T18:01:41.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.906+0000 7f8b3986e9c0 20 add_watcher() i=4 2024-09-12T18:01:41.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.906+0000 7f8b3986e9c0 20 add_watcher() i=5 2024-09-12T18:01:41.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.906+0000 7f8b3986e9c0 20 add_watcher() i=6 2024-09-12T18:01:41.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.906+0000 7f8b3986e9c0 20 add_watcher() i=7 2024-09-12T18:01:41.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.906+0000 7f8b3986e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:41.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.910+0000 7f89edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:41.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.910+0000 7f8b3986e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:41.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.910+0000 7f8b3986e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:41.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.910+0000 7f8b3986e9c0 5 note: GC not initialized 2024-09-12T18:01:41.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.910+0000 7f89ecfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:41.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.910+0000 7f8b3986e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:41.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.910+0000 7f8b3986e9c0 20 Filter name: none 2024-09-12T18:01:41.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.910+0000 7f89667fc640 20 reqs_thread_entry: start 2024-09-12T18:01:41.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.910+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000000 2024-09-12T18:01:41.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.914+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T18:01:41.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.914+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000001 2024-09-12T18:01:41.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.918+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T18:01:41.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.918+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000002 2024-09-12T18:01:41.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.922+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T18:01:41.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.922+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000003 2024-09-12T18:01:41.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.930+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T18:01:41.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.930+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000004 2024-09-12T18:01:41.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.934+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T18:01:41.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.934+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000005 2024-09-12T18:01:41.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.938+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T18:01:41.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.938+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000006 2024-09-12T18:01:41.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 20 process_entry resharding a-bucket 2024-09-12T18:01:41.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:41.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:41.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T18:01:41.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:41.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:01:41.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:41.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:41.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:41.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:41.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:41.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.942+0000 7f8b3986e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:01:41.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.954+0000 7f8b3986e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:41.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.954+0000 7f8b3986e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:41.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.954+0000 7f8b3986e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:41.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.954+0000 7f8b3986e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:01:41.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.954+0000 7f8a1a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94451505332448 notifier 6210 bl.length()=827 2024-09-12T18:01:41.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.954+0000 7f8a1a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:41.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.954+0000 7f8a1a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:41.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.954+0000 7f8a1a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:41.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.958+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:01:41.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.958+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:01:41.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.958+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:01:41.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.958+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:01:41.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.962+0000 7f8b3986e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:01:41.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.962+0000 7f8b3986e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:01:41.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.962+0000 7f8b3986e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:01:41.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.962+0000 7f8b3986e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:01:41.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.962+0000 7f8b3986e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:01:41.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.962+0000 7f8b3986e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:01:41.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.962+0000 7f8b3986e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.0 2024-09-12T18:01:41.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.962+0000 7f8b3986e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.0 2024-09-12T18:01:41.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.962+0000 7f8b3986e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.1 2024-09-12T18:01:41.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.962+0000 7f8b3986e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.1 2024-09-12T18:01:41.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.970+0000 7f8b3986e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:01:41.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.970+0000 7f8b3986e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:01:41.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.970+0000 7f8b3986e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:41.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.970+0000 7f8b3986e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:41.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.970+0000 7f8b3986e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:41.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.970+0000 7f8b3986e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:01:41.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.970+0000 7f8a1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 94451505332448 notifier 6210 bl.length()=827 2024-09-12T18:01:41.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.970+0000 7f8a1affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:41.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.970+0000 7f8a1affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:41.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.970+0000 7f8a1affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:41.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.974+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:01:41.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.974+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:01:41.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.974+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:01:41.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.974+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:01:41.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.978+0000 7f8b3986e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.0 2024-09-12T18:01:41.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.978+0000 7f8b3986e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.0 2024-09-12T18:01:41.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.978+0000 7f8b3986e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.1 2024-09-12T18:01:41.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.978+0000 7f8b3986e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.1.1 2024-09-12T18:01:41.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.978+0000 7f8b3986e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:01:41.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.978+0000 7f8b3986e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:01:41.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.978+0000 7f8b3986e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:41.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.978+0000 7f8b3986e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:41.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.978+0000 7f8b3986e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:41.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.978+0000 7f8b3986e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:01:41.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.982+0000 7f8a1a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 94451505332448 notifier 6210 bl.length()=795 2024-09-12T18:01:41.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.982+0000 7f8a1a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:01:41.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.982+0000 7f8a1a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:01:41.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.982+0000 7f8a1a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:41.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.982+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:01:41.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.982+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:01:41.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.982+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:01:41.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.982+0000 7f8b3986e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:01:41.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.986+0000 7f8b3986e9c0 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-12T18:01:41.986 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.990+0000 7f8b3986e9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T18:01:41.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.994+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T18:01:41.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.994+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000007 2024-09-12T18:01:41.996 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.998+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T18:01:41.996 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:41.998+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000008 2024-09-12T18:01:42.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.002+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T18:01:42.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.002+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000009 2024-09-12T18:01:42.008 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.010+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T18:01:42.008 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.010+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000010 2024-09-12T18:01:42.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.014+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T18:01:42.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.014+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000011 2024-09-12T18:01:42.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.018+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T18:01:42.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.018+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000012 2024-09-12T18:01:42.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.026+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T18:01:42.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.026+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000013 2024-09-12T18:01:42.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.034+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T18:01:42.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.034+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000014 2024-09-12T18:01:42.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.038+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T18:01:42.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.038+0000 7f8b3986e9c0 20 processing logshard = reshard.0000000015 2024-09-12T18:01:42.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.046+0000 7f8b3986e9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T18:01:42.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.046+0000 7f89edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:42.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.050+0000 7f8b3986e9c0 20 remove_watcher() i=0 2024-09-12T18:01:42.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.050+0000 7f8b3986e9c0 2 removed watcher, disabling cache 2024-09-12T18:01:42.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.054+0000 7f8b3986e9c0 20 remove_watcher() i=1 2024-09-12T18:01:42.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.054+0000 7f8b3986e9c0 20 remove_watcher() i=2 2024-09-12T18:01:42.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.058+0000 7f8b3986e9c0 20 remove_watcher() i=3 2024-09-12T18:01:42.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.062+0000 7f8b3986e9c0 20 remove_watcher() i=4 2024-09-12T18:01:42.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.062+0000 7f8b3986e9c0 20 remove_watcher() i=5 2024-09-12T18:01:42.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.062+0000 7f8b3986e9c0 20 remove_watcher() i=6 2024-09-12T18:01:42.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.066+0000 7f8b3986e9c0 20 remove_watcher() i=7 2024-09-12T18:01:42.082 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:42.109 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:42.109 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:42.152 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.154+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 20 realm 2024-09-12T18:01:42.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:42.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:42.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:42.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.158+0000 7f0b84c0e9c0 20 searching for the correct realm 2024-09-12T18:01:42.163 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.166+0000 7f0b82f15640 0 -- 172.21.15.157:0/1877169622 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x5618072be8d0 msgr2=0x5618072c0d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:42.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.170+0000 7f0b82714640 0 -- 172.21.15.157:0/1877169622 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f0b6c01db20 msgr2=0x7f0b6c0898f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:42.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:42.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:42.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:42.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:42.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:42.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:42.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:42.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:42.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 zone default found 2024-09-12T18:01:42.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 4 Realm: () 2024-09-12T18:01:42.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:42.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:42.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:42.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 zonegroup default 2024-09-12T18:01:42.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.178+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.182+0000 7f0b84c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.182+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.182+0000 7f0b84c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.182+0000 7f0b84c0e9c0 20 started sync module instance, tier type = 2024-09-12T18:01:42.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.182+0000 7f0b84c0e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:42.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.194+0000 7f0b84c0e9c0 20 add_watcher() i=0 2024-09-12T18:01:42.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.194+0000 7f0b84c0e9c0 20 add_watcher() i=1 2024-09-12T18:01:42.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.194+0000 7f0b84c0e9c0 20 add_watcher() i=2 2024-09-12T18:01:42.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.194+0000 7f0b84c0e9c0 20 add_watcher() i=3 2024-09-12T18:01:42.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.194+0000 7f0b84c0e9c0 20 add_watcher() i=4 2024-09-12T18:01:42.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.194+0000 7f0b84c0e9c0 20 add_watcher() i=5 2024-09-12T18:01:42.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.198+0000 7f0b84c0e9c0 20 add_watcher() i=6 2024-09-12T18:01:42.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.198+0000 7f0b84c0e9c0 20 add_watcher() i=7 2024-09-12T18:01:42.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.198+0000 7f0b84c0e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:42.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.198+0000 7f0a38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:42.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.198+0000 7f0b84c0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:42.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.198+0000 7f0b84c0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:42.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.198+0000 7f0b84c0e9c0 5 note: GC not initialized 2024-09-12T18:01:42.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f09b37fe640 20 reqs_thread_entry: start 2024-09-12T18:01:42.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:42.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 Filter name: none 2024-09-12T18:01:42.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f09b17fa640 20 reqs_thread_entry: start 2024-09-12T18:01:42.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:42.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:42.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:42.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:42.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:42.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.202+0000 7f0b84c0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:42.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.206+0000 7f0a38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:42.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.210+0000 7f0b84c0e9c0 20 remove_watcher() i=0 2024-09-12T18:01:42.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.210+0000 7f0b84c0e9c0 2 removed watcher, disabling cache 2024-09-12T18:01:42.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.210+0000 7f0b84c0e9c0 20 remove_watcher() i=1 2024-09-12T18:01:42.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.214+0000 7f0b84c0e9c0 20 remove_watcher() i=2 2024-09-12T18:01:42.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.214+0000 7f0b84c0e9c0 20 remove_watcher() i=3 2024-09-12T18:01:42.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.218+0000 7f0b84c0e9c0 20 remove_watcher() i=4 2024-09-12T18:01:42.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.218+0000 7f0b84c0e9c0 20 remove_watcher() i=5 2024-09-12T18:01:42.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.222+0000 7f0b84c0e9c0 20 remove_watcher() i=6 2024-09-12T18:01:42.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:42.222+0000 7f0b84c0e9c0 20 remove_watcher() i=7 2024-09-12T18:01:42.234 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:42.234 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:01:42.234 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: a-bucket id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T18:01:42.234 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:42.234 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T18:01:42.234 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:44.302 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:01:44.335 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:44.335 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:44.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.382+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 20 realm 2024-09-12T18:01:44.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:44.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:44.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:44.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.386+0000 7fd8795af9c0 20 searching for the correct realm 2024-09-12T18:01:44.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.394+0000 7fd8768b4640 0 -- 172.21.15.157:0/1181480667 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fd86c0ef060 msgr2=0x7fd86c0ac710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:44.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.398+0000 7fd8768b4640 0 -- 172.21.15.157:0/1181480667 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fd740080880 msgr2=0x7fd740082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:44.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:44.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:44.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:44.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:44.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:44.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:44.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:44.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:44.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 zone default found 2024-09-12T18:01:44.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 4 Realm: () 2024-09-12T18:01:44.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:44.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:44.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:44.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 zonegroup default 2024-09-12T18:01:44.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.406+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.410+0000 7fd8795af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.410+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.410+0000 7fd8795af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.410+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.410+0000 7fd8795af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.410+0000 7fd8795af9c0 20 started sync module instance, tier type = 2024-09-12T18:01:44.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.410+0000 7fd8795af9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:44.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.426+0000 7fd8795af9c0 20 add_watcher() i=0 2024-09-12T18:01:44.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.426+0000 7fd8795af9c0 20 add_watcher() i=1 2024-09-12T18:01:44.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.426+0000 7fd8795af9c0 20 add_watcher() i=2 2024-09-12T18:01:44.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.426+0000 7fd8795af9c0 20 add_watcher() i=3 2024-09-12T18:01:44.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.426+0000 7fd8795af9c0 20 add_watcher() i=4 2024-09-12T18:01:44.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.426+0000 7fd8795af9c0 20 add_watcher() i=5 2024-09-12T18:01:44.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.426+0000 7fd8795af9c0 20 add_watcher() i=6 2024-09-12T18:01:44.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.426+0000 7fd8795af9c0 20 add_watcher() i=7 2024-09-12T18:01:44.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.426+0000 7fd8795af9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:44.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd72dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:44.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd8795af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:44.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd8795af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:44.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd8795af9c0 5 note: GC not initialized 2024-09-12T18:01:44.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd72cfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:44.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd8795af9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:44.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd8795af9c0 20 Filter name: none 2024-09-12T18:01:44.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd6a67fc640 20 reqs_thread_entry: start 2024-09-12T18:01:44.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd8795af9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:44.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd8795af9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:44.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd8795af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:44.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.430+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.434+0000 7fd8795af9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:44.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.434+0000 7fd8795af9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.434+0000 7fd8795af9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:44.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.434+0000 7fd8795af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:44.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.434+0000 7fd72dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:44.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.442+0000 7fd8795af9c0 20 remove_watcher() i=0 2024-09-12T18:01:44.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.442+0000 7fd8795af9c0 2 removed watcher, disabling cache 2024-09-12T18:01:44.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.442+0000 7fd8795af9c0 20 remove_watcher() i=1 2024-09-12T18:01:44.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.446+0000 7fd8795af9c0 20 remove_watcher() i=2 2024-09-12T18:01:44.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.446+0000 7fd8795af9c0 20 remove_watcher() i=3 2024-09-12T18:01:44.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.450+0000 7fd8795af9c0 20 remove_watcher() i=4 2024-09-12T18:01:44.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.450+0000 7fd8795af9c0 20 remove_watcher() i=5 2024-09-12T18:01:44.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.450+0000 7fd8795af9c0 20 remove_watcher() i=6 2024-09-12T18:01:44.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.454+0000 7fd8795af9c0 20 remove_watcher() i=7 2024-09-12T18:01:44.466 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:44.466 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:01:44.466 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-init-index id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:01:44.466 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:44.466 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T18:01:44.498 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:44.498 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:44.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.542+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.546+0000 7f32c96d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.546+0000 7f32c96d89c0 20 realm 2024-09-12T18:01:44.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.546+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.546+0000 7f32c96d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.546+0000 7f32c96d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:44.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.546+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.546+0000 7f32c96d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.546+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.545 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.546+0000 7f32c96d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:44.546 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.546+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.546 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.550+0000 7f32c96d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:44.546 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.550+0000 7f32c96d89c0 20 searching for the correct realm 2024-09-12T18:01:44.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.554+0000 7f32c79df640 0 -- 172.21.15.157:0/4190297873 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55f43bcfe640 msgr2=0x55f43bd00ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:44.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.558+0000 7f32c71de640 0 -- 172.21.15.157:0/4190297873 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f32bc04ab30 msgr2=0x7f32bc06c750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:44.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:44.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:44.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:44.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:44.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:44.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:44.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:44.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:44.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 zone default found 2024-09-12T18:01:44.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 4 Realm: () 2024-09-12T18:01:44.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:44.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:44.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:44.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 zonegroup default 2024-09-12T18:01:44.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.566+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.570+0000 7f32c96d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.570+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.570+0000 7f32c96d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.570+0000 7f32c96d89c0 20 started sync module instance, tier type = 2024-09-12T18:01:44.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.570+0000 7f32c96d89c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:44.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.586+0000 7f32c96d89c0 20 add_watcher() i=0 2024-09-12T18:01:44.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.586+0000 7f32c96d89c0 20 add_watcher() i=1 2024-09-12T18:01:44.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.586+0000 7f32c96d89c0 20 add_watcher() i=2 2024-09-12T18:01:44.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.586+0000 7f32c96d89c0 20 add_watcher() i=3 2024-09-12T18:01:44.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.586+0000 7f32c96d89c0 20 add_watcher() i=4 2024-09-12T18:01:44.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.586+0000 7f32c96d89c0 20 add_watcher() i=5 2024-09-12T18:01:44.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.586+0000 7f32c96d89c0 20 add_watcher() i=6 2024-09-12T18:01:44.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.586+0000 7f32c96d89c0 20 add_watcher() i=7 2024-09-12T18:01:44.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.586+0000 7f32c96d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:44.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f317dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:44.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:44.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:44.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 5 note: GC not initialized 2024-09-12T18:01:44.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f317cfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:44.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:44.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 20 Filter name: none 2024-09-12T18:01:44.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f30f67fc640 20 reqs_thread_entry: start 2024-09-12T18:01:44.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T18:01:44.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:44.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T18:01:44.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T18:01:44.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 : miss 2024-09-12T18:01:44.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.590+0000 7f32c96d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.594+0000 7f32c96d89c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:44.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.594+0000 7f32c96d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 info.flags=0x17 2024-09-12T18:01:44.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.594+0000 7f32c96d89c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 to cache LRU end 2024-09-12T18:01:44.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.594+0000 7f32c96d89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:44.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.594+0000 7f32c96d89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:44.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.594+0000 7f32c96d89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 2024-09-12T18:01:44.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.594+0000 7f32c96d89c0 -1 Injecting error=-5 at location=init_index 2024-09-12T18:01:44.593 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.594+0000 7f32c96d89c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T18:01:44.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.598+0000 7f317dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:44.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.602+0000 7f32c96d89c0 20 remove_watcher() i=0 2024-09-12T18:01:44.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.602+0000 7f32c96d89c0 2 removed watcher, disabling cache 2024-09-12T18:01:44.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.606+0000 7f32c96d89c0 20 remove_watcher() i=1 2024-09-12T18:01:44.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.606+0000 7f32c96d89c0 20 remove_watcher() i=2 2024-09-12T18:01:44.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.610+0000 7f32c96d89c0 20 remove_watcher() i=3 2024-09-12T18:01:44.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.610+0000 7f32c96d89c0 20 remove_watcher() i=4 2024-09-12T18:01:44.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.610+0000 7f32c96d89c0 20 remove_watcher() i=5 2024-09-12T18:01:44.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.614+0000 7f32c96d89c0 20 remove_watcher() i=6 2024-09-12T18:01:44.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.614+0000 7f32c96d89c0 20 remove_watcher() i=7 2024-09-12T18:01:44.626 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:01:44.652 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:44.652 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:44.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.698+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.698+0000 7f54b15b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.698+0000 7f54b15b59c0 20 realm 2024-09-12T18:01:44.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.698+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.698+0000 7f54b15b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.698+0000 7f54b15b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:44.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.698+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.698+0000 7f54b15b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.698+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.702+0000 7f54b15b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:44.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.702+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.702+0000 7f54b15b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:44.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.702+0000 7f54b15b59c0 20 searching for the correct realm 2024-09-12T18:01:44.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.710+0000 7f54af8bc640 0 -- 172.21.15.157:0/3007819588 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f5498008050 msgr2=0x7f5498064600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:44.925 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.926+0000 7f54af0bb640 0 -- 172.21.15.157:0/3007819588 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5574ca83c120 msgr2=0x5574ca83e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:44.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:44.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:44.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:44.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:44.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:44.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:44.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:44.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:44.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 zone default found 2024-09-12T18:01:44.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 4 Realm: () 2024-09-12T18:01:44.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:44.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:44.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:44.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 zonegroup default 2024-09-12T18:01:44.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.934+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.938+0000 7f54b15b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.938+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.938+0000 7f54b15b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.938+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.938+0000 7f54b15b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:44.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.938+0000 7f54b15b59c0 20 started sync module instance, tier type = 2024-09-12T18:01:44.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.938+0000 7f54b15b59c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:44.959 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.962+0000 7f54b15b59c0 20 add_watcher() i=0 2024-09-12T18:01:44.959 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.962+0000 7f54b15b59c0 20 add_watcher() i=1 2024-09-12T18:01:44.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.962+0000 7f54b15b59c0 20 add_watcher() i=2 2024-09-12T18:01:44.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.962+0000 7f54b15b59c0 20 add_watcher() i=3 2024-09-12T18:01:44.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.962+0000 7f54b15b59c0 20 add_watcher() i=4 2024-09-12T18:01:44.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.962+0000 7f54b15b59c0 20 add_watcher() i=5 2024-09-12T18:01:44.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.962+0000 7f54b15b59c0 20 add_watcher() i=6 2024-09-12T18:01:44.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.962+0000 7f54b15b59c0 20 add_watcher() i=7 2024-09-12T18:01:44.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.962+0000 7f54b15b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:44.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.966+0000 7f5365fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:44.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f54b15b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:44.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f54b15b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:44.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f54b15b59c0 5 note: GC not initialized 2024-09-12T18:01:44.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f5364fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:44.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f54b15b59c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:44.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f54b15b59c0 20 Filter name: none 2024-09-12T18:01:44.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f52de7fc640 20 reqs_thread_entry: start 2024-09-12T18:01:44.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f54b15b59c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:44.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f54b15b59c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:44.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f54b15b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:44.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.970+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.974+0000 7f54b15b59c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:44.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.974+0000 7f54b15b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:44.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.974+0000 7f54b15b59c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:44.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.974+0000 7f54b15b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:44.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.978+0000 7f5365fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:44.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.982+0000 7f54b15b59c0 20 remove_watcher() i=0 2024-09-12T18:01:44.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.982+0000 7f54b15b59c0 2 removed watcher, disabling cache 2024-09-12T18:01:44.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.986+0000 7f54b15b59c0 20 remove_watcher() i=1 2024-09-12T18:01:44.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.986+0000 7f54b15b59c0 20 remove_watcher() i=2 2024-09-12T18:01:44.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.990+0000 7f54b15b59c0 20 remove_watcher() i=3 2024-09-12T18:01:44.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.990+0000 7f54b15b59c0 20 remove_watcher() i=4 2024-09-12T18:01:44.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.994+0000 7f54b15b59c0 20 remove_watcher() i=5 2024-09-12T18:01:44.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.994+0000 7f54b15b59c0 20 remove_watcher() i=6 2024-09-12T18:01:44.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:44.994+0000 7f54b15b59c0 20 remove_watcher() i=7 2024-09-12T18:01:45.013 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:45.013 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:01:45.013 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-init-index id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:01:45.013 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:45.120 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:01:45.156 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:45.156 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:45.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.202+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.202+0000 7efd430149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.202+0000 7efd430149c0 20 realm 2024-09-12T18:01:45.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.202+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.202+0000 7efd430149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.202+0000 7efd430149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:45.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.202+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.202+0000 7efd430149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.202+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.206+0000 7efd430149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:45.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.206+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.206+0000 7efd430149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:45.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.206+0000 7efd430149c0 20 searching for the correct realm 2024-09-12T18:01:45.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.214+0000 7efd4131b640 0 -- 172.21.15.157:0/4016847666 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7efd280902b0 msgr2=0x7efd28089a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:45.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.430+0000 7efd40b1a640 0 -- 172.21.15.157:0/4016847666 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5559de7e0fe0 msgr2=0x5559de7e33d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:45.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:45.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:45.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:45.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:45.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:45.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:45.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:45.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:45.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 zone default found 2024-09-12T18:01:45.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 4 Realm: () 2024-09-12T18:01:45.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:45.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:45.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:45.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 zonegroup default 2024-09-12T18:01:45.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.438+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.442+0000 7efd430149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.442+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.442+0000 7efd430149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.442+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.442+0000 7efd430149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.442+0000 7efd430149c0 20 started sync module instance, tier type = 2024-09-12T18:01:45.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.442+0000 7efd430149c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:45.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.466+0000 7efd430149c0 20 add_watcher() i=0 2024-09-12T18:01:45.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.466+0000 7efd430149c0 20 add_watcher() i=1 2024-09-12T18:01:45.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.466+0000 7efd430149c0 20 add_watcher() i=2 2024-09-12T18:01:45.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.466+0000 7efd430149c0 20 add_watcher() i=3 2024-09-12T18:01:45.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.466+0000 7efd430149c0 20 add_watcher() i=4 2024-09-12T18:01:45.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.466+0000 7efd430149c0 20 add_watcher() i=5 2024-09-12T18:01:45.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.466+0000 7efd430149c0 20 add_watcher() i=6 2024-09-12T18:01:45.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.466+0000 7efd430149c0 20 add_watcher() i=7 2024-09-12T18:01:45.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.466+0000 7efd430149c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:45.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efbf6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:45.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:45.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:45.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 5 note: GC not initialized 2024-09-12T18:01:45.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efbf5fe3640 20 reqs_thread_entry: start 2024-09-12T18:01:45.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:45.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 20 Filter name: none 2024-09-12T18:01:45.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efb677fe640 20 reqs_thread_entry: start 2024-09-12T18:01:45.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T18:01:45.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:45.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T18:01:45.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T18:01:45.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 : miss 2024-09-12T18:01:45.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.474+0000 7efd430149c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.478+0000 7efd430149c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:45.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.478+0000 7efd430149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 info.flags=0x17 2024-09-12T18:01:45.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.478+0000 7efd430149c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 to cache LRU end 2024-09-12T18:01:45.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.478+0000 7efd430149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:45.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.478+0000 7efd430149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:45.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.478+0000 7efd430149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 2024-09-12T18:01:45.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.482+0000 7efd430149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 info.flags=0x17 2024-09-12T18:01:45.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.482+0000 7efd430149c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 to cache LRU end 2024-09-12T18:01:45.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.482+0000 7efd430149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:45.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.482+0000 7efd430149c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19, ofs0, ns] 2024-09-12T18:01:45.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.486+0000 7efc17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 93844473305296 notifier 5915 bl.length()=911 2024-09-12T18:01:45.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.486+0000 7efc17fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 info.flags=0x17 2024-09-12T18:01:45.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.486+0000 7efc17fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 to cache LRU end 2024-09-12T18:01:45.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.486+0000 7efc17fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:45.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.486+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): orig_sources= new_sources= 2024-09-12T18:01:45.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.486+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): potential sources added=[] removed=[] 2024-09-12T18:01:45.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.486+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): orig_dests= new_dests= 2024-09-12T18:01:45.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.486+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): potential dests added=[] removed=[] 2024-09-12T18:01:45.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.494+0000 7efd430149c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19.1.0 2024-09-12T18:01:45.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.494+0000 7efd430149c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19.1.0 2024-09-12T18:01:45.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.494+0000 7efd430149c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19.1.1 2024-09-12T18:01:45.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.494+0000 7efd430149c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19.1.1 2024-09-12T18:01:45.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.494+0000 7efd430149c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19.0 2024-09-12T18:01:45.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.498+0000 7efd430149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 : hit (requested=0x17, cached=0x17) 2024-09-12T18:01:45.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.498+0000 7efd430149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 2024-09-12T18:01:45.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.502+0000 7efd430149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 info.flags=0x17 2024-09-12T18:01:45.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.502+0000 7efd430149c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 to cache LRU end 2024-09-12T18:01:45.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.502+0000 7efd430149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:45.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.502+0000 7efd430149c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19, ofs0, ns] 2024-09-12T18:01:45.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.502+0000 7efc17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 93844473305296 notifier 5915 bl.length()=911 2024-09-12T18:01:45.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.502+0000 7efc17fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 info.flags=0x17 2024-09-12T18:01:45.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.502+0000 7efc17fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 to cache LRU end 2024-09-12T18:01:45.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.502+0000 7efc17fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:45.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.506+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): orig_sources= new_sources= 2024-09-12T18:01:45.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.506+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): potential sources added=[] removed=[] 2024-09-12T18:01:45.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.506+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): orig_dests= new_dests= 2024-09-12T18:01:45.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.506+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): potential dests added=[] removed=[] 2024-09-12T18:01:45.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.510+0000 7efd430149c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19.0 2024-09-12T18:01:45.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.510+0000 7efd430149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 : hit (requested=0x17, cached=0x17) 2024-09-12T18:01:45.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.510+0000 7efd430149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 2024-09-12T18:01:45.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efd430149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 info.flags=0x17 2024-09-12T18:01:45.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efd430149c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 to cache LRU end 2024-09-12T18:01:45.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efd430149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:45.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efd430149c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19, ofs0, ns] 2024-09-12T18:01:45.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efc177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 93844473305296 notifier 5915 bl.length()=879 2024-09-12T18:01:45.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efc177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 info.flags=0x17 2024-09-12T18:01:45.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efc177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 to cache LRU end 2024-09-12T18:01:45.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efc177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:45.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): orig_sources= new_sources= 2024-09-12T18:01:45.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): potential sources added=[] removed=[] 2024-09-12T18:01:45.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): orig_dests= new_dests= 2024-09-12T18:01:45.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.514+0000 7efd430149c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19]): potential dests added=[] removed=[] 2024-09-12T18:01:45.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.518+0000 7efd430149c0 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T18:01:45.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.522+0000 7efbf6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:45.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.526+0000 7efd430149c0 20 remove_watcher() i=0 2024-09-12T18:01:45.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.526+0000 7efd430149c0 2 removed watcher, disabling cache 2024-09-12T18:01:45.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.530+0000 7efd430149c0 20 remove_watcher() i=1 2024-09-12T18:01:45.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.534+0000 7efd430149c0 20 remove_watcher() i=2 2024-09-12T18:01:45.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.534+0000 7efd430149c0 20 remove_watcher() i=3 2024-09-12T18:01:45.535 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.538+0000 7efd430149c0 20 remove_watcher() i=4 2024-09-12T18:01:45.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.538+0000 7efd430149c0 20 remove_watcher() i=5 2024-09-12T18:01:45.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.542+0000 7efd430149c0 20 remove_watcher() i=6 2024-09-12T18:01:45.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.542+0000 7efd430149c0 20 remove_watcher() i=7 2024-09-12T18:01:45.559 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:01:45.589 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:45.590 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:45.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.634+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 20 realm 2024-09-12T18:01:45.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:45.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:45.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:45.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.638+0000 7f99900a39c0 20 searching for the correct realm 2024-09-12T18:01:45.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.642+0000 7f998d3a8640 0 -- 172.21.15.157:0/3790585491 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f99840f8340 msgr2=0x7f99840f6db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:45.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.650+0000 7f998dba9640 0 -- 172.21.15.157:0/3790585491 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f99840b8b00 msgr2=0x7f998412d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:45.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.866+0000 7f99900a39c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:45.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.866+0000 7f99900a39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:45.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.866+0000 7f99900a39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:45.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.866+0000 7f99900a39c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:45.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.866+0000 7f99900a39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:45.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.866+0000 7f99900a39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:45.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.866+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.866+0000 7f99900a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.866+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.866+0000 7f99900a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:45.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.866+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:45.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 20 zone default found 2024-09-12T18:01:45.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 4 Realm: () 2024-09-12T18:01:45.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:45.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:45.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:45.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 20 zonegroup default 2024-09-12T18:01:45.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:45.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 20 started sync module instance, tier type = 2024-09-12T18:01:45.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.870+0000 7f99900a39c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:45.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.890+0000 7f99900a39c0 20 add_watcher() i=0 2024-09-12T18:01:45.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.890+0000 7f99900a39c0 20 add_watcher() i=1 2024-09-12T18:01:45.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.890+0000 7f99900a39c0 20 add_watcher() i=2 2024-09-12T18:01:45.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.890+0000 7f99900a39c0 20 add_watcher() i=3 2024-09-12T18:01:45.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.890+0000 7f99900a39c0 20 add_watcher() i=4 2024-09-12T18:01:45.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.890+0000 7f99900a39c0 20 add_watcher() i=5 2024-09-12T18:01:45.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.890+0000 7f99900a39c0 20 add_watcher() i=6 2024-09-12T18:01:45.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.894+0000 7f99900a39c0 20 add_watcher() i=7 2024-09-12T18:01:45.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.894+0000 7f99900a39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:45.895 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.898+0000 7f983f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:45.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.898+0000 7f99900a39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:45.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.898+0000 7f99900a39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:45.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.898+0000 7f99900a39c0 5 note: GC not initialized 2024-09-12T18:01:45.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.898+0000 7f983e7fc640 20 reqs_thread_entry: start 2024-09-12T18:01:45.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.898+0000 7f99900a39c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:45.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.898+0000 7f99900a39c0 20 Filter name: none 2024-09-12T18:01:45.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.898+0000 7f97affff640 20 reqs_thread_entry: start 2024-09-12T18:01:45.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.898+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.902+0000 7f99900a39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:45.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.902+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.902+0000 7f99900a39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:45.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.902+0000 7f99900a39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:45.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.902+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.902+0000 7f99900a39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:45.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.902+0000 7f99900a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:45.902 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.906+0000 7f99900a39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:45.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.906+0000 7f99900a39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:45.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.906+0000 7f983f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:45.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.910+0000 7f99900a39c0 20 remove_watcher() i=0 2024-09-12T18:01:45.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.910+0000 7f99900a39c0 2 removed watcher, disabling cache 2024-09-12T18:01:45.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.914+0000 7f99900a39c0 20 remove_watcher() i=1 2024-09-12T18:01:45.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.914+0000 7f99900a39c0 20 remove_watcher() i=2 2024-09-12T18:01:45.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.918+0000 7f99900a39c0 20 remove_watcher() i=3 2024-09-12T18:01:45.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.918+0000 7f99900a39c0 20 remove_watcher() i=4 2024-09-12T18:01:45.918 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.922+0000 7f99900a39c0 20 remove_watcher() i=5 2024-09-12T18:01:45.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.922+0000 7f99900a39c0 20 remove_watcher() i=6 2024-09-12T18:01:45.921 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:45.922+0000 7f99900a39c0 20 remove_watcher() i=7 2024-09-12T18:01:45.938 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:45.938 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:01:45.938 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-init-index id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:01:45.938 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:46.690 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T18:01:46.691 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:48.832 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:01:48.865 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:48.865 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:49.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.118+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.122+0000 7f18a9db19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.122+0000 7f18a9db19c0 20 realm 2024-09-12T18:01:49.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.122+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.122+0000 7f18a9db19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.122+0000 7f18a9db19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:49.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.122+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.122+0000 7f18a9db19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.122+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.126+0000 7f18a9db19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:49.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.126+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.126+0000 7f18a9db19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:49.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.126+0000 7f18a9db19c0 20 searching for the correct realm 2024-09-12T18:01:49.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.130+0000 7f18a70b6640 0 -- 172.21.15.157:0/3874882628 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f189003a040 msgr2=0x7f189003b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:49.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.138+0000 7f18a78b7640 0 -- 172.21.15.157:0/3874882628 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f189004c3f0 msgr2=0x7f189004c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:49.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.354+0000 7f18a9db19c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:49.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.354+0000 7f18a9db19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:49.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.354+0000 7f18a9db19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:49.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.354+0000 7f18a9db19c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:49.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.354+0000 7f18a9db19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:49.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.354+0000 7f18a9db19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:49.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.354+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.356 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:49.356 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:49.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 20 zone default found 2024-09-12T18:01:49.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 4 Realm: () 2024-09-12T18:01:49.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:49.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:49.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:49.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 20 zonegroup default 2024-09-12T18:01:49.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.358 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.358 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.358+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.358 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.362+0000 7f18a9db19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.358 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.362+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.362+0000 7f18a9db19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.362+0000 7f18a9db19c0 20 started sync module instance, tier type = 2024-09-12T18:01:49.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.362+0000 7f18a9db19c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:49.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.386+0000 7f18a9db19c0 20 add_watcher() i=0 2024-09-12T18:01:49.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.386+0000 7f18a9db19c0 20 add_watcher() i=1 2024-09-12T18:01:49.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.386+0000 7f18a9db19c0 20 add_watcher() i=2 2024-09-12T18:01:49.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.386+0000 7f18a9db19c0 20 add_watcher() i=3 2024-09-12T18:01:49.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.386+0000 7f18a9db19c0 20 add_watcher() i=4 2024-09-12T18:01:49.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.386+0000 7f18a9db19c0 20 add_watcher() i=5 2024-09-12T18:01:49.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.386+0000 7f18a9db19c0 20 add_watcher() i=6 2024-09-12T18:01:49.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.386+0000 7f18a9db19c0 20 add_watcher() i=7 2024-09-12T18:01:49.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.386+0000 7f18a9db19c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:49.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.390+0000 7f175dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:49.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.390+0000 7f18a9db19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:49.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.390+0000 7f18a9db19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:49.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.394+0000 7f18a9db19c0 5 note: GC not initialized 2024-09-12T18:01:49.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.394+0000 7f175cfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:49.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.394+0000 7f18a9db19c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:49.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.394+0000 7f18a9db19c0 20 Filter name: none 2024-09-12T18:01:49.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.394+0000 7f16d67fc640 20 reqs_thread_entry: start 2024-09-12T18:01:49.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.394+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.394+0000 7f18a9db19c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:49.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.394+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.398+0000 7f18a9db19c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:49.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.398+0000 7f18a9db19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:49.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.398+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.398+0000 7f18a9db19c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:49.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.398+0000 7f18a9db19c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.398+0000 7f18a9db19c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:49.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.398+0000 7f18a9db19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:49.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.402+0000 7f175dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:49.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.406+0000 7f18a9db19c0 20 remove_watcher() i=0 2024-09-12T18:01:49.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.406+0000 7f18a9db19c0 2 removed watcher, disabling cache 2024-09-12T18:01:49.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.410+0000 7f18a9db19c0 20 remove_watcher() i=1 2024-09-12T18:01:49.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.414+0000 7f18a9db19c0 20 remove_watcher() i=2 2024-09-12T18:01:49.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.418+0000 7f18a9db19c0 20 remove_watcher() i=3 2024-09-12T18:01:49.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.418+0000 7f18a9db19c0 20 remove_watcher() i=4 2024-09-12T18:01:49.418 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.418+0000 7f18a9db19c0 20 remove_watcher() i=5 2024-09-12T18:01:49.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.422+0000 7f18a9db19c0 20 remove_watcher() i=6 2024-09-12T18:01:49.421 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.422+0000 7f18a9db19c0 20 remove_watcher() i=7 2024-09-12T18:01:49.438 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:49.438 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:01:49.438 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-init-index id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:01:49.438 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:49.438 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T18:01:49.478 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:49.478 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:49.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.522+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 20 realm 2024-09-12T18:01:49.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:49.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.524 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:49.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:49.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.526+0000 7fb56cfca9c0 20 searching for the correct realm 2024-09-12T18:01:49.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.534+0000 7fb56aad0640 0 -- 172.21.15.157:0/2796260190 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7fb564004040 msgr2=0x7fb5640cb700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:49.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.538+0000 7fb56aad0640 0 -- 172.21.15.157:0/2796260190 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fb560099040 msgr2=0x7fb56006a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:49.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.754+0000 7fb56cfca9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:49.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.754+0000 7fb56cfca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:49.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.754+0000 7fb56cfca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:49.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.754+0000 7fb56cfca9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:49.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.754+0000 7fb56cfca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:49.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.754+0000 7fb56cfca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:49.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.754+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.754+0000 7fb56cfca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.754+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:49.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:49.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 zone default found 2024-09-12T18:01:49.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 4 Realm: () 2024-09-12T18:01:49.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:49.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:49.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:49.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 zonegroup default 2024-09-12T18:01:49.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 started sync module instance, tier type = 2024-09-12T18:01:49.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.758+0000 7fb56cfca9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:49.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.790+0000 7fb56cfca9c0 20 add_watcher() i=0 2024-09-12T18:01:49.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.790+0000 7fb56cfca9c0 20 add_watcher() i=1 2024-09-12T18:01:49.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.790+0000 7fb56cfca9c0 20 add_watcher() i=2 2024-09-12T18:01:49.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.790+0000 7fb56cfca9c0 20 add_watcher() i=3 2024-09-12T18:01:49.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.790+0000 7fb56cfca9c0 20 add_watcher() i=4 2024-09-12T18:01:49.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.790+0000 7fb56cfca9c0 20 add_watcher() i=5 2024-09-12T18:01:49.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.790+0000 7fb56cfca9c0 20 add_watcher() i=6 2024-09-12T18:01:49.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.794+0000 7fb56cfca9c0 20 add_watcher() i=7 2024-09-12T18:01:49.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.794+0000 7fb56cfca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:49.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.798+0000 7fb4217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:49.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.798+0000 7fb56cfca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:49.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.798+0000 7fb56cfca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:49.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.798+0000 7fb56cfca9c0 5 note: GC not initialized 2024-09-12T18:01:49.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb39bfff640 20 reqs_thread_entry: start 2024-09-12T18:01:49.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:49.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 20 Filter name: none 2024-09-12T18:01:49.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb399ffb640 20 reqs_thread_entry: start 2024-09-12T18:01:49.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T18:01:49.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:49.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T18:01:49.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T18:01:49.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 : miss 2024-09-12T18:01:49.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:49.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 info.flags=0x17 2024-09-12T18:01:49.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 to cache LRU end 2024-09-12T18:01:49.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:49.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:49.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.802+0000 7fb56cfca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 2024-09-12T18:01:49.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.806+0000 7fb56cfca9c0 -1 Injecting error=-95 at location=init_index 2024-09-12T18:01:49.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.806+0000 7fb56cfca9c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T18:01:49.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.814+0000 7fb56cfca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 info.flags=0x17 2024-09-12T18:01:49.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.814+0000 7fb56cfca9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 to cache LRU end 2024-09-12T18:01:49.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.814+0000 7fb56cfca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:49.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.814+0000 7fb56cfca9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20, ofs0, ns] 2024-09-12T18:01:49.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.814+0000 7fb44e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464303 cookie 94722868541152 notifier 5966 bl.length()=911 2024-09-12T18:01:49.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.814+0000 7fb44e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 info.flags=0x17 2024-09-12T18:01:49.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.814+0000 7fb44e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 to cache LRU end 2024-09-12T18:01:49.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.814+0000 7fb44e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:49.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.818+0000 7fb56cfca9c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20]): orig_sources= new_sources= 2024-09-12T18:01:49.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.818+0000 7fb56cfca9c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20]): potential sources added=[] removed=[] 2024-09-12T18:01:49.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.818+0000 7fb56cfca9c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20]): orig_dests= new_dests= 2024-09-12T18:01:49.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.818+0000 7fb56cfca9c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20]): potential dests added=[] removed=[] 2024-09-12T18:01:49.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.818+0000 7fb56cfca9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20.1.0 2024-09-12T18:01:49.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.818+0000 7fb56cfca9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20.1.0 2024-09-12T18:01:49.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.818+0000 7fb56cfca9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20.1.1 2024-09-12T18:01:49.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.818+0000 7fb56cfca9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20.1.1 2024-09-12T18:01:49.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.818+0000 7fb56cfca9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20.0 2024-09-12T18:01:49.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.826+0000 7fb56cfca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 : hit (requested=0x17, cached=0x17) 2024-09-12T18:01:49.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.826+0000 7fb56cfca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 2024-09-12T18:01:49.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.826+0000 7fb56cfca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 info.flags=0x17 2024-09-12T18:01:49.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.826+0000 7fb56cfca9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 to cache LRU end 2024-09-12T18:01:49.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.826+0000 7fb56cfca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:49.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.826+0000 7fb56cfca9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20, ofs0, ns] 2024-09-12T18:01:49.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.826+0000 7fb44dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94722868541152 notifier 5966 bl.length()=879 2024-09-12T18:01:49.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.826+0000 7fb44dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 info.flags=0x17 2024-09-12T18:01:49.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.830+0000 7fb44dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 to cache LRU end 2024-09-12T18:01:49.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.830+0000 7fb44dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:49.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.830+0000 7fb56cfca9c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20]): orig_sources= new_sources= 2024-09-12T18:01:49.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.830+0000 7fb56cfca9c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20]): potential sources added=[] removed=[] 2024-09-12T18:01:49.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.830+0000 7fb56cfca9c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20]): orig_dests= new_dests= 2024-09-12T18:01:49.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.830+0000 7fb56cfca9c0 20 handle_bi_update(): bucket=:error-at-init-index[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20]): potential dests added=[] removed=[] 2024-09-12T18:01:49.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.834+0000 7fb56cfca9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T18:01:49.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.838+0000 7fb4217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:49.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.846+0000 7fb56cfca9c0 20 remove_watcher() i=0 2024-09-12T18:01:49.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.846+0000 7fb56cfca9c0 2 removed watcher, disabling cache 2024-09-12T18:01:49.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.846+0000 7fb56cfca9c0 20 remove_watcher() i=1 2024-09-12T18:01:49.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.850+0000 7fb56cfca9c0 20 remove_watcher() i=2 2024-09-12T18:01:49.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.850+0000 7fb56cfca9c0 20 remove_watcher() i=3 2024-09-12T18:01:49.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.858+0000 7fb56cfca9c0 20 remove_watcher() i=4 2024-09-12T18:01:49.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.858+0000 7fb56cfca9c0 20 remove_watcher() i=5 2024-09-12T18:01:49.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.858+0000 7fb56cfca9c0 20 remove_watcher() i=6 2024-09-12T18:01:49.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.862+0000 7fb56cfca9c0 20 remove_watcher() i=7 2024-09-12T18:01:49.875 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:01:49.906 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:49.906 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:49.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:49.950+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.158+0000 7fdaf6a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:50.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.158+0000 7fdaf6a949c0 20 realm 2024-09-12T18:01:50.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.158+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.158+0000 7fdaf6a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:50.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.158+0000 7fdaf6a949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:50.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.158+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.158+0000 7fdaf6a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:50.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.158+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.162+0000 7fdaf6a949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:50.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.162+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.162+0000 7fdaf6a949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:50.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.162+0000 7fdaf6a949c0 20 searching for the correct realm 2024-09-12T18:01:50.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.170+0000 7fdaf459a640 0 -- 172.21.15.157:0/4201623933 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7fdaec022040 msgr2=0x7fdaec06d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:50.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.182+0000 7fdaf459a640 0 -- 172.21.15.157:0/4201623933 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fdadc008040 msgr2=0x7fdadc02a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:50.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.398+0000 7fdaf6a949c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:50.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.398+0000 7fdaf6a949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:50.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.398+0000 7fdaf6a949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:50.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.398+0000 7fdaf6a949c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:50.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.398+0000 7fdaf6a949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:50.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.398+0000 7fdaf6a949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:50.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.398+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:50.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:50.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:50.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 zone default found 2024-09-12T18:01:50.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 4 Realm: () 2024-09-12T18:01:50.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:50.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:50.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:50.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 zonegroup default 2024-09-12T18:01:50.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:50.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:50.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.402+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.406+0000 7fdaf6a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:50.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.406+0000 7fdaf6a949c0 20 started sync module instance, tier type = 2024-09-12T18:01:50.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.406+0000 7fdaf6a949c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:50.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.426+0000 7fdaf6a949c0 20 add_watcher() i=0 2024-09-12T18:01:50.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.426+0000 7fdaf6a949c0 20 add_watcher() i=1 2024-09-12T18:01:50.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.426+0000 7fdaf6a949c0 20 add_watcher() i=2 2024-09-12T18:01:50.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.426+0000 7fdaf6a949c0 20 add_watcher() i=3 2024-09-12T18:01:50.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.426+0000 7fdaf6a949c0 20 add_watcher() i=4 2024-09-12T18:01:50.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.426+0000 7fdaf6a949c0 20 add_watcher() i=5 2024-09-12T18:01:50.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.426+0000 7fdaf6a949c0 20 add_watcher() i=6 2024-09-12T18:01:50.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.430+0000 7fdaf6a949c0 20 add_watcher() i=7 2024-09-12T18:01:50.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.430+0000 7fdaf6a949c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:50.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.434+0000 7fd9aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:50.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.434+0000 7fdaf6a949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:50.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.434+0000 7fdaf6a949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:50.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.434+0000 7fdaf6a949c0 5 note: GC not initialized 2024-09-12T18:01:50.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.434+0000 7fd9a9fdb640 20 reqs_thread_entry: start 2024-09-12T18:01:50.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.434+0000 7fdaf6a949c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:50.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.434+0000 7fdaf6a949c0 20 Filter name: none 2024-09-12T18:01:50.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.434+0000 7fd91b7fe640 20 reqs_thread_entry: start 2024-09-12T18:01:50.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.434+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.438+0000 7fdaf6a949c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:50.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.438+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.438+0000 7fdaf6a949c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:50.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.438+0000 7fdaf6a949c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:50.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.438+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.438+0000 7fdaf6a949c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:01:50.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.438+0000 7fdaf6a949c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:50.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.438+0000 7fdaf6a949c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:01:50.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.438+0000 7fdaf6a949c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:50.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.442+0000 7fd9aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:50.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.446+0000 7fdaf6a949c0 20 remove_watcher() i=0 2024-09-12T18:01:50.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.446+0000 7fdaf6a949c0 2 removed watcher, disabling cache 2024-09-12T18:01:50.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.450+0000 7fdaf6a949c0 20 remove_watcher() i=1 2024-09-12T18:01:50.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.450+0000 7fdaf6a949c0 20 remove_watcher() i=2 2024-09-12T18:01:50.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.454+0000 7fdaf6a949c0 20 remove_watcher() i=3 2024-09-12T18:01:50.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.458+0000 7fdaf6a949c0 20 remove_watcher() i=4 2024-09-12T18:01:50.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.458+0000 7fdaf6a949c0 20 remove_watcher() i=5 2024-09-12T18:01:50.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.458+0000 7fdaf6a949c0 20 remove_watcher() i=6 2024-09-12T18:01:50.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:50.462+0000 7fdaf6a949c0 20 remove_watcher() i=7 2024-09-12T18:01:50.476 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:50.476 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:01:50.476 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-init-index id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T18:01:50.476 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:51.225 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T18:01:51.225 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:53.398 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T18:01:53.431 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:53.431 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:53.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.478+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:53.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 20 realm 2024-09-12T18:01:53.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:53.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:53.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:53.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:53.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:53.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.482+0000 7fdb178b09c0 20 searching for the correct realm 2024-09-12T18:01:53.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.490+0000 7fdb15bb7640 0 -- 172.21.15.157:0/3686738418 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x7fd9e00808b0 msgr2=0x7fd9e0082ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:53.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.706+0000 7fdb153b6640 0 -- 172.21.15.157:0/3686738418 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fdb0011abe0 msgr2=0x7fdb00007c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:53.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.718+0000 7fdb178b09c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:53.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.718+0000 7fdb178b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:53.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.718+0000 7fdb178b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:53.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.718+0000 7fdb178b09c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:53.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.718+0000 7fdb178b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:53.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.718+0000 7fdb178b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:53.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.718+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.718+0000 7fdb178b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:53.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.718+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:53.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:53.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 zone default found 2024-09-12T18:01:53.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 4 Realm: () 2024-09-12T18:01:53.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:53.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:53.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:53.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 zonegroup default 2024-09-12T18:01:53.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:53.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:53.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:53.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 started sync module instance, tier type = 2024-09-12T18:01:53.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.722+0000 7fdb178b09c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:53.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.746+0000 7fdb178b09c0 20 add_watcher() i=0 2024-09-12T18:01:53.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.746+0000 7fdb178b09c0 20 add_watcher() i=1 2024-09-12T18:01:53.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.746+0000 7fdb178b09c0 20 add_watcher() i=2 2024-09-12T18:01:53.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.746+0000 7fdb178b09c0 20 add_watcher() i=3 2024-09-12T18:01:53.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.746+0000 7fdb178b09c0 20 add_watcher() i=4 2024-09-12T18:01:53.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.746+0000 7fdb178b09c0 20 add_watcher() i=5 2024-09-12T18:01:53.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.746+0000 7fdb178b09c0 20 add_watcher() i=6 2024-09-12T18:01:53.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.746+0000 7fdb178b09c0 20 add_watcher() i=7 2024-09-12T18:01:53.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.746+0000 7fdb178b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:53.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.750+0000 7fd9cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:53.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.750+0000 7fdb178b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:53.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.750+0000 7fdb178b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:53.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.750+0000 7fdb178b09c0 5 note: GC not initialized 2024-09-12T18:01:53.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fd9cafe5640 20 reqs_thread_entry: start 2024-09-12T18:01:53.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:53.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 Filter name: none 2024-09-12T18:01:53.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fd9c8fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:53.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:01:53.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:01:53.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:53.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:01:53.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:01:53.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.754+0000 7fdb178b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:53.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.758+0000 7fd9cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:53.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.762+0000 7fdb178b09c0 20 remove_watcher() i=0 2024-09-12T18:01:53.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.762+0000 7fdb178b09c0 2 removed watcher, disabling cache 2024-09-12T18:01:53.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.762+0000 7fdb178b09c0 20 remove_watcher() i=1 2024-09-12T18:01:53.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.766+0000 7fdb178b09c0 20 remove_watcher() i=2 2024-09-12T18:01:53.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.770+0000 7fdb178b09c0 20 remove_watcher() i=3 2024-09-12T18:01:53.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.770+0000 7fdb178b09c0 20 remove_watcher() i=4 2024-09-12T18:01:53.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.770+0000 7fdb178b09c0 20 remove_watcher() i=5 2024-09-12T18:01:53.771 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.774+0000 7fdb178b09c0 20 remove_watcher() i=6 2024-09-12T18:01:53.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.774+0000 7fdb178b09c0 20 remove_watcher() i=7 2024-09-12T18:01:53.787 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:53.787 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:01:53.788 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-init-indext id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:01:53.788 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:53.788 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T18:01:53.822 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:53.822 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:53.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:53.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.866+0000 7f812d9519c0 20 realm 2024-09-12T18:01:53.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:53.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.866+0000 7f812d9519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:53.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:53.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.870+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:53.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.870+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:53.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.870+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:53.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.870+0000 7f812d9519c0 20 searching for the correct realm 2024-09-12T18:01:53.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:53.878+0000 7f812bc58640 0 -- 172.21.15.157:0/302883074 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f812006d740 msgr2=0x7f8120097250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:54.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.094+0000 7f812b457640 0 -- 172.21.15.157:0/302883074 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55bc0c375f90 msgr2=0x55bc0c378380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:54.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:54.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:54.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:54.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:54.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:54.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:54.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:54.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:54.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 zone default found 2024-09-12T18:01:54.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 4 Realm: () 2024-09-12T18:01:54.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:54.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:54.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:54.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 zonegroup default 2024-09-12T18:01:54.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 started sync module instance, tier type = 2024-09-12T18:01:54.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.106+0000 7f812d9519c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:54.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=0 2024-09-12T18:01:54.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=1 2024-09-12T18:01:54.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=2 2024-09-12T18:01:54.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=3 2024-09-12T18:01:54.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=4 2024-09-12T18:01:54.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=5 2024-09-12T18:01:54.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=6 2024-09-12T18:01:54.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.130+0000 7f812d9519c0 20 add_watcher() i=7 2024-09-12T18:01:54.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.130+0000 7f812d9519c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:54.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.134+0000 7f7fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:54.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.134+0000 7f812d9519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:54.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.134+0000 7f812d9519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:54.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.134+0000 7f812d9519c0 5 note: GC not initialized 2024-09-12T18:01:54.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.134+0000 7f7fe0fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:54.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.134+0000 7f812d9519c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:54.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.134+0000 7f812d9519c0 20 Filter name: none 2024-09-12T18:01:54.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.134+0000 7f7f5a7fc640 20 reqs_thread_entry: start 2024-09-12T18:01:54.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:01:54.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:01:54.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:01:54.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:01:54.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 : miss 2024-09-12T18:01:54.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:01:54.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 info.flags=0x17 2024-09-12T18:01:54.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to cache LRU end 2024-09-12T18:01:54.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:54.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:54.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.138+0000 7f812d9519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 2024-09-12T18:01:54.138 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f812d9519c0 time 2024-09-12T18:01:54.143501+0000 2024-09-12T18:01:54.138 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:54.139 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:54.139 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f813122b2eb] 2024-09-12T18:01:54.139 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f813122b49f] 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0ada90c1] 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x140f572) [0x55bc0b7fe572] 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc0adbb18d] 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8130091d90] 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f812d9519c0 thread_name:radosgw-admin 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.142+0000 7f812d9519c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f812d9519c0 time 2024-09-12T18:01:54.143501+0000 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:54.140 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.141 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:54.141 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f813122b2eb] 2024-09-12T18:01:54.141 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f813122b49f] 2024-09-12T18:01:54.141 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0ada90c1] 2024-09-12T18:01:54.141 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x140f572) [0x55bc0b7fe572] 2024-09-12T18:01:54.141 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc0adbb18d] 2024-09-12T18:01:54.141 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:01:54.141 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8130091d90] 2024-09-12T18:01:54.141 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:01:54.141 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:01:54.141 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.158 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:54.158 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f81300aa520] 2024-09-12T18:01:54.158 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:01:54.158 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:01:54.158 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:01:54.158 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f813122b345] 2024-09-12T18:01:54.158 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f813122b49f] 2024-09-12T18:01:54.158 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0ada90c1] 2024-09-12T18:01:54.158 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x140f572) [0x55bc0b7fe572] 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc0adbb18d] 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8130091d90] 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.142+0000 7f812d9519c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f812d9519c0 thread_name:radosgw-admin 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f81300aa520] 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:01:54.159 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f813122b345] 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f813122b49f] 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0ada90c1] 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x140f572) [0x55bc0b7fe572] 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc0adbb18d] 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8130091d90] 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:54.160 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): authenticate will time out at 2276.068188s 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): get_auth_request con 0x55bc0c11b040 auth_method 0 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): get_auth_request con 0x55bc0c143c80 auth_method 0 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.161 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_done global_id 6408 payload 274 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient: _finish_hunting 0 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:01:53.846+0000 7f812b457640 1 monclient: found mon.noname-a 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: dump: 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.162 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: _finish_auth 0 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: _check_auth_tickets 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 monclient: authenticate success, global_id 6408 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.163 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:54.164 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: dump: 2024-09-12T18:01:54.164 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.164 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.164 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.164 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.164 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.164 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.164 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.164 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.164 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.164 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.165 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: get_monmap_and_config success 2024-09-12T18:01:54.165 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:01:53.846+0000 7f812d9519c0 4 set_mon_vals no callback set 2024-09-12T18:01:54.165 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: shutdown 2024-09-12T18:01:54.165 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) unregister_commands rotate-key 2024-09-12T18:01:54.165 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: build_initial_monmap 2024-09-12T18:01:54.165 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:01:53.846+0000 7f812d9519c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:54.165 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: monmap: 2024-09-12T18:01:54.165 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:01:54.165 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:54.165 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:01:54.165 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding auth protocol: cephx 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding auth protocol: cephx 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding auth protocol: cephx 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.166 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:01:53.846+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:01:53.846+0000 7f812d9519c0 1 librados: starting msgr at 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:01:53.846+0000 7f812d9519c0 1 librados: starting objecter 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command objecter_requests hook 0x55bc0c28e0a0 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:01:53.846+0000 7f812d9519c0 1 librados: setting wanted keys 2024-09-12T18:01:54.167 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:01:53.846+0000 7f812d9519c0 1 librados: calling monclient init 2024-09-12T18:01:54.168 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: init 2024-09-12T18:01:54.168 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding auth protocol: cephx 2024-09-12T18:01:54.168 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding auth protocol: cephx 2024-09-12T18:01:54.168 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding auth protocol: cephx 2024-09-12T18:01:54.168 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.168 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.168 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.168 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.168 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.168 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.168 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:01:53.846+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:01:53.846+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command rotate-key hook 0x55bc0c289198 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-a con 0x55bc0c11b040 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:01:54.169 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-b con 0x55bc0c143c80 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-c con 0x55bc0c28c270 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): authenticate will time out at 2276.071062s 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): get_auth_request con 0x55bc0c11b040 auth_method 0 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): get_auth_request con 0x55bc0c28c270 auth_method 0 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.170 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_done global_id 6411 payload 824 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient: _finish_hunting 0 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:01:53.846+0000 7f812b457640 1 monclient: found mon.noname-a 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:54.171 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: dump: 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: _finish_auth 0 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: _check_auth_tickets 2024-09-12T18:01:54.172 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:54.173 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.173 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:54.173 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: dump: 2024-09-12T18:01:54.173 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.173 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.173 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.173 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.173 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.173 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.173 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:01:53.846+0000 7f801960a640 4 set_mon_vals no callback set 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:01:53.850+0000 7f812d9519c0 5 monclient: authenticate success, global_id 6411 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:01:53.850+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:01:53.850+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:01:53.850+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:01:53.850+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:01:53.850+0000 7f812d9519c0 1 librados: init done 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:01:53.850+0000 7f8017e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:54.174 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:01:53.850+0000 7f8017e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:01:53.850+0000 7f8017e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:01:53.850+0000 7f812ac56640 10 monclient: get_auth_request con 0x7f8010070ae0 auth_method 0 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:01:53.850+0000 7f812bc58640 10 monclient: get_auth_request con 0x55bc0c2b60c0 auth_method 0 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:01:53.850+0000 7f812b457640 10 monclient: get_auth_request con 0x55bc0c2d3ab0 auth_method 0 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:01:53.854+0000 7f812ac56640 10 monclient: get_auth_request con 0x55bc0c2d7ca0 auth_method 0 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient: build_initial_monmap 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:01:53.854+0000 7f812d9519c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient: monmap: 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:01:54.175 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding auth protocol: cephx 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding auth protocol: cephx 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding auth protocol: cephx 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.176 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:01:53.854+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bc0c2e04e0 EEXIST 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient: init 2024-09-12T18:01:54.177 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding auth protocol: cephx 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding auth protocol: cephx 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding auth protocol: cephx 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.178 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:01:53.854+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:01:53.854+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command rotate-key cmddesc rotate-key hook 0x55bc0c2db250 EEXIST 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-b con 0x55bc0c304690 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-c con 0x55bc0c303fc0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-a con 0x55bc0c3029a0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:54.179 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): authenticate will time out at 2276.079972s 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): get_auth_request con 0x55bc0c303fc0 auth_method 0 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): get_auth_request con 0x55bc0c3029a0 auth_method 0 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.180 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:01:53.858+0000 7f812b457640 10 monclient(hunting): get_auth_request con 0x55bc0c304690 auth_method 0 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:01:53.858+0000 7f812b457640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:01:53.858+0000 7f812b457640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:01:53.858+0000 7f812b457640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): handle_auth_done global_id 6014 payload 824 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient: _finish_hunting 0 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:01:53.858+0000 7f812ac56640 1 monclient: found mon.noname-c 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:54.181 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: dump: 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: _finish_auth 0 2024-09-12T18:01:54.182 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: _check_auth_tickets 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: dump: 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.183 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 monclient: authenticate success, global_id 6014 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:01:53.858+0000 7f812c459640 4 set_mon_vals no callback set 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:01:53.858+0000 7f8015602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:01:53.858+0000 7f8015602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:01:53.858+0000 7f8015602640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:01:53.858+0000 7f812b457640 10 monclient: get_auth_request con 0x7f8004070a20 auth_method 0 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: get_monmap_and_config 2024-09-12T18:01:54.184 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: build_initial_monmap 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:01:53.858+0000 7f812d9519c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: monmap: 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.185 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding auth protocol: cephx 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding auth protocol: cephx 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding auth protocol: cephx 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.186 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:01:53.858+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: init 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding auth protocol: cephx 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding auth protocol: cephx 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding auth protocol: cephx 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.187 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:01:53.858+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:01:53.862+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command rotate-key cmddesc rotate-key hook 0x7fff0ce0ec98 EEXIST 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-b con 0x55bc0c328080 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-a con 0x55bc0c3538e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-c con 0x55bc0c349060 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:01:54.188 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): authenticate will time out at 2276.084142s 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): get_auth_request con 0x55bc0c3538e0 auth_method 0 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): get_auth_request con 0x55bc0c349060 auth_method 0 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.189 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_done global_id 6417 payload 274 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient: _finish_hunting 0 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:01:53.862+0000 7f812ac56640 1 monclient: found mon.noname-a 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient: get_auth_request con 0x55bc0c328080 auth_method 0 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:54.190 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: dump: 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: _finish_auth 0 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: _check_auth_tickets 2024-09-12T18:01:54.191 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: dump: 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.192 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 monclient: authenticate success, global_id 6417 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: get_monmap_and_config success 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:01:53.862+0000 7f812d9519c0 4 set_mon_vals no callback set 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: shutdown 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: build_initial_monmap 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: monmap: 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:54.193 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding auth protocol: cephx 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding auth protocol: cephx 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding auth protocol: cephx 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.194 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:01:53.862+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 librados: starting msgr at 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 librados: starting objecter 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bc0c3278c0 EEXIST 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 librados: setting wanted keys 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 librados: calling monclient init 2024-09-12T18:01:54.195 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: init 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding auth protocol: cephx 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding auth protocol: cephx 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding auth protocol: cephx 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.196 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:01:53.862+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:01:53.862+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command rotate-key cmddesc rotate-key hook 0x55bc0c3065f8 EEXIST 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-c con 0x55bc0c328080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-a con 0x55bc0c349060 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-b con 0x55bc0c3538e0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.197 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): authenticate will time out at 2276.086722s 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): get_auth_request con 0x55bc0c328080 auth_method 0 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): get_auth_request con 0x55bc0c349060 auth_method 0 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.198 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): handle_auth_done global_id 6020 payload 824 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient: _finish_hunting 0 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:01:53.862+0000 7f812b457640 1 monclient: found mon.noname-c 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: dump: 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.199 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: _finish_auth 0 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:54.200 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: dump: 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 monclient: authenticate success, global_id 6020 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:01:53.862+0000 7f800effd640 4 set_mon_vals no callback set 2024-09-12T18:01:54.201 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 librados: init done 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command cr dump hook 0x55bc0c354458 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:01:53.866+0000 7f800d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:01:53.866+0000 7f800d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:01:53.866+0000 7f800d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:01:53.866+0000 7f812ac56640 10 monclient: get_auth_request con 0x7f7ff4070b10 auth_method 0 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:01:53.866+0000 7f812bc58640 10 monclient: get_auth_request con 0x55bc0c371be0 auth_method 0 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.202 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 realm 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:01:53.866+0000 7f812d9519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:01:53.866+0000 7f812b457640 10 monclient: get_auth_request con 0x55bc0c375f90 auth_method 0 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:01:53.870+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:01:53.870+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:01:53.870+0000 7f812ac56640 10 monclient: get_auth_request con 0x55bc0c379740 auth_method 0 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:01:53.870+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:01:53.870+0000 7f812d9519c0 20 searching for the correct realm 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:01:53.870+0000 7f812bc58640 10 monclient: get_auth_request con 0x55bc0c37e500 auth_method 0 2024-09-12T18:01:54.203 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:01:53.870+0000 7f812b457640 10 monclient: get_auth_request con 0x7f812400e3c0 auth_method 0 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:01:53.874+0000 7f812ac56640 10 monclient: get_auth_request con 0x7f8120008040 auth_method 0 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:01:53.878+0000 7f812bc58640 10 monclient: get_auth_request con 0x7f812006d740 auth_method 0 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:01:53.878+0000 7f812bc58640 0 -- 172.21.15.157:0/302883074 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f812006d740 msgr2=0x7f8120097250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:01:54.082+0000 7f812bc58640 10 monclient: get_auth_request con 0x7f812006d740 auth_method 0 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:01:54.090+0000 7f812b457640 10 monclient: get_auth_request con 0x7f8120087ba0 auth_method 0 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:01:54.094+0000 7f812b457640 0 -- 172.21.15.157:0/302883074 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55bc0c375f90 msgr2=0x55bc0c378380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:01:54.094+0000 7f800d7fa640 1 client.6020.objecter ms_handle_reset 0x55bc0c375f90 session 0x55bc0c374e60 osd.5 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:01:54.094+0000 7f800d7fa640 10 monclient: _renew_subs 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:01:54.094+0000 7f800d7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:01:54.094+0000 7f812b457640 10 monclient: get_auth_request con 0x7f7ff4080930 auth_method 0 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:54.204 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 zone default found 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:01:54.106+0000 7f812d9519c0 4 Realm: () 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:01:54.106+0000 7f812d9519c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:54.205 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:01:54.106+0000 7f812d9519c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:01:54.106+0000 7f812d9519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 zonegroup default 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 started sync module instance, tier type = 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=0 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=1 2024-09-12T18:01:54.206 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=2 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=3 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=4 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=5 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=6 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:01:54.130+0000 7f812d9519c0 20 add_watcher() i=7 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:01:54.130+0000 7f812d9519c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding auth protocol: cephx 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding auth protocol: cephx 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding auth protocol: cephx 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.207 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:01:54.134+0000 7f7fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:01:54.134+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:01:54.134+0000 7f812d9519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:01:54.134+0000 7f812d9519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:54.208 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command cache list hook 0x55bc0c325dc0 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command cache inspect hook 0x55bc0c325dc0 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command cache erase hook 0x55bc0c325dc0 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command cache zap hook 0x55bc0c325dc0 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 note: GC not initialized 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:01:54.134+0000 7f7fe0fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command sync trace show hook 0x7f8124012210 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command sync trace history hook 0x7f8124012210 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command sync trace active hook 0x7f8124012210 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command sync trace active_short hook 0x7f8124012210 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:01:54.134+0000 7f812d9519c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:01:54.134+0000 7f812d9519c0 20 Filter name: none 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:01:54.134+0000 7f7f5a7fc640 20 reqs_thread_entry: start 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:01:54.209 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 : miss 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 info.flags=0x17 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to cache LRU end 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:01:54.142+0000 7f812d9519c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f812d9519c0 time 2024-09-12T18:01:54.143501+0000 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:54.210 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f813122b2eb] 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f813122b49f] 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0ada90c1] 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x140f572) [0x55bc0b7fe572] 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc0adbb18d] 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8130091d90] 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:01:54.142+0000 7f812d9519c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f812d9519c0 thread_name:radosgw-admin 2024-09-12T18:01:54.211 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.212 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:54.212 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f81300aa520] 2024-09-12T18:01:54.212 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:01:54.212 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:01:54.212 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:01:54.212 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f813122b345] 2024-09-12T18:01:54.212 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f813122b49f] 2024-09-12T18:01:54.212 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0ada90c1] 2024-09-12T18:01:54.212 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x140f572) [0x55bc0b7fe572] 2024-09-12T18:01:54.212 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc0adbb18d] 2024-09-12T18:01:54.212 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8130091d90] 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:01:54.213 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:01:54.214 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:01:54.215 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:01:54.216 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:01:54.217 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:01:54.218 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:01:54.219 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f5a7fc640 / http_manager 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7fe0fe1640 / http_manager 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7fe1fe3640 / rgw_dt_lg_renew 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 7f800d7fa640 / ms_dispatch 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 7f800effd640 / io_context_pool 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 7f8015602640 / ms_dispatch 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 7f8017e07640 / ms_dispatch 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 7f801960a640 / io_context_pool 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 7f812ac56640 / msgr-worker-2 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 7f812b457640 / msgr-worker-1 2024-09-12T18:01:54.220 INFO:tasks.workunit.client.0.smithi157.stderr: 7f812bc58640 / msgr-worker-0 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr: 7f812c459640 / io_context_pool 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr: 7f812d9519c0 / radosgw-admin 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.81023.log 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): authenticate will time out at 2276.068188s 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): get_auth_request con 0x55bc0c11b040 auth_method 0 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.221 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): get_auth_request con 0x55bc0c143c80 auth_method 0 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:01:53.846+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_done global_id 6408 payload 274 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient: _finish_hunting 0 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:01:53.846+0000 7f812b457640 1 monclient: found mon.noname-a 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:01:54.222 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: dump: 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.223 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: _finish_auth 0 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: _check_auth_tickets 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 monclient: authenticate success, global_id 6408 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:01:53.846+0000 7f801960a640 10 monclient: dump: 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.224 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: get_monmap_and_config success 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:01:53.846+0000 7f812d9519c0 4 set_mon_vals no callback set 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: shutdown 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) unregister_commands rotate-key 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: build_initial_monmap 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:01:53.846+0000 7f812d9519c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: monmap: 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:01:54.225 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding auth protocol: cephx 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding auth protocol: cephx 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding auth protocol: cephx 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.226 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: crc 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c28e5e0) adding con mode: secure 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:01:53.846+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:01:53.846+0000 7f812d9519c0 1 librados: starting msgr at 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:01:53.846+0000 7f812d9519c0 1 librados: starting objecter 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command objecter_requests hook 0x55bc0c28e0a0 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:01:53.846+0000 7f812d9519c0 1 librados: setting wanted keys 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:01:53.846+0000 7f812d9519c0 1 librados: calling monclient init 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: init 2024-09-12T18:01:54.227 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding auth protocol: cephx 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding auth protocol: cephx 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding auth protocol: cephx 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.228 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: crc 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c289050) adding con mode: secure 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:01:53.846+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:01:53.846+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:01:53.846+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command rotate-key hook 0x55bc0c289198 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-a con 0x55bc0c11b040 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-b con 0x55bc0c143c80 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-c con 0x55bc0c28c270 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.229 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:01:53.846+0000 7f812d9519c0 10 monclient(hunting): authenticate will time out at 2276.071062s 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): get_auth_request con 0x55bc0c11b040 auth_method 0 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): get_auth_request con 0x55bc0c28c270 auth_method 0 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.230 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:01:53.846+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient(hunting): handle_auth_done global_id 6411 payload 824 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient: _finish_hunting 0 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:01:53.846+0000 7f812b457640 1 monclient: found mon.noname-a 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:01:53.846+0000 7f812b457640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: dump: 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.231 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: _finish_auth 0 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: _check_auth_tickets 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:01:53.846+0000 7f8017e07640 10 monclient: dump: 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.232 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:01:53.846+0000 7f801960a640 4 set_mon_vals no callback set 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:01:53.850+0000 7f812d9519c0 5 monclient: authenticate success, global_id 6411 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:01:53.850+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:01:53.850+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:01:54.233 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:01:53.850+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:01:53.850+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:01:53.850+0000 7f812d9519c0 1 librados: init done 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:01:53.850+0000 7f8017e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:01:53.850+0000 7f8017e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:01:53.850+0000 7f8017e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:01:53.850+0000 7f812ac56640 10 monclient: get_auth_request con 0x7f8010070ae0 auth_method 0 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:01:53.850+0000 7f812bc58640 10 monclient: get_auth_request con 0x55bc0c2b60c0 auth_method 0 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:01:53.850+0000 7f812b457640 10 monclient: get_auth_request con 0x55bc0c2d3ab0 auth_method 0 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:01:53.854+0000 7f812ac56640 10 monclient: get_auth_request con 0x55bc0c2d7ca0 auth_method 0 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient: build_initial_monmap 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:01:53.854+0000 7f812d9519c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient: monmap: 2024-09-12T18:01:54.234 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding auth protocol: cephx 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding auth protocol: cephx 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding auth protocol: cephx 2024-09-12T18:01:54.235 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: crc 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2dcc00) adding con mode: secure 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:01:53.854+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.236 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bc0c2e04e0 EEXIST 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient: init 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding auth protocol: cephx 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding auth protocol: cephx 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding auth protocol: cephx 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.237 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: crc 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c2db108) adding con mode: secure 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:01:53.854+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:01:53.854+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:01:53.854+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command rotate-key cmddesc rotate-key hook 0x55bc0c2db250 EEXIST 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-b con 0x55bc0c304690 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-c con 0x55bc0c303fc0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-a con 0x55bc0c3029a0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.238 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:01:53.854+0000 7f812d9519c0 10 monclient(hunting): authenticate will time out at 2276.079972s 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): get_auth_request con 0x55bc0c303fc0 auth_method 0 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): get_auth_request con 0x55bc0c3029a0 auth_method 0 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.239 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:01:53.858+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:01:53.858+0000 7f812b457640 10 monclient(hunting): get_auth_request con 0x55bc0c304690 auth_method 0 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:01:53.858+0000 7f812b457640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:01:53.858+0000 7f812b457640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:01:53.858+0000 7f812b457640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient(hunting): handle_auth_done global_id 6014 payload 824 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient: _finish_hunting 0 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:01:53.858+0000 7f812ac56640 1 monclient: found mon.noname-c 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:01:53.858+0000 7f812ac56640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: dump: 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.240 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: _finish_auth 0 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: _check_auth_tickets 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:54.241 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:01:53.858+0000 7f8015602640 10 monclient: dump: 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 monclient: authenticate success, global_id 6014 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:01:53.858+0000 7f812c459640 4 set_mon_vals no callback set 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.242 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:01:53.858+0000 7f8015602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:01:53.858+0000 7f8015602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:01:53.858+0000 7f8015602640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:01:53.858+0000 7f812b457640 10 monclient: get_auth_request con 0x7f8004070a20 auth_method 0 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: get_monmap_and_config 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: build_initial_monmap 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:01:53.858+0000 7f812d9519c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: monmap: 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:54.243 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding auth protocol: cephx 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding auth protocol: cephx 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding auth protocol: cephx 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.244 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: crc 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c324020) adding con mode: secure 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:01:53.858+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:01:53.858+0000 7f812d9519c0 10 monclient: init 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding auth protocol: cephx 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding auth protocol: cephx 2024-09-12T18:01:54.245 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding auth protocol: cephx 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: crc 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:01:53.858+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0eb50) adding con mode: secure 2024-09-12T18:01:54.246 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:01:53.858+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:01:53.862+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command rotate-key cmddesc rotate-key hook 0x7fff0ce0ec98 EEXIST 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-b con 0x55bc0c328080 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-a con 0x55bc0c3538e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-c con 0x55bc0c349060 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): authenticate will time out at 2276.084142s 2024-09-12T18:01:54.247 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): get_auth_request con 0x55bc0c3538e0 auth_method 0 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): get_auth_request con 0x55bc0c349060 auth_method 0 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.248 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:01:53.862+0000 7f812bc58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_done global_id 6417 payload 274 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient: _finish_hunting 0 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:01:53.862+0000 7f812ac56640 1 monclient: found mon.noname-a 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient: get_auth_request con 0x55bc0c328080 auth_method 0 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: dump: 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.249 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: _finish_auth 0 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: _check_auth_tickets 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:01:53.862+0000 7f800effd640 10 monclient: dump: 2024-09-12T18:01:54.250 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 monclient: authenticate success, global_id 6417 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: get_monmap_and_config success 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:01:53.862+0000 7f812d9519c0 4 set_mon_vals no callback set 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: shutdown 2024-09-12T18:01:54.251 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: build_initial_monmap 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: monmap: 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding auth protocol: cephx 2024-09-12T18:01:54.252 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding auth protocol: cephx 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding auth protocol: cephx 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: crc 2024-09-12T18:01:54.253 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c352600) adding con mode: secure 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:01:53.862+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 librados: starting msgr at 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 librados: starting objecter 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bc0c3278c0 EEXIST 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 librados: setting wanted keys 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 librados: calling monclient init 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: init 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding auth protocol: cephx 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding auth protocol: cephx 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding auth protocol: cephx 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.254 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: crc 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 AuthRegistry(0x55bc0c3064b0) adding con mode: secure 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:01:53.862+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:01:53.862+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command rotate-key cmddesc rotate-key hook 0x55bc0c3065f8 EEXIST 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:01:54.255 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-c con 0x55bc0c328080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-a con 0x55bc0c349060 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): picked mon.noname-b con 0x55bc0c3538e0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient(hunting): authenticate will time out at 2276.086722s 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): get_auth_request con 0x55bc0c328080 auth_method 0 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): get_auth_request con 0x55bc0c349060 auth_method 0 2024-09-12T18:01:54.256 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:01:53.862+0000 7f812ac56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient(hunting): handle_auth_done global_id 6020 payload 824 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient: _finish_hunting 0 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:01:53.862+0000 7f812b457640 1 monclient: found mon.noname-c 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:01:53.862+0000 7f812b457640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.257 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: dump: 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: _finish_auth 0 2024-09-12T18:01:54.258 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:01:53.862+0000 7f800d7fa640 10 monclient: dump: 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:01:54.259 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 monclient: authenticate success, global_id 6020 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:01:53.862+0000 7f800effd640 4 set_mon_vals no callback set 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _renew_subs 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:01:53.862+0000 7f812d9519c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:01:53.862+0000 7f812d9519c0 1 librados: init done 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:01:53.862+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command cr dump hook 0x55bc0c354458 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:01:53.866+0000 7f800d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:01:53.866+0000 7f800d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:01:53.866+0000 7f800d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:01:54.260 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:01:53.866+0000 7f812ac56640 10 monclient: get_auth_request con 0x7f7ff4070b10 auth_method 0 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:01:53.866+0000 7f812bc58640 10 monclient: get_auth_request con 0x55bc0c371be0 auth_method 0 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 realm 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:01:53.866+0000 7f812d9519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:01:53.866+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:01:53.866+0000 7f812b457640 10 monclient: get_auth_request con 0x55bc0c375f90 auth_method 0 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:01:53.870+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:01:53.870+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.261 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:01:53.870+0000 7f812ac56640 10 monclient: get_auth_request con 0x55bc0c379740 auth_method 0 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:01:53.870+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:01:53.870+0000 7f812d9519c0 20 searching for the correct realm 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:01:53.870+0000 7f812bc58640 10 monclient: get_auth_request con 0x55bc0c37e500 auth_method 0 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:01:53.870+0000 7f812b457640 10 monclient: get_auth_request con 0x7f812400e3c0 auth_method 0 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:01:53.874+0000 7f812ac56640 10 monclient: get_auth_request con 0x7f8120008040 auth_method 0 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:01:53.878+0000 7f812bc58640 10 monclient: get_auth_request con 0x7f812006d740 auth_method 0 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:01:53.878+0000 7f812bc58640 0 -- 172.21.15.157:0/302883074 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f812006d740 msgr2=0x7f8120097250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:01:54.082+0000 7f812bc58640 10 monclient: get_auth_request con 0x7f812006d740 auth_method 0 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:01:54.090+0000 7f812b457640 10 monclient: get_auth_request con 0x7f8120087ba0 auth_method 0 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:01:54.094+0000 7f812b457640 0 -- 172.21.15.157:0/302883074 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55bc0c375f90 msgr2=0x55bc0c378380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:01:54.094+0000 7f800d7fa640 1 client.6020.objecter ms_handle_reset 0x55bc0c375f90 session 0x55bc0c374e60 osd.5 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:01:54.094+0000 7f800d7fa640 10 monclient: _renew_subs 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:01:54.094+0000 7f800d7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:01:54.262 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:01:54.094+0000 7f812b457640 10 monclient: get_auth_request con 0x7f7ff4080930 auth_method 0 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:01:54.102+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.263 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 zone default found 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:01:54.106+0000 7f812d9519c0 4 Realm: () 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:01:54.106+0000 7f812d9519c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:01:54.106+0000 7f812d9519c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:01:54.106+0000 7f812d9519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 zonegroup default 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 started sync module instance, tier type = 2024-09-12T18:01:54.264 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:01:54.106+0000 7f812d9519c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=0 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=1 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=2 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=3 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=4 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=5 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:01:54.126+0000 7f812d9519c0 20 add_watcher() i=6 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:01:54.130+0000 7f812d9519c0 20 add_watcher() i=7 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:01:54.130+0000 7f812d9519c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding auth protocol: cephx 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding auth protocol: cephx 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding auth protocol: cephx 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.265 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: crc 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 AuthRegistry(0x7fff0ce0f020) adding con mode: secure 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:01:54.134+0000 7f7fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:01:54.134+0000 7f812d9519c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:01:54.134+0000 7f812d9519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:54.266 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:01:54.134+0000 7f812d9519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command cache list hook 0x55bc0c325dc0 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command cache inspect hook 0x55bc0c325dc0 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command cache erase hook 0x55bc0c325dc0 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command cache zap hook 0x55bc0c325dc0 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 note: GC not initialized 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:01:54.134+0000 7f7fe0fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command sync trace show hook 0x7f8124012210 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command sync trace history hook 0x7f8124012210 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command sync trace active hook 0x7f8124012210 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:01:54.134+0000 7f812d9519c0 5 asok(0x55bc0c0812b0) register_command sync trace active_short hook 0x7f8124012210 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:01:54.134+0000 7f812d9519c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:01:54.134+0000 7f812d9519c0 20 Filter name: none 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:01:54.134+0000 7f7f5a7fc640 20 reqs_thread_entry: start 2024-09-12T18:01:54.267 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 : miss 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:01:54.138+0000 7f812d9519c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 info.flags=0x17 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to cache LRU end 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:01:54.138+0000 7f812d9519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 2024-09-12T18:01:54.268 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:01:54.142+0000 7f812d9519c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f812d9519c0 time 2024-09-12T18:01:54.143501+0000 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f813122b2eb] 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f813122b49f] 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0ada90c1] 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x140f572) [0x55bc0b7fe572] 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc0adbb18d] 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8130091d90] 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:01:54.269 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:01:54.142+0000 7f812d9519c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f812d9519c0 thread_name:radosgw-admin 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f81300aa520] 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f813122b345] 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f813122b49f] 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0ada90c1] 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x140f572) [0x55bc0b7fe572] 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc0adbb18d] 2024-09-12T18:01:54.270 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8130091d90] 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:01:54.271 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:01:54.272 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:01:54.273 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:01:54.274 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:01:54.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:01:54.276 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:01:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f5a7fc640 / http_manager 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7fe0fe1640 / http_manager 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7fe1fe3640 / rgw_dt_lg_renew 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f800d7fa640 / ms_dispatch 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f800effd640 / io_context_pool 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f8015602640 / ms_dispatch 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f8017e07640 / ms_dispatch 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f801960a640 / io_context_pool 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f812ac56640 / msgr-worker-2 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f812b457640 / msgr-worker-1 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f812bc58640 / msgr-worker-0 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f812c459640 / io_context_pool 2024-09-12T18:01:54.278 INFO:tasks.workunit.client.0.smithi157.stderr: 7f812d9519c0 / radosgw-admin 2024-09-12T18:01:54.279 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:01:54.279 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:01:54.279 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:01:54.145964Z_68c09556-4c27-4423-8cdf-418a6e7e8153/log 2024-09-12T18:01:54.279 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:01:54.279 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:01:54.279 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T18:01:54.280 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:54.280 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:54.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.226+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.226+0000 7f04f9b8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.226+0000 7f04f9b8e9c0 20 realm 2024-09-12T18:01:54.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.226+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.226+0000 7f04f9b8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.226+0000 7f04f9b8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:54.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.226+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.226+0000 7f04f9b8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.226+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.230+0000 7f04f9b8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:54.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.230+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.230+0000 7f04f9b8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:54.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.230+0000 7f04f9b8e9c0 20 searching for the correct realm 2024-09-12T18:01:54.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.238+0000 7f04f7e95640 0 -- 172.21.15.157:0/3716558375 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f04e0063ac0 msgr2=0x7f04e0089200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:54.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.454+0000 7f04f7694640 0 -- 172.21.15.157:0/3716558375 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5607c5c7c940 msgr2=0x5607c5c7ed30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:54.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.462+0000 7f04f9b8e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:54.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.462+0000 7f04f9b8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:54.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.462+0000 7f04f9b8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:54.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.462+0000 7f04f9b8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:54.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.462+0000 7f04f9b8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:54.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.462+0000 7f04f9b8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:54.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.462+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.462+0000 7f04f9b8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.462+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.462+0000 7f04f9b8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:54.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.462+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 20 zone default found 2024-09-12T18:01:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 4 Realm: () 2024-09-12T18:01:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 20 zonegroup default 2024-09-12T18:01:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 20 started sync module instance, tier type = 2024-09-12T18:01:54.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.466+0000 7f04f9b8e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:54.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.486+0000 7f04f9b8e9c0 20 add_watcher() i=0 2024-09-12T18:01:54.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.486+0000 7f04f9b8e9c0 20 add_watcher() i=1 2024-09-12T18:01:54.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.486+0000 7f04f9b8e9c0 20 add_watcher() i=2 2024-09-12T18:01:54.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.486+0000 7f04f9b8e9c0 20 add_watcher() i=3 2024-09-12T18:01:54.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.486+0000 7f04f9b8e9c0 20 add_watcher() i=4 2024-09-12T18:01:54.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.486+0000 7f04f9b8e9c0 20 add_watcher() i=5 2024-09-12T18:01:54.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.490+0000 7f04f9b8e9c0 20 add_watcher() i=6 2024-09-12T18:01:54.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.490+0000 7f04f9b8e9c0 20 add_watcher() i=7 2024-09-12T18:01:54.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.490+0000 7f04f9b8e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:54.491 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.494+0000 7f03adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:54.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.494+0000 7f04f9b8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:54.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.494+0000 7f04f9b8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:54.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.494+0000 7f04f9b8e9c0 5 note: GC not initialized 2024-09-12T18:01:54.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.494+0000 7f03acfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.494+0000 7f04f9b8e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.494+0000 7f04f9b8e9c0 20 Filter name: none 2024-09-12T18:01:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.494+0000 7f03267fc640 20 reqs_thread_entry: start 2024-09-12T18:01:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.494+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.498+0000 7f04f9b8e9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:01:54.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.498+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.498+0000 7f04f9b8e9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:01:54.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.498+0000 7f04f9b8e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:54.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.498+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.498+0000 7f04f9b8e9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:01:54.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.498+0000 7f04f9b8e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.498+0000 7f04f9b8e9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:01:54.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.498+0000 7f04f9b8e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:54.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.498+0000 7f03adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:54.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.506+0000 7f04f9b8e9c0 20 remove_watcher() i=0 2024-09-12T18:01:54.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.506+0000 7f04f9b8e9c0 2 removed watcher, disabling cache 2024-09-12T18:01:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.506+0000 7f04f9b8e9c0 20 remove_watcher() i=1 2024-09-12T18:01:54.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.510+0000 7f04f9b8e9c0 20 remove_watcher() i=2 2024-09-12T18:01:54.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.510+0000 7f04f9b8e9c0 20 remove_watcher() i=3 2024-09-12T18:01:54.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.514+0000 7f04f9b8e9c0 20 remove_watcher() i=4 2024-09-12T18:01:54.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.514+0000 7f04f9b8e9c0 20 remove_watcher() i=5 2024-09-12T18:01:54.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.514+0000 7f04f9b8e9c0 20 remove_watcher() i=6 2024-09-12T18:01:54.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.518+0000 7f04f9b8e9c0 20 remove_watcher() i=7 2024-09-12T18:01:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.529 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:01:54.530 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-init-indext id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:01:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:01:54.660 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:01:54.696 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:54.696 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:54.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.742+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.742+0000 7f2332e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.742+0000 7f2332e7e9c0 20 realm 2024-09-12T18:01:54.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.742+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.746+0000 7f2332e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.746+0000 7f2332e7e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:54.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.746+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.746+0000 7f2332e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.746+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.746+0000 7f2332e7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:54.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.746+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.746+0000 7f2332e7e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:54.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.746+0000 7f2332e7e9c0 20 searching for the correct realm 2024-09-12T18:01:54.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.754+0000 7f2331185640 0 -- 172.21.15.157:0/2096636020 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f2324025040 msgr2=0x7f2324047450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:54.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.970+0000 7f2330984640 0 -- 172.21.15.157:0/2096636020 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55983b090430 msgr2=0x55983b092820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:54.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.974+0000 7f2332e7e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:01:54.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.974+0000 7f2332e7e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:54.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.974+0000 7f2332e7e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:54.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.974+0000 7f2332e7e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:01:54.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.974+0000 7f2332e7e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:54.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.974+0000 7f2332e7e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:54.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.974+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:54.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:54.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 zone default found 2024-09-12T18:01:54.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 4 Realm: () 2024-09-12T18:01:54.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:01:54.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:01:54.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:54.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 zonegroup default 2024-09-12T18:01:54.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.978+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:54.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.982+0000 7f2332e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:54.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.982+0000 7f2332e7e9c0 20 started sync module instance, tier type = 2024-09-12T18:01:54.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:54.982+0000 7f2332e7e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:01:55.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.002+0000 7f2332e7e9c0 20 add_watcher() i=0 2024-09-12T18:01:55.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.002+0000 7f2332e7e9c0 20 add_watcher() i=1 2024-09-12T18:01:55.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.002+0000 7f2332e7e9c0 20 add_watcher() i=2 2024-09-12T18:01:55.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.002+0000 7f2332e7e9c0 20 add_watcher() i=3 2024-09-12T18:01:55.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.002+0000 7f2332e7e9c0 20 add_watcher() i=4 2024-09-12T18:01:55.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.002+0000 7f2332e7e9c0 20 add_watcher() i=5 2024-09-12T18:01:55.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.002+0000 7f2332e7e9c0 20 add_watcher() i=6 2024-09-12T18:01:55.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.006+0000 7f2332e7e9c0 20 add_watcher() i=7 2024-09-12T18:01:55.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.006+0000 7f2332e7e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:55.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f21e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:55.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:55.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:55.008 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 5 note: GC not initialized 2024-09-12T18:01:55.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f21e5fe3640 20 reqs_thread_entry: start 2024-09-12T18:01:55.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:01:55.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 20 Filter name: none 2024-09-12T18:01:55.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f21577fe640 20 reqs_thread_entry: start 2024-09-12T18:01:55.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:01:55.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:55.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:01:55.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:01:55.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:01:55.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 : miss 2024-09-12T18:01:55.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:55.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:01:55.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 info.flags=0x17 2024-09-12T18:01:55.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to cache LRU end 2024-09-12T18:01:55.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:55.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:55.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.010+0000 7f2332e7e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 2024-09-12T18:01:55.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.014+0000 7f2332e7e9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to be held by another RGW process; skipping for now 2024-09-12T18:01:55.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.014+0000 7f21e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:55.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.018+0000 7f2332e7e9c0 20 remove_watcher() i=0 2024-09-12T18:01:55.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.018+0000 7f2332e7e9c0 2 removed watcher, disabling cache 2024-09-12T18:01:55.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.022+0000 7f2332e7e9c0 20 remove_watcher() i=1 2024-09-12T18:01:55.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.022+0000 7f2332e7e9c0 20 remove_watcher() i=2 2024-09-12T18:01:55.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.026+0000 7f2332e7e9c0 20 remove_watcher() i=3 2024-09-12T18:01:55.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.030+0000 7f2332e7e9c0 20 remove_watcher() i=4 2024-09-12T18:01:55.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.030+0000 7f2332e7e9c0 20 remove_watcher() i=5 2024-09-12T18:01:55.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.030+0000 7f2332e7e9c0 20 remove_watcher() i=6 2024-09-12T18:01:55.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:01:55.034+0000 7f2332e7e9c0 20 remove_watcher() i=7 2024-09-12T18:01:55.045 INFO:tasks.workunit.client.0.smithi157.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:02:25.058 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:02:25.096 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:25.096 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:25.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.141+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.141+0000 7f261eda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.141+0000 7f261eda59c0 20 realm 2024-09-12T18:02:25.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.145+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.145+0000 7f261eda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.145+0000 7f261eda59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:25.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.145+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.145+0000 7f261eda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.145+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.145+0000 7f261eda59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:25.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.145+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.145+0000 7f261eda59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:25.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.145+0000 7f261eda59c0 20 searching for the correct realm 2024-09-12T18:02:25.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.153+0000 7f261d0ac640 0 -- 172.21.15.157:0/3993748569 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f2610083ba0 msgr2=0x7f261007f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:25.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.369+0000 7f261c8ab640 0 -- 172.21.15.157:0/3993748569 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5632b8c95300 msgr2=0x5632b8c97710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:25.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:25.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:25.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:25.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:25.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:25.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:25.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:25.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:25.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 zone default found 2024-09-12T18:02:25.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 4 Realm: () 2024-09-12T18:02:25.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:25.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:25.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:25.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 zonegroup default 2024-09-12T18:02:25.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.377+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.381+0000 7f261eda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.381+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.381+0000 7f261eda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.381+0000 7f261eda59c0 20 started sync module instance, tier type = 2024-09-12T18:02:25.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.381+0000 7f261eda59c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:25.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.401+0000 7f261eda59c0 20 add_watcher() i=0 2024-09-12T18:02:25.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.401+0000 7f261eda59c0 20 add_watcher() i=1 2024-09-12T18:02:25.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.401+0000 7f261eda59c0 20 add_watcher() i=2 2024-09-12T18:02:25.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.401+0000 7f261eda59c0 20 add_watcher() i=3 2024-09-12T18:02:25.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.401+0000 7f261eda59c0 20 add_watcher() i=4 2024-09-12T18:02:25.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.401+0000 7f261eda59c0 20 add_watcher() i=5 2024-09-12T18:02:25.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.401+0000 7f261eda59c0 20 add_watcher() i=6 2024-09-12T18:02:25.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.405+0000 7f261eda59c0 20 add_watcher() i=7 2024-09-12T18:02:25.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.405+0000 7f261eda59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:25.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.405+0000 7f24d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:25.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:25.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:25.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 5 note: GC not initialized 2024-09-12T18:02:25.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f24d1fe3640 20 reqs_thread_entry: start 2024-09-12T18:02:25.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:25.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 20 Filter name: none 2024-09-12T18:02:25.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f24437fe640 20 reqs_thread_entry: start 2024-09-12T18:02:25.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:02:25.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:25.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:02:25.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:02:25.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 : miss 2024-09-12T18:02:25.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:25.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 info.flags=0x17 2024-09-12T18:02:25.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to cache LRU end 2024-09-12T18:02:25.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:25.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:25.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.409+0000 7f261eda59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 2024-09-12T18:02:25.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.417+0000 7f261eda59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 info.flags=0x17 2024-09-12T18:02:25.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.417+0000 7f261eda59c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to cache LRU end 2024-09-12T18:02:25.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.417+0000 7f261eda59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:25.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.417+0000 7f261eda59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21, ofs0, ns] 2024-09-12T18:02:25.418 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.417+0000 7f24f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464307 cookie 94775848609488 notifier 6471 bl.length()=913 2024-09-12T18:02:25.418 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.417+0000 7f24f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 info.flags=0x17 2024-09-12T18:02:25.418 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.417+0000 7f24f3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to cache LRU end 2024-09-12T18:02:25.418 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.417+0000 7f24f3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:25.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.421+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): orig_sources= new_sources= 2024-09-12T18:02:25.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.421+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): potential sources added=[] removed=[] 2024-09-12T18:02:25.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.421+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): orig_dests= new_dests= 2024-09-12T18:02:25.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.421+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): potential dests added=[] removed=[] 2024-09-12T18:02:25.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.425+0000 7f261eda59c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21.1.0 2024-09-12T18:02:25.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.425+0000 7f261eda59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21.1.0 2024-09-12T18:02:25.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.425+0000 7f261eda59c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21.1.1 2024-09-12T18:02:25.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.425+0000 7f261eda59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21.1.1 2024-09-12T18:02:25.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.425+0000 7f261eda59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21.0 2024-09-12T18:02:25.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.429+0000 7f261eda59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:25.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.429+0000 7f261eda59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 2024-09-12T18:02:25.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.433+0000 7f261eda59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 info.flags=0x17 2024-09-12T18:02:25.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.433+0000 7f261eda59c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to cache LRU end 2024-09-12T18:02:25.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.433+0000 7f261eda59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:25.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.433+0000 7f261eda59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21, ofs0, ns] 2024-09-12T18:02:25.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.433+0000 7f24f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464308 cookie 94775848609488 notifier 6471 bl.length()=913 2024-09-12T18:02:25.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.433+0000 7f24f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 info.flags=0x17 2024-09-12T18:02:25.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.433+0000 7f24f3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to cache LRU end 2024-09-12T18:02:25.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.433+0000 7f24f3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:25.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.437+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): orig_sources= new_sources= 2024-09-12T18:02:25.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.437+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): potential sources added=[] removed=[] 2024-09-12T18:02:25.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.437+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): orig_dests= new_dests= 2024-09-12T18:02:25.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.437+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): potential dests added=[] removed=[] 2024-09-12T18:02:25.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.437+0000 7f261eda59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21.0 2024-09-12T18:02:25.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.437+0000 7f261eda59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:25.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.437+0000 7f261eda59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 2024-09-12T18:02:25.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.441+0000 7f261eda59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 info.flags=0x17 2024-09-12T18:02:25.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.441+0000 7f261eda59c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to cache LRU end 2024-09-12T18:02:25.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.441+0000 7f261eda59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:25.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.441+0000 7f261eda59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21, ofs0, ns] 2024-09-12T18:02:25.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.441+0000 7f24f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94775848609488 notifier 6471 bl.length()=881 2024-09-12T18:02:25.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.441+0000 7f24f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 info.flags=0x17 2024-09-12T18:02:25.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.441+0000 7f24f37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 to cache LRU end 2024-09-12T18:02:25.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.441+0000 7f24f37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:25.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.445+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): orig_sources= new_sources= 2024-09-12T18:02:25.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.445+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): potential sources added=[] removed=[] 2024-09-12T18:02:25.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.445+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): orig_dests= new_dests= 2024-09-12T18:02:25.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.445+0000 7f261eda59c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21]): potential dests added=[] removed=[] 2024-09-12T18:02:25.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.445+0000 7f261eda59c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-12T18:02:25.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.449+0000 7f24d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:25.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.453+0000 7f261eda59c0 20 remove_watcher() i=0 2024-09-12T18:02:25.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.453+0000 7f261eda59c0 2 removed watcher, disabling cache 2024-09-12T18:02:25.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.457+0000 7f261eda59c0 20 remove_watcher() i=1 2024-09-12T18:02:25.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.457+0000 7f261eda59c0 20 remove_watcher() i=2 2024-09-12T18:02:25.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.461+0000 7f261eda59c0 20 remove_watcher() i=3 2024-09-12T18:02:25.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.461+0000 7f261eda59c0 20 remove_watcher() i=4 2024-09-12T18:02:25.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.465+0000 7f261eda59c0 20 remove_watcher() i=5 2024-09-12T18:02:25.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.465+0000 7f261eda59c0 20 remove_watcher() i=6 2024-09-12T18:02:25.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.469+0000 7f261eda59c0 20 remove_watcher() i=7 2024-09-12T18:02:25.484 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T18:02:25.515 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:25.515 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:25.558 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.561+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.561+0000 7f9d188199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.561+0000 7f9d188199c0 20 realm 2024-09-12T18:02:25.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.561+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.561+0000 7f9d188199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.561+0000 7f9d188199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:25.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.561+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.561+0000 7f9d188199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.561+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.565+0000 7f9d188199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:25.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.565+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.565+0000 7f9d188199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:25.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.565+0000 7f9d188199c0 20 searching for the correct realm 2024-09-12T18:02:25.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.569+0000 7f9d15b1e640 0 -- 172.21.15.157:0/1149356798 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f9d0c021c40 msgr2=0x7f9d0c032930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:25.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.577+0000 7f9d15b1e640 0 -- 172.21.15.157:0/1149356798 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f9be0080900 msgr2=0x7f9be0082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:25.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:25.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:25.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:25.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:25.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:25.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:25.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:25.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:25.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 zone default found 2024-09-12T18:02:25.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 4 Realm: () 2024-09-12T18:02:25.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:25.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:25.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:25.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 zonegroup default 2024-09-12T18:02:25.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.585+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.589+0000 7f9d188199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.589+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.589+0000 7f9d188199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.589+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.589+0000 7f9d188199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:25.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.589+0000 7f9d188199c0 20 started sync module instance, tier type = 2024-09-12T18:02:25.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.589+0000 7f9d188199c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:25.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.605+0000 7f9d188199c0 20 add_watcher() i=0 2024-09-12T18:02:25.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.605+0000 7f9d188199c0 20 add_watcher() i=1 2024-09-12T18:02:25.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.605+0000 7f9d188199c0 20 add_watcher() i=2 2024-09-12T18:02:25.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.605+0000 7f9d188199c0 20 add_watcher() i=3 2024-09-12T18:02:25.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.605+0000 7f9d188199c0 20 add_watcher() i=4 2024-09-12T18:02:25.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.605+0000 7f9d188199c0 20 add_watcher() i=5 2024-09-12T18:02:25.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.605+0000 7f9d188199c0 20 add_watcher() i=6 2024-09-12T18:02:25.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.605+0000 7f9d188199c0 20 add_watcher() i=7 2024-09-12T18:02:25.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.605+0000 7f9d188199c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:25.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9bccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:25.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:25.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:25.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 5 note: GC not initialized 2024-09-12T18:02:25.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9b477fe640 20 reqs_thread_entry: start 2024-09-12T18:02:25.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:25.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 Filter name: none 2024-09-12T18:02:25.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9b457fa640 20 reqs_thread_entry: start 2024-09-12T18:02:25.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:25.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:25.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:25.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:25.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:25.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:25.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.609+0000 7f9d188199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:25.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.613+0000 7f9bccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:25.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.617+0000 7f9d188199c0 20 remove_watcher() i=0 2024-09-12T18:02:25.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.617+0000 7f9d188199c0 2 removed watcher, disabling cache 2024-09-12T18:02:25.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.617+0000 7f9d188199c0 20 remove_watcher() i=1 2024-09-12T18:02:25.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.621+0000 7f9d188199c0 20 remove_watcher() i=2 2024-09-12T18:02:25.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.621+0000 7f9d188199c0 20 remove_watcher() i=3 2024-09-12T18:02:25.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.625+0000 7f9d188199c0 20 remove_watcher() i=4 2024-09-12T18:02:25.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.625+0000 7f9d188199c0 20 remove_watcher() i=5 2024-09-12T18:02:25.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.625+0000 7f9d188199c0 20 remove_watcher() i=6 2024-09-12T18:02:25.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:25.629+0000 7f9d188199c0 20 remove_watcher() i=7 2024-09-12T18:02:25.640 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:25.640 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:02:25.640 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-init-indext id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:02:25.640 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:26.336 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T18:02:26.336 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:28.485 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:02:28.517 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:28.517 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:28.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.561+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.565+0000 7fbffec6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.565+0000 7fbffec6b9c0 20 realm 2024-09-12T18:02:28.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.565+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.565+0000 7fbffec6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.565+0000 7fbffec6b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:28.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.565+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.565+0000 7fbffec6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.565+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.565+0000 7fbffec6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:28.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.565+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.569+0000 7fbffec6b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:28.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.569+0000 7fbffec6b9c0 20 searching for the correct realm 2024-09-12T18:02:28.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.573+0000 7fbffc771640 0 -- 172.21.15.157:0/378630367 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7fbff40e8360 msgr2=0x7fbff40f9ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:28.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.577+0000 7fbffc771640 0 -- 172.21.15.157:0/378630367 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fbfe4018910 msgr2=0x7fbfe40483e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:28.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:28.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:28.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:28.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:28.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:28.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:28.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:28.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:28.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 zone default found 2024-09-12T18:02:28.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 4 Realm: () 2024-09-12T18:02:28.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:28.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:28.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:28.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 zonegroup default 2024-09-12T18:02:28.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.797+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.801+0000 7fbffec6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.801+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.801+0000 7fbffec6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.801+0000 7fbffec6b9c0 20 started sync module instance, tier type = 2024-09-12T18:02:28.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.801+0000 7fbffec6b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:28.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.825+0000 7fbffec6b9c0 20 add_watcher() i=0 2024-09-12T18:02:28.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.825+0000 7fbffec6b9c0 20 add_watcher() i=1 2024-09-12T18:02:28.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.825+0000 7fbffec6b9c0 20 add_watcher() i=2 2024-09-12T18:02:28.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.825+0000 7fbffec6b9c0 20 add_watcher() i=3 2024-09-12T18:02:28.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.825+0000 7fbffec6b9c0 20 add_watcher() i=4 2024-09-12T18:02:28.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.825+0000 7fbffec6b9c0 20 add_watcher() i=5 2024-09-12T18:02:28.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.825+0000 7fbffec6b9c0 20 add_watcher() i=6 2024-09-12T18:02:28.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.825+0000 7fbffec6b9c0 20 add_watcher() i=7 2024-09-12T18:02:28.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.825+0000 7fbffec6b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:28.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.829+0000 7fbeb2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:28.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.833+0000 7fbffec6b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:28.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.833+0000 7fbffec6b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:28.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.833+0000 7fbffec6b9c0 5 note: GC not initialized 2024-09-12T18:02:28.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.833+0000 7fbeb1fdb640 20 reqs_thread_entry: start 2024-09-12T18:02:28.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.833+0000 7fbffec6b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:28.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.833+0000 7fbffec6b9c0 20 Filter name: none 2024-09-12T18:02:28.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.833+0000 7fbe237fe640 20 reqs_thread_entry: start 2024-09-12T18:02:28.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.833+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.833+0000 7fbffec6b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:28.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.833+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.837+0000 7fbffec6b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:28.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.837+0000 7fbffec6b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:28.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.837+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.837+0000 7fbffec6b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:28.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.837+0000 7fbffec6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.837+0000 7fbffec6b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:28.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.837+0000 7fbffec6b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:28.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.841+0000 7fbeb2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:28.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.845+0000 7fbffec6b9c0 20 remove_watcher() i=0 2024-09-12T18:02:28.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.845+0000 7fbffec6b9c0 2 removed watcher, disabling cache 2024-09-12T18:02:28.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.845+0000 7fbffec6b9c0 20 remove_watcher() i=1 2024-09-12T18:02:28.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.849+0000 7fbffec6b9c0 20 remove_watcher() i=2 2024-09-12T18:02:28.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.849+0000 7fbffec6b9c0 20 remove_watcher() i=3 2024-09-12T18:02:28.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.853+0000 7fbffec6b9c0 20 remove_watcher() i=4 2024-09-12T18:02:28.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.853+0000 7fbffec6b9c0 20 remove_watcher() i=5 2024-09-12T18:02:28.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.857+0000 7fbffec6b9c0 20 remove_watcher() i=6 2024-09-12T18:02:28.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.857+0000 7fbffec6b9c0 20 remove_watcher() i=7 2024-09-12T18:02:28.869 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:28.869 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:02:28.869 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-set-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:02:28.870 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:28.870 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T18:02:28.906 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:28.906 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:28.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.949+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.949+0000 7fe41252a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.949+0000 7fe41252a9c0 20 realm 2024-09-12T18:02:28.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.949+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.949+0000 7fe41252a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.949+0000 7fe41252a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:28.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.949+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.949+0000 7fe41252a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.949+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.953+0000 7fe41252a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:28.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.953+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.953+0000 7fe41252a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:28.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.953+0000 7fe41252a9c0 20 searching for the correct realm 2024-09-12T18:02:28.957 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.957+0000 7fe410831640 0 -- 172.21.15.157:0/2428446617 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x7fe2d8080990 msgr2=0x7fe2d8082dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:28.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.965+0000 7fe410030640 0 -- 172.21.15.157:0/2428446617 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fe404085310 msgr2=0x7fe404095940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:28.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.969+0000 7fe41252a9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:28.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.969+0000 7fe41252a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:28.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.969+0000 7fe41252a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:28.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.969+0000 7fe41252a9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:28.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.969+0000 7fe41252a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:28.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.969+0000 7fe41252a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:28.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.969+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.969+0000 7fe41252a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.969+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:28.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:28.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 zone default found 2024-09-12T18:02:28.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 4 Realm: () 2024-09-12T18:02:28.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:28.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:28.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:28.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 zonegroup default 2024-09-12T18:02:28.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:28.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 started sync module instance, tier type = 2024-09-12T18:02:28.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.973+0000 7fe41252a9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:28.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.989+0000 7fe41252a9c0 20 add_watcher() i=0 2024-09-12T18:02:28.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.989+0000 7fe41252a9c0 20 add_watcher() i=1 2024-09-12T18:02:28.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.989+0000 7fe41252a9c0 20 add_watcher() i=2 2024-09-12T18:02:28.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.989+0000 7fe41252a9c0 20 add_watcher() i=3 2024-09-12T18:02:28.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.989+0000 7fe41252a9c0 20 add_watcher() i=4 2024-09-12T18:02:28.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.989+0000 7fe41252a9c0 20 add_watcher() i=5 2024-09-12T18:02:28.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.989+0000 7fe41252a9c0 20 add_watcher() i=6 2024-09-12T18:02:28.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.989+0000 7fe41252a9c0 20 add_watcher() i=7 2024-09-12T18:02:28.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.989+0000 7fe41252a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:28.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe2c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:28.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:28.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:28.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 5 note: GC not initialized 2024-09-12T18:02:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe2c5fdb640 20 reqs_thread_entry: start 2024-09-12T18:02:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 20 Filter name: none 2024-09-12T18:02:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe2377fe640 20 reqs_thread_entry: start 2024-09-12T18:02:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T18:02:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T18:02:28.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T18:02:28.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 : miss 2024-09-12T18:02:28.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:28.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:28.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 info.flags=0x17 2024-09-12T18:02:28.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 to cache LRU end 2024-09-12T18:02:28.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:28.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:28.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.993+0000 7fe41252a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 2024-09-12T18:02:28.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.997+0000 7fe41252a9c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T18:02:28.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:28.997+0000 7fe41252a9c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T18:02:29.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.001+0000 7fe2c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:29.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.005+0000 7fe41252a9c0 20 remove_watcher() i=0 2024-09-12T18:02:29.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.005+0000 7fe41252a9c0 2 removed watcher, disabling cache 2024-09-12T18:02:29.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.009+0000 7fe41252a9c0 20 remove_watcher() i=1 2024-09-12T18:02:29.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.009+0000 7fe41252a9c0 20 remove_watcher() i=2 2024-09-12T18:02:29.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.013+0000 7fe41252a9c0 20 remove_watcher() i=3 2024-09-12T18:02:29.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.013+0000 7fe41252a9c0 20 remove_watcher() i=4 2024-09-12T18:02:29.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.017+0000 7fe41252a9c0 20 remove_watcher() i=5 2024-09-12T18:02:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.017+0000 7fe41252a9c0 20 remove_watcher() i=6 2024-09-12T18:02:29.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.017+0000 7fe41252a9c0 20 remove_watcher() i=7 2024-09-12T18:02:29.030 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:02:29.056 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:29.056 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:29.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.101+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.101+0000 7f4c47e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.101+0000 7f4c47e029c0 20 realm 2024-09-12T18:02:29.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.101+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.101+0000 7f4c47e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.101+0000 7f4c47e029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:29.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.101+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.101+0000 7f4c47e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.101+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.105+0000 7f4c47e029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:29.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.105+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.105+0000 7f4c47e029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:29.104 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.105+0000 7f4c47e029c0 20 searching for the correct realm 2024-09-12T18:02:29.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.109+0000 7f4c45107640 0 -- 172.21.15.157:0/4056757275 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f4c3c008050 msgr2=0x7f4c3c05b4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:29.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.113+0000 7f4c45908640 0 -- 172.21.15.157:0/4056757275 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f4c3c067c20 msgr2=0x7f4c3c07d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:29.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.329+0000 7f4c47e029c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:29.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.329+0000 7f4c47e029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:29.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.329+0000 7f4c47e029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:29.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.329+0000 7f4c47e029c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:29.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.329+0000 7f4c47e029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:29.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.329+0000 7f4c47e029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:29.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.329+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.329+0000 7f4c47e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.329+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:29.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.331 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:29.331 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 zone default found 2024-09-12T18:02:29.331 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 4 Realm: () 2024-09-12T18:02:29.331 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:29.331 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:29.331 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:29.331 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 zonegroup default 2024-09-12T18:02:29.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 started sync module instance, tier type = 2024-09-12T18:02:29.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.333+0000 7f4c47e029c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:29.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.357+0000 7f4c47e029c0 20 add_watcher() i=0 2024-09-12T18:02:29.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.357+0000 7f4c47e029c0 20 add_watcher() i=1 2024-09-12T18:02:29.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.357+0000 7f4c47e029c0 20 add_watcher() i=2 2024-09-12T18:02:29.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.357+0000 7f4c47e029c0 20 add_watcher() i=3 2024-09-12T18:02:29.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.357+0000 7f4c47e029c0 20 add_watcher() i=4 2024-09-12T18:02:29.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.357+0000 7f4c47e029c0 20 add_watcher() i=5 2024-09-12T18:02:29.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.357+0000 7f4c47e029c0 20 add_watcher() i=6 2024-09-12T18:02:29.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.357+0000 7f4c47e029c0 20 add_watcher() i=7 2024-09-12T18:02:29.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.357+0000 7f4c47e029c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:29.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.361+0000 7f4af77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:29.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.361+0000 7f4c47e029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:29.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.361+0000 7f4c47e029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:29.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.361+0000 7f4c47e029c0 5 note: GC not initialized 2024-09-12T18:02:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4af67fc640 20 reqs_thread_entry: start 2024-09-12T18:02:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4c47e029c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4c47e029c0 20 Filter name: none 2024-09-12T18:02:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4a67fff640 20 reqs_thread_entry: start 2024-09-12T18:02:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4c47e029c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:29.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4c47e029c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:29.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4c47e029c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:29.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4c47e029c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:29.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.365+0000 7f4c47e029c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.369+0000 7f4c47e029c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:29.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.369+0000 7f4c47e029c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:29.369 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.369+0000 7f4af77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:29.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.377+0000 7f4c47e029c0 20 remove_watcher() i=0 2024-09-12T18:02:29.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.377+0000 7f4c47e029c0 2 removed watcher, disabling cache 2024-09-12T18:02:29.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.377+0000 7f4c47e029c0 20 remove_watcher() i=1 2024-09-12T18:02:29.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.381+0000 7f4c47e029c0 20 remove_watcher() i=2 2024-09-12T18:02:29.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.381+0000 7f4c47e029c0 20 remove_watcher() i=3 2024-09-12T18:02:29.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.385+0000 7f4c47e029c0 20 remove_watcher() i=4 2024-09-12T18:02:29.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.385+0000 7f4c47e029c0 20 remove_watcher() i=5 2024-09-12T18:02:29.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.389+0000 7f4c47e029c0 20 remove_watcher() i=6 2024-09-12T18:02:29.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.389+0000 7f4c47e029c0 20 remove_watcher() i=7 2024-09-12T18:02:29.407 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:29.408 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:02:29.408 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-set-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:02:29.408 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:29.524 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:02:29.560 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:29.560 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:29.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.605+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.605+0000 7fb23c0da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.605+0000 7fb23c0da9c0 20 realm 2024-09-12T18:02:29.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.605+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.605+0000 7fb23c0da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.605+0000 7fb23c0da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:29.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.609+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.609+0000 7fb23c0da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.609+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.609+0000 7fb23c0da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:29.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.609+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.609+0000 7fb23c0da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:29.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.609+0000 7fb23c0da9c0 20 searching for the correct realm 2024-09-12T18:02:29.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.617+0000 7fb23a3e1640 0 -- 172.21.15.157:0/3148048640 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fb23002ab20 msgr2=0x7fb230017910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:29.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.833+0000 7fb239be0640 0 -- 172.21.15.157:0/3148048640 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55bdf388e090 msgr2=0x55bdf3890480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:29.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.841+0000 7fb23c0da9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:29.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.841+0000 7fb23c0da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:29.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.841+0000 7fb23c0da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:29.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.841+0000 7fb23c0da9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:29.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.841+0000 7fb23c0da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:29.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.841+0000 7fb23c0da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:29.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.841+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.841+0000 7fb23c0da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.841+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:29.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:29.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 zone default found 2024-09-12T18:02:29.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 4 Realm: () 2024-09-12T18:02:29.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:29.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:29.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:29.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 zonegroup default 2024-09-12T18:02:29.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:29.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 started sync module instance, tier type = 2024-09-12T18:02:29.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.845+0000 7fb23c0da9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:29.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.869+0000 7fb23c0da9c0 20 add_watcher() i=0 2024-09-12T18:02:29.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.869+0000 7fb23c0da9c0 20 add_watcher() i=1 2024-09-12T18:02:29.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.869+0000 7fb23c0da9c0 20 add_watcher() i=2 2024-09-12T18:02:29.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.869+0000 7fb23c0da9c0 20 add_watcher() i=3 2024-09-12T18:02:29.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.869+0000 7fb23c0da9c0 20 add_watcher() i=4 2024-09-12T18:02:29.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.869+0000 7fb23c0da9c0 20 add_watcher() i=5 2024-09-12T18:02:29.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.869+0000 7fb23c0da9c0 20 add_watcher() i=6 2024-09-12T18:02:29.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.869+0000 7fb23c0da9c0 20 add_watcher() i=7 2024-09-12T18:02:29.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.869+0000 7fb23c0da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:29.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.873+0000 7fb0eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:29.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.873+0000 7fb23c0da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:29.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.873+0000 7fb23c0da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:29.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.873+0000 7fb23c0da9c0 5 note: GC not initialized 2024-09-12T18:02:29.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.873+0000 7fb0ea7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:29.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.873+0000 7fb23c0da9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:29.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.873+0000 7fb23c0da9c0 20 Filter name: none 2024-09-12T18:02:29.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.873+0000 7fb05bfff640 20 reqs_thread_entry: start 2024-09-12T18:02:29.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T18:02:29.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:29.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T18:02:29.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T18:02:29.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 : miss 2024-09-12T18:02:29.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:29.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:29.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 info.flags=0x17 2024-09-12T18:02:29.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 to cache LRU end 2024-09-12T18:02:29.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:29.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:29.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.877+0000 7fb23c0da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 2024-09-12T18:02:29.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.885+0000 7fb23c0da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 info.flags=0x17 2024-09-12T18:02:29.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.885+0000 7fb23c0da9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 to cache LRU end 2024-09-12T18:02:29.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.885+0000 7fb23c0da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:29.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.885+0000 7fb23c0da9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22, ofs0, ns] 2024-09-12T18:02:29.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.885+0000 7fb11d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94274323059920 notifier 6570 bl.length()=925 2024-09-12T18:02:29.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.885+0000 7fb11d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 info.flags=0x17 2024-09-12T18:02:29.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.885+0000 7fb11d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 to cache LRU end 2024-09-12T18:02:29.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.885+0000 7fb11d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:29.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.889+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): orig_sources= new_sources= 2024-09-12T18:02:29.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.889+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): potential sources added=[] removed=[] 2024-09-12T18:02:29.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.889+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): orig_dests= new_dests= 2024-09-12T18:02:29.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.889+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): potential dests added=[] removed=[] 2024-09-12T18:02:29.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.893+0000 7fb23c0da9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22.1.0 2024-09-12T18:02:29.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.893+0000 7fb23c0da9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22.1.0 2024-09-12T18:02:29.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.893+0000 7fb23c0da9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22.1.1 2024-09-12T18:02:29.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.893+0000 7fb23c0da9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22.1.1 2024-09-12T18:02:29.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.893+0000 7fb23c0da9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22.0 2024-09-12T18:02:29.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.897+0000 7fb23c0da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:29.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.897+0000 7fb23c0da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 2024-09-12T18:02:29.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.901+0000 7fb23c0da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 info.flags=0x17 2024-09-12T18:02:29.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.901+0000 7fb23c0da9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 to cache LRU end 2024-09-12T18:02:29.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.901+0000 7fb23c0da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:29.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.901+0000 7fb23c0da9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22, ofs0, ns] 2024-09-12T18:02:29.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.901+0000 7fb11d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 94274323059920 notifier 6570 bl.length()=925 2024-09-12T18:02:29.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.901+0000 7fb11d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 info.flags=0x17 2024-09-12T18:02:29.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.901+0000 7fb11d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 to cache LRU end 2024-09-12T18:02:29.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.901+0000 7fb11d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:29.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.905+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): orig_sources= new_sources= 2024-09-12T18:02:29.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.905+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): potential sources added=[] removed=[] 2024-09-12T18:02:29.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.905+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): orig_dests= new_dests= 2024-09-12T18:02:29.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.905+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): potential dests added=[] removed=[] 2024-09-12T18:02:29.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.909+0000 7fb23c0da9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22.0 2024-09-12T18:02:29.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.909+0000 7fb23c0da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:29.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.909+0000 7fb23c0da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 2024-09-12T18:02:29.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.913+0000 7fb23c0da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 info.flags=0x17 2024-09-12T18:02:29.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.913+0000 7fb23c0da9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 to cache LRU end 2024-09-12T18:02:29.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.913+0000 7fb23c0da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:29.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.913+0000 7fb23c0da9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22, ofs0, ns] 2024-09-12T18:02:29.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.913+0000 7fb11cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464294 cookie 94274323059920 notifier 6570 bl.length()=893 2024-09-12T18:02:29.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.913+0000 7fb11cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 info.flags=0x17 2024-09-12T18:02:29.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.913+0000 7fb11cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 to cache LRU end 2024-09-12T18:02:29.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.913+0000 7fb11cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:29.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.917+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): orig_sources= new_sources= 2024-09-12T18:02:29.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.917+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): potential sources added=[] removed=[] 2024-09-12T18:02:29.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.917+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): orig_dests= new_dests= 2024-09-12T18:02:29.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.917+0000 7fb23c0da9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22]): potential dests added=[] removed=[] 2024-09-12T18:02:29.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.917+0000 7fb23c0da9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T18:02:29.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.921+0000 7fb0eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:29.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.929+0000 7fb23c0da9c0 20 remove_watcher() i=0 2024-09-12T18:02:29.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.929+0000 7fb23c0da9c0 2 removed watcher, disabling cache 2024-09-12T18:02:29.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.929+0000 7fb23c0da9c0 20 remove_watcher() i=1 2024-09-12T18:02:29.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.933+0000 7fb23c0da9c0 20 remove_watcher() i=2 2024-09-12T18:02:29.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.933+0000 7fb23c0da9c0 20 remove_watcher() i=3 2024-09-12T18:02:29.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.937+0000 7fb23c0da9c0 20 remove_watcher() i=4 2024-09-12T18:02:29.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.937+0000 7fb23c0da9c0 20 remove_watcher() i=5 2024-09-12T18:02:29.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.941+0000 7fb23c0da9c0 20 remove_watcher() i=6 2024-09-12T18:02:29.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:29.941+0000 7fb23c0da9c0 20 remove_watcher() i=7 2024-09-12T18:02:29.960 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:02:29.990 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:29.990 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:30.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.037+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.037+0000 7fe12802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:30.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.037+0000 7fe12802e9c0 20 realm 2024-09-12T18:02:30.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.037+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.037+0000 7fe12802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:30.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.037+0000 7fe12802e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:30.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.037+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.037+0000 7fe12802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:30.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.037+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.041+0000 7fe12802e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:30.039 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.041+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.041+0000 7fe12802e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:30.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.041+0000 7fe12802e9c0 20 searching for the correct realm 2024-09-12T18:02:30.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.045+0000 7fe125333640 0 -- 172.21.15.157:0/3852507908 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fe11c0da070 msgr2=0x7fe11c0e4560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:30.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.053+0000 7fe125333640 0 -- 172.21.15.157:0/3852507908 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fdff0080900 msgr2=0x7fdff0082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:30.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:30.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:30.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:30.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:30.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:30.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:30.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:30.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:30.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:30.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 zone default found 2024-09-12T18:02:30.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 4 Realm: () 2024-09-12T18:02:30.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:30.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:30.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:30.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 zonegroup default 2024-09-12T18:02:30.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:30.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:30.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:30.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 started sync module instance, tier type = 2024-09-12T18:02:30.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.061+0000 7fe12802e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:30.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.077+0000 7fe12802e9c0 20 add_watcher() i=0 2024-09-12T18:02:30.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.077+0000 7fe12802e9c0 20 add_watcher() i=1 2024-09-12T18:02:30.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.077+0000 7fe12802e9c0 20 add_watcher() i=2 2024-09-12T18:02:30.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.077+0000 7fe12802e9c0 20 add_watcher() i=3 2024-09-12T18:02:30.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.077+0000 7fe12802e9c0 20 add_watcher() i=4 2024-09-12T18:02:30.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.077+0000 7fe12802e9c0 20 add_watcher() i=5 2024-09-12T18:02:30.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.077+0000 7fe12802e9c0 20 add_watcher() i=6 2024-09-12T18:02:30.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.077+0000 7fe12802e9c0 20 add_watcher() i=7 2024-09-12T18:02:30.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.077+0000 7fe12802e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:30.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fdfd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:30.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fe12802e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:30.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fe12802e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:30.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fe12802e9c0 5 note: GC not initialized 2024-09-12T18:02:30.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fdfd67fc640 20 reqs_thread_entry: start 2024-09-12T18:02:30.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fe12802e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:30.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fe12802e9c0 20 Filter name: none 2024-09-12T18:02:30.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fdf47fff640 20 reqs_thread_entry: start 2024-09-12T18:02:30.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fe12802e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:30.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fe12802e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:30.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fe12802e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:30.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.081+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.085+0000 7fe12802e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:30.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.085+0000 7fe12802e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:30.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.085+0000 7fe12802e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:30.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.085+0000 7fe12802e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:30.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.085+0000 7fdfd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:30.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.089+0000 7fe12802e9c0 20 remove_watcher() i=0 2024-09-12T18:02:30.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.089+0000 7fe12802e9c0 2 removed watcher, disabling cache 2024-09-12T18:02:30.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.093+0000 7fe12802e9c0 20 remove_watcher() i=1 2024-09-12T18:02:30.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.093+0000 7fe12802e9c0 20 remove_watcher() i=2 2024-09-12T18:02:30.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.097+0000 7fe12802e9c0 20 remove_watcher() i=3 2024-09-12T18:02:30.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.097+0000 7fe12802e9c0 20 remove_watcher() i=4 2024-09-12T18:02:30.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.097+0000 7fe12802e9c0 20 remove_watcher() i=5 2024-09-12T18:02:30.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.101+0000 7fe12802e9c0 20 remove_watcher() i=6 2024-09-12T18:02:30.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:30.101+0000 7fe12802e9c0 20 remove_watcher() i=7 2024-09-12T18:02:30.114 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:30.114 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:02:30.115 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-set-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:02:30.115 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:30.878 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T18:02:30.878 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:33.047 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:02:33.080 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:33.080 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:33.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.125+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.129+0000 7f6ddef3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.129+0000 7f6ddef3b9c0 20 realm 2024-09-12T18:02:33.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.129+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.129+0000 7f6ddef3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.129+0000 7f6ddef3b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:33.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.129+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.129+0000 7f6ddef3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.129+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.133+0000 7f6ddef3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:33.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.133+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.133+0000 7f6ddef3b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:33.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.133+0000 7f6ddef3b9c0 20 searching for the correct realm 2024-09-12T18:02:33.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.137+0000 7f6ddc240640 0 -- 172.21.15.157:0/2317853321 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f6dd0017030 msgr2=0x7f6dd005c6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:33.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.353+0000 7f6ddca41640 0 -- 172.21.15.157:0/2317853321 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f6dd0008050 msgr2=0x7f6dd0064040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:33.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.569+0000 7f6ddef3b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:33.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.569+0000 7f6ddef3b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:33.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.569+0000 7f6ddef3b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.569+0000 7f6ddef3b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.569+0000 7f6ddef3b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.569+0000 7f6ddef3b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.569+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.569+0000 7f6ddef3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.569+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:33.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 zone default found 2024-09-12T18:02:33.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 4 Realm: () 2024-09-12T18:02:33.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:33.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:33.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:33.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 zonegroup default 2024-09-12T18:02:33.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 started sync module instance, tier type = 2024-09-12T18:02:33.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.573+0000 7f6ddef3b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:33.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.597+0000 7f6ddef3b9c0 20 add_watcher() i=0 2024-09-12T18:02:33.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.597+0000 7f6ddef3b9c0 20 add_watcher() i=1 2024-09-12T18:02:33.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.597+0000 7f6ddef3b9c0 20 add_watcher() i=2 2024-09-12T18:02:33.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.597+0000 7f6ddef3b9c0 20 add_watcher() i=3 2024-09-12T18:02:33.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.597+0000 7f6ddef3b9c0 20 add_watcher() i=4 2024-09-12T18:02:33.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.597+0000 7f6ddef3b9c0 20 add_watcher() i=5 2024-09-12T18:02:33.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.597+0000 7f6ddef3b9c0 20 add_watcher() i=6 2024-09-12T18:02:33.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.601+0000 7f6ddef3b9c0 20 add_watcher() i=7 2024-09-12T18:02:33.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.601+0000 7f6ddef3b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:33.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.605+0000 7f6c937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:33.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.605+0000 7f6ddef3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:33.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.605+0000 7f6ddef3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:33.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.605+0000 7f6ddef3b9c0 5 note: GC not initialized 2024-09-12T18:02:33.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.605+0000 7f6c927e4640 20 reqs_thread_entry: start 2024-09-12T18:02:33.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.605+0000 7f6ddef3b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:33.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.605+0000 7f6ddef3b9c0 20 Filter name: none 2024-09-12T18:02:33.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.605+0000 7f6c8b7fe640 20 reqs_thread_entry: start 2024-09-12T18:02:33.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.605+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.609+0000 7f6ddef3b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:33.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.609+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.609+0000 7f6ddef3b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:33.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.609+0000 7f6ddef3b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:33.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.609+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.609+0000 7f6ddef3b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:33.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.609+0000 7f6ddef3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.609+0000 7f6ddef3b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:33.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.609+0000 7f6ddef3b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:33.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.613+0000 7f6c937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:33.616 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.617+0000 7f6ddef3b9c0 20 remove_watcher() i=0 2024-09-12T18:02:33.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.617+0000 7f6ddef3b9c0 2 removed watcher, disabling cache 2024-09-12T18:02:33.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.621+0000 7f6ddef3b9c0 20 remove_watcher() i=1 2024-09-12T18:02:33.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.621+0000 7f6ddef3b9c0 20 remove_watcher() i=2 2024-09-12T18:02:33.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.625+0000 7f6ddef3b9c0 20 remove_watcher() i=3 2024-09-12T18:02:33.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.625+0000 7f6ddef3b9c0 20 remove_watcher() i=4 2024-09-12T18:02:33.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.629+0000 7f6ddef3b9c0 20 remove_watcher() i=5 2024-09-12T18:02:33.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.629+0000 7f6ddef3b9c0 20 remove_watcher() i=6 2024-09-12T18:02:33.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.629+0000 7f6ddef3b9c0 20 remove_watcher() i=7 2024-09-12T18:02:33.643 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:33.644 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:02:33.644 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-set-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:02:33.644 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:33.644 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T18:02:33.678 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:33.679 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:33.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.721+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 20 realm 2024-09-12T18:02:33.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:33.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:33.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:33.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.725+0000 7faa652eb9c0 20 searching for the correct realm 2024-09-12T18:02:33.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.729+0000 7faa62df1640 0 -- 172.21.15.157:0/2144010097 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x563923b9e280 msgr2=0x7faa5c027930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:33.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.945+0000 7faa625f0640 0 -- 172.21.15.157:0/2144010097 >> [v2:172.21.15.157:6800/2182114182,v1:172.21.15.157:6801/2182114182] conn(0x563923df7b20 msgr2=0x563923df9f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:33.959 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:33.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:33.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:33.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:33.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:33.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:33.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:33.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:33.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 zone default found 2024-09-12T18:02:33.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 4 Realm: () 2024-09-12T18:02:33.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:33.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:33.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:33.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 zonegroup default 2024-09-12T18:02:33.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.961+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.965+0000 7faa652eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.965+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.965+0000 7faa652eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.965+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.965+0000 7faa652eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:33.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.965+0000 7faa652eb9c0 20 started sync module instance, tier type = 2024-09-12T18:02:33.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.965+0000 7faa652eb9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:33.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.985+0000 7faa652eb9c0 20 add_watcher() i=0 2024-09-12T18:02:33.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.985+0000 7faa652eb9c0 20 add_watcher() i=1 2024-09-12T18:02:33.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.985+0000 7faa652eb9c0 20 add_watcher() i=2 2024-09-12T18:02:33.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.985+0000 7faa652eb9c0 20 add_watcher() i=3 2024-09-12T18:02:33.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.985+0000 7faa652eb9c0 20 add_watcher() i=4 2024-09-12T18:02:33.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.985+0000 7faa652eb9c0 20 add_watcher() i=5 2024-09-12T18:02:33.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.985+0000 7faa652eb9c0 20 add_watcher() i=6 2024-09-12T18:02:33.986 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.989+0000 7faa652eb9c0 20 add_watcher() i=7 2024-09-12T18:02:33.986 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.989+0000 7faa652eb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:33.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.989+0000 7fa919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:33.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:33.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:33.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 5 note: GC not initialized 2024-09-12T18:02:33.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7fa918fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:33.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:33.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 20 Filter name: none 2024-09-12T18:02:33.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7fa911ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:33.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T18:02:33.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:33.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T18:02:33.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T18:02:33.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 : miss 2024-09-12T18:02:33.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:33.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:33.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 info.flags=0x17 2024-09-12T18:02:33.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 to cache LRU end 2024-09-12T18:02:33.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:33.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:33.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.993+0000 7faa652eb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 2024-09-12T18:02:33.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:33.997+0000 7faa652eb9c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T18:02:34.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.001+0000 7faa652eb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 info.flags=0x17 2024-09-12T18:02:34.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.001+0000 7faa652eb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 to cache LRU end 2024-09-12T18:02:34.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.001+0000 7faa652eb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:34.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.001+0000 7faa652eb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23, ofs0, ns] 2024-09-12T18:02:34.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.001+0000 7fa9467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464297 cookie 94803415008336 notifier 6627 bl.length()=925 2024-09-12T18:02:34.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.001+0000 7fa9467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 info.flags=0x17 2024-09-12T18:02:34.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.001+0000 7fa9467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 to cache LRU end 2024-09-12T18:02:34.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.001+0000 7fa9467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:34.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.005+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): orig_sources= new_sources= 2024-09-12T18:02:34.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.005+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): potential sources added=[] removed=[] 2024-09-12T18:02:34.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.005+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): orig_dests= new_dests= 2024-09-12T18:02:34.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.005+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): potential dests added=[] removed=[] 2024-09-12T18:02:34.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.009+0000 7faa652eb9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23.1.0 2024-09-12T18:02:34.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.009+0000 7faa652eb9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23.1.0 2024-09-12T18:02:34.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.009+0000 7faa652eb9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23.1.1 2024-09-12T18:02:34.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.009+0000 7faa652eb9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23.1.1 2024-09-12T18:02:34.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.009+0000 7faa652eb9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23.0 2024-09-12T18:02:34.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.017+0000 7faa652eb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:34.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.017+0000 7faa652eb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 2024-09-12T18:02:34.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.017+0000 7faa652eb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 info.flags=0x17 2024-09-12T18:02:34.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.017+0000 7faa652eb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 to cache LRU end 2024-09-12T18:02:34.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.017+0000 7faa652eb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:34.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.017+0000 7faa652eb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23, ofs0, ns] 2024-09-12T18:02:34.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.017+0000 7fa9467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 94803415008336 notifier 6627 bl.length()=925 2024-09-12T18:02:34.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.017+0000 7fa9467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 info.flags=0x17 2024-09-12T18:02:34.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.017+0000 7fa9467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 to cache LRU end 2024-09-12T18:02:34.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.017+0000 7fa9467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:34.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.021+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): orig_sources= new_sources= 2024-09-12T18:02:34.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.021+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): potential sources added=[] removed=[] 2024-09-12T18:02:34.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.021+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): orig_dests= new_dests= 2024-09-12T18:02:34.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.021+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): potential dests added=[] removed=[] 2024-09-12T18:02:34.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.025+0000 7faa652eb9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23.0 2024-09-12T18:02:34.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.025+0000 7faa652eb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:34.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.025+0000 7faa652eb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 2024-09-12T18:02:34.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.025+0000 7faa652eb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 info.flags=0x17 2024-09-12T18:02:34.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.025+0000 7faa652eb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 to cache LRU end 2024-09-12T18:02:34.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.025+0000 7faa652eb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:34.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.025+0000 7faa652eb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23, ofs0, ns] 2024-09-12T18:02:34.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.029+0000 7fa945ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94803415008336 notifier 6627 bl.length()=893 2024-09-12T18:02:34.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.029+0000 7fa945ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 info.flags=0x17 2024-09-12T18:02:34.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.029+0000 7fa945ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 to cache LRU end 2024-09-12T18:02:34.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.029+0000 7fa945ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:34.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.029+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): orig_sources= new_sources= 2024-09-12T18:02:34.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.029+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): potential sources added=[] removed=[] 2024-09-12T18:02:34.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.029+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): orig_dests= new_dests= 2024-09-12T18:02:34.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.029+0000 7faa652eb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23]): potential dests added=[] removed=[] 2024-09-12T18:02:34.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.033+0000 7faa652eb9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T18:02:34.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.037+0000 7fa919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:34.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.041+0000 7faa652eb9c0 20 remove_watcher() i=0 2024-09-12T18:02:34.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.041+0000 7faa652eb9c0 2 removed watcher, disabling cache 2024-09-12T18:02:34.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.041+0000 7faa652eb9c0 20 remove_watcher() i=1 2024-09-12T18:02:34.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.045+0000 7faa652eb9c0 20 remove_watcher() i=2 2024-09-12T18:02:34.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.049+0000 7faa652eb9c0 20 remove_watcher() i=3 2024-09-12T18:02:34.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.049+0000 7faa652eb9c0 20 remove_watcher() i=4 2024-09-12T18:02:34.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.049+0000 7faa652eb9c0 20 remove_watcher() i=5 2024-09-12T18:02:34.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.053+0000 7faa652eb9c0 20 remove_watcher() i=6 2024-09-12T18:02:34.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.053+0000 7faa652eb9c0 20 remove_watcher() i=7 2024-09-12T18:02:34.068 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:02:34.100 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:34.100 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:34.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.145+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.145+0000 7faef87129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:34.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.145+0000 7faef87129c0 20 realm 2024-09-12T18:02:34.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.145+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.145+0000 7faef87129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:34.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.145+0000 7faef87129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:34.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.145+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.145+0000 7faef87129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:34.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.145+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.149+0000 7faef87129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:34.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.149+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.149+0000 7faef87129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:34.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.149+0000 7faef87129c0 20 searching for the correct realm 2024-09-12T18:02:34.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.157+0000 7faef5a17640 0 -- 172.21.15.157:0/4188421144 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7faeec06c4f0 msgr2=0x7faeec0623c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:34.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.161+0000 7faef5a17640 0 -- 172.21.15.157:0/4188421144 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fadc0080900 msgr2=0x7fadc0082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:34.168 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.168 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 zone default found 2024-09-12T18:02:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 4 Realm: () 2024-09-12T18:02:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 zonegroup default 2024-09-12T18:02:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:34.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:34.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 started sync module instance, tier type = 2024-09-12T18:02:34.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.169+0000 7faef87129c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:34.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.185+0000 7faef87129c0 20 add_watcher() i=0 2024-09-12T18:02:34.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.185+0000 7faef87129c0 20 add_watcher() i=1 2024-09-12T18:02:34.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.185+0000 7faef87129c0 20 add_watcher() i=2 2024-09-12T18:02:34.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.185+0000 7faef87129c0 20 add_watcher() i=3 2024-09-12T18:02:34.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.185+0000 7faef87129c0 20 add_watcher() i=4 2024-09-12T18:02:34.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.185+0000 7faef87129c0 20 add_watcher() i=5 2024-09-12T18:02:34.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.185+0000 7faef87129c0 20 add_watcher() i=6 2024-09-12T18:02:34.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.185+0000 7faef87129c0 20 add_watcher() i=7 2024-09-12T18:02:34.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.185+0000 7faef87129c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:34.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.189+0000 7fadacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:34.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.189+0000 7faef87129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:34.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.189+0000 7faef87129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:34.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.189+0000 7faef87129c0 5 note: GC not initialized 2024-09-12T18:02:34.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.189+0000 7fad277fe640 20 reqs_thread_entry: start 2024-09-12T18:02:34.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.189+0000 7faef87129c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:34.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.189+0000 7faef87129c0 20 Filter name: none 2024-09-12T18:02:34.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.189+0000 7fad257fa640 20 reqs_thread_entry: start 2024-09-12T18:02:34.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.189+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.189+0000 7faef87129c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:34.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.189+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.193+0000 7faef87129c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:34.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.193+0000 7faef87129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:34.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.193+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.193+0000 7faef87129c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:34.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.193+0000 7faef87129c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:34.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.193+0000 7faef87129c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:34.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.193+0000 7faef87129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:34.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.193+0000 7fadacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:34.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.201+0000 7faef87129c0 20 remove_watcher() i=0 2024-09-12T18:02:34.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.201+0000 7faef87129c0 2 removed watcher, disabling cache 2024-09-12T18:02:34.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.201+0000 7faef87129c0 20 remove_watcher() i=1 2024-09-12T18:02:34.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.201+0000 7faef87129c0 20 remove_watcher() i=2 2024-09-12T18:02:34.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.205+0000 7faef87129c0 20 remove_watcher() i=3 2024-09-12T18:02:34.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.205+0000 7faef87129c0 20 remove_watcher() i=4 2024-09-12T18:02:34.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.209+0000 7faef87129c0 20 remove_watcher() i=5 2024-09-12T18:02:34.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.209+0000 7faef87129c0 20 remove_watcher() i=6 2024-09-12T18:02:34.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:34.209+0000 7faef87129c0 20 remove_watcher() i=7 2024-09-12T18:02:34.223 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:34.224 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:02:34.224 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-set-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T18:02:34.224 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:34.940 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T18:02:34.941 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.114 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T18:02:37.148 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:37.148 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:37.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.193+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.193+0000 7f9d8fd149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.193+0000 7f9d8fd149c0 20 realm 2024-09-12T18:02:37.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.193+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.193+0000 7f9d8fd149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.193+0000 7f9d8fd149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:37.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.193+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.193+0000 7f9d8fd149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.193+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.197+0000 7f9d8fd149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.197+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.197+0000 7f9d8fd149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:37.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.197+0000 7f9d8fd149c0 20 searching for the correct realm 2024-09-12T18:02:37.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.201+0000 7f9d8d81a640 0 -- 172.21.15.157:0/1907895491 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f9c58080930 msgr2=0x7f9c58082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.209+0000 7f9d8d81a640 0 -- 172.21.15.157:0/1907895491 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f9d84133b00 msgr2=0x7f9d841094d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.425+0000 7f9d8fd149c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:37.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.425+0000 7f9d8fd149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:37.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.425+0000 7f9d8fd149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:37.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.425+0000 7f9d8fd149c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:37.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.425+0000 7f9d8fd149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:37.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.425+0000 7f9d8fd149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:37.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.425+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:37.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 zone default found 2024-09-12T18:02:37.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 4 Realm: () 2024-09-12T18:02:37.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:37.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:37.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:37.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 zonegroup default 2024-09-12T18:02:37.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.429+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.433+0000 7f9d8fd149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.433+0000 7f9d8fd149c0 20 started sync module instance, tier type = 2024-09-12T18:02:37.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.433+0000 7f9d8fd149c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:37.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.457+0000 7f9d8fd149c0 20 add_watcher() i=0 2024-09-12T18:02:37.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.457+0000 7f9d8fd149c0 20 add_watcher() i=1 2024-09-12T18:02:37.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.457+0000 7f9d8fd149c0 20 add_watcher() i=2 2024-09-12T18:02:37.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.457+0000 7f9d8fd149c0 20 add_watcher() i=3 2024-09-12T18:02:37.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.457+0000 7f9d8fd149c0 20 add_watcher() i=4 2024-09-12T18:02:37.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.457+0000 7f9d8fd149c0 20 add_watcher() i=5 2024-09-12T18:02:37.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.457+0000 7f9d8fd149c0 20 add_watcher() i=6 2024-09-12T18:02:37.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.457+0000 7f9d8fd149c0 20 add_watcher() i=7 2024-09-12T18:02:37.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.457+0000 7f9d8fd149c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:37.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.461+0000 7f9c3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:37.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.465+0000 7f9d8fd149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:37.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.465+0000 7f9d8fd149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:37.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.465+0000 7f9d8fd149c0 5 note: GC not initialized 2024-09-12T18:02:37.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.465+0000 7f9c3e7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:37.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.465+0000 7f9d8fd149c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:37.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.465+0000 7f9d8fd149c0 20 Filter name: none 2024-09-12T18:02:37.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.465+0000 7f9baffff640 20 reqs_thread_entry: start 2024-09-12T18:02:37.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.465+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.465+0000 7f9d8fd149c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:37.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.465+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.465+0000 7f9d8fd149c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:37.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.469+0000 7f9d8fd149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:37.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.469+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.469+0000 7f9d8fd149c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:37.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.469+0000 7f9d8fd149c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.469+0000 7f9d8fd149c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:37.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.469+0000 7f9d8fd149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:37.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.469+0000 7f9c3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:37.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.477+0000 7f9d8fd149c0 20 remove_watcher() i=0 2024-09-12T18:02:37.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.477+0000 7f9d8fd149c0 2 removed watcher, disabling cache 2024-09-12T18:02:37.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.477+0000 7f9d8fd149c0 20 remove_watcher() i=1 2024-09-12T18:02:37.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.481+0000 7f9d8fd149c0 20 remove_watcher() i=2 2024-09-12T18:02:37.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.481+0000 7f9d8fd149c0 20 remove_watcher() i=3 2024-09-12T18:02:37.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.485+0000 7f9d8fd149c0 20 remove_watcher() i=4 2024-09-12T18:02:37.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.485+0000 7f9d8fd149c0 20 remove_watcher() i=5 2024-09-12T18:02:37.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.489+0000 7f9d8fd149c0 20 remove_watcher() i=6 2024-09-12T18:02:37.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.489+0000 7f9d8fd149c0 20 remove_watcher() i=7 2024-09-12T18:02:37.504 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.504 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:02:37.504 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-set-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:02:37.504 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.505 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T18:02:37.537 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:37.537 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:37.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 realm 2024-09-12T18:02:37.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.581+0000 7f5f93e929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:37.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:37.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 searching for the correct realm 2024-09-12T18:02:37.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.593+0000 7f5f92199640 0 -- 172.21.15.157:0/2969667688 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f5f7c0f6450 msgr2=0x7f5f7c0f68b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.601+0000 7f5f91998640 0 -- 172.21.15.157:0/2969667688 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55d7f1345960 msgr2=0x55d7f1347d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:37.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:37.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:37.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:37.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:37.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:37.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:37.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 zone default found 2024-09-12T18:02:37.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 4 Realm: () 2024-09-12T18:02:37.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:37.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:37.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:37.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 zonegroup default 2024-09-12T18:02:37.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 started sync module instance, tier type = 2024-09-12T18:02:37.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=0 2024-09-12T18:02:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=1 2024-09-12T18:02:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=2 2024-09-12T18:02:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=3 2024-09-12T18:02:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=4 2024-09-12T18:02:37.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=5 2024-09-12T18:02:37.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=6 2024-09-12T18:02:37.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 add_watcher() i=7 2024-09-12T18:02:37.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5f93e929c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:37.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5e437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:37.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:37.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:37.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 note: GC not initialized 2024-09-12T18:02:37.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5e427fc640 20 reqs_thread_entry: start 2024-09-12T18:02:37.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:37.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 Filter name: none 2024-09-12T18:02:37.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5db3fff640 20 reqs_thread_entry: start 2024-09-12T18:02:37.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5f93e929c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:02:37.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.629+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:37.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:02:37.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:02:37.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 : miss 2024-09-12T18:02:37.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.629+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.629+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:37.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 info.flags=0x17 2024-09-12T18:02:37.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to cache LRU end 2024-09-12T18:02:37.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:37.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:37.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 2024-09-12T18:02:37.632 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5f93e929c0 time 2024-09-12T18:02:37.638075+0000 2024-09-12T18:02:37.632 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:37.633 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:37.634 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5f9776c2eb] 2024-09-12T18:02:37.634 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5f9776c49f] 2024-09-12T18:02:37.634 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7ef36a0c1] 2024-09-12T18:02:37.634 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x140f6b8) [0x55d7efdbf6b8] 2024-09-12T18:02:37.634 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7ef37c18d] 2024-09-12T18:02:37.634 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:02:37.634 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5f965d2d90] 2024-09-12T18:02:37.634 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:02:37.634 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:02:37.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.633+0000 7f5f93e929c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5f93e929c0 time 2024-09-12T18:02:37.638075+0000 2024-09-12T18:02:37.634 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:37.635 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.635 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:37.635 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5f9776c2eb] 2024-09-12T18:02:37.635 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5f9776c49f] 2024-09-12T18:02:37.635 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7ef36a0c1] 2024-09-12T18:02:37.635 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x140f6b8) [0x55d7efdbf6b8] 2024-09-12T18:02:37.635 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7ef37c18d] 2024-09-12T18:02:37.635 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:02:37.635 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5f965d2d90] 2024-09-12T18:02:37.636 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:02:37.636 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:02:37.636 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.636 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:02:37.636 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f5f93e929c0 thread_name:radosgw-admin 2024-09-12T18:02:37.653 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:37.653 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5f965eb520] 2024-09-12T18:02:37.653 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:02:37.653 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:02:37.654 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:02:37.654 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5f9776c345] 2024-09-12T18:02:37.654 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5f9776c49f] 2024-09-12T18:02:37.654 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7ef36a0c1] 2024-09-12T18:02:37.654 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x140f6b8) [0x55d7efdbf6b8] 2024-09-12T18:02:37.654 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7ef37c18d] 2024-09-12T18:02:37.654 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:02:37.654 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5f965d2d90] 2024-09-12T18:02:37.654 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:02:37.654 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:02:37.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.637+0000 7f5f93e929c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:37.655 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f5f93e929c0 thread_name:radosgw-admin 2024-09-12T18:02:37.655 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.655 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:37.655 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5f965eb520] 2024-09-12T18:02:37.655 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:02:37.655 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:02:37.655 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:02:37.655 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5f9776c345] 2024-09-12T18:02:37.655 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5f9776c49f] 2024-09-12T18:02:37.655 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7ef36a0c1] 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x140f6b8) [0x55d7efdbf6b8] 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7ef37c18d] 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5f965d2d90] 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:02:37.557+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c80) adding con mode: secure 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:02:37.557+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.656 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.657 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command rotate-key hook 0x7ffc10fb2dc8 2024-09-12T18:02:37.657 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:37.658 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:02:37.658 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-b con 0x55d7f1101210 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:02:37.658 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-c con 0x55d7f11015f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:02:37.658 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-a con 0x55d7f1196b00 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:02:37.658 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.658 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.658 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.658 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:37.658 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): authenticate will time out at 2319.784328s 2024-09-12T18:02:37.658 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): get_auth_request con 0x55d7f1196b00 auth_method 0 2024-09-12T18:02:37.659 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.659 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.659 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.659 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.659 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.659 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.659 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): get_auth_request con 0x55d7f1101210 auth_method 0 2024-09-12T18:02:37.659 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.659 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.660 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.660 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_done global_id 6672 payload 274 2024-09-12T18:02:37.660 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient: _finish_hunting 0 2024-09-12T18:02:37.660 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:02:37.561+0000 7f5f92199640 1 monclient: found mon.noname-a 2024-09-12T18:02:37.660 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.660 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.660 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:37.660 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: dump: 2024-09-12T18:02:37.660 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.660 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.661 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.661 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.661 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.661 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.661 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.661 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.661 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.661 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.661 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: _finish_auth 0 2024-09-12T18:02:37.662 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: _check_auth_tickets 2024-09-12T18:02:37.662 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:37.662 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.662 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:37.662 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: dump: 2024-09-12T18:02:37.662 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.662 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.662 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.662 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.663 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.663 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.663 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.663 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.663 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.663 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.663 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 monclient: authenticate success, global_id 6672 2024-09-12T18:02:37.663 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:37.663 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 4 set_mon_vals no callback set 2024-09-12T18:02:37.663 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: shutdown 2024-09-12T18:02:37.664 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) unregister_commands rotate-key 2024-09-12T18:02:37.664 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: build_initial_monmap 2024-09-12T18:02:37.664 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:37.664 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: monmap: 2024-09-12T18:02:37.664 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:02:37.664 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:37.664 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:02:37.664 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:02:37.664 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:37.665 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.665 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:02:37.665 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:02:37.665 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:02:37.665 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.665 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding auth protocol: cephx 2024-09-12T18:02:37.665 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding auth protocol: cephx 2024-09-12T18:02:37.665 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding auth protocol: cephx 2024-09-12T18:02:37.666 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.666 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.666 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.666 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.666 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.666 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.666 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.666 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.666 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.667 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.667 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.667 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.667 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.667 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 1 librados: starting msgr at 2024-09-12T18:02:37.667 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 1 librados: starting objecter 2024-09-12T18:02:37.667 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command objecter_requests hook 0x55d7f1279f90 2024-09-12T18:02:37.667 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 1 librados: setting wanted keys 2024-09-12T18:02:37.667 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 1 librados: calling monclient init 2024-09-12T18:02:37.667 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: init 2024-09-12T18:02:37.668 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding auth protocol: cephx 2024-09-12T18:02:37.668 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding auth protocol: cephx 2024-09-12T18:02:37.668 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding auth protocol: cephx 2024-09-12T18:02:37.668 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.668 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.668 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.668 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.668 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.668 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.669 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.669 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.669 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.669 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.669 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.669 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.669 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.669 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.669 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command rotate-key hook 0x55d7f1250cb8 2024-09-12T18:02:37.670 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:37.670 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:02:37.670 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-a con 0x55d7f1101210 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:02:37.670 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-b con 0x55d7f11015f0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:02:37.670 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-c con 0x55d7f1196b00 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:02:37.670 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.670 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.670 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.670 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:37.670 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): authenticate will time out at 2319.787394s 2024-09-12T18:02:37.671 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): get_auth_request con 0x55d7f1101210 auth_method 0 2024-09-12T18:02:37.671 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.671 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.671 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.671 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.671 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.671 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.671 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): get_auth_request con 0x55d7f1196b00 auth_method 0 2024-09-12T18:02:37.671 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.671 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.672 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.672 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.672 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.672 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.672 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): handle_auth_done global_id 6675 payload 824 2024-09-12T18:02:37.672 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient: _finish_hunting 0 2024-09-12T18:02:37.672 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:02:37.561+0000 7f5f91998640 1 monclient: found mon.noname-a 2024-09-12T18:02:37.672 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.672 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.673 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:37.673 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: dump: 2024-09-12T18:02:37.673 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.673 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.673 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.673 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.673 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.673 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.673 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.673 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.673 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.674 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.674 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: _finish_auth 0 2024-09-12T18:02:37.674 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: _check_auth_tickets 2024-09-12T18:02:37.674 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 5 monclient: authenticate success, global_id 6675 2024-09-12T18:02:37.674 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:37.674 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.674 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:37.674 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: dump: 2024-09-12T18:02:37.674 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.675 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.675 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.675 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.675 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.675 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.675 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.675 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.675 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.675 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:02:37.565+0000 7f5e7fe07640 4 set_mon_vals no callback set 2024-09-12T18:02:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 1 librados: init done 2024-09-12T18:02:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:02:37.565+0000 7f5e7e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:02:37.565+0000 7f5e7e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:02:37.565+0000 7f5e7e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:02:37.565+0000 7f5f91197640 10 monclient: get_auth_request con 0x7f5e78070ae0 auth_method 0 2024-09-12T18:02:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:02:37.565+0000 7f5f92199640 10 monclient: get_auth_request con 0x55d7f1277470 auth_method 0 2024-09-12T18:02:37.677 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:02:37.565+0000 7f5f91998640 10 monclient: get_auth_request con 0x55d7f129bea0 auth_method 0 2024-09-12T18:02:37.677 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:02:37.569+0000 7f5f91197640 10 monclient: get_auth_request con 0x55d7f12a0090 auth_method 0 2024-09-12T18:02:37.677 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient: build_initial_monmap 2024-09-12T18:02:37.677 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:37.677 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient: monmap: 2024-09-12T18:02:37.677 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:02:37.677 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:37.677 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:02:37.677 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:02:37.677 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:37.677 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding auth protocol: cephx 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding auth protocol: cephx 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding auth protocol: cephx 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.678 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d7f12a86d0 EEXIST 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient: init 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding auth protocol: cephx 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding auth protocol: cephx 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding auth protocol: cephx 2024-09-12T18:02:37.679 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.680 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command rotate-key cmddesc rotate-key hook 0x55d7f12a34f0 EEXIST 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-a con 0x55d7f12cc880 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-c con 0x55d7f12cc1b0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-b con 0x55d7f12cab90 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): authenticate will time out at 2319.795848s 2024-09-12T18:02:37.681 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:02:37.569+0000 7f5f91998640 10 monclient(hunting): get_auth_request con 0x55d7f12cc880 auth_method 0 2024-09-12T18:02:37.682 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:02:37.569+0000 7f5f91998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.682 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:02:37.569+0000 7f5f91998640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.682 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:02:37.569+0000 7f5f91998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.682 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.682 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.682 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.682 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): handle_auth_done global_id 6678 payload 824 2024-09-12T18:02:37.682 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient: _finish_hunting 0 2024-09-12T18:02:37.682 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:02:37.573+0000 7f5f91998640 1 monclient: found mon.noname-a 2024-09-12T18:02:37.682 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.682 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:02:37.573+0000 7f5f92199640 10 monclient: get_auth_request con 0x55d7f12cab90 auth_method 0 2024-09-12T18:02:37.683 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.683 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:37.683 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: dump: 2024-09-12T18:02:37.683 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.683 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.683 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.683 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.683 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.683 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.683 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.683 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.684 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.684 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.684 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: _finish_auth 0 2024-09-12T18:02:37.684 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: _check_auth_tickets 2024-09-12T18:02:37.684 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:37.684 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.684 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:37.684 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: dump: 2024-09-12T18:02:37.684 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.684 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.684 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 monclient: authenticate success, global_id 6678 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:02:37.573+0000 7f5f9299a640 4 set_mon_vals no callback set 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.685 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:02:37.573+0000 7f5e777fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:02:37.573+0000 7f5e777fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:02:37.573+0000 7f5e777fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:02:37.573+0000 7f5f91197640 10 monclient: get_auth_request con 0x7f5e6c070a20 auth_method 0 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: get_monmap_and_config 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: build_initial_monmap 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: monmap: 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:02:37.686 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding auth protocol: cephx 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding auth protocol: cephx 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding auth protocol: cephx 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.687 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: init 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding auth protocol: cephx 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding auth protocol: cephx 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding auth protocol: cephx 2024-09-12T18:02:37.688 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.689 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc10fb2d48 EEXIST 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-a con 0x55d7f12f0460 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-c con 0x55d7f1324080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-b con 0x55d7f1327610 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): authenticate will time out at 2319.799793s 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): get_auth_request con 0x55d7f12f0460 auth_method 0 2024-09-12T18:02:37.690 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:02:37.573+0000 7f5f91197640 10 monclient(hunting): get_auth_request con 0x55d7f1324080 auth_method 0 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:02:37.573+0000 7f5f91197640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:02:37.573+0000 7f5f91197640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:02:37.573+0000 7f5f91197640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:02:37.577+0000 7f5f91197640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:02:37.577+0000 7f5f91197640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:02:37.577+0000 7f5f91197640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.691 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_done global_id 6681 payload 274 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient: _finish_hunting 0 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:02:37.577+0000 7f5f91998640 1 monclient: found mon.noname-a 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: dump: 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.692 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: _finish_auth 0 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: _check_auth_tickets 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 monclient: authenticate success, global_id 6681 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 4 set_mon_vals no callback set 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: dump: 2024-09-12T18:02:37.693 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: shutdown 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: build_initial_monmap 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:37.694 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: monmap: 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding auth protocol: cephx 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding auth protocol: cephx 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding auth protocol: cephx 2024-09-12T18:02:37.695 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.696 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 librados: starting msgr at 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 librados: starting objecter 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d7f131e6a0 EEXIST 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 librados: setting wanted keys 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 librados: calling monclient init 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: init 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding auth protocol: cephx 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding auth protocol: cephx 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding auth protocol: cephx 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.697 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command rotate-key cmddesc rotate-key hook 0x55d7f12ce7e8 EEXIST 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:02:37.698 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-a con 0x55d7f12f0460 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-b con 0x55d7f1324080 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-c con 0x55d7f1327610 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): authenticate will time out at 2319.802237s 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): get_auth_request con 0x55d7f1327610 auth_method 0 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): get_auth_request con 0x55d7f12f0460 auth_method 0 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.699 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): handle_auth_done global_id 6251 payload 824 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient: _finish_hunting 0 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:02:37.577+0000 7f5f92199640 1 monclient: found mon.noname-c 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:37.700 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: dump: 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: _finish_auth 0 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: _check_auth_tickets 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:37.701 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: dump: 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.702 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 monclient: authenticate success, global_id 6251 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:02:37.577+0000 7f5e757fa640 4 set_mon_vals no callback set 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 librados: init done 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command cr dump hook 0x7f5f8c05bf78 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:02:37.581+0000 7f5e637fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:02:37.581+0000 7f5e637fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:02:37.581+0000 7f5e637fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.703 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:02:37.581+0000 7f5f91998640 10 monclient: get_auth_request con 0x7f5e5c070ae0 auth_method 0 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:02:37.581+0000 7f5f91197640 10 monclient: get_auth_request con 0x55d7f1341580 auth_method 0 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 realm 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:02:37.581+0000 7f5f91998640 10 monclient: get_auth_request con 0x55d7f1345960 auth_method 0 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:02:37.585+0000 7f5f91197640 10 monclient: get_auth_request con 0x55d7f1349080 auth_method 0 2024-09-12T18:02:37.704 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 searching for the correct realm 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:02:37.585+0000 7f5f92199640 10 monclient: get_auth_request con 0x55d7f134dd90 auth_method 0 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:02:37.585+0000 7f5f91998640 10 monclient: get_auth_request con 0x7f5f84061da0 auth_method 0 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:02:37.589+0000 7f5f91197640 10 monclient: get_auth_request con 0x7f5f7c0e7c00 auth_method 0 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:02:37.593+0000 7f5f92199640 10 monclient: get_auth_request con 0x7f5f7c0f6450 auth_method 0 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:02:37.593+0000 7f5f92199640 0 -- 172.21.15.157:0/2969667688 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f5f7c0f6450 msgr2=0x7f5f7c0f68b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:02:37.593+0000 7f5e637fe640 1 client.6251.objecter ms_handle_reset 0x7f5f7c0f6450 session 0x7f5f7c0c6c90 osd.6 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:02:37.593+0000 7f5e637fe640 10 monclient: _renew_subs 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:02:37.593+0000 7f5e637fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:02:37.593+0000 7f5f92199640 10 monclient: get_auth_request con 0x7f5e5c080900 auth_method 0 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:02:37.597+0000 7f5f91998640 10 monclient: get_auth_request con 0x7f5f7c0f53e0 auth_method 0 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:02:37.601+0000 7f5f91998640 0 -- 172.21.15.157:0/2969667688 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55d7f1345960 msgr2=0x55d7f1347d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:02:37.601+0000 7f5e637fe640 1 client.6251.objecter ms_handle_reset 0x55d7f1345960 session 0x55d7f1344800 osd.5 2024-09-12T18:02:37.705 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:02:37.601+0000 7f5f91998640 10 monclient: get_auth_request con 0x7f5f7c0f6450 auth_method 0 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.706 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 zone default found 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 4 Realm: () 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 zonegroup default 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 started sync module instance, tier type = 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:37.707 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=0 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=1 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=2 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=3 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=4 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=5 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=6 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 add_watcher() i=7 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding auth protocol: cephx 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding auth protocol: cephx 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding auth protocol: cephx 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.708 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:02:37.625+0000 7f5e437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:37.709 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command cache list hook 0x55d7f1324dd0 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command cache inspect hook 0x55d7f1324dd0 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command cache erase hook 0x55d7f1324dd0 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command cache zap hook 0x55d7f1324dd0 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 note: GC not initialized 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:02:37.625+0000 7f5e427fc640 20 reqs_thread_entry: start 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command sync trace show hook 0x7f5f8c0022d0 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command sync trace history hook 0x7f5f8c0022d0 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command sync trace active hook 0x7f5f8c0022d0 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command sync trace active_short hook 0x7f5f8c0022d0 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 Filter name: none 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:02:37.625+0000 7f5db3fff640 20 reqs_thread_entry: start 2024-09-12T18:02:37.710 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 : miss 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 info.flags=0x17 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to cache LRU end 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:02:37.633+0000 7f5f93e929c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5f93e929c0 time 2024-09-12T18:02:37.638075+0000 2024-09-12T18:02:37.711 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5f9776c2eb] 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5f9776c49f] 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7ef36a0c1] 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x140f6b8) [0x55d7efdbf6b8] 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7ef37c18d] 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5f965d2d90] 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.712 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:02:37.637+0000 7f5f93e929c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f5f93e929c0 thread_name:radosgw-admin 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5f965eb520] 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5f9776c345] 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5f9776c49f] 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7ef36a0c1] 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x140f6b8) [0x55d7efdbf6b8] 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7ef37c18d] 2024-09-12T18:02:37.713 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5f965d2d90] 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:02:37.714 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:02:37.715 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:02:37.716 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:02:37.717 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:02:37.718 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:02:37.718 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:02:37.718 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:02:37.718 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:02:37.718 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:02:37.718 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:02:37.718 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:02:37.718 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:02:37.718 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:02:37.718 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:02:37.719 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:02:37.720 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5db3fff640 / http_manager 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e427fc640 / http_manager 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e437fe640 / rgw_dt_lg_renew 2024-09-12T18:02:37.721 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e637fe640 / ms_dispatch 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e757fa640 / io_context_pool 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e777fe640 / ms_dispatch 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e7e604640 / ms_dispatch 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e7fe07640 / io_context_pool 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5f91197640 / msgr-worker-2 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5f91998640 / msgr-worker-1 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5f92199640 / msgr-worker-0 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5f9299a640 / io_context_pool 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5f93e929c0 / radosgw-admin 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.89284.log 2024-09-12T18:02:37.722 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:02:37.557+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c80) adding con mode: secure 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:02:37.557+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command rotate-key hook 0x7ffc10fb2dc8 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-b con 0x55d7f1101210 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-c con 0x55d7f11015f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-a con 0x55d7f1196b00 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.723 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): authenticate will time out at 2319.784328s 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): get_auth_request con 0x55d7f1196b00 auth_method 0 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): get_auth_request con 0x55d7f1101210 auth_method 0 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.724 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_done global_id 6672 payload 274 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient: _finish_hunting 0 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:02:37.561+0000 7f5f92199640 1 monclient: found mon.noname-a 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: dump: 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.725 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: _finish_auth 0 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: _check_auth_tickets 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:02:37.561+0000 7f5e7fe07640 10 monclient: dump: 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.726 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 monclient: authenticate success, global_id 6672 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 4 set_mon_vals no callback set 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: shutdown 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) unregister_commands rotate-key 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: build_initial_monmap 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: monmap: 2024-09-12T18:02:37.727 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding auth protocol: cephx 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding auth protocol: cephx 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding auth protocol: cephx 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.728 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: crc 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1256180) adding con mode: secure 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 1 librados: starting msgr at 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 1 librados: starting objecter 2024-09-12T18:02:37.729 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command objecter_requests hook 0x55d7f1279f90 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 1 librados: setting wanted keys 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 1 librados: calling monclient init 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: init 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding auth protocol: cephx 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding auth protocol: cephx 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding auth protocol: cephx 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.730 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: crc 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f1250b70) adding con mode: secure 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command rotate-key hook 0x55d7f1250cb8 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-a con 0x55d7f1101210 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-b con 0x55d7f11015f0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:02:37.731 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-c con 0x55d7f1196b00 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:02:37.561+0000 7f5f93e929c0 10 monclient(hunting): authenticate will time out at 2319.787394s 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): get_auth_request con 0x55d7f1101210 auth_method 0 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): get_auth_request con 0x55d7f1196b00 auth_method 0 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.732 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:02:37.561+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient(hunting): handle_auth_done global_id 6675 payload 824 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient: _finish_hunting 0 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:02:37.561+0000 7f5f91998640 1 monclient: found mon.noname-a 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:02:37.561+0000 7f5f91998640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: dump: 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.733 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: _finish_auth 0 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: _check_auth_tickets 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 5 monclient: authenticate success, global_id 6675 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:37.734 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:02:37.565+0000 7f5e7e604640 10 monclient: dump: 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:02:37.565+0000 7f5e7fe07640 4 set_mon_vals no callback set 2024-09-12T18:02:37.735 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:02:37.565+0000 7f5f93e929c0 1 librados: init done 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:02:37.565+0000 7f5e7e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:02:37.565+0000 7f5e7e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:02:37.565+0000 7f5e7e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:02:37.565+0000 7f5f91197640 10 monclient: get_auth_request con 0x7f5e78070ae0 auth_method 0 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:02:37.565+0000 7f5f92199640 10 monclient: get_auth_request con 0x55d7f1277470 auth_method 0 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:02:37.565+0000 7f5f91998640 10 monclient: get_auth_request con 0x55d7f129bea0 auth_method 0 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:02:37.569+0000 7f5f91197640 10 monclient: get_auth_request con 0x55d7f12a0090 auth_method 0 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient: build_initial_monmap 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient: monmap: 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:02:37.736 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding auth protocol: cephx 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding auth protocol: cephx 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding auth protocol: cephx 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.737 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: crc 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a4d20) adding con mode: secure 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d7f12a86d0 EEXIST 2024-09-12T18:02:37.738 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient: init 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding auth protocol: cephx 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding auth protocol: cephx 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding auth protocol: cephx 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.739 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: crc 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12a33a8) adding con mode: secure 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command rotate-key cmddesc rotate-key hook 0x55d7f12a34f0 EEXIST 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-a con 0x55d7f12cc880 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-c con 0x55d7f12cc1b0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-b con 0x55d7f12cab90 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.740 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:02:37.569+0000 7f5f93e929c0 10 monclient(hunting): authenticate will time out at 2319.795848s 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:02:37.569+0000 7f5f91998640 10 monclient(hunting): get_auth_request con 0x55d7f12cc880 auth_method 0 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:02:37.569+0000 7f5f91998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:02:37.569+0000 7f5f91998640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:02:37.569+0000 7f5f91998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): handle_auth_done global_id 6678 payload 824 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient: _finish_hunting 0 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:02:37.573+0000 7f5f91998640 1 monclient: found mon.noname-a 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.741 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:02:37.573+0000 7f5f92199640 10 monclient: get_auth_request con 0x55d7f12cab90 auth_method 0 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: dump: 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: _finish_auth 0 2024-09-12T18:02:37.742 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: _check_auth_tickets 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:02:37.573+0000 7f5e777fe640 10 monclient: dump: 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.743 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 monclient: authenticate success, global_id 6678 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:02:37.573+0000 7f5f9299a640 4 set_mon_vals no callback set 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:02:37.573+0000 7f5e777fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:02:37.573+0000 7f5e777fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:02:37.573+0000 7f5e777fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:02:37.573+0000 7f5f91197640 10 monclient: get_auth_request con 0x7f5e6c070a20 auth_method 0 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: get_monmap_and_config 2024-09-12T18:02:37.744 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: build_initial_monmap 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: monmap: 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding auth protocol: cephx 2024-09-12T18:02:37.745 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding auth protocol: cephx 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding auth protocol: cephx 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: crc 2024-09-12T18:02:37.746 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ec290) adding con mode: secure 2024-09-12T18:02:37.747 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.747 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: init 2024-09-12T18:02:37.747 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding auth protocol: cephx 2024-09-12T18:02:37.747 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding auth protocol: cephx 2024-09-12T18:02:37.747 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding auth protocol: cephx 2024-09-12T18:02:37.747 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.747 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.747 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.747 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.747 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: crc 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb2c00) adding con mode: secure 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc10fb2d48 EEXIST 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-a con 0x55d7f12f0460 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:02:37.748 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-c con 0x55d7f1324080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-b con 0x55d7f1327610 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:02:37.573+0000 7f5f93e929c0 10 monclient(hunting): authenticate will time out at 2319.799793s 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): get_auth_request con 0x55d7f12f0460 auth_method 0 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:02:37.573+0000 7f5f91197640 10 monclient(hunting): get_auth_request con 0x55d7f1324080 auth_method 0 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:02:37.573+0000 7f5f91197640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.749 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:02:37.573+0000 7f5f91197640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:02:37.573+0000 7f5f91197640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:02:37.573+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:02:37.577+0000 7f5f91197640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:02:37.577+0000 7f5f91197640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:02:37.577+0000 7f5f91197640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_done global_id 6681 payload 274 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient: _finish_hunting 0 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:02:37.577+0000 7f5f91998640 1 monclient: found mon.noname-a 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:02:37.750 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: dump: 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: _finish_auth 0 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: _check_auth_tickets 2024-09-12T18:02:37.751 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 monclient: authenticate success, global_id 6681 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 4 set_mon_vals no callback set 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:02:37.577+0000 7f5e757fa640 10 monclient: dump: 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.752 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: shutdown 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: build_initial_monmap 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: monmap: 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding auth protocol: cephx 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding auth protocol: cephx 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding auth protocol: cephx 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.754 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: crc 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f10df6f0) adding con mode: secure 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 librados: starting msgr at 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 librados: starting objecter 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d7f131e6a0 EEXIST 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 librados: setting wanted keys 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 librados: calling monclient init 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: init 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding auth protocol: cephx 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding auth protocol: cephx 2024-09-12T18:02:37.755 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding auth protocol: cephx 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: crc 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 AuthRegistry(0x55d7f12ce6a0) adding con mode: secure 2024-09-12T18:02:37.756 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.757 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.757 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command rotate-key cmddesc rotate-key hook 0x55d7f12ce7e8 EEXIST 2024-09-12T18:02:37.757 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:37.757 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:02:37.757 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-a con 0x55d7f12f0460 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:02:37.757 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-b con 0x55d7f1324080 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:02:37.757 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): picked mon.noname-c con 0x55d7f1327610 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:02:37.757 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.757 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.757 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient(hunting): authenticate will time out at 2319.802237s 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): get_auth_request con 0x55d7f1327610 auth_method 0 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): get_auth_request con 0x55d7f12f0460 auth_method 0 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.758 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:02:37.577+0000 7f5f91998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient(hunting): handle_auth_done global_id 6251 payload 824 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient: _finish_hunting 0 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:02:37.577+0000 7f5f92199640 1 monclient: found mon.noname-c 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:02:37.577+0000 7f5f92199640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: dump: 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.759 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: _finish_auth 0 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: _check_auth_tickets 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:02:37.577+0000 7f5e637fe640 10 monclient: dump: 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:02:37.760 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 monclient: authenticate success, global_id 6251 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:02:37.577+0000 7f5e757fa640 4 set_mon_vals no callback set 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _renew_subs 2024-09-12T18:02:37.761 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 1 librados: init done 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:02:37.577+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command cr dump hook 0x7f5f8c05bf78 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:02:37.581+0000 7f5e637fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:02:37.581+0000 7f5e637fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:02:37.581+0000 7f5e637fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:02:37.581+0000 7f5f91998640 10 monclient: get_auth_request con 0x7f5e5c070ae0 auth_method 0 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:02:37.581+0000 7f5f91197640 10 monclient: get_auth_request con 0x55d7f1341580 auth_method 0 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 realm 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.762 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:02:37.581+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:02:37.581+0000 7f5f91998640 10 monclient: get_auth_request con 0x55d7f1345960 auth_method 0 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:02:37.585+0000 7f5f91197640 10 monclient: get_auth_request con 0x55d7f1349080 auth_method 0 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:02:37.585+0000 7f5f93e929c0 20 searching for the correct realm 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:02:37.585+0000 7f5f92199640 10 monclient: get_auth_request con 0x55d7f134dd90 auth_method 0 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:02:37.585+0000 7f5f91998640 10 monclient: get_auth_request con 0x7f5f84061da0 auth_method 0 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:02:37.589+0000 7f5f91197640 10 monclient: get_auth_request con 0x7f5f7c0e7c00 auth_method 0 2024-09-12T18:02:37.763 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:02:37.593+0000 7f5f92199640 10 monclient: get_auth_request con 0x7f5f7c0f6450 auth_method 0 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:02:37.593+0000 7f5f92199640 0 -- 172.21.15.157:0/2969667688 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f5f7c0f6450 msgr2=0x7f5f7c0f68b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:02:37.593+0000 7f5e637fe640 1 client.6251.objecter ms_handle_reset 0x7f5f7c0f6450 session 0x7f5f7c0c6c90 osd.6 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:02:37.593+0000 7f5e637fe640 10 monclient: _renew_subs 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:02:37.593+0000 7f5e637fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:02:37.593+0000 7f5f92199640 10 monclient: get_auth_request con 0x7f5e5c080900 auth_method 0 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:02:37.597+0000 7f5f91998640 10 monclient: get_auth_request con 0x7f5f7c0f53e0 auth_method 0 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:02:37.601+0000 7f5f91998640 0 -- 172.21.15.157:0/2969667688 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55d7f1345960 msgr2=0x55d7f1347d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:02:37.601+0000 7f5e637fe640 1 client.6251.objecter ms_handle_reset 0x55d7f1345960 session 0x55d7f1344800 osd.5 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:02:37.601+0000 7f5f91998640 10 monclient: get_auth_request con 0x7f5f7c0f6450 auth_method 0 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:37.764 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 zone default found 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 4 Realm: () 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:37.765 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 zonegroup default 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 started sync module instance, tier type = 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:02:37.605+0000 7f5f93e929c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=0 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=1 2024-09-12T18:02:37.766 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=2 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=3 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=4 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=5 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:02:37.621+0000 7f5f93e929c0 20 add_watcher() i=6 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 add_watcher() i=7 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding auth protocol: cephx 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding auth protocol: cephx 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding auth protocol: cephx 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.767 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:02:37.625+0000 7f5e437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: crc 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 AuthRegistry(0x7ffc10fb30d0) adding con mode: secure 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command cache list hook 0x55d7f1324dd0 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command cache inspect hook 0x55d7f1324dd0 2024-09-12T18:02:37.768 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command cache erase hook 0x55d7f1324dd0 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command cache zap hook 0x55d7f1324dd0 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 note: GC not initialized 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:02:37.625+0000 7f5e427fc640 20 reqs_thread_entry: start 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command sync trace show hook 0x7f5f8c0022d0 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command sync trace history hook 0x7f5f8c0022d0 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command sync trace active hook 0x7f5f8c0022d0 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 5 asok(0x55d7f10472b0) register_command sync trace active_short hook 0x7f5f8c0022d0 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 Filter name: none 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:02:37.625+0000 7f5db3fff640 20 reqs_thread_entry: start 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:02:37.625+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:37.769 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 : miss 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 info.flags=0x17 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to cache LRU end 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:02:37.629+0000 7f5f93e929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:02:37.633+0000 7f5f93e929c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5f93e929c0 time 2024-09-12T18:02:37.638075+0000 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:37.770 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5f9776c2eb] 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5f9776c49f] 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7ef36a0c1] 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x140f6b8) [0x55d7efdbf6b8] 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7ef37c18d] 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5f965d2d90] 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:02:37.637+0000 7f5f93e929c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f5f93e929c0 thread_name:radosgw-admin 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:37.771 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5f965eb520] 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5f9776c345] 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5f9776c49f] 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7ef36a0c1] 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x140f6b8) [0x55d7efdbf6b8] 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7ef37c18d] 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5f965d2d90] 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:02:37.772 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:02:37.773 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:02:37.774 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:02:37.775 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:02:37.776 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:02:37.777 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:02:37.778 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:02:37.779 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5db3fff640 / http_manager 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e427fc640 / http_manager 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e437fe640 / rgw_dt_lg_renew 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e637fe640 / ms_dispatch 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e757fa640 / io_context_pool 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e777fe640 / ms_dispatch 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e7e604640 / ms_dispatch 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5e7fe07640 / io_context_pool 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5f91197640 / msgr-worker-2 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5f91998640 / msgr-worker-1 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5f92199640 / msgr-worker-0 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5f9299a640 / io_context_pool 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: 7f5f93e929c0 / radosgw-admin 2024-09-12T18:02:37.780 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:02:37.781 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:02:37.781 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:02:37.640528Z_6bf9f1b9-21cd-4923-a9af-e8dd95d499e4/log 2024-09-12T18:02:37.781 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:02:37.781 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:02:37.781 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T18:02:37.782 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:37.782 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:37.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.713+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 20 realm 2024-09-12T18:02:37.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:37.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:37.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.717+0000 7fec14edc9c0 20 searching for the correct realm 2024-09-12T18:02:37.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.725+0000 7fec131e3640 0 -- 172.21.15.157:0/2609364449 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fec080e1440 msgr2=0x7fec080e18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:37.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.941+0000 7fec129e2640 0 -- 172.21.15.157:0/2609364449 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5569891674e0 msgr2=0x5569891699a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.949+0000 7fec14edc9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:37.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.949+0000 7fec14edc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:37.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.949+0000 7fec14edc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:37.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.949+0000 7fec14edc9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:37.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.949+0000 7fec14edc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:37.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.949+0000 7fec14edc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:37.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.949+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.949+0000 7fec14edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.949+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:37.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 zone default found 2024-09-12T18:02:37.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 4 Realm: () 2024-09-12T18:02:37.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:37.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:37.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:37.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 zonegroup default 2024-09-12T18:02:37.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 started sync module instance, tier type = 2024-09-12T18:02:37.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.953+0000 7fec14edc9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:37.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.973+0000 7fec14edc9c0 20 add_watcher() i=0 2024-09-12T18:02:37.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.973+0000 7fec14edc9c0 20 add_watcher() i=1 2024-09-12T18:02:37.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.973+0000 7fec14edc9c0 20 add_watcher() i=2 2024-09-12T18:02:37.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.973+0000 7fec14edc9c0 20 add_watcher() i=3 2024-09-12T18:02:37.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.973+0000 7fec14edc9c0 20 add_watcher() i=4 2024-09-12T18:02:37.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.973+0000 7fec14edc9c0 20 add_watcher() i=5 2024-09-12T18:02:37.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.973+0000 7fec14edc9c0 20 add_watcher() i=6 2024-09-12T18:02:37.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.977+0000 7fec14edc9c0 20 add_watcher() i=7 2024-09-12T18:02:37.976 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.977+0000 7fec14edc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:37.980 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.981+0000 7feac97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:37.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.981+0000 7fec14edc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:37.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.981+0000 7fec14edc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:37.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.981+0000 7fec14edc9c0 5 note: GC not initialized 2024-09-12T18:02:37.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.981+0000 7fea43fff640 20 reqs_thread_entry: start 2024-09-12T18:02:37.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.981+0000 7fec14edc9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:37.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.981+0000 7fec14edc9c0 20 Filter name: none 2024-09-12T18:02:37.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.981+0000 7fea41ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:37.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.985+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.985+0000 7fec14edc9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:37.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.985+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.985+0000 7fec14edc9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:37.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.985+0000 7fec14edc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:37.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.985+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.985+0000 7fec14edc9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:37.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.985+0000 7fec14edc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.986 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.985+0000 7fec14edc9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:37.986 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.985+0000 7fec14edc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:37.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.989+0000 7feac97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:37.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.993+0000 7fec14edc9c0 20 remove_watcher() i=0 2024-09-12T18:02:37.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.993+0000 7fec14edc9c0 2 removed watcher, disabling cache 2024-09-12T18:02:37.996 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.997+0000 7fec14edc9c0 20 remove_watcher() i=1 2024-09-12T18:02:37.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:37.997+0000 7fec14edc9c0 20 remove_watcher() i=2 2024-09-12T18:02:38.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.001+0000 7fec14edc9c0 20 remove_watcher() i=3 2024-09-12T18:02:38.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.001+0000 7fec14edc9c0 20 remove_watcher() i=4 2024-09-12T18:02:38.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.005+0000 7fec14edc9c0 20 remove_watcher() i=5 2024-09-12T18:02:38.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.005+0000 7fec14edc9c0 20 remove_watcher() i=6 2024-09-12T18:02:38.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.009+0000 7fec14edc9c0 20 remove_watcher() i=7 2024-09-12T18:02:38.021 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:38.021 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:02:38.021 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-set-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:02:38.021 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:02:38.128 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:02:38.164 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:38.164 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:38.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.209+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.209+0000 7fd609a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.209+0000 7fd609a159c0 20 realm 2024-09-12T18:02:38.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.209+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.209+0000 7fd609a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.209+0000 7fd609a159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:38.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.209+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.209+0000 7fd609a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.209+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.213+0000 7fd609a159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:38.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.213+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.213+0000 7fd609a159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:38.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.213+0000 7fd609a159c0 20 searching for the correct realm 2024-09-12T18:02:38.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.217+0000 7fd606d1a640 0 -- 172.21.15.157:0/2150225801 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fd5f4032060 msgr2=0x7fd5f4063180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:38.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.225+0000 7fd606d1a640 0 -- 172.21.15.157:0/2150225801 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fd4d0080880 msgr2=0x7fd4d0082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:38.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:02:38.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:38.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:38.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:02:38.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:38.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:38.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 zone default found 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 4 Realm: () 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 zonegroup default 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.233+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.237+0000 7fd609a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.237+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.237+0000 7fd609a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.237+0000 7fd609a159c0 20 started sync module instance, tier type = 2024-09-12T18:02:38.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.237+0000 7fd609a159c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd609a159c0 20 add_watcher() i=0 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd609a159c0 20 add_watcher() i=1 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd609a159c0 20 add_watcher() i=2 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd609a159c0 20 add_watcher() i=3 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd609a159c0 20 add_watcher() i=4 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd609a159c0 20 add_watcher() i=5 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd609a159c0 20 add_watcher() i=6 2024-09-12T18:02:38.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd609a159c0 20 add_watcher() i=7 2024-09-12T18:02:38.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd609a159c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:38.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd4bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:38.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd609a159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:38.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.253+0000 7fd609a159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:38.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 5 note: GC not initialized 2024-09-12T18:02:38.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd437fff640 20 reqs_thread_entry: start 2024-09-12T18:02:38.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 20 init_complete bucket index max shards: 1 2024-09-12T18:02:38.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 20 Filter name: none 2024-09-12T18:02:38.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd435ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:38.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:02:38.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:38.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:02:38.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:02:38.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 : miss 2024-09-12T18:02:38.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:38.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 info.flags=0x17 2024-09-12T18:02:38.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to cache LRU end 2024-09-12T18:02:38.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:38.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:38.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.257+0000 7fd609a159c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 2024-09-12T18:02:38.259 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.261+0000 7fd609a159c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to be held by another RGW process; skipping for now 2024-09-12T18:02:38.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.261+0000 7fd4bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:38.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.265+0000 7fd609a159c0 20 remove_watcher() i=0 2024-09-12T18:02:38.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.265+0000 7fd609a159c0 2 removed watcher, disabling cache 2024-09-12T18:02:38.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.269+0000 7fd609a159c0 20 remove_watcher() i=1 2024-09-12T18:02:38.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.269+0000 7fd609a159c0 20 remove_watcher() i=2 2024-09-12T18:02:38.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.273+0000 7fd609a159c0 20 remove_watcher() i=3 2024-09-12T18:02:38.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.273+0000 7fd609a159c0 20 remove_watcher() i=4 2024-09-12T18:02:38.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.273+0000 7fd609a159c0 20 remove_watcher() i=5 2024-09-12T18:02:38.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.277+0000 7fd609a159c0 20 remove_watcher() i=6 2024-09-12T18:02:38.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:02:38.277+0000 7fd609a159c0 20 remove_watcher() i=7 2024-09-12T18:02:38.289 INFO:tasks.workunit.client.0.smithi157.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:03:08.315 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:03:08.352 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:08.353 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:08.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.397+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.397+0000 7f44853b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.397+0000 7f44853b29c0 20 realm 2024-09-12T18:03:08.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.401+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.401+0000 7f44853b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.401+0000 7f44853b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:08.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.401+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.401+0000 7f44853b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.401+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.401+0000 7f44853b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:08.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.401+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.401+0000 7f44853b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:08.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.401+0000 7f44853b29c0 20 searching for the correct realm 2024-09-12T18:03:08.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.409+0000 7f44836b9640 0 -- 172.21.15.157:0/1163211607 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x55f34e394d60 msgr2=0x55f34e397220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:08.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.413+0000 7f4482eb8640 0 -- 172.21.15.157:0/1163211607 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f446c0e0570 msgr2=0x7f446c113040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:08.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.629+0000 7f44853b29c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:08.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.629+0000 7f44853b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:08.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.629+0000 7f44853b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:08.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.629+0000 7f44853b29c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:08.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.629+0000 7f44853b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:08.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.629+0000 7f44853b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:08.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.629+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.629+0000 7f44853b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.629+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:08.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:08.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 zone default found 2024-09-12T18:03:08.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 4 Realm: () 2024-09-12T18:03:08.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:08.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:08.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:08.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 zonegroup default 2024-09-12T18:03:08.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 started sync module instance, tier type = 2024-09-12T18:03:08.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.633+0000 7f44853b29c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:08.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.657+0000 7f44853b29c0 20 add_watcher() i=0 2024-09-12T18:03:08.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.657+0000 7f44853b29c0 20 add_watcher() i=1 2024-09-12T18:03:08.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.657+0000 7f44853b29c0 20 add_watcher() i=2 2024-09-12T18:03:08.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.657+0000 7f44853b29c0 20 add_watcher() i=3 2024-09-12T18:03:08.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.657+0000 7f44853b29c0 20 add_watcher() i=4 2024-09-12T18:03:08.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.657+0000 7f44853b29c0 20 add_watcher() i=5 2024-09-12T18:03:08.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.657+0000 7f44853b29c0 20 add_watcher() i=6 2024-09-12T18:03:08.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.661+0000 7f44853b29c0 20 add_watcher() i=7 2024-09-12T18:03:08.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.661+0000 7f44853b29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:08.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.665+0000 7f43397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:08.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.665+0000 7f44853b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:08.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.665+0000 7f44853b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:08.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.665+0000 7f44853b29c0 5 note: GC not initialized 2024-09-12T18:03:08.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.665+0000 7f42b3fff640 20 reqs_thread_entry: start 2024-09-12T18:03:08.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.665+0000 7f44853b29c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:08.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.665+0000 7f44853b29c0 20 Filter name: none 2024-09-12T18:03:08.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f42b1ffb640 20 reqs_thread_entry: start 2024-09-12T18:03:08.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:03:08.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:08.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:03:08.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:03:08.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 : miss 2024-09-12T18:03:08.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:08.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 info.flags=0x17 2024-09-12T18:03:08.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to cache LRU end 2024-09-12T18:03:08.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:08.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:08.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.669+0000 7f44853b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 2024-09-12T18:03:08.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.677+0000 7f44853b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 info.flags=0x17 2024-09-12T18:03:08.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.677+0000 7f44853b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to cache LRU end 2024-09-12T18:03:08.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.677+0000 7f44853b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:08.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.677+0000 7f44853b29c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24, ofs0, ns] 2024-09-12T18:03:08.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.677+0000 7f43667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464272 cookie 94503477813392 notifier 6744 bl.length()=925 2024-09-12T18:03:08.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.677+0000 7f43667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 info.flags=0x17 2024-09-12T18:03:08.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.677+0000 7f43667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to cache LRU end 2024-09-12T18:03:08.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.677+0000 7f43667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:08.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.681+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): orig_sources= new_sources= 2024-09-12T18:03:08.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.681+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): potential sources added=[] removed=[] 2024-09-12T18:03:08.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.681+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): orig_dests= new_dests= 2024-09-12T18:03:08.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.681+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): potential dests added=[] removed=[] 2024-09-12T18:03:08.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.685+0000 7f44853b29c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24.1.0 2024-09-12T18:03:08.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.685+0000 7f44853b29c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24.1.0 2024-09-12T18:03:08.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.685+0000 7f44853b29c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24.1.1 2024-09-12T18:03:08.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.685+0000 7f44853b29c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24.1.1 2024-09-12T18:03:08.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.685+0000 7f44853b29c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24.0 2024-09-12T18:03:08.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.689+0000 7f44853b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:08.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.689+0000 7f44853b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 2024-09-12T18:03:08.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f44853b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 info.flags=0x17 2024-09-12T18:03:08.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f44853b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to cache LRU end 2024-09-12T18:03:08.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f44853b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:08.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f44853b29c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24, ofs0, ns] 2024-09-12T18:03:08.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f43667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464273 cookie 94503477813392 notifier 6744 bl.length()=925 2024-09-12T18:03:08.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f43667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 info.flags=0x17 2024-09-12T18:03:08.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f43667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to cache LRU end 2024-09-12T18:03:08.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f43667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:08.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): orig_sources= new_sources= 2024-09-12T18:03:08.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): potential sources added=[] removed=[] 2024-09-12T18:03:08.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): orig_dests= new_dests= 2024-09-12T18:03:08.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): potential dests added=[] removed=[] 2024-09-12T18:03:08.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.693+0000 7f44853b29c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24.0 2024-09-12T18:03:08.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.697+0000 7f44853b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:08.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.697+0000 7f44853b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 2024-09-12T18:03:08.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.697+0000 7f44853b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 info.flags=0x17 2024-09-12T18:03:08.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.697+0000 7f44853b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to cache LRU end 2024-09-12T18:03:08.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.697+0000 7f44853b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:08.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.697+0000 7f44853b29c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24, ofs0, ns] 2024-09-12T18:03:08.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.701+0000 7f43667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 94503477813392 notifier 6744 bl.length()=893 2024-09-12T18:03:08.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.701+0000 7f43667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 info.flags=0x17 2024-09-12T18:03:08.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.701+0000 7f43667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 to cache LRU end 2024-09-12T18:03:08.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.701+0000 7f43667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:08.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.701+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): orig_sources= new_sources= 2024-09-12T18:03:08.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.701+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): potential sources added=[] removed=[] 2024-09-12T18:03:08.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.701+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): orig_dests= new_dests= 2024-09-12T18:03:08.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.701+0000 7f44853b29c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24]): potential dests added=[] removed=[] 2024-09-12T18:03:08.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.701+0000 7f44853b29c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T18:03:08.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.709+0000 7f43397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:08.711 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.713+0000 7f44853b29c0 20 remove_watcher() i=0 2024-09-12T18:03:08.711 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.713+0000 7f44853b29c0 2 removed watcher, disabling cache 2024-09-12T18:03:08.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.713+0000 7f44853b29c0 20 remove_watcher() i=1 2024-09-12T18:03:08.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.717+0000 7f44853b29c0 20 remove_watcher() i=2 2024-09-12T18:03:08.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.717+0000 7f44853b29c0 20 remove_watcher() i=3 2024-09-12T18:03:08.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.721+0000 7f44853b29c0 20 remove_watcher() i=4 2024-09-12T18:03:08.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.721+0000 7f44853b29c0 20 remove_watcher() i=5 2024-09-12T18:03:08.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.725+0000 7f44853b29c0 20 remove_watcher() i=6 2024-09-12T18:03:08.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.725+0000 7f44853b29c0 20 remove_watcher() i=7 2024-09-12T18:03:08.741 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T18:03:08.771 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:08.771 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:08.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.813+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 20 realm 2024-09-12T18:03:08.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:08.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:08.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:08.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.817+0000 7f4cd4f579c0 20 searching for the correct realm 2024-09-12T18:03:08.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.825+0000 7f4cd225c640 0 -- 172.21.15.157:0/4142726312 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f4cc80c8070 msgr2=0x7f4cc80ad710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:08.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.829+0000 7f4cd225c640 0 -- 172.21.15.157:0/4142726312 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f4b9c080900 msgr2=0x7f4b9c082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:08.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.837+0000 7f4cd4f579c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:08.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.837+0000 7f4cd4f579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:08.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.837+0000 7f4cd4f579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:08.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.837+0000 7f4cd4f579c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:08.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.837+0000 7f4cd4f579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:08.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.837+0000 7f4cd4f579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:08.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.837+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.837+0000 7f4cd4f579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.837+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.837+0000 7f4cd4f579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:08.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.837+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:08.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 20 zone default found 2024-09-12T18:03:08.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 4 Realm: () 2024-09-12T18:03:08.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:08.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:08.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:08.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 20 zonegroup default 2024-09-12T18:03:08.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 20 started sync module instance, tier type = 2024-09-12T18:03:08.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.841+0000 7f4cd4f579c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:08.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.857+0000 7f4cd4f579c0 20 add_watcher() i=0 2024-09-12T18:03:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.857+0000 7f4cd4f579c0 20 add_watcher() i=1 2024-09-12T18:03:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.857+0000 7f4cd4f579c0 20 add_watcher() i=2 2024-09-12T18:03:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.857+0000 7f4cd4f579c0 20 add_watcher() i=3 2024-09-12T18:03:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.857+0000 7f4cd4f579c0 20 add_watcher() i=4 2024-09-12T18:03:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.857+0000 7f4cd4f579c0 20 add_watcher() i=5 2024-09-12T18:03:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.857+0000 7f4cd4f579c0 20 add_watcher() i=6 2024-09-12T18:03:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.857+0000 7f4cd4f579c0 20 add_watcher() i=7 2024-09-12T18:03:08.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.857+0000 7f4cd4f579c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:08.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4b897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:08.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4cd4f579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:08.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4cd4f579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:08.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4cd4f579c0 5 note: GC not initialized 2024-09-12T18:03:08.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4b03fff640 20 reqs_thread_entry: start 2024-09-12T18:03:08.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4cd4f579c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:08.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4cd4f579c0 20 Filter name: none 2024-09-12T18:03:08.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4b01ffb640 20 reqs_thread_entry: start 2024-09-12T18:03:08.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4cd4f579c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:08.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4cd4f579c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:08.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4cd4f579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:08.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.861+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.865+0000 7f4cd4f579c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:08.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.865+0000 7f4cd4f579c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.865+0000 7f4cd4f579c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:08.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.865+0000 7f4cd4f579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:08.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.865+0000 7f4b897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:08.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.869+0000 7f4cd4f579c0 20 remove_watcher() i=0 2024-09-12T18:03:08.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.869+0000 7f4cd4f579c0 2 removed watcher, disabling cache 2024-09-12T18:03:08.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.873+0000 7f4cd4f579c0 20 remove_watcher() i=1 2024-09-12T18:03:08.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.873+0000 7f4cd4f579c0 20 remove_watcher() i=2 2024-09-12T18:03:08.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.877+0000 7f4cd4f579c0 20 remove_watcher() i=3 2024-09-12T18:03:08.876 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.877+0000 7f4cd4f579c0 20 remove_watcher() i=4 2024-09-12T18:03:08.877 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.877+0000 7f4cd4f579c0 20 remove_watcher() i=5 2024-09-12T18:03:08.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.881+0000 7f4cd4f579c0 20 remove_watcher() i=6 2024-09-12T18:03:08.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:08.881+0000 7f4cd4f579c0 20 remove_watcher() i=7 2024-09-12T18:03:08.893 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:08.893 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:08.893 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-set-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:03:08.893 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:09.588 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T18:03:09.589 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:11.717 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:03:11.749 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:11.749 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:11.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.793+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.793+0000 7f3148a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.793+0000 7f3148a7c9c0 20 realm 2024-09-12T18:03:11.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.793+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.797+0000 7f3148a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.797+0000 7f3148a7c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:11.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.797+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.797+0000 7f3148a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.797+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.797+0000 7f3148a7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:11.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.797+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.797+0000 7f3148a7c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:11.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.797+0000 7f3148a7c9c0 20 searching for the correct realm 2024-09-12T18:03:11.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.805+0000 7f3146d83640 0 -- 172.21.15.157:0/3873065449 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x5582c30f5c30 msgr2=0x5582c30f8020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:11.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.809+0000 7f3145d81640 0 -- 172.21.15.157:0/3873065449 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f313c1090c0 msgr2=0x7f313c101050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 zone default found 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 4 Realm: () 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:11.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:11.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 zonegroup default 2024-09-12T18:03:11.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.817+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.821+0000 7f3148a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.821+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.821+0000 7f3148a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.821+0000 7f3148a7c9c0 20 started sync module instance, tier type = 2024-09-12T18:03:11.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.821+0000 7f3148a7c9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:11.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.833+0000 7f3148a7c9c0 20 add_watcher() i=0 2024-09-12T18:03:11.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.833+0000 7f3148a7c9c0 20 add_watcher() i=1 2024-09-12T18:03:11.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.833+0000 7f3148a7c9c0 20 add_watcher() i=2 2024-09-12T18:03:11.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.833+0000 7f3148a7c9c0 20 add_watcher() i=3 2024-09-12T18:03:11.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.833+0000 7f3148a7c9c0 20 add_watcher() i=4 2024-09-12T18:03:11.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.833+0000 7f3148a7c9c0 20 add_watcher() i=5 2024-09-12T18:03:11.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.833+0000 7f3148a7c9c0 20 add_watcher() i=6 2024-09-12T18:03:11.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.837+0000 7f3148a7c9c0 20 add_watcher() i=7 2024-09-12T18:03:11.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.837+0000 7f3148a7c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:11.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.837+0000 7f2ffd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:11.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.837+0000 7f3148a7c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:11.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.837+0000 7f3148a7c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:11.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.837+0000 7f3148a7c9c0 5 note: GC not initialized 2024-09-12T18:03:11.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.837+0000 7f2ff77fe640 20 reqs_thread_entry: start 2024-09-12T18:03:11.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.837+0000 7f3148a7c9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:11.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.837+0000 7f3148a7c9c0 20 Filter name: none 2024-09-12T18:03:11.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.841+0000 7f2ff57fa640 20 reqs_thread_entry: start 2024-09-12T18:03:11.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.841+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.841+0000 7f3148a7c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:11.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.841+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.841+0000 7f3148a7c9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:11.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.841+0000 7f3148a7c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:11.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.841+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.841+0000 7f3148a7c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:11.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.841+0000 7f3148a7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.841+0000 7f3148a7c9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:11.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.841+0000 7f3148a7c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:11.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.845+0000 7f2ffd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:11.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.849+0000 7f3148a7c9c0 20 remove_watcher() i=0 2024-09-12T18:03:11.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.849+0000 7f3148a7c9c0 2 removed watcher, disabling cache 2024-09-12T18:03:11.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.849+0000 7f3148a7c9c0 20 remove_watcher() i=1 2024-09-12T18:03:11.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.853+0000 7f3148a7c9c0 20 remove_watcher() i=2 2024-09-12T18:03:11.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.853+0000 7f3148a7c9c0 20 remove_watcher() i=3 2024-09-12T18:03:11.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.857+0000 7f3148a7c9c0 20 remove_watcher() i=4 2024-09-12T18:03:11.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.857+0000 7f3148a7c9c0 20 remove_watcher() i=5 2024-09-12T18:03:11.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.861+0000 7f3148a7c9c0 20 remove_watcher() i=6 2024-09-12T18:03:11.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.861+0000 7f3148a7c9c0 20 remove_watcher() i=7 2024-09-12T18:03:11.873 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:11.873 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:11.873 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-trim-reshard-log-entries id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:03:11.873 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:11.874 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T18:03:11.906 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:11.906 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:11.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.949+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 20 realm 2024-09-12T18:03:11.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:11.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:11.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:11.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.953+0000 7f462baee9c0 20 searching for the correct realm 2024-09-12T18:03:11.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:11.961+0000 7f4629df5640 0 -- 172.21.15.157:0/3866047241 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f4620018070 msgr2=0x7f462005bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.177+0000 7f46295f4640 0 -- 172.21.15.157:0/3866047241 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x561a194e3940 msgr2=0x561a194e5d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.185+0000 7f462baee9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:12.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.185+0000 7f462baee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:12.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.185+0000 7f462baee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:12.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.185+0000 7f462baee9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:12.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.185+0000 7f462baee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:12.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.185+0000 7f462baee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:12.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.185+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.185+0000 7f462baee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.185+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.185+0000 7f462baee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.185+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:12.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 20 zone default found 2024-09-12T18:03:12.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 4 Realm: () 2024-09-12T18:03:12.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:12.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:12.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:12.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 20 zonegroup default 2024-09-12T18:03:12.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 20 started sync module instance, tier type = 2024-09-12T18:03:12.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.189+0000 7f462baee9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:12.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.213+0000 7f462baee9c0 20 add_watcher() i=0 2024-09-12T18:03:12.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.213+0000 7f462baee9c0 20 add_watcher() i=1 2024-09-12T18:03:12.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.213+0000 7f462baee9c0 20 add_watcher() i=2 2024-09-12T18:03:12.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.213+0000 7f462baee9c0 20 add_watcher() i=3 2024-09-12T18:03:12.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.213+0000 7f462baee9c0 20 add_watcher() i=4 2024-09-12T18:03:12.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.213+0000 7f462baee9c0 20 add_watcher() i=5 2024-09-12T18:03:12.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.213+0000 7f462baee9c0 20 add_watcher() i=6 2024-09-12T18:03:12.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.217+0000 7f462baee9c0 20 add_watcher() i=7 2024-09-12T18:03:12.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.217+0000 7f462baee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:12.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f44dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:12.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:12.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 5 note: GC not initialized 2024-09-12T18:03:12.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f44defe5640 20 reqs_thread_entry: start 2024-09-12T18:03:12.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:12.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 20 Filter name: none 2024-09-12T18:03:12.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f44dcfe1640 20 reqs_thread_entry: start 2024-09-12T18:03:12.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T18:03:12.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:12.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:12.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:12.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 : miss 2024-09-12T18:03:12.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.221+0000 7f462baee9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.225+0000 7f462baee9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:12.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.225+0000 7f462baee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 info.flags=0x17 2024-09-12T18:03:12.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.225+0000 7f462baee9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 to cache LRU end 2024-09-12T18:03:12.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.225+0000 7f462baee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:12.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.225+0000 7f462baee9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:12.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.225+0000 7f462baee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 2024-09-12T18:03:12.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.229+0000 7f462baee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 info.flags=0x17 2024-09-12T18:03:12.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.229+0000 7f462baee9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 to cache LRU end 2024-09-12T18:03:12.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.229+0000 7f462baee9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:12.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.229+0000 7f462baee9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25, ofs0, ns] 2024-09-12T18:03:12.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.229+0000 7f450cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464312 cookie 94670093703264 notifier 6353 bl.length()=939 2024-09-12T18:03:12.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.229+0000 7f450cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 info.flags=0x17 2024-09-12T18:03:12.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.229+0000 7f450cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 to cache LRU end 2024-09-12T18:03:12.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.229+0000 7f450cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:12.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.233+0000 7f462baee9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): orig_sources= new_sources= 2024-09-12T18:03:12.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.233+0000 7f462baee9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): potential sources added=[] removed=[] 2024-09-12T18:03:12.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.233+0000 7f462baee9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): orig_dests= new_dests= 2024-09-12T18:03:12.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.233+0000 7f462baee9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): potential dests added=[] removed=[] 2024-09-12T18:03:12.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.233+0000 7f462baee9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T18:03:12.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.233+0000 7f462baee9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T18:03:12.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.237+0000 7f44dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.241+0000 7f462baee9c0 20 remove_watcher() i=0 2024-09-12T18:03:12.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.241+0000 7f462baee9c0 2 removed watcher, disabling cache 2024-09-12T18:03:12.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.245+0000 7f462baee9c0 20 remove_watcher() i=1 2024-09-12T18:03:12.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.245+0000 7f462baee9c0 20 remove_watcher() i=2 2024-09-12T18:03:12.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.249+0000 7f462baee9c0 20 remove_watcher() i=3 2024-09-12T18:03:12.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.249+0000 7f462baee9c0 20 remove_watcher() i=4 2024-09-12T18:03:12.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.253+0000 7f462baee9c0 20 remove_watcher() i=5 2024-09-12T18:03:12.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.253+0000 7f462baee9c0 20 remove_watcher() i=6 2024-09-12T18:03:12.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.253+0000 7f462baee9c0 20 remove_watcher() i=7 2024-09-12T18:03:12.276 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:03:12.304 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:12.305 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:12.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.353+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.353+0000 7ff4383819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.353+0000 7ff4383819c0 20 realm 2024-09-12T18:03:12.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.353+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.353+0000 7ff4383819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.353+0000 7ff4383819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:12.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.353+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.353+0000 7ff4383819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.353+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.357+0000 7ff4383819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.357+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.357+0000 7ff4383819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:12.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.357+0000 7ff4383819c0 20 searching for the correct realm 2024-09-12T18:03:12.358 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.361+0000 7ff435686640 0 -- 172.21.15.157:0/2750544162 >> [v2:172.21.15.157:6800/2182114182,v1:172.21.15.157:6801/2182114182] conn(0x5608fe1885b0 msgr2=0x5608fe18a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.365+0000 7ff435e87640 0 -- 172.21.15.157:0/2750544162 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7ff430079040 msgr2=0x7ff43005f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:12.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:12.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:12.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:12.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:12.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:12.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:12.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 zone default found 2024-09-12T18:03:12.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 4 Realm: () 2024-09-12T18:03:12.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:12.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:12.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:12.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 zonegroup default 2024-09-12T18:03:12.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 started sync module instance, tier type = 2024-09-12T18:03:12.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.377+0000 7ff4383819c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:12.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.393+0000 7ff4383819c0 20 add_watcher() i=0 2024-09-12T18:03:12.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.393+0000 7ff4383819c0 20 add_watcher() i=1 2024-09-12T18:03:12.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.393+0000 7ff4383819c0 20 add_watcher() i=2 2024-09-12T18:03:12.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.393+0000 7ff4383819c0 20 add_watcher() i=3 2024-09-12T18:03:12.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.393+0000 7ff4383819c0 20 add_watcher() i=4 2024-09-12T18:03:12.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.393+0000 7ff4383819c0 20 add_watcher() i=5 2024-09-12T18:03:12.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.393+0000 7ff4383819c0 20 add_watcher() i=6 2024-09-12T18:03:12.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.397+0000 7ff4383819c0 20 add_watcher() i=7 2024-09-12T18:03:12.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.397+0000 7ff4383819c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:12.396 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.397+0000 7ff2e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.397+0000 7ff4383819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:12.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.397+0000 7ff4383819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:12.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.397+0000 7ff4383819c0 5 note: GC not initialized 2024-09-12T18:03:12.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.397+0000 7ff2e67fc640 20 reqs_thread_entry: start 2024-09-12T18:03:12.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.397+0000 7ff4383819c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:12.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.397+0000 7ff4383819c0 20 Filter name: none 2024-09-12T18:03:12.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.397+0000 7ff257fff640 20 reqs_thread_entry: start 2024-09-12T18:03:12.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.397+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.401+0000 7ff4383819c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:12.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.401+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.401+0000 7ff4383819c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:12.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.401+0000 7ff4383819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:12.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.401+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.401+0000 7ff4383819c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:12.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.401+0000 7ff4383819c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.401+0000 7ff4383819c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:12.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.401+0000 7ff4383819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:12.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.405+0000 7ff2e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.409+0000 7ff4383819c0 20 remove_watcher() i=0 2024-09-12T18:03:12.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.409+0000 7ff4383819c0 2 removed watcher, disabling cache 2024-09-12T18:03:12.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.409+0000 7ff4383819c0 20 remove_watcher() i=1 2024-09-12T18:03:12.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.413+0000 7ff4383819c0 20 remove_watcher() i=2 2024-09-12T18:03:12.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.413+0000 7ff4383819c0 20 remove_watcher() i=3 2024-09-12T18:03:12.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.417+0000 7ff4383819c0 20 remove_watcher() i=4 2024-09-12T18:03:12.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.417+0000 7ff4383819c0 20 remove_watcher() i=5 2024-09-12T18:03:12.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.417+0000 7ff4383819c0 20 remove_watcher() i=6 2024-09-12T18:03:12.418 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.421+0000 7ff4383819c0 20 remove_watcher() i=7 2024-09-12T18:03:12.432 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:12.432 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:12.433 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-trim-reshard-log-entries id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:03:12.433 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:12.540 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:03:12.575 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:12.575 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:12.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.621+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.621+0000 7fb49caa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.621+0000 7fb49caa79c0 20 realm 2024-09-12T18:03:12.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.621+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.621+0000 7fb49caa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.621+0000 7fb49caa79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:12.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.621+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.621+0000 7fb49caa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.621+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.625+0000 7fb49caa79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.625+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.625+0000 7fb49caa79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:12.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.625+0000 7fb49caa79c0 20 searching for the correct realm 2024-09-12T18:03:12.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.629+0000 7fb499dac640 0 -- 172.21.15.157:0/259399638 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fb490004040 msgr2=0x7fb4900b69a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.635 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.637+0000 7fb499dac640 0 -- 172.21.15.157:0/259399638 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fb364080930 msgr2=0x7fb364082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:12.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:12.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:12.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:12.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:12.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:12.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:12.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 zone default found 2024-09-12T18:03:12.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 4 Realm: () 2024-09-12T18:03:12.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:12.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:12.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:12.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 zonegroup default 2024-09-12T18:03:12.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 started sync module instance, tier type = 2024-09-12T18:03:12.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.645+0000 7fb49caa79c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:12.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.661+0000 7fb49caa79c0 20 add_watcher() i=0 2024-09-12T18:03:12.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.661+0000 7fb49caa79c0 20 add_watcher() i=1 2024-09-12T18:03:12.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.661+0000 7fb49caa79c0 20 add_watcher() i=2 2024-09-12T18:03:12.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.661+0000 7fb49caa79c0 20 add_watcher() i=3 2024-09-12T18:03:12.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.661+0000 7fb49caa79c0 20 add_watcher() i=4 2024-09-12T18:03:12.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.661+0000 7fb49caa79c0 20 add_watcher() i=5 2024-09-12T18:03:12.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.661+0000 7fb49caa79c0 20 add_watcher() i=6 2024-09-12T18:03:12.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.661+0000 7fb49caa79c0 20 add_watcher() i=7 2024-09-12T18:03:12.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.661+0000 7fb49caa79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:12.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb350fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 5 note: GC not initialized 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb2cb7fe640 20 reqs_thread_entry: start 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 20 Filter name: none 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb2c97fa640 20 reqs_thread_entry: start 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:12.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:12.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:12.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 : miss 2024-09-12T18:03:12.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.665+0000 7fb49caa79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.669+0000 7fb49caa79c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:12.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.669+0000 7fb49caa79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 info.flags=0x17 2024-09-12T18:03:12.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.669+0000 7fb49caa79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 to cache LRU end 2024-09-12T18:03:12.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.669+0000 7fb49caa79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:12.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.669+0000 7fb49caa79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:12.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.669+0000 7fb49caa79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 2024-09-12T18:03:12.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.669+0000 7fb49caa79c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:03:12.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.673+0000 7fb49caa79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 info.flags=0x17 2024-09-12T18:03:12.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.673+0000 7fb49caa79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 to cache LRU end 2024-09-12T18:03:12.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.673+0000 7fb49caa79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:12.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.673+0000 7fb49caa79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25, ofs0, ns] 2024-09-12T18:03:12.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.677+0000 7fb37dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464313 cookie 94012633595424 notifier 6383 bl.length()=939 2024-09-12T18:03:12.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.677+0000 7fb37dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 info.flags=0x17 2024-09-12T18:03:12.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.677+0000 7fb37dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 to cache LRU end 2024-09-12T18:03:12.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.677+0000 7fb37dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:12.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.677+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): orig_sources= new_sources= 2024-09-12T18:03:12.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.677+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): potential sources added=[] removed=[] 2024-09-12T18:03:12.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.677+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): orig_dests= new_dests= 2024-09-12T18:03:12.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.677+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): potential dests added=[] removed=[] 2024-09-12T18:03:12.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.681+0000 7fb49caa79c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25.2.0 2024-09-12T18:03:12.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.681+0000 7fb49caa79c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25.2.0 2024-09-12T18:03:12.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.681+0000 7fb49caa79c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25.2.1 2024-09-12T18:03:12.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.681+0000 7fb49caa79c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25.2.1 2024-09-12T18:03:12.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.681+0000 7fb49caa79c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25.0 2024-09-12T18:03:12.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.685+0000 7fb49caa79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:12.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.685+0000 7fb49caa79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 2024-09-12T18:03:12.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.685+0000 7fb49caa79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 info.flags=0x17 2024-09-12T18:03:12.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.685+0000 7fb49caa79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 to cache LRU end 2024-09-12T18:03:12.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.685+0000 7fb49caa79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:12.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.685+0000 7fb49caa79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25, ofs0, ns] 2024-09-12T18:03:12.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.685+0000 7fb37d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464314 cookie 94012633595424 notifier 6383 bl.length()=939 2024-09-12T18:03:12.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.685+0000 7fb37d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 info.flags=0x17 2024-09-12T18:03:12.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.685+0000 7fb37d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 to cache LRU end 2024-09-12T18:03:12.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.685+0000 7fb37d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:12.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.689+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): orig_sources= new_sources= 2024-09-12T18:03:12.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.689+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): potential sources added=[] removed=[] 2024-09-12T18:03:12.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.689+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): orig_dests= new_dests= 2024-09-12T18:03:12.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.689+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): potential dests added=[] removed=[] 2024-09-12T18:03:12.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.689+0000 7fb49caa79c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25.0 2024-09-12T18:03:12.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.689+0000 7fb49caa79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:12.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.689+0000 7fb49caa79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 2024-09-12T18:03:12.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.689+0000 7fb49caa79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 info.flags=0x17 2024-09-12T18:03:12.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.689+0000 7fb49caa79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 to cache LRU end 2024-09-12T18:03:12.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.689+0000 7fb49caa79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:12.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.689+0000 7fb49caa79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25, ofs0, ns] 2024-09-12T18:03:12.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.693+0000 7fb37dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464315 cookie 94012633595424 notifier 6383 bl.length()=907 2024-09-12T18:03:12.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.693+0000 7fb37dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 info.flags=0x17 2024-09-12T18:03:12.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.693+0000 7fb37dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 to cache LRU end 2024-09-12T18:03:12.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.693+0000 7fb37dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:12.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.693+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): orig_sources= new_sources= 2024-09-12T18:03:12.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.693+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): potential sources added=[] removed=[] 2024-09-12T18:03:12.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.693+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): orig_dests= new_dests= 2024-09-12T18:03:12.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.693+0000 7fb49caa79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25]): potential dests added=[] removed=[] 2024-09-12T18:03:12.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.697+0000 7fb49caa79c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T18:03:12.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.697+0000 7fb350fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.701+0000 7fb49caa79c0 20 remove_watcher() i=0 2024-09-12T18:03:12.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.701+0000 7fb49caa79c0 2 removed watcher, disabling cache 2024-09-12T18:03:12.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.705+0000 7fb49caa79c0 20 remove_watcher() i=1 2024-09-12T18:03:12.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.705+0000 7fb49caa79c0 20 remove_watcher() i=2 2024-09-12T18:03:12.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.709+0000 7fb49caa79c0 20 remove_watcher() i=3 2024-09-12T18:03:12.709 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.709+0000 7fb49caa79c0 20 remove_watcher() i=4 2024-09-12T18:03:12.711 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.713+0000 7fb49caa79c0 20 remove_watcher() i=5 2024-09-12T18:03:12.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.713+0000 7fb49caa79c0 20 remove_watcher() i=6 2024-09-12T18:03:12.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.713+0000 7fb49caa79c0 20 remove_watcher() i=7 2024-09-12T18:03:12.726 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:03:12.753 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:12.753 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:12.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.797+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.797+0000 7fa3997b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.797+0000 7fa3997b49c0 20 realm 2024-09-12T18:03:12.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.797+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.797+0000 7fa3997b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.797+0000 7fa3997b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:12.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.797+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.797+0000 7fa3997b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.797+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.801+0000 7fa3997b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.801+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.801+0000 7fa3997b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:12.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.801+0000 7fa3997b49c0 20 searching for the correct realm 2024-09-12T18:03:12.804 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.805+0000 7fa397abb640 0 -- 172.21.15.157:0/3084097699 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55befc674f30 msgr2=0x55befc677340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:12.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.813+0000 7fa3972ba640 0 -- 172.21.15.157:0/3084097699 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fa380045520 msgr2=0x7fa380043a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 zone default found 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 4 Realm: () 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 zonegroup default 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 started sync module instance, tier type = 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.821+0000 7fa3997b49c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:12.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.837+0000 7fa3997b49c0 20 add_watcher() i=0 2024-09-12T18:03:12.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.837+0000 7fa3997b49c0 20 add_watcher() i=1 2024-09-12T18:03:12.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.837+0000 7fa3997b49c0 20 add_watcher() i=2 2024-09-12T18:03:12.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.837+0000 7fa3997b49c0 20 add_watcher() i=3 2024-09-12T18:03:12.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.837+0000 7fa3997b49c0 20 add_watcher() i=4 2024-09-12T18:03:12.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.837+0000 7fa3997b49c0 20 add_watcher() i=5 2024-09-12T18:03:12.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.837+0000 7fa3997b49c0 20 add_watcher() i=6 2024-09-12T18:03:12.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.837+0000 7fa3997b49c0 20 add_watcher() i=7 2024-09-12T18:03:12.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.837+0000 7fa3997b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:12.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.841+0000 7fa24dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.841+0000 7fa3997b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.841+0000 7fa3997b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.841+0000 7fa3997b49c0 5 note: GC not initialized 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.841+0000 7fa24cfe1640 20 reqs_thread_entry: start 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.841+0000 7fa3997b49c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.841+0000 7fa3997b49c0 20 Filter name: none 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.841+0000 7fa1c67fc640 20 reqs_thread_entry: start 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.841+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.845+0000 7fa3997b49c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:12.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.845+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.845+0000 7fa3997b49c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:12.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.845+0000 7fa3997b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:12.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.845+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.845+0000 7fa3997b49c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:12.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.845+0000 7fa3997b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.845+0000 7fa3997b49c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:12.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.845+0000 7fa3997b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:12.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.845+0000 7fa24dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.849+0000 7fa3997b49c0 20 remove_watcher() i=0 2024-09-12T18:03:12.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.849+0000 7fa3997b49c0 2 removed watcher, disabling cache 2024-09-12T18:03:12.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.853+0000 7fa3997b49c0 20 remove_watcher() i=1 2024-09-12T18:03:12.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.853+0000 7fa3997b49c0 20 remove_watcher() i=2 2024-09-12T18:03:12.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.857+0000 7fa3997b49c0 20 remove_watcher() i=3 2024-09-12T18:03:12.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.857+0000 7fa3997b49c0 20 remove_watcher() i=4 2024-09-12T18:03:12.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.861+0000 7fa3997b49c0 20 remove_watcher() i=5 2024-09-12T18:03:12.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.861+0000 7fa3997b49c0 20 remove_watcher() i=6 2024-09-12T18:03:12.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:12.861+0000 7fa3997b49c0 20 remove_watcher() i=7 2024-09-12T18:03:12.874 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:12.874 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:12.874 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-trim-reshard-log-entries id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:03:12.874 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:13.591 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T18:03:13.591 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:15.719 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:03:15.752 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:15.752 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:15.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.796+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:15.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:15.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 20 realm 2024-09-12T18:03:15.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:15.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:15.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:15.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:15.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:15.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:15.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:15.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:15.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:15.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.800+0000 7f042f02d9c0 20 searching for the correct realm 2024-09-12T18:03:15.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:15.808+0000 7f042d334640 0 -- 172.21.15.157:0/4085300391 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f04200678e0 msgr2=0x7f042008a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:16.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.024+0000 7f042cb33640 0 -- 172.21.15.157:0/4085300391 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55afcab28ee0 msgr2=0x55afcab2b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:16.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.032+0000 7f042f02d9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:16.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.032+0000 7f042f02d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:16.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.032+0000 7f042f02d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:16.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.032+0000 7f042f02d9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:16.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.032+0000 7f042f02d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:16.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.032+0000 7f042f02d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:16.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.032+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.032+0000 7f042f02d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.032+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.032+0000 7f042f02d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:16.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.032+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:16.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 20 zone default found 2024-09-12T18:03:16.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 4 Realm: () 2024-09-12T18:03:16.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:16.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:16.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:16.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 20 zonegroup default 2024-09-12T18:03:16.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 20 started sync module instance, tier type = 2024-09-12T18:03:16.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.036+0000 7f042f02d9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:16.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.056+0000 7f042f02d9c0 20 add_watcher() i=0 2024-09-12T18:03:16.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.056+0000 7f042f02d9c0 20 add_watcher() i=1 2024-09-12T18:03:16.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.056+0000 7f042f02d9c0 20 add_watcher() i=2 2024-09-12T18:03:16.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.056+0000 7f042f02d9c0 20 add_watcher() i=3 2024-09-12T18:03:16.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.056+0000 7f042f02d9c0 20 add_watcher() i=4 2024-09-12T18:03:16.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.056+0000 7f042f02d9c0 20 add_watcher() i=5 2024-09-12T18:03:16.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.060+0000 7f042f02d9c0 20 add_watcher() i=6 2024-09-12T18:03:16.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.060+0000 7f042f02d9c0 20 add_watcher() i=7 2024-09-12T18:03:16.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.060+0000 7f042f02d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:16.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.064+0000 7f02e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:16.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.064+0000 7f042f02d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:16.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.064+0000 7f042f02d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:16.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.064+0000 7f042f02d9c0 5 note: GC not initialized 2024-09-12T18:03:16.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.064+0000 7f02e27e4640 20 reqs_thread_entry: start 2024-09-12T18:03:16.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.064+0000 7f042f02d9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:16.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.064+0000 7f042f02d9c0 20 Filter name: none 2024-09-12T18:03:16.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.068+0000 7f02db7fe640 20 reqs_thread_entry: start 2024-09-12T18:03:16.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.068+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.068+0000 7f042f02d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:16.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.068+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.068+0000 7f042f02d9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:16.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.068+0000 7f042f02d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:16.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.068+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.068+0000 7f042f02d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:16.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.068+0000 7f042f02d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.068+0000 7f042f02d9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:16.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.068+0000 7f042f02d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:16.071 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.072+0000 7f02e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:16.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.076+0000 7f042f02d9c0 20 remove_watcher() i=0 2024-09-12T18:03:16.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.076+0000 7f042f02d9c0 2 removed watcher, disabling cache 2024-09-12T18:03:16.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.080+0000 7f042f02d9c0 20 remove_watcher() i=1 2024-09-12T18:03:16.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.080+0000 7f042f02d9c0 20 remove_watcher() i=2 2024-09-12T18:03:16.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.080+0000 7f042f02d9c0 20 remove_watcher() i=3 2024-09-12T18:03:16.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.084+0000 7f042f02d9c0 20 remove_watcher() i=4 2024-09-12T18:03:16.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.084+0000 7f042f02d9c0 20 remove_watcher() i=5 2024-09-12T18:03:16.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.088+0000 7f042f02d9c0 20 remove_watcher() i=6 2024-09-12T18:03:16.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.088+0000 7f042f02d9c0 20 remove_watcher() i=7 2024-09-12T18:03:16.102 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:16.102 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:16.102 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-trim-reshard-log-entries id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:03:16.102 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:16.102 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T18:03:16.137 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:16.137 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:16.181 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.180+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 20 realm 2024-09-12T18:03:16.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:16.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:16.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:16.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.184+0000 7f75bcfd79c0 20 searching for the correct realm 2024-09-12T18:03:16.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.192+0000 7f75ba2dc640 0 -- 172.21.15.157:0/1986704391 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55deb8afff70 msgr2=0x55deb8b02380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:16.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.196+0000 7f75baadd640 0 -- 172.21.15.157:0/1986704391 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f75b00df910 msgr2=0x7f75b00b83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:16.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:16.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:16.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:16.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:16.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:16.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:16.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.205 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:16.205 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.205 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:16.205 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 zone default found 2024-09-12T18:03:16.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 4 Realm: () 2024-09-12T18:03:16.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:16.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:16.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:16.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 zonegroup default 2024-09-12T18:03:16.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.204+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.208+0000 7f75bcfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.208+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.208+0000 7f75bcfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.208+0000 7f75bcfd79c0 20 started sync module instance, tier type = 2024-09-12T18:03:16.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.208+0000 7f75bcfd79c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:16.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.220+0000 7f75bcfd79c0 20 add_watcher() i=0 2024-09-12T18:03:16.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.220+0000 7f75bcfd79c0 20 add_watcher() i=1 2024-09-12T18:03:16.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.220+0000 7f75bcfd79c0 20 add_watcher() i=2 2024-09-12T18:03:16.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.220+0000 7f75bcfd79c0 20 add_watcher() i=3 2024-09-12T18:03:16.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.220+0000 7f75bcfd79c0 20 add_watcher() i=4 2024-09-12T18:03:16.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.220+0000 7f75bcfd79c0 20 add_watcher() i=5 2024-09-12T18:03:16.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.220+0000 7f75bcfd79c0 20 add_watcher() i=6 2024-09-12T18:03:16.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f75bcfd79c0 20 add_watcher() i=7 2024-09-12T18:03:16.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f75bcfd79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:16.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f74717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:16.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f75bcfd79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:16.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f75bcfd79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:16.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f75bcfd79c0 5 note: GC not initialized 2024-09-12T18:03:16.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f73ebfff640 20 reqs_thread_entry: start 2024-09-12T18:03:16.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f75bcfd79c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:16.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f75bcfd79c0 20 Filter name: none 2024-09-12T18:03:16.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f73e9ffb640 20 reqs_thread_entry: start 2024-09-12T18:03:16.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f75bcfd79c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T18:03:16.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.224+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.228+0000 7f75bcfd79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:16.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.228+0000 7f75bcfd79c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:16.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.228+0000 7f75bcfd79c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:16.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.228+0000 7f75bcfd79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 : miss 2024-09-12T18:03:16.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.228+0000 7f75bcfd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.228+0000 7f75bcfd79c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:16.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.228+0000 7f75bcfd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 info.flags=0x17 2024-09-12T18:03:16.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.228+0000 7f75bcfd79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 to cache LRU end 2024-09-12T18:03:16.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.228+0000 7f75bcfd79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:16.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.228+0000 7f75bcfd79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:16.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.228+0000 7f75bcfd79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 2024-09-12T18:03:16.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.232+0000 7f75bcfd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 info.flags=0x17 2024-09-12T18:03:16.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.232+0000 7f75bcfd79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 to cache LRU end 2024-09-12T18:03:16.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.232+0000 7f75bcfd79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:16.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.232+0000 7f75bcfd79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26, ofs0, ns] 2024-09-12T18:03:16.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.236+0000 7f749dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464318 cookie 94415069647168 notifier 6897 bl.length()=939 2024-09-12T18:03:16.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.236+0000 7f749dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 info.flags=0x17 2024-09-12T18:03:16.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.236+0000 7f749dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 to cache LRU end 2024-09-12T18:03:16.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.236+0000 7f749dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:16.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.236+0000 7f75bcfd79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26]): orig_sources= new_sources= 2024-09-12T18:03:16.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.236+0000 7f75bcfd79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26]): potential sources added=[] removed=[] 2024-09-12T18:03:16.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.236+0000 7f75bcfd79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26]): orig_dests= new_dests= 2024-09-12T18:03:16.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.236+0000 7f75bcfd79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26]): potential dests added=[] removed=[] 2024-09-12T18:03:16.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.236+0000 7f75bcfd79c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T18:03:16.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.236+0000 7f75bcfd79c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T18:03:16.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.240+0000 7f75bcfd79c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26.1.0 2024-09-12T18:03:16.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.240+0000 7f75bcfd79c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26.1.0 2024-09-12T18:03:16.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.240+0000 7f75bcfd79c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26.1.1 2024-09-12T18:03:16.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.240+0000 7f75bcfd79c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26.1.1 2024-09-12T18:03:16.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.240+0000 7f75bcfd79c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26.0 2024-09-12T18:03:16.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.244+0000 7f75bcfd79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:16.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.244+0000 7f75bcfd79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 2024-09-12T18:03:16.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.244+0000 7f75bcfd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 info.flags=0x17 2024-09-12T18:03:16.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.244+0000 7f75bcfd79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 to cache LRU end 2024-09-12T18:03:16.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.244+0000 7f75bcfd79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:16.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.244+0000 7f75bcfd79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26, ofs0, ns] 2024-09-12T18:03:16.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.244+0000 7f749dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94415069647168 notifier 6897 bl.length()=907 2024-09-12T18:03:16.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.244+0000 7f749dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 info.flags=0x17 2024-09-12T18:03:16.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.244+0000 7f749dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 to cache LRU end 2024-09-12T18:03:16.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.244+0000 7f749dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:16.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.248+0000 7f75bcfd79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26]): orig_sources= new_sources= 2024-09-12T18:03:16.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.248+0000 7f75bcfd79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26]): potential sources added=[] removed=[] 2024-09-12T18:03:16.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.248+0000 7f75bcfd79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26]): orig_dests= new_dests= 2024-09-12T18:03:16.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.248+0000 7f75bcfd79c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26]): potential dests added=[] removed=[] 2024-09-12T18:03:16.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.248+0000 7f75bcfd79c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T18:03:16.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.252+0000 7f74717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:16.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.256+0000 7f75bcfd79c0 20 remove_watcher() i=0 2024-09-12T18:03:16.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.256+0000 7f75bcfd79c0 2 removed watcher, disabling cache 2024-09-12T18:03:16.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.256+0000 7f75bcfd79c0 20 remove_watcher() i=1 2024-09-12T18:03:16.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.260+0000 7f75bcfd79c0 20 remove_watcher() i=2 2024-09-12T18:03:16.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.260+0000 7f75bcfd79c0 20 remove_watcher() i=3 2024-09-12T18:03:16.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.264+0000 7f75bcfd79c0 20 remove_watcher() i=4 2024-09-12T18:03:16.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.264+0000 7f75bcfd79c0 20 remove_watcher() i=5 2024-09-12T18:03:16.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.268+0000 7f75bcfd79c0 20 remove_watcher() i=6 2024-09-12T18:03:16.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.268+0000 7f75bcfd79c0 20 remove_watcher() i=7 2024-09-12T18:03:16.282 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:03:16.308 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:16.309 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:16.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.352+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.352+0000 7f71c66f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.352+0000 7f71c66f29c0 20 realm 2024-09-12T18:03:16.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.352+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.352+0000 7f71c66f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.352+0000 7f71c66f29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:16.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.352+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.352+0000 7f71c66f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.353 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.352+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.356+0000 7f71c66f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:16.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.356+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.356+0000 7f71c66f29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:16.355 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.356+0000 7f71c66f29c0 20 searching for the correct realm 2024-09-12T18:03:16.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.360+0000 7f71c49f9640 0 -- 172.21.15.157:0/3669660648 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f71ac01b040 msgr2=0x7f71ac0438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:16.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.576+0000 7f71c41f8640 0 -- 172.21.15.157:0/3669660648 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x558434443a50 msgr2=0x558434445e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:16.585 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.584+0000 7f71c66f29c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:16.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.584+0000 7f71c66f29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:16.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.584+0000 7f71c66f29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:16.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.584+0000 7f71c66f29c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:16.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.584+0000 7f71c66f29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:16.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.584+0000 7f71c66f29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:16.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.584+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.584+0000 7f71c66f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.584+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.584+0000 7f71c66f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:16.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.584+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:16.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 20 zone default found 2024-09-12T18:03:16.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 4 Realm: () 2024-09-12T18:03:16.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:16.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:16.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:16.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 20 zonegroup default 2024-09-12T18:03:16.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:16.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 20 started sync module instance, tier type = 2024-09-12T18:03:16.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.588+0000 7f71c66f29c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:16.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.612+0000 7f71c66f29c0 20 add_watcher() i=0 2024-09-12T18:03:16.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.612+0000 7f71c66f29c0 20 add_watcher() i=1 2024-09-12T18:03:16.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.612+0000 7f71c66f29c0 20 add_watcher() i=2 2024-09-12T18:03:16.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.612+0000 7f71c66f29c0 20 add_watcher() i=3 2024-09-12T18:03:16.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.612+0000 7f71c66f29c0 20 add_watcher() i=4 2024-09-12T18:03:16.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.612+0000 7f71c66f29c0 20 add_watcher() i=5 2024-09-12T18:03:16.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.612+0000 7f71c66f29c0 20 add_watcher() i=6 2024-09-12T18:03:16.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.616+0000 7f71c66f29c0 20 add_watcher() i=7 2024-09-12T18:03:16.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.616+0000 7f71c66f29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:16.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.620+0000 7f707b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:16.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.620+0000 7f71c66f29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:16.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.620+0000 7f71c66f29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:16.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.620+0000 7f71c66f29c0 5 note: GC not initialized 2024-09-12T18:03:16.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.620+0000 7f707a7dc640 20 reqs_thread_entry: start 2024-09-12T18:03:16.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.620+0000 7f71c66f29c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:16.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.620+0000 7f71c66f29c0 20 Filter name: none 2024-09-12T18:03:16.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.620+0000 7f70737fe640 20 reqs_thread_entry: start 2024-09-12T18:03:16.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.620+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.624+0000 7f71c66f29c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:16.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.624+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.624+0000 7f71c66f29c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:16.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.624+0000 7f71c66f29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:16.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.624+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.624+0000 7f71c66f29c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:16.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.624+0000 7f71c66f29c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:16.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.624+0000 7f71c66f29c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:16.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.624+0000 7f71c66f29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:16.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.628+0000 7f707b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:16.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.632+0000 7f71c66f29c0 20 remove_watcher() i=0 2024-09-12T18:03:16.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.632+0000 7f71c66f29c0 2 removed watcher, disabling cache 2024-09-12T18:03:16.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.636+0000 7f71c66f29c0 20 remove_watcher() i=1 2024-09-12T18:03:16.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.636+0000 7f71c66f29c0 20 remove_watcher() i=2 2024-09-12T18:03:16.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.640+0000 7f71c66f29c0 20 remove_watcher() i=3 2024-09-12T18:03:16.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.640+0000 7f71c66f29c0 20 remove_watcher() i=4 2024-09-12T18:03:16.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.640+0000 7f71c66f29c0 20 remove_watcher() i=5 2024-09-12T18:03:16.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.644+0000 7f71c66f29c0 20 remove_watcher() i=6 2024-09-12T18:03:16.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:16.644+0000 7f71c66f29c0 20 remove_watcher() i=7 2024-09-12T18:03:16.660 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:16.660 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:16.660 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-trim-reshard-log-entries id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T18:03:16.660 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:17.408 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T18:03:17.409 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:19.516 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T18:03:19.548 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:19.549 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:19.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.592+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:19.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 20 realm 2024-09-12T18:03:19.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:19.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:19.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:19.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:19.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:19.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.596+0000 7fd4cf3b99c0 20 searching for the correct realm 2024-09-12T18:03:19.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.604+0000 7fd4cc6be640 0 -- 172.21.15.157:0/3316206365 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fd4c006ac20 msgr2=0x7fd4c0063ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:19.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.812+0000 7fd4ccebf640 0 -- 172.21.15.157:0/3316206365 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fd4c0098930 msgr2=0x7fd4c002a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:19.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:19.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:19.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:19.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:19.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:19.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:19.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:19.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:19.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:19.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 zone default found 2024-09-12T18:03:19.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 4 Realm: () 2024-09-12T18:03:19.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:19.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:19.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 zonegroup default 2024-09-12T18:03:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.824+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.828+0000 7fd4cf3b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:19.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.828+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.828+0000 7fd4cf3b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:19.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.828+0000 7fd4cf3b99c0 20 started sync module instance, tier type = 2024-09-12T18:03:19.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.828+0000 7fd4cf3b99c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:19.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.852+0000 7fd4cf3b99c0 20 add_watcher() i=0 2024-09-12T18:03:19.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.852+0000 7fd4cf3b99c0 20 add_watcher() i=1 2024-09-12T18:03:19.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.852+0000 7fd4cf3b99c0 20 add_watcher() i=2 2024-09-12T18:03:19.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.852+0000 7fd4cf3b99c0 20 add_watcher() i=3 2024-09-12T18:03:19.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.852+0000 7fd4cf3b99c0 20 add_watcher() i=4 2024-09-12T18:03:19.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.852+0000 7fd4cf3b99c0 20 add_watcher() i=5 2024-09-12T18:03:19.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.852+0000 7fd4cf3b99c0 20 add_watcher() i=6 2024-09-12T18:03:19.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.852+0000 7fd4cf3b99c0 20 add_watcher() i=7 2024-09-12T18:03:19.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.852+0000 7fd4cf3b99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:19.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.856+0000 7fd3837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:19.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.856+0000 7fd4cf3b99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:19.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.856+0000 7fd4cf3b99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:19.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.856+0000 7fd4cf3b99c0 5 note: GC not initialized 2024-09-12T18:03:19.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.856+0000 7fd3827e4640 20 reqs_thread_entry: start 2024-09-12T18:03:19.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.860+0000 7fd4cf3b99c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:19.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.860+0000 7fd4cf3b99c0 20 Filter name: none 2024-09-12T18:03:19.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.860+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.860+0000 7fd37b7fe640 20 reqs_thread_entry: start 2024-09-12T18:03:19.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.860+0000 7fd4cf3b99c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:19.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.860+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.860+0000 7fd4cf3b99c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:19.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.860+0000 7fd4cf3b99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:19.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.860+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.860+0000 7fd4cf3b99c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:19.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.860+0000 7fd4cf3b99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.864+0000 7fd4cf3b99c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:19.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.864+0000 7fd4cf3b99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:19.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.864+0000 7fd3837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:19.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.868+0000 7fd4cf3b99c0 20 remove_watcher() i=0 2024-09-12T18:03:19.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.868+0000 7fd4cf3b99c0 2 removed watcher, disabling cache 2024-09-12T18:03:19.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.872+0000 7fd4cf3b99c0 20 remove_watcher() i=1 2024-09-12T18:03:19.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.876+0000 7fd4cf3b99c0 20 remove_watcher() i=2 2024-09-12T18:03:19.877 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.876+0000 7fd4cf3b99c0 20 remove_watcher() i=3 2024-09-12T18:03:19.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.880+0000 7fd4cf3b99c0 20 remove_watcher() i=4 2024-09-12T18:03:19.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.880+0000 7fd4cf3b99c0 20 remove_watcher() i=5 2024-09-12T18:03:19.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.884+0000 7fd4cf3b99c0 20 remove_watcher() i=6 2024-09-12T18:03:19.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.884+0000 7fd4cf3b99c0 20 remove_watcher() i=7 2024-09-12T18:03:19.906 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:19.907 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:19.907 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-trim-reshard-log-entries id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:03:19.907 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:19.907 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T18:03:19.944 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:19.944 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:19.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:19.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 realm 2024-09-12T18:03:19.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:19.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.988+0000 7ff80b32e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:19.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:19.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:19.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:19.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:19.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 searching for the correct realm 2024-09-12T18:03:19.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.000+0000 7ff809635640 0 -- 172.21.15.157:0/1945662821 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7ff7f0059040 msgr2=0x7ff7f0065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:20.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.216+0000 7ff808e34640 0 -- 172.21.15.157:0/1945662821 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x56102311d900 msgr2=0x56102311fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:20.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:20.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:20.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:20.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:20.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:20.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:20.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 zone default found 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 4 Realm: () 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 zonegroup default 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 started sync module instance, tier type = 2024-09-12T18:03:20.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:20.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=0 2024-09-12T18:03:20.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=1 2024-09-12T18:03:20.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=2 2024-09-12T18:03:20.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=3 2024-09-12T18:03:20.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=4 2024-09-12T18:03:20.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=5 2024-09-12T18:03:20.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=6 2024-09-12T18:03:20.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=7 2024-09-12T18:03:20.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.252+0000 7ff80b32e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:20.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.256+0000 7ff6befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:20.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:20.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:20.259 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 note: GC not initialized 2024-09-12T18:03:20.259 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff6bdfe3640 20 reqs_thread_entry: start 2024-09-12T18:03:20.259 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:20.259 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 Filter name: none 2024-09-12T18:03:20.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff62f7fe640 20 reqs_thread_entry: start 2024-09-12T18:03:20.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:03:20.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:20.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:20.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:20.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 : miss 2024-09-12T18:03:20.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:20.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:20.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:20.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:20.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:20.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.264+0000 7ff80b32e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 2024-09-12T18:03:20.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27, ofs0, ns] 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 94627307900208 notifier 6951 bl.length()=939 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:20.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_sources= new_sources= 2024-09-12T18:03:20.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential sources added=[] removed=[] 2024-09-12T18:03:20.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_dests= new_dests= 2024-09-12T18:03:20.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential dests added=[] removed=[] 2024-09-12T18:03:20.272 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff80b32e9c0 time 2024-09-12T18:03:20.277574+0000 2024-09-12T18:03:20.272 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:20.275 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:20.275 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff80ec082eb] 2024-09-12T18:03:20.275 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff80ec0849f] 2024-09-12T18:03:20.275 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610214360c1] 2024-09-12T18:03:20.275 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x141007e) [0x561021e8c07e] 2024-09-12T18:03:20.275 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56102144818d] 2024-09-12T18:03:20.276 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:03:20.276 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff80da6ed90] 2024-09-12T18:03:20.276 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:03:20.276 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:03:20.276 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:03:20.276 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff80b32e9c0 thread_name:radosgw-admin 2024-09-12T18:03:20.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.276+0000 7ff80b32e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff80b32e9c0 time 2024-09-12T18:03:20.277574+0000 2024-09-12T18:03:20.276 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:20.276 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.276 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff80ec082eb] 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff80ec0849f] 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610214360c1] 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x141007e) [0x561021e8c07e] 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56102144818d] 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff80da6ed90] 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff80da87520] 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff80ec08345] 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff80ec0849f] 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610214360c1] 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x141007e) [0x561021e8c07e] 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56102144818d] 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff80da6ed90] 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.280+0000 7ff80b32e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff80b32e9c0 thread_name:radosgw-admin 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff80da87520] 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff80ec08345] 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff80ec0849f] 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610214360c1] 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x141007e) [0x561021e8c07e] 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56102144818d] 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff80da6ed90] 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.281 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:03:20.315 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.315 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_done global_id 6939 payload 274 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient: _finish_hunting 0 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:03:19.968+0000 7ff808633640 1 monclient: found mon.noname-a 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:03:19.968+0000 7ff808e34640 10 monclient: get_auth_request con 0x561022ebeb40 auth_method 0 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: dump: 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.318 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: _finish_auth 0 2024-09-12T18:03:20.320 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: _check_auth_tickets 2024-09-12T18:03:20.320 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:20.320 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 monclient: authenticate success, global_id 6939 2024-09-12T18:03:20.320 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:20.320 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 4 set_mon_vals no callback set 2024-09-12T18:03:20.320 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: dump: 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: shutdown 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 asok(0x561022e242b0) unregister_commands rotate-key 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: build_initial_monmap 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: monmap: 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding auth protocol: cephx 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding auth protocol: cephx 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding auth protocol: cephx 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 1 librados: starting msgr at 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 1 librados: starting objecter 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command objecter_requests hook 0x561022dd84a0 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 1 librados: setting wanted keys 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 1 librados: calling monclient init 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: init 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding auth protocol: cephx 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding auth protocol: cephx 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding auth protocol: cephx 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command rotate-key hook 0x561023031978 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-b con 0x561022ebeb40 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-a con 0x561022ebf460 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-c con 0x561022f7a1d0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): authenticate will time out at 2362.195385s 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): get_auth_request con 0x561022ebf460 auth_method 0 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): get_auth_request con 0x561022f7a1d0 auth_method 0 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_done global_id 6942 payload 824 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient: _finish_hunting 0 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:03:19.968+0000 7ff808633640 1 monclient: found mon.noname-a 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: dump: 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: _finish_auth 0 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: _check_auth_tickets 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: dump: 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 5 monclient: authenticate success, global_id 6942 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:03:19.972+0000 7ff6f6e0d640 4 set_mon_vals no callback set 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 1 librados: init done 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:03:19.972+0000 7ff6f560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:03:19.972+0000 7ff6f560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:03:19.972+0000 7ff6f560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:03:19.972+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff6f0070ae0 auth_method 0 2024-09-12T18:03:20.331 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:03:19.972+0000 7ff809635640 10 monclient: get_auth_request con 0x5610230598b0 auth_method 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:03:19.972+0000 7ff808e34640 10 monclient: get_auth_request con 0x56102307c640 auth_method 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:03:19.976+0000 7ff808633640 10 monclient: get_auth_request con 0x561023080830 auth_method 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 10 monclient: build_initial_monmap 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 10 monclient: monmap: 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding auth protocol: cephx 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding auth protocol: cephx 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding auth protocol: cephx 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.333 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command objecter_requests cmddesc objecter_requests hook 0x561023088f40 EEXIST 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 10 monclient: init 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding auth protocol: cephx 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding auth protocol: cephx 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding auth protocol: cephx 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command rotate-key cmddesc rotate-key hook 0x5610230847f0 EEXIST 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-c con 0x5610230ad0f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-a con 0x5610230aca20 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-b con 0x5610230ab400 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:20.337 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): authenticate will time out at 2362.204243s 2024-09-12T18:03:20.337 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): get_auth_request con 0x5610230ad0f0 auth_method 0 2024-09-12T18:03:20.337 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.337 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.337 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.337 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): get_auth_request con 0x5610230aca20 auth_method 0 2024-09-12T18:03:20.337 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.337 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.338 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.338 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.338 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.338 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.338 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.338 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.338 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.338 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): handle_auth_done global_id 6945 payload 824 2024-09-12T18:03:20.338 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient: _finish_hunting 0 2024-09-12T18:03:20.338 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:03:19.980+0000 7ff808633640 1 monclient: found mon.noname-a 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:03:19.980+0000 7ff809635640 10 monclient: get_auth_request con 0x5610230ab400 auth_method 0 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: dump: 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: _finish_auth 0 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: dump: 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:03:19.980+0000 7ff809e36640 4 set_mon_vals no callback set 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 monclient: authenticate success, global_id 6945 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff6e0070a20 auth_method 0 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: get_monmap_and_config 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: build_initial_monmap 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: monmap: 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding auth protocol: cephx 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding auth protocol: cephx 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding auth protocol: cephx 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: init 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding auth protocol: cephx 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding auth protocol: cephx 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding auth protocol: cephx 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command rotate-key cmddesc rotate-key hook 0x7fff92c65c98 EEXIST 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-b con 0x561023100970 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-c con 0x5610230fbd60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-a con 0x5610230fc6e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): authenticate will time out at 2362.208554s 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): get_auth_request con 0x5610230fbd60 auth_method 0 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): get_auth_request con 0x5610230fc6e0 auth_method 0 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_done global_id 6488 payload 274 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient: _finish_hunting 0 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:03:19.984+0000 7ff808633640 1 monclient: found mon.noname-c 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: dump: 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: _finish_auth 0 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: _check_auth_tickets 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 monclient: authenticate success, global_id 6488 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: dump: 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 4 set_mon_vals no callback set 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: shutdown 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: build_initial_monmap 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: monmap: 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:20.353 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:20.353 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:20.353 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.353 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding auth protocol: cephx 2024-09-12T18:03:20.353 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding auth protocol: cephx 2024-09-12T18:03:20.353 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding auth protocol: cephx 2024-09-12T18:03:20.353 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.353 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.353 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.353 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 1 librados: starting msgr at 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 1 librados: starting objecter 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command objecter_requests cmddesc objecter_requests hook 0x561023083180 EEXIST 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 1 librados: setting wanted keys 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 1 librados: calling monclient init 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: init 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding auth protocol: cephx 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding auth protocol: cephx 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding auth protocol: cephx 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.356 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.356 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.356 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.356 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.356 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.356 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.356 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.356 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.356 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.356 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.356 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command rotate-key cmddesc rotate-key hook 0x5610230af058 EEXIST 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-c con 0x5610230fbd60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-a con 0x5610230fc6e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-b con 0x561023100970 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): authenticate will time out at 2362.211240s 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): get_auth_request con 0x5610230fbd60 auth_method 0 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): get_auth_request con 0x5610230fc6e0 auth_method 0 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_done global_id 6951 payload 824 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient: _finish_hunting 0 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:03:19.984+0000 7ff808633640 1 monclient: found mon.noname-a 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: dump: 2024-09-12T18:03:20.360 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.360 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.360 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.360 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.360 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.360 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.360 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.360 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.360 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.360 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: _finish_auth 0 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:03:19.988+0000 7ff6de7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:03:19.988+0000 7ff6de7fc640 10 monclient: dump: 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:03:19.984+0000 7ff6dffff640 4 set_mon_vals no callback set 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 5 monclient: authenticate success, global_id 6951 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 1 librados: init done 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command cr dump hook 0x7ff7f0091078 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:03:19.988+0000 7ff6de7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:03:19.988+0000 7ff6de7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:03:19.988+0000 7ff6de7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:03:19.988+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff6d4070ae0 auth_method 0 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:03:19.988+0000 7ff809635640 10 monclient: get_auth_request con 0x561023119540 auth_method 0 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 realm 2024-09-12T18:03:20.364 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.364 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.364 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:20.364 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.364 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.364 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:03:19.992+0000 7ff808e34640 10 monclient: get_auth_request con 0x56102311d900 auth_method 0 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:03:19.992+0000 7ff808633640 10 monclient: get_auth_request con 0x561023121070 auth_method 0 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 searching for the correct realm 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:03:19.992+0000 7ff809635640 10 monclient: get_auth_request con 0x561023125df0 auth_method 0 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:03:19.992+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff7f80abba0 auth_method 0 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:03:19.996+0000 7ff808633640 10 monclient: get_auth_request con 0x7ff7f0008050 auth_method 0 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:03:20.000+0000 7ff809635640 10 monclient: get_auth_request con 0x7ff7f0059040 auth_method 0 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:03:20.000+0000 7ff809635640 0 -- 172.21.15.157:0/1945662821 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7ff7f0059040 msgr2=0x7ff7f0065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:03:20.204+0000 7ff809635640 10 monclient: get_auth_request con 0x7ff7f0059040 auth_method 0 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:03:20.212+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff7f0059420 auth_method 0 2024-09-12T18:03:20.366 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:03:20.216+0000 7ff808e34640 0 -- 172.21.15.157:0/1945662821 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x56102311d900 msgr2=0x56102311fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:20.366 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:03:20.216+0000 7ff6de7fc640 1 client.6951.objecter ms_handle_reset 0x56102311d900 session 0x56102311c7a0 osd.5 2024-09-12T18:03:20.366 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:03:20.216+0000 7ff6de7fc640 10 monclient: _renew_subs 2024-09-12T18:03:20.366 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:03:20.216+0000 7ff6de7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.366 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:03:20.216+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff6d4080880 auth_method 0 2024-09-12T18:03:20.366 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:20.366 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:20.366 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:20.366 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:20.366 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:20.367 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:20.367 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.367 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.367 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.367 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:20.367 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.367 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 zone default found 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 4 Realm: () 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 zonegroup default 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 started sync module instance, tier type = 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=0 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=1 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=2 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=3 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=4 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=5 2024-09-12T18:03:20.369 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=6 2024-09-12T18:03:20.370 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=7 2024-09-12T18:03:20.370 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:20.370 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding auth protocol: cephx 2024-09-12T18:03:20.370 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding auth protocol: cephx 2024-09-12T18:03:20.370 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding auth protocol: cephx 2024-09-12T18:03:20.370 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.370 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.370 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.370 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:03:20.256+0000 7ff6befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command cache list hook 0x5610230f8190 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command cache inspect hook 0x5610230f8190 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command cache erase hook 0x5610230f8190 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command cache zap hook 0x5610230f8190 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 note: GC not initialized 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:03:20.260+0000 7ff6bdfe3640 20 reqs_thread_entry: start 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command sync trace show hook 0x7ff7f0076070 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command sync trace history hook 0x7ff7f0076070 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command sync trace active hook 0x7ff7f0076070 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command sync trace active_short hook 0x7ff7f0076070 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 Filter name: none 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:03:20.260+0000 7ff62f7fe640 20 reqs_thread_entry: start 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 : miss 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.374 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:20.374 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:20.374 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:20.374 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:20.374 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:20.374 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:03:20.264+0000 7ff80b32e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 2024-09-12T18:03:20.374 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:20.374 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:20.374 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27, ofs0, ns] 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 94627307900208 notifier 6951 bl.length()=939 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_sources= new_sources= 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential sources added=[] removed=[] 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_dests= new_dests= 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential dests added=[] removed=[] 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:03:20.276+0000 7ff80b32e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff80b32e9c0 time 2024-09-12T18:03:20.277574+0000 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff80ec082eb] 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff80ec0849f] 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610214360c1] 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x141007e) [0x561021e8c07e] 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56102144818d] 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff80da6ed90] 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:03:20.376 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:03:20.280+0000 7ff80b32e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff80b32e9c0 thread_name:radosgw-admin 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff80da87520] 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff80ec08345] 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff80ec0849f] 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610214360c1] 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x141007e) [0x561021e8c07e] 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56102144818d] 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff80da6ed90] 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff62f7fe640 / http_manager 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6bdfe3640 / http_manager 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6befe5640 / rgw_dt_lg_renew 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6de7fc640 / ms_dispatch 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6dffff640 / io_context_pool 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6ee7fc640 / ms_dispatch 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6f560a640 / ms_dispatch 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6f6e0d640 / io_context_pool 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff808633640 / msgr-worker-2 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff808e34640 / msgr-worker-1 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff809635640 / msgr-worker-0 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff809e36640 / io_context_pool 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff80b32e9c0 / radosgw-admin 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.97544.log 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_done global_id 6939 payload 274 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient: _finish_hunting 0 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:03:19.968+0000 7ff808633640 1 monclient: found mon.noname-a 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:03:19.968+0000 7ff808e34640 10 monclient: get_auth_request con 0x561022ebeb40 auth_method 0 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: dump: 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: _finish_auth 0 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: _check_auth_tickets 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 monclient: authenticate success, global_id 6939 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 4 set_mon_vals no callback set 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:03:19.968+0000 7ff6f6e0d640 10 monclient: dump: 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: shutdown 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 asok(0x561022e242b0) unregister_commands rotate-key 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: build_initial_monmap 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: monmap: 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding auth protocol: cephx 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding auth protocol: cephx 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding auth protocol: cephx 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: crc 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023033910) adding con mode: secure 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 1 librados: starting msgr at 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 1 librados: starting objecter 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command objecter_requests hook 0x561022dd84a0 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 1 librados: setting wanted keys 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 1 librados: calling monclient init 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: init 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding auth protocol: cephx 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding auth protocol: cephx 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding auth protocol: cephx 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: crc 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 AuthRegistry(0x561023031830) adding con mode: secure 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command rotate-key hook 0x561023031978 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-b con 0x561022ebeb40 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-a con 0x561022ebf460 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-c con 0x561022f7a1d0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:03:19.968+0000 7ff80b32e9c0 10 monclient(hunting): authenticate will time out at 2362.195385s 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): get_auth_request con 0x561022ebf460 auth_method 0 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): get_auth_request con 0x561022f7a1d0 auth_method 0 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:03:19.968+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient(hunting): handle_auth_done global_id 6942 payload 824 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient: _finish_hunting 0 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:03:19.968+0000 7ff808633640 1 monclient: found mon.noname-a 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:03:19.968+0000 7ff808633640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: dump: 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.399 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: _finish_auth 0 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: _check_auth_tickets 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:03:19.972+0000 7ff6f560a640 10 monclient: dump: 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 5 monclient: authenticate success, global_id 6942 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:03:19.972+0000 7ff6f6e0d640 4 set_mon_vals no callback set 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:03:19.972+0000 7ff80b32e9c0 1 librados: init done 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:03:19.972+0000 7ff6f560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:03:19.972+0000 7ff6f560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:03:19.972+0000 7ff6f560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:03:19.972+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff6f0070ae0 auth_method 0 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:03:19.972+0000 7ff809635640 10 monclient: get_auth_request con 0x5610230598b0 auth_method 0 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:03:19.972+0000 7ff808e34640 10 monclient: get_auth_request con 0x56102307c640 auth_method 0 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:03:19.976+0000 7ff808633640 10 monclient: get_auth_request con 0x561023080830 auth_method 0 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 10 monclient: build_initial_monmap 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 10 monclient: monmap: 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding auth protocol: cephx 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding auth protocol: cephx 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding auth protocol: cephx 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: crc 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x561023085570) adding con mode: secure 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command objecter_requests cmddesc objecter_requests hook 0x561023088f40 EEXIST 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 10 monclient: init 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding auth protocol: cephx 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding auth protocol: cephx 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding auth protocol: cephx 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: crc 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230846a8) adding con mode: secure 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:03:19.976+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command rotate-key cmddesc rotate-key hook 0x5610230847f0 EEXIST 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-c con 0x5610230ad0f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-a con 0x5610230aca20 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-b con 0x5610230ab400 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient(hunting): authenticate will time out at 2362.204243s 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): get_auth_request con 0x5610230ad0f0 auth_method 0 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): get_auth_request con 0x5610230aca20 auth_method 0 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient(hunting): handle_auth_done global_id 6945 payload 824 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient: _finish_hunting 0 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:03:19.980+0000 7ff808633640 1 monclient: found mon.noname-a 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:03:19.980+0000 7ff808633640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:03:19.980+0000 7ff809635640 10 monclient: get_auth_request con 0x5610230ab400 auth_method 0 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: dump: 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: _finish_auth 0 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:03:20.412 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:20.412 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.412 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:20.412 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 10 monclient: dump: 2024-09-12T18:03:20.412 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.412 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.412 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.412 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.412 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:03:19.980+0000 7ff809e36640 4 set_mon_vals no callback set 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 monclient: authenticate success, global_id 6945 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:03:19.980+0000 7ff6ee7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:03:19.980+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff6e0070a20 auth_method 0 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: get_monmap_and_config 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: build_initial_monmap 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: monmap: 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:20.415 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.415 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:20.415 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:20.415 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:20.415 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.415 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding auth protocol: cephx 2024-09-12T18:03:20.415 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding auth protocol: cephx 2024-09-12T18:03:20.415 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding auth protocol: cephx 2024-09-12T18:03:20.415 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.416 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.416 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.416 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.416 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.416 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.416 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.416 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.416 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: crc 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230cc510) adding con mode: secure 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 10 monclient: init 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding auth protocol: cephx 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding auth protocol: cephx 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding auth protocol: cephx 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:03:19.980+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: crc 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c65b50) adding con mode: secure 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.419 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command rotate-key cmddesc rotate-key hook 0x7fff92c65c98 EEXIST 2024-09-12T18:03:20.419 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:20.419 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:03:20.419 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-b con 0x561023100970 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:20.419 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-c con 0x5610230fbd60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:20.419 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-a con 0x5610230fc6e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:20.419 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.419 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): authenticate will time out at 2362.208554s 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): get_auth_request con 0x5610230fbd60 auth_method 0 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): get_auth_request con 0x5610230fc6e0 auth_method 0 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:03:19.984+0000 7ff809635640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_done global_id 6488 payload 274 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient: _finish_hunting 0 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:03:19.984+0000 7ff808633640 1 monclient: found mon.noname-c 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: dump: 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: _finish_auth 0 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: _check_auth_tickets 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 monclient: authenticate success, global_id 6488 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:03:19.984+0000 7ff6dffff640 10 monclient: dump: 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 4 set_mon_vals no callback set 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: shutdown 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: build_initial_monmap 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: monmap: 2024-09-12T18:03:20.425 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:20.425 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:20.425 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:20.425 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:20.425 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:20.425 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.425 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:20.425 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:20.425 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:20.425 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.425 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding auth protocol: cephx 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding auth protocol: cephx 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding auth protocol: cephx 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: crc 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230fcbb0) adding con mode: secure 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 1 librados: starting msgr at 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 1 librados: starting objecter 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command objecter_requests cmddesc objecter_requests hook 0x561023083180 EEXIST 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 1 librados: setting wanted keys 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 1 librados: calling monclient init 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: init 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding auth protocol: cephx 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding auth protocol: cephx 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding auth protocol: cephx 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: crc 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 AuthRegistry(0x5610230aef10) adding con mode: secure 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command rotate-key cmddesc rotate-key hook 0x5610230af058 EEXIST 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-c con 0x5610230fbd60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-a con 0x5610230fc6e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): picked mon.noname-b con 0x561023100970 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:03:19.984+0000 7ff80b32e9c0 10 monclient(hunting): authenticate will time out at 2362.211240s 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): get_auth_request con 0x5610230fbd60 auth_method 0 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): get_auth_request con 0x5610230fc6e0 auth_method 0 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:20.430 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:03:19.984+0000 7ff808e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient(hunting): handle_auth_done global_id 6951 payload 824 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient: _finish_hunting 0 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:03:19.984+0000 7ff808633640 1 monclient: found mon.noname-a 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:03:19.984+0000 7ff808633640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: dump: 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: _finish_auth 0 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:03:19.984+0000 7ff6de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:03:19.988+0000 7ff6de7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:03:19.988+0000 7ff6de7fc640 10 monclient: dump: 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:03:19.984+0000 7ff6dffff640 4 set_mon_vals no callback set 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 5 monclient: authenticate success, global_id 6951 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 10 monclient: _renew_subs 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 1 librados: init done 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command cr dump hook 0x7ff7f0091078 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:03:19.988+0000 7ff6de7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:03:19.988+0000 7ff6de7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:03:19.988+0000 7ff6de7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:03:19.988+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff6d4070ae0 auth_method 0 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:03:19.988+0000 7ff809635640 10 monclient: get_auth_request con 0x561023119540 auth_method 0 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 realm 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.435 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:03:19.988+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:03:19.992+0000 7ff808e34640 10 monclient: get_auth_request con 0x56102311d900 auth_method 0 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:03:19.992+0000 7ff808633640 10 monclient: get_auth_request con 0x561023121070 auth_method 0 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:03:19.992+0000 7ff80b32e9c0 20 searching for the correct realm 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:03:19.992+0000 7ff809635640 10 monclient: get_auth_request con 0x561023125df0 auth_method 0 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:03:19.992+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff7f80abba0 auth_method 0 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:03:19.996+0000 7ff808633640 10 monclient: get_auth_request con 0x7ff7f0008050 auth_method 0 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:03:20.000+0000 7ff809635640 10 monclient: get_auth_request con 0x7ff7f0059040 auth_method 0 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:03:20.000+0000 7ff809635640 0 -- 172.21.15.157:0/1945662821 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7ff7f0059040 msgr2=0x7ff7f0065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:03:20.204+0000 7ff809635640 10 monclient: get_auth_request con 0x7ff7f0059040 auth_method 0 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:03:20.212+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff7f0059420 auth_method 0 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:03:20.216+0000 7ff808e34640 0 -- 172.21.15.157:0/1945662821 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x56102311d900 msgr2=0x56102311fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:03:20.216+0000 7ff6de7fc640 1 client.6951.objecter ms_handle_reset 0x56102311d900 session 0x56102311c7a0 osd.5 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:03:20.216+0000 7ff6de7fc640 10 monclient: _renew_subs 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:03:20.216+0000 7ff6de7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:03:20.216+0000 7ff808e34640 10 monclient: get_auth_request con 0x7ff6d4080880 auth_method 0 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:03:20.224+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:20.438 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 zone default found 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 4 Realm: () 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 zonegroup default 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 started sync module instance, tier type = 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:03:20.228+0000 7ff80b32e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=0 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=1 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=2 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=3 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=4 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=5 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=6 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 20 add_watcher() i=7 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:03:20.252+0000 7ff80b32e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding auth protocol: cephx 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding auth protocol: cephx 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding auth protocol: cephx 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:03:20.256+0000 7ff6befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: crc 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:03:20.256+0000 7ff80b32e9c0 5 AuthRegistry(0x7fff92c66020) adding con mode: secure 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command cache list hook 0x5610230f8190 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command cache inspect hook 0x5610230f8190 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command cache erase hook 0x5610230f8190 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command cache zap hook 0x5610230f8190 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 note: GC not initialized 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:03:20.260+0000 7ff6bdfe3640 20 reqs_thread_entry: start 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command sync trace show hook 0x7ff7f0076070 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command sync trace history hook 0x7ff7f0076070 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command sync trace active hook 0x7ff7f0076070 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 5 asok(0x561022e242b0) register_command sync trace active_short hook 0x7ff7f0076070 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 Filter name: none 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:03:20.260+0000 7ff62f7fe640 20 reqs_thread_entry: start 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 : miss 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:03:20.260+0000 7ff80b32e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:03:20.264+0000 7ff80b32e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:03:20.268+0000 7ff80b32e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27, ofs0, ns] 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 94627307900208 notifier 6951 bl.length()=939 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:03:20.268+0000 7ff6dffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_sources= new_sources= 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential sources added=[] removed=[] 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_dests= new_dests= 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:03:20.272+0000 7ff80b32e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential dests added=[] removed=[] 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:03:20.276+0000 7ff80b32e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff80b32e9c0 time 2024-09-12T18:03:20.277574+0000 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff80ec082eb] 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff80ec0849f] 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610214360c1] 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x141007e) [0x561021e8c07e] 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56102144818d] 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff80da6ed90] 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.448 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:03:20.280+0000 7ff80b32e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:20.448 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff80b32e9c0 thread_name:radosgw-admin 2024-09-12T18:03:20.448 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.448 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:20.448 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff80da87520] 2024-09-12T18:03:20.448 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:03:20.448 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:03:20.448 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:03:20.448 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff80ec08345] 2024-09-12T18:03:20.448 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff80ec0849f] 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610214360c1] 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x141007e) [0x561021e8c07e] 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56102144818d] 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff80da6ed90] 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:03:20.453 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:03:20.454 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff62f7fe640 / http_manager 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6bdfe3640 / http_manager 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6befe5640 / rgw_dt_lg_renew 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6de7fc640 / ms_dispatch 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6dffff640 / io_context_pool 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6ee7fc640 / ms_dispatch 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6f560a640 / ms_dispatch 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff6f6e0d640 / io_context_pool 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff808633640 / msgr-worker-2 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff808e34640 / msgr-worker-1 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff809635640 / msgr-worker-0 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff809e36640 / io_context_pool 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff80b32e9c0 / radosgw-admin 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:03:20.284464Z_d7cae874-16f5-40f6-8c19-ca5ac6aa190b/log 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T18:03:20.464 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:20.464 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:20.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.368+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.372+0000 7fb5796909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.372+0000 7fb5796909c0 20 realm 2024-09-12T18:03:20.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.372+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.372+0000 7fb5796909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.372+0000 7fb5796909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:20.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.372+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.372+0000 7fb5796909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.372+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.372+0000 7fb5796909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:20.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.372+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.376+0000 7fb5796909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:20.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.376+0000 7fb5796909c0 20 searching for the correct realm 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.380+0000 7fb577997640 0 -- 172.21.15.157:0/2978601047 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55c83e6c52b0 msgr2=0x55c83e6c76a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.384+0000 7fb576995640 0 -- 172.21.15.157:0/2978601047 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fb56000e040 msgr2=0x7fb560063570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 zone default found 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 4 Realm: () 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 zonegroup default 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 started sync module instance, tier type = 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.396+0000 7fb5796909c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.412+0000 7fb5796909c0 20 add_watcher() i=0 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.412+0000 7fb5796909c0 20 add_watcher() i=1 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.412+0000 7fb5796909c0 20 add_watcher() i=2 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.412+0000 7fb5796909c0 20 add_watcher() i=3 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.412+0000 7fb5796909c0 20 add_watcher() i=4 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.412+0000 7fb5796909c0 20 add_watcher() i=5 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.412+0000 7fb5796909c0 20 add_watcher() i=6 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.412+0000 7fb5796909c0 20 add_watcher() i=7 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.412+0000 7fb5796909c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.416+0000 7fb42dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.416+0000 7fb5796909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.416+0000 7fb5796909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.416+0000 7fb5796909c0 5 note: GC not initialized 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.416+0000 7fb42cfe1640 20 reqs_thread_entry: start 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.416+0000 7fb5796909c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.416+0000 7fb5796909c0 20 Filter name: none 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.416+0000 7fb3a67fc640 20 reqs_thread_entry: start 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.416+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.420+0000 7fb5796909c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.420+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.420+0000 7fb5796909c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.420+0000 7fb5796909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.420+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.420+0000 7fb5796909c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.420+0000 7fb5796909c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.420+0000 7fb5796909c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.420+0000 7fb5796909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.424+0000 7fb42dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.428+0000 7fb5796909c0 20 remove_watcher() i=0 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.428+0000 7fb5796909c0 2 removed watcher, disabling cache 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.428+0000 7fb5796909c0 20 remove_watcher() i=1 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.432+0000 7fb5796909c0 20 remove_watcher() i=2 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.432+0000 7fb5796909c0 20 remove_watcher() i=3 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.436+0000 7fb5796909c0 20 remove_watcher() i=4 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.436+0000 7fb5796909c0 20 remove_watcher() i=5 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.440+0000 7fb5796909c0 20 remove_watcher() i=6 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.440+0000 7fb5796909c0 20 remove_watcher() i=7 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:20.472 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-trim-reshard-log-entries id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:03:20.472 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:20.552 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:03:20.585 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:20.585 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.628+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.628+0000 7fc0a86c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.628+0000 7fc0a86c19c0 20 realm 2024-09-12T18:03:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.628+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.628+0000 7fc0a86c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.628+0000 7fc0a86c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.628+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.628+0000 7fc0a86c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.628+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.632+0000 7fc0a86c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:20.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.632+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.632+0000 7fc0a86c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:20.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.632+0000 7fc0a86c19c0 20 searching for the correct realm 2024-09-12T18:03:20.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.636+0000 7fc0a59c6640 0 -- 172.21.15.157:0/1329493154 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fc09c043040 msgr2=0x7fc09c043930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:20.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.644+0000 7fc0a69c8640 0 -- 172.21.15.157:0/1329493154 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fc09c035070 msgr2=0x7fc09c0523e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:20.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.648+0000 7fc0a86c19c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:20.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.648+0000 7fc0a86c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:20.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.648+0000 7fc0a86c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:20.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.648+0000 7fc0a86c19c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:20.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.648+0000 7fc0a86c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:20.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.648+0000 7fc0a86c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:20.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.648+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:20.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:20.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 zone default found 2024-09-12T18:03:20.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 4 Realm: () 2024-09-12T18:03:20.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:20.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:20.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:20.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 zonegroup default 2024-09-12T18:03:20.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:20.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 started sync module instance, tier type = 2024-09-12T18:03:20.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.652+0000 7fc0a86c19c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:20.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.668+0000 7fc0a86c19c0 20 add_watcher() i=0 2024-09-12T18:03:20.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.668+0000 7fc0a86c19c0 20 add_watcher() i=1 2024-09-12T18:03:20.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.668+0000 7fc0a86c19c0 20 add_watcher() i=2 2024-09-12T18:03:20.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.668+0000 7fc0a86c19c0 20 add_watcher() i=3 2024-09-12T18:03:20.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.668+0000 7fc0a86c19c0 20 add_watcher() i=4 2024-09-12T18:03:20.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.668+0000 7fc0a86c19c0 20 add_watcher() i=5 2024-09-12T18:03:20.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.668+0000 7fc0a86c19c0 20 add_watcher() i=6 2024-09-12T18:03:20.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.672+0000 7fc0a86c19c0 20 add_watcher() i=7 2024-09-12T18:03:20.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.672+0000 7fc0a86c19c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:20.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.672+0000 7fbf5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:20.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.672+0000 7fc0a86c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:20.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.672+0000 7fc0a86c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:20.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.672+0000 7fc0a86c19c0 5 note: GC not initialized 2024-09-12T18:03:20.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.672+0000 7fbed77fe640 20 reqs_thread_entry: start 2024-09-12T18:03:20.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:20.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 20 Filter name: none 2024-09-12T18:03:20.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fbed57fa640 20 reqs_thread_entry: start 2024-09-12T18:03:20.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:03:20.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:20.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:20.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:20.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 : miss 2024-09-12T18:03:20.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:20.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:20.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:20.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:20.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:20.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:20.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.676+0000 7fc0a86c19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 2024-09-12T18:03:20.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.680+0000 7fc0a86c19c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to be held by another RGW process; skipping for now 2024-09-12T18:03:20.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.680+0000 7fbf5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:20.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.684+0000 7fc0a86c19c0 20 remove_watcher() i=0 2024-09-12T18:03:20.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.684+0000 7fc0a86c19c0 2 removed watcher, disabling cache 2024-09-12T18:03:20.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.684+0000 7fc0a86c19c0 20 remove_watcher() i=1 2024-09-12T18:03:20.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.688+0000 7fc0a86c19c0 20 remove_watcher() i=2 2024-09-12T18:03:20.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.688+0000 7fc0a86c19c0 20 remove_watcher() i=3 2024-09-12T18:03:20.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.692+0000 7fc0a86c19c0 20 remove_watcher() i=4 2024-09-12T18:03:20.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.692+0000 7fc0a86c19c0 20 remove_watcher() i=5 2024-09-12T18:03:20.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.696+0000 7fc0a86c19c0 20 remove_watcher() i=6 2024-09-12T18:03:20.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:20.696+0000 7fc0a86c19c0 20 remove_watcher() i=7 2024-09-12T18:03:20.709 INFO:tasks.workunit.client.0.smithi157.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:03:50.735 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:03:50.771 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:50.772 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:50.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.816+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 20 realm 2024-09-12T18:03:50.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:50.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:50.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:50.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.820+0000 7f0f6cccc9c0 20 searching for the correct realm 2024-09-12T18:03:50.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:50.828+0000 7f0f6afd3640 0 -- 172.21.15.157:0/882799154 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f0f60032bb0 msgr2=0x7f0f60017900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.044+0000 7f0f6a7d2640 0 -- 172.21.15.157:0/882799154 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x56023e120a40 msgr2=0x56023e122e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.048+0000 7f0f6cccc9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.048+0000 7f0f6cccc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.048+0000 7f0f6cccc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.048+0000 7f0f6cccc9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.048+0000 7f0f6cccc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.048+0000 7f0f6cccc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.048+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 zone default found 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 4 Realm: () 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 zonegroup default 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.052+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.056+0000 7f0f6cccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.056+0000 7f0f6cccc9c0 20 started sync module instance, tier type = 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.056+0000 7f0f6cccc9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.088+0000 7f0f6cccc9c0 20 add_watcher() i=0 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.088+0000 7f0f6cccc9c0 20 add_watcher() i=1 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.088+0000 7f0f6cccc9c0 20 add_watcher() i=2 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.088+0000 7f0f6cccc9c0 20 add_watcher() i=3 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.088+0000 7f0f6cccc9c0 20 add_watcher() i=4 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.088+0000 7f0f6cccc9c0 20 add_watcher() i=5 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.088+0000 7f0f6cccc9c0 20 add_watcher() i=6 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.088+0000 7f0f6cccc9c0 20 add_watcher() i=7 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.088+0000 7f0f6cccc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.092+0000 7f0e217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.092+0000 7f0f6cccc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.092+0000 7f0f6cccc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.092+0000 7f0f6cccc9c0 5 note: GC not initialized 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0e1b7fe640 20 reqs_thread_entry: start 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 20 Filter name: none 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0e197fa640 20 reqs_thread_entry: start 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 : miss 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.096+0000 7f0f6cccc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.100+0000 7f0f6cccc9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:03:51.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.108+0000 7f0f6cccc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:51.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.108+0000 7f0f6cccc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:51.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.108+0000 7f0f6cccc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.108+0000 7f0f6cccc9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27, ofs0, ns] 2024-09-12T18:03:51.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.108+0000 7f0e4dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 94567631355168 notifier 6542 bl.length()=939 2024-09-12T18:03:51.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.108+0000 7f0e4dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:51.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.108+0000 7f0e4dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:51.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.108+0000 7f0e4dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.112+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_sources= new_sources= 2024-09-12T18:03:51.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.112+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential sources added=[] removed=[] 2024-09-12T18:03:51.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.112+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_dests= new_dests= 2024-09-12T18:03:51.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.112+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential dests added=[] removed=[] 2024-09-12T18:03:51.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.116+0000 7f0f6cccc9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27.2.0 2024-09-12T18:03:51.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.116+0000 7f0f6cccc9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27.2.0 2024-09-12T18:03:51.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.116+0000 7f0f6cccc9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27.2.1 2024-09-12T18:03:51.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.116+0000 7f0f6cccc9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27.2.1 2024-09-12T18:03:51.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.116+0000 7f0f6cccc9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27.0 2024-09-12T18:03:51.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.120+0000 7f0f6cccc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:51.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.120+0000 7f0f6cccc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 2024-09-12T18:03:51.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.124+0000 7f0f6cccc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:51.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.124+0000 7f0f6cccc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:51.122 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.124+0000 7f0f6cccc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.124+0000 7f0f6cccc9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27, ofs0, ns] 2024-09-12T18:03:51.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.124+0000 7f0e4d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464279 cookie 94567631355168 notifier 6542 bl.length()=939 2024-09-12T18:03:51.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.124+0000 7f0e4d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:51.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.124+0000 7f0e4d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:51.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.124+0000 7f0e4d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.128+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_sources= new_sources= 2024-09-12T18:03:51.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.128+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential sources added=[] removed=[] 2024-09-12T18:03:51.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.128+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_dests= new_dests= 2024-09-12T18:03:51.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.128+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential dests added=[] removed=[] 2024-09-12T18:03:51.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.128+0000 7f0f6cccc9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27.0 2024-09-12T18:03:51.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.128+0000 7f0f6cccc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:51.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.128+0000 7f0f6cccc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 2024-09-12T18:03:51.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.132+0000 7f0f6cccc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:51.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.132+0000 7f0f6cccc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:51.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.132+0000 7f0f6cccc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.132+0000 7f0f6cccc9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27, ofs0, ns] 2024-09-12T18:03:51.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.132+0000 7f0e4dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94567631355168 notifier 6542 bl.length()=907 2024-09-12T18:03:51.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.132+0000 7f0e4dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 info.flags=0x17 2024-09-12T18:03:51.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.132+0000 7f0e4dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 to cache LRU end 2024-09-12T18:03:51.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.132+0000 7f0e4dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.136+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_sources= new_sources= 2024-09-12T18:03:51.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.136+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential sources added=[] removed=[] 2024-09-12T18:03:51.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.136+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): orig_dests= new_dests= 2024-09-12T18:03:51.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.136+0000 7f0f6cccc9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27]): potential dests added=[] removed=[] 2024-09-12T18:03:51.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.136+0000 7f0f6cccc9c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T18:03:51.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.140+0000 7f0e217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:51.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.144+0000 7f0f6cccc9c0 20 remove_watcher() i=0 2024-09-12T18:03:51.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.144+0000 7f0f6cccc9c0 2 removed watcher, disabling cache 2024-09-12T18:03:51.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.148+0000 7f0f6cccc9c0 20 remove_watcher() i=1 2024-09-12T18:03:51.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.152+0000 7f0f6cccc9c0 20 remove_watcher() i=2 2024-09-12T18:03:51.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.152+0000 7f0f6cccc9c0 20 remove_watcher() i=3 2024-09-12T18:03:51.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.156+0000 7f0f6cccc9c0 20 remove_watcher() i=4 2024-09-12T18:03:51.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.156+0000 7f0f6cccc9c0 20 remove_watcher() i=5 2024-09-12T18:03:51.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.160+0000 7f0f6cccc9c0 20 remove_watcher() i=6 2024-09-12T18:03:51.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.160+0000 7f0f6cccc9c0 20 remove_watcher() i=7 2024-09-12T18:03:51.179 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T18:03:51.207 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:51.207 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:51.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.252+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.252+0000 7f83aa2ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.252+0000 7f83aa2ca9c0 20 realm 2024-09-12T18:03:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.252+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.252+0000 7f83aa2ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.252+0000 7f83aa2ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.252+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.252+0000 7f83aa2ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.252+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.256+0000 7f83aa2ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:51.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.256+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.256+0000 7f83aa2ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:51.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.256+0000 7f83aa2ca9c0 20 searching for the correct realm 2024-09-12T18:03:51.259 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.260+0000 7f83a75cf640 0 -- 172.21.15.157:0/2600895313 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f839c04c060 msgr2=0x7f839c0279d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:51.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.476+0000 7f83a7dd0640 0 -- 172.21.15.157:0/2600895313 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f839c071090 msgr2=0x7f839c0940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.692+0000 7f83aa2ca9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.692+0000 7f83aa2ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.692+0000 7f83aa2ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.692+0000 7f83aa2ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.692+0000 7f83aa2ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.692+0000 7f83aa2ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.692+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.692+0000 7f83aa2ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.692+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:51.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 zone default found 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 4 Realm: () 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 zonegroup default 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 started sync module instance, tier type = 2024-09-12T18:03:51.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.696+0000 7f83aa2ca9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:51.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.720+0000 7f83aa2ca9c0 20 add_watcher() i=0 2024-09-12T18:03:51.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.720+0000 7f83aa2ca9c0 20 add_watcher() i=1 2024-09-12T18:03:51.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.720+0000 7f83aa2ca9c0 20 add_watcher() i=2 2024-09-12T18:03:51.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.720+0000 7f83aa2ca9c0 20 add_watcher() i=3 2024-09-12T18:03:51.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.720+0000 7f83aa2ca9c0 20 add_watcher() i=4 2024-09-12T18:03:51.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.720+0000 7f83aa2ca9c0 20 add_watcher() i=5 2024-09-12T18:03:51.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.720+0000 7f83aa2ca9c0 20 add_watcher() i=6 2024-09-12T18:03:51.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.724+0000 7f83aa2ca9c0 20 add_watcher() i=7 2024-09-12T18:03:51.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.724+0000 7f83aa2ca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:51.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.728+0000 7f825e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:51.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.728+0000 7f83aa2ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:51.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.728+0000 7f83aa2ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:51.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.728+0000 7f83aa2ca9c0 5 note: GC not initialized 2024-09-12T18:03:51.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.728+0000 7f825d7e2640 20 reqs_thread_entry: start 2024-09-12T18:03:51.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.728+0000 7f83aa2ca9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:51.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.728+0000 7f83aa2ca9c0 20 Filter name: none 2024-09-12T18:03:51.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.728+0000 7f82567fc640 20 reqs_thread_entry: start 2024-09-12T18:03:51.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.728+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.728+0000 7f83aa2ca9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:51.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.728+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.732+0000 7f83aa2ca9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:51.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.732+0000 7f83aa2ca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:51.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.732+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.732+0000 7f83aa2ca9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:51.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.732+0000 7f83aa2ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.732+0000 7f83aa2ca9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:51.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.732+0000 7f83aa2ca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:51.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.736+0000 7f825e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:51.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.740+0000 7f83aa2ca9c0 20 remove_watcher() i=0 2024-09-12T18:03:51.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.740+0000 7f83aa2ca9c0 2 removed watcher, disabling cache 2024-09-12T18:03:51.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.744+0000 7f83aa2ca9c0 20 remove_watcher() i=1 2024-09-12T18:03:51.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.744+0000 7f83aa2ca9c0 20 remove_watcher() i=2 2024-09-12T18:03:51.747 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.748+0000 7f83aa2ca9c0 20 remove_watcher() i=3 2024-09-12T18:03:51.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.748+0000 7f83aa2ca9c0 20 remove_watcher() i=4 2024-09-12T18:03:51.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.752+0000 7f83aa2ca9c0 20 remove_watcher() i=5 2024-09-12T18:03:51.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.752+0000 7f83aa2ca9c0 20 remove_watcher() i=6 2024-09-12T18:03:51.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:51.756+0000 7f83aa2ca9c0 20 remove_watcher() i=7 2024-09-12T18:03:51.771 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:51.771 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:51.771 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-trim-reshard-log-entries id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:03:51.771 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:52.482 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T18:03:52.482 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:54.611 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T18:03:54.643 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:54.644 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:54.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.688+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.688+0000 7fac7b5d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:54.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.688+0000 7fac7b5d79c0 20 realm 2024-09-12T18:03:54.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.688+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.688+0000 7fac7b5d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:54.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.688+0000 7fac7b5d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:54.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.688+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.688+0000 7fac7b5d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:54.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.688+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.692+0000 7fac7b5d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:54.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.692+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.692+0000 7fac7b5d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:54.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.692+0000 7fac7b5d79c0 20 searching for the correct realm 2024-09-12T18:03:54.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.700+0000 7fac798de640 0 -- 172.21.15.157:0/2219141036 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x5571ab7b8fa0 msgr2=0x5571ab7bb430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:54.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.704+0000 7fac708dc640 0 -- 172.21.15.157:0/2219141036 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fac6401e040 msgr2=0x7fac64035670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:54.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.712+0000 7fac7b5d79c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:54.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.712+0000 7fac7b5d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:54.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.712+0000 7fac7b5d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:54.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.712+0000 7fac7b5d79c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:54.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.712+0000 7fac7b5d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:54.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.712+0000 7fac7b5d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:54.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.712+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.712+0000 7fac7b5d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:54.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.712+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:54.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:54.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 zone default found 2024-09-12T18:03:54.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 4 Realm: () 2024-09-12T18:03:54.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:54.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 zonegroup default 2024-09-12T18:03:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:54.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:54.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 started sync module instance, tier type = 2024-09-12T18:03:54.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.716+0000 7fac7b5d79c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:54.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.732+0000 7fac7b5d79c0 20 add_watcher() i=0 2024-09-12T18:03:54.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.732+0000 7fac7b5d79c0 20 add_watcher() i=1 2024-09-12T18:03:54.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.732+0000 7fac7b5d79c0 20 add_watcher() i=2 2024-09-12T18:03:54.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.732+0000 7fac7b5d79c0 20 add_watcher() i=3 2024-09-12T18:03:54.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.732+0000 7fac7b5d79c0 20 add_watcher() i=4 2024-09-12T18:03:54.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.732+0000 7fac7b5d79c0 20 add_watcher() i=5 2024-09-12T18:03:54.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.732+0000 7fac7b5d79c0 20 add_watcher() i=6 2024-09-12T18:03:54.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.732+0000 7fac7b5d79c0 20 add_watcher() i=7 2024-09-12T18:03:54.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.732+0000 7fac7b5d79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:54.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.736+0000 7fab2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:54.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.736+0000 7fac7b5d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:54.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.736+0000 7fac7b5d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:54.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.736+0000 7fac7b5d79c0 5 note: GC not initialized 2024-09-12T18:03:54.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.736+0000 7fab2e7e4640 20 reqs_thread_entry: start 2024-09-12T18:03:54.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.736+0000 7fac7b5d79c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:54.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.736+0000 7fac7b5d79c0 20 Filter name: none 2024-09-12T18:03:54.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.736+0000 7faa9ffff640 20 reqs_thread_entry: start 2024-09-12T18:03:54.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.736+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.736+0000 7fac7b5d79c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:54.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.736+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.740+0000 7fac7b5d79c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:54.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.740+0000 7fac7b5d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:54.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.740+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.740+0000 7fac7b5d79c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.740+0000 7fac7b5d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.740+0000 7fac7b5d79c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.740+0000 7fac7b5d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:54.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.740+0000 7fab2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:54.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.748+0000 7fac7b5d79c0 20 remove_watcher() i=0 2024-09-12T18:03:54.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.748+0000 7fac7b5d79c0 2 removed watcher, disabling cache 2024-09-12T18:03:54.747 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.748+0000 7fac7b5d79c0 20 remove_watcher() i=1 2024-09-12T18:03:54.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.752+0000 7fac7b5d79c0 20 remove_watcher() i=2 2024-09-12T18:03:54.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.752+0000 7fac7b5d79c0 20 remove_watcher() i=3 2024-09-12T18:03:54.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.756+0000 7fac7b5d79c0 20 remove_watcher() i=4 2024-09-12T18:03:54.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.756+0000 7fac7b5d79c0 20 remove_watcher() i=5 2024-09-12T18:03:54.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.756+0000 7fac7b5d79c0 20 remove_watcher() i=6 2024-09-12T18:03:54.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.760+0000 7fac7b5d79c0 20 remove_watcher() i=7 2024-09-12T18:03:54.771 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:54.772 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:54.772 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-block-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:03:54.772 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:54.772 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T18:03:54.805 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:54.805 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:54.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.852+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.852+0000 7fbb4cd539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:54.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.852+0000 7fbb4cd539c0 20 realm 2024-09-12T18:03:54.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.852+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.852+0000 7fbb4cd539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:54.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.852+0000 7fbb4cd539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:54.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.852+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.852+0000 7fbb4cd539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:54.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.852+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.856+0000 7fbb4cd539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:54.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.856+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:54.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.856+0000 7fbb4cd539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:54.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.856+0000 7fbb4cd539c0 20 searching for the correct realm 2024-09-12T18:03:54.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:54.860+0000 7fbb4b05a640 0 -- 172.21.15.157:0/1904466412 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fbb3405ee40 msgr2=0x7fbb3407a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:55.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.076+0000 7fbb4a859640 0 -- 172.21.15.157:0/1904466412 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x560477ef0570 msgr2=0x560477ef2960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:55.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:55.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:55.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:55.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:55.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:55.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:55.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:55.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:55.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 zone default found 2024-09-12T18:03:55.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 4 Realm: () 2024-09-12T18:03:55.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:55.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:55.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:55.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 zonegroup default 2024-09-12T18:03:55.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.084+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.088+0000 7fbb4cd539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.088+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.088+0000 7fbb4cd539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.088+0000 7fbb4cd539c0 20 started sync module instance, tier type = 2024-09-12T18:03:55.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.088+0000 7fbb4cd539c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:55.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.112+0000 7fbb4cd539c0 20 add_watcher() i=0 2024-09-12T18:03:55.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.112+0000 7fbb4cd539c0 20 add_watcher() i=1 2024-09-12T18:03:55.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.112+0000 7fbb4cd539c0 20 add_watcher() i=2 2024-09-12T18:03:55.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.112+0000 7fbb4cd539c0 20 add_watcher() i=3 2024-09-12T18:03:55.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.112+0000 7fbb4cd539c0 20 add_watcher() i=4 2024-09-12T18:03:55.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.112+0000 7fbb4cd539c0 20 add_watcher() i=5 2024-09-12T18:03:55.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.112+0000 7fbb4cd539c0 20 add_watcher() i=6 2024-09-12T18:03:55.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.112+0000 7fbb4cd539c0 20 add_watcher() i=7 2024-09-12T18:03:55.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.112+0000 7fbb4cd539c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:55.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.116+0000 7fba017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:55.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.116+0000 7fbb4cd539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:55.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.116+0000 7fbb4cd539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:55.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.116+0000 7fbb4cd539c0 5 note: GC not initialized 2024-09-12T18:03:55.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fb97bfff640 20 reqs_thread_entry: start 2024-09-12T18:03:55.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:55.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 20 Filter name: none 2024-09-12T18:03:55.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fb979ffb640 20 reqs_thread_entry: start 2024-09-12T18:03:55.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T18:03:55.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:55.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T18:03:55.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T18:03:55.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 : miss 2024-09-12T18:03:55.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:55.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:55.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:55.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:55.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:55.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.120+0000 7fbb4cd539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 2024-09-12T18:03:55.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.128+0000 7fbb4cd539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:55.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.128+0000 7fbb4cd539c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:55.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.128+0000 7fbb4cd539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:55.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.128+0000 7fbb4cd539c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28, ofs0, ns] 2024-09-12T18:03:55.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.128+0000 7fba2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464324 cookie 94577192015680 notifier 6587 bl.length()=915 2024-09-12T18:03:55.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.128+0000 7fba2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:55.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.128+0000 7fba2e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:55.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.128+0000 7fba2e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:55.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.132+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_sources= new_sources= 2024-09-12T18:03:55.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.132+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential sources added=[] removed=[] 2024-09-12T18:03:55.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.132+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_dests= new_dests= 2024-09-12T18:03:55.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.132+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential dests added=[] removed=[] 2024-09-12T18:03:55.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.136+0000 7fbb4cd539c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28.1.0 2024-09-12T18:03:55.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.136+0000 7fbb4cd539c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28.1.0 2024-09-12T18:03:55.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.136+0000 7fbb4cd539c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28.1.1 2024-09-12T18:03:55.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.136+0000 7fbb4cd539c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28.1.1 2024-09-12T18:03:55.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.136+0000 7fbb4cd539c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28.0 2024-09-12T18:03:55.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.140+0000 7fbb4cd539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:55.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.140+0000 7fbb4cd539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 2024-09-12T18:03:55.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.144+0000 7fbb4cd539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:55.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.144+0000 7fbb4cd539c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:55.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.144+0000 7fbb4cd539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:55.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.144+0000 7fbb4cd539c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28, ofs0, ns] 2024-09-12T18:03:55.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.144+0000 7fba2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464325 cookie 94577192015680 notifier 6587 bl.length()=915 2024-09-12T18:03:55.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.144+0000 7fba2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:55.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.144+0000 7fba2dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:55.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.144+0000 7fba2dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:55.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.148+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_sources= new_sources= 2024-09-12T18:03:55.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.148+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential sources added=[] removed=[] 2024-09-12T18:03:55.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.148+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_dests= new_dests= 2024-09-12T18:03:55.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.148+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential dests added=[] removed=[] 2024-09-12T18:03:55.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.148+0000 7fbb4cd539c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T18:03:55.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.148+0000 7fbb4cd539c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T18:03:55.152 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.152+0000 7fbb4cd539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:55.152 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.152+0000 7fbb4cd539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 2024-09-12T18:03:55.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.156+0000 7fbb4cd539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:55.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.156+0000 7fbb4cd539c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:55.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.156+0000 7fbb4cd539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:55.155 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.156+0000 7fbb4cd539c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28, ofs0, ns] 2024-09-12T18:03:55.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.156+0000 7fba2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464326 cookie 94577192015680 notifier 6587 bl.length()=883 2024-09-12T18:03:55.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.156+0000 7fba2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:55.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.156+0000 7fba2dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:55.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.156+0000 7fba2dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:55.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.160+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_sources= new_sources= 2024-09-12T18:03:55.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.160+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential sources added=[] removed=[] 2024-09-12T18:03:55.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.160+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_dests= new_dests= 2024-09-12T18:03:55.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.160+0000 7fbb4cd539c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential dests added=[] removed=[] 2024-09-12T18:03:55.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.164+0000 7fbb4cd539c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T18:03:55.165 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.164+0000 7fba017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:55.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.172+0000 7fbb4cd539c0 20 remove_watcher() i=0 2024-09-12T18:03:55.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.172+0000 7fbb4cd539c0 2 removed watcher, disabling cache 2024-09-12T18:03:55.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.172+0000 7fbb4cd539c0 20 remove_watcher() i=1 2024-09-12T18:03:55.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.176+0000 7fbb4cd539c0 20 remove_watcher() i=2 2024-09-12T18:03:55.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.176+0000 7fbb4cd539c0 20 remove_watcher() i=3 2024-09-12T18:03:55.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.180+0000 7fbb4cd539c0 20 remove_watcher() i=4 2024-09-12T18:03:55.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.180+0000 7fbb4cd539c0 20 remove_watcher() i=5 2024-09-12T18:03:55.181 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.184+0000 7fbb4cd539c0 20 remove_watcher() i=6 2024-09-12T18:03:55.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.184+0000 7fbb4cd539c0 20 remove_watcher() i=7 2024-09-12T18:03:55.198 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T18:03:55.225 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:55.225 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:55.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.268+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.272+0000 7f164fa339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.272+0000 7f164fa339c0 20 realm 2024-09-12T18:03:55.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.272+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.272+0000 7f164fa339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.272+0000 7f164fa339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:55.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.272+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.272+0000 7f164fa339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.272+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.272+0000 7f164fa339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:55.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.272+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.276+0000 7f164fa339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:55.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.276+0000 7f164fa339c0 20 searching for the correct realm 2024-09-12T18:03:55.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.280+0000 7f164dd3a640 0 -- 172.21.15.157:0/1422989959 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f163812b2d0 msgr2=0x7f1638124990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:55.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.496+0000 7f164d539640 0 -- 172.21.15.157:0/1422989959 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x56336959ee70 msgr2=0x5633695a1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:55.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.504+0000 7f164fa339c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:55.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.504+0000 7f164fa339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:55.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.504+0000 7f164fa339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:55.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.504+0000 7f164fa339c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:55.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.504+0000 7f164fa339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:55.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.504+0000 7f164fa339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:55.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.504+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.505 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.504+0000 7f164fa339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.505 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.504+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.505 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.504+0000 7f164fa339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:55.505 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.504+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:55.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 20 zone default found 2024-09-12T18:03:55.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 4 Realm: () 2024-09-12T18:03:55.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:55.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:55.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:55.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 20 zonegroup default 2024-09-12T18:03:55.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 20 started sync module instance, tier type = 2024-09-12T18:03:55.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.508+0000 7f164fa339c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:55.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.532+0000 7f164fa339c0 20 add_watcher() i=0 2024-09-12T18:03:55.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.532+0000 7f164fa339c0 20 add_watcher() i=1 2024-09-12T18:03:55.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.532+0000 7f164fa339c0 20 add_watcher() i=2 2024-09-12T18:03:55.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.532+0000 7f164fa339c0 20 add_watcher() i=3 2024-09-12T18:03:55.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.532+0000 7f164fa339c0 20 add_watcher() i=4 2024-09-12T18:03:55.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.532+0000 7f164fa339c0 20 add_watcher() i=5 2024-09-12T18:03:55.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.532+0000 7f164fa339c0 20 add_watcher() i=6 2024-09-12T18:03:55.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.532+0000 7f164fa339c0 20 add_watcher() i=7 2024-09-12T18:03:55.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.532+0000 7f164fa339c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:55.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.536+0000 7f1503fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:55.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.536+0000 7f164fa339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:55.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.536+0000 7f164fa339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:55.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.536+0000 7f164fa339c0 5 note: GC not initialized 2024-09-12T18:03:55.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.536+0000 7f1502fe5640 20 reqs_thread_entry: start 2024-09-12T18:03:55.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:55.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 Filter name: none 2024-09-12T18:03:55.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f1500fe1640 20 reqs_thread_entry: start 2024-09-12T18:03:55.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:55.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:55.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:55.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:55.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:55.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.540+0000 7f164fa339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:55.543 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.544+0000 7f1503fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:55.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.548+0000 7f164fa339c0 20 remove_watcher() i=0 2024-09-12T18:03:55.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.548+0000 7f164fa339c0 2 removed watcher, disabling cache 2024-09-12T18:03:55.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.552+0000 7f164fa339c0 20 remove_watcher() i=1 2024-09-12T18:03:55.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.552+0000 7f164fa339c0 20 remove_watcher() i=2 2024-09-12T18:03:55.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.556+0000 7f164fa339c0 20 remove_watcher() i=3 2024-09-12T18:03:55.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.556+0000 7f164fa339c0 20 remove_watcher() i=4 2024-09-12T18:03:55.558 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.560+0000 7f164fa339c0 20 remove_watcher() i=5 2024-09-12T18:03:55.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.560+0000 7f164fa339c0 20 remove_watcher() i=6 2024-09-12T18:03:55.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.560+0000 7f164fa339c0 20 remove_watcher() i=7 2024-09-12T18:03:55.575 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:55.575 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:55.575 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-block-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:03:55.575 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:55.675 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:03:55.710 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:55.711 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:55.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.752+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.756+0000 7f743670c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.756+0000 7f743670c9c0 20 realm 2024-09-12T18:03:55.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.756+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.756+0000 7f743670c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.756+0000 7f743670c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:55.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.756+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.756+0000 7f743670c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.756+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.756+0000 7f743670c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:55.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.756+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.760+0000 7f743670c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:55.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.760+0000 7f743670c9c0 20 searching for the correct realm 2024-09-12T18:03:55.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.764+0000 7f7434a13640 0 -- 172.21.15.157:0/4041891295 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f7428038070 msgr2=0x7f7428070040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:55.980 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.980+0000 7f7434212640 0 -- 172.21.15.157:0/4041891295 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55ea40605410 msgr2=0x55ea40607800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:55.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.988+0000 7f743670c9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:55.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.988+0000 7f743670c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:55.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.988+0000 7f743670c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:55.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.988+0000 7f743670c9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:55.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.988+0000 7f743670c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:55.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.988+0000 7f743670c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:55.988 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.988+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.988+0000 7f743670c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.988+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.988+0000 7f743670c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:55.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.988+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:55.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 20 zone default found 2024-09-12T18:03:55.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 4 Realm: () 2024-09-12T18:03:55.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:55.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:55.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:55.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 20 zonegroup default 2024-09-12T18:03:55.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:55.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:55.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 20 started sync module instance, tier type = 2024-09-12T18:03:55.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:55.992+0000 7f743670c9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:56.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.016+0000 7f743670c9c0 20 add_watcher() i=0 2024-09-12T18:03:56.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.016+0000 7f743670c9c0 20 add_watcher() i=1 2024-09-12T18:03:56.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.016+0000 7f743670c9c0 20 add_watcher() i=2 2024-09-12T18:03:56.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.016+0000 7f743670c9c0 20 add_watcher() i=3 2024-09-12T18:03:56.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.016+0000 7f743670c9c0 20 add_watcher() i=4 2024-09-12T18:03:56.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.016+0000 7f743670c9c0 20 add_watcher() i=5 2024-09-12T18:03:56.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.016+0000 7f743670c9c0 20 add_watcher() i=6 2024-09-12T18:03:56.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.020+0000 7f743670c9c0 20 add_watcher() i=7 2024-09-12T18:03:56.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.020+0000 7f743670c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:56.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.024+0000 7f72eb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:56.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.024+0000 7f743670c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:56.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.024+0000 7f743670c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:56.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.024+0000 7f743670c9c0 5 note: GC not initialized 2024-09-12T18:03:56.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.024+0000 7f72ea7dc640 20 reqs_thread_entry: start 2024-09-12T18:03:56.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.024+0000 7f743670c9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:56.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.024+0000 7f743670c9c0 20 Filter name: none 2024-09-12T18:03:56.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.024+0000 7f72e37fe640 20 reqs_thread_entry: start 2024-09-12T18:03:56.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.024+0000 7f743670c9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T18:03:56.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.024+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.028+0000 7f743670c9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:56.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.028+0000 7f743670c9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T18:03:56.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.028+0000 7f743670c9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T18:03:56.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.028+0000 7f743670c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 : miss 2024-09-12T18:03:56.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.028+0000 7f743670c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.028+0000 7f743670c9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:56.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.028+0000 7f743670c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:56.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.028+0000 7f743670c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:56.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.028+0000 7f743670c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:56.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.028+0000 7f743670c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:56.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.028+0000 7f743670c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 2024-09-12T18:03:56.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.032+0000 7f743670c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:56.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.032+0000 7f743670c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:56.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.032+0000 7f743670c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:56.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.032+0000 7f743670c9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28, ofs0, ns] 2024-09-12T18:03:56.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.032+0000 7f730b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464327 cookie 94464590771056 notifier 7098 bl.length()=915 2024-09-12T18:03:56.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.032+0000 7f730b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:56.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.032+0000 7f730b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:56.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.032+0000 7f730b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:56.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.036+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_sources= new_sources= 2024-09-12T18:03:56.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.036+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential sources added=[] removed=[] 2024-09-12T18:03:56.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.036+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_dests= new_dests= 2024-09-12T18:03:56.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.036+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential dests added=[] removed=[] 2024-09-12T18:03:56.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.044+0000 7f743670c9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28.1.0 2024-09-12T18:03:56.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.044+0000 7f743670c9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28.1.0 2024-09-12T18:03:56.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.044+0000 7f743670c9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28.1.1 2024-09-12T18:03:56.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.044+0000 7f743670c9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28.1.1 2024-09-12T18:03:56.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.044+0000 7f743670c9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28.0 2024-09-12T18:03:56.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.048+0000 7f743670c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:56.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.048+0000 7f743670c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 2024-09-12T18:03:56.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f743670c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:56.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f743670c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:56.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f743670c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:56.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f743670c9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28, ofs0, ns] 2024-09-12T18:03:56.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f730affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464328 cookie 94464590771056 notifier 7098 bl.length()=915 2024-09-12T18:03:56.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f730affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:56.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f730affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:56.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f730affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:56.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_sources= new_sources= 2024-09-12T18:03:56.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential sources added=[] removed=[] 2024-09-12T18:03:56.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_dests= new_dests= 2024-09-12T18:03:56.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.052+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential dests added=[] removed=[] 2024-09-12T18:03:56.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.056+0000 7f743670c9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28.0 2024-09-12T18:03:56.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.056+0000 7f743670c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:56.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.056+0000 7f743670c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 2024-09-12T18:03:56.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.060+0000 7f743670c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:56.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.060+0000 7f743670c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:56.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.060+0000 7f743670c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:56.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.060+0000 7f743670c9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28, ofs0, ns] 2024-09-12T18:03:56.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.060+0000 7f730b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 94464590771056 notifier 7098 bl.length()=883 2024-09-12T18:03:56.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.060+0000 7f730b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 info.flags=0x17 2024-09-12T18:03:56.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.060+0000 7f730b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 to cache LRU end 2024-09-12T18:03:56.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.060+0000 7f730b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:56.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.064+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_sources= new_sources= 2024-09-12T18:03:56.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.064+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential sources added=[] removed=[] 2024-09-12T18:03:56.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.064+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): orig_dests= new_dests= 2024-09-12T18:03:56.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.064+0000 7f743670c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28]): potential dests added=[] removed=[] 2024-09-12T18:03:56.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.068+0000 7f743670c9c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T18:03:56.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.072+0000 7f72eb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:56.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.076+0000 7f743670c9c0 20 remove_watcher() i=0 2024-09-12T18:03:56.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.076+0000 7f743670c9c0 2 removed watcher, disabling cache 2024-09-12T18:03:56.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.080+0000 7f743670c9c0 20 remove_watcher() i=1 2024-09-12T18:03:56.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.084+0000 7f743670c9c0 20 remove_watcher() i=2 2024-09-12T18:03:56.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.084+0000 7f743670c9c0 20 remove_watcher() i=3 2024-09-12T18:03:56.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.088+0000 7f743670c9c0 20 remove_watcher() i=4 2024-09-12T18:03:56.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.092+0000 7f743670c9c0 20 remove_watcher() i=5 2024-09-12T18:03:56.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.092+0000 7f743670c9c0 20 remove_watcher() i=6 2024-09-12T18:03:56.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.096+0000 7f743670c9c0 20 remove_watcher() i=7 2024-09-12T18:03:56.119 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T18:03:56.146 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:56.146 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:56.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.192+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.192+0000 7fcef1d419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:56.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.192+0000 7fcef1d419c0 20 realm 2024-09-12T18:03:56.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.192+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.196+0000 7fcef1d419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:56.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.196+0000 7fcef1d419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:56.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.196+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.196+0000 7fcef1d419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:56.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.196+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.196+0000 7fcef1d419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:56.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.196+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.196+0000 7fcef1d419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:56.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.196+0000 7fcef1d419c0 20 searching for the correct realm 2024-09-12T18:03:56.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.204+0000 7fcef0048640 0 -- 172.21.15.157:0/3720184968 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fcee4027020 msgr2=0x7fcee4050a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:56.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.420+0000 7fceef847640 0 -- 172.21.15.157:0/3720184968 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55cd62b92cc0 msgr2=0x55cd62b950b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:56.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:56.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:56.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:56.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:56.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:56.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:56.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:56.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:56.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:56.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 zone default found 2024-09-12T18:03:56.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 4 Realm: () 2024-09-12T18:03:56.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:56.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:56.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:56.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 zonegroup default 2024-09-12T18:03:56.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.428+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.432+0000 7fcef1d419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:56.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.432+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.432+0000 7fcef1d419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:56.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.432+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.432+0000 7fcef1d419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:56.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.432+0000 7fcef1d419c0 20 started sync module instance, tier type = 2024-09-12T18:03:56.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.432+0000 7fcef1d419c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:56.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.452+0000 7fcef1d419c0 20 add_watcher() i=0 2024-09-12T18:03:56.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.452+0000 7fcef1d419c0 20 add_watcher() i=1 2024-09-12T18:03:56.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.452+0000 7fcef1d419c0 20 add_watcher() i=2 2024-09-12T18:03:56.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.452+0000 7fcef1d419c0 20 add_watcher() i=3 2024-09-12T18:03:56.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.452+0000 7fcef1d419c0 20 add_watcher() i=4 2024-09-12T18:03:56.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.452+0000 7fcef1d419c0 20 add_watcher() i=5 2024-09-12T18:03:56.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.452+0000 7fcef1d419c0 20 add_watcher() i=6 2024-09-12T18:03:56.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.456+0000 7fcef1d419c0 20 add_watcher() i=7 2024-09-12T18:03:56.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.456+0000 7fcef1d419c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:56.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.460+0000 7fcda5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:56.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.460+0000 7fcef1d419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:56.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.460+0000 7fcef1d419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:56.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.460+0000 7fcef1d419c0 5 note: GC not initialized 2024-09-12T18:03:56.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.460+0000 7fcda4fe1640 20 reqs_thread_entry: start 2024-09-12T18:03:56.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.460+0000 7fcef1d419c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:56.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.460+0000 7fcef1d419c0 20 Filter name: none 2024-09-12T18:03:56.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.460+0000 7fcd1e7fc640 20 reqs_thread_entry: start 2024-09-12T18:03:56.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.460+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.464+0000 7fcef1d419c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:56.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.464+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.464+0000 7fcef1d419c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:56.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.464+0000 7fcef1d419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:56.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.464+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.464+0000 7fcef1d419c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:56.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.464+0000 7fcef1d419c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:56.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.464+0000 7fcef1d419c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:56.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.464+0000 7fcef1d419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:56.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.468+0000 7fcda5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:56.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.472+0000 7fcef1d419c0 20 remove_watcher() i=0 2024-09-12T18:03:56.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.472+0000 7fcef1d419c0 2 removed watcher, disabling cache 2024-09-12T18:03:56.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.476+0000 7fcef1d419c0 20 remove_watcher() i=1 2024-09-12T18:03:56.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.476+0000 7fcef1d419c0 20 remove_watcher() i=2 2024-09-12T18:03:56.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.480+0000 7fcef1d419c0 20 remove_watcher() i=3 2024-09-12T18:03:56.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.480+0000 7fcef1d419c0 20 remove_watcher() i=4 2024-09-12T18:03:56.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.484+0000 7fcef1d419c0 20 remove_watcher() i=5 2024-09-12T18:03:56.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.484+0000 7fcef1d419c0 20 remove_watcher() i=6 2024-09-12T18:03:56.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:56.488+0000 7fcef1d419c0 20 remove_watcher() i=7 2024-09-12T18:03:56.501 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:56.501 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:56.501 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-block-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:03:56.501 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:57.209 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T18:03:57.209 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.341 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T18:03:59.375 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:59.376 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:59.421 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.420+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.424+0000 7efe1efb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.424+0000 7efe1efb99c0 20 realm 2024-09-12T18:03:59.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.424+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.424+0000 7efe1efb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.424+0000 7efe1efb99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:59.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.424+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.424+0000 7efe1efb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.424+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.424+0000 7efe1efb99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:59.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.424+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.428+0000 7efe1efb99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:59.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.428+0000 7efe1efb99c0 20 searching for the correct realm 2024-09-12T18:03:59.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.432+0000 7efe1d2c0640 0 -- 172.21.15.157:0/2211470466 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x558d622cb5c0 msgr2=0x558d622cda80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:59.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.436+0000 7efe1cabf640 0 -- 172.21.15.157:0/2211470466 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7efe080f7910 msgr2=0x7efe080aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:59.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.444+0000 7efe1efb99c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:59.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.444+0000 7efe1efb99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:59.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.444+0000 7efe1efb99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:59.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.444+0000 7efe1efb99c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:59.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.444+0000 7efe1efb99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:59.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.444+0000 7efe1efb99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:59.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.444+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.444+0000 7efe1efb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.444+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:59.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:59.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 zone default found 2024-09-12T18:03:59.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 4 Realm: () 2024-09-12T18:03:59.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:59.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:59.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:59.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 zonegroup default 2024-09-12T18:03:59.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 started sync module instance, tier type = 2024-09-12T18:03:59.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.448+0000 7efe1efb99c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:59.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.464+0000 7efe1efb99c0 20 add_watcher() i=0 2024-09-12T18:03:59.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.464+0000 7efe1efb99c0 20 add_watcher() i=1 2024-09-12T18:03:59.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.464+0000 7efe1efb99c0 20 add_watcher() i=2 2024-09-12T18:03:59.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.464+0000 7efe1efb99c0 20 add_watcher() i=3 2024-09-12T18:03:59.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.464+0000 7efe1efb99c0 20 add_watcher() i=4 2024-09-12T18:03:59.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.464+0000 7efe1efb99c0 20 add_watcher() i=5 2024-09-12T18:03:59.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.464+0000 7efe1efb99c0 20 add_watcher() i=6 2024-09-12T18:03:59.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.464+0000 7efe1efb99c0 20 add_watcher() i=7 2024-09-12T18:03:59.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.464+0000 7efe1efb99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:59.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efcd2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:59.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:59.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:59.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 5 note: GC not initialized 2024-09-12T18:03:59.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efcd1fe3640 20 reqs_thread_entry: start 2024-09-12T18:03:59.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:59.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 Filter name: none 2024-09-12T18:03:59.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efc437fe640 20 reqs_thread_entry: start 2024-09-12T18:03:59.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:59.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:59.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:59.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:59.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:59.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.468+0000 7efe1efb99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:59.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.472+0000 7efcd2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:59.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.476+0000 7efe1efb99c0 20 remove_watcher() i=0 2024-09-12T18:03:59.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.476+0000 7efe1efb99c0 2 removed watcher, disabling cache 2024-09-12T18:03:59.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.476+0000 7efe1efb99c0 20 remove_watcher() i=1 2024-09-12T18:03:59.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.480+0000 7efe1efb99c0 20 remove_watcher() i=2 2024-09-12T18:03:59.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.484+0000 7efe1efb99c0 20 remove_watcher() i=3 2024-09-12T18:03:59.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.484+0000 7efe1efb99c0 20 remove_watcher() i=4 2024-09-12T18:03:59.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.484+0000 7efe1efb99c0 20 remove_watcher() i=5 2024-09-12T18:03:59.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.488+0000 7efe1efb99c0 20 remove_watcher() i=6 2024-09-12T18:03:59.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.488+0000 7efe1efb99c0 20 remove_watcher() i=7 2024-09-12T18:03:59.501 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.501 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:03:59.501 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-block-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:03:59.501 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.501 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T18:03:59.533 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:59.533 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:59.575 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 realm 2024-09-12T18:03:59.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.576+0000 7f55ec3319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:59.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:59.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:59.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 searching for the correct realm 2024-09-12T18:03:59.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.588+0000 7f55ea638640 0 -- 172.21.15.157:0/1981604824 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f55e00c9070 msgr2=0x7f55e01319d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:59.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.596+0000 7f55e9e37640 0 -- 172.21.15.157:0/1981604824 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5650699e0b20 msgr2=0x5650699e2fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:59.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:59.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:59.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:59.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:59.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:59.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:59.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:59.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:59.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 zone default found 2024-09-12T18:03:59.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 4 Realm: () 2024-09-12T18:03:59.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:59.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:59.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:59.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 zonegroup default 2024-09-12T18:03:59.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 started sync module instance, tier type = 2024-09-12T18:03:59.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:59.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=0 2024-09-12T18:03:59.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=1 2024-09-12T18:03:59.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=2 2024-09-12T18:03:59.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=3 2024-09-12T18:03:59.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=4 2024-09-12T18:03:59.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=5 2024-09-12T18:03:59.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=6 2024-09-12T18:03:59.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=7 2024-09-12T18:03:59.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.620+0000 7f55ec3319c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:59.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f549b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:59.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:59.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:59.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 note: GC not initialized 2024-09-12T18:03:59.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f549a7fc640 20 reqs_thread_entry: start 2024-09-12T18:03:59.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:59.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 Filter name: none 2024-09-12T18:03:59.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f540bfff640 20 reqs_thread_entry: start 2024-09-12T18:03:59.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:03:59.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:59.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:03:59.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:03:59.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 : miss 2024-09-12T18:03:59.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:59.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:59.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 2024-09-12T18:03:59.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29, ofs0, ns] 2024-09-12T18:03:59.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94903369403696 notifier 6668 bl.length()=915 2024-09-12T18:03:59.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_sources= new_sources= 2024-09-12T18:03:59.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential sources added=[] removed=[] 2024-09-12T18:03:59.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_dests= new_dests= 2024-09-12T18:03:59.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential dests added=[] removed=[] 2024-09-12T18:03:59.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.640+0000 7f55ec3319c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.0 2024-09-12T18:03:59.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.640+0000 7f55ec3319c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.0 2024-09-12T18:03:59.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.640+0000 7f55ec3319c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.1 2024-09-12T18:03:59.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.640+0000 7f55ec3319c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.1 2024-09-12T18:03:59.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.640+0000 7f55ec3319c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.0 2024-09-12T18:03:59.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.644+0000 7f55ec3319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:59.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.644+0000 7f55ec3319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 2024-09-12T18:03:59.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29, ofs0, ns] 2024-09-12T18:03:59.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94903369403696 notifier 6668 bl.length()=915 2024-09-12T18:03:59.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_sources= new_sources= 2024-09-12T18:03:59.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential sources added=[] removed=[] 2024-09-12T18:03:59.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_dests= new_dests= 2024-09-12T18:03:59.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential dests added=[] removed=[] 2024-09-12T18:03:59.648 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f55ec3319c0 time 2024-09-12T18:03:59.653677+0000 2024-09-12T18:03:59.648 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:59.649 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:59.649 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f55efc0b2eb] 2024-09-12T18:03:59.649 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f55efc0b49f] 2024-09-12T18:03:59.649 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56506685f0c1] 2024-09-12T18:03:59.649 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x56506687055b] 2024-09-12T18:03:59.649 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565066871b44] 2024-09-12T18:03:59.649 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:03:59.649 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f55eea71d90] 2024-09-12T18:03:59.649 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.648+0000 7f55ec3319c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f55ec3319c0 time 2024-09-12T18:03:59.653677+0000 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f55efc0b2eb] 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f55efc0b49f] 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56506685f0c1] 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x56506687055b] 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565066871b44] 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:03:59.650 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f55eea71d90] 2024-09-12T18:03:59.651 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:03:59.651 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:03:59.651 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.651 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:03:59.651 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f55ec3319c0 thread_name:radosgw-admin 2024-09-12T18:03:59.667 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:59.667 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f55eea8a520] 2024-09-12T18:03:59.667 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:03:59.667 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:03:59.668 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:03:59.668 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f55efc0b345] 2024-09-12T18:03:59.668 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f55efc0b49f] 2024-09-12T18:03:59.668 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56506685f0c1] 2024-09-12T18:03:59.668 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x56506687055b] 2024-09-12T18:03:59.668 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565066871b44] 2024-09-12T18:03:59.668 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:03:59.668 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f55eea71d90] 2024-09-12T18:03:59.668 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:03:59.668 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:03:59.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.652+0000 7f55ec3319c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f55ec3319c0 thread_name:radosgw-admin 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f55eea8a520] 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f55efc0b345] 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f55efc0b49f] 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56506685f0c1] 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x56506687055b] 2024-09-12T18:03:59.669 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565066871b44] 2024-09-12T18:03:59.670 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:03:59.670 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f55eea71d90] 2024-09-12T18:03:59.670 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:03:59.670 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:03:59.670 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:59.670 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.670 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:03:59.670 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:03:59.556+0000 7f54d7e07640 10 monclient: dump: 2024-09-12T18:03:59.670 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.670 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.670 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 monclient: authenticate success, global_id 6656 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 4 set_mon_vals no callback set 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: shutdown 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 asok(0x5650696e82b0) unregister_commands rotate-key 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: build_initial_monmap 2024-09-12T18:03:59.671 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: monmap: 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding auth protocol: cephx 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding auth protocol: cephx 2024-09-12T18:03:59.672 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding auth protocol: cephx 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.673 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 librados: starting msgr at 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 librados: starting objecter 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command objecter_requests hook 0x5650698f70b0 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 librados: setting wanted keys 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 librados: calling monclient init 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: init 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding auth protocol: cephx 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding auth protocol: cephx 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding auth protocol: cephx 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.674 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command rotate-key hook 0x5650698f3238 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:03:59.675 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-a con 0x565069782040 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-b con 0x5650697aac80 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-c con 0x5650698f66c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): authenticate will time out at 2401.783019s 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): get_auth_request con 0x5650698f66c0 auth_method 0 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.676 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): get_auth_request con 0x565069782040 auth_method 0 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): handle_auth_done global_id 6659 payload 824 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient: _finish_hunting 0 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:03:59.556+0000 7f55ea638640 1 monclient: found mon.noname-c 2024-09-12T18:03:59.677 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: dump: 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.678 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: _finish_auth 0 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: _check_auth_tickets 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: dump: 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.679 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 monclient: authenticate success, global_id 6659 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:03:59.556+0000 7f54d7e07640 4 set_mon_vals no callback set 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 librados: init done 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:03:59.560+0000 7f54d6604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:03:59.560+0000 7f54d6604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.680 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:03:59.560+0000 7f54d6604640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:03:59.560+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f54d0070ae0 auth_method 0 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:03:59.560+0000 7f55e9636640 10 monclient: get_auth_request con 0x56506991b900 auth_method 0 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:03:59.560+0000 7f55e9e37640 10 monclient: get_auth_request con 0x56506993dfd0 auth_method 0 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:03:59.564+0000 7f55e9636640 10 monclient: get_auth_request con 0x565069942670 auth_method 0 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient: build_initial_monmap 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient: monmap: 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:59.681 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding auth protocol: cephx 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding auth protocol: cephx 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding auth protocol: cephx 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.682 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command objecter_requests cmddesc objecter_requests hook 0x56506994ac40 EEXIST 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient: init 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding auth protocol: cephx 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding auth protocol: cephx 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding auth protocol: cephx 2024-09-12T18:03:59.683 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.684 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command rotate-key cmddesc rotate-key hook 0x565069945b60 EEXIST 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-b con 0x56506996edf0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-a con 0x56506996e720 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-c con 0x56506996d100 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:59.685 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): authenticate will time out at 2401.791798s 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:03:59.564+0000 7f55e9636640 10 monclient(hunting): get_auth_request con 0x56506996e720 auth_method 0 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:03:59.564+0000 7f55e9636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:03:59.564+0000 7f55e9636640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:03:59.564+0000 7f55e9636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:03:59.564+0000 7f55ea638640 10 monclient(hunting): get_auth_request con 0x56506996d100 auth_method 0 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:03:59.564+0000 7f55ea638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:03:59.564+0000 7f55ea638640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:03:59.564+0000 7f55ea638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:03:59.568+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.686 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:03:59.568+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:03:59.568+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient(hunting): handle_auth_done global_id 6662 payload 824 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient: _finish_hunting 0 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:03:59.568+0000 7f55ea638640 1 monclient: found mon.noname-c 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: dump: 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.687 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: _finish_auth 0 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: dump: 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.688 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:03:59.568+0000 7f55eae39640 4 set_mon_vals no callback set 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 monclient: authenticate success, global_id 6662 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:59.689 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:03:59.568+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f54c4070a20 auth_method 0 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: get_monmap_and_config 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: build_initial_monmap 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: monmap: 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:59.690 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding auth protocol: cephx 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding auth protocol: cephx 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding auth protocol: cephx 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.691 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: init 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding auth protocol: cephx 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding auth protocol: cephx 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding auth protocol: cephx 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.692 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command rotate-key cmddesc rotate-key hook 0x7fff05c90438 EEXIST 2024-09-12T18:03:59.693 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-a con 0x565069992920 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-b con 0x5650699c2c10 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-c con 0x5650699b4890 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): authenticate will time out at 2401.796264s 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): get_auth_request con 0x565069992920 auth_method 0 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.694 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): get_auth_request con 0x5650699b4890 auth_method 0 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): handle_auth_done global_id 7146 payload 274 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient: _finish_hunting 0 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:03:59.572+0000 7f55e9e37640 1 monclient: found mon.noname-a 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:03:59.695 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: dump: 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.696 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: _finish_auth 0 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: dump: 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.697 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 monclient: authenticate success, global_id 7146 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 4 set_mon_vals no callback set 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: shutdown 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: build_initial_monmap 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: monmap: 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:59.698 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding auth protocol: cephx 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding auth protocol: cephx 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding auth protocol: cephx 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.699 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 1 librados: starting msgr at 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 1 librados: starting objecter 2024-09-12T18:03:59.700 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command objecter_requests cmddesc objecter_requests hook 0x56506996cd70 EEXIST 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 1 librados: setting wanted keys 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 1 librados: calling monclient init 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: init 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding auth protocol: cephx 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding auth protocol: cephx 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding auth protocol: cephx 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.701 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command rotate-key cmddesc rotate-key hook 0x565069970d58 EEXIST 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-b con 0x565069992920 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-c con 0x5650699b4890 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-a con 0x5650699c2c10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:59.702 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): authenticate will time out at 2401.798947s 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): get_auth_request con 0x5650699b4890 auth_method 0 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): get_auth_request con 0x5650699c2c10 auth_method 0 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.703 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): handle_auth_done global_id 6668 payload 824 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient: _finish_hunting 0 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:03:59.572+0000 7f55e9636640 1 monclient: found mon.noname-c 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: dump: 2024-09-12T18:03:59.704 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: _finish_auth 0 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:03:59.705 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: dump: 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.706 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 4 set_mon_vals no callback set 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 5 monclient: authenticate success, global_id 6668 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 1 librados: init done 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command cr dump hook 0x5650699b6e08 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:03:59.576+0000 7f54bb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:03:59.576+0000 7f54bb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:03:59.576+0000 7f54bb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:03:59.576+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f54b4070ae0 auth_method 0 2024-09-12T18:03:59.707 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:03:59.576+0000 7f55ea638640 10 monclient: get_auth_request con 0x5650699dcb00 auth_method 0 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 realm 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:03:59.580+0000 7f55e9e37640 10 monclient: get_auth_request con 0x5650699e0b20 auth_method 0 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.708 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:03:59.580+0000 7f55e9636640 10 monclient: get_auth_request con 0x5650699e43f0 auth_method 0 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 searching for the correct realm 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:03:59.580+0000 7f55ea638640 10 monclient: get_auth_request con 0x5650699e9140 auth_method 0 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:03:59.580+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f55e406a2d0 auth_method 0 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:03:59.584+0000 7f55e9636640 10 monclient: get_auth_request con 0x7f55e00d2070 auth_method 0 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:03:59.588+0000 7f55ea638640 10 monclient: get_auth_request con 0x7f55e00c9070 auth_method 0 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:03:59.588+0000 7f55ea638640 0 -- 172.21.15.157:0/1981604824 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f55e00c9070 msgr2=0x7f55e01319d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:03:59.588+0000 7f54bb7fe640 1 client.6668.objecter ms_handle_reset 0x7f55e00c9070 session 0x7f55e00a6070 osd.6 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:03:59.588+0000 7f54bb7fe640 10 monclient: _renew_subs 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:03:59.588+0000 7f54bb7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:03:59.588+0000 7f55ea638640 10 monclient: get_auth_request con 0x7f54b4080900 auth_method 0 2024-09-12T18:03:59.709 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:03:59.592+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f55e00fe5d0 auth_method 0 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:03:59.596+0000 7f55e9e37640 0 -- 172.21.15.157:0/1981604824 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5650699e0b20 msgr2=0x5650699e2fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:03:59.596+0000 7f54bb7fe640 1 client.6668.objecter ms_handle_reset 0x5650699e0b20 session 0x5650699dc2f0 osd.5 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:03:59.596+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f55e00c9070 auth_method 0 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.710 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 zone default found 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 4 Realm: () 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 zonegroup default 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.711 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 started sync module instance, tier type = 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=0 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=1 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=2 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=3 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=4 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=5 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=6 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=7 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:59.712 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding auth protocol: cephx 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding auth protocol: cephx 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding auth protocol: cephx 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:03:59.624+0000 7f549b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.713 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command cache list hook 0x5650699b7850 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command cache inspect hook 0x5650699b7850 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command cache erase hook 0x5650699b7850 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command cache zap hook 0x5650699b7850 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 note: GC not initialized 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:03:59.624+0000 7f549a7fc640 20 reqs_thread_entry: start 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command sync trace show hook 0x7f55dc009930 2024-09-12T18:03:59.714 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command sync trace history hook 0x7f55dc009930 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command sync trace active hook 0x7f55dc009930 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command sync trace active_short hook 0x7f55dc009930 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 Filter name: none 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:03:59.624+0000 7f540bfff640 20 reqs_thread_entry: start 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 : miss 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.715 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:59.716 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.716 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.716 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:59.716 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.716 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 2024-09-12T18:03:59.716 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.716 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.716 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.716 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29, ofs0, ns] 2024-09-12T18:03:59.716 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94903369403696 notifier 6668 bl.length()=915 2024-09-12T18:03:59.716 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_sources= new_sources= 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential sources added=[] removed=[] 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_dests= new_dests= 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential dests added=[] removed=[] 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:03:59.640+0000 7f55ec3319c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.0 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:03:59.640+0000 7f55ec3319c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.0 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:03:59.640+0000 7f55ec3319c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.1 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:03:59.640+0000 7f55ec3319c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.1 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:03:59.640+0000 7f55ec3319c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.0 2024-09-12T18:03:59.717 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:03:59.644+0000 7f55ec3319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:03:59.644+0000 7f55ec3319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29, ofs0, ns] 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94903369403696 notifier 6668 bl.length()=915 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_sources= new_sources= 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential sources added=[] removed=[] 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_dests= new_dests= 2024-09-12T18:03:59.718 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential dests added=[] removed=[] 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f55ec3319c0 time 2024-09-12T18:03:59.653677+0000 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f55efc0b2eb] 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f55efc0b49f] 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56506685f0c1] 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x56506687055b] 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565066871b44] 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f55eea71d90] 2024-09-12T18:03:59.719 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:03:59.652+0000 7f55ec3319c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f55ec3319c0 thread_name:radosgw-admin 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f55eea8a520] 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f55efc0b345] 2024-09-12T18:03:59.720 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f55efc0b49f] 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56506685f0c1] 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x56506687055b] 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565066871b44] 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f55eea71d90] 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:03:59.721 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:03:59.722 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:03:59.723 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:03:59.724 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:03:59.725 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:03:59.726 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:03:59.727 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:03:59.728 INFO:tasks.workunit.client.0.smithi157.stderr: 7f540bfff640 / http_manager 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f549a7fc640 / http_manager 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f549b7fe640 / rgw_dt_lg_renew 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f54bb7fe640 / ms_dispatch 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f54cd7fa640 / io_context_pool 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f54cf7fe640 / ms_dispatch 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f54d6604640 / ms_dispatch 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f54d7e07640 / io_context_pool 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f55e9636640 / msgr-worker-2 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f55e9e37640 / msgr-worker-1 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f55ea638640 / msgr-worker-0 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f55eae39640 / io_context_pool 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: 7f55ec3319c0 / radosgw-admin 2024-09-12T18:03:59.729 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.104034.log 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:03:59.556+0000 7f54d7e07640 10 monclient: dump: 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.730 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 monclient: authenticate success, global_id 6656 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 4 set_mon_vals no callback set 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: shutdown 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 asok(0x5650696e82b0) unregister_commands rotate-key 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: build_initial_monmap 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: monmap: 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:59.731 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding auth protocol: cephx 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding auth protocol: cephx 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding auth protocol: cephx 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.732 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: crc 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f8700) adding con mode: secure 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 librados: starting msgr at 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 librados: starting objecter 2024-09-12T18:03:59.733 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command objecter_requests hook 0x5650698f70b0 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 librados: setting wanted keys 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 librados: calling monclient init 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: init 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding auth protocol: cephx 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding auth protocol: cephx 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding auth protocol: cephx 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.734 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: crc 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 AuthRegistry(0x5650698f30f0) adding con mode: secure 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command rotate-key hook 0x5650698f3238 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-a con 0x565069782040 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-b con 0x5650697aac80 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:59.735 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-c con 0x5650698f66c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient(hunting): authenticate will time out at 2401.783019s 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): get_auth_request con 0x5650698f66c0 auth_method 0 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): get_auth_request con 0x565069782040 auth_method 0 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.736 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:03:59.556+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient(hunting): handle_auth_done global_id 6659 payload 824 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient: _finish_hunting 0 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:03:59.556+0000 7f55ea638640 1 monclient: found mon.noname-c 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:03:59.556+0000 7f55ea638640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: dump: 2024-09-12T18:03:59.737 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: _finish_auth 0 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: _check_auth_tickets 2024-09-12T18:03:59.738 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:03:59.556+0000 7f54d6604640 10 monclient: dump: 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.739 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 5 monclient: authenticate success, global_id 6659 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:03:59.556+0000 7f54d7e07640 4 set_mon_vals no callback set 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:03:59.556+0000 7f55ec3319c0 1 librados: init done 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:03:59.560+0000 7f54d6604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:03:59.560+0000 7f54d6604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:03:59.560+0000 7f54d6604640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:03:59.560+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f54d0070ae0 auth_method 0 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:03:59.560+0000 7f55e9636640 10 monclient: get_auth_request con 0x56506991b900 auth_method 0 2024-09-12T18:03:59.740 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:03:59.560+0000 7f55e9e37640 10 monclient: get_auth_request con 0x56506993dfd0 auth_method 0 2024-09-12T18:03:59.741 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:03:59.564+0000 7f55e9636640 10 monclient: get_auth_request con 0x565069942670 auth_method 0 2024-09-12T18:03:59.741 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient: build_initial_monmap 2024-09-12T18:03:59.741 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:59.741 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient: monmap: 2024-09-12T18:03:59.741 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:59.741 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:59.741 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:59.741 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:59.741 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:59.741 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.741 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding auth protocol: cephx 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding auth protocol: cephx 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding auth protocol: cephx 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.742 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: crc 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x5650699472f0) adding con mode: secure 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command objecter_requests cmddesc objecter_requests hook 0x56506994ac40 EEXIST 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient: init 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding auth protocol: cephx 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding auth protocol: cephx 2024-09-12T18:03:59.743 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding auth protocol: cephx 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: crc 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 AuthRegistry(0x565069945a18) adding con mode: secure 2024-09-12T18:03:59.744 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command rotate-key cmddesc rotate-key hook 0x565069945b60 EEXIST 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-b con 0x56506996edf0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-a con 0x56506996e720 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-c con 0x56506996d100 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:59.745 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:03:59.564+0000 7f55ec3319c0 10 monclient(hunting): authenticate will time out at 2401.791798s 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:03:59.564+0000 7f55e9636640 10 monclient(hunting): get_auth_request con 0x56506996e720 auth_method 0 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:03:59.564+0000 7f55e9636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:03:59.564+0000 7f55e9636640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:03:59.564+0000 7f55e9636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:03:59.564+0000 7f55ea638640 10 monclient(hunting): get_auth_request con 0x56506996d100 auth_method 0 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:03:59.564+0000 7f55ea638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:03:59.564+0000 7f55ea638640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:03:59.564+0000 7f55ea638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:03:59.568+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.746 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:03:59.568+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:03:59.568+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient(hunting): handle_auth_done global_id 6662 payload 824 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient: _finish_hunting 0 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:03:59.568+0000 7f55ea638640 1 monclient: found mon.noname-c 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:03:59.568+0000 7f55ea638640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: dump: 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.747 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: _finish_auth 0 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 10 monclient: dump: 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.748 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:03:59.568+0000 7f55eae39640 4 set_mon_vals no callback set 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 monclient: authenticate success, global_id 6662 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.749 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:03:59.568+0000 7f54cf7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:03:59.568+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f54c4070a20 auth_method 0 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: get_monmap_and_config 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: build_initial_monmap 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: monmap: 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:59.750 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding auth protocol: cephx 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding auth protocol: cephx 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding auth protocol: cephx 2024-09-12T18:03:59.751 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: crc 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x56506998e7a0) adding con mode: secure 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.752 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 10 monclient: init 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding auth protocol: cephx 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding auth protocol: cephx 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding auth protocol: cephx 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.753 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: crc 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c902f0) adding con mode: secure 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:03:59.568+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command rotate-key cmddesc rotate-key hook 0x7fff05c90438 EEXIST 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-a con 0x565069992920 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-b con 0x5650699c2c10 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-c con 0x5650699b4890 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.754 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): authenticate will time out at 2401.796264s 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): get_auth_request con 0x565069992920 auth_method 0 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): get_auth_request con 0x5650699b4890 auth_method 0 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.755 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.756 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.756 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient(hunting): handle_auth_done global_id 7146 payload 274 2024-09-12T18:03:59.756 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient: _finish_hunting 0 2024-09-12T18:03:59.756 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:03:59.572+0000 7f55e9e37640 1 monclient: found mon.noname-a 2024-09-12T18:03:59.756 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:03:59.572+0000 7f55e9e37640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:03:59.756 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.756 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:59.756 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: dump: 2024-09-12T18:03:59.756 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.756 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: _finish_auth 0 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:59.757 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 10 monclient: dump: 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.758 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 monclient: authenticate success, global_id 7146 2024-09-12T18:03:59.759 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:59.759 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 4 set_mon_vals no callback set 2024-09-12T18:03:59.759 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: shutdown 2024-09-12T18:03:59.759 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: build_initial_monmap 2024-09-12T18:03:59.759 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:59.759 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: monmap: 2024-09-12T18:03:59.760 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:03:59.760 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:59.760 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:03:59.760 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:03:59.760 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:59.760 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.760 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:03:59.760 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:03:59.760 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:03:59.760 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.760 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding auth protocol: cephx 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding auth protocol: cephx 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding auth protocol: cephx 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.761 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: crc 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x5650699b4dc0) adding con mode: secure 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 1 librados: starting msgr at 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 1 librados: starting objecter 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command objecter_requests cmddesc objecter_requests hook 0x56506996cd70 EEXIST 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 1 librados: setting wanted keys 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 1 librados: calling monclient init 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: init 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding auth protocol: cephx 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding auth protocol: cephx 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding auth protocol: cephx 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.762 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: crc 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 AuthRegistry(0x565069970c10) adding con mode: secure 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.763 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.764 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command rotate-key cmddesc rotate-key hook 0x565069970d58 EEXIST 2024-09-12T18:03:59.764 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:59.764 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:03:59.764 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-b con 0x565069992920 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:03:59.764 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-c con 0x5650699b4890 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:03:59.764 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): picked mon.noname-a con 0x5650699c2c10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:03:59.764 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.764 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.764 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:59.764 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:59.764 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:03:59.572+0000 7f55ec3319c0 10 monclient(hunting): authenticate will time out at 2401.798947s 2024-09-12T18:03:59.765 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): get_auth_request con 0x5650699b4890 auth_method 0 2024-09-12T18:03:59.765 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.765 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.765 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.765 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): get_auth_request con 0x5650699c2c10 auth_method 0 2024-09-12T18:03:59.765 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:59.765 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:59.765 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:59.765 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.765 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.765 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:03:59.572+0000 7f55ea638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient(hunting): handle_auth_done global_id 6668 payload 824 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient: _finish_hunting 0 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:03:59.572+0000 7f55e9636640 1 monclient: found mon.noname-c 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:03:59.572+0000 7f55e9636640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: dump: 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.766 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.767 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.767 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.767 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.767 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.767 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.767 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.767 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.767 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.767 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: _finish_auth 0 2024-09-12T18:03:59.767 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:03:59.767 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:03:59.572+0000 7f54bb7fe640 10 monclient: dump: 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:03:59.768 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:03:59.572+0000 7f54cd7fa640 4 set_mon_vals no callback set 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 5 monclient: authenticate success, global_id 6668 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 10 monclient: _renew_subs 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 1 librados: init done 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command cr dump hook 0x5650699b6e08 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:03:59.576+0000 7f54bb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:03:59.576+0000 7f54bb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:03:59.576+0000 7f54bb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:03:59.769 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:03:59.576+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f54b4070ae0 auth_method 0 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:03:59.576+0000 7f55ea638640 10 monclient: get_auth_request con 0x5650699dcb00 auth_method 0 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 realm 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:03:59.576+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:03:59.580+0000 7f55e9e37640 10 monclient: get_auth_request con 0x5650699e0b20 auth_method 0 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:59.770 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:03:59.580+0000 7f55e9636640 10 monclient: get_auth_request con 0x5650699e43f0 auth_method 0 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:03:59.580+0000 7f55ec3319c0 20 searching for the correct realm 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:03:59.580+0000 7f55ea638640 10 monclient: get_auth_request con 0x5650699e9140 auth_method 0 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:03:59.580+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f55e406a2d0 auth_method 0 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:03:59.584+0000 7f55e9636640 10 monclient: get_auth_request con 0x7f55e00d2070 auth_method 0 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:03:59.588+0000 7f55ea638640 10 monclient: get_auth_request con 0x7f55e00c9070 auth_method 0 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:03:59.588+0000 7f55ea638640 0 -- 172.21.15.157:0/1981604824 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f55e00c9070 msgr2=0x7f55e01319d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:03:59.588+0000 7f54bb7fe640 1 client.6668.objecter ms_handle_reset 0x7f55e00c9070 session 0x7f55e00a6070 osd.6 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:03:59.588+0000 7f54bb7fe640 10 monclient: _renew_subs 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:03:59.588+0000 7f54bb7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:03:59.771 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:03:59.588+0000 7f55ea638640 10 monclient: get_auth_request con 0x7f54b4080900 auth_method 0 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:03:59.592+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f55e00fe5d0 auth_method 0 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:03:59.596+0000 7f55e9e37640 0 -- 172.21.15.157:0/1981604824 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5650699e0b20 msgr2=0x5650699e2fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:03:59.596+0000 7f54bb7fe640 1 client.6668.objecter ms_handle_reset 0x5650699e0b20 session 0x5650699dc2f0 osd.5 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:03:59.596+0000 7f55e9e37640 10 monclient: get_auth_request con 0x7f55e00c9070 auth_method 0 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.772 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:03:59.600+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 zone default found 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 4 Realm: () 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 zonegroup default 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.773 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 started sync module instance, tier type = 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:03:59.604+0000 7f55ec3319c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=0 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=1 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=2 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=3 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=4 2024-09-12T18:03:59.774 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=5 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=6 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 20 add_watcher() i=7 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:03:59.620+0000 7f55ec3319c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding auth protocol: cephx 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding auth protocol: cephx 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding auth protocol: cephx 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:03:59.624+0000 7f549b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.775 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: crc 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 AuthRegistry(0x7fff05c907c0) adding con mode: secure 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command cache list hook 0x5650699b7850 2024-09-12T18:03:59.776 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command cache inspect hook 0x5650699b7850 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command cache erase hook 0x5650699b7850 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command cache zap hook 0x5650699b7850 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 note: GC not initialized 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:03:59.624+0000 7f549a7fc640 20 reqs_thread_entry: start 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command sync trace show hook 0x7f55dc009930 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command sync trace history hook 0x7f55dc009930 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command sync trace active hook 0x7f55dc009930 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 5 asok(0x5650696e82b0) register_command sync trace active_short hook 0x7f55dc009930 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 init_complete bucket index max shards: 1 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 Filter name: none 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:03:59.624+0000 7f540bfff640 20 reqs_thread_entry: start 2024-09-12T18:03:59.777 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 : miss 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:03:59.624+0000 7f55ec3319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 2024-09-12T18:03:59.778 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29, ofs0, ns] 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94903369403696 notifier 6668 bl.length()=915 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:03:59.632+0000 7f54cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_sources= new_sources= 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential sources added=[] removed=[] 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_dests= new_dests= 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:03:59.632+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential dests added=[] removed=[] 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:03:59.640+0000 7f55ec3319c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.0 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:03:59.640+0000 7f55ec3319c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.0 2024-09-12T18:03:59.779 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:03:59.640+0000 7f55ec3319c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.1 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:03:59.640+0000 7f55ec3319c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.1.1 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:03:59.640+0000 7f55ec3319c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.0 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:03:59.644+0000 7f55ec3319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:03:59.644+0000 7f55ec3319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29, ofs0, ns] 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94903369403696 notifier 6668 bl.length()=915 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:03:59.780 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:03:59.648+0000 7f54cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_sources= new_sources= 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential sources added=[] removed=[] 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_dests= new_dests= 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential dests added=[] removed=[] 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:03:59.648+0000 7f55ec3319c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f55ec3319c0 time 2024-09-12T18:03:59.653677+0000 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f55efc0b2eb] 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f55efc0b49f] 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56506685f0c1] 2024-09-12T18:03:59.781 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x56506687055b] 2024-09-12T18:03:59.782 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565066871b44] 2024-09-12T18:03:59.782 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:03:59.782 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f55eea71d90] 2024-09-12T18:03:59.782 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:03:59.782 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:03:59.782 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.782 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:03:59.652+0000 7f55ec3319c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:59.782 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f55ec3319c0 thread_name:radosgw-admin 2024-09-12T18:03:59.782 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.782 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:59.782 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f55eea8a520] 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f55efc0b345] 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f55efc0b49f] 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56506685f0c1] 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x56506687055b] 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565066871b44] 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f55eea71d90] 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:03:59.783 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:03:59.784 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:03:59.785 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:03:59.786 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:03:59.787 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:03:59.788 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:03:59.789 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:03:59.790 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr: 7f540bfff640 / http_manager 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr: 7f549a7fc640 / http_manager 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr: 7f549b7fe640 / rgw_dt_lg_renew 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr: 7f54bb7fe640 / ms_dispatch 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr: 7f54cd7fa640 / io_context_pool 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr: 7f54cf7fe640 / ms_dispatch 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr: 7f54d6604640 / ms_dispatch 2024-09-12T18:03:59.791 INFO:tasks.workunit.client.0.smithi157.stderr: 7f54d7e07640 / io_context_pool 2024-09-12T18:03:59.792 INFO:tasks.workunit.client.0.smithi157.stderr: 7f55e9636640 / msgr-worker-2 2024-09-12T18:03:59.792 INFO:tasks.workunit.client.0.smithi157.stderr: 7f55e9e37640 / msgr-worker-1 2024-09-12T18:03:59.792 INFO:tasks.workunit.client.0.smithi157.stderr: 7f55ea638640 / msgr-worker-0 2024-09-12T18:03:59.792 INFO:tasks.workunit.client.0.smithi157.stderr: 7f55eae39640 / io_context_pool 2024-09-12T18:03:59.792 INFO:tasks.workunit.client.0.smithi157.stderr: 7f55ec3319c0 / radosgw-admin 2024-09-12T18:03:59.792 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:03:59.792 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:03:59.792 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:03:59.656041Z_3a6f6f32-0bbf-48f2-b5a9-0617603d2846/log 2024-09-12T18:03:59.792 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:03:59.792 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:03:59.792 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.728+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.728+0000 7f61fc9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.728+0000 7f61fc9d79c0 20 realm 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.728+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.728+0000 7f61fc9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.728+0000 7f61fc9d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.728+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.728+0000 7f61fc9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.728+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.732+0000 7f61fc9d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:59.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.732+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.732+0000 7f61fc9d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:59.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.732+0000 7f61fc9d79c0 20 searching for the correct realm 2024-09-12T18:03:59.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.740+0000 7f61facde640 0 -- 172.21.15.157:0/781571108 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f61e4048480 msgr2=0x7f61e408ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:59.956 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.956+0000 7f61fa4dd640 0 -- 172.21.15.157:0/781571108 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x557edbd65d90 msgr2=0x557edbd68250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:59.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.964+0000 7f61fc9d79c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:03:59.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.964+0000 7f61fc9d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:59.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.964+0000 7f61fc9d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:59.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.964+0000 7f61fc9d79c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:03:59.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.964+0000 7f61fc9d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:59.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.964+0000 7f61fc9d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:59.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.964+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.964+0000 7f61fc9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.964+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.964+0000 7f61fc9d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:59.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.964+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:59.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 20 zone default found 2024-09-12T18:03:59.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 4 Realm: () 2024-09-12T18:03:59.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:03:59.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:03:59.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:59.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 20 zonegroup default 2024-09-12T18:03:59.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:59.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:59.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 20 started sync module instance, tier type = 2024-09-12T18:03:59.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.968+0000 7f61fc9d79c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:03:59.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.992+0000 7f61fc9d79c0 20 add_watcher() i=0 2024-09-12T18:03:59.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.992+0000 7f61fc9d79c0 20 add_watcher() i=1 2024-09-12T18:03:59.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.992+0000 7f61fc9d79c0 20 add_watcher() i=2 2024-09-12T18:03:59.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.992+0000 7f61fc9d79c0 20 add_watcher() i=3 2024-09-12T18:03:59.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.992+0000 7f61fc9d79c0 20 add_watcher() i=4 2024-09-12T18:03:59.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.992+0000 7f61fc9d79c0 20 add_watcher() i=5 2024-09-12T18:03:59.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.992+0000 7f61fc9d79c0 20 add_watcher() i=6 2024-09-12T18:03:59.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.996+0000 7f61fc9d79c0 20 add_watcher() i=7 2024-09-12T18:03:59.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:03:59.996+0000 7f61fc9d79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:59.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.000+0000 7f60b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:00.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.000+0000 7f61fc9d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:00.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.000+0000 7f61fc9d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:00.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.000+0000 7f61fc9d79c0 5 note: GC not initialized 2024-09-12T18:04:00.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.000+0000 7f602b7fe640 20 reqs_thread_entry: start 2024-09-12T18:04:00.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.000+0000 7f61fc9d79c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:00.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.000+0000 7f61fc9d79c0 20 Filter name: none 2024-09-12T18:04:00.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.000+0000 7f60297fa640 20 reqs_thread_entry: start 2024-09-12T18:04:00.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.000+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.004+0000 7f61fc9d79c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:00.002 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.004+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.004+0000 7f61fc9d79c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:04:00.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.004+0000 7f61fc9d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:00.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.004+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.004+0000 7f61fc9d79c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:00.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.004+0000 7f61fc9d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.004+0000 7f61fc9d79c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:04:00.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.004+0000 7f61fc9d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:00.008 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.008+0000 7f60b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:00.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.012+0000 7f61fc9d79c0 20 remove_watcher() i=0 2024-09-12T18:04:00.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.012+0000 7f61fc9d79c0 2 removed watcher, disabling cache 2024-09-12T18:04:00.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.016+0000 7f61fc9d79c0 20 remove_watcher() i=1 2024-09-12T18:04:00.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.020+0000 7f61fc9d79c0 20 remove_watcher() i=2 2024-09-12T18:04:00.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.020+0000 7f61fc9d79c0 20 remove_watcher() i=3 2024-09-12T18:04:00.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.024+0000 7f61fc9d79c0 20 remove_watcher() i=4 2024-09-12T18:04:00.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.028+0000 7f61fc9d79c0 20 remove_watcher() i=5 2024-09-12T18:04:00.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.028+0000 7f61fc9d79c0 20 remove_watcher() i=6 2024-09-12T18:04:00.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.032+0000 7f61fc9d79c0 20 remove_watcher() i=7 2024-09-12T18:04:00.047 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:00.048 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:04:00.048 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-block-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:04:00.048 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:00.187 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:04:00.221 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:00.221 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:00.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.264+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.264+0000 7fcfca85f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:00.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.264+0000 7fcfca85f9c0 20 realm 2024-09-12T18:04:00.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.264+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.264+0000 7fcfca85f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:00.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.264+0000 7fcfca85f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:00.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.264+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.264+0000 7fcfca85f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:00.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.264+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.268+0000 7fcfca85f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:00.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.268+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.268+0000 7fcfca85f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:00.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.268+0000 7fcfca85f9c0 20 searching for the correct realm 2024-09-12T18:04:00.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.272+0000 7fcfc8b66640 0 -- 172.21.15.157:0/2650204149 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x559b334bfd40 msgr2=0x559b334c2200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:00.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.280+0000 7fcfc8365640 0 -- 172.21.15.157:0/2650204149 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fcfb00ab070 msgr2=0x7fcfb01110c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:00.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:00.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:00.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:00.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:00.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:00.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:00.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:00.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:00.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:00.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 zone default found 2024-09-12T18:04:00.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 4 Realm: () 2024-09-12T18:04:00.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:00.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:00.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:00.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 zonegroup default 2024-09-12T18:04:00.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:00.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:00.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:00.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 started sync module instance, tier type = 2024-09-12T18:04:00.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.288+0000 7fcfca85f9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:00.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.304+0000 7fcfca85f9c0 20 add_watcher() i=0 2024-09-12T18:04:00.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.304+0000 7fcfca85f9c0 20 add_watcher() i=1 2024-09-12T18:04:00.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.304+0000 7fcfca85f9c0 20 add_watcher() i=2 2024-09-12T18:04:00.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.304+0000 7fcfca85f9c0 20 add_watcher() i=3 2024-09-12T18:04:00.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.304+0000 7fcfca85f9c0 20 add_watcher() i=4 2024-09-12T18:04:00.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.304+0000 7fcfca85f9c0 20 add_watcher() i=5 2024-09-12T18:04:00.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.304+0000 7fcfca85f9c0 20 add_watcher() i=6 2024-09-12T18:04:00.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fcfca85f9c0 20 add_watcher() i=7 2024-09-12T18:04:00.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fcfca85f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:00.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fce7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:00.309 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fcfca85f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:00.309 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fcfca85f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:00.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fcfca85f9c0 5 note: GC not initialized 2024-09-12T18:04:00.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fce7dfdb640 20 reqs_thread_entry: start 2024-09-12T18:04:00.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fcfca85f9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:00.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fcfca85f9c0 20 Filter name: none 2024-09-12T18:04:00.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fcdef7fe640 20 reqs_thread_entry: start 2024-09-12T18:04:00.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fcfca85f9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:04:00.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.308+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:00.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:04:00.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:04:00.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 : miss 2024-09-12T18:04:00.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:00.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:04:00.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:04:00.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:04:00.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:00.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:00.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 2024-09-12T18:04:00.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.312+0000 7fcfca85f9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to be held by another RGW process; skipping for now 2024-09-12T18:04:00.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.316+0000 7fce7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:00.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.320+0000 7fcfca85f9c0 20 remove_watcher() i=0 2024-09-12T18:04:00.319 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.320+0000 7fcfca85f9c0 2 removed watcher, disabling cache 2024-09-12T18:04:00.321 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.320+0000 7fcfca85f9c0 20 remove_watcher() i=1 2024-09-12T18:04:00.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.324+0000 7fcfca85f9c0 20 remove_watcher() i=2 2024-09-12T18:04:00.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.324+0000 7fcfca85f9c0 20 remove_watcher() i=3 2024-09-12T18:04:00.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.328+0000 7fcfca85f9c0 20 remove_watcher() i=4 2024-09-12T18:04:00.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.328+0000 7fcfca85f9c0 20 remove_watcher() i=5 2024-09-12T18:04:00.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.328+0000 7fcfca85f9c0 20 remove_watcher() i=6 2024-09-12T18:04:00.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:00.332+0000 7fcfca85f9c0 20 remove_watcher() i=7 2024-09-12T18:04:00.343 INFO:tasks.workunit.client.0.smithi157.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:04:30.373 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:04:30.409 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:30.409 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:30.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.455+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.455+0000 7fbc95b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.455+0000 7fbc95b179c0 20 realm 2024-09-12T18:04:30.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.455+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.455+0000 7fbc95b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.455+0000 7fbc95b179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:30.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.455+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.455+0000 7fbc95b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.455+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.459+0000 7fbc95b179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:30.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.459+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.459+0000 7fbc95b179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:30.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.459+0000 7fbc95b179c0 20 searching for the correct realm 2024-09-12T18:04:30.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.467+0000 7fbc93e1e640 0 -- 172.21.15.157:0/3045855169 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fbc88089760 msgr2=0x7fbc8805b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:04:30.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.683+0000 7fbc9361d640 0 -- 172.21.15.157:0/3045855169 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55fd62911ab0 msgr2=0x55fd62913ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:30.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.691+0000 7fbc95b179c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:30.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.691+0000 7fbc95b179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:30.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.691+0000 7fbc95b179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:30.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.691+0000 7fbc95b179c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:30.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.691+0000 7fbc95b179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:30.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.691+0000 7fbc95b179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:30.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.691+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.691+0000 7fbc95b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.691+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.691+0000 7fbc95b179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.691+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 20 zone default found 2024-09-12T18:04:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 4 Realm: () 2024-09-12T18:04:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:30.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 20 zonegroup default 2024-09-12T18:04:30.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 20 started sync module instance, tier type = 2024-09-12T18:04:30.696 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.695+0000 7fbc95b179c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:30.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.715+0000 7fbc95b179c0 20 add_watcher() i=0 2024-09-12T18:04:30.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.715+0000 7fbc95b179c0 20 add_watcher() i=1 2024-09-12T18:04:30.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.715+0000 7fbc95b179c0 20 add_watcher() i=2 2024-09-12T18:04:30.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.715+0000 7fbc95b179c0 20 add_watcher() i=3 2024-09-12T18:04:30.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.715+0000 7fbc95b179c0 20 add_watcher() i=4 2024-09-12T18:04:30.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.715+0000 7fbc95b179c0 20 add_watcher() i=5 2024-09-12T18:04:30.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.715+0000 7fbc95b179c0 20 add_watcher() i=6 2024-09-12T18:04:30.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.719+0000 7fbc95b179c0 20 add_watcher() i=7 2024-09-12T18:04:30.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.719+0000 7fbc95b179c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:30.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.723+0000 7fbb49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:30.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.723+0000 7fbc95b179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:30.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.723+0000 7fbc95b179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:30.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.723+0000 7fbc95b179c0 5 note: GC not initialized 2024-09-12T18:04:30.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.723+0000 7fbb48fe1640 20 reqs_thread_entry: start 2024-09-12T18:04:30.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:30.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 20 Filter name: none 2024-09-12T18:04:30.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbac27fc640 20 reqs_thread_entry: start 2024-09-12T18:04:30.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:04:30.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:30.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:04:30.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:04:30.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 : miss 2024-09-12T18:04:30.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:04:30.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:04:30.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:04:30.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:30.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:30.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.727+0000 7fbc95b179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 2024-09-12T18:04:30.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.731+0000 7fbc95b179c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:04:30.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.735+0000 7fbc95b179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:04:30.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.735+0000 7fbc95b179c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:04:30.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.735+0000 7fbc95b179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:30.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.735+0000 7fbc95b179c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29, ofs0, ns] 2024-09-12T18:04:30.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.735+0000 7fbb76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464285 cookie 94546768826096 notifier 7206 bl.length()=915 2024-09-12T18:04:30.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.735+0000 7fbb76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:04:30.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.735+0000 7fbb76ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:04:30.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.735+0000 7fbb76ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:30.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.739+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_sources= new_sources= 2024-09-12T18:04:30.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.739+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential sources added=[] removed=[] 2024-09-12T18:04:30.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.739+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_dests= new_dests= 2024-09-12T18:04:30.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.739+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential dests added=[] removed=[] 2024-09-12T18:04:30.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.747+0000 7fbc95b179c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.2.0 2024-09-12T18:04:30.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.747+0000 7fbc95b179c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.2.0 2024-09-12T18:04:30.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.747+0000 7fbc95b179c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.2.1 2024-09-12T18:04:30.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.747+0000 7fbc95b179c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.2.1 2024-09-12T18:04:30.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.747+0000 7fbc95b179c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.0 2024-09-12T18:04:30.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.751+0000 7fbc95b179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:30.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.751+0000 7fbc95b179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 2024-09-12T18:04:30.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.751+0000 7fbc95b179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:04:30.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.751+0000 7fbc95b179c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:04:30.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.751+0000 7fbc95b179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:30.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.751+0000 7fbc95b179c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29, ofs0, ns] 2024-09-12T18:04:30.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.755+0000 7fbb767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94546768826096 notifier 7206 bl.length()=915 2024-09-12T18:04:30.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.755+0000 7fbb767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:04:30.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.755+0000 7fbb767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:04:30.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.755+0000 7fbb767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:30.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.755+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_sources= new_sources= 2024-09-12T18:04:30.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.755+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential sources added=[] removed=[] 2024-09-12T18:04:30.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.755+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_dests= new_dests= 2024-09-12T18:04:30.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.755+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential dests added=[] removed=[] 2024-09-12T18:04:30.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.759+0000 7fbc95b179c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29.0 2024-09-12T18:04:30.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.759+0000 7fbc95b179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:30.760 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.759+0000 7fbc95b179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 2024-09-12T18:04:30.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.759+0000 7fbc95b179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:04:30.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.759+0000 7fbc95b179c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:04:30.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.759+0000 7fbc95b179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:30.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.759+0000 7fbc95b179c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29, ofs0, ns] 2024-09-12T18:04:30.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.763+0000 7fbb76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94546768826096 notifier 7206 bl.length()=883 2024-09-12T18:04:30.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.763+0000 7fbb76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 info.flags=0x17 2024-09-12T18:04:30.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.763+0000 7fbb76ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 to cache LRU end 2024-09-12T18:04:30.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.763+0000 7fbb76ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:30.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.763+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_sources= new_sources= 2024-09-12T18:04:30.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.763+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential sources added=[] removed=[] 2024-09-12T18:04:30.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.763+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): orig_dests= new_dests= 2024-09-12T18:04:30.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.763+0000 7fbc95b179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29]): potential dests added=[] removed=[] 2024-09-12T18:04:30.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.767+0000 7fbc95b179c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T18:04:30.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.771+0000 7fbb49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:30.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.775+0000 7fbc95b179c0 20 remove_watcher() i=0 2024-09-12T18:04:30.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.775+0000 7fbc95b179c0 2 removed watcher, disabling cache 2024-09-12T18:04:30.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.775+0000 7fbc95b179c0 20 remove_watcher() i=1 2024-09-12T18:04:30.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.779+0000 7fbc95b179c0 20 remove_watcher() i=2 2024-09-12T18:04:30.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.783+0000 7fbc95b179c0 20 remove_watcher() i=3 2024-09-12T18:04:30.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.783+0000 7fbc95b179c0 20 remove_watcher() i=4 2024-09-12T18:04:30.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.787+0000 7fbc95b179c0 20 remove_watcher() i=5 2024-09-12T18:04:30.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.787+0000 7fbc95b179c0 20 remove_watcher() i=6 2024-09-12T18:04:30.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.791+0000 7fbc95b179c0 20 remove_watcher() i=7 2024-09-12T18:04:30.811 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T18:04:30.840 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:30.840 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:30.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.883+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.887+0000 7f19e162d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.887+0000 7f19e162d9c0 20 realm 2024-09-12T18:04:30.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.887+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.887+0000 7f19e162d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.887+0000 7f19e162d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:30.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.887+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.887+0000 7f19e162d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.887+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.887+0000 7f19e162d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:30.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.887+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.891+0000 7f19e162d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:30.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.891+0000 7f19e162d9c0 20 searching for the correct realm 2024-09-12T18:04:30.895 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.895+0000 7f19df934640 0 -- 172.21.15.157:0/2486802100 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x564eaebef460 msgr2=0x564eaebf1920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:30.902 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.903+0000 7f19df133640 0 -- 172.21.15.157:0/2486802100 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f19d4008040 msgr2=0x7f19d4056930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:04:30.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:30.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:30.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:30.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:30.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:30.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:30.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:30.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:30.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 zone default found 2024-09-12T18:04:30.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 4 Realm: () 2024-09-12T18:04:30.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:30.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:30.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:30.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 zonegroup default 2024-09-12T18:04:30.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 started sync module instance, tier type = 2024-09-12T18:04:30.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.911+0000 7f19e162d9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:30.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.927+0000 7f19e162d9c0 20 add_watcher() i=0 2024-09-12T18:04:30.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.927+0000 7f19e162d9c0 20 add_watcher() i=1 2024-09-12T18:04:30.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.927+0000 7f19e162d9c0 20 add_watcher() i=2 2024-09-12T18:04:30.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.927+0000 7f19e162d9c0 20 add_watcher() i=3 2024-09-12T18:04:30.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.927+0000 7f19e162d9c0 20 add_watcher() i=4 2024-09-12T18:04:30.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.927+0000 7f19e162d9c0 20 add_watcher() i=5 2024-09-12T18:04:30.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.927+0000 7f19e162d9c0 20 add_watcher() i=6 2024-09-12T18:04:30.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.927+0000 7f19e162d9c0 20 add_watcher() i=7 2024-09-12T18:04:30.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.927+0000 7f19e162d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:30.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.931+0000 7f1895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:30.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.931+0000 7f19e162d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:30.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.931+0000 7f19e162d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:30.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.931+0000 7f19e162d9c0 5 note: GC not initialized 2024-09-12T18:04:30.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.931+0000 7f1894fe1640 20 reqs_thread_entry: start 2024-09-12T18:04:30.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.931+0000 7f19e162d9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:30.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.931+0000 7f19e162d9c0 20 Filter name: none 2024-09-12T18:04:30.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.931+0000 7f180e7fc640 20 reqs_thread_entry: start 2024-09-12T18:04:30.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.931+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.931+0000 7f19e162d9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:30.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.931+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.935+0000 7f19e162d9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:30.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.935+0000 7f19e162d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:30.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.935+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.935+0000 7f19e162d9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:30.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.935+0000 7f19e162d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.935+0000 7f19e162d9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:30.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.935+0000 7f19e162d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:30.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.935+0000 7f1895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:30.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.939+0000 7f19e162d9c0 20 remove_watcher() i=0 2024-09-12T18:04:30.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.939+0000 7f19e162d9c0 2 removed watcher, disabling cache 2024-09-12T18:04:30.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.943+0000 7f19e162d9c0 20 remove_watcher() i=1 2024-09-12T18:04:30.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.943+0000 7f19e162d9c0 20 remove_watcher() i=2 2024-09-12T18:04:30.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.947+0000 7f19e162d9c0 20 remove_watcher() i=3 2024-09-12T18:04:30.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.947+0000 7f19e162d9c0 20 remove_watcher() i=4 2024-09-12T18:04:30.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.951+0000 7f19e162d9c0 20 remove_watcher() i=5 2024-09-12T18:04:30.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.951+0000 7f19e162d9c0 20 remove_watcher() i=6 2024-09-12T18:04:30.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:30.951+0000 7f19e162d9c0 20 remove_watcher() i=7 2024-09-12T18:04:30.966 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:30.966 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:04:30.966 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-block-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:04:30.966 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:31.647 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T18:04:31.647 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:33.806 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:04:33.839 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:33.839 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:33.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.883+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.883+0000 7fd98897a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:33.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.883+0000 7fd98897a9c0 20 realm 2024-09-12T18:04:33.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.883+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.883+0000 7fd98897a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:33.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.883+0000 7fd98897a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:33.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.883+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.887+0000 7fd98897a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:33.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.887+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.887+0000 7fd98897a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:33.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.887+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.887+0000 7fd98897a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:33.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.887+0000 7fd98897a9c0 20 searching for the correct realm 2024-09-12T18:04:33.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.895+0000 7fd985c7f640 0 -- 172.21.15.157:0/2850348676 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fd97c025040 msgr2=0x7fd97c0896f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:04:33.902 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.903+0000 7fd985c7f640 0 -- 172.21.15.157:0/2850348676 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fd850080900 msgr2=0x7fd850082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:33.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.907+0000 7fd98897a9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:33.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.907+0000 7fd98897a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:33.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.907+0000 7fd98897a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:33.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.907+0000 7fd98897a9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:33.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.907+0000 7fd98897a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:33.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.907+0000 7fd98897a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:33.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.907+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.907+0000 7fd98897a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:33.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.907+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:33.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:33.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 zone default found 2024-09-12T18:04:33.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 4 Realm: () 2024-09-12T18:04:33.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:33.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:33.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:33.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 zonegroup default 2024-09-12T18:04:33.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:33.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:33.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:33.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 started sync module instance, tier type = 2024-09-12T18:04:33.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.911+0000 7fd98897a9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:33.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.927+0000 7fd98897a9c0 20 add_watcher() i=0 2024-09-12T18:04:33.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.927+0000 7fd98897a9c0 20 add_watcher() i=1 2024-09-12T18:04:33.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.927+0000 7fd98897a9c0 20 add_watcher() i=2 2024-09-12T18:04:33.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.927+0000 7fd98897a9c0 20 add_watcher() i=3 2024-09-12T18:04:33.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.927+0000 7fd98897a9c0 20 add_watcher() i=4 2024-09-12T18:04:33.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.927+0000 7fd98897a9c0 20 add_watcher() i=5 2024-09-12T18:04:33.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.927+0000 7fd98897a9c0 20 add_watcher() i=6 2024-09-12T18:04:33.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.927+0000 7fd98897a9c0 20 add_watcher() i=7 2024-09-12T18:04:33.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.927+0000 7fd98897a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:33.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd83cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:33.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd98897a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:33.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd98897a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:33.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd98897a9c0 5 note: GC not initialized 2024-09-12T18:04:33.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd7b77fe640 20 reqs_thread_entry: start 2024-09-12T18:04:33.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd98897a9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:33.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd98897a9c0 20 Filter name: none 2024-09-12T18:04:33.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd7b57fa640 20 reqs_thread_entry: start 2024-09-12T18:04:33.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd98897a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:33.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd98897a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:33.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd98897a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:33.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.931+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.935+0000 7fd98897a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:33.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.935+0000 7fd98897a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:33.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.935+0000 7fd98897a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:33.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.935+0000 7fd98897a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:33.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.935+0000 7fd83cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:33.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.939+0000 7fd98897a9c0 20 remove_watcher() i=0 2024-09-12T18:04:33.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.939+0000 7fd98897a9c0 2 removed watcher, disabling cache 2024-09-12T18:04:33.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.943+0000 7fd98897a9c0 20 remove_watcher() i=1 2024-09-12T18:04:33.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.943+0000 7fd98897a9c0 20 remove_watcher() i=2 2024-09-12T18:04:33.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.947+0000 7fd98897a9c0 20 remove_watcher() i=3 2024-09-12T18:04:33.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.947+0000 7fd98897a9c0 20 remove_watcher() i=4 2024-09-12T18:04:33.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.951+0000 7fd98897a9c0 20 remove_watcher() i=5 2024-09-12T18:04:33.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.951+0000 7fd98897a9c0 20 remove_watcher() i=6 2024-09-12T18:04:33.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:33.951+0000 7fd98897a9c0 20 remove_watcher() i=7 2024-09-12T18:04:33.967 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:33.967 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:04:33.967 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-commit-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:04:33.967 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:33.968 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T18:04:33.999 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:33.999 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:34.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.039+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.043+0000 7f1ae22849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:34.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.043+0000 7f1ae22849c0 20 realm 2024-09-12T18:04:34.043 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.043+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.043+0000 7f1ae22849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:34.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.043+0000 7f1ae22849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:34.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.043+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.043+0000 7f1ae22849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:34.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.043+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.043+0000 7f1ae22849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:34.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.043+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.047+0000 7f1ae22849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:34.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.047+0000 7f1ae22849c0 20 searching for the correct realm 2024-09-12T18:04:34.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.047+0000 7f1adf589640 0 -- 172.21.15.157:0/1429317193 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f1ad4033070 msgr2=0x7f1ad4044930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:34.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.263+0000 7f1adfd8a640 0 -- 172.21.15.157:0/1429317193 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f1ad4008050 msgr2=0x7f1ad4042460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.479+0000 7f1ae22849c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.479+0000 7f1ae22849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.479+0000 7f1ae22849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.479+0000 7f1ae22849c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.479+0000 7f1ae22849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.479+0000 7f1ae22849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:34.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.479+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.479+0000 7f1ae22849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:34.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.479+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:34.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:34.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 zone default found 2024-09-12T18:04:34.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 4 Realm: () 2024-09-12T18:04:34.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:34.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:34.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:34.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 zonegroup default 2024-09-12T18:04:34.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:34.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:34.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:34.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 started sync module instance, tier type = 2024-09-12T18:04:34.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.483+0000 7f1ae22849c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:34.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.507+0000 7f1ae22849c0 20 add_watcher() i=0 2024-09-12T18:04:34.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.507+0000 7f1ae22849c0 20 add_watcher() i=1 2024-09-12T18:04:34.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.507+0000 7f1ae22849c0 20 add_watcher() i=2 2024-09-12T18:04:34.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.507+0000 7f1ae22849c0 20 add_watcher() i=3 2024-09-12T18:04:34.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.507+0000 7f1ae22849c0 20 add_watcher() i=4 2024-09-12T18:04:34.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.507+0000 7f1ae22849c0 20 add_watcher() i=5 2024-09-12T18:04:34.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.507+0000 7f1ae22849c0 20 add_watcher() i=6 2024-09-12T18:04:34.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.511+0000 7f1ae22849c0 20 add_watcher() i=7 2024-09-12T18:04:34.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.511+0000 7f1ae22849c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:34.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.515+0000 7f19967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:34.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.515+0000 7f1ae22849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:34.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.515+0000 7f1ae22849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:34.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.515+0000 7f1ae22849c0 5 note: GC not initialized 2024-09-12T18:04:34.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.515+0000 7f19957e2640 20 reqs_thread_entry: start 2024-09-12T18:04:34.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.515+0000 7f1ae22849c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:34.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.515+0000 7f1ae22849c0 20 Filter name: none 2024-09-12T18:04:34.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.515+0000 7f198effd640 20 reqs_thread_entry: start 2024-09-12T18:04:34.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T18:04:34.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:34.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T18:04:34.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T18:04:34.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 : miss 2024-09-12T18:04:34.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:34.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:34.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:34.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:34.520 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:34.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.519+0000 7f1ae22849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 2024-09-12T18:04:34.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.523+0000 7f1ae22849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:34.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.523+0000 7f1ae22849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:34.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.523+0000 7f1ae22849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:34.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.523+0000 7f1ae22849c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30, ofs0, ns] 2024-09-12T18:04:34.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.523+0000 7f19beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94182726911168 notifier 6767 bl.length()=931 2024-09-12T18:04:34.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.523+0000 7f19beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:34.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.523+0000 7f19beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:34.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.523+0000 7f19beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:34.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.527+0000 7f1ae22849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): orig_sources= new_sources= 2024-09-12T18:04:34.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.527+0000 7f1ae22849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): potential sources added=[] removed=[] 2024-09-12T18:04:34.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.527+0000 7f1ae22849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): orig_dests= new_dests= 2024-09-12T18:04:34.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.527+0000 7f1ae22849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): potential dests added=[] removed=[] 2024-09-12T18:04:34.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.531+0000 7f1ae22849c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.1.0 2024-09-12T18:04:34.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.531+0000 7f1ae22849c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.1.0 2024-09-12T18:04:34.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.531+0000 7f1ae22849c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.1.1 2024-09-12T18:04:34.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.531+0000 7f1ae22849c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.1.1 2024-09-12T18:04:34.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.531+0000 7f1ae22849c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.0 2024-09-12T18:04:34.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.539+0000 7f1ae22849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:34.538 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.539+0000 7f1ae22849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 2024-09-12T18:04:34.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.539+0000 7f1ae22849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:34.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.539+0000 7f1ae22849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:34.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.539+0000 7f1ae22849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:34.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.539+0000 7f1ae22849c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30, ofs0, ns] 2024-09-12T18:04:34.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.539+0000 7f19beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 94182726911168 notifier 6767 bl.length()=931 2024-09-12T18:04:34.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.539+0000 7f19beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:34.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.539+0000 7f19beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:34.541 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.539+0000 7f19beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:34.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.543+0000 7f1ae22849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): orig_sources= new_sources= 2024-09-12T18:04:34.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.543+0000 7f1ae22849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): potential sources added=[] removed=[] 2024-09-12T18:04:34.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.543+0000 7f1ae22849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): orig_dests= new_dests= 2024-09-12T18:04:34.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.543+0000 7f1ae22849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): potential dests added=[] removed=[] 2024-09-12T18:04:34.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.543+0000 7f1ae22849c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.0 2024-09-12T18:04:34.545 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.543+0000 7f1ae22849c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T18:04:34.545 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.543+0000 7f1ae22849c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T18:04:34.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.551+0000 7f19967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:34.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.555+0000 7f1ae22849c0 20 remove_watcher() i=0 2024-09-12T18:04:34.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.555+0000 7f1ae22849c0 2 removed watcher, disabling cache 2024-09-12T18:04:34.558 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.559+0000 7f1ae22849c0 20 remove_watcher() i=1 2024-09-12T18:04:34.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.559+0000 7f1ae22849c0 20 remove_watcher() i=2 2024-09-12T18:04:34.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.563+0000 7f1ae22849c0 20 remove_watcher() i=3 2024-09-12T18:04:34.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.563+0000 7f1ae22849c0 20 remove_watcher() i=4 2024-09-12T18:04:34.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.567+0000 7f1ae22849c0 20 remove_watcher() i=5 2024-09-12T18:04:34.567 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.567+0000 7f1ae22849c0 20 remove_watcher() i=6 2024-09-12T18:04:34.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.567+0000 7f1ae22849c0 20 remove_watcher() i=7 2024-09-12T18:04:34.583 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:04:34.610 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:34.611 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:34.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.655+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.655+0000 7f5e17a589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:34.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.655+0000 7f5e17a589c0 20 realm 2024-09-12T18:04:34.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.655+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.655+0000 7f5e17a589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:34.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.655+0000 7f5e17a589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:34.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.655+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.655+0000 7f5e17a589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:34.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.655+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.659+0000 7f5e17a589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:34.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.659+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:34.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.659+0000 7f5e17a589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:34.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.659+0000 7f5e17a589c0 20 searching for the correct realm 2024-09-12T18:04:34.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.663+0000 7f5e14d5d640 0 -- 172.21.15.157:0/2467190520 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f5e0c03b9d0 msgr2=0x7f5e0c0103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:04:34.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:34.879+0000 7f5e1555e640 0 -- 172.21.15.157:0/2467190520 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f5e0c055910 msgr2=0x7f5e0c052380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:04:35.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.095+0000 7f5e17a589c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:35.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.095+0000 7f5e17a589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:35.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.095+0000 7f5e17a589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:35.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.095+0000 7f5e17a589c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:35.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.095+0000 7f5e17a589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:35.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.095+0000 7f5e17a589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:35.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.095+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.098 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:35.099 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:35.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 zone default found 2024-09-12T18:04:35.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 4 Realm: () 2024-09-12T18:04:35.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:35.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:35.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:35.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 zonegroup default 2024-09-12T18:04:35.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.099+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.103+0000 7f5e17a589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.103+0000 7f5e17a589c0 20 started sync module instance, tier type = 2024-09-12T18:04:35.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.103+0000 7f5e17a589c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:35.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.127+0000 7f5e17a589c0 20 add_watcher() i=0 2024-09-12T18:04:35.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.127+0000 7f5e17a589c0 20 add_watcher() i=1 2024-09-12T18:04:35.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.127+0000 7f5e17a589c0 20 add_watcher() i=2 2024-09-12T18:04:35.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.127+0000 7f5e17a589c0 20 add_watcher() i=3 2024-09-12T18:04:35.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.127+0000 7f5e17a589c0 20 add_watcher() i=4 2024-09-12T18:04:35.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.127+0000 7f5e17a589c0 20 add_watcher() i=5 2024-09-12T18:04:35.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.127+0000 7f5e17a589c0 20 add_watcher() i=6 2024-09-12T18:04:35.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.127+0000 7f5e17a589c0 20 add_watcher() i=7 2024-09-12T18:04:35.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.127+0000 7f5e17a589c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:35.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.131+0000 7f5ccb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:35.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.131+0000 7f5e17a589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:35.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.131+0000 7f5e17a589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:35.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5e17a589c0 5 note: GC not initialized 2024-09-12T18:04:35.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5cca7e4640 20 reqs_thread_entry: start 2024-09-12T18:04:35.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5e17a589c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:35.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5e17a589c0 20 Filter name: none 2024-09-12T18:04:35.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5c3bfff640 20 reqs_thread_entry: start 2024-09-12T18:04:35.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5e17a589c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:35.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5e17a589c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:04:35.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5e17a589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:35.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5e17a589c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:35.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.135+0000 7f5e17a589c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.139+0000 7f5e17a589c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:04:35.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.139+0000 7f5e17a589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:35.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.139+0000 7f5ccb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:35.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.143+0000 7f5e17a589c0 20 remove_watcher() i=0 2024-09-12T18:04:35.145 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.143+0000 7f5e17a589c0 2 removed watcher, disabling cache 2024-09-12T18:04:35.147 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.147+0000 7f5e17a589c0 20 remove_watcher() i=1 2024-09-12T18:04:35.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.151+0000 7f5e17a589c0 20 remove_watcher() i=2 2024-09-12T18:04:35.152 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.151+0000 7f5e17a589c0 20 remove_watcher() i=3 2024-09-12T18:04:35.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.155+0000 7f5e17a589c0 20 remove_watcher() i=4 2024-09-12T18:04:35.156 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.155+0000 7f5e17a589c0 20 remove_watcher() i=5 2024-09-12T18:04:35.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.155+0000 7f5e17a589c0 20 remove_watcher() i=6 2024-09-12T18:04:35.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.159+0000 7f5e17a589c0 20 remove_watcher() i=7 2024-09-12T18:04:35.176 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:35.177 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:04:35.177 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-commit-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:04:35.177 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:35.303 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:04:35.340 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:35.340 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:35.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.383+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.387+0000 7fa193dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.387+0000 7fa193dba9c0 20 realm 2024-09-12T18:04:35.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.387+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.387+0000 7fa193dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.387+0000 7fa193dba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:35.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.387+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.387+0000 7fa193dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.387+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.387+0000 7fa193dba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:35.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.387+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.391+0000 7fa193dba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:35.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.391+0000 7fa193dba9c0 20 searching for the correct realm 2024-09-12T18:04:35.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.395+0000 7fa1910bf640 0 -- 172.21.15.157:0/1453443913 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x5571fef50380 msgr2=0x5571fef527f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:35.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.403+0000 7fa1910bf640 0 -- 172.21.15.157:0/1453443913 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fa1880c9040 msgr2=0x7fa1880b9450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:35.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.407+0000 7fa193dba9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:35.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.407+0000 7fa193dba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:35.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.407+0000 7fa193dba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:35.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.407+0000 7fa193dba9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:35.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.407+0000 7fa193dba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:35.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.407+0000 7fa193dba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:35.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.407+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:35.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:35.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 zone default found 2024-09-12T18:04:35.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 4 Realm: () 2024-09-12T18:04:35.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:35.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:35.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:35.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 zonegroup default 2024-09-12T18:04:35.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 started sync module instance, tier type = 2024-09-12T18:04:35.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.411+0000 7fa193dba9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:35.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.427+0000 7fa193dba9c0 20 add_watcher() i=0 2024-09-12T18:04:35.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.427+0000 7fa193dba9c0 20 add_watcher() i=1 2024-09-12T18:04:35.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.427+0000 7fa193dba9c0 20 add_watcher() i=2 2024-09-12T18:04:35.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.427+0000 7fa193dba9c0 20 add_watcher() i=3 2024-09-12T18:04:35.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.427+0000 7fa193dba9c0 20 add_watcher() i=4 2024-09-12T18:04:35.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.427+0000 7fa193dba9c0 20 add_watcher() i=5 2024-09-12T18:04:35.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.427+0000 7fa193dba9c0 20 add_watcher() i=6 2024-09-12T18:04:35.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.427+0000 7fa193dba9c0 20 add_watcher() i=7 2024-09-12T18:04:35.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.427+0000 7fa193dba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:35.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.431+0000 7fa047fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:35.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.431+0000 7fa193dba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:35.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.431+0000 7fa193dba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:35.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.431+0000 7fa193dba9c0 5 note: GC not initialized 2024-09-12T18:04:35.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.431+0000 7fa046fe5640 20 reqs_thread_entry: start 2024-09-12T18:04:35.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.431+0000 7fa193dba9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:35.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.431+0000 7fa193dba9c0 20 Filter name: none 2024-09-12T18:04:35.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.431+0000 7fa044fe1640 20 reqs_thread_entry: start 2024-09-12T18:04:35.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.431+0000 7fa193dba9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T18:04:35.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.431+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:35.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T18:04:35.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T18:04:35.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 : miss 2024-09-12T18:04:35.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:04:35.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:35.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:35.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:35.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:35.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 2024-09-12T18:04:35.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.435+0000 7fa193dba9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:04:35.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa193dba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:35.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa193dba9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:35.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa193dba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:35.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa193dba9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30, ofs0, ns] 2024-09-12T18:04:35.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa0757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464294 cookie 93948097206208 notifier 7296 bl.length()=931 2024-09-12T18:04:35.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa0757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:35.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa0757fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:35.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa0757fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:35.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): orig_sources= new_sources= 2024-09-12T18:04:35.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): potential sources added=[] removed=[] 2024-09-12T18:04:35.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): orig_dests= new_dests= 2024-09-12T18:04:35.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.443+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): potential dests added=[] removed=[] 2024-09-12T18:04:35.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.447+0000 7fa193dba9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.2.0 2024-09-12T18:04:35.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.447+0000 7fa193dba9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.2.0 2024-09-12T18:04:35.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.447+0000 7fa193dba9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.2.1 2024-09-12T18:04:35.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.447+0000 7fa193dba9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.2.1 2024-09-12T18:04:35.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.447+0000 7fa193dba9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.0 2024-09-12T18:04:35.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.451+0000 7fa193dba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:35.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.451+0000 7fa193dba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 2024-09-12T18:04:35.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa193dba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:35.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa193dba9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:35.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa193dba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:35.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa193dba9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30, ofs0, ns] 2024-09-12T18:04:35.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa0757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 93948097206208 notifier 7296 bl.length()=931 2024-09-12T18:04:35.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa0757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:35.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa0757fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:35.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa0757fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:35.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): orig_sources= new_sources= 2024-09-12T18:04:35.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): potential sources added=[] removed=[] 2024-09-12T18:04:35.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): orig_dests= new_dests= 2024-09-12T18:04:35.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.455+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): potential dests added=[] removed=[] 2024-09-12T18:04:35.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.459+0000 7fa193dba9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30.0 2024-09-12T18:04:35.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.459+0000 7fa193dba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:35.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.459+0000 7fa193dba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 2024-09-12T18:04:35.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa193dba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:35.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa193dba9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:35.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa193dba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:35.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa193dba9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30, ofs0, ns] 2024-09-12T18:04:35.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa0757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 93948097206208 notifier 7296 bl.length()=899 2024-09-12T18:04:35.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa0757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 info.flags=0x17 2024-09-12T18:04:35.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa0757fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 to cache LRU end 2024-09-12T18:04:35.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa0757fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:35.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): orig_sources= new_sources= 2024-09-12T18:04:35.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): potential sources added=[] removed=[] 2024-09-12T18:04:35.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): orig_dests= new_dests= 2024-09-12T18:04:35.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.463+0000 7fa193dba9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30]): potential dests added=[] removed=[] 2024-09-12T18:04:35.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.467+0000 7fa193dba9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T18:04:35.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.467+0000 7fa047fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:35.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.471+0000 7fa193dba9c0 20 remove_watcher() i=0 2024-09-12T18:04:35.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.471+0000 7fa193dba9c0 2 removed watcher, disabling cache 2024-09-12T18:04:35.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.475+0000 7fa193dba9c0 20 remove_watcher() i=1 2024-09-12T18:04:35.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.475+0000 7fa193dba9c0 20 remove_watcher() i=2 2024-09-12T18:04:35.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.479+0000 7fa193dba9c0 20 remove_watcher() i=3 2024-09-12T18:04:35.481 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.479+0000 7fa193dba9c0 20 remove_watcher() i=4 2024-09-12T18:04:35.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.483+0000 7fa193dba9c0 20 remove_watcher() i=5 2024-09-12T18:04:35.483 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.483+0000 7fa193dba9c0 20 remove_watcher() i=6 2024-09-12T18:04:35.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.483+0000 7fa193dba9c0 20 remove_watcher() i=7 2024-09-12T18:04:35.499 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:04:35.526 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:35.526 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:35.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.567+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 20 realm 2024-09-12T18:04:35.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:35.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:35.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:35.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:35.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:35.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.571+0000 7fb0ae2a29c0 20 searching for the correct realm 2024-09-12T18:04:35.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.575+0000 7fb0ab5a7640 0 -- 172.21.15.157:0/3972075564 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fb0a008a040 msgr2=0x7fb0a005deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:35.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:35.791+0000 7fb0abda8640 0 -- 172.21.15.157:0/3972075564 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fb0a002a0a0 msgr2=0x7fb0a005a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:36.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.007+0000 7fb0ae2a29c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:36.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.007+0000 7fb0ae2a29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:36.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.007+0000 7fb0ae2a29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:36.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.007+0000 7fb0ae2a29c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:36.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.007+0000 7fb0ae2a29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:36.009 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.007+0000 7fb0ae2a29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:36.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.007+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:36.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.007+0000 7fb0ae2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:36.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.007+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:36.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:36.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:36.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:36.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 zone default found 2024-09-12T18:04:36.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 4 Realm: () 2024-09-12T18:04:36.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:36.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:36.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:36.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 zonegroup default 2024-09-12T18:04:36.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:36.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:36.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:36.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:36.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:36.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:36.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 started sync module instance, tier type = 2024-09-12T18:04:36.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.011+0000 7fb0ae2a29c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:36.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.035+0000 7fb0ae2a29c0 20 add_watcher() i=0 2024-09-12T18:04:36.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.035+0000 7fb0ae2a29c0 20 add_watcher() i=1 2024-09-12T18:04:36.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.035+0000 7fb0ae2a29c0 20 add_watcher() i=2 2024-09-12T18:04:36.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.035+0000 7fb0ae2a29c0 20 add_watcher() i=3 2024-09-12T18:04:36.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.035+0000 7fb0ae2a29c0 20 add_watcher() i=4 2024-09-12T18:04:36.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.035+0000 7fb0ae2a29c0 20 add_watcher() i=5 2024-09-12T18:04:36.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.035+0000 7fb0ae2a29c0 20 add_watcher() i=6 2024-09-12T18:04:36.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.039+0000 7fb0ae2a29c0 20 add_watcher() i=7 2024-09-12T18:04:36.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.039+0000 7fb0ae2a29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:36.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.043+0000 7faf61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:36.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.043+0000 7fb0ae2a29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:36.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.043+0000 7fb0ae2a29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:36.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.043+0000 7fb0ae2a29c0 5 note: GC not initialized 2024-09-12T18:04:36.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.043+0000 7faf60fe1640 20 reqs_thread_entry: start 2024-09-12T18:04:36.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.047+0000 7fb0ae2a29c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:36.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.047+0000 7fb0ae2a29c0 20 Filter name: none 2024-09-12T18:04:36.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.047+0000 7faeda7fc640 20 reqs_thread_entry: start 2024-09-12T18:04:36.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.047+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:36.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.047+0000 7fb0ae2a29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:36.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.047+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:36.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.047+0000 7fb0ae2a29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:36.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.047+0000 7fb0ae2a29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:36.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.047+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:36.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.047+0000 7fb0ae2a29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:36.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.047+0000 7fb0ae2a29c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:36.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.051+0000 7fb0ae2a29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:36.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.051+0000 7fb0ae2a29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:36.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.051+0000 7faf61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:36.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.055+0000 7fb0ae2a29c0 20 remove_watcher() i=0 2024-09-12T18:04:36.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.055+0000 7fb0ae2a29c0 2 removed watcher, disabling cache 2024-09-12T18:04:36.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.059+0000 7fb0ae2a29c0 20 remove_watcher() i=1 2024-09-12T18:04:36.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.063+0000 7fb0ae2a29c0 20 remove_watcher() i=2 2024-09-12T18:04:36.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.063+0000 7fb0ae2a29c0 20 remove_watcher() i=3 2024-09-12T18:04:36.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.063+0000 7fb0ae2a29c0 20 remove_watcher() i=4 2024-09-12T18:04:36.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.067+0000 7fb0ae2a29c0 20 remove_watcher() i=5 2024-09-12T18:04:36.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.067+0000 7fb0ae2a29c0 20 remove_watcher() i=6 2024-09-12T18:04:36.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:36.071+0000 7fb0ae2a29c0 20 remove_watcher() i=7 2024-09-12T18:04:36.084 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:36.084 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:04:36.085 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-commit-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:04:36.085 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:36.796 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T18:04:36.796 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:38.930 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:04:38.964 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:38.964 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:39.008 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.007+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 20 realm 2024-09-12T18:04:39.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:39.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:39.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:39.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.011+0000 7fc6484ce9c0 20 searching for the correct realm 2024-09-12T18:04:39.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.019+0000 7fc6467d5640 0 -- 172.21.15.157:0/1547443654 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fc63c12a220 msgr2=0x7fc63c11c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:39.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.235+0000 7fc645fd4640 0 -- 172.21.15.157:0/1547443654 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55c180c646b0 msgr2=0x55c180c66aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:39.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:39.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:39.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:39.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:39.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:39.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:39.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:39.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:39.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 zone default found 2024-09-12T18:04:39.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 4 Realm: () 2024-09-12T18:04:39.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:39.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:39.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:39.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 zonegroup default 2024-09-12T18:04:39.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.243+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.247+0000 7fc6484ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.247+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.247+0000 7fc6484ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.247+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.247+0000 7fc6484ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.247+0000 7fc6484ce9c0 20 started sync module instance, tier type = 2024-09-12T18:04:39.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.247+0000 7fc6484ce9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:39.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.271+0000 7fc6484ce9c0 20 add_watcher() i=0 2024-09-12T18:04:39.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.271+0000 7fc6484ce9c0 20 add_watcher() i=1 2024-09-12T18:04:39.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.271+0000 7fc6484ce9c0 20 add_watcher() i=2 2024-09-12T18:04:39.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.271+0000 7fc6484ce9c0 20 add_watcher() i=3 2024-09-12T18:04:39.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.271+0000 7fc6484ce9c0 20 add_watcher() i=4 2024-09-12T18:04:39.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.271+0000 7fc6484ce9c0 20 add_watcher() i=5 2024-09-12T18:04:39.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.271+0000 7fc6484ce9c0 20 add_watcher() i=6 2024-09-12T18:04:39.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.271+0000 7fc6484ce9c0 20 add_watcher() i=7 2024-09-12T18:04:39.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.271+0000 7fc6484ce9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:39.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.275+0000 7fc4f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:39.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.275+0000 7fc6484ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:39.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.275+0000 7fc6484ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:39.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.275+0000 7fc6484ce9c0 5 note: GC not initialized 2024-09-12T18:04:39.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.275+0000 7fc4f67fc640 20 reqs_thread_entry: start 2024-09-12T18:04:39.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.275+0000 7fc6484ce9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:39.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.275+0000 7fc6484ce9c0 20 Filter name: none 2024-09-12T18:04:39.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.275+0000 7fc467fff640 20 reqs_thread_entry: start 2024-09-12T18:04:39.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.279+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.279+0000 7fc6484ce9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:39.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.279+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.279+0000 7fc6484ce9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:39.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.279+0000 7fc6484ce9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:39.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.279+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.279+0000 7fc6484ce9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:39.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.279+0000 7fc6484ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.282 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.283+0000 7fc6484ce9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:39.282 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.283+0000 7fc6484ce9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:39.285 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.283+0000 7fc4f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:39.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.295+0000 7fc6484ce9c0 20 remove_watcher() i=0 2024-09-12T18:04:39.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.295+0000 7fc6484ce9c0 2 removed watcher, disabling cache 2024-09-12T18:04:39.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.295+0000 7fc6484ce9c0 20 remove_watcher() i=1 2024-09-12T18:04:39.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.295+0000 7fc6484ce9c0 20 remove_watcher() i=2 2024-09-12T18:04:39.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.295+0000 7fc6484ce9c0 20 remove_watcher() i=3 2024-09-12T18:04:39.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.299+0000 7fc6484ce9c0 20 remove_watcher() i=4 2024-09-12T18:04:39.300 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.299+0000 7fc6484ce9c0 20 remove_watcher() i=5 2024-09-12T18:04:39.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.299+0000 7fc6484ce9c0 20 remove_watcher() i=6 2024-09-12T18:04:39.303 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.303+0000 7fc6484ce9c0 20 remove_watcher() i=7 2024-09-12T18:04:39.319 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:39.319 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:04:39.319 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-commit-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:04:39.320 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:39.320 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T18:04:39.358 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:39.358 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:39.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.399+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.403+0000 7fe7799909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.403+0000 7fe7799909c0 20 realm 2024-09-12T18:04:39.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.403+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.403+0000 7fe7799909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.403+0000 7fe7799909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:39.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.403+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.403+0000 7fe7799909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.403+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.403+0000 7fe7799909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:39.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.403+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.407+0000 7fe7799909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:39.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.407+0000 7fe7799909c0 20 searching for the correct realm 2024-09-12T18:04:39.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.411+0000 7fe777c97640 0 -- 172.21.15.157:0/2971303117 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x5646dfe6a6c0 msgr2=0x5646dfe6cb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:39.418 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.419+0000 7fe776c95640 0 -- 172.21.15.157:0/2971303117 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fe760043070 msgr2=0x7fe760026920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:39.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.423+0000 7fe7799909c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:39.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.423+0000 7fe7799909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:39.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.423+0000 7fe7799909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:39.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.423+0000 7fe7799909c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:39.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.423+0000 7fe7799909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:39.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.423+0000 7fe7799909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:39.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.423+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.423+0000 7fe7799909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.423+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:39.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:39.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 zone default found 2024-09-12T18:04:39.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 4 Realm: () 2024-09-12T18:04:39.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:39.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:39.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:39.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 zonegroup default 2024-09-12T18:04:39.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 started sync module instance, tier type = 2024-09-12T18:04:39.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.427+0000 7fe7799909c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:39.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.443+0000 7fe7799909c0 20 add_watcher() i=0 2024-09-12T18:04:39.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.443+0000 7fe7799909c0 20 add_watcher() i=1 2024-09-12T18:04:39.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.443+0000 7fe7799909c0 20 add_watcher() i=2 2024-09-12T18:04:39.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.443+0000 7fe7799909c0 20 add_watcher() i=3 2024-09-12T18:04:39.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.443+0000 7fe7799909c0 20 add_watcher() i=4 2024-09-12T18:04:39.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.443+0000 7fe7799909c0 20 add_watcher() i=5 2024-09-12T18:04:39.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.443+0000 7fe7799909c0 20 add_watcher() i=6 2024-09-12T18:04:39.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.443+0000 7fe7799909c0 20 add_watcher() i=7 2024-09-12T18:04:39.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.443+0000 7fe7799909c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:39.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe62e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:39.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:39.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:39.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 5 note: GC not initialized 2024-09-12T18:04:39.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe62d7e2640 20 reqs_thread_entry: start 2024-09-12T18:04:39.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:39.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 20 Filter name: none 2024-09-12T18:04:39.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe6267fc640 20 reqs_thread_entry: start 2024-09-12T18:04:39.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T18:04:39.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:39.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T18:04:39.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T18:04:39.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 : miss 2024-09-12T18:04:39.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.447+0000 7fe7799909c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.451+0000 7fe7799909c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:39.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.451+0000 7fe7799909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 info.flags=0x17 2024-09-12T18:04:39.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.451+0000 7fe7799909c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 to cache LRU end 2024-09-12T18:04:39.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.451+0000 7fe7799909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:39.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.451+0000 7fe7799909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:39.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.451+0000 7fe7799909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 2024-09-12T18:04:39.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.455+0000 7fe7799909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 info.flags=0x17 2024-09-12T18:04:39.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.455+0000 7fe7799909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 to cache LRU end 2024-09-12T18:04:39.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.455+0000 7fe7799909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:39.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.455+0000 7fe7799909c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31, ofs0, ns] 2024-09-12T18:04:39.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.455+0000 7fe65affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94862404205200 notifier 7350 bl.length()=931 2024-09-12T18:04:39.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.455+0000 7fe65affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 info.flags=0x17 2024-09-12T18:04:39.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.455+0000 7fe65affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 to cache LRU end 2024-09-12T18:04:39.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.455+0000 7fe65affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:39.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.459+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): orig_sources= new_sources= 2024-09-12T18:04:39.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.459+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): potential sources added=[] removed=[] 2024-09-12T18:04:39.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.459+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): orig_dests= new_dests= 2024-09-12T18:04:39.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.459+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): potential dests added=[] removed=[] 2024-09-12T18:04:39.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.467+0000 7fe7799909c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31.1.0 2024-09-12T18:04:39.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.467+0000 7fe7799909c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31.1.0 2024-09-12T18:04:39.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.467+0000 7fe7799909c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31.1.1 2024-09-12T18:04:39.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.467+0000 7fe7799909c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31.1.1 2024-09-12T18:04:39.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.467+0000 7fe7799909c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31.0 2024-09-12T18:04:39.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.467+0000 7fe7799909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:39.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.467+0000 7fe7799909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 2024-09-12T18:04:39.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe7799909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 info.flags=0x17 2024-09-12T18:04:39.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe7799909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 to cache LRU end 2024-09-12T18:04:39.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe7799909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:39.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe7799909c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31, ofs0, ns] 2024-09-12T18:04:39.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe65affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94862404205200 notifier 7350 bl.length()=931 2024-09-12T18:04:39.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe65affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 info.flags=0x17 2024-09-12T18:04:39.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe65affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 to cache LRU end 2024-09-12T18:04:39.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe65affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:39.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): orig_sources= new_sources= 2024-09-12T18:04:39.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): potential sources added=[] removed=[] 2024-09-12T18:04:39.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): orig_dests= new_dests= 2024-09-12T18:04:39.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.475+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): potential dests added=[] removed=[] 2024-09-12T18:04:39.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31.0 2024-09-12T18:04:39.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T18:04:39.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:39.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 2024-09-12T18:04:39.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 info.flags=0x17 2024-09-12T18:04:39.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 to cache LRU end 2024-09-12T18:04:39.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:39.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31, ofs0, ns] 2024-09-12T18:04:39.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe65a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464301 cookie 94862404205200 notifier 7350 bl.length()=899 2024-09-12T18:04:39.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe65a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 info.flags=0x17 2024-09-12T18:04:39.479 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe65a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 to cache LRU end 2024-09-12T18:04:39.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe65a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:39.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): orig_sources= new_sources= 2024-09-12T18:04:39.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): potential sources added=[] removed=[] 2024-09-12T18:04:39.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): orig_dests= new_dests= 2024-09-12T18:04:39.480 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.479+0000 7fe7799909c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31]): potential dests added=[] removed=[] 2024-09-12T18:04:39.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.483+0000 7fe7799909c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T18:04:39.485 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.483+0000 7fe62e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:39.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.491+0000 7fe7799909c0 20 remove_watcher() i=0 2024-09-12T18:04:39.490 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.491+0000 7fe7799909c0 2 removed watcher, disabling cache 2024-09-12T18:04:39.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.491+0000 7fe7799909c0 20 remove_watcher() i=1 2024-09-12T18:04:39.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.495+0000 7fe7799909c0 20 remove_watcher() i=2 2024-09-12T18:04:39.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.495+0000 7fe7799909c0 20 remove_watcher() i=3 2024-09-12T18:04:39.498 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.499+0000 7fe7799909c0 20 remove_watcher() i=4 2024-09-12T18:04:39.500 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.499+0000 7fe7799909c0 20 remove_watcher() i=5 2024-09-12T18:04:39.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.503+0000 7fe7799909c0 20 remove_watcher() i=6 2024-09-12T18:04:39.503 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.503+0000 7fe7799909c0 20 remove_watcher() i=7 2024-09-12T18:04:39.518 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:04:39.545 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:39.545 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:39.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.587+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.587+0000 7f38f9f559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.587+0000 7f38f9f559c0 20 realm 2024-09-12T18:04:39.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.587+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.587+0000 7f38f9f559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.587+0000 7f38f9f559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:39.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.587+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.587+0000 7f38f9f559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:39.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.587+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.591+0000 7f38f9f559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:39.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.591+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:39.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.591+0000 7f38f9f559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:39.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.591+0000 7f38f9f559c0 20 searching for the correct realm 2024-09-12T18:04:39.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.595+0000 7f38f725a640 0 -- 172.21.15.157:0/1193142825 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f38e0008050 msgr2=0x7f38e0047430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:39.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:39.811+0000 7f38f7a5b640 0 -- 172.21.15.157:0/1193142825 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f38e002d3c0 msgr2=0x7f38e002d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:40.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.027+0000 7f38f9f559c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:40.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.027+0000 7f38f9f559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:40.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.027+0000 7f38f9f559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:40.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.027+0000 7f38f9f559c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:40.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.027+0000 7f38f9f559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:40.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.027+0000 7f38f9f559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:40.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.027+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:40.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:40.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:40.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:40.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:40.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:40.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 zone default found 2024-09-12T18:04:40.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 4 Realm: () 2024-09-12T18:04:40.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:40.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:40.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:40.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 zonegroup default 2024-09-12T18:04:40.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:40.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:40.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:40.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:40.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:40.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:40.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 started sync module instance, tier type = 2024-09-12T18:04:40.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.031+0000 7f38f9f559c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:40.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.059+0000 7f38f9f559c0 20 add_watcher() i=0 2024-09-12T18:04:40.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.059+0000 7f38f9f559c0 20 add_watcher() i=1 2024-09-12T18:04:40.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.059+0000 7f38f9f559c0 20 add_watcher() i=2 2024-09-12T18:04:40.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.059+0000 7f38f9f559c0 20 add_watcher() i=3 2024-09-12T18:04:40.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.059+0000 7f38f9f559c0 20 add_watcher() i=4 2024-09-12T18:04:40.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.059+0000 7f38f9f559c0 20 add_watcher() i=5 2024-09-12T18:04:40.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.059+0000 7f38f9f559c0 20 add_watcher() i=6 2024-09-12T18:04:40.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.059+0000 7f38f9f559c0 20 add_watcher() i=7 2024-09-12T18:04:40.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.059+0000 7f38f9f559c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:40.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.063+0000 7f37adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:40.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.063+0000 7f38f9f559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:40.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.063+0000 7f38f9f559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:40.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.063+0000 7f38f9f559c0 5 note: GC not initialized 2024-09-12T18:04:40.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.067+0000 7f37acfe1640 20 reqs_thread_entry: start 2024-09-12T18:04:40.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.067+0000 7f38f9f559c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:40.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.067+0000 7f38f9f559c0 20 Filter name: none 2024-09-12T18:04:40.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.067+0000 7f37267fc640 20 reqs_thread_entry: start 2024-09-12T18:04:40.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.067+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:40.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.067+0000 7f38f9f559c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:40.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.067+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:40.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.067+0000 7f38f9f559c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:40.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.067+0000 7f38f9f559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:40.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.067+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:40.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.071+0000 7f38f9f559c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:40.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.071+0000 7f38f9f559c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:40.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.071+0000 7f38f9f559c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:40.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.071+0000 7f38f9f559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:40.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.071+0000 7f37adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:40.074 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.079+0000 7f38f9f559c0 20 remove_watcher() i=0 2024-09-12T18:04:40.074 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.079+0000 7f38f9f559c0 2 removed watcher, disabling cache 2024-09-12T18:04:40.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.079+0000 7f38f9f559c0 20 remove_watcher() i=1 2024-09-12T18:04:40.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.083+0000 7f38f9f559c0 20 remove_watcher() i=2 2024-09-12T18:04:40.081 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.083+0000 7f38f9f559c0 20 remove_watcher() i=3 2024-09-12T18:04:40.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.087+0000 7f38f9f559c0 20 remove_watcher() i=4 2024-09-12T18:04:40.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.087+0000 7f38f9f559c0 20 remove_watcher() i=5 2024-09-12T18:04:40.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.091+0000 7f38f9f559c0 20 remove_watcher() i=6 2024-09-12T18:04:40.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:40.091+0000 7f38f9f559c0 20 remove_watcher() i=7 2024-09-12T18:04:40.104 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:40.104 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:04:40.104 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-commit-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T18:04:40.104 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:40.876 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T18:04:40.877 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.009 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T18:04:43.041 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:43.041 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:43.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.087+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.091+0000 7fe19482b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.091+0000 7fe19482b9c0 20 realm 2024-09-12T18:04:43.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.091+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.091+0000 7fe19482b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.091+0000 7fe19482b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:43.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.091+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.091+0000 7fe19482b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.091+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.091+0000 7fe19482b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:43.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.091+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.095+0000 7fe19482b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:43.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.095+0000 7fe19482b9c0 20 searching for the correct realm 2024-09-12T18:04:43.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.099+0000 7fe191b30640 0 -- 172.21.15.157:0/2869511372 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fe1881033b0 msgr2=0x7fe188115880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:43.103 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.107+0000 7fe192b32640 0 -- 172.21.15.157:0/2869511372 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fe1880fd490 msgr2=0x7fe188132780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.111+0000 7fe19482b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.111+0000 7fe19482b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.111+0000 7fe19482b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.111+0000 7fe19482b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.111+0000 7fe19482b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:43.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.111+0000 7fe19482b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:43.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.111+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.111+0000 7fe19482b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.111+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 zone default found 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 4 Realm: () 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 zonegroup default 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 started sync module instance, tier type = 2024-09-12T18:04:43.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.115+0000 7fe19482b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:43.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.131+0000 7fe19482b9c0 20 add_watcher() i=0 2024-09-12T18:04:43.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.131+0000 7fe19482b9c0 20 add_watcher() i=1 2024-09-12T18:04:43.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.131+0000 7fe19482b9c0 20 add_watcher() i=2 2024-09-12T18:04:43.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.131+0000 7fe19482b9c0 20 add_watcher() i=3 2024-09-12T18:04:43.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.131+0000 7fe19482b9c0 20 add_watcher() i=4 2024-09-12T18:04:43.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.131+0000 7fe19482b9c0 20 add_watcher() i=5 2024-09-12T18:04:43.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.131+0000 7fe19482b9c0 20 add_watcher() i=6 2024-09-12T18:04:43.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.131+0000 7fe19482b9c0 20 add_watcher() i=7 2024-09-12T18:04:43.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.131+0000 7fe19482b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:43.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe048fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:43.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:43.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:43.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 5 note: GC not initialized 2024-09-12T18:04:43.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fdfc37fe640 20 reqs_thread_entry: start 2024-09-12T18:04:43.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:43.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 Filter name: none 2024-09-12T18:04:43.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fdfc17fa640 20 reqs_thread_entry: start 2024-09-12T18:04:43.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:43.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:43.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:43.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:43.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.135+0000 7fe19482b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.139+0000 7fe19482b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:43.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.139+0000 7fe19482b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:43.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.139+0000 7fe048fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:43.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.143+0000 7fe19482b9c0 20 remove_watcher() i=0 2024-09-12T18:04:43.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.143+0000 7fe19482b9c0 2 removed watcher, disabling cache 2024-09-12T18:04:43.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.147+0000 7fe19482b9c0 20 remove_watcher() i=1 2024-09-12T18:04:43.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.147+0000 7fe19482b9c0 20 remove_watcher() i=2 2024-09-12T18:04:43.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.151+0000 7fe19482b9c0 20 remove_watcher() i=3 2024-09-12T18:04:43.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.151+0000 7fe19482b9c0 20 remove_watcher() i=4 2024-09-12T18:04:43.149 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.151+0000 7fe19482b9c0 20 remove_watcher() i=5 2024-09-12T18:04:43.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.155+0000 7fe19482b9c0 20 remove_watcher() i=6 2024-09-12T18:04:43.152 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.155+0000 7fe19482b9c0 20 remove_watcher() i=7 2024-09-12T18:04:43.165 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.166 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:04:43.166 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-commit-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:04:43.166 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.166 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T18:04:43.198 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:43.198 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:43.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.243+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 realm 2024-09-12T18:04:43.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:43.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:43.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:43.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 searching for the correct realm 2024-09-12T18:04:43.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.251+0000 7f4b4c13c640 0 -- 172.21.15.157:0/1905817040 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f4b40035040 msgr2=0x7f4b4002a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:43.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.467+0000 7f4b4c93d640 0 -- 172.21.15.157:0/1905817040 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f4b34003100 msgr2=0x7f4b4004f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:43.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:43.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:43.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:43.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:43.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:43.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:43.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:43.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:43.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 zone default found 2024-09-12T18:04:43.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 4 Realm: () 2024-09-12T18:04:43.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:43.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:43.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:43.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 zonegroup default 2024-09-12T18:04:43.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.691+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.691+0000 7f4b4ee379c0 20 started sync module instance, tier type = 2024-09-12T18:04:43.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.691+0000 7f4b4ee379c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:43.710 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=0 2024-09-12T18:04:43.710 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=1 2024-09-12T18:04:43.710 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=2 2024-09-12T18:04:43.710 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=3 2024-09-12T18:04:43.710 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=4 2024-09-12T18:04:43.710 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=5 2024-09-12T18:04:43.710 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=6 2024-09-12T18:04:43.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.715+0000 7f4b4ee379c0 20 add_watcher() i=7 2024-09-12T18:04:43.712 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.715+0000 7f4b4ee379c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:43.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.719+0000 7f4a02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:43.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.719+0000 7f4b4ee379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:43.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.719+0000 7f4b4ee379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:43.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 note: GC not initialized 2024-09-12T18:04:43.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.719+0000 7f4a01fe3640 20 reqs_thread_entry: start 2024-09-12T18:04:43.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:43.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 Filter name: none 2024-09-12T18:04:43.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f49737fe640 20 reqs_thread_entry: start 2024-09-12T18:04:43.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:04:43.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:43.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:04:43.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:04:43.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 : miss 2024-09-12T18:04:43.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:43.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:43.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 2024-09-12T18:04:43.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32, ofs0, ns] 2024-09-12T18:04:43.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94062034316000 notifier 6899 bl.length()=931 2024-09-12T18:04:43.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_sources= new_sources= 2024-09-12T18:04:43.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential sources added=[] removed=[] 2024-09-12T18:04:43.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_dests= new_dests= 2024-09-12T18:04:43.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential dests added=[] removed=[] 2024-09-12T18:04:43.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.739+0000 7f4b4ee379c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.0 2024-09-12T18:04:43.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.739+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.0 2024-09-12T18:04:43.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.739+0000 7f4b4ee379c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.1 2024-09-12T18:04:43.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.739+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.1 2024-09-12T18:04:43.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.739+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.0 2024-09-12T18:04:43.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:43.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 2024-09-12T18:04:43.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32, ofs0, ns] 2024-09-12T18:04:43.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464305 cookie 94062034316000 notifier 6899 bl.length()=931 2024-09-12T18:04:43.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_sources= new_sources= 2024-09-12T18:04:43.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential sources added=[] removed=[] 2024-09-12T18:04:43.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_dests= new_dests= 2024-09-12T18:04:43.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential dests added=[] removed=[] 2024-09-12T18:04:43.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.755+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.0 2024-09-12T18:04:43.752 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4b4ee379c0 time 2024-09-12T18:04:43.757589+0000 2024-09-12T18:04:43.752 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:04:43.754 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:43.754 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4b527112eb] 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4b5271149f] 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558c8370c0c1] 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558c8371e467] 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4b51577d90] 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.759+0000 7f4b4ee379c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4b4ee379c0 time 2024-09-12T18:04:43.757589+0000 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:43.755 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4b527112eb] 2024-09-12T18:04:43.756 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4b5271149f] 2024-09-12T18:04:43.756 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558c8370c0c1] 2024-09-12T18:04:43.756 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558c8371e467] 2024-09-12T18:04:43.756 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:04:43.756 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4b51577d90] 2024-09-12T18:04:43.756 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:04:43.756 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:04:43.756 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.756 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:04:43.756 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f4b4ee379c0 thread_name:radosgw-admin 2024-09-12T18:04:43.781 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:43.781 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4b51590520] 2024-09-12T18:04:43.781 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:04:43.781 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:04:43.781 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:04:43.781 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4b52711345] 2024-09-12T18:04:43.781 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4b5271149f] 2024-09-12T18:04:43.781 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558c8370c0c1] 2024-09-12T18:04:43.781 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558c8371e467] 2024-09-12T18:04:43.781 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4b51577d90] 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.759+0000 7f4b4ee379c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f4b4ee379c0 thread_name:radosgw-admin 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4b51590520] 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4b52711345] 2024-09-12T18:04:43.782 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4b5271149f] 2024-09-12T18:04:43.783 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558c8370c0c1] 2024-09-12T18:04:43.783 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558c8371e467] 2024-09-12T18:04:43.783 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:04:43.783 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4b51577d90] 2024-09-12T18:04:43.783 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:04:43.783 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:04:43.783 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:04:43.783 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.783 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:04:43.783 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:04:43.223+0000 7f4a3ae0d640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:43.783 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:04:43.223+0000 7f4a3ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:04:43.223+0000 7f4a3ae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:04:43.223+0000 7f4a3ae0d640 10 monclient: dump: 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.784 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 monclient: authenticate success, global_id 6887 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 10 monclient: get_monmap_and_config success 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 4 set_mon_vals no callback set 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 10 monclient: shutdown 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) unregister_commands rotate-key 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 10 monclient: build_initial_monmap 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 10 monclient: monmap: 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:04:43.785 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding auth protocol: cephx 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding auth protocol: cephx 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding auth protocol: cephx 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.786 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 1 librados: starting msgr at 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 1 librados: starting objecter 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command objecter_requests hook 0x558c8614cc70 2024-09-12T18:04:43.787 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 1 librados: setting wanted keys 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 1 librados: calling monclient init 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 10 monclient: init 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding auth protocol: cephx 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding auth protocol: cephx 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding auth protocol: cephx 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.788 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command rotate-key hook 0x558c86149e78 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-a con 0x558c8614d4c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:04:43.789 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-b con 0x558c8614fec0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-c con 0x7f4b34002350 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): authenticate will time out at 2445.448362s 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): get_auth_request con 0x558c8614d4c0 auth_method 0 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request con 0x7f4b34002350 auth_method 0 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.790 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_done global_id 7398 payload 824 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient: _finish_hunting 0 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 1 monclient: found mon.noname-a 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:04:43.791 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: dump: 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: _finish_auth 0 2024-09-12T18:04:43.792 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: _check_auth_tickets 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: dump: 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.793 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:04:43.227+0000 7f4a3ae0d640 4 set_mon_vals no callback set 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 5 monclient: authenticate success, global_id 7398 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 1 librados: init done 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:04:43.227+0000 7f4a3960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:04:43.227+0000 7f4a3960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:04:43.227+0000 7f4a3960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:04:43.227+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x7f4a34070b10 auth_method 0 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:04:43.231+0000 7f4b4d13e640 10 monclient: get_auth_request con 0x558c86176070 auth_method 0 2024-09-12T18:04:43.794 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:04:43.231+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x558c861950e0 auth_method 0 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:04:43.231+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x558c861992d0 auth_method 0 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: build_initial_monmap 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: monmap: 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:04:43.795 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding auth protocol: cephx 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding auth protocol: cephx 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding auth protocol: cephx 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.796 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command objecter_requests cmddesc objecter_requests hook 0x558c861a1960 EEXIST 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: init 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding auth protocol: cephx 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding auth protocol: cephx 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding auth protocol: cephx 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.797 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command rotate-key cmddesc rotate-key hook 0x558c8619c770 EEXIST 2024-09-12T18:04:43.798 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-b con 0x558c861c5b10 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-a con 0x558c861c5440 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-c con 0x558c861c3e20 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): authenticate will time out at 2445.457161s 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request con 0x558c861c3e20 auth_method 0 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.799 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): get_auth_request con 0x558c861c5440 auth_method 0 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_done global_id 6893 payload 824 2024-09-12T18:04:43.800 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient: _finish_hunting 0 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 1 monclient: found mon.noname-c 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: dump: 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.801 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: _finish_auth 0 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: _check_auth_tickets 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: dump: 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.802 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.803 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.803 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.803 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.803 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.803 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.803 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 monclient: authenticate success, global_id 6893 2024-09-12T18:04:43.803 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:04:43.235+0000 7f4b4d93f640 4 set_mon_vals no callback set 2024-09-12T18:04:43.803 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.803 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.803 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.803 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:04:43.239+0000 7f4a327fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:04:43.239+0000 7f4a327fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:04:43.239+0000 7f4a327fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:04:43.239+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x7f4a24070a20 auth_method 0 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: get_monmap_and_config 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: build_initial_monmap 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: monmap: 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:04:43.804 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding auth protocol: cephx 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding auth protocol: cephx 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding auth protocol: cephx 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.805 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.806 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.806 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.806 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.806 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.806 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.806 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.806 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.806 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.806 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.806 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: init 2024-09-12T18:04:43.806 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding auth protocol: cephx 2024-09-12T18:04:43.807 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding auth protocol: cephx 2024-09-12T18:04:43.807 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding auth protocol: cephx 2024-09-12T18:04:43.807 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.807 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.807 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.807 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.807 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.807 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.807 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.807 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.807 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.808 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.808 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.808 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.808 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.808 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.808 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe65d921c8 EEXIST 2024-09-12T18:04:43.808 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:43.808 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:04:43.808 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-b con 0x558c86219920 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:04:43.808 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-a con 0x558c86214d10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:04:43.808 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-c con 0x558c86215690 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): authenticate will time out at 2445.461575s 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): get_auth_request con 0x558c86214d10 auth_method 0 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request con 0x558c86215690 auth_method 0 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.809 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_done global_id 7404 payload 274 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient: _finish_hunting 0 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 1 monclient: found mon.noname-a 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.810 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: dump: 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: _finish_auth 0 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: _check_auth_tickets 2024-09-12T18:04:43.811 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: dump: 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.812 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 monclient: authenticate success, global_id 7404 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: get_monmap_and_config success 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 4 set_mon_vals no callback set 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: shutdown 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: build_initial_monmap 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: monmap: 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:04:43.813 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding auth protocol: cephx 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding auth protocol: cephx 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding auth protocol: cephx 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.814 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 librados: starting msgr at 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 librados: starting objecter 2024-09-12T18:04:43.815 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command objecter_requests cmddesc objecter_requests hook 0x558c861e5120 EEXIST 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 librados: setting wanted keys 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 librados: calling monclient init 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: init 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding auth protocol: cephx 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding auth protocol: cephx 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding auth protocol: cephx 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.816 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command rotate-key cmddesc rotate-key hook 0x558c861c7a78 EEXIST 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-a con 0x558c86214d10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:04:43.817 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-b con 0x558c86215690 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:04:43.818 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-c con 0x558c86219920 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:04:43.818 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.818 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.818 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.818 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:43.818 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): authenticate will time out at 2445.464170s 2024-09-12T18:04:43.818 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request con 0x558c86219920 auth_method 0 2024-09-12T18:04:43.818 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.818 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.818 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): get_auth_request con 0x558c86214d10 auth_method 0 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_done global_id 6899 payload 824 2024-09-12T18:04:43.819 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient: _finish_hunting 0 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 1 monclient: found mon.noname-c 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: dump: 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.820 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: _finish_auth 0 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: _check_auth_tickets 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: dump: 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.821 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 5 monclient: authenticate success, global_id 6899 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:04:43.243+0000 7f4a23fff640 4 set_mon_vals no callback set 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.822 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 1 librados: init done 2024-09-12T18:04:43.823 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command cr dump hook 0x7f4b40004b38 2024-09-12T18:04:43.823 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.823 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:04:43.243+0000 7f4a227fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:43.823 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:04:43.243+0000 7f4a227fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.823 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:04:43.243+0000 7f4a227fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.823 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x7f4a18070ae0 auth_method 0 2024-09-12T18:04:43.823 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:04:43.243+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x558c86233730 auth_method 0 2024-09-12T18:04:43.823 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.823 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 realm 2024-09-12T18:04:43.823 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.823 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:04:43.247+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x558c862379a0 auth_method 0 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:04:43.247+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x558c8623b200 auth_method 0 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 searching for the correct realm 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:04:43.247+0000 7f4b4d13e640 10 monclient: get_auth_request con 0x558c8623ff40 auth_method 0 2024-09-12T18:04:43.824 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:04:43.251+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x7f4b44068040 auth_method 0 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:04:43.251+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x7f4b40035040 auth_method 0 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:04:43.251+0000 7f4b4c13c640 0 -- 172.21.15.157:0/1905817040 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f4b40035040 msgr2=0x7f4b4002a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:04:43.455+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x7f4b40035040 auth_method 0 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:04:43.459+0000 7f4b4d13e640 10 monclient: get_auth_request con 0x7f4b40008070 auth_method 0 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:04:43.467+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x7f4b34003100 auth_method 0 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:04:43.467+0000 7f4b4c93d640 0 -- 172.21.15.157:0/1905817040 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f4b34003100 msgr2=0x7f4b4004f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:04:43.671+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x7f4b34003100 auth_method 0 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:43.825 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 zone default found 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 4 Realm: () 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:43.826 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 zonegroup default 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:04:43.691+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:04:43.691+0000 7f4b4ee379c0 20 started sync module instance, tier type = 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:04:43.691+0000 7f4b4ee379c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=0 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=1 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=2 2024-09-12T18:04:43.827 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=3 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=4 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=5 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=6 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:04:43.715+0000 7f4b4ee379c0 20 add_watcher() i=7 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:04:43.715+0000 7f4b4ee379c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding auth protocol: cephx 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding auth protocol: cephx 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding auth protocol: cephx 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.828 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:04:43.719+0000 7f4a02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:43.829 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command cache list hook 0x558c86211cc0 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command cache inspect hook 0x558c86211cc0 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command cache erase hook 0x558c86211cc0 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command cache zap hook 0x558c86211cc0 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 note: GC not initialized 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:04:43.719+0000 7f4a01fe3640 20 reqs_thread_entry: start 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command sync trace show hook 0x7f4b34001d40 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command sync trace history hook 0x7f4b34001d40 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command sync trace active hook 0x7f4b34001d40 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command sync trace active_short hook 0x7f4b34001d40 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 Filter name: none 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:04:43.723+0000 7f49737fe640 20 reqs_thread_entry: start 2024-09-12T18:04:43.830 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 : miss 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 2024-09-12T18:04:43.831 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32, ofs0, ns] 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94062034316000 notifier 6899 bl.length()=931 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_sources= new_sources= 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential sources added=[] removed=[] 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_dests= new_dests= 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential dests added=[] removed=[] 2024-09-12T18:04:43.832 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:04:43.739+0000 7f4b4ee379c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.0 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:04:43.739+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.0 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:04:43.739+0000 7f4b4ee379c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.1 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:04:43.739+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.1 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:04:43.739+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.0 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32, ofs0, ns] 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464305 cookie 94062034316000 notifier 6899 bl.length()=931 2024-09-12T18:04:43.833 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_sources= new_sources= 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential sources added=[] removed=[] 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_dests= new_dests= 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential dests added=[] removed=[] 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:04:43.755+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.0 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:04:43.759+0000 7f4b4ee379c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4b4ee379c0 time 2024-09-12T18:04:43.757589+0000 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:43.834 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4b527112eb] 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4b5271149f] 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558c8370c0c1] 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558c8371e467] 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4b51577d90] 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:04:43.759+0000 7f4b4ee379c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f4b4ee379c0 thread_name:radosgw-admin 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:43.835 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4b51590520] 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4b52711345] 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4b5271149f] 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558c8370c0c1] 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558c8371e467] 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4b51577d90] 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:04:43.836 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:04:43.837 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:04:43.838 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:04:43.839 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:04:43.840 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:04:43.841 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:04:43.842 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:04:43.843 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: 7f49737fe640 / http_manager 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a01fe3640 / http_manager 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a02fe5640 / rgw_dt_lg_renew 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a227fc640 / ms_dispatch 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a23fff640 / io_context_pool 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a327fc640 / ms_dispatch 2024-09-12T18:04:43.844 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a3960a640 / ms_dispatch 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a3ae0d640 / io_context_pool 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4b4c13c640 / msgr-worker-2 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4b4c93d640 / msgr-worker-1 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4b4d13e640 / msgr-worker-0 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4b4d93f640 / io_context_pool 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4b4ee379c0 / radosgw-admin 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.112294.log 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:04:43.223+0000 7f4a3ae0d640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:43.845 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:04:43.223+0000 7f4a3ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:04:43.223+0000 7f4a3ae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:04:43.223+0000 7f4a3ae0d640 10 monclient: dump: 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.846 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 monclient: authenticate success, global_id 6887 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 10 monclient: get_monmap_and_config success 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 4 set_mon_vals no callback set 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 10 monclient: shutdown 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) unregister_commands rotate-key 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 10 monclient: build_initial_monmap 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 10 monclient: monmap: 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:04:43.847 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding auth protocol: cephx 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding auth protocol: cephx 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding auth protocol: cephx 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.848 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: crc 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8614be10) adding con mode: secure 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 1 librados: starting msgr at 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 1 librados: starting objecter 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command objecter_requests hook 0x558c8614cc70 2024-09-12T18:04:43.849 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 1 librados: setting wanted keys 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 1 librados: calling monclient init 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 10 monclient: init 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding auth protocol: cephx 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding auth protocol: cephx 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding auth protocol: cephx 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.850 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: crc 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:04:43.223+0000 7f4b4ee379c0 5 AuthRegistry(0x558c86149d30) adding con mode: secure 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command rotate-key hook 0x558c86149e78 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-a con 0x558c8614d4c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-b con 0x558c8614fec0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:04:43.851 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-c con 0x7f4b34002350 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:04:43.852 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.852 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.852 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.852 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:43.852 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient(hunting): authenticate will time out at 2445.448362s 2024-09-12T18:04:43.852 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): get_auth_request con 0x558c8614d4c0 auth_method 0 2024-09-12T18:04:43.852 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.852 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.852 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.852 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request con 0x7f4b34002350 auth_method 0 2024-09-12T18:04:43.852 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:04:43.227+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_done global_id 7398 payload 824 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient: _finish_hunting 0 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 1 monclient: found mon.noname-a 2024-09-12T18:04:43.853 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:04:43.227+0000 7f4b4c93d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: dump: 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.854 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: _finish_auth 0 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: _check_auth_tickets 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:04:43.227+0000 7f4a3960a640 10 monclient: dump: 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.855 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:04:43.227+0000 7f4a3ae0d640 4 set_mon_vals no callback set 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 5 monclient: authenticate success, global_id 7398 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:04:43.227+0000 7f4b4ee379c0 1 librados: init done 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:04:43.227+0000 7f4a3960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:43.856 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:04:43.227+0000 7f4a3960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:04:43.227+0000 7f4a3960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:04:43.227+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x7f4a34070b10 auth_method 0 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:04:43.231+0000 7f4b4d13e640 10 monclient: get_auth_request con 0x558c86176070 auth_method 0 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:04:43.231+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x558c861950e0 auth_method 0 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:04:43.231+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x558c861992d0 auth_method 0 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: build_initial_monmap 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: monmap: 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:04:43.857 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding auth protocol: cephx 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding auth protocol: cephx 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding auth protocol: cephx 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.858 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: crc 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619df50) adding con mode: secure 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command objecter_requests cmddesc objecter_requests hook 0x558c861a1960 EEXIST 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: init 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding auth protocol: cephx 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding auth protocol: cephx 2024-09-12T18:04:43.859 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding auth protocol: cephx 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: crc 2024-09-12T18:04:43.860 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8619c628) adding con mode: secure 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command rotate-key cmddesc rotate-key hook 0x558c8619c770 EEXIST 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-b con 0x558c861c5b10 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-a con 0x558c861c5440 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-c con 0x558c861c3e20 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:43.861 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient(hunting): authenticate will time out at 2445.457161s 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request con 0x558c861c3e20 auth_method 0 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): get_auth_request con 0x558c861c5440 auth_method 0 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.862 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:04:43.235+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_done global_id 6893 payload 824 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient: _finish_hunting 0 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 1 monclient: found mon.noname-c 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:04:43.235+0000 7f4b4d13e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: dump: 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.863 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: _finish_auth 0 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: _check_auth_tickets 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:04:43.235+0000 7f4a327fc640 10 monclient: dump: 2024-09-12T18:04:43.864 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 5 monclient: authenticate success, global_id 6893 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:04:43.235+0000 7f4b4d93f640 4 set_mon_vals no callback set 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.865 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:04:43.235+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:04:43.239+0000 7f4a327fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:04:43.239+0000 7f4a327fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:04:43.239+0000 7f4a327fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:04:43.239+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x7f4a24070a20 auth_method 0 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: get_monmap_and_config 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: build_initial_monmap 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: monmap: 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:04:43.866 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding auth protocol: cephx 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding auth protocol: cephx 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding auth protocol: cephx 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.867 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.868 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.868 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.868 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.868 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.868 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.868 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.868 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.868 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.868 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: crc 2024-09-12T18:04:43.868 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861e5430) adding con mode: secure 2024-09-12T18:04:43.868 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: init 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding auth protocol: cephx 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding auth protocol: cephx 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding auth protocol: cephx 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.869 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: crc 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92080) adding con mode: secure 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe65d921c8 EEXIST 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-b con 0x558c86219920 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-a con 0x558c86214d10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:04:43.870 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-c con 0x558c86215690 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient(hunting): authenticate will time out at 2445.461575s 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): get_auth_request con 0x558c86214d10 auth_method 0 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request con 0x558c86215690 auth_method 0 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.871 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:04:43.239+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient(hunting): handle_auth_done global_id 7404 payload 274 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient: _finish_hunting 0 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 1 monclient: found mon.noname-a 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:04:43.239+0000 7f4b4c13c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:04:43.872 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: dump: 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: _finish_auth 0 2024-09-12T18:04:43.873 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: _check_auth_tickets 2024-09-12T18:04:43.874 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:43.874 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.874 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:04:43.874 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:04:43.239+0000 7f4a23fff640 10 monclient: dump: 2024-09-12T18:04:43.874 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.874 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.874 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.874 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.874 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.874 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.874 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 monclient: authenticate success, global_id 7404 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: get_monmap_and_config success 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 4 set_mon_vals no callback set 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: shutdown 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: build_initial_monmap 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: monmap: 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:04:43.875 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding auth protocol: cephx 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding auth protocol: cephx 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding auth protocol: cephx 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.876 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: crc 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c8620bf10) adding con mode: secure 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 librados: starting msgr at 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 librados: starting objecter 2024-09-12T18:04:43.877 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command objecter_requests cmddesc objecter_requests hook 0x558c861e5120 EEXIST 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 librados: setting wanted keys 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 1 librados: calling monclient init 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 10 monclient: init 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding auth protocol: cephx 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding auth protocol: cephx 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding auth protocol: cephx 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.878 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: crc 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 5 AuthRegistry(0x558c861c7930) adding con mode: secure 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:04:43.239+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command rotate-key cmddesc rotate-key hook 0x558c861c7a78 EEXIST 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-a con 0x558c86214d10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-b con 0x558c86215690 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:04:43.879 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): picked mon.noname-c con 0x558c86219920 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient(hunting): authenticate will time out at 2445.464170s 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request con 0x558c86219920 auth_method 0 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): get_auth_request con 0x558c86214d10 auth_method 0 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:43.880 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient(hunting): handle_auth_done global_id 6899 payload 824 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient: _finish_hunting 0 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 1 monclient: found mon.noname-c 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:04:43.243+0000 7f4b4d13e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.881 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: dump: 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.882 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: _finish_auth 0 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: _check_auth_tickets 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:04:43.243+0000 7f4a227fc640 10 monclient: dump: 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:04:43.883 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:04:43.884 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:04:43.884 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.884 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 5 monclient: authenticate success, global_id 6899 2024-09-12T18:04:43.884 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:04:43.243+0000 7f4a23fff640 4 set_mon_vals no callback set 2024-09-12T18:04:43.884 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.884 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.884 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _renew_subs 2024-09-12T18:04:43.884 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:04:43.884 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 1 librados: init done 2024-09-12T18:04:43.884 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command cr dump hook 0x7f4b40004b38 2024-09-12T18:04:43.884 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:04:43.243+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:04:43.243+0000 7f4a227fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:04:43.243+0000 7f4a227fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:04:43.243+0000 7f4a227fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:04:43.243+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x7f4a18070ae0 auth_method 0 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:04:43.243+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x558c86233730 auth_method 0 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 realm 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.885 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:04:43.247+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x558c862379a0 auth_method 0 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:04:43.247+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x558c8623b200 auth_method 0 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:04:43.247+0000 7f4b4ee379c0 20 searching for the correct realm 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:04:43.247+0000 7f4b4d13e640 10 monclient: get_auth_request con 0x558c8623ff40 auth_method 0 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:04:43.251+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x7f4b44068040 auth_method 0 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:04:43.251+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x7f4b40035040 auth_method 0 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:04:43.251+0000 7f4b4c13c640 0 -- 172.21.15.157:0/1905817040 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f4b40035040 msgr2=0x7f4b4002a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:04:43.455+0000 7f4b4c13c640 10 monclient: get_auth_request con 0x7f4b40035040 auth_method 0 2024-09-12T18:04:43.886 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:04:43.459+0000 7f4b4d13e640 10 monclient: get_auth_request con 0x7f4b40008070 auth_method 0 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:04:43.467+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x7f4b34003100 auth_method 0 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:04:43.467+0000 7f4b4c93d640 0 -- 172.21.15.157:0/1905817040 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f4b34003100 msgr2=0x7f4b4004f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:04:43.671+0000 7f4b4c93d640 10 monclient: get_auth_request con 0x7f4b34003100 auth_method 0 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:04:43.683+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.887 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 zone default found 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 4 Realm: () 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 zonegroup default 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:04:43.687+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:04:43.691+0000 7f4b4ee379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:04:43.691+0000 7f4b4ee379c0 20 started sync module instance, tier type = 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:04:43.691+0000 7f4b4ee379c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=0 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=1 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=2 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=3 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=4 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=5 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:04:43.711+0000 7f4b4ee379c0 20 add_watcher() i=6 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:04:43.715+0000 7f4b4ee379c0 20 add_watcher() i=7 2024-09-12T18:04:43.889 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:04:43.715+0000 7f4b4ee379c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding auth protocol: cephx 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding auth protocol: cephx 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding auth protocol: cephx 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:04:43.719+0000 7f4a02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:43.890 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: crc 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 AuthRegistry(0x7ffe65d92550) adding con mode: secure 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command cache list hook 0x558c86211cc0 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command cache inspect hook 0x558c86211cc0 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command cache erase hook 0x558c86211cc0 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command cache zap hook 0x558c86211cc0 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:04:43.719+0000 7f4b4ee379c0 5 note: GC not initialized 2024-09-12T18:04:43.891 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:04:43.719+0000 7f4a01fe3640 20 reqs_thread_entry: start 2024-09-12T18:04:43.892 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command sync trace show hook 0x7f4b34001d40 2024-09-12T18:04:43.892 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command sync trace history hook 0x7f4b34001d40 2024-09-12T18:04:43.892 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command sync trace active hook 0x7f4b34001d40 2024-09-12T18:04:43.892 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 5 asok(0x558c85f422b0) register_command sync trace active_short hook 0x7f4b34001d40 2024-09-12T18:04:43.892 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:43.892 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 Filter name: none 2024-09-12T18:04:43.892 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:04:43.723+0000 7f49737fe640 20 reqs_thread_entry: start 2024-09-12T18:04:43.892 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:04:43.892 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.892 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:43.892 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 : miss 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:04:43.723+0000 7f4b4ee379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.893 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:04:43.731+0000 7f4b4ee379c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32, ofs0, ns] 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94062034316000 notifier 6899 bl.length()=931 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:04:43.731+0000 7f4a23fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_sources= new_sources= 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential sources added=[] removed=[] 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_dests= new_dests= 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:04:43.735+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential dests added=[] removed=[] 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:04:43.739+0000 7f4b4ee379c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.0 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:04:43.739+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.0 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:04:43.739+0000 7f4b4ee379c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.1 2024-09-12T18:04:43.894 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:04:43.739+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.1 2024-09-12T18:04:43.895 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:04:43.739+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.0 2024-09-12T18:04:43.895 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:43.895 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 2024-09-12T18:04:43.895 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.895 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.895 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.895 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:04:43.747+0000 7f4b4ee379c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32, ofs0, ns] 2024-09-12T18:04:43.895 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464305 cookie 94062034316000 notifier 6899 bl.length()=931 2024-09-12T18:04:43.895 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:04:43.895 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:04:43.895 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:04:43.747+0000 7f4a23fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_sources= new_sources= 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential sources added=[] removed=[] 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_dests= new_dests= 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:04:43.751+0000 7f4b4ee379c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential dests added=[] removed=[] 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:04:43.755+0000 7f4b4ee379c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.0 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:04:43.759+0000 7f4b4ee379c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4b4ee379c0 time 2024-09-12T18:04:43.757589+0000 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4b527112eb] 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4b5271149f] 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558c8370c0c1] 2024-09-12T18:04:43.896 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558c8371e467] 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4b51577d90] 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:04:43.759+0000 7f4b4ee379c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f4b4ee379c0 thread_name:radosgw-admin 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4b51590520] 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:04:43.897 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4b52711345] 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4b5271149f] 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558c8370c0c1] 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558c8371e467] 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4b51577d90] 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:04:43.898 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:04:43.899 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:04:43.900 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:04:43.901 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:04:43.902 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:04:43.903 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:04:43.904 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 7f49737fe640 / http_manager 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a01fe3640 / http_manager 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a02fe5640 / rgw_dt_lg_renew 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a227fc640 / ms_dispatch 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a23fff640 / io_context_pool 2024-09-12T18:04:43.905 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a327fc640 / ms_dispatch 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a3960a640 / ms_dispatch 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4a3ae0d640 / io_context_pool 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4b4c13c640 / msgr-worker-2 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4b4c93d640 / msgr-worker-1 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4b4d13e640 / msgr-worker-0 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4b4d93f640 / io_context_pool 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr: 7f4b4ee379c0 / radosgw-admin 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:04:43.763191Z_cfdea50a-03f3-4007-bb08-d9e1f9209894/log 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:04:43.906 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T18:04:43.908 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:43.908 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:43.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.847+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.847+0000 7fb76ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.847+0000 7fb76ec569c0 20 realm 2024-09-12T18:04:43.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.847+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.851+0000 7fb76ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.851+0000 7fb76ec569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:43.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.851+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.851+0000 7fb76ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:43.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.851+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.851+0000 7fb76ec569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:43.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.851+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:43.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.851+0000 7fb76ec569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:43.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.851+0000 7fb76ec569c0 20 searching for the correct realm 2024-09-12T18:04:43.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:43.859+0000 7fb76cf5d640 0 -- 172.21.15.157:0/2570183681 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fb754072a20 msgr2=0x7fb75406c9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:04:44.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.075+0000 7fb76c75c640 0 -- 172.21.15.157:0/2570183681 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5639fe115e10 msgr2=0x5639fe118200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:44.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:04:44.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:44.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:44.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:04:44.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:44.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:44.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:44.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:44.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:44.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:44.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:44.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:44.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 zone default found 2024-09-12T18:04:44.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 4 Realm: () 2024-09-12T18:04:44.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:04:44.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:04:44.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:44.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 zonegroup default 2024-09-12T18:04:44.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.083+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:44.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.087+0000 7fb76ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:44.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.087+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:44.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.087+0000 7fb76ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:44.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.087+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:44.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.087+0000 7fb76ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:44.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.087+0000 7fb76ec569c0 20 started sync module instance, tier type = 2024-09-12T18:04:44.084 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.087+0000 7fb76ec569c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:04:44.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.111+0000 7fb76ec569c0 20 add_watcher() i=0 2024-09-12T18:04:44.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.111+0000 7fb76ec569c0 20 add_watcher() i=1 2024-09-12T18:04:44.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.111+0000 7fb76ec569c0 20 add_watcher() i=2 2024-09-12T18:04:44.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.111+0000 7fb76ec569c0 20 add_watcher() i=3 2024-09-12T18:04:44.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.111+0000 7fb76ec569c0 20 add_watcher() i=4 2024-09-12T18:04:44.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.111+0000 7fb76ec569c0 20 add_watcher() i=5 2024-09-12T18:04:44.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.111+0000 7fb76ec569c0 20 add_watcher() i=6 2024-09-12T18:04:44.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.111+0000 7fb76ec569c0 20 add_watcher() i=7 2024-09-12T18:04:44.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.111+0000 7fb76ec569c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:44.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.115+0000 7fb622fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:44.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:44.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:44.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 5 note: GC not initialized 2024-09-12T18:04:44.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb621fdb640 20 reqs_thread_entry: start 2024-09-12T18:04:44.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 init_complete bucket index max shards: 1 2024-09-12T18:04:44.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 Filter name: none 2024-09-12T18:04:44.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb5937fe640 20 reqs_thread_entry: start 2024-09-12T18:04:44.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:44.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:44.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:44.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:04:44.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:44.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:44.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:04:44.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.119+0000 7fb76ec569c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:44.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.123+0000 7fb76ec569c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:04:44.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.123+0000 7fb76ec569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:44.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.123+0000 7fb622fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:44.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.127+0000 7fb76ec569c0 20 remove_watcher() i=0 2024-09-12T18:04:44.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.127+0000 7fb76ec569c0 2 removed watcher, disabling cache 2024-09-12T18:04:44.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.131+0000 7fb76ec569c0 20 remove_watcher() i=1 2024-09-12T18:04:44.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.135+0000 7fb76ec569c0 20 remove_watcher() i=2 2024-09-12T18:04:44.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.135+0000 7fb76ec569c0 20 remove_watcher() i=3 2024-09-12T18:04:44.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.139+0000 7fb76ec569c0 20 remove_watcher() i=4 2024-09-12T18:04:44.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.139+0000 7fb76ec569c0 20 remove_watcher() i=5 2024-09-12T18:04:44.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.143+0000 7fb76ec569c0 20 remove_watcher() i=6 2024-09-12T18:04:44.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:04:44.143+0000 7fb76ec569c0 20 remove_watcher() i=7 2024-09-12T18:04:44.159 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:04:44.159 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:04:44.159 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-commit-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:04:44.159 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:14.501 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.586+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.586+0000 7fcdfcecb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.586+0000 7fcdfcecb9c0 20 realm 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.586+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.586+0000 7fcdfcecb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.586+0000 7fcdfcecb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.586+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.586+0000 7fcdfcecb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.586+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.590+0000 7fcdfcecb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.590+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.590+0000 7fcdfcecb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.590+0000 7fcdfcecb9c0 20 searching for the correct realm 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.598+0000 7fcdfa1d0640 0 -- 172.21.15.157:0/2957943054 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fcde402c070 msgr2=0x7fcde4083780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.602+0000 7fcdfa1d0640 0 -- 172.21.15.157:0/2957943054 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fccc4080880 msgr2=0x7fccc4082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 zone default found 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 4 Realm: () 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 zonegroup default 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.610+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.614+0000 7fcdfcecb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.614+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.614+0000 7fcdfcecb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.614+0000 7fcdfcecb9c0 20 started sync module instance, tier type = 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.614+0000 7fcdfcecb9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:14.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.626+0000 7fcdfcecb9c0 20 add_watcher() i=0 2024-09-12T18:05:14.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.626+0000 7fcdfcecb9c0 20 add_watcher() i=1 2024-09-12T18:05:14.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.626+0000 7fcdfcecb9c0 20 add_watcher() i=2 2024-09-12T18:05:14.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.626+0000 7fcdfcecb9c0 20 add_watcher() i=3 2024-09-12T18:05:14.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.626+0000 7fcdfcecb9c0 20 add_watcher() i=4 2024-09-12T18:05:14.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.626+0000 7fcdfcecb9c0 20 add_watcher() i=5 2024-09-12T18:05:14.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.630+0000 7fcdfcecb9c0 20 add_watcher() i=6 2024-09-12T18:05:14.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.630+0000 7fcdfcecb9c0 20 add_watcher() i=7 2024-09-12T18:05:14.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.630+0000 7fcdfcecb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:14.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.630+0000 7fccb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:14.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:14.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:14.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 5 note: GC not initialized 2024-09-12T18:05:14.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcc2bfff640 20 reqs_thread_entry: start 2024-09-12T18:05:14.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:14.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 20 Filter name: none 2024-09-12T18:05:14.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcc29ffb640 20 reqs_thread_entry: start 2024-09-12T18:05:14.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:05:14.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:14.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:05:14.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:05:14.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 : miss 2024-09-12T18:05:14.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:14.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:05:14.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:05:14.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:14.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.634 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.634+0000 7fcdfcecb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 2024-09-12T18:05:14.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fcdfcecb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:05:14.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fcdfcecb9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:05:14.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fcdfcecb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fcdfcecb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32, ofs0, ns] 2024-09-12T18:05:14.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fccde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464307 cookie 93972770712800 notifier 6932 bl.length()=931 2024-09-12T18:05:14.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fccde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:05:14.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fccde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:05:14.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fccde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_sources= new_sources= 2024-09-12T18:05:14.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential sources added=[] removed=[] 2024-09-12T18:05:14.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_dests= new_dests= 2024-09-12T18:05:14.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.642+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential dests added=[] removed=[] 2024-09-12T18:05:14.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.646+0000 7fcdfcecb9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.0 2024-09-12T18:05:14.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.646+0000 7fcdfcecb9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.0 2024-09-12T18:05:14.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.646+0000 7fcdfcecb9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.1 2024-09-12T18:05:14.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.646+0000 7fcdfcecb9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.1.1 2024-09-12T18:05:14.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.650+0000 7fcdfcecb9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.0 2024-09-12T18:05:14.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.654+0000 7fcdfcecb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:14.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.654+0000 7fcdfcecb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 2024-09-12T18:05:14.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.654+0000 7fcdfcecb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:05:14.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.654+0000 7fcdfcecb9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:05:14.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.654+0000 7fcdfcecb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.654+0000 7fcdfcecb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32, ofs0, ns] 2024-09-12T18:05:14.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.658+0000 7fccde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464308 cookie 93972770712800 notifier 6932 bl.length()=931 2024-09-12T18:05:14.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.658+0000 7fccde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:05:14.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.658+0000 7fccde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:05:14.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.658+0000 7fccde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.658+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_sources= new_sources= 2024-09-12T18:05:14.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.658+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential sources added=[] removed=[] 2024-09-12T18:05:14.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.658+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_dests= new_dests= 2024-09-12T18:05:14.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.658+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential dests added=[] removed=[] 2024-09-12T18:05:14.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.662+0000 7fcdfcecb9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32.0 2024-09-12T18:05:14.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.662+0000 7fcdfcecb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:14.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.662+0000 7fcdfcecb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 2024-09-12T18:05:14.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.662+0000 7fcdfcecb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:05:14.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.662+0000 7fcdfcecb9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:05:14.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.662+0000 7fcdfcecb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.662+0000 7fcdfcecb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32, ofs0, ns] 2024-09-12T18:05:14.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.662+0000 7fccde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 93972770712800 notifier 6932 bl.length()=899 2024-09-12T18:05:14.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.662+0000 7fccde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 info.flags=0x17 2024-09-12T18:05:14.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.662+0000 7fccde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 to cache LRU end 2024-09-12T18:05:14.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.662+0000 7fccde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.666+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_sources= new_sources= 2024-09-12T18:05:14.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.666+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential sources added=[] removed=[] 2024-09-12T18:05:14.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.666+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): orig_dests= new_dests= 2024-09-12T18:05:14.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.666+0000 7fcdfcecb9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32]): potential dests added=[] removed=[] 2024-09-12T18:05:14.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.666+0000 7fcdfcecb9c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T18:05:14.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.670+0000 7fccb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:14.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.674+0000 7fcdfcecb9c0 20 remove_watcher() i=0 2024-09-12T18:05:14.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.674+0000 7fcdfcecb9c0 2 removed watcher, disabling cache 2024-09-12T18:05:14.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.678+0000 7fcdfcecb9c0 20 remove_watcher() i=1 2024-09-12T18:05:14.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.682+0000 7fcdfcecb9c0 20 remove_watcher() i=2 2024-09-12T18:05:14.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.682+0000 7fcdfcecb9c0 20 remove_watcher() i=3 2024-09-12T18:05:14.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.686+0000 7fcdfcecb9c0 20 remove_watcher() i=4 2024-09-12T18:05:14.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.686+0000 7fcdfcecb9c0 20 remove_watcher() i=5 2024-09-12T18:05:14.685 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.686+0000 7fcdfcecb9c0 20 remove_watcher() i=6 2024-09-12T18:05:14.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.690+0000 7fcdfcecb9c0 20 remove_watcher() i=7 2024-09-12T18:05:14.702 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T18:05:14.733 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:14.733 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:14.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.778+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.778+0000 7fef7f2979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.778+0000 7fef7f2979c0 20 realm 2024-09-12T18:05:14.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.778+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.778+0000 7fef7f2979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.778+0000 7fef7f2979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:14.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.778+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.778+0000 7fef7f2979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.778+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.986+0000 7fef7f2979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.986+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.990+0000 7fef7f2979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:14.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.990+0000 7fef7f2979c0 20 searching for the correct realm 2024-09-12T18:05:14.995 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:14.998+0000 7fef77fff640 0 -- 172.21.15.157:0/1952865906 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fef68068b90 msgr2=0x7fef68067ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:05:15.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.006+0000 7fef77fff640 0 -- 172.21.15.157:0/1952865906 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fee48080930 msgr2=0x7fee48082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:15.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.018+0000 7fef7f2979c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:15.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.018+0000 7fef7f2979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:15.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.018+0000 7fef7f2979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:15.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.018+0000 7fef7f2979c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:15.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.018+0000 7fef7f2979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:15.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.018+0000 7fef7f2979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:15.018 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.018+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:15.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:15.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:15.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:15.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:15.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:15.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 20 zone default found 2024-09-12T18:05:15.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 4 Realm: () 2024-09-12T18:05:15.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:15.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:15.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:15.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 20 zonegroup default 2024-09-12T18:05:15.021 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:15.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:15.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:15.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.022+0000 7fef7f2979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:15.022 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.026+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:15.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.026+0000 7fef7f2979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:15.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.026+0000 7fef7f2979c0 20 started sync module instance, tier type = 2024-09-12T18:05:15.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.026+0000 7fef7f2979c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:15.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.046+0000 7fef7f2979c0 20 add_watcher() i=0 2024-09-12T18:05:15.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.046+0000 7fef7f2979c0 20 add_watcher() i=1 2024-09-12T18:05:15.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.046+0000 7fef7f2979c0 20 add_watcher() i=2 2024-09-12T18:05:15.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.046+0000 7fef7f2979c0 20 add_watcher() i=3 2024-09-12T18:05:15.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.046+0000 7fef7f2979c0 20 add_watcher() i=4 2024-09-12T18:05:15.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.046+0000 7fef7f2979c0 20 add_watcher() i=5 2024-09-12T18:05:15.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.046+0000 7fef7f2979c0 20 add_watcher() i=6 2024-09-12T18:05:15.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.046+0000 7fef7f2979c0 20 add_watcher() i=7 2024-09-12T18:05:15.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.046+0000 7fef7f2979c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:15.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.050+0000 7fee337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:15.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.050+0000 7fef7f2979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:15.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.050+0000 7fef7f2979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:15.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.050+0000 7fef7f2979c0 5 note: GC not initialized 2024-09-12T18:05:15.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fee327e4640 20 reqs_thread_entry: start 2024-09-12T18:05:15.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:15.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 Filter name: none 2024-09-12T18:05:15.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fee2b7fe640 20 reqs_thread_entry: start 2024-09-12T18:05:15.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:15.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:15.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:15.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:15.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:15.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:15.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:15.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:15.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:15.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.054+0000 7fef7f2979c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:15.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.058+0000 7fee337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:15.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.062+0000 7fef7f2979c0 20 remove_watcher() i=0 2024-09-12T18:05:15.060 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.062+0000 7fef7f2979c0 2 removed watcher, disabling cache 2024-09-12T18:05:15.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.066+0000 7fef7f2979c0 20 remove_watcher() i=1 2024-09-12T18:05:15.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.066+0000 7fef7f2979c0 20 remove_watcher() i=2 2024-09-12T18:05:15.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.070+0000 7fef7f2979c0 20 remove_watcher() i=3 2024-09-12T18:05:15.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.070+0000 7fef7f2979c0 20 remove_watcher() i=4 2024-09-12T18:05:15.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.074+0000 7fef7f2979c0 20 remove_watcher() i=5 2024-09-12T18:05:15.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.074+0000 7fef7f2979c0 20 remove_watcher() i=6 2024-09-12T18:05:15.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:15.074+0000 7fef7f2979c0 20 remove_watcher() i=7 2024-09-12T18:05:15.089 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:15.089 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:05:15.089 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-commit-target-layout id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:05:15.090 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:15.801 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T18:05:15.802 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:17.981 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T18:05:18.013 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:18.013 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:18.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.058+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 20 realm 2024-09-12T18:05:18.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:18.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:18.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:18.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.062+0000 7fc76e7139c0 20 searching for the correct realm 2024-09-12T18:05:18.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.070+0000 7fc76ca1a640 0 -- 172.21.15.157:0/2090889195 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fc754008050 msgr2=0x7fc754031910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:18.283 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.286+0000 7fc76c219640 0 -- 172.21.15.157:0/2090889195 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x564511397b30 msgr2=0x564511399ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:18.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:18.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:18.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:18.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:18.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:18.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:18.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:18.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:18.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 zone default found 2024-09-12T18:05:18.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 4 Realm: () 2024-09-12T18:05:18.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:18.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:18.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:18.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 zonegroup default 2024-09-12T18:05:18.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.294+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.298+0000 7fc76e7139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.298+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.298+0000 7fc76e7139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.298+0000 7fc76e7139c0 20 started sync module instance, tier type = 2024-09-12T18:05:18.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.298+0000 7fc76e7139c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:18.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.318+0000 7fc76e7139c0 20 add_watcher() i=0 2024-09-12T18:05:18.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.318+0000 7fc76e7139c0 20 add_watcher() i=1 2024-09-12T18:05:18.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.318+0000 7fc76e7139c0 20 add_watcher() i=2 2024-09-12T18:05:18.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.318+0000 7fc76e7139c0 20 add_watcher() i=3 2024-09-12T18:05:18.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.318+0000 7fc76e7139c0 20 add_watcher() i=4 2024-09-12T18:05:18.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.318+0000 7fc76e7139c0 20 add_watcher() i=5 2024-09-12T18:05:18.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.318+0000 7fc76e7139c0 20 add_watcher() i=6 2024-09-12T18:05:18.319 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.322+0000 7fc76e7139c0 20 add_watcher() i=7 2024-09-12T18:05:18.319 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.322+0000 7fc76e7139c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:18.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.326+0000 7fc622fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:18.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.326+0000 7fc76e7139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:18.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.326+0000 7fc76e7139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:18.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.326+0000 7fc76e7139c0 5 note: GC not initialized 2024-09-12T18:05:18.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.326+0000 7fc621fdb640 20 reqs_thread_entry: start 2024-09-12T18:05:18.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.326+0000 7fc76e7139c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:18.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.326+0000 7fc76e7139c0 20 Filter name: none 2024-09-12T18:05:18.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.326+0000 7fc5937fe640 20 reqs_thread_entry: start 2024-09-12T18:05:18.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.326+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.326+0000 7fc76e7139c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:18.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.326+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.330+0000 7fc76e7139c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:18.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.330+0000 7fc76e7139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:18.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.330+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.330+0000 7fc76e7139c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:18.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.330+0000 7fc76e7139c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.330+0000 7fc76e7139c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:18.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.330+0000 7fc76e7139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:18.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.334+0000 7fc622fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:18.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.338+0000 7fc76e7139c0 20 remove_watcher() i=0 2024-09-12T18:05:18.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.338+0000 7fc76e7139c0 2 removed watcher, disabling cache 2024-09-12T18:05:18.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.338+0000 7fc76e7139c0 20 remove_watcher() i=1 2024-09-12T18:05:18.340 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.342+0000 7fc76e7139c0 20 remove_watcher() i=2 2024-09-12T18:05:18.342 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.346+0000 7fc76e7139c0 20 remove_watcher() i=3 2024-09-12T18:05:18.345 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.346+0000 7fc76e7139c0 20 remove_watcher() i=4 2024-09-12T18:05:18.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.350+0000 7fc76e7139c0 20 remove_watcher() i=5 2024-09-12T18:05:18.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.350+0000 7fc76e7139c0 20 remove_watcher() i=6 2024-09-12T18:05:18.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.354+0000 7fc76e7139c0 20 remove_watcher() i=7 2024-09-12T18:05:18.365 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:18.365 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:05:18.365 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-do-reshard id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:05:18.365 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:18.366 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T18:05:18.402 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:18.402 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:18.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.446+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 20 realm 2024-09-12T18:05:18.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:18.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:18.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:18.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.450+0000 7fa45bc4a9c0 20 searching for the correct realm 2024-09-12T18:05:18.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.458+0000 7fa459f51640 0 -- 172.21.15.157:0/1826900332 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55bbe49bdc10 msgr2=0x55bbe49c0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:18.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.462+0000 7fa458f4f640 0 -- 172.21.15.157:0/1826900332 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fa4500d7180 msgr2=0x7fa4500a4a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:18.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:18.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:18.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:18.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:18.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:18.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:18.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:18.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:18.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 zone default found 2024-09-12T18:05:18.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 4 Realm: () 2024-09-12T18:05:18.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:18.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:18.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:18.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 zonegroup default 2024-09-12T18:05:18.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.470+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.474+0000 7fa45bc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.471 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.474+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.474+0000 7fa45bc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.474+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.474+0000 7fa45bc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.474+0000 7fa45bc4a9c0 20 started sync module instance, tier type = 2024-09-12T18:05:18.472 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.474+0000 7fa45bc4a9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:18.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.490+0000 7fa45bc4a9c0 20 add_watcher() i=0 2024-09-12T18:05:18.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.490+0000 7fa45bc4a9c0 20 add_watcher() i=1 2024-09-12T18:05:18.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.490+0000 7fa45bc4a9c0 20 add_watcher() i=2 2024-09-12T18:05:18.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.490+0000 7fa45bc4a9c0 20 add_watcher() i=3 2024-09-12T18:05:18.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.490+0000 7fa45bc4a9c0 20 add_watcher() i=4 2024-09-12T18:05:18.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.490+0000 7fa45bc4a9c0 20 add_watcher() i=5 2024-09-12T18:05:18.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.490+0000 7fa45bc4a9c0 20 add_watcher() i=6 2024-09-12T18:05:18.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.490+0000 7fa45bc4a9c0 20 add_watcher() i=7 2024-09-12T18:05:18.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.490+0000 7fa45bc4a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:18.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.494+0000 7fa30f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:18.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.494+0000 7fa45bc4a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:18.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.494+0000 7fa45bc4a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:18.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.494+0000 7fa45bc4a9c0 5 note: GC not initialized 2024-09-12T18:05:18.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.494+0000 7fa30e7e4640 20 reqs_thread_entry: start 2024-09-12T18:05:18.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.494+0000 7fa45bc4a9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:18.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.494+0000 7fa45bc4a9c0 20 Filter name: none 2024-09-12T18:05:18.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.494+0000 7fa27ffff640 20 reqs_thread_entry: start 2024-09-12T18:05:18.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.494+0000 7fa45bc4a9c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T18:05:18.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.494+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.498+0000 7fa45bc4a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:18.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.498+0000 7fa45bc4a9c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T18:05:18.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.498+0000 7fa45bc4a9c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T18:05:18.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.498+0000 7fa45bc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 : miss 2024-09-12T18:05:18.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.498+0000 7fa45bc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.498+0000 7fa45bc4a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:18.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.498+0000 7fa45bc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:18.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.498+0000 7fa45bc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:18.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.498+0000 7fa45bc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:18.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.498+0000 7fa45bc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:18.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.498+0000 7fa45bc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 2024-09-12T18:05:18.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.502+0000 7fa45bc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:18.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.502+0000 7fa45bc4a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:18.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.502+0000 7fa45bc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:18.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.502+0000 7fa45bc4a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33, ofs0, ns] 2024-09-12T18:05:18.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.502+0000 7fa33cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 94265482745232 notifier 6980 bl.length()=911 2024-09-12T18:05:18.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.502+0000 7fa33cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:18.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.502+0000 7fa33cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:18.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.502+0000 7fa33cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:18.503 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.506+0000 7fa45bc4a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): orig_sources= new_sources= 2024-09-12T18:05:18.503 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.506+0000 7fa45bc4a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): potential sources added=[] removed=[] 2024-09-12T18:05:18.503 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.506+0000 7fa45bc4a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): orig_dests= new_dests= 2024-09-12T18:05:18.503 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.506+0000 7fa45bc4a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): potential dests added=[] removed=[] 2024-09-12T18:05:18.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.506+0000 7fa45bc4a9c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T18:05:18.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa45bc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:18.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa45bc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 2024-09-12T18:05:18.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa45bc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:18.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa45bc4a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:18.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa45bc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:18.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa45bc4a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33, ofs0, ns] 2024-09-12T18:05:18.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa33cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 94265482745232 notifier 6980 bl.length()=879 2024-09-12T18:05:18.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa33cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:18.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa33cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:18.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa33cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:18.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa45bc4a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): orig_sources= new_sources= 2024-09-12T18:05:18.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa45bc4a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): potential sources added=[] removed=[] 2024-09-12T18:05:18.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa45bc4a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): orig_dests= new_dests= 2024-09-12T18:05:18.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa45bc4a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): potential dests added=[] removed=[] 2024-09-12T18:05:18.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.514+0000 7fa45bc4a9c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T18:05:18.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.518+0000 7fa30f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:18.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.522+0000 7fa45bc4a9c0 20 remove_watcher() i=0 2024-09-12T18:05:18.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.522+0000 7fa45bc4a9c0 2 removed watcher, disabling cache 2024-09-12T18:05:18.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.526+0000 7fa45bc4a9c0 20 remove_watcher() i=1 2024-09-12T18:05:18.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.526+0000 7fa45bc4a9c0 20 remove_watcher() i=2 2024-09-12T18:05:18.527 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.530+0000 7fa45bc4a9c0 20 remove_watcher() i=3 2024-09-12T18:05:18.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.530+0000 7fa45bc4a9c0 20 remove_watcher() i=4 2024-09-12T18:05:18.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.534+0000 7fa45bc4a9c0 20 remove_watcher() i=5 2024-09-12T18:05:18.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.534+0000 7fa45bc4a9c0 20 remove_watcher() i=6 2024-09-12T18:05:18.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.534+0000 7fa45bc4a9c0 20 remove_watcher() i=7 2024-09-12T18:05:18.547 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T18:05:18.573 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:18.573 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:18.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.618+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 20 realm 2024-09-12T18:05:18.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:18.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:18.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:18.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.622+0000 7fb28def29c0 20 searching for the correct realm 2024-09-12T18:05:18.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.630+0000 7fb28c1f9640 0 -- 172.21.15.157:0/2358620558 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fb2740f1040 msgr2=0x7fb2740c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:18.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.846+0000 7fb28b9f8640 0 -- 172.21.15.157:0/2358620558 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55bf9222a430 msgr2=0x55bf9222c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:18.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.854+0000 7fb28def29c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:18.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.854+0000 7fb28def29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:18.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.854+0000 7fb28def29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:18.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.854+0000 7fb28def29c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:18.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.854+0000 7fb28def29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:18.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.854+0000 7fb28def29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:18.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.854+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.854+0000 7fb28def29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.854+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.854+0000 7fb28def29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:18.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.854+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:18.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 20 zone default found 2024-09-12T18:05:18.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 4 Realm: () 2024-09-12T18:05:18.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:18.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:18.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:18.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 20 zonegroup default 2024-09-12T18:05:18.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:18.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 20 started sync module instance, tier type = 2024-09-12T18:05:18.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.858+0000 7fb28def29c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:18.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.882+0000 7fb28def29c0 20 add_watcher() i=0 2024-09-12T18:05:18.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.882+0000 7fb28def29c0 20 add_watcher() i=1 2024-09-12T18:05:18.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.882+0000 7fb28def29c0 20 add_watcher() i=2 2024-09-12T18:05:18.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.882+0000 7fb28def29c0 20 add_watcher() i=3 2024-09-12T18:05:18.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.882+0000 7fb28def29c0 20 add_watcher() i=4 2024-09-12T18:05:18.879 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.882+0000 7fb28def29c0 20 add_watcher() i=5 2024-09-12T18:05:18.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.882+0000 7fb28def29c0 20 add_watcher() i=6 2024-09-12T18:05:18.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.882+0000 7fb28def29c0 20 add_watcher() i=7 2024-09-12T18:05:18.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.882+0000 7fb28def29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:18.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.886+0000 7fb1427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:18.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:18.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:18.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 5 note: GC not initialized 2024-09-12T18:05:18.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb1417e2640 20 reqs_thread_entry: start 2024-09-12T18:05:18.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:18.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 Filter name: none 2024-09-12T18:05:18.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb13a7fc640 20 reqs_thread_entry: start 2024-09-12T18:05:18.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:18.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:18.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:18.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:18.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:18.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:18.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.890+0000 7fb28def29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:18.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.894+0000 7fb1427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:18.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.898+0000 7fb28def29c0 20 remove_watcher() i=0 2024-09-12T18:05:18.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.898+0000 7fb28def29c0 2 removed watcher, disabling cache 2024-09-12T18:05:18.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.902+0000 7fb28def29c0 20 remove_watcher() i=1 2024-09-12T18:05:18.901 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.902+0000 7fb28def29c0 20 remove_watcher() i=2 2024-09-12T18:05:18.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.906+0000 7fb28def29c0 20 remove_watcher() i=3 2024-09-12T18:05:18.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.906+0000 7fb28def29c0 20 remove_watcher() i=4 2024-09-12T18:05:18.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.910+0000 7fb28def29c0 20 remove_watcher() i=5 2024-09-12T18:05:18.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.910+0000 7fb28def29c0 20 remove_watcher() i=6 2024-09-12T18:05:18.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:18.910+0000 7fb28def29c0 20 remove_watcher() i=7 2024-09-12T18:05:18.925 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:18.925 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:05:18.925 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-do-reshard id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:05:18.925 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:19.056 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:05:19.094 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:19.094 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:19.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.138+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.142+0000 7fa8a17be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.142+0000 7fa8a17be9c0 20 realm 2024-09-12T18:05:19.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.142+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.142+0000 7fa8a17be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.142+0000 7fa8a17be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:19.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.142+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.142+0000 7fa8a17be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.142+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.142+0000 7fa8a17be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:19.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.142+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.146+0000 7fa8a17be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:19.143 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.146+0000 7fa8a17be9c0 20 searching for the correct realm 2024-09-12T18:05:19.149 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.150+0000 7fa89fac5640 0 -- 172.21.15.157:0/3584781237 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fa89403a360 msgr2=0x7fa89406a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:19.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.366+0000 7fa89f2c4640 0 -- 172.21.15.157:0/3584781237 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55b56e598510 msgr2=0x55b56e59a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:19.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.374+0000 7fa8a17be9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:19.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.374+0000 7fa8a17be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:19.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.374+0000 7fa8a17be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:19.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.374+0000 7fa8a17be9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:19.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.374+0000 7fa8a17be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:19.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.374+0000 7fa8a17be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:19.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.374+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.374+0000 7fa8a17be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.374+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.374+0000 7fa8a17be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:19.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.374+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:19.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 20 zone default found 2024-09-12T18:05:19.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 4 Realm: () 2024-09-12T18:05:19.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:19.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:19.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:19.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 20 zonegroup default 2024-09-12T18:05:19.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 20 started sync module instance, tier type = 2024-09-12T18:05:19.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.378+0000 7fa8a17be9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:19.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.402+0000 7fa8a17be9c0 20 add_watcher() i=0 2024-09-12T18:05:19.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.402+0000 7fa8a17be9c0 20 add_watcher() i=1 2024-09-12T18:05:19.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.402+0000 7fa8a17be9c0 20 add_watcher() i=2 2024-09-12T18:05:19.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.402+0000 7fa8a17be9c0 20 add_watcher() i=3 2024-09-12T18:05:19.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.402+0000 7fa8a17be9c0 20 add_watcher() i=4 2024-09-12T18:05:19.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.402+0000 7fa8a17be9c0 20 add_watcher() i=5 2024-09-12T18:05:19.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.402+0000 7fa8a17be9c0 20 add_watcher() i=6 2024-09-12T18:05:19.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.402+0000 7fa8a17be9c0 20 add_watcher() i=7 2024-09-12T18:05:19.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.402+0000 7fa8a17be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:19.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.406+0000 7fa755fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:19.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.406+0000 7fa8a17be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:19.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.406+0000 7fa8a17be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:19.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.406+0000 7fa8a17be9c0 5 note: GC not initialized 2024-09-12T18:05:19.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa754fe1640 20 reqs_thread_entry: start 2024-09-12T18:05:19.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:19.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 20 Filter name: none 2024-09-12T18:05:19.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa6ce7fc640 20 reqs_thread_entry: start 2024-09-12T18:05:19.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T18:05:19.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:19.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T18:05:19.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T18:05:19.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 : miss 2024-09-12T18:05:19.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:19.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:19.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:19.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:19.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:19.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.410+0000 7fa8a17be9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 2024-09-12T18:05:19.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.418+0000 7fa8a17be9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:19.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.418+0000 7fa8a17be9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:19.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.418+0000 7fa8a17be9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:19.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.418+0000 7fa8a17be9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33, ofs0, ns] 2024-09-12T18:05:19.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.418+0000 7fa782ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94237728865104 notifier 7013 bl.length()=911 2024-09-12T18:05:19.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.418+0000 7fa782ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:19.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.418+0000 7fa782ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:19.417 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.418+0000 7fa782ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:19.418 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.422+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): orig_sources= new_sources= 2024-09-12T18:05:19.418 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.422+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): potential sources added=[] removed=[] 2024-09-12T18:05:19.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.422+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): orig_dests= new_dests= 2024-09-12T18:05:19.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.422+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): potential dests added=[] removed=[] 2024-09-12T18:05:19.421 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.422+0000 7fa8a17be9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33.1.0 2024-09-12T18:05:19.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.422+0000 7fa8a17be9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33.1.0 2024-09-12T18:05:19.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.422+0000 7fa8a17be9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33.1.1 2024-09-12T18:05:19.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.422+0000 7fa8a17be9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33.1.1 2024-09-12T18:05:19.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.422+0000 7fa8a17be9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33.0 2024-09-12T18:05:19.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.430+0000 7fa8a17be9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:19.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.430+0000 7fa8a17be9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 2024-09-12T18:05:19.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.430+0000 7fa8a17be9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:19.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.430+0000 7fa8a17be9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:19.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.430+0000 7fa8a17be9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:19.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.430+0000 7fa8a17be9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33, ofs0, ns] 2024-09-12T18:05:19.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.430+0000 7fa782ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 94237728865104 notifier 7013 bl.length()=911 2024-09-12T18:05:19.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.430+0000 7fa782ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:19.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.430+0000 7fa782ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:19.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.430+0000 7fa782ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:19.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.434+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): orig_sources= new_sources= 2024-09-12T18:05:19.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.434+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): potential sources added=[] removed=[] 2024-09-12T18:05:19.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.434+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): orig_dests= new_dests= 2024-09-12T18:05:19.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.434+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): potential dests added=[] removed=[] 2024-09-12T18:05:19.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.434+0000 7fa8a17be9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33.0 2024-09-12T18:05:19.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.434+0000 7fa8a17be9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:19.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.434+0000 7fa8a17be9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 2024-09-12T18:05:19.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa8a17be9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:19.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa8a17be9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:19.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa8a17be9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:19.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa8a17be9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33, ofs0, ns] 2024-09-12T18:05:19.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa7827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464294 cookie 94237728865104 notifier 7013 bl.length()=879 2024-09-12T18:05:19.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa7827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 info.flags=0x17 2024-09-12T18:05:19.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa7827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 to cache LRU end 2024-09-12T18:05:19.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa7827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:19.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): orig_sources= new_sources= 2024-09-12T18:05:19.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): potential sources added=[] removed=[] 2024-09-12T18:05:19.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): orig_dests= new_dests= 2024-09-12T18:05:19.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.438+0000 7fa8a17be9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33]): potential dests added=[] removed=[] 2024-09-12T18:05:19.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.442+0000 7fa8a17be9c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T18:05:19.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.446+0000 7fa755fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:19.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.450+0000 7fa8a17be9c0 20 remove_watcher() i=0 2024-09-12T18:05:19.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.450+0000 7fa8a17be9c0 2 removed watcher, disabling cache 2024-09-12T18:05:19.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.454+0000 7fa8a17be9c0 20 remove_watcher() i=1 2024-09-12T18:05:19.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.454+0000 7fa8a17be9c0 20 remove_watcher() i=2 2024-09-12T18:05:19.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.458+0000 7fa8a17be9c0 20 remove_watcher() i=3 2024-09-12T18:05:19.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.458+0000 7fa8a17be9c0 20 remove_watcher() i=4 2024-09-12T18:05:19.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.462+0000 7fa8a17be9c0 20 remove_watcher() i=5 2024-09-12T18:05:19.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.462+0000 7fa8a17be9c0 20 remove_watcher() i=6 2024-09-12T18:05:19.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.462+0000 7fa8a17be9c0 20 remove_watcher() i=7 2024-09-12T18:05:19.476 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T18:05:19.505 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:19.506 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:19.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.550+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 20 realm 2024-09-12T18:05:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:19.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:19.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.554+0000 7f3cde67e9c0 20 searching for the correct realm 2024-09-12T18:05:19.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.562+0000 7f3cdc985640 0 -- 172.21.15.157:0/3579067559 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f3cd010b530 msgr2=0x7f3cd00b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:19.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.778+0000 7f3cdc184640 0 -- 172.21.15.157:0/3579067559 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55ff2d99bcf0 msgr2=0x55ff2d99e0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:19.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.786+0000 7f3cde67e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:19.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.786+0000 7f3cde67e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:19.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.786+0000 7f3cde67e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:19.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.786+0000 7f3cde67e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:19.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.786+0000 7f3cde67e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:19.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.786+0000 7f3cde67e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:19.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.786+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.786+0000 7f3cde67e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.786+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.786+0000 7f3cde67e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:19.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.786+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 20 zone default found 2024-09-12T18:05:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 4 Realm: () 2024-09-12T18:05:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 20 zonegroup default 2024-09-12T18:05:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:19.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 20 started sync module instance, tier type = 2024-09-12T18:05:19.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.790+0000 7f3cde67e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:19.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.814+0000 7f3cde67e9c0 20 add_watcher() i=0 2024-09-12T18:05:19.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.814+0000 7f3cde67e9c0 20 add_watcher() i=1 2024-09-12T18:05:19.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.814+0000 7f3cde67e9c0 20 add_watcher() i=2 2024-09-12T18:05:19.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.814+0000 7f3cde67e9c0 20 add_watcher() i=3 2024-09-12T18:05:19.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.814+0000 7f3cde67e9c0 20 add_watcher() i=4 2024-09-12T18:05:19.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.814+0000 7f3cde67e9c0 20 add_watcher() i=5 2024-09-12T18:05:19.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.814+0000 7f3cde67e9c0 20 add_watcher() i=6 2024-09-12T18:05:19.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.814+0000 7f3cde67e9c0 20 add_watcher() i=7 2024-09-12T18:05:19.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.814+0000 7f3cde67e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:19.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.818+0000 7f3b92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:19.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3cde67e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:19.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3cde67e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:19.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3cde67e9c0 5 note: GC not initialized 2024-09-12T18:05:19.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3b91fdb640 20 reqs_thread_entry: start 2024-09-12T18:05:19.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3cde67e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:19.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3cde67e9c0 20 Filter name: none 2024-09-12T18:05:19.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3b037fe640 20 reqs_thread_entry: start 2024-09-12T18:05:19.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3cde67e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:19.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3cde67e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:19.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3cde67e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:19.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.822+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.826+0000 7f3cde67e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:19.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.826+0000 7f3cde67e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:19.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.826+0000 7f3cde67e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:19.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.826+0000 7f3cde67e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:19.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.826+0000 7f3b92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:19.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.834+0000 7f3cde67e9c0 20 remove_watcher() i=0 2024-09-12T18:05:19.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.834+0000 7f3cde67e9c0 2 removed watcher, disabling cache 2024-09-12T18:05:19.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.834+0000 7f3cde67e9c0 20 remove_watcher() i=1 2024-09-12T18:05:19.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.838+0000 7f3cde67e9c0 20 remove_watcher() i=2 2024-09-12T18:05:19.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.842+0000 7f3cde67e9c0 20 remove_watcher() i=3 2024-09-12T18:05:19.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.842+0000 7f3cde67e9c0 20 remove_watcher() i=4 2024-09-12T18:05:19.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.846+0000 7f3cde67e9c0 20 remove_watcher() i=5 2024-09-12T18:05:19.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.846+0000 7f3cde67e9c0 20 remove_watcher() i=6 2024-09-12T18:05:19.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:19.850+0000 7f3cde67e9c0 20 remove_watcher() i=7 2024-09-12T18:05:19.861 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:19.861 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:05:19.861 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-do-reshard id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:05:19.861 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:20.572 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T18:05:20.572 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:22.698 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T18:05:22.732 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:22.732 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:22.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.778+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:22.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 20 realm 2024-09-12T18:05:22.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:22.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:22.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:22.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:22.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:22.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.782+0000 7fae2f3e69c0 20 searching for the correct realm 2024-09-12T18:05:22.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.790+0000 7fae2c6eb640 0 -- 172.21.15.157:0/2321527639 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fae20031040 msgr2=0x7fae20071330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:22.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.798+0000 7fae2d6ed640 0 -- 172.21.15.157:0/2321527639 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fae20008040 msgr2=0x7fae200977f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:22.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.802+0000 7fae2f3e69c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:22.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.802+0000 7fae2f3e69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:22.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.802+0000 7fae2f3e69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:22.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.802+0000 7fae2f3e69c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:22.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.802+0000 7fae2f3e69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:22.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.802+0000 7fae2f3e69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:22.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.802+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.802+0000 7fae2f3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:22.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.802+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:22.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 zone default found 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 4 Realm: () 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 zonegroup default 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:22.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 started sync module instance, tier type = 2024-09-12T18:05:22.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.806+0000 7fae2f3e69c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:22.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.822+0000 7fae2f3e69c0 20 add_watcher() i=0 2024-09-12T18:05:22.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.822+0000 7fae2f3e69c0 20 add_watcher() i=1 2024-09-12T18:05:22.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.822+0000 7fae2f3e69c0 20 add_watcher() i=2 2024-09-12T18:05:22.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.822+0000 7fae2f3e69c0 20 add_watcher() i=3 2024-09-12T18:05:22.820 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.822+0000 7fae2f3e69c0 20 add_watcher() i=4 2024-09-12T18:05:22.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.822+0000 7fae2f3e69c0 20 add_watcher() i=5 2024-09-12T18:05:22.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.822+0000 7fae2f3e69c0 20 add_watcher() i=6 2024-09-12T18:05:22.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.822+0000 7fae2f3e69c0 20 add_watcher() i=7 2024-09-12T18:05:22.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.822+0000 7fae2f3e69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:22.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.826+0000 7face37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:22.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.826+0000 7fae2f3e69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:22.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.826+0000 7fae2f3e69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:22.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.826+0000 7fae2f3e69c0 5 note: GC not initialized 2024-09-12T18:05:22.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.826+0000 7face27e4640 20 reqs_thread_entry: start 2024-09-12T18:05:22.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.826+0000 7fae2f3e69c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:22.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.826+0000 7fae2f3e69c0 20 Filter name: none 2024-09-12T18:05:22.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.826+0000 7facdb7fe640 20 reqs_thread_entry: start 2024-09-12T18:05:22.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.826+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.830+0000 7fae2f3e69c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:22.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.830+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.830+0000 7fae2f3e69c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:22.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.830+0000 7fae2f3e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:22.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.830+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.830+0000 7fae2f3e69c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:22.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.830+0000 7fae2f3e69c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.830+0000 7fae2f3e69c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:22.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.830+0000 7fae2f3e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:22.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.830+0000 7face37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:22.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.838+0000 7fae2f3e69c0 20 remove_watcher() i=0 2024-09-12T18:05:22.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.838+0000 7fae2f3e69c0 2 removed watcher, disabling cache 2024-09-12T18:05:22.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.838+0000 7fae2f3e69c0 20 remove_watcher() i=1 2024-09-12T18:05:22.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.842+0000 7fae2f3e69c0 20 remove_watcher() i=2 2024-09-12T18:05:22.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.842+0000 7fae2f3e69c0 20 remove_watcher() i=3 2024-09-12T18:05:22.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.846+0000 7fae2f3e69c0 20 remove_watcher() i=4 2024-09-12T18:05:22.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.846+0000 7fae2f3e69c0 20 remove_watcher() i=5 2024-09-12T18:05:22.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.850+0000 7fae2f3e69c0 20 remove_watcher() i=6 2024-09-12T18:05:22.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.850+0000 7fae2f3e69c0 20 remove_watcher() i=7 2024-09-12T18:05:22.861 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:22.861 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:05:22.861 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-do-reshard id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:05:22.861 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:22.862 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:05:22.894 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:22.894 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:22.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:22.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 realm 2024-09-12T18:05:22.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:22.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:22.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:22.938 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:22.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:22.940 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:22.940 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 searching for the correct realm 2024-09-12T18:05:22.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:22.950+0000 7f7f59241640 0 -- 172.21.15.157:0/3658229273 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f7f4c03f060 msgr2=0x7f7f4c07a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:23.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.166+0000 7f7f58a40640 0 -- 172.21.15.157:0/3658229273 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5630bedb92d0 msgr2=0x5630bedbb6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:23.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:23.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:23.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:23.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:23.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:23.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:23.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:23.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:23.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 zone default found 2024-09-12T18:05:23.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 4 Realm: () 2024-09-12T18:05:23.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:23.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:23.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:23.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 zonegroup default 2024-09-12T18:05:23.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 started sync module instance, tier type = 2024-09-12T18:05:23.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:23.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=0 2024-09-12T18:05:23.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=1 2024-09-12T18:05:23.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=2 2024-09-12T18:05:23.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=3 2024-09-12T18:05:23.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=4 2024-09-12T18:05:23.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=5 2024-09-12T18:05:23.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=6 2024-09-12T18:05:23.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.206+0000 7f7f5af3a9c0 20 add_watcher() i=7 2024-09-12T18:05:23.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.206+0000 7f7f5af3a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:23.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7e0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:23.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:23.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:23.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 note: GC not initialized 2024-09-12T18:05:23.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7e0e7e4640 20 reqs_thread_entry: start 2024-09-12T18:05:23.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:23.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 Filter name: none 2024-09-12T18:05:23.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7e07fff640 20 reqs_thread_entry: start 2024-09-12T18:05:23.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:05:23.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:23.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:05:23.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:05:23.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 : miss 2024-09-12T18:05:23.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:23.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:23.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:23.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:23.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:23.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 2024-09-12T18:05:23.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:23.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:23.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:23.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34, ofs0, ns] 2024-09-12T18:05:23.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94767360541632 notifier 7064 bl.length()=911 2024-09-12T18:05:23.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:23.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:23.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:23.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_sources= new_sources= 2024-09-12T18:05:23.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential sources added=[] removed=[] 2024-09-12T18:05:23.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_dests= new_dests= 2024-09-12T18:05:23.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential dests added=[] removed=[] 2024-09-12T18:05:23.224 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7f5af3a9c0 time 2024-09-12T18:05:23.229673+0000 2024-09-12T18:05:23.224 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:23.227 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:23.227 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7f5e8142eb] 2024-09-12T18:05:23.227 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7f5e81449f] 2024-09-12T18:05:23.227 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630bd4690c1] 2024-09-12T18:05:23.227 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5630bd47b1fa] 2024-09-12T18:05:23.227 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:05:23.227 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7f5d67ad90] 2024-09-12T18:05:23.227 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:05:23.227 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:05:23.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.230+0000 7f7f5af3a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7f5af3a9c0 time 2024-09-12T18:05:23.229673+0000 2024-09-12T18:05:23.228 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:23.228 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.228 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:23.228 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7f5e8142eb] 2024-09-12T18:05:23.228 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7f5e81449f] 2024-09-12T18:05:23.228 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630bd4690c1] 2024-09-12T18:05:23.228 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5630bd47b1fa] 2024-09-12T18:05:23.228 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:05:23.228 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7f5d67ad90] 2024-09-12T18:05:23.228 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:05:23.228 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:05:23.229 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.229 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:05:23.229 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f7f5af3a9c0 thread_name:radosgw-admin 2024-09-12T18:05:23.235 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:23.235 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7f5d693520] 2024-09-12T18:05:23.235 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:05:23.235 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:05:23.235 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:05:23.235 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7f5e814345] 2024-09-12T18:05:23.235 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7f5e81449f] 2024-09-12T18:05:23.236 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630bd4690c1] 2024-09-12T18:05:23.236 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5630bd47b1fa] 2024-09-12T18:05:23.236 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:05:23.236 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7f5d67ad90] 2024-09-12T18:05:23.236 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:05:23.236 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:05:23.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.230+0000 7f7f5af3a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:05:23.236 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f7f5af3a9c0 thread_name:radosgw-admin 2024-09-12T18:05:23.236 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.236 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:23.236 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7f5d693520] 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7f5e814345] 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7f5e81449f] 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630bd4690c1] 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5630bd47b1fa] 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7f5d67ad90] 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:05:23.237 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:05:22.918+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:05:22.918+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:05:22.918+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_done global_id 7584 payload 274 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient: _finish_hunting 0 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:05:22.918+0000 7f7f5823f640 1 monclient: found mon.noname-a 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.238 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient: get_auth_request con 0x5630beb7ccc0 auth_method 0 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: dump: 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.239 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: _finish_auth 0 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: _check_auth_tickets 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: dump: 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.240 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 monclient: authenticate success, global_id 7584 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 4 set_mon_vals no callback set 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: shutdown 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) unregister_commands rotate-key 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: build_initial_monmap 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: monmap: 2024-09-12T18:05:23.241 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding auth protocol: cephx 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding auth protocol: cephx 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding auth protocol: cephx 2024-09-12T18:05:23.242 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.243 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.243 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.243 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.243 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.243 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.243 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.243 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.243 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.243 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.243 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.243 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.244 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.244 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 1 librados: starting msgr at 2024-09-12T18:05:23.244 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 1 librados: starting objecter 2024-09-12T18:05:23.244 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command objecter_requests hook 0x5630becd3270 2024-09-12T18:05:23.244 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 1 librados: setting wanted keys 2024-09-12T18:05:23.244 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 1 librados: calling monclient init 2024-09-12T18:05:23.244 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: init 2024-09-12T18:05:23.244 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding auth protocol: cephx 2024-09-12T18:05:23.244 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding auth protocol: cephx 2024-09-12T18:05:23.244 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding auth protocol: cephx 2024-09-12T18:05:23.244 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.245 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command rotate-key hook 0x5630beccc1e8 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-a con 0x5630beb7ccc0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-c con 0x5630bec117d0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-b con 0x5630bec14ce0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): authenticate will time out at 2485.143600s 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): get_auth_request con 0x5630beb7ccc0 auth_method 0 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.246 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): get_auth_request con 0x5630bec117d0 auth_method 0 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): handle_auth_done global_id 7587 payload 824 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:05:22.922+0000 7f7f58a40640 10 monclient: _finish_hunting 0 2024-09-12T18:05:23.247 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:05:22.922+0000 7f7f58a40640 1 monclient: found mon.noname-a 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:05:22.922+0000 7f7f58a40640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:05:22.922+0000 7f7f59241640 10 monclient: get_auth_request con 0x5630bec14ce0 auth_method 0 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: dump: 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.248 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: _finish_auth 0 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: _check_auth_tickets 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: dump: 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.249 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 5 monclient: authenticate success, global_id 7587 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:05:22.922+0000 7f7e46e0d640 4 set_mon_vals no callback set 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.250 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 1 librados: init done 2024-09-12T18:05:23.251 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:05:22.922+0000 7f7e4560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:23.251 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:05:22.922+0000 7f7e4560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.251 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:05:22.922+0000 7f7e4560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.251 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:05:22.922+0000 7f7f5823f640 10 monclient: get_auth_request con 0x7f7e40070ae0 auth_method 0 2024-09-12T18:05:23.251 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:05:22.922+0000 7f7f59241640 10 monclient: get_auth_request con 0x5630becfcd50 auth_method 0 2024-09-12T18:05:23.251 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:05:22.926+0000 7f7f58a40640 10 monclient: get_auth_request con 0x5630bed16e20 auth_method 0 2024-09-12T18:05:23.251 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:05:22.926+0000 7f7f5823f640 10 monclient: get_auth_request con 0x5630bed1b180 auth_method 0 2024-09-12T18:05:23.251 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 10 monclient: build_initial_monmap 2024-09-12T18:05:23.251 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:23.251 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 10 monclient: monmap: 2024-09-12T18:05:23.251 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding auth protocol: cephx 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding auth protocol: cephx 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding auth protocol: cephx 2024-09-12T18:05:23.252 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.253 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5630bed239f0 EEXIST 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 10 monclient: init 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding auth protocol: cephx 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding auth protocol: cephx 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding auth protocol: cephx 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.254 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command rotate-key cmddesc rotate-key hook 0x5630bed1e7b0 EEXIST 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-b con 0x5630bed47ba0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-a con 0x5630bed474d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:05:23.255 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-c con 0x5630bed45eb0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): authenticate will time out at 2485.152270s 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): get_auth_request con 0x5630bed474d0 auth_method 0 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): get_auth_request con 0x5630bed45eb0 auth_method 0 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.256 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.257 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.257 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.257 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.257 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.257 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.257 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.257 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): handle_auth_done global_id 7590 payload 824 2024-09-12T18:05:23.257 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient: _finish_hunting 0 2024-09-12T18:05:23.257 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:05:22.930+0000 7f7f5823f640 1 monclient: found mon.noname-a 2024-09-12T18:05:23.258 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.258 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.258 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:05:23.258 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: dump: 2024-09-12T18:05:23.258 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.258 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.258 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.258 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.258 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.258 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.258 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 monclient: authenticate success, global_id 7590 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: dump: 2024-09-12T18:05:23.259 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.260 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.260 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.260 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.260 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.260 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.260 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.260 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.260 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.260 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.260 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:05:22.930+0000 7f7f59a42640 4 set_mon_vals no callback set 2024-09-12T18:05:23.260 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:05:22.930+0000 7f7f58a40640 10 monclient: get_auth_request con 0x7f7e30070a20 auth_method 0 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: get_monmap_and_config 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: build_initial_monmap 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: monmap: 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:23.261 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding auth protocol: cephx 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding auth protocol: cephx 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding auth protocol: cephx 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.262 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.263 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.263 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.263 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.263 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.263 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.263 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.263 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.263 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.263 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.263 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.263 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: init 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding auth protocol: cephx 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding auth protocol: cephx 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding auth protocol: cephx 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.264 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe1236cd38 EEXIST 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-c con 0x5630beda0ef0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-b con 0x5630bed6b240 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-a con 0x5630bed973e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:05:23.265 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): authenticate will time out at 2485.156400s 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): get_auth_request con 0x5630beda0ef0 auth_method 0 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): get_auth_request con 0x5630bed973e0 auth_method 0 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.266 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_done global_id 7061 payload 274 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient: _finish_hunting 0 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:05:22.934+0000 7f7f58a40640 1 monclient: found mon.noname-c 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: dump: 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.267 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.268 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.268 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.268 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.268 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.268 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.268 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.268 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.268 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.268 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: _finish_auth 0 2024-09-12T18:05:23.268 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: _check_auth_tickets 2024-09-12T18:05:23.268 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: dump: 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.269 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 monclient: authenticate success, global_id 7061 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 4 set_mon_vals no callback set 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: shutdown 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: build_initial_monmap 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: monmap: 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:05:23.270 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding auth protocol: cephx 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding auth protocol: cephx 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding auth protocol: cephx 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.271 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.272 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.272 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.272 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.272 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.272 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.272 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.272 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.272 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 librados: starting msgr at 2024-09-12T18:05:23.272 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 librados: starting objecter 2024-09-12T18:05:23.272 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5630bed9bd50 EEXIST 2024-09-12T18:05:23.272 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 librados: setting wanted keys 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 librados: calling monclient init 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: init 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding auth protocol: cephx 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding auth protocol: cephx 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding auth protocol: cephx 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.273 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command rotate-key cmddesc rotate-key hook 0x5630bed49b08 EEXIST 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-a con 0x5630bed6b240 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-c con 0x5630bed973e0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-b con 0x5630beda0ef0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:05:23.274 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): authenticate will time out at 2485.158933s 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): get_auth_request con 0x5630bed973e0 auth_method 0 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): get_auth_request con 0x5630bed6b240 auth_method 0 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.275 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): handle_auth_done global_id 7064 payload 824 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient: _finish_hunting 0 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:05:22.934+0000 7f7f5823f640 1 monclient: found mon.noname-c 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: dump: 2024-09-12T18:05:23.276 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.277 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: dump: 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 monclient: authenticate success, global_id 7064 2024-09-12T18:05:23.278 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.279 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 4 set_mon_vals no callback set 2024-09-12T18:05:23.279 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:05:23.279 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.279 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:05:23.279 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 librados: init done 2024-09-12T18:05:23.279 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command cr dump hook 0x5630bed69818 2024-09-12T18:05:23.279 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.279 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:05:22.938+0000 7f7e2e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:23.279 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:05:22.938+0000 7f7e2e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.279 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:05:22.938+0000 7f7e2e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.279 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:05:22.938+0000 7f7f58a40640 10 monclient: get_auth_request con 0x7f7e24070ae0 auth_method 0 2024-09-12T18:05:23.280 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:05:22.938+0000 7f7f59241640 10 monclient: get_auth_request con 0x5630bedb4ec0 auth_method 0 2024-09-12T18:05:23.280 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.280 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 realm 2024-09-12T18:05:23.280 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.280 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.280 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:23.280 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.280 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.280 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.280 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:05:22.938+0000 7f7f58a40640 10 monclient: get_auth_request con 0x5630bedb92d0 auth_method 0 2024-09-12T18:05:23.280 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:23.281 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.281 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:05:22.942+0000 7f7f5823f640 10 monclient: get_auth_request con 0x5630bedbc9f0 auth_method 0 2024-09-12T18:05:23.281 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:23.281 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 searching for the correct realm 2024-09-12T18:05:23.281 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:05:22.942+0000 7f7f59241640 10 monclient: get_auth_request con 0x5630bedc1750 auth_method 0 2024-09-12T18:05:23.281 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:05:22.942+0000 7f7f58a40640 10 monclient: get_auth_request con 0x7f7f50020040 auth_method 0 2024-09-12T18:05:23.281 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:05:22.946+0000 7f7f5823f640 10 monclient: get_auth_request con 0x7f7f4c07ec20 auth_method 0 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:05:22.950+0000 7f7f59241640 10 monclient: get_auth_request con 0x7f7f4c03f060 auth_method 0 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:05:22.950+0000 7f7f59241640 0 -- 172.21.15.157:0/3658229273 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f7f4c03f060 msgr2=0x7f7f4c07a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:05:23.154+0000 7f7f59241640 10 monclient: get_auth_request con 0x7f7f4c03f060 auth_method 0 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:05:23.158+0000 7f7f58a40640 10 monclient: get_auth_request con 0x7f7f4c01e040 auth_method 0 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:05:23.166+0000 7f7f58a40640 0 -- 172.21.15.157:0/3658229273 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5630bedb92d0 msgr2=0x5630bedbb6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:05:23.166+0000 7f7e2e7fc640 1 client.7064.objecter ms_handle_reset 0x5630bedb92d0 session 0x5630bedb8120 osd.5 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:05:23.166+0000 7f7e2e7fc640 10 monclient: _renew_subs 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:05:23.166+0000 7f7e2e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:05:23.166+0000 7f7f58a40640 10 monclient: get_auth_request con 0x7f7e24080900 auth_method 0 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:23.282 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:23.283 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:23.283 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:23.283 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:23.283 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.283 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.283 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.283 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:23.283 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.283 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:23.283 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 zone default found 2024-09-12T18:05:23.284 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 4 Realm: () 2024-09-12T18:05:23.284 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:23.284 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:23.284 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:23.284 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 zonegroup default 2024-09-12T18:05:23.284 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.284 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.284 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.284 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.284 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.284 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 started sync module instance, tier type = 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=0 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=1 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=2 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=3 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=4 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=5 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=6 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:05:23.206+0000 7f7f5af3a9c0 20 add_watcher() i=7 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:05:23.206+0000 7f7f5af3a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding auth protocol: cephx 2024-09-12T18:05:23.285 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding auth protocol: cephx 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding auth protocol: cephx 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:05:23.210+0000 7f7e0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.286 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command cache list hook 0x5630bed9ef80 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command cache inspect hook 0x5630bed9ef80 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command cache erase hook 0x5630bed9ef80 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command cache zap hook 0x5630bed9ef80 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 note: GC not initialized 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:05:23.210+0000 7f7e0e7e4640 20 reqs_thread_entry: start 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command sync trace show hook 0x7f7f50004670 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command sync trace history hook 0x7f7f50004670 2024-09-12T18:05:23.287 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command sync trace active hook 0x7f7f50004670 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command sync trace active_short hook 0x7f7f50004670 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 Filter name: none 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:05:23.210+0000 7f7e07fff640 20 reqs_thread_entry: start 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 : miss 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:23.288 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34, ofs0, ns] 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94767360541632 notifier 7064 bl.length()=911 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_sources= new_sources= 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential sources added=[] removed=[] 2024-09-12T18:05:23.289 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_dests= new_dests= 2024-09-12T18:05:23.290 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential dests added=[] removed=[] 2024-09-12T18:05:23.290 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:05:23.230+0000 7f7f5af3a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7f5af3a9c0 time 2024-09-12T18:05:23.229673+0000 2024-09-12T18:05:23.290 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:23.290 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.290 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:23.290 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7f5e8142eb] 2024-09-12T18:05:23.290 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7f5e81449f] 2024-09-12T18:05:23.290 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630bd4690c1] 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5630bd47b1fa] 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7f5d67ad90] 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:05:23.230+0000 7f7f5af3a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f7f5af3a9c0 thread_name:radosgw-admin 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7f5d693520] 2024-09-12T18:05:23.291 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:05:23.292 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:05:23.292 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:05:23.292 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7f5e814345] 2024-09-12T18:05:23.292 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7f5e81449f] 2024-09-12T18:05:23.292 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630bd4690c1] 2024-09-12T18:05:23.292 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5630bd47b1fa] 2024-09-12T18:05:23.292 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:05:23.292 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7f5d67ad90] 2024-09-12T18:05:23.292 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:05:23.292 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:05:23.292 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:05:23.293 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:05:23.294 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:05:23.295 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:05:23.295 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:05:23.295 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:05:23.295 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:05:23.295 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:05:23.295 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:05:23.295 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:05:23.295 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:05:23.295 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:05:23.295 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:05:23.295 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:05:23.296 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:05:23.297 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:05:23.297 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:05:23.297 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:05:23.297 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:05:23.297 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:05:23.297 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:05:23.297 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:05:23.297 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:05:23.297 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:05:23.297 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:05:23.298 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:05:23.299 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e07fff640 / http_manager 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e0e7e4640 / http_manager 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e0f7e6640 / rgw_dt_lg_renew 2024-09-12T18:05:23.300 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e2e7fc640 / ms_dispatch 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e2ffff640 / io_context_pool 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e3e7fc640 / ms_dispatch 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e4560a640 / ms_dispatch 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e46e0d640 / io_context_pool 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f5823f640 / msgr-worker-2 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f58a40640 / msgr-worker-1 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f59241640 / msgr-worker-0 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f59a42640 / io_context_pool 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f5af3a9c0 / radosgw-admin 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:05:23.301 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.118197.log 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:05:22.918+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:05:22.918+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:05:22.918+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_done global_id 7584 payload 274 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient: _finish_hunting 0 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:05:22.918+0000 7f7f5823f640 1 monclient: found mon.noname-a 2024-09-12T18:05:23.302 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient: get_auth_request con 0x5630beb7ccc0 auth_method 0 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: dump: 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.303 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: _finish_auth 0 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: _check_auth_tickets 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:05:22.918+0000 7f7e46e0d640 10 monclient: dump: 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.304 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 monclient: authenticate success, global_id 7584 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 4 set_mon_vals no callback set 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: shutdown 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) unregister_commands rotate-key 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: build_initial_monmap 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: monmap: 2024-09-12T18:05:23.305 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding auth protocol: cephx 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding auth protocol: cephx 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding auth protocol: cephx 2024-09-12T18:05:23.306 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: crc 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630becd16b0) adding con mode: secure 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.307 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 1 librados: starting msgr at 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 1 librados: starting objecter 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command objecter_requests hook 0x5630becd3270 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 1 librados: setting wanted keys 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 1 librados: calling monclient init 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: init 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding auth protocol: cephx 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding auth protocol: cephx 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding auth protocol: cephx 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.308 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: crc 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630beccc0a0) adding con mode: secure 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command rotate-key hook 0x5630beccc1e8 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-a con 0x5630beb7ccc0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:05:23.309 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-c con 0x5630bec117d0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-b con 0x5630bec14ce0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:05:22.918+0000 7f7f5af3a9c0 10 monclient(hunting): authenticate will time out at 2485.143600s 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): get_auth_request con 0x5630beb7ccc0 auth_method 0 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): get_auth_request con 0x5630bec117d0 auth_method 0 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.310 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:05:22.918+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:05:22.918+0000 7f7f58a40640 10 monclient(hunting): handle_auth_done global_id 7587 payload 824 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:05:22.922+0000 7f7f58a40640 10 monclient: _finish_hunting 0 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:05:22.922+0000 7f7f58a40640 1 monclient: found mon.noname-a 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:05:22.922+0000 7f7f58a40640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:05:22.922+0000 7f7f59241640 10 monclient: get_auth_request con 0x5630bec14ce0 auth_method 0 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:05:23.311 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: dump: 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: _finish_auth 0 2024-09-12T18:05:23.312 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: _check_auth_tickets 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:05:22.922+0000 7f7e4560a640 10 monclient: dump: 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.313 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.314 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.314 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.314 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 5 monclient: authenticate success, global_id 7587 2024-09-12T18:05:23.314 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.314 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:05:22.922+0000 7f7e46e0d640 4 set_mon_vals no callback set 2024-09-12T18:05:23.314 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.314 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.314 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.314 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:05:22.922+0000 7f7f5af3a9c0 1 librados: init done 2024-09-12T18:05:23.314 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:05:22.922+0000 7f7e4560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:23.314 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:05:22.922+0000 7f7e4560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:05:22.922+0000 7f7e4560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:05:22.922+0000 7f7f5823f640 10 monclient: get_auth_request con 0x7f7e40070ae0 auth_method 0 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:05:22.922+0000 7f7f59241640 10 monclient: get_auth_request con 0x5630becfcd50 auth_method 0 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:05:22.926+0000 7f7f58a40640 10 monclient: get_auth_request con 0x5630bed16e20 auth_method 0 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:05:22.926+0000 7f7f5823f640 10 monclient: get_auth_request con 0x5630bed1b180 auth_method 0 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 10 monclient: build_initial_monmap 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 10 monclient: monmap: 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:05:23.315 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:05:23.316 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:23.316 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.316 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:05:23.316 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:05:23.316 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:05:23.316 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.316 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding auth protocol: cephx 2024-09-12T18:05:23.316 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding auth protocol: cephx 2024-09-12T18:05:23.316 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding auth protocol: cephx 2024-09-12T18:05:23.316 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.316 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: crc 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed20040) adding con mode: secure 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.317 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5630bed239f0 EEXIST 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 10 monclient: init 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding auth protocol: cephx 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding auth protocol: cephx 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding auth protocol: cephx 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.318 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: crc 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed1e668) adding con mode: secure 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:05:22.926+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command rotate-key cmddesc rotate-key hook 0x5630bed1e7b0 EEXIST 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-b con 0x5630bed47ba0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-a con 0x5630bed474d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-c con 0x5630bed45eb0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:05:23.319 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.320 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.320 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.320 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:23.320 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient(hunting): authenticate will time out at 2485.152270s 2024-09-12T18:05:23.320 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): get_auth_request con 0x5630bed474d0 auth_method 0 2024-09-12T18:05:23.320 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.320 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.320 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.320 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): get_auth_request con 0x5630bed45eb0 auth_method 0 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:05:22.930+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient(hunting): handle_auth_done global_id 7590 payload 824 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient: _finish_hunting 0 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:05:22.930+0000 7f7f5823f640 1 monclient: found mon.noname-a 2024-09-12T18:05:23.321 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:05:22.930+0000 7f7f5823f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.322 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.322 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:05:23.322 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: dump: 2024-09-12T18:05:23.322 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.322 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.322 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.322 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.322 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.322 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.323 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.323 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.323 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.323 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.323 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:05:23.323 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:05:23.323 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 monclient: authenticate success, global_id 7590 2024-09-12T18:05:23.323 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.323 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.323 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:23.323 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 10 monclient: dump: 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.324 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:05:22.930+0000 7f7f59a42640 4 set_mon_vals no callback set 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:05:22.930+0000 7f7e3e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:05:22.930+0000 7f7f58a40640 10 monclient: get_auth_request con 0x7f7e30070a20 auth_method 0 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: get_monmap_and_config 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: build_initial_monmap 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: monmap: 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:05:23.325 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding auth protocol: cephx 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding auth protocol: cephx 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding auth protocol: cephx 2024-09-12T18:05:23.326 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.327 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.327 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.327 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.327 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.327 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.327 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.327 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.327 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.327 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: crc 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed673b0) adding con mode: secure 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 10 monclient: init 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding auth protocol: cephx 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding auth protocol: cephx 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding auth protocol: cephx 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.328 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: crc 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:05:22.930+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236cbf0) adding con mode: secure 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe1236cd38 EEXIST 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:05:23.329 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-c con 0x5630beda0ef0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-b con 0x5630bed6b240 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-a con 0x5630bed973e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): authenticate will time out at 2485.156400s 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): get_auth_request con 0x5630beda0ef0 auth_method 0 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.330 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): get_auth_request con 0x5630bed973e0 auth_method 0 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:05:22.934+0000 7f7f59241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_done global_id 7061 payload 274 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient: _finish_hunting 0 2024-09-12T18:05:23.331 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:05:22.934+0000 7f7f58a40640 1 monclient: found mon.noname-c 2024-09-12T18:05:23.332 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:05:23.332 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.332 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:23.332 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: dump: 2024-09-12T18:05:23.332 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.332 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.332 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.332 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.332 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.332 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.332 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: _finish_auth 0 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: _check_auth_tickets 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 10 monclient: dump: 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.333 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 monclient: authenticate success, global_id 7061 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 4 set_mon_vals no callback set 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: shutdown 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: build_initial_monmap 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:23.334 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: monmap: 2024-09-12T18:05:23.335 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:05:23.335 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:23.335 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:05:23.335 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:05:23.335 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:23.335 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.335 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:05:23.335 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:05:23.335 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:05:23.335 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.336 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding auth protocol: cephx 2024-09-12T18:05:23.336 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding auth protocol: cephx 2024-09-12T18:05:23.336 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding auth protocol: cephx 2024-09-12T18:05:23.336 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.336 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.336 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.336 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.336 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.336 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.336 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.336 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: crc 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed97ab0) adding con mode: secure 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 librados: starting msgr at 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 librados: starting objecter 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5630bed9bd50 EEXIST 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 librados: setting wanted keys 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 librados: calling monclient init 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: init 2024-09-12T18:05:23.337 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding auth protocol: cephx 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding auth protocol: cephx 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding auth protocol: cephx 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.338 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: crc 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 AuthRegistry(0x5630bed499c0) adding con mode: secure 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command rotate-key cmddesc rotate-key hook 0x5630bed49b08 EEXIST 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-a con 0x5630bed6b240 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-c con 0x5630bed973e0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): picked mon.noname-b con 0x5630beda0ef0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.339 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:23.340 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:23.340 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient(hunting): authenticate will time out at 2485.158933s 2024-09-12T18:05:23.340 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): get_auth_request con 0x5630bed973e0 auth_method 0 2024-09-12T18:05:23.340 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.340 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.340 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.340 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): get_auth_request con 0x5630bed6b240 auth_method 0 2024-09-12T18:05:23.340 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:23.340 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:23.340 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:05:22.934+0000 7f7f58a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient(hunting): handle_auth_done global_id 7064 payload 824 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient: _finish_hunting 0 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:05:22.934+0000 7f7f5823f640 1 monclient: found mon.noname-c 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:05:22.934+0000 7f7f5823f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.341 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:23.342 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: dump: 2024-09-12T18:05:23.342 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.342 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.342 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.342 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.342 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.342 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.342 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.342 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.342 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.342 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:05:22.934+0000 7f7e2e7fc640 10 monclient: dump: 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:05:23.343 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 monclient: authenticate success, global_id 7064 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:05:22.934+0000 7f7e2ffff640 4 set_mon_vals no callback set 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _renew_subs 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 1 librados: init done 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:05:22.934+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command cr dump hook 0x5630bed69818 2024-09-12T18:05:23.344 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:05:22.938+0000 7f7e2e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:05:22.938+0000 7f7e2e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:05:22.938+0000 7f7e2e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:05:22.938+0000 7f7f58a40640 10 monclient: get_auth_request con 0x7f7e24070ae0 auth_method 0 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:05:22.938+0000 7f7f59241640 10 monclient: get_auth_request con 0x5630bedb4ec0 auth_method 0 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 realm 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.345 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.346 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:05:22.938+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.346 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:05:22.938+0000 7f7f58a40640 10 monclient: get_auth_request con 0x5630bedb92d0 auth_method 0 2024-09-12T18:05:23.346 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:23.346 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.346 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:05:22.942+0000 7f7f5823f640 10 monclient: get_auth_request con 0x5630bedbc9f0 auth_method 0 2024-09-12T18:05:23.346 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:23.346 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:05:22.942+0000 7f7f5af3a9c0 20 searching for the correct realm 2024-09-12T18:05:23.346 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:05:22.942+0000 7f7f59241640 10 monclient: get_auth_request con 0x5630bedc1750 auth_method 0 2024-09-12T18:05:23.346 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:05:22.942+0000 7f7f58a40640 10 monclient: get_auth_request con 0x7f7f50020040 auth_method 0 2024-09-12T18:05:23.346 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:05:22.946+0000 7f7f5823f640 10 monclient: get_auth_request con 0x7f7f4c07ec20 auth_method 0 2024-09-12T18:05:23.346 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:05:22.950+0000 7f7f59241640 10 monclient: get_auth_request con 0x7f7f4c03f060 auth_method 0 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:05:22.950+0000 7f7f59241640 0 -- 172.21.15.157:0/3658229273 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f7f4c03f060 msgr2=0x7f7f4c07a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:05:23.154+0000 7f7f59241640 10 monclient: get_auth_request con 0x7f7f4c03f060 auth_method 0 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:05:23.158+0000 7f7f58a40640 10 monclient: get_auth_request con 0x7f7f4c01e040 auth_method 0 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:05:23.166+0000 7f7f58a40640 0 -- 172.21.15.157:0/3658229273 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5630bedb92d0 msgr2=0x5630bedbb6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:05:23.166+0000 7f7e2e7fc640 1 client.7064.objecter ms_handle_reset 0x5630bedb92d0 session 0x5630bedb8120 osd.5 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:05:23.166+0000 7f7e2e7fc640 10 monclient: _renew_subs 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:05:23.166+0000 7f7e2e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:05:23.166+0000 7f7f58a40640 10 monclient: get_auth_request con 0x7f7e24080900 auth_method 0 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:23.347 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 zone default found 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 4 Realm: () 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:23.348 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 zonegroup default 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:05:23.174+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 started sync module instance, tier type = 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:05:23.178+0000 7f7f5af3a9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=0 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=1 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=2 2024-09-12T18:05:23.349 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=3 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=4 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=5 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:05:23.202+0000 7f7f5af3a9c0 20 add_watcher() i=6 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:05:23.206+0000 7f7f5af3a9c0 20 add_watcher() i=7 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:05:23.206+0000 7f7f5af3a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding auth protocol: cephx 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding auth protocol: cephx 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding auth protocol: cephx 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.350 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.351 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:05:23.210+0000 7f7e0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:23.351 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.351 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.351 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.351 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.351 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.351 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.351 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: crc 2024-09-12T18:05:23.351 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 AuthRegistry(0x7ffe1236d0c0) adding con mode: secure 2024-09-12T18:05:23.351 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:23.351 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:23.352 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:23.352 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command cache list hook 0x5630bed9ef80 2024-09-12T18:05:23.352 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command cache inspect hook 0x5630bed9ef80 2024-09-12T18:05:23.352 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command cache erase hook 0x5630bed9ef80 2024-09-12T18:05:23.352 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command cache zap hook 0x5630bed9ef80 2024-09-12T18:05:23.352 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 note: GC not initialized 2024-09-12T18:05:23.352 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:05:23.210+0000 7f7e0e7e4640 20 reqs_thread_entry: start 2024-09-12T18:05:23.352 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command sync trace show hook 0x7f7f50004670 2024-09-12T18:05:23.352 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command sync trace history hook 0x7f7f50004670 2024-09-12T18:05:23.352 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command sync trace active hook 0x7f7f50004670 2024-09-12T18:05:23.352 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 5 asok(0x5630beabf2b0) register_command sync trace active_short hook 0x7f7f50004670 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 Filter name: none 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:05:23.210+0000 7f7e07fff640 20 reqs_thread_entry: start 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 : miss 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:05:23.210+0000 7f7f5af3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:23.353 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:05:23.214+0000 7f7f5af3a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:05:23.218+0000 7f7f5af3a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34, ofs0, ns] 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94767360541632 notifier 7064 bl.length()=911 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:23.354 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:05:23.222+0000 7f7e2ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_sources= new_sources= 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential sources added=[] removed=[] 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_dests= new_dests= 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:05:23.222+0000 7f7f5af3a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential dests added=[] removed=[] 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:05:23.230+0000 7f7f5af3a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7f5af3a9c0 time 2024-09-12T18:05:23.229673+0000 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7f5e8142eb] 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7f5e81449f] 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630bd4690c1] 2024-09-12T18:05:23.355 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5630bd47b1fa] 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7f5d67ad90] 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:05:23.230+0000 7f7f5af3a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f7f5af3a9c0 thread_name:radosgw-admin 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7f5d693520] 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:05:23.356 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7f5e814345] 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7f5e81449f] 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630bd4690c1] 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5630bd47b1fa] 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7f5d67ad90] 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.357 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:05:23.358 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:05:23.359 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:05:23.360 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:05:23.361 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:05:23.361 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:05:23.361 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:05:23.361 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:05:23.361 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:05:23.361 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:05:23.361 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:05:23.361 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:05:23.361 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:05:23.361 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:05:23.362 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:05:23.363 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:05:23.364 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e07fff640 / http_manager 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e0e7e4640 / http_manager 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e0f7e6640 / rgw_dt_lg_renew 2024-09-12T18:05:23.365 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e2e7fc640 / ms_dispatch 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e2ffff640 / io_context_pool 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e3e7fc640 / ms_dispatch 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e4560a640 / ms_dispatch 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7e46e0d640 / io_context_pool 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f5823f640 / msgr-worker-2 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f58a40640 / msgr-worker-1 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f59241640 / msgr-worker-0 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f59a42640 / io_context_pool 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: 7f7f5af3a9c0 / radosgw-admin 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:05:23.366 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:05:23.233071Z_220a552c-f218-4619-a799-f8d0ee3086ab/log 2024-09-12T18:05:23.367 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:05:23.371 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:05:23.371 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T18:05:23.371 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:23.371 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:23.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.314+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 20 realm 2024-09-12T18:05:23.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.371 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.318+0000 7f1488f729c0 20 searching for the correct realm 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.326+0000 7f147ffff640 0 -- 172.21.15.157:0/4006609419 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f147004a040 msgr2=0x7f1470031420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.330+0000 7f147ffff640 0 -- 172.21.15.157:0/4006609419 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f1350080900 msgr2=0x7f1350082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:23.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 zone default found 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 4 Realm: () 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:23.373 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 zonegroup default 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 started sync module instance, tier type = 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.338+0000 7f1488f729c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.358+0000 7f1488f729c0 20 add_watcher() i=0 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.358+0000 7f1488f729c0 20 add_watcher() i=1 2024-09-12T18:05:23.374 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.358+0000 7f1488f729c0 20 add_watcher() i=2 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.358+0000 7f1488f729c0 20 add_watcher() i=3 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.358+0000 7f1488f729c0 20 add_watcher() i=4 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.358+0000 7f1488f729c0 20 add_watcher() i=5 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.358+0000 7f1488f729c0 20 add_watcher() i=6 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.358+0000 7f1488f729c0 20 add_watcher() i=7 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.358+0000 7f1488f729c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.362+0000 7f133d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.362+0000 7f1488f729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.362+0000 7f1488f729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.362+0000 7f1488f729c0 5 note: GC not initialized 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.362+0000 7f12b7fff640 20 reqs_thread_entry: start 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.362+0000 7f1488f729c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:23.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.362+0000 7f1488f729c0 20 Filter name: none 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.362+0000 7f12b5ffb640 20 reqs_thread_entry: start 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.362+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.366+0000 7f1488f729c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.366+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.366+0000 7f1488f729c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.366+0000 7f1488f729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.366+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.366+0000 7f1488f729c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.366+0000 7f1488f729c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.366+0000 7f1488f729c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.366+0000 7f1488f729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.366+0000 7f133d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:23.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.370+0000 7f1488f729c0 20 remove_watcher() i=0 2024-09-12T18:05:23.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.370+0000 7f1488f729c0 2 removed watcher, disabling cache 2024-09-12T18:05:23.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.374+0000 7f1488f729c0 20 remove_watcher() i=1 2024-09-12T18:05:23.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.378+0000 7f1488f729c0 20 remove_watcher() i=2 2024-09-12T18:05:23.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.382+0000 7f1488f729c0 20 remove_watcher() i=3 2024-09-12T18:05:23.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.386+0000 7f1488f729c0 20 remove_watcher() i=4 2024-09-12T18:05:23.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.386+0000 7f1488f729c0 20 remove_watcher() i=5 2024-09-12T18:05:23.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.386+0000 7f1488f729c0 20 remove_watcher() i=6 2024-09-12T18:05:23.386 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.386+0000 7f1488f729c0 20 remove_watcher() i=7 2024-09-12T18:05:23.399 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.400 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:05:23.400 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-do-reshard id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:05:23.400 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:23.496 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:05:23.530 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:23.531 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:23.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.574+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.574+0000 7f5a0ed179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.574+0000 7f5a0ed179c0 20 realm 2024-09-12T18:05:23.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.574+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.574+0000 7f5a0ed179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.574+0000 7f5a0ed179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:23.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.574+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.574+0000 7f5a0ed179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.574+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.575 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.578+0000 7f5a0ed179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:23.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.578+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.578+0000 7f5a0ed179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:23.576 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.578+0000 7f5a0ed179c0 20 searching for the correct realm 2024-09-12T18:05:23.583 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.586+0000 7f5a0d01e640 0 -- 172.21.15.157:0/30896765 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f5a00008050 msgr2=0x7f5a00065960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:23.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.802+0000 7f5a0c81d640 0 -- 172.21.15.157:0/30896765 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x56043ed8de90 msgr2=0x56043ed902c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:23.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.810+0000 7f5a0ed179c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:23.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.810+0000 7f5a0ed179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:23.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.810+0000 7f5a0ed179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:23.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.810+0000 7f5a0ed179c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:23.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.810+0000 7f5a0ed179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:23.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.810+0000 7f5a0ed179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:23.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.810+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.810+0000 7f5a0ed179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.810+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.810+0000 7f5a0ed179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:23.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.810+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:23.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 20 zone default found 2024-09-12T18:05:23.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 4 Realm: () 2024-09-12T18:05:23.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:23.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:23.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:23.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 20 zonegroup default 2024-09-12T18:05:23.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:23.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 20 started sync module instance, tier type = 2024-09-12T18:05:23.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.814+0000 7f5a0ed179c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:23.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.838+0000 7f5a0ed179c0 20 add_watcher() i=0 2024-09-12T18:05:23.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.838+0000 7f5a0ed179c0 20 add_watcher() i=1 2024-09-12T18:05:23.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.838+0000 7f5a0ed179c0 20 add_watcher() i=2 2024-09-12T18:05:23.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.838+0000 7f5a0ed179c0 20 add_watcher() i=3 2024-09-12T18:05:23.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.838+0000 7f5a0ed179c0 20 add_watcher() i=4 2024-09-12T18:05:23.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.838+0000 7f5a0ed179c0 20 add_watcher() i=5 2024-09-12T18:05:23.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.838+0000 7f5a0ed179c0 20 add_watcher() i=6 2024-09-12T18:05:23.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.842+0000 7f5a0ed179c0 20 add_watcher() i=7 2024-09-12T18:05:23.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.842+0000 7f5a0ed179c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:23.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.846+0000 7f58c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:23.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.846+0000 7f5a0ed179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:23.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.846+0000 7f5a0ed179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:23.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.846+0000 7f5a0ed179c0 5 note: GC not initialized 2024-09-12T18:05:23.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.846+0000 7f58c1fe3640 20 reqs_thread_entry: start 2024-09-12T18:05:23.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.846+0000 7f5a0ed179c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:23.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.846+0000 7f5a0ed179c0 20 Filter name: none 2024-09-12T18:05:23.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.846+0000 7f58337fe640 20 reqs_thread_entry: start 2024-09-12T18:05:23.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.846+0000 7f5a0ed179c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:05:23.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.846+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.850+0000 7f5a0ed179c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:23.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.850+0000 7f5a0ed179c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:05:23.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.850+0000 7f5a0ed179c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:05:23.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.850+0000 7f5a0ed179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 : miss 2024-09-12T18:05:23.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.850+0000 7f5a0ed179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:23.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.850+0000 7f5a0ed179c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:05:23.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.850+0000 7f5a0ed179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:23.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.850+0000 7f5a0ed179c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:23.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.850+0000 7f5a0ed179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:23.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.850+0000 7f5a0ed179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:23.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.850+0000 7f5a0ed179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 2024-09-12T18:05:23.850 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.854+0000 7f5a0ed179c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to be held by another RGW process; skipping for now 2024-09-12T18:05:23.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.854+0000 7f58c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:23.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.858+0000 7f5a0ed179c0 20 remove_watcher() i=0 2024-09-12T18:05:23.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.858+0000 7f5a0ed179c0 2 removed watcher, disabling cache 2024-09-12T18:05:23.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.862+0000 7f5a0ed179c0 20 remove_watcher() i=1 2024-09-12T18:05:23.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.862+0000 7f5a0ed179c0 20 remove_watcher() i=2 2024-09-12T18:05:23.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.866+0000 7f5a0ed179c0 20 remove_watcher() i=3 2024-09-12T18:05:23.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.866+0000 7f5a0ed179c0 20 remove_watcher() i=4 2024-09-12T18:05:23.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.870+0000 7f5a0ed179c0 20 remove_watcher() i=5 2024-09-12T18:05:23.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.870+0000 7f5a0ed179c0 20 remove_watcher() i=6 2024-09-12T18:05:23.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:23.874+0000 7f5a0ed179c0 20 remove_watcher() i=7 2024-09-12T18:05:23.886 INFO:tasks.workunit.client.0.smithi157.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:05:53.896 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:05:53.933 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:53.933 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:53.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.977+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:53.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 20 realm 2024-09-12T18:05:53.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:53.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:53.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:53.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:53.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:53.981 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.981+0000 7fc0924079c0 20 searching for the correct realm 2024-09-12T18:05:53.987 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.989+0000 7fc08f70c640 0 -- 172.21.15.157:0/4004537018 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fc084008040 msgr2=0x7fc084032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:53.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:53.993+0000 7fc08f70c640 0 -- 172.21.15.157:0/4004537018 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fbf58080900 msgr2=0x7fbf58082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:54.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:54.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:54.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:54.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:54.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:54.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:54.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:54.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 zone default found 2024-09-12T18:05:54.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 4 Realm: () 2024-09-12T18:05:54.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 zonegroup default 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.001+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.005+0000 7fc0924079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.005+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.005+0000 7fc0924079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.005+0000 7fc0924079c0 20 started sync module instance, tier type = 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.005+0000 7fc0924079c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:54.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.021+0000 7fc0924079c0 20 add_watcher() i=0 2024-09-12T18:05:54.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.021+0000 7fc0924079c0 20 add_watcher() i=1 2024-09-12T18:05:54.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.021+0000 7fc0924079c0 20 add_watcher() i=2 2024-09-12T18:05:54.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.021+0000 7fc0924079c0 20 add_watcher() i=3 2024-09-12T18:05:54.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.021+0000 7fc0924079c0 20 add_watcher() i=4 2024-09-12T18:05:54.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.021+0000 7fc0924079c0 20 add_watcher() i=5 2024-09-12T18:05:54.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.021+0000 7fc0924079c0 20 add_watcher() i=6 2024-09-12T18:05:54.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.021+0000 7fc0924079c0 20 add_watcher() i=7 2024-09-12T18:05:54.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.021+0000 7fc0924079c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:54.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.021+0000 7fbf467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:54.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:54.023 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 5 note: GC not initialized 2024-09-12T18:05:54.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fbf457e2640 20 reqs_thread_entry: start 2024-09-12T18:05:54.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:54.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 20 Filter name: none 2024-09-12T18:05:54.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fbf3e7fc640 20 reqs_thread_entry: start 2024-09-12T18:05:54.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:05:54.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:54.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:05:54.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:05:54.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 : miss 2024-09-12T18:05:54.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:05:54.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:54.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:54.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:54.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.025+0000 7fc0924079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 2024-09-12T18:05:54.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.029+0000 7fc0924079c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:05:54.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.033+0000 7fc0924079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:54.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.033+0000 7fc0924079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:54.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.033+0000 7fc0924079c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.033+0000 7fc0924079c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34, ofs0, ns] 2024-09-12T18:05:54.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.033+0000 7fbf6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94413448452496 notifier 7650 bl.length()=911 2024-09-12T18:05:54.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.033+0000 7fbf6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:54.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.033+0000 7fbf6effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:54.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.033+0000 7fbf6effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.037+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_sources= new_sources= 2024-09-12T18:05:54.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.037+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential sources added=[] removed=[] 2024-09-12T18:05:54.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.037+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_dests= new_dests= 2024-09-12T18:05:54.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.037+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential dests added=[] removed=[] 2024-09-12T18:05:54.040 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.041+0000 7fc0924079c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34.2.0 2024-09-12T18:05:54.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.041+0000 7fc0924079c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34.2.0 2024-09-12T18:05:54.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.041+0000 7fc0924079c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34.2.1 2024-09-12T18:05:54.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.041+0000 7fc0924079c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34.2.1 2024-09-12T18:05:54.041 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.041+0000 7fc0924079c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34.0 2024-09-12T18:05:54.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.045+0000 7fc0924079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:54.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.045+0000 7fc0924079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 2024-09-12T18:05:54.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.045+0000 7fc0924079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:54.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.045+0000 7fc0924079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:54.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.045+0000 7fc0924079c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.045+0000 7fc0924079c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34, ofs0, ns] 2024-09-12T18:05:54.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.049+0000 7fbf6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94413448452496 notifier 7650 bl.length()=911 2024-09-12T18:05:54.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.049+0000 7fbf6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:54.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.049+0000 7fbf6e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:54.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.049+0000 7fbf6e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.049+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_sources= new_sources= 2024-09-12T18:05:54.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.049+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential sources added=[] removed=[] 2024-09-12T18:05:54.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.049+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_dests= new_dests= 2024-09-12T18:05:54.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.049+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential dests added=[] removed=[] 2024-09-12T18:05:54.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.049+0000 7fc0924079c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34.0 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.049+0000 7fc0924079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.049+0000 7fc0924079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fc0924079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fc0924079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fc0924079c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fc0924079c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34, ofs0, ns] 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fbf6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464285 cookie 94413448452496 notifier 7650 bl.length()=879 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fbf6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 info.flags=0x17 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fbf6effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 to cache LRU end 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fbf6effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_sources= new_sources= 2024-09-12T18:05:54.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential sources added=[] removed=[] 2024-09-12T18:05:54.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): orig_dests= new_dests= 2024-09-12T18:05:54.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.053+0000 7fc0924079c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34]): potential dests added=[] removed=[] 2024-09-12T18:05:54.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.057+0000 7fc0924079c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T18:05:54.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.061+0000 7fbf467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.065+0000 7fc0924079c0 20 remove_watcher() i=0 2024-09-12T18:05:54.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.065+0000 7fc0924079c0 2 removed watcher, disabling cache 2024-09-12T18:05:54.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.065+0000 7fc0924079c0 20 remove_watcher() i=1 2024-09-12T18:05:54.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.069+0000 7fc0924079c0 20 remove_watcher() i=2 2024-09-12T18:05:54.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.069+0000 7fc0924079c0 20 remove_watcher() i=3 2024-09-12T18:05:54.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.073+0000 7fc0924079c0 20 remove_watcher() i=4 2024-09-12T18:05:54.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.073+0000 7fc0924079c0 20 remove_watcher() i=5 2024-09-12T18:05:54.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.077+0000 7fc0924079c0 20 remove_watcher() i=6 2024-09-12T18:05:54.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.077+0000 7fc0924079c0 20 remove_watcher() i=7 2024-09-12T18:05:54.091 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T18:05:54.121 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:54.121 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:54.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.165+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.166 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.166 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 20 realm 2024-09-12T18:05:54.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:54.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.168 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.168 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:54.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.169+0000 7fc68a46c9c0 20 searching for the correct realm 2024-09-12T18:05:54.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.177+0000 7fc688773640 0 -- 172.21.15.157:0/603806802 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fc67011f0e0 msgr2=0x7fc6700ff8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:54.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.393+0000 7fc687f72640 0 -- 172.21.15.157:0/603806802 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55ce9da50560 msgr2=0x55ce9da52a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:54.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 zone default found 2024-09-12T18:05:54.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 4 Realm: () 2024-09-12T18:05:54.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:54.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:54.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:54.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 zonegroup default 2024-09-12T18:05:54.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.401+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.405+0000 7fc68a46c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.405+0000 7fc68a46c9c0 20 started sync module instance, tier type = 2024-09-12T18:05:54.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.405+0000 7fc68a46c9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:54.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.425+0000 7fc68a46c9c0 20 add_watcher() i=0 2024-09-12T18:05:54.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.425+0000 7fc68a46c9c0 20 add_watcher() i=1 2024-09-12T18:05:54.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.425+0000 7fc68a46c9c0 20 add_watcher() i=2 2024-09-12T18:05:54.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.425+0000 7fc68a46c9c0 20 add_watcher() i=3 2024-09-12T18:05:54.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.425+0000 7fc68a46c9c0 20 add_watcher() i=4 2024-09-12T18:05:54.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.425+0000 7fc68a46c9c0 20 add_watcher() i=5 2024-09-12T18:05:54.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.425+0000 7fc68a46c9c0 20 add_watcher() i=6 2024-09-12T18:05:54.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.429+0000 7fc68a46c9c0 20 add_watcher() i=7 2024-09-12T18:05:54.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.429+0000 7fc68a46c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:54.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.433+0000 7fc53e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.433+0000 7fc68a46c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:54.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.433+0000 7fc68a46c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:54.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.433+0000 7fc68a46c9c0 5 note: GC not initialized 2024-09-12T18:05:54.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.433+0000 7fc53d7e2640 20 reqs_thread_entry: start 2024-09-12T18:05:54.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.433+0000 7fc68a46c9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:54.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.433+0000 7fc68a46c9c0 20 Filter name: none 2024-09-12T18:05:54.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.433+0000 7fc5367fc640 20 reqs_thread_entry: start 2024-09-12T18:05:54.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.433+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.437+0000 7fc68a46c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:54.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.437+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.437+0000 7fc68a46c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:54.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.437+0000 7fc68a46c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:54.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.437+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.437+0000 7fc68a46c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:54.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.437+0000 7fc68a46c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.437+0000 7fc68a46c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:54.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.437+0000 7fc68a46c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:54.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.441+0000 7fc53e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.445+0000 7fc68a46c9c0 20 remove_watcher() i=0 2024-09-12T18:05:54.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.445+0000 7fc68a46c9c0 2 removed watcher, disabling cache 2024-09-12T18:05:54.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.449+0000 7fc68a46c9c0 20 remove_watcher() i=1 2024-09-12T18:05:54.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.449+0000 7fc68a46c9c0 20 remove_watcher() i=2 2024-09-12T18:05:54.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.453+0000 7fc68a46c9c0 20 remove_watcher() i=3 2024-09-12T18:05:54.453 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.453+0000 7fc68a46c9c0 20 remove_watcher() i=4 2024-09-12T18:05:54.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.457+0000 7fc68a46c9c0 20 remove_watcher() i=5 2024-09-12T18:05:54.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.457+0000 7fc68a46c9c0 20 remove_watcher() i=6 2024-09-12T18:05:54.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:54.457+0000 7fc68a46c9c0 20 remove_watcher() i=7 2024-09-12T18:05:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:54.482 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:05:54.482 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-do-reshard id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:05:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:55.238 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T18:05:55.238 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:57.378 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T18:05:57.409 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:57.409 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:57.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.453+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.457+0000 7f48563789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:57.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.457+0000 7f48563789c0 20 realm 2024-09-12T18:05:57.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.457+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.457+0000 7f48563789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:57.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.457+0000 7f48563789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:57.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.457+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.457+0000 7f48563789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:57.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.457+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.457+0000 7f48563789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:57.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.457+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.461+0000 7f48563789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:57.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.461+0000 7f48563789c0 20 searching for the correct realm 2024-09-12T18:05:57.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.465+0000 7f485467f640 0 -- 172.21.15.157:0/3311943322 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f4848072ae0 msgr2=0x7f4848068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:57.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.681+0000 7f4853e7e640 0 -- 172.21.15.157:0/3311943322 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5637c306d100 msgr2=0x5637c306f590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:57.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.689+0000 7f48563789c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:57.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.689+0000 7f48563789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:57.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.689+0000 7f48563789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:57.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.689+0000 7f48563789c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:57.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.689+0000 7f48563789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:57.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.689+0000 7f48563789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:57.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.689+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.689+0000 7f48563789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:57.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.689+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:57.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:57.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 zone default found 2024-09-12T18:05:57.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 4 Realm: () 2024-09-12T18:05:57.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:57.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:57.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:57.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 zonegroup default 2024-09-12T18:05:57.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:57.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:57.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:57.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.693+0000 7f48563789c0 20 started sync module instance, tier type = 2024-09-12T18:05:57.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.697+0000 7f48563789c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:57.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.717+0000 7f48563789c0 20 add_watcher() i=0 2024-09-12T18:05:57.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.717+0000 7f48563789c0 20 add_watcher() i=1 2024-09-12T18:05:57.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.717+0000 7f48563789c0 20 add_watcher() i=2 2024-09-12T18:05:57.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.717+0000 7f48563789c0 20 add_watcher() i=3 2024-09-12T18:05:57.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.717+0000 7f48563789c0 20 add_watcher() i=4 2024-09-12T18:05:57.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.717+0000 7f48563789c0 20 add_watcher() i=5 2024-09-12T18:05:57.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.717+0000 7f48563789c0 20 add_watcher() i=6 2024-09-12T18:05:57.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.721+0000 7f48563789c0 20 add_watcher() i=7 2024-09-12T18:05:57.720 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.721+0000 7f48563789c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:57.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.725+0000 7f4709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:57.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.725+0000 7f48563789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:57.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.725+0000 7f48563789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:57.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.725+0000 7f48563789c0 5 note: GC not initialized 2024-09-12T18:05:57.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.725+0000 7f4708fe1640 20 reqs_thread_entry: start 2024-09-12T18:05:57.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.725+0000 7f48563789c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:57.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.725+0000 7f48563789c0 20 Filter name: none 2024-09-12T18:05:57.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.725+0000 7f46827fc640 20 reqs_thread_entry: start 2024-09-12T18:05:57.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.725+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.729+0000 7f48563789c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:05:57.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.729+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.729+0000 7f48563789c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:05:57.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.729+0000 7f48563789c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:57.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.729+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.729+0000 7f48563789c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:05:57.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.729+0000 7f48563789c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:57.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.729+0000 7f48563789c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:05:57.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.729+0000 7f48563789c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:57.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.733+0000 7f4709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:57.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.737+0000 7f48563789c0 20 remove_watcher() i=0 2024-09-12T18:05:57.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.737+0000 7f48563789c0 2 removed watcher, disabling cache 2024-09-12T18:05:57.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.741+0000 7f48563789c0 20 remove_watcher() i=1 2024-09-12T18:05:57.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.741+0000 7f48563789c0 20 remove_watcher() i=2 2024-09-12T18:05:57.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.741+0000 7f48563789c0 20 remove_watcher() i=3 2024-09-12T18:05:57.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.745+0000 7f48563789c0 20 remove_watcher() i=4 2024-09-12T18:05:57.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.745+0000 7f48563789c0 20 remove_watcher() i=5 2024-09-12T18:05:57.747 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.749+0000 7f48563789c0 20 remove_watcher() i=6 2024-09-12T18:05:57.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.749+0000 7f48563789c0 20 remove_watcher() i=7 2024-09-12T18:05:57.765 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:57.765 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:05:57.765 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-logrecord-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:05:57.765 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:57.765 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T18:05:57.798 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:57.798 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:57.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:57.841+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.049+0000 7f96c6ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.049+0000 7f96c6ad89c0 20 realm 2024-09-12T18:05:58.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.049+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.049+0000 7f96c6ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.049+0000 7f96c6ad89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:58.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.049+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.049+0000 7f96c6ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.049+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.053+0000 7f96c6ad89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:58.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.053+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.053+0000 7f96c6ad89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:58.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.053+0000 7f96c6ad89c0 20 searching for the correct realm 2024-09-12T18:05:58.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.061+0000 7f96c45de640 0 -- 172.21.15.157:0/2418709743 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f96bc018070 msgr2=0x7f96bc00f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:58.071 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.073+0000 7f96c45de640 0 -- 172.21.15.157:0/2418709743 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f96b8110c40 msgr2=0x7f96b8133920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:58.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.289+0000 7f96c6ad89c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:58.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.289+0000 7f96c6ad89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:58.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.289+0000 7f96c6ad89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:58.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.289+0000 7f96c6ad89c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:58.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.289+0000 7f96c6ad89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:58.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.289+0000 7f96c6ad89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:58.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.289+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.289+0000 7f96c6ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.289+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:58.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:58.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 20 zone default found 2024-09-12T18:05:58.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 4 Realm: () 2024-09-12T18:05:58.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:58.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:58.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:58.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 20 zonegroup default 2024-09-12T18:05:58.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.294 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.293+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.297+0000 7f96c6ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.297+0000 7f96c6ad89c0 20 started sync module instance, tier type = 2024-09-12T18:05:58.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.297+0000 7f96c6ad89c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:58.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.317+0000 7f96c6ad89c0 20 add_watcher() i=0 2024-09-12T18:05:58.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.317+0000 7f96c6ad89c0 20 add_watcher() i=1 2024-09-12T18:05:58.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.317+0000 7f96c6ad89c0 20 add_watcher() i=2 2024-09-12T18:05:58.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.317+0000 7f96c6ad89c0 20 add_watcher() i=3 2024-09-12T18:05:58.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.317+0000 7f96c6ad89c0 20 add_watcher() i=4 2024-09-12T18:05:58.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.317+0000 7f96c6ad89c0 20 add_watcher() i=5 2024-09-12T18:05:58.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.317+0000 7f96c6ad89c0 20 add_watcher() i=6 2024-09-12T18:05:58.321 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.321+0000 7f96c6ad89c0 20 add_watcher() i=7 2024-09-12T18:05:58.321 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.321+0000 7f96c6ad89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:58.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.325+0000 7f957a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:58.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.325+0000 7f96c6ad89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:58.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.325+0000 7f96c6ad89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:58.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.325+0000 7f96c6ad89c0 5 note: GC not initialized 2024-09-12T18:05:58.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.325+0000 7f95797e2640 20 reqs_thread_entry: start 2024-09-12T18:05:58.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:58.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 20 Filter name: none 2024-09-12T18:05:58.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f94eaffd640 20 reqs_thread_entry: start 2024-09-12T18:05:58.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T18:05:58.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:05:58.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T18:05:58.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T18:05:58.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 : miss 2024-09-12T18:05:58.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:05:58.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:58.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.330 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.329+0000 7f96c6ad89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 2024-09-12T18:05:58.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.337+0000 7f96c6ad89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.337+0000 7f96c6ad89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.337+0000 7f96c6ad89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.337+0000 7f96c6ad89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35, ofs0, ns] 2024-09-12T18:05:58.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.337+0000 7f959b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464312 cookie 94312102585760 notifier 7701 bl.length()=923 2024-09-12T18:05:58.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.337+0000 7f959b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.337+0000 7f959b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.337+0000 7f959b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.341+0000 7f96c6ad89c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): orig_sources= new_sources= 2024-09-12T18:05:58.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.341+0000 7f96c6ad89c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): potential sources added=[] removed=[] 2024-09-12T18:05:58.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.341+0000 7f96c6ad89c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): orig_dests= new_dests= 2024-09-12T18:05:58.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.341+0000 7f96c6ad89c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): potential dests added=[] removed=[] 2024-09-12T18:05:58.344 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.345+0000 7f96c6ad89c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T18:05:58.344 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.345+0000 7f96c6ad89c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T18:05:58.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.349+0000 7f96c6ad89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:58.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.349+0000 7f96c6ad89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 2024-09-12T18:05:58.351 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f96c6ad89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.351 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f96c6ad89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.351 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f96c6ad89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.351 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f96c6ad89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35, ofs0, ns] 2024-09-12T18:05:58.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f959b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464313 cookie 94312102585760 notifier 7701 bl.length()=891 2024-09-12T18:05:58.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f959b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f959b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f959b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f96c6ad89c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): orig_sources= new_sources= 2024-09-12T18:05:58.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f96c6ad89c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): potential sources added=[] removed=[] 2024-09-12T18:05:58.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f96c6ad89c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): orig_dests= new_dests= 2024-09-12T18:05:58.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.353+0000 7f96c6ad89c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): potential dests added=[] removed=[] 2024-09-12T18:05:58.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.361+0000 7f957a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:58.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.365+0000 7f96c6ad89c0 20 remove_watcher() i=0 2024-09-12T18:05:58.364 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.365+0000 7f96c6ad89c0 2 removed watcher, disabling cache 2024-09-12T18:05:58.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.369+0000 7f96c6ad89c0 20 remove_watcher() i=1 2024-09-12T18:05:58.369 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.369+0000 7f96c6ad89c0 20 remove_watcher() i=2 2024-09-12T18:05:58.372 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.373+0000 7f96c6ad89c0 20 remove_watcher() i=3 2024-09-12T18:05:58.375 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.377+0000 7f96c6ad89c0 20 remove_watcher() i=4 2024-09-12T18:05:58.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.377+0000 7f96c6ad89c0 20 remove_watcher() i=5 2024-09-12T18:05:58.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.377+0000 7f96c6ad89c0 20 remove_watcher() i=6 2024-09-12T18:05:58.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.381+0000 7f96c6ad89c0 20 remove_watcher() i=7 2024-09-12T18:05:58.395 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T18:05:58.425 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:58.425 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:58.470 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.469+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.473+0000 7fe4b6a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.473+0000 7fe4b6a119c0 20 realm 2024-09-12T18:05:58.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.473+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.473+0000 7fe4b6a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.473+0000 7fe4b6a119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:58.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.473+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.473+0000 7fe4b6a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.473 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.473+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.477+0000 7fe4b6a119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:58.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.477+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.477+0000 7fe4b6a119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:58.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.477+0000 7fe4b6a119c0 20 searching for the correct realm 2024-09-12T18:05:58.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.477+0000 7fe4b3d16640 0 -- 172.21.15.157:0/3121670501 >> [v2:172.21.15.157:6800/2182114182,v1:172.21.15.157:6801/2182114182] conn(0x5574f6c0ea30 msgr2=0x5574f6c10e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:58.484 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.485+0000 7fe4b4517640 0 -- 172.21.15.157:0/3121670501 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7fe4ac01f040 msgr2=0x7fe4ac02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:58.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.493+0000 7fe4b6a119c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:58.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.493+0000 7fe4b6a119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:58.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.493+0000 7fe4b6a119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:58.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.493+0000 7fe4b6a119c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:58.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.493+0000 7fe4b6a119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:58.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.493+0000 7fe4b6a119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:58.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.493+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.493+0000 7fe4b6a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.493+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:58.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:58.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 zone default found 2024-09-12T18:05:58.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 4 Realm: () 2024-09-12T18:05:58.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:58.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:58.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:58.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 zonegroup default 2024-09-12T18:05:58.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 started sync module instance, tier type = 2024-09-12T18:05:58.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.497+0000 7fe4b6a119c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:58.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.513+0000 7fe4b6a119c0 20 add_watcher() i=0 2024-09-12T18:05:58.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.513+0000 7fe4b6a119c0 20 add_watcher() i=1 2024-09-12T18:05:58.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.513+0000 7fe4b6a119c0 20 add_watcher() i=2 2024-09-12T18:05:58.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.513+0000 7fe4b6a119c0 20 add_watcher() i=3 2024-09-12T18:05:58.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.513+0000 7fe4b6a119c0 20 add_watcher() i=4 2024-09-12T18:05:58.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.513+0000 7fe4b6a119c0 20 add_watcher() i=5 2024-09-12T18:05:58.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.513+0000 7fe4b6a119c0 20 add_watcher() i=6 2024-09-12T18:05:58.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.513+0000 7fe4b6a119c0 20 add_watcher() i=7 2024-09-12T18:05:58.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.513+0000 7fe4b6a119c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:58.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe36a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:58.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe4b6a119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:58.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe4b6a119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:58.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe4b6a119c0 5 note: GC not initialized 2024-09-12T18:05:58.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe3697e2640 20 reqs_thread_entry: start 2024-09-12T18:05:58.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe4b6a119c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:58.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe4b6a119c0 20 Filter name: none 2024-09-12T18:05:58.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe2daffd640 20 reqs_thread_entry: start 2024-09-12T18:05:58.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe4b6a119c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:05:58.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe4b6a119c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:05:58.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe4b6a119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:58.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.517+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.521+0000 7fe4b6a119c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:05:58.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.521+0000 7fe4b6a119c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.521+0000 7fe4b6a119c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:05:58.519 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.521+0000 7fe4b6a119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:58.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.521+0000 7fe36a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:58.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.525+0000 7fe4b6a119c0 20 remove_watcher() i=0 2024-09-12T18:05:58.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.525+0000 7fe4b6a119c0 2 removed watcher, disabling cache 2024-09-12T18:05:58.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.529+0000 7fe4b6a119c0 20 remove_watcher() i=1 2024-09-12T18:05:58.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.529+0000 7fe4b6a119c0 20 remove_watcher() i=2 2024-09-12T18:05:58.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.533+0000 7fe4b6a119c0 20 remove_watcher() i=3 2024-09-12T18:05:58.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.533+0000 7fe4b6a119c0 20 remove_watcher() i=4 2024-09-12T18:05:58.535 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.537+0000 7fe4b6a119c0 20 remove_watcher() i=5 2024-09-12T18:05:58.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.537+0000 7fe4b6a119c0 20 remove_watcher() i=6 2024-09-12T18:05:58.537 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.537+0000 7fe4b6a119c0 20 remove_watcher() i=7 2024-09-12T18:05:58.552 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:58.552 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:05:58.553 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-logrecord-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:05:58.553 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:58.652 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:05:58.688 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:58.688 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:58.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.733+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.733+0000 7f8b078279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.733+0000 7f8b078279c0 20 realm 2024-09-12T18:05:58.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.733+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.733+0000 7f8b078279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.733+0000 7f8b078279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:58.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.733+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.733+0000 7f8b078279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.733+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.737+0000 7f8b078279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:58.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.737+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.737+0000 7f8b078279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:58.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.737+0000 7f8b078279c0 20 searching for the correct realm 2024-09-12T18:05:58.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.745+0000 7f8b04b2c640 0 -- 172.21.15.157:0/4011654633 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f8afc062bd0 msgr2=0x7f8afc062640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:58.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.749+0000 7f8b05b2e640 0 -- 172.21.15.157:0/4011654633 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f8afc084b10 msgr2=0x7f8afc06c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:05:58.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:58.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:58.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:58.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:58.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:58.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:58.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.757 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 zone default found 2024-09-12T18:05:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 4 Realm: () 2024-09-12T18:05:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 zonegroup default 2024-09-12T18:05:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.757+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.761+0000 7f8b078279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:58.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.761+0000 7f8b078279c0 20 started sync module instance, tier type = 2024-09-12T18:05:58.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.761+0000 7f8b078279c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:58.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.773+0000 7f8b078279c0 20 add_watcher() i=0 2024-09-12T18:05:58.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.773+0000 7f8b078279c0 20 add_watcher() i=1 2024-09-12T18:05:58.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.773+0000 7f8b078279c0 20 add_watcher() i=2 2024-09-12T18:05:58.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.773+0000 7f8b078279c0 20 add_watcher() i=3 2024-09-12T18:05:58.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.773+0000 7f8b078279c0 20 add_watcher() i=4 2024-09-12T18:05:58.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.773+0000 7f8b078279c0 20 add_watcher() i=5 2024-09-12T18:05:58.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.773+0000 7f8b078279c0 20 add_watcher() i=6 2024-09-12T18:05:58.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.777+0000 7f8b078279c0 20 add_watcher() i=7 2024-09-12T18:05:58.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.777+0000 7f8b078279c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:58.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.777+0000 7f89bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:58.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.777+0000 7f8b078279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:58.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.777+0000 7f8b078279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:58.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.777+0000 7f8b078279c0 5 note: GC not initialized 2024-09-12T18:05:58.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.777+0000 7f89ba7e4640 20 reqs_thread_entry: start 2024-09-12T18:05:58.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.777+0000 7f8b078279c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:58.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.777+0000 7f8b078279c0 20 Filter name: none 2024-09-12T18:05:58.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f892bfff640 20 reqs_thread_entry: start 2024-09-12T18:05:58.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T18:05:58.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:05:58.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T18:05:58.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T18:05:58.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 : miss 2024-09-12T18:05:58.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:58.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:05:58.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:58.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.781+0000 7f8b078279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 2024-09-12T18:05:58.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.785+0000 7f8b078279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.785+0000 7f8b078279c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.785+0000 7f8b078279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.785+0000 7f8b078279c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35, ofs0, ns] 2024-09-12T18:05:58.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.789+0000 7f89e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464314 cookie 94220133916528 notifier 7202 bl.length()=923 2024-09-12T18:05:58.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.789+0000 7f89e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.789+0000 7f89e8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.789+0000 7f89e8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.789+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): orig_sources= new_sources= 2024-09-12T18:05:58.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.789+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): potential sources added=[] removed=[] 2024-09-12T18:05:58.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.789+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): orig_dests= new_dests= 2024-09-12T18:05:58.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.789+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): potential dests added=[] removed=[] 2024-09-12T18:05:58.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.793+0000 7f8b078279c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35.1.0 2024-09-12T18:05:58.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.793+0000 7f8b078279c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35.1.0 2024-09-12T18:05:58.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.793+0000 7f8b078279c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35.1.1 2024-09-12T18:05:58.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.793+0000 7f8b078279c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35.1.1 2024-09-12T18:05:58.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.793+0000 7f8b078279c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35.0 2024-09-12T18:05:58.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.797+0000 7f8b078279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:58.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.797+0000 7f8b078279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 2024-09-12T18:05:58.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f8b078279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f8b078279c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f8b078279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f8b078279c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35, ofs0, ns] 2024-09-12T18:05:58.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f89d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464315 cookie 94220133916528 notifier 7202 bl.length()=923 2024-09-12T18:05:58.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f89d7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f89d7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f89d7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): orig_sources= new_sources= 2024-09-12T18:05:58.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): potential sources added=[] removed=[] 2024-09-12T18:05:58.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): orig_dests= new_dests= 2024-09-12T18:05:58.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.801+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): potential dests added=[] removed=[] 2024-09-12T18:05:58.804 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.805+0000 7f8b078279c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35.0 2024-09-12T18:05:58.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.805+0000 7f8b078279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:58.805 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.805+0000 7f8b078279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 2024-09-12T18:05:58.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f8b078279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f8b078279c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f8b078279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f8b078279c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35, ofs0, ns] 2024-09-12T18:05:58.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f89e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464316 cookie 94220133916528 notifier 7202 bl.length()=891 2024-09-12T18:05:58.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f89e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 info.flags=0x17 2024-09-12T18:05:58.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f89e8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 to cache LRU end 2024-09-12T18:05:58.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f89e8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:58.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): orig_sources= new_sources= 2024-09-12T18:05:58.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): potential sources added=[] removed=[] 2024-09-12T18:05:58.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): orig_dests= new_dests= 2024-09-12T18:05:58.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.809+0000 7f8b078279c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35]): potential dests added=[] removed=[] 2024-09-12T18:05:58.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.813+0000 7f8b078279c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T18:05:58.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.817+0000 7f89bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:58.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.821+0000 7f8b078279c0 20 remove_watcher() i=0 2024-09-12T18:05:58.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.821+0000 7f8b078279c0 2 removed watcher, disabling cache 2024-09-12T18:05:58.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.825+0000 7f8b078279c0 20 remove_watcher() i=1 2024-09-12T18:05:58.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.825+0000 7f8b078279c0 20 remove_watcher() i=2 2024-09-12T18:05:58.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.829+0000 7f8b078279c0 20 remove_watcher() i=3 2024-09-12T18:05:58.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.829+0000 7f8b078279c0 20 remove_watcher() i=4 2024-09-12T18:05:58.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.833+0000 7f8b078279c0 20 remove_watcher() i=5 2024-09-12T18:05:58.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.833+0000 7f8b078279c0 20 remove_watcher() i=6 2024-09-12T18:05:58.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:58.833+0000 7f8b078279c0 20 remove_watcher() i=7 2024-09-12T18:05:58.848 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T18:05:58.875 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:58.875 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:59.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.133+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.133+0000 7fa34a0ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:59.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.133+0000 7fa34a0ca9c0 20 realm 2024-09-12T18:05:59.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.133+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.133+0000 7fa34a0ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:59.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.133+0000 7fa34a0ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:59.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.133+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.133+0000 7fa34a0ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:59.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.133+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.137+0000 7fa34a0ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:59.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.137+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.137+0000 7fa34a0ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:59.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.137+0000 7fa34a0ca9c0 20 searching for the correct realm 2024-09-12T18:05:59.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.141+0000 7fa3483d1640 0 -- 172.21.15.157:0/2210555859 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x55ed27587a40 msgr2=0x55ed27589f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:59.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.149+0000 7fa347bd0640 0 -- 172.21.15.157:0/2210555859 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fa33c06c450 msgr2=0x7fa33c084040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:59.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.157+0000 7fa34a0ca9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:05:59.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.157+0000 7fa34a0ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:59.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.157+0000 7fa34a0ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:59.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.157+0000 7fa34a0ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:05:59.157 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.157+0000 7fa34a0ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:59.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.157+0000 7fa34a0ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:59.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.157+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.157+0000 7fa34a0ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:59.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.157+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.157+0000 7fa34a0ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:59.158 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.157+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:59.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 20 zone default found 2024-09-12T18:05:59.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 4 Realm: () 2024-09-12T18:05:59.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:05:59.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:05:59.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:59.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 20 zonegroup default 2024-09-12T18:05:59.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:59.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:59.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:59.161 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 20 started sync module instance, tier type = 2024-09-12T18:05:59.161 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.161+0000 7fa34a0ca9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:05:59.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.177+0000 7fa34a0ca9c0 20 add_watcher() i=0 2024-09-12T18:05:59.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.177+0000 7fa34a0ca9c0 20 add_watcher() i=1 2024-09-12T18:05:59.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.177+0000 7fa34a0ca9c0 20 add_watcher() i=2 2024-09-12T18:05:59.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.177+0000 7fa34a0ca9c0 20 add_watcher() i=3 2024-09-12T18:05:59.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.177+0000 7fa34a0ca9c0 20 add_watcher() i=4 2024-09-12T18:05:59.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.177+0000 7fa34a0ca9c0 20 add_watcher() i=5 2024-09-12T18:05:59.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.177+0000 7fa34a0ca9c0 20 add_watcher() i=6 2024-09-12T18:05:59.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.177+0000 7fa34a0ca9c0 20 add_watcher() i=7 2024-09-12T18:05:59.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.177+0000 7fa34a0ca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:59.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.181+0000 7fa1fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:59.181 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.181+0000 7fa34a0ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:59.181 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.181+0000 7fa34a0ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:59.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.181+0000 7fa34a0ca9c0 5 note: GC not initialized 2024-09-12T18:05:59.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.181+0000 7fa1fcfe1640 20 reqs_thread_entry: start 2024-09-12T18:05:59.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.181+0000 7fa34a0ca9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:05:59.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.181+0000 7fa34a0ca9c0 20 Filter name: none 2024-09-12T18:05:59.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.181+0000 7fa1767fc640 20 reqs_thread_entry: start 2024-09-12T18:05:59.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.181+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.181+0000 7fa34a0ca9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:05:59.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.181+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.185+0000 7fa34a0ca9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:05:59.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.185+0000 7fa34a0ca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:59.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.185+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.185+0000 7fa34a0ca9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:05:59.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.185+0000 7fa34a0ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:59.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.185+0000 7fa34a0ca9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:05:59.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.185+0000 7fa34a0ca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:59.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.185+0000 7fa1fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:59.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.193+0000 7fa34a0ca9c0 20 remove_watcher() i=0 2024-09-12T18:05:59.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.193+0000 7fa34a0ca9c0 2 removed watcher, disabling cache 2024-09-12T18:05:59.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.193+0000 7fa34a0ca9c0 20 remove_watcher() i=1 2024-09-12T18:05:59.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.193+0000 7fa34a0ca9c0 20 remove_watcher() i=2 2024-09-12T18:05:59.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.197+0000 7fa34a0ca9c0 20 remove_watcher() i=3 2024-09-12T18:05:59.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.197+0000 7fa34a0ca9c0 20 remove_watcher() i=4 2024-09-12T18:05:59.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.201+0000 7fa34a0ca9c0 20 remove_watcher() i=5 2024-09-12T18:05:59.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.201+0000 7fa34a0ca9c0 20 remove_watcher() i=6 2024-09-12T18:05:59.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:05:59.201+0000 7fa34a0ca9c0 20 remove_watcher() i=7 2024-09-12T18:05:59.216 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:59.216 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:05:59.217 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-logrecord-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:05:59.217 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:05:59.993 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T18:05:59.994 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.119 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T18:06:02.152 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:02.152 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:02.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.197+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 20 realm 2024-09-12T18:06:02.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:02.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:02.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:02.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.201+0000 7ff30c81f9c0 20 searching for the correct realm 2024-09-12T18:06:02.205 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.205+0000 7ff309b24640 0 -- 172.21.15.157:0/2000510415 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7ff30005d040 msgr2=0x7ff30005d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:02.421 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.421+0000 7ff30a325640 0 -- 172.21.15.157:0/2000510415 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7ff30006db00 msgr2=0x7ff300050900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:02.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.637+0000 7ff30c81f9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:02.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.637+0000 7ff30c81f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:02.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.637+0000 7ff30c81f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:02.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.637+0000 7ff30c81f9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:02.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.637+0000 7ff30c81f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:02.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.637+0000 7ff30c81f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:02.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.637+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:02.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:02.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 zone default found 2024-09-12T18:06:02.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 4 Realm: () 2024-09-12T18:06:02.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:02.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:02.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:02.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 zonegroup default 2024-09-12T18:06:02.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.641+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.645+0000 7ff30c81f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.645+0000 7ff30c81f9c0 20 started sync module instance, tier type = 2024-09-12T18:06:02.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.645+0000 7ff30c81f9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:02.667 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.669+0000 7ff30c81f9c0 20 add_watcher() i=0 2024-09-12T18:06:02.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.669+0000 7ff30c81f9c0 20 add_watcher() i=1 2024-09-12T18:06:02.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.669+0000 7ff30c81f9c0 20 add_watcher() i=2 2024-09-12T18:06:02.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.669+0000 7ff30c81f9c0 20 add_watcher() i=3 2024-09-12T18:06:02.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.669+0000 7ff30c81f9c0 20 add_watcher() i=4 2024-09-12T18:06:02.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.669+0000 7ff30c81f9c0 20 add_watcher() i=5 2024-09-12T18:06:02.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.669+0000 7ff30c81f9c0 20 add_watcher() i=6 2024-09-12T18:06:02.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.669+0000 7ff30c81f9c0 20 add_watcher() i=7 2024-09-12T18:06:02.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.669+0000 7ff30c81f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:02.674 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.673+0000 7ff1c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:02.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.677+0000 7ff30c81f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:02.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.677+0000 7ff30c81f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:02.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.677+0000 7ff30c81f9c0 5 note: GC not initialized 2024-09-12T18:06:02.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.677+0000 7ff13b7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:02.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.677+0000 7ff30c81f9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:02.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.677+0000 7ff30c81f9c0 20 Filter name: none 2024-09-12T18:06:02.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.677+0000 7ff1397fa640 20 reqs_thread_entry: start 2024-09-12T18:06:02.677 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.677+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.677+0000 7ff30c81f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:02.678 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.677+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.679 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.681+0000 7ff30c81f9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:02.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.681+0000 7ff30c81f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:02.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.681+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.681+0000 7ff30c81f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:02.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.681+0000 7ff30c81f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.681+0000 7ff30c81f9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:02.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.681+0000 7ff30c81f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:02.684 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.685+0000 7ff1c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:02.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.689+0000 7ff30c81f9c0 20 remove_watcher() i=0 2024-09-12T18:06:02.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.689+0000 7ff30c81f9c0 2 removed watcher, disabling cache 2024-09-12T18:06:02.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.693+0000 7ff30c81f9c0 20 remove_watcher() i=1 2024-09-12T18:06:02.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.693+0000 7ff30c81f9c0 20 remove_watcher() i=2 2024-09-12T18:06:02.697 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.697+0000 7ff30c81f9c0 20 remove_watcher() i=3 2024-09-12T18:06:02.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.701+0000 7ff30c81f9c0 20 remove_watcher() i=4 2024-09-12T18:06:02.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.701+0000 7ff30c81f9c0 20 remove_watcher() i=5 2024-09-12T18:06:02.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.705+0000 7ff30c81f9c0 20 remove_watcher() i=6 2024-09-12T18:06:02.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.705+0000 7ff30c81f9c0 20 remove_watcher() i=7 2024-09-12T18:06:02.727 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.727 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:06:02.727 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-logrecord-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:06:02.727 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.728 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T18:06:02.766 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:02.766 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:02.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.809+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.813+0000 7f10cee579c0 20 realm 2024-09-12T18:06:02.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.813+0000 7f10cee579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:02.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.812 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:02.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.817+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:02.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.817+0000 7f10cee579c0 20 searching for the correct realm 2024-09-12T18:06:02.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.821+0000 7f10cd15e640 0 -- 172.21.15.157:0/2230630183 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x557fda919c90 msgr2=0x557fda91c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:02.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.829+0000 7f10cc15c640 0 -- 172.21.15.157:0/2230630183 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f10c0050070 msgr2=0x7f10c00309e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:02.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:02.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:02.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:02.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:02.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:02.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:02.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.833+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:02.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:02.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 zone default found 2024-09-12T18:06:02.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 4 Realm: () 2024-09-12T18:06:02.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:02.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:02.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:02.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 zonegroup default 2024-09-12T18:06:02.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 started sync module instance, tier type = 2024-09-12T18:06:02.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.837+0000 7f10cee579c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:02.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=0 2024-09-12T18:06:02.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=1 2024-09-12T18:06:02.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=2 2024-09-12T18:06:02.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=3 2024-09-12T18:06:02.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=4 2024-09-12T18:06:02.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=5 2024-09-12T18:06:02.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=6 2024-09-12T18:06:02.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=7 2024-09-12T18:06:02.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.853+0000 7f10cee579c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:02.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.857+0000 7f0f837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:02.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.857+0000 7f10cee579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:02.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.857+0000 7f10cee579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:02.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.857+0000 7f10cee579c0 5 note: GC not initialized 2024-09-12T18:06:02.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.857+0000 7f0f827e4640 20 reqs_thread_entry: start 2024-09-12T18:06:02.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.857+0000 7f10cee579c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:02.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.857+0000 7f10cee579c0 20 Filter name: none 2024-09-12T18:06:02.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.857+0000 7f0f7bfff640 20 reqs_thread_entry: start 2024-09-12T18:06:02.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.857+0000 7f10cee579c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:06:02.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.857+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.861+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:02.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.861+0000 7f10cee579c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:06:02.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.861+0000 7f10cee579c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:06:02.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.861+0000 7f10cee579c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 : miss 2024-09-12T18:06:02.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.861+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.861+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:02.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.861+0000 7f10cee579c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:02.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.861+0000 7f10cee579c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:02.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.861+0000 7f10cee579c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:02.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.861+0000 7f10cee579c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:02.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.861+0000 7f10cee579c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 2024-09-12T18:06:02.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.869+0000 7f10cee579c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:02.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.869+0000 7f10cee579c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:02.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.869+0000 7f10cee579c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:02.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.869+0000 7f10cee579c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36, ofs0, ns] 2024-09-12T18:06:02.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94007616189584 notifier 7250 bl.length()=923 2024-09-12T18:06:02.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:02.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:02.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:02.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_sources= new_sources= 2024-09-12T18:06:02.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential sources added=[] removed=[] 2024-09-12T18:06:02.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_dests= new_dests= 2024-09-12T18:06:02.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential dests added=[] removed=[] 2024-09-12T18:06:02.874 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f10cee579c0 time 2024-09-12T18:06:02.879438+0000 2024-09-12T18:06:02.874 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:02.876 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:02.876 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f10d27312eb] 2024-09-12T18:06:02.876 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f10d273149f] 2024-09-12T18:06:02.876 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557fd894b0c1] 2024-09-12T18:06:02.876 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x14100ec) [0x557fd93a10ec] 2024-09-12T18:06:02.876 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557fd895d18d] 2024-09-12T18:06:02.876 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:06:02.876 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10d1597d90] 2024-09-12T18:06:02.876 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f10cee579c0 thread_name:radosgw-admin 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.877+0000 7f10cee579c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f10cee579c0 time 2024-09-12T18:06:02.879438+0000 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f10d27312eb] 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f10d273149f] 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557fd894b0c1] 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x14100ec) [0x557fd93a10ec] 2024-09-12T18:06:02.877 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557fd895d18d] 2024-09-12T18:06:02.878 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:06:02.878 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10d1597d90] 2024-09-12T18:06:02.878 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:06:02.878 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:06:02.878 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.894 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:02.894 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f10d15b0520] 2024-09-12T18:06:02.894 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:06:02.894 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:06:02.895 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:06:02.895 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f10d2731345] 2024-09-12T18:06:02.895 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f10d273149f] 2024-09-12T18:06:02.895 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557fd894b0c1] 2024-09-12T18:06:02.895 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x14100ec) [0x557fd93a10ec] 2024-09-12T18:06:02.895 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557fd895d18d] 2024-09-12T18:06:02.895 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:06:02.895 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10d1597d90] 2024-09-12T18:06:02.895 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:06:02.895 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:06:02.895 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.877+0000 7f10cee579c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f10cee579c0 thread_name:radosgw-admin 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f10d15b0520] 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f10d2731345] 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f10d273149f] 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557fd894b0c1] 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x14100ec) [0x557fd93a10ec] 2024-09-12T18:06:02.896 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557fd895d18d] 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10d1597d90] 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:06:02.789+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:06:02.789+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:06:02.789+0000 7f10cc15c640 10 monclient(hunting): handle_auth_done global_id 7238 payload 274 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:06:02.789+0000 7f10cc15c640 10 monclient: _finish_hunting 0 2024-09-12T18:06:02.897 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:06:02.789+0000 7f10cc15c640 1 monclient: found mon.noname-c 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:06:02.789+0000 7f10cc15c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:06:02.789+0000 7f10cc95d640 10 monclient: get_auth_request con 0x557fda6f09c0 auth_method 0 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: dump: 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.898 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: _finish_auth 0 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: _check_auth_tickets 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: dump: 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.899 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 monclient: authenticate success, global_id 7238 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:06:02.789+0000 7f10cee579c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:06:02.789+0000 7f10cee579c0 4 set_mon_vals no callback set 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:06:02.789+0000 7f10cee579c0 10 monclient: shutdown 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 asok(0x557fda6262b0) unregister_commands rotate-key 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:06:02.789+0000 7f10cee579c0 10 monclient: build_initial_monmap 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:06:02.789+0000 7f10cee579c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:06:02.789+0000 7f10cee579c0 10 monclient: monmap: 2024-09-12T18:06:02.900 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding auth protocol: cephx 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding auth protocol: cephx 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding auth protocol: cephx 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.901 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:06:02.789+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:06:02.789+0000 7f10cee579c0 1 librados: starting msgr at 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:06:02.789+0000 7f10cee579c0 1 librados: starting objecter 2024-09-12T18:06:02.902 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command objecter_requests hook 0x557fda834d50 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:06:02.789+0000 7f10cee579c0 1 librados: setting wanted keys 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:06:02.789+0000 7f10cee579c0 1 librados: calling monclient init 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:06:02.789+0000 7f10cee579c0 10 monclient: init 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding auth protocol: cephx 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding auth protocol: cephx 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding auth protocol: cephx 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.903 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:06:02.793+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:06:02.793+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:06:02.793+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command rotate-key hook 0x557fda830e98 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-a con 0x557fda6f09c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-b con 0x557fda7768a0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-c con 0x557fda779b00 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:02.904 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): authenticate will time out at 2525.016429s 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): get_auth_request con 0x557fda6f09c0 auth_method 0 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): get_auth_request con 0x557fda779b00 auth_method 0 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.905 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): handle_auth_done global_id 7785 payload 824 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient: _finish_hunting 0 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:06:02.793+0000 7f10cc95d640 1 monclient: found mon.noname-a 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: dump: 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.906 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: _finish_auth 0 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: _check_auth_tickets 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: dump: 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.907 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:06:02.793+0000 7f10cee579c0 5 monclient: authenticate success, global_id 7785 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:06:02.793+0000 7f0fbae0d640 4 set_mon_vals no callback set 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.908 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:06:02.793+0000 7f10cee579c0 1 librados: init done 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:06:02.793+0000 7f0fb960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:06:02.793+0000 7f0fb960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:06:02.793+0000 7f0fb960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:06:02.793+0000 7f10cc15c640 10 monclient: get_auth_request con 0x7f0fb4070ae0 auth_method 0 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient: get_auth_request con 0x557fda85ce90 auth_method 0 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:06:02.797+0000 7f10cc95d640 10 monclient: get_auth_request con 0x557fda87b9e0 auth_method 0 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:06:02.797+0000 7f10cc15c640 10 monclient: get_auth_request con 0x557fda87fc20 auth_method 0 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: build_initial_monmap 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:06:02.801+0000 7f10cee579c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:02.909 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: monmap: 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding auth protocol: cephx 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding auth protocol: cephx 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding auth protocol: cephx 2024-09-12T18:06:02.910 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:06:02.801+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command objecter_requests cmddesc objecter_requests hook 0x557fda888430 EEXIST 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: init 2024-09-12T18:06:02.911 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding auth protocol: cephx 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding auth protocol: cephx 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding auth protocol: cephx 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.912 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:06:02.801+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:06:02.801+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command rotate-key cmddesc rotate-key hook 0x557fda8832a0 EEXIST 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-a con 0x557fda8ac5e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-b con 0x557fda8abf10 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-c con 0x557fda8aa8f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.913 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): authenticate will time out at 2525.025531s 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): get_auth_request con 0x557fda8ac5e0 auth_method 0 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): get_auth_request con 0x557fda8aa8f0 auth_method 0 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.914 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:06:02.801+0000 7f10cc15c640 10 monclient(hunting): get_auth_request con 0x557fda8abf10 auth_method 0 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:06:02.801+0000 7f10cc15c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:06:02.801+0000 7f10cc15c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:06:02.801+0000 7f10cc15c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): handle_auth_done global_id 7788 payload 824 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient: _finish_hunting 0 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:06:02.801+0000 7f10cc95d640 1 monclient: found mon.noname-a 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: dump: 2024-09-12T18:06:02.915 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: _finish_auth 0 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: _check_auth_tickets 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 monclient: authenticate success, global_id 7788 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.916 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: dump: 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:06:02.801+0000 7f10cd95f640 4 set_mon_vals no callback set 2024-09-12T18:06:02.917 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:06:02.805+0000 7f0fb27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:06:02.805+0000 7f0fb27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:06:02.805+0000 7f0fb27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient: get_auth_request con 0x7f0fa4070a20 auth_method 0 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: get_monmap_and_config 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: build_initial_monmap 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: monmap: 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:02.918 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding auth protocol: cephx 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding auth protocol: cephx 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding auth protocol: cephx 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.919 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:06:02.805+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: init 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding auth protocol: cephx 2024-09-12T18:06:02.920 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding auth protocol: cephx 2024-09-12T18:06:02.921 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding auth protocol: cephx 2024-09-12T18:06:02.921 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.921 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.921 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.921 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.921 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.921 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.921 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.921 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:06:02.805+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:06:02.805+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc58048ca8 EEXIST 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-b con 0x557fda900450 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-c con 0x557fda8fb840 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-a con 0x557fda8fc1c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.922 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): authenticate will time out at 2525.029772s 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): get_auth_request con 0x557fda8fb840 auth_method 0 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): get_auth_request con 0x557fda8fc1c0 auth_method 0 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.923 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): handle_auth_done global_id 7247 payload 274 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient: _finish_hunting 0 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:06:02.805+0000 7f10cc15c640 1 monclient: found mon.noname-c 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: dump: 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.924 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: _finish_auth 0 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: _check_auth_tickets 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 monclient: authenticate success, global_id 7247 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:02.925 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:06:02.805+0000 7f10cee579c0 4 set_mon_vals no callback set 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: dump: 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.926 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: shutdown 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: build_initial_monmap 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: monmap: 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.927 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding auth protocol: cephx 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding auth protocol: cephx 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding auth protocol: cephx 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.928 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:06:02.805+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 librados: starting msgr at 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 librados: starting objecter 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command objecter_requests cmddesc objecter_requests hook 0x557fda8faa00 EEXIST 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 librados: setting wanted keys 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 librados: calling monclient init 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: init 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding auth protocol: cephx 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding auth protocol: cephx 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding auth protocol: cephx 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.929 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:06:02.809+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:06:02.809+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:06:02.809+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command rotate-key cmddesc rotate-key hook 0x557fda8ae548 EEXIST 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-b con 0x557fda8fb840 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:02.930 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-c con 0x557fda8fc1c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-a con 0x557fda900450 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): authenticate will time out at 2525.032446s 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): get_auth_request con 0x557fda8fc1c0 auth_method 0 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): get_auth_request con 0x557fda900450 auth_method 0 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.931 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): handle_auth_done global_id 7250 payload 824 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient: _finish_hunting 0 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:06:02.809+0000 7f10cc15c640 1 monclient: found mon.noname-c 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.932 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: dump: 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.933 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: _finish_auth 0 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: _check_auth_tickets 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: dump: 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.934 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:06:02.809+0000 7f0fa3fff640 4 set_mon_vals no callback set 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:06:02.809+0000 7f10cee579c0 5 monclient: authenticate success, global_id 7250 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:06:02.809+0000 7f10cee579c0 1 librados: init done 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:06:02.809+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command cr dump hook 0x557fda8eff98 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:06:02.809+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:02.935 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:06:02.813+0000 7f10cc95d640 10 monclient: get_auth_request con 0x7f0f98070ae0 auth_method 0 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:06:02.813+0000 7f10cd15e640 10 monclient: get_auth_request con 0x557fda919c90 auth_method 0 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 realm 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:06:02.813+0000 7f10cee579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:06:02.813+0000 7f10cc95d640 10 monclient: get_auth_request con 0x557fda91dce0 auth_method 0 2024-09-12T18:06:02.936 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:06:02.813+0000 7f10cc15c640 10 monclient: get_auth_request con 0x557fda9215a0 auth_method 0 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:06:02.817+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:06:02.817+0000 7f10cee579c0 20 searching for the correct realm 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:06:02.817+0000 7f10cd15e640 10 monclient: get_auth_request con 0x557fda926340 auth_method 0 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:06:02.817+0000 7f10cc95d640 10 monclient: get_auth_request con 0x7f10c40bfb60 auth_method 0 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:06:02.817+0000 7f10cc15c640 10 monclient: get_auth_request con 0x7f10c0050070 auth_method 0 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:06:02.821+0000 7f10cd15e640 0 -- 172.21.15.157:0/2230630183 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x557fda919c90 msgr2=0x557fda91c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:06:02.821+0000 7f0fa27fc640 1 client.7250.objecter ms_handle_reset 0x557fda919c90 session 0x557fda919610 osd.1 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:06:02.821+0000 7f0fa27fc640 10 monclient: _renew_subs 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:06:02.821+0000 7f0fa27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:06:02.821+0000 7f10cd15e640 10 monclient: get_auth_request con 0x7f0f98080880 auth_method 0 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:06:02.821+0000 7f10cd15e640 10 monclient: get_auth_request con 0x7f10c003b8f0 auth_method 0 2024-09-12T18:06:02.937 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:06:02.825+0000 7f10cc95d640 10 monclient: get_auth_request con 0x7f10c0043b80 auth_method 0 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:06:02.829+0000 7f10cc15c640 0 -- 172.21.15.157:0/2230630183 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f10c0050070 msgr2=0x7f10c00309e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:06:02.829+0000 7f0fa27fc640 1 client.7250.objecter ms_handle_reset 0x7f10c0050070 session 0x7f10c0033070 osd.4 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:06:02.829+0000 7f10cc15c640 10 monclient: get_auth_request con 0x557fda919c90 auth_method 0 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.938 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 zone default found 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:06:02.837+0000 7f10cee579c0 4 Realm: () 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:06:02.837+0000 7f10cee579c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:06:02.837+0000 7f10cee579c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:06:02.837+0000 7f10cee579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 zonegroup default 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.939 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 started sync module instance, tier type = 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=0 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=1 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=2 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=3 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=4 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=5 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=6 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=7 2024-09-12T18:06:02.940 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:06:02.853+0000 7f10cee579c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding auth protocol: cephx 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding auth protocol: cephx 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding auth protocol: cephx 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:06:02.857+0000 7f0f837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.941 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:06:02.857+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:06:02.857+0000 7f10cee579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:06:02.857+0000 7f10cee579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command cache list hook 0x557fda8f0570 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command cache inspect hook 0x557fda8f0570 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command cache erase hook 0x557fda8f0570 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command cache zap hook 0x557fda8f0570 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 note: GC not initialized 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:06:02.857+0000 7f0f827e4640 20 reqs_thread_entry: start 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command sync trace show hook 0x7f10c0008ed0 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command sync trace history hook 0x7f10c0008ed0 2024-09-12T18:06:02.942 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command sync trace active hook 0x7f10c0008ed0 2024-09-12T18:06:02.943 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command sync trace active_short hook 0x7f10c0008ed0 2024-09-12T18:06:02.943 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:06:02.857+0000 7f10cee579c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:02.943 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:06:02.857+0000 7f10cee579c0 20 Filter name: none 2024-09-12T18:06:02.943 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:06:02.857+0000 7f0f7bfff640 20 reqs_thread_entry: start 2024-09-12T18:06:02.943 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:06:02.857+0000 7f10cee579c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:06:02.943 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:06:02.857+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.943 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:06:02.861+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:02.943 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:06:02.943 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:06:02.943 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 : miss 2024-09-12T18:06:02.943 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:06:02.861+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.944 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:06:02.861+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:02.944 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:02.944 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:02.944 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:02.944 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:02.944 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 2024-09-12T18:06:02.944 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:06:02.869+0000 7f10cee579c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:02.944 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:06:02.869+0000 7f10cee579c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:02.944 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:06:02.869+0000 7f10cee579c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:02.944 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:06:02.869+0000 7f10cee579c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36, ofs0, ns] 2024-09-12T18:06:02.944 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94007616189584 notifier 7250 bl.length()=923 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_sources= new_sources= 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential sources added=[] removed=[] 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_dests= new_dests= 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential dests added=[] removed=[] 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:06:02.877+0000 7f10cee579c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f10cee579c0 time 2024-09-12T18:06:02.879438+0000 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f10d27312eb] 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f10d273149f] 2024-09-12T18:06:02.945 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557fd894b0c1] 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x14100ec) [0x557fd93a10ec] 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557fd895d18d] 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10d1597d90] 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:06:02.877+0000 7f10cee579c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f10cee579c0 thread_name:radosgw-admin 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f10d15b0520] 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:06:02.946 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f10d2731345] 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f10d273149f] 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557fd894b0c1] 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x14100ec) [0x557fd93a10ec] 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557fd895d18d] 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10d1597d90] 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:06:02.947 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:06:02.948 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:06:02.949 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:06:02.950 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:06:02.951 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:06:02.952 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:06:02.953 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0f7bfff640 / http_manager 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0f827e4640 / http_manager 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0f837e6640 / rgw_dt_lg_renew 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0fa27fc640 / ms_dispatch 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0fa3fff640 / io_context_pool 2024-09-12T18:06:02.954 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0fb27fc640 / ms_dispatch 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0fb960a640 / ms_dispatch 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0fbae0d640 / io_context_pool 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: 7f10cc15c640 / msgr-worker-2 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: 7f10cc95d640 / msgr-worker-1 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: 7f10cd15e640 / msgr-worker-0 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: 7f10cd95f640 / io_context_pool 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: 7f10cee579c0 / radosgw-admin 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.124688.log 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:06:02.789+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:06:02.789+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.955 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:06:02.789+0000 7f10cc15c640 10 monclient(hunting): handle_auth_done global_id 7238 payload 274 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:06:02.789+0000 7f10cc15c640 10 monclient: _finish_hunting 0 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:06:02.789+0000 7f10cc15c640 1 monclient: found mon.noname-c 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:06:02.789+0000 7f10cc15c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:06:02.789+0000 7f10cc95d640 10 monclient: get_auth_request con 0x557fda6f09c0 auth_method 0 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: dump: 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.956 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: _finish_auth 0 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: _check_auth_tickets 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:06:02.789+0000 7f0fbae0d640 10 monclient: dump: 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.957 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 monclient: authenticate success, global_id 7238 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:06:02.789+0000 7f10cee579c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:06:02.789+0000 7f10cee579c0 4 set_mon_vals no callback set 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:06:02.789+0000 7f10cee579c0 10 monclient: shutdown 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 asok(0x557fda6262b0) unregister_commands rotate-key 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:06:02.789+0000 7f10cee579c0 10 monclient: build_initial_monmap 2024-09-12T18:06:02.958 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:06:02.789+0000 7f10cee579c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:06:02.789+0000 7f10cee579c0 10 monclient: monmap: 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding auth protocol: cephx 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding auth protocol: cephx 2024-09-12T18:06:02.959 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding auth protocol: cephx 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: crc 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda8622a0) adding con mode: secure 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:06:02.789+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.960 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:06:02.789+0000 7f10cee579c0 1 librados: starting msgr at 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:06:02.789+0000 7f10cee579c0 1 librados: starting objecter 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command objecter_requests hook 0x557fda834d50 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:06:02.789+0000 7f10cee579c0 1 librados: setting wanted keys 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:06:02.789+0000 7f10cee579c0 1 librados: calling monclient init 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:06:02.789+0000 7f10cee579c0 10 monclient: init 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding auth protocol: cephx 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding auth protocol: cephx 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding auth protocol: cephx 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.961 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: crc 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:06:02.789+0000 7f10cee579c0 5 AuthRegistry(0x557fda830d50) adding con mode: secure 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:06:02.793+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:06:02.793+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:06:02.793+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command rotate-key hook 0x557fda830e98 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:06:02.962 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-a con 0x557fda6f09c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-b con 0x557fda7768a0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-c con 0x557fda779b00 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient(hunting): authenticate will time out at 2525.016429s 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): get_auth_request con 0x557fda6f09c0 auth_method 0 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): get_auth_request con 0x557fda779b00 auth_method 0 2024-09-12T18:06:02.963 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient(hunting): handle_auth_done global_id 7785 payload 824 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient: _finish_hunting 0 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:06:02.793+0000 7f10cc95d640 1 monclient: found mon.noname-a 2024-09-12T18:06:02.964 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:06:02.793+0000 7f10cc95d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: dump: 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.965 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: _finish_auth 0 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: _check_auth_tickets 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:06:02.793+0000 7f0fb960a640 10 monclient: dump: 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.966 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:06:02.793+0000 7f10cee579c0 5 monclient: authenticate success, global_id 7785 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:06:02.793+0000 7f0fbae0d640 4 set_mon_vals no callback set 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:06:02.793+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:06:02.793+0000 7f10cee579c0 1 librados: init done 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:06:02.793+0000 7f0fb960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:06:02.793+0000 7f0fb960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:06:02.793+0000 7f0fb960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:06:02.793+0000 7f10cc15c640 10 monclient: get_auth_request con 0x7f0fb4070ae0 auth_method 0 2024-09-12T18:06:02.967 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:06:02.793+0000 7f10cd15e640 10 monclient: get_auth_request con 0x557fda85ce90 auth_method 0 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:06:02.797+0000 7f10cc95d640 10 monclient: get_auth_request con 0x557fda87b9e0 auth_method 0 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:06:02.797+0000 7f10cc15c640 10 monclient: get_auth_request con 0x557fda87fc20 auth_method 0 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: build_initial_monmap 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:06:02.801+0000 7f10cee579c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: monmap: 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.968 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding auth protocol: cephx 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding auth protocol: cephx 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding auth protocol: cephx 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.969 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: crc 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda884ad0) adding con mode: secure 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:06:02.801+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command objecter_requests cmddesc objecter_requests hook 0x557fda888430 EEXIST 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: init 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding auth protocol: cephx 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding auth protocol: cephx 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding auth protocol: cephx 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.970 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: crc 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 AuthRegistry(0x557fda883158) adding con mode: secure 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:06:02.801+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:06:02.801+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command rotate-key cmddesc rotate-key hook 0x557fda8832a0 EEXIST 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:02.971 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-a con 0x557fda8ac5e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-b con 0x557fda8abf10 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-c con 0x557fda8aa8f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient(hunting): authenticate will time out at 2525.025531s 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): get_auth_request con 0x557fda8ac5e0 auth_method 0 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): get_auth_request con 0x557fda8aa8f0 auth_method 0 2024-09-12T18:06:02.972 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.973 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.973 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.973 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.973 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.973 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.973 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.973 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.973 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:06:02.801+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.973 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:06:02.801+0000 7f10cc15c640 10 monclient(hunting): get_auth_request con 0x557fda8abf10 auth_method 0 2024-09-12T18:06:02.973 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:06:02.801+0000 7f10cc15c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.973 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:06:02.801+0000 7f10cc15c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:06:02.801+0000 7f10cc15c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient(hunting): handle_auth_done global_id 7788 payload 824 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient: _finish_hunting 0 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:06:02.801+0000 7f10cc95d640 1 monclient: found mon.noname-a 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:06:02.801+0000 7f10cc95d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: dump: 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.974 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: _finish_auth 0 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: _check_auth_tickets 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:06:02.801+0000 7f10cee579c0 5 monclient: authenticate success, global_id 7788 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:06:02.801+0000 7f0fb27fc640 10 monclient: dump: 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.975 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:06:02.801+0000 7f10cd95f640 4 set_mon_vals no callback set 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:06:02.801+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:02.976 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:06:02.805+0000 7f0fb27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:06:02.805+0000 7f0fb27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:06:02.805+0000 7f0fb27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient: get_auth_request con 0x7f0fa4070a20 auth_method 0 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: get_monmap_and_config 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: build_initial_monmap 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: monmap: 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:02.977 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding auth protocol: cephx 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding auth protocol: cephx 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding auth protocol: cephx 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.978 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: crc 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8cbf30) adding con mode: secure 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:06:02.805+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: init 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding auth protocol: cephx 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding auth protocol: cephx 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding auth protocol: cephx 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.979 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: crc 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58048b60) adding con mode: secure 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:06:02.805+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:06:02.805+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc58048ca8 EEXIST 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-b con 0x557fda900450 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:02.980 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-c con 0x557fda8fb840 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-a con 0x557fda8fc1c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient(hunting): authenticate will time out at 2525.029772s 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): get_auth_request con 0x557fda8fb840 auth_method 0 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): get_auth_request con 0x557fda8fc1c0 auth_method 0 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.981 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:06:02.805+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient(hunting): handle_auth_done global_id 7247 payload 274 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient: _finish_hunting 0 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:06:02.805+0000 7f10cc15c640 1 monclient: found mon.noname-c 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:06:02.805+0000 7f10cc15c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:06:02.982 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: dump: 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: _finish_auth 0 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: _check_auth_tickets 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 monclient: authenticate success, global_id 7247 2024-09-12T18:06:02.983 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:06:02.805+0000 7f10cee579c0 4 set_mon_vals no callback set 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:06:02.805+0000 7f0fa3fff640 10 monclient: dump: 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.984 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: shutdown 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: build_initial_monmap 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: monmap: 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:02.985 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding auth protocol: cephx 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding auth protocol: cephx 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding auth protocol: cephx 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.986 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: crc 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8f2aa0) adding con mode: secure 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:06:02.805+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 librados: starting msgr at 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 librados: starting objecter 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command objecter_requests cmddesc objecter_requests hook 0x557fda8faa00 EEXIST 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 librados: setting wanted keys 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:06:02.805+0000 7f10cee579c0 1 librados: calling monclient init 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:06:02.805+0000 7f10cee579c0 10 monclient: init 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding auth protocol: cephx 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding auth protocol: cephx 2024-09-12T18:06:02.987 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding auth protocol: cephx 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: crc 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:06:02.805+0000 7f10cee579c0 5 AuthRegistry(0x557fda8ae400) adding con mode: secure 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:06:02.809+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:06:02.809+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.988 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:06:02.809+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command rotate-key cmddesc rotate-key hook 0x557fda8ae548 EEXIST 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-b con 0x557fda8fb840 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-c con 0x557fda8fc1c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): picked mon.noname-a con 0x557fda900450 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient(hunting): authenticate will time out at 2525.032446s 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): get_auth_request con 0x557fda8fc1c0 auth_method 0 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.989 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): get_auth_request con 0x557fda900450 auth_method 0 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:06:02.809+0000 7f10cd15e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient(hunting): handle_auth_done global_id 7250 payload 824 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient: _finish_hunting 0 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:06:02.809+0000 7f10cc15c640 1 monclient: found mon.noname-c 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:06:02.809+0000 7f10cc15c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.990 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: dump: 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.991 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: _finish_auth 0 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: _check_auth_tickets 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 10 monclient: dump: 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:02.992 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:02.993 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:02.993 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:06:02.809+0000 7f0fa3fff640 4 set_mon_vals no callback set 2024-09-12T18:06:02.993 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:06:02.809+0000 7f10cee579c0 5 monclient: authenticate success, global_id 7250 2024-09-12T18:06:02.993 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.993 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.993 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _renew_subs 2024-09-12T18:06:02.993 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:06:02.809+0000 7f10cee579c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.993 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:06:02.809+0000 7f10cee579c0 1 librados: init done 2024-09-12T18:06:02.993 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:06:02.809+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command cr dump hook 0x557fda8eff98 2024-09-12T18:06:02.993 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:06:02.809+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.993 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:06:02.809+0000 7f0fa27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:06:02.813+0000 7f10cc95d640 10 monclient: get_auth_request con 0x7f0f98070ae0 auth_method 0 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:06:02.813+0000 7f10cd15e640 10 monclient: get_auth_request con 0x557fda919c90 auth_method 0 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 realm 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:06:02.813+0000 7f10cee579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:06:02.813+0000 7f10cc95d640 10 monclient: get_auth_request con 0x557fda91dce0 auth_method 0 2024-09-12T18:06:02.994 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:06:02.813+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:06:02.813+0000 7f10cc15c640 10 monclient: get_auth_request con 0x557fda9215a0 auth_method 0 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:06:02.817+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:06:02.817+0000 7f10cee579c0 20 searching for the correct realm 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:06:02.817+0000 7f10cd15e640 10 monclient: get_auth_request con 0x557fda926340 auth_method 0 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:06:02.817+0000 7f10cc95d640 10 monclient: get_auth_request con 0x7f10c40bfb60 auth_method 0 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:06:02.817+0000 7f10cc15c640 10 monclient: get_auth_request con 0x7f10c0050070 auth_method 0 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:06:02.821+0000 7f10cd15e640 0 -- 172.21.15.157:0/2230630183 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x557fda919c90 msgr2=0x557fda91c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:06:02.821+0000 7f0fa27fc640 1 client.7250.objecter ms_handle_reset 0x557fda919c90 session 0x557fda919610 osd.1 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:06:02.821+0000 7f0fa27fc640 10 monclient: _renew_subs 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:06:02.821+0000 7f0fa27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:06:02.821+0000 7f10cd15e640 10 monclient: get_auth_request con 0x7f0f98080880 auth_method 0 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:06:02.821+0000 7f10cd15e640 10 monclient: get_auth_request con 0x7f10c003b8f0 auth_method 0 2024-09-12T18:06:02.995 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:06:02.825+0000 7f10cc95d640 10 monclient: get_auth_request con 0x7f10c0043b80 auth_method 0 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:06:02.829+0000 7f10cc15c640 0 -- 172.21.15.157:0/2230630183 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f10c0050070 msgr2=0x7f10c00309e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:06:02.829+0000 7f0fa27fc640 1 client.7250.objecter ms_handle_reset 0x7f10c0050070 session 0x7f10c0033070 osd.4 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:06:02.829+0000 7f10cc15c640 10 monclient: get_auth_request con 0x557fda919c90 auth_method 0 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:06:02.833+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.996 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 zone default found 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:06:02.837+0000 7f10cee579c0 4 Realm: () 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:06:02.837+0000 7f10cee579c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:06:02.837+0000 7f10cee579c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:06:02.837+0000 7f10cee579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 zonegroup default 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:02.997 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 started sync module instance, tier type = 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:06:02.837+0000 7f10cee579c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=0 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=1 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=2 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=3 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=4 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=5 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=6 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:06:02.853+0000 7f10cee579c0 20 add_watcher() i=7 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:06:02.853+0000 7f10cee579c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding auth protocol: cephx 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding auth protocol: cephx 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding auth protocol: cephx 2024-09-12T18:06:02.998 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:06:02.857+0000 7f0f837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: crc 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 AuthRegistry(0x7ffc58049030) adding con mode: secure 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:06:02.857+0000 7f10cee579c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:02.999 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:06:02.857+0000 7f10cee579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:06:02.857+0000 7f10cee579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command cache list hook 0x557fda8f0570 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command cache inspect hook 0x557fda8f0570 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command cache erase hook 0x557fda8f0570 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command cache zap hook 0x557fda8f0570 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 note: GC not initialized 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:06:02.857+0000 7f0f827e4640 20 reqs_thread_entry: start 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command sync trace show hook 0x7f10c0008ed0 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command sync trace history hook 0x7f10c0008ed0 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command sync trace active hook 0x7f10c0008ed0 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:06:02.857+0000 7f10cee579c0 5 asok(0x557fda6262b0) register_command sync trace active_short hook 0x7f10c0008ed0 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:06:02.857+0000 7f10cee579c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:06:02.857+0000 7f10cee579c0 20 Filter name: none 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:06:02.857+0000 7f0f7bfff640 20 reqs_thread_entry: start 2024-09-12T18:06:03.000 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:06:02.857+0000 7f10cee579c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:06:02.857+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:06:02.861+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 : miss 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:06:02.861+0000 7f10cee579c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:06:02.861+0000 7f10cee579c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:06:02.861+0000 7f10cee579c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:06:02.869+0000 7f10cee579c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:03.001 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:06:02.869+0000 7f10cee579c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:06:02.869+0000 7f10cee579c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:06:02.869+0000 7f10cee579c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36, ofs0, ns] 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94007616189584 notifier 7250 bl.length()=923 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:06:02.869+0000 7f0fa3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_sources= new_sources= 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential sources added=[] removed=[] 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_dests= new_dests= 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:06:02.873+0000 7f10cee579c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential dests added=[] removed=[] 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:06:02.877+0000 7f10cee579c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f10cee579c0 time 2024-09-12T18:06:02.879438+0000 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:03.002 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f10d27312eb] 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f10d273149f] 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557fd894b0c1] 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x14100ec) [0x557fd93a10ec] 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557fd895d18d] 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10d1597d90] 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:06:02.877+0000 7f10cee579c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f10cee579c0 thread_name:radosgw-admin 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:03.003 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f10d15b0520] 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f10d2731345] 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f10d273149f] 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557fd894b0c1] 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x14100ec) [0x557fd93a10ec] 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557fd895d18d] 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f10d1597d90] 2024-09-12T18:06:03.004 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:06:03.005 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:06:03.006 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:06:03.007 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:06:03.008 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:06:03.009 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:06:03.010 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0f7bfff640 / http_manager 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0f827e4640 / http_manager 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0f837e6640 / rgw_dt_lg_renew 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0fa27fc640 / ms_dispatch 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0fa3fff640 / io_context_pool 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0fb27fc640 / ms_dispatch 2024-09-12T18:06:03.011 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0fb960a640 / ms_dispatch 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr: 7f0fbae0d640 / io_context_pool 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr: 7f10cc15c640 / msgr-worker-2 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr: 7f10cc95d640 / msgr-worker-1 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr: 7f10cd15e640 / msgr-worker-0 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr: 7f10cd95f640 / io_context_pool 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr: 7f10cee579c0 / radosgw-admin 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:06:02.882012Z_e6324113-84ca-4859-814a-d1d60d115041/log 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:06:03.012 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T18:06:03.014 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:03.014 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:03.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.961+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.961+0000 7f5ce52f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.961+0000 7f5ce52f59c0 20 realm 2024-09-12T18:06:03.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.961+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.961+0000 7f5ce52f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.961+0000 7f5ce52f59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:03.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.961+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.961+0000 7f5ce52f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.961+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.965+0000 7f5ce52f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:03.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.965+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.965+0000 7f5ce52f59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:03.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.965+0000 7f5ce52f59c0 20 searching for the correct realm 2024-09-12T18:06:03.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:02.969+0000 7f5ce25fa640 0 -- 172.21.15.157:0/3865369007 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f5cd806a530 msgr2=0x7f5cd8060400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:03.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.185+0000 7f5ce2dfb640 0 -- 172.21.15.157:0/3865369007 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f5cd8029050 msgr2=0x7f5cd8086880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:03.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.401+0000 7f5ce52f59c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:03.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.401+0000 7f5ce52f59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:03.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.401+0000 7f5ce52f59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:03.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.401+0000 7f5ce52f59c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:03.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.401+0000 7f5ce52f59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:03.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.401+0000 7f5ce52f59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:03.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.401+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.401+0000 7f5ce52f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.401+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.401+0000 7f5ce52f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:03.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.401+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:03.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 20 zone default found 2024-09-12T18:06:03.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 4 Realm: () 2024-09-12T18:06:03.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:03.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:03.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:03.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 20 zonegroup default 2024-09-12T18:06:03.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 20 started sync module instance, tier type = 2024-09-12T18:06:03.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.405+0000 7f5ce52f59c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:03.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.429+0000 7f5ce52f59c0 20 add_watcher() i=0 2024-09-12T18:06:03.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.429+0000 7f5ce52f59c0 20 add_watcher() i=1 2024-09-12T18:06:03.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.429+0000 7f5ce52f59c0 20 add_watcher() i=2 2024-09-12T18:06:03.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.429+0000 7f5ce52f59c0 20 add_watcher() i=3 2024-09-12T18:06:03.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.429+0000 7f5ce52f59c0 20 add_watcher() i=4 2024-09-12T18:06:03.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.429+0000 7f5ce52f59c0 20 add_watcher() i=5 2024-09-12T18:06:03.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.429+0000 7f5ce52f59c0 20 add_watcher() i=6 2024-09-12T18:06:03.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.433+0000 7f5ce52f59c0 20 add_watcher() i=7 2024-09-12T18:06:03.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.433+0000 7f5ce52f59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:03.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.437+0000 7f5b997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:03.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.437+0000 7f5ce52f59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:03.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.437+0000 7f5ce52f59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:03.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.437+0000 7f5ce52f59c0 5 note: GC not initialized 2024-09-12T18:06:03.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.437+0000 7f5b13fff640 20 reqs_thread_entry: start 2024-09-12T18:06:03.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.437+0000 7f5ce52f59c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:03.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.437+0000 7f5ce52f59c0 20 Filter name: none 2024-09-12T18:06:03.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.437+0000 7f5b11ffb640 20 reqs_thread_entry: start 2024-09-12T18:06:03.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.437+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.441+0000 7f5ce52f59c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:03.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.441+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.441+0000 7f5ce52f59c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:06:03.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.441+0000 7f5ce52f59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:03.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.441+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.441+0000 7f5ce52f59c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:03.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.441+0000 7f5ce52f59c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.445+0000 7f5ce52f59c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:06:03.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.445+0000 7f5ce52f59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:03.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.445+0000 7f5b997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:03.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.449+0000 7f5ce52f59c0 20 remove_watcher() i=0 2024-09-12T18:06:03.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.449+0000 7f5ce52f59c0 2 removed watcher, disabling cache 2024-09-12T18:06:03.452 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.453+0000 7f5ce52f59c0 20 remove_watcher() i=1 2024-09-12T18:06:03.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.453+0000 7f5ce52f59c0 20 remove_watcher() i=2 2024-09-12T18:06:03.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.457+0000 7f5ce52f59c0 20 remove_watcher() i=3 2024-09-12T18:06:03.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.461+0000 7f5ce52f59c0 20 remove_watcher() i=4 2024-09-12T18:06:03.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.461+0000 7f5ce52f59c0 20 remove_watcher() i=5 2024-09-12T18:06:03.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.461+0000 7f5ce52f59c0 20 remove_watcher() i=6 2024-09-12T18:06:03.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.465+0000 7f5ce52f59c0 20 remove_watcher() i=7 2024-09-12T18:06:03.477 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:03.477 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:06:03.478 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-logrecord-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:06:03.478 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:03.588 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:06:03.625 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:03.625 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:03.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.669+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.669+0000 7f5f2a1069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.669+0000 7f5f2a1069c0 20 realm 2024-09-12T18:06:03.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.669+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.669+0000 7f5f2a1069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.669+0000 7f5f2a1069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:03.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.669+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.669+0000 7f5f2a1069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.669+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.672 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.673+0000 7f5f2a1069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:03.672 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.673+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.673+0000 7f5f2a1069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:03.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.673+0000 7f5f2a1069c0 20 searching for the correct realm 2024-09-12T18:06:03.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.681+0000 7f5f2840d640 0 -- 172.21.15.157:0/783249272 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f5f10029070 msgr2=0x7f5f10038990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:03.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.897+0000 7f5f27c0c640 0 -- 172.21.15.157:0/783249272 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55a61ad9b200 msgr2=0x55a61ad9d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:03.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.905+0000 7f5f2a1069c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:03.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.905+0000 7f5f2a1069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:03.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.905+0000 7f5f2a1069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:03.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.905+0000 7f5f2a1069c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:03.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.905+0000 7f5f2a1069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:03.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.905+0000 7f5f2a1069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:03.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.905+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.905+0000 7f5f2a1069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.905+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.905+0000 7f5f2a1069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:03.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.905+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:03.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 20 zone default found 2024-09-12T18:06:03.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 4 Realm: () 2024-09-12T18:06:03.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:03.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:03.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:03.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 20 zonegroup default 2024-09-12T18:06:03.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:03.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 20 started sync module instance, tier type = 2024-09-12T18:06:03.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.909+0000 7f5f2a1069c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:03.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.933+0000 7f5f2a1069c0 20 add_watcher() i=0 2024-09-12T18:06:03.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.933+0000 7f5f2a1069c0 20 add_watcher() i=1 2024-09-12T18:06:03.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.933+0000 7f5f2a1069c0 20 add_watcher() i=2 2024-09-12T18:06:03.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.933+0000 7f5f2a1069c0 20 add_watcher() i=3 2024-09-12T18:06:03.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.933+0000 7f5f2a1069c0 20 add_watcher() i=4 2024-09-12T18:06:03.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.933+0000 7f5f2a1069c0 20 add_watcher() i=5 2024-09-12T18:06:03.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.933+0000 7f5f2a1069c0 20 add_watcher() i=6 2024-09-12T18:06:03.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.937+0000 7f5f2a1069c0 20 add_watcher() i=7 2024-09-12T18:06:03.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.937+0000 7f5f2a1069c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:03.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.941+0000 7f5dddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:03.940 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.941+0000 7f5f2a1069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:03.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.941+0000 7f5f2a1069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:03.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.941+0000 7f5f2a1069c0 5 note: GC not initialized 2024-09-12T18:06:03.941 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.941+0000 7f5ddcfe1640 20 reqs_thread_entry: start 2024-09-12T18:06:03.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.941+0000 7f5f2a1069c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:03.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.941+0000 7f5f2a1069c0 20 Filter name: none 2024-09-12T18:06:03.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.941+0000 7f5d567fc640 20 reqs_thread_entry: start 2024-09-12T18:06:03.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.941+0000 7f5f2a1069c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:06:03.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.941+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:03.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:06:03.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:06:03.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 : miss 2024-09-12T18:06:03.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:03.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:06:03.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:03.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:03.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:03.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:03.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 2024-09-12T18:06:03.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.945+0000 7f5f2a1069c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to be held by another RGW process; skipping for now 2024-09-12T18:06:03.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.949+0000 7f5dddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:03.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.953+0000 7f5f2a1069c0 20 remove_watcher() i=0 2024-09-12T18:06:03.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.953+0000 7f5f2a1069c0 2 removed watcher, disabling cache 2024-09-12T18:06:03.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.953+0000 7f5f2a1069c0 20 remove_watcher() i=1 2024-09-12T18:06:03.956 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.957+0000 7f5f2a1069c0 20 remove_watcher() i=2 2024-09-12T18:06:03.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.961+0000 7f5f2a1069c0 20 remove_watcher() i=3 2024-09-12T18:06:03.960 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.961+0000 7f5f2a1069c0 20 remove_watcher() i=4 2024-09-12T18:06:03.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.961+0000 7f5f2a1069c0 20 remove_watcher() i=5 2024-09-12T18:06:03.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.965+0000 7f5f2a1069c0 20 remove_watcher() i=6 2024-09-12T18:06:03.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:03.965+0000 7f5f2a1069c0 20 remove_watcher() i=7 2024-09-12T18:06:03.979 INFO:tasks.workunit.client.0.smithi157.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:06:34.008 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:06:34.045 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:34.045 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:34.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.088+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.092+0000 7f797c7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.092+0000 7f797c7559c0 20 realm 2024-09-12T18:06:34.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.092+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.092+0000 7f797c7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.092+0000 7f797c7559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:34.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.092+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.092+0000 7f797c7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.092+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.096+0000 7f797c7559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:34.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.096+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.096+0000 7f797c7559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:34.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.096+0000 7f797c7559c0 20 searching for the correct realm 2024-09-12T18:06:34.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.100+0000 7f7979a5a640 0 -- 172.21.15.157:0/2545916002 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f7970071040 msgr2=0x7f797006f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:34.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.108+0000 7f7979a5a640 0 -- 172.21.15.157:0/2545916002 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f7844080930 msgr2=0x7f7844082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:34.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.112+0000 7f797c7559c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:34.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.112+0000 7f797c7559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:34.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.112+0000 7f797c7559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:34.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.112+0000 7f797c7559c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:34.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.112+0000 7f797c7559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:34.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.112+0000 7f797c7559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:34.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.112+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.112+0000 7f797c7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.112+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:34.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:34.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 zone default found 2024-09-12T18:06:34.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 4 Realm: () 2024-09-12T18:06:34.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:34.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:34.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:34.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 zonegroup default 2024-09-12T18:06:34.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 started sync module instance, tier type = 2024-09-12T18:06:34.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.116+0000 7f797c7559c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:34.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.132+0000 7f797c7559c0 20 add_watcher() i=0 2024-09-12T18:06:34.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.132+0000 7f797c7559c0 20 add_watcher() i=1 2024-09-12T18:06:34.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.132+0000 7f797c7559c0 20 add_watcher() i=2 2024-09-12T18:06:34.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.132+0000 7f797c7559c0 20 add_watcher() i=3 2024-09-12T18:06:34.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.132+0000 7f797c7559c0 20 add_watcher() i=4 2024-09-12T18:06:34.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.132+0000 7f797c7559c0 20 add_watcher() i=5 2024-09-12T18:06:34.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.132+0000 7f797c7559c0 20 add_watcher() i=6 2024-09-12T18:06:34.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.136+0000 7f797c7559c0 20 add_watcher() i=7 2024-09-12T18:06:34.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.136+0000 7f797c7559c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:34.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.136+0000 7f78317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:34.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.136+0000 7f797c7559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:34.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.136+0000 7f797c7559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:34.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.136+0000 7f797c7559c0 5 note: GC not initialized 2024-09-12T18:06:34.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.136+0000 7f782b7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:34.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.136+0000 7f797c7559c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:34.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.136+0000 7f797c7559c0 20 Filter name: none 2024-09-12T18:06:34.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f78297fa640 20 reqs_thread_entry: start 2024-09-12T18:06:34.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:06:34.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:34.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:06:34.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:06:34.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 : miss 2024-09-12T18:06:34.141 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:06:34.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:34.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:34.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:34.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:34.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.140+0000 7f797c7559c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 2024-09-12T18:06:34.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.144+0000 7f797c7559c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:06:34.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.148+0000 7f797c7559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:34.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.148+0000 7f797c7559c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:34.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.148+0000 7f797c7559c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:34.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.148+0000 7f797c7559c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36, ofs0, ns] 2024-09-12T18:06:34.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.152+0000 7f785dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464366 cookie 94307850939344 notifier 7845 bl.length()=923 2024-09-12T18:06:34.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.152+0000 7f785dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:34.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.152+0000 7f785dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:34.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.152+0000 7f785dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:34.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.152+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_sources= new_sources= 2024-09-12T18:06:34.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.152+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential sources added=[] removed=[] 2024-09-12T18:06:34.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.152+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_dests= new_dests= 2024-09-12T18:06:34.154 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.152+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential dests added=[] removed=[] 2024-09-12T18:06:34.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.160+0000 7f797c7559c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36.2.0 2024-09-12T18:06:34.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.160+0000 7f797c7559c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36.2.0 2024-09-12T18:06:34.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.160+0000 7f797c7559c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36.2.1 2024-09-12T18:06:34.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.160+0000 7f797c7559c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36.2.1 2024-09-12T18:06:34.160 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.160+0000 7f797c7559c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36.0 2024-09-12T18:06:34.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.164+0000 7f797c7559c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:34.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.164+0000 7f797c7559c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 2024-09-12T18:06:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f797c7559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f797c7559c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f797c7559c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f797c7559c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36, ofs0, ns] 2024-09-12T18:06:34.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f785dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464367 cookie 94307850939344 notifier 7845 bl.length()=923 2024-09-12T18:06:34.168 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f785dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:34.168 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f785dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:34.168 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f785dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_sources= new_sources= 2024-09-12T18:06:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential sources added=[] removed=[] 2024-09-12T18:06:34.169 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_dests= new_dests= 2024-09-12T18:06:34.170 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.168+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential dests added=[] removed=[] 2024-09-12T18:06:34.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.172+0000 7f797c7559c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36.0 2024-09-12T18:06:34.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.172+0000 7f797c7559c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:34.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.172+0000 7f797c7559c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 2024-09-12T18:06:34.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.176+0000 7f797c7559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:34.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.176+0000 7f797c7559c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:34.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.176+0000 7f797c7559c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:34.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.176+0000 7f797c7559c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36, ofs0, ns] 2024-09-12T18:06:34.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.176+0000 7f785dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464368 cookie 94307850939344 notifier 7845 bl.length()=891 2024-09-12T18:06:34.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.176+0000 7f785dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 info.flags=0x17 2024-09-12T18:06:34.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.176+0000 7f785dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 to cache LRU end 2024-09-12T18:06:34.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.176+0000 7f785dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:34.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.180+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_sources= new_sources= 2024-09-12T18:06:34.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.180+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential sources added=[] removed=[] 2024-09-12T18:06:34.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.180+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): orig_dests= new_dests= 2024-09-12T18:06:34.180 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.180+0000 7f797c7559c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36]): potential dests added=[] removed=[] 2024-09-12T18:06:34.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.180+0000 7f797c7559c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T18:06:34.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.184+0000 7f78317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:34.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.192+0000 7f797c7559c0 20 remove_watcher() i=0 2024-09-12T18:06:34.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.192+0000 7f797c7559c0 2 removed watcher, disabling cache 2024-09-12T18:06:34.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.192+0000 7f797c7559c0 20 remove_watcher() i=1 2024-09-12T18:06:34.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.196+0000 7f797c7559c0 20 remove_watcher() i=2 2024-09-12T18:06:34.197 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.196+0000 7f797c7559c0 20 remove_watcher() i=3 2024-09-12T18:06:34.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.200+0000 7f797c7559c0 20 remove_watcher() i=4 2024-09-12T18:06:34.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.200+0000 7f797c7559c0 20 remove_watcher() i=5 2024-09-12T18:06:34.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.200+0000 7f797c7559c0 20 remove_watcher() i=6 2024-09-12T18:06:34.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.204+0000 7f797c7559c0 20 remove_watcher() i=7 2024-09-12T18:06:34.222 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T18:06:34.249 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:34.249 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:34.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.292+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 20 realm 2024-09-12T18:06:34.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:34.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.296 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:34.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:34.298 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.296+0000 7f6f9c1ac9c0 20 searching for the correct realm 2024-09-12T18:06:34.304 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.304+0000 7f6f9a4b3640 0 -- 172.21.15.157:0/494108842 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f6f84066d40 msgr2=0x7f6f8407d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:34.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.520+0000 7f6f99cb2640 0 -- 172.21.15.157:0/494108842 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55d978b6b430 msgr2=0x55d978b6d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:34.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.528+0000 7f6f9c1ac9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:34.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.528+0000 7f6f9c1ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:34.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.528+0000 7f6f9c1ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:34.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.528+0000 7f6f9c1ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:34.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.528+0000 7f6f9c1ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:34.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.528+0000 7f6f9c1ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:34.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.528+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.528+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.528+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:34.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:34.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 zone default found 2024-09-12T18:06:34.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 4 Realm: () 2024-09-12T18:06:34.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:34.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:34.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:34.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 zonegroup default 2024-09-12T18:06:34.532 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:34.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 started sync module instance, tier type = 2024-09-12T18:06:34.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.532+0000 7f6f9c1ac9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:34.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.556+0000 7f6f9c1ac9c0 20 add_watcher() i=0 2024-09-12T18:06:34.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.556+0000 7f6f9c1ac9c0 20 add_watcher() i=1 2024-09-12T18:06:34.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.556+0000 7f6f9c1ac9c0 20 add_watcher() i=2 2024-09-12T18:06:34.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.556+0000 7f6f9c1ac9c0 20 add_watcher() i=3 2024-09-12T18:06:34.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.556+0000 7f6f9c1ac9c0 20 add_watcher() i=4 2024-09-12T18:06:34.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.556+0000 7f6f9c1ac9c0 20 add_watcher() i=5 2024-09-12T18:06:34.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.556+0000 7f6f9c1ac9c0 20 add_watcher() i=6 2024-09-12T18:06:34.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.560+0000 7f6f9c1ac9c0 20 add_watcher() i=7 2024-09-12T18:06:34.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.560+0000 7f6f9c1ac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:34.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.564+0000 7f6e4ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:34.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.564+0000 7f6f9c1ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:34.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.564+0000 7f6f9c1ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:34.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.564+0000 7f6f9c1ac9c0 5 note: GC not initialized 2024-09-12T18:06:34.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.564+0000 7f6e4efe5640 20 reqs_thread_entry: start 2024-09-12T18:06:34.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.564+0000 7f6f9c1ac9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:34.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.564+0000 7f6f9c1ac9c0 20 Filter name: none 2024-09-12T18:06:34.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.564+0000 7f6e4cfe1640 20 reqs_thread_entry: start 2024-09-12T18:06:34.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.564+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.564+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:34.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.564+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.568+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:34.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.568+0000 7f6f9c1ac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:34.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.568+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.568+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:34.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.568+0000 7f6f9c1ac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:34.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.568+0000 7f6f9c1ac9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:34.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.568+0000 7f6f9c1ac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:34.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.572+0000 7f6e4ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:34.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.576+0000 7f6f9c1ac9c0 20 remove_watcher() i=0 2024-09-12T18:06:34.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.576+0000 7f6f9c1ac9c0 2 removed watcher, disabling cache 2024-09-12T18:06:34.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.580+0000 7f6f9c1ac9c0 20 remove_watcher() i=1 2024-09-12T18:06:34.582 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.580+0000 7f6f9c1ac9c0 20 remove_watcher() i=2 2024-09-12T18:06:34.584 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.584+0000 7f6f9c1ac9c0 20 remove_watcher() i=3 2024-09-12T18:06:34.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.584+0000 7f6f9c1ac9c0 20 remove_watcher() i=4 2024-09-12T18:06:34.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.588+0000 7f6f9c1ac9c0 20 remove_watcher() i=5 2024-09-12T18:06:34.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.588+0000 7f6f9c1ac9c0 20 remove_watcher() i=6 2024-09-12T18:06:34.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:34.588+0000 7f6f9c1ac9c0 20 remove_watcher() i=7 2024-09-12T18:06:34.605 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:34.605 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:06:34.605 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-logrecord-writes id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:06:34.605 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:35.366 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T18:06:35.366 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:37.517 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:06:37.550 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:37.550 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:37.595 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.596+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.596+0000 7f481a7be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:37.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.596+0000 7f481a7be9c0 20 realm 2024-09-12T18:06:37.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.596+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.596+0000 7f481a7be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:37.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.596+0000 7f481a7be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:37.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.596+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.596+0000 7f481a7be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:37.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.596+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.600+0000 7f481a7be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:37.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.600+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.600+0000 7f481a7be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:37.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.600+0000 7f481a7be9c0 20 searching for the correct realm 2024-09-12T18:06:37.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.604+0000 7f4817ac3640 0 -- 172.21.15.157:0/753779866 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f480c018070 msgr2=0x7f480c05bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:37.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.612+0000 7f4817ac3640 0 -- 172.21.15.157:0/753779866 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f46e0080900 msgr2=0x7f46e0082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:37.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.616+0000 7f481a7be9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:37.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.616+0000 7f481a7be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:37.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.616+0000 7f481a7be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:37.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.616+0000 7f481a7be9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:37.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.616+0000 7f481a7be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:37.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.616+0000 7f481a7be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:37.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.616+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.616+0000 7f481a7be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:37.619 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.616+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:37.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:37.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 zone default found 2024-09-12T18:06:37.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 4 Realm: () 2024-09-12T18:06:37.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 zonegroup default 2024-09-12T18:06:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:37.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 started sync module instance, tier type = 2024-09-12T18:06:37.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.620+0000 7f481a7be9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:37.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.636+0000 7f481a7be9c0 20 add_watcher() i=0 2024-09-12T18:06:37.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.636+0000 7f481a7be9c0 20 add_watcher() i=1 2024-09-12T18:06:37.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.636+0000 7f481a7be9c0 20 add_watcher() i=2 2024-09-12T18:06:37.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.636+0000 7f481a7be9c0 20 add_watcher() i=3 2024-09-12T18:06:37.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.636+0000 7f481a7be9c0 20 add_watcher() i=4 2024-09-12T18:06:37.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.636+0000 7f481a7be9c0 20 add_watcher() i=5 2024-09-12T18:06:37.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.636+0000 7f481a7be9c0 20 add_watcher() i=6 2024-09-12T18:06:37.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.636+0000 7f481a7be9c0 20 add_watcher() i=7 2024-09-12T18:06:37.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.636+0000 7f481a7be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:37.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f46cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:37.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f481a7be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:37.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f481a7be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:37.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f481a7be9c0 5 note: GC not initialized 2024-09-12T18:06:37.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f46cdfdb640 20 reqs_thread_entry: start 2024-09-12T18:06:37.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f481a7be9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:37.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f481a7be9c0 20 Filter name: none 2024-09-12T18:06:37.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f463f7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:37.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f481a7be9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:37.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f481a7be9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:37.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f481a7be9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:37.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.640+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.644+0000 7f481a7be9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:37.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.644+0000 7f481a7be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.644+0000 7f481a7be9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:37.644 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.644+0000 7f481a7be9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:37.646 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.644+0000 7f46cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:37.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.652+0000 7f481a7be9c0 20 remove_watcher() i=0 2024-09-12T18:06:37.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.652+0000 7f481a7be9c0 2 removed watcher, disabling cache 2024-09-12T18:06:37.653 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.652+0000 7f481a7be9c0 20 remove_watcher() i=1 2024-09-12T18:06:37.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.656+0000 7f481a7be9c0 20 remove_watcher() i=2 2024-09-12T18:06:37.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.656+0000 7f481a7be9c0 20 remove_watcher() i=3 2024-09-12T18:06:37.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.660+0000 7f481a7be9c0 20 remove_watcher() i=4 2024-09-12T18:06:37.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.660+0000 7f481a7be9c0 20 remove_watcher() i=5 2024-09-12T18:06:37.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.660+0000 7f481a7be9c0 20 remove_watcher() i=6 2024-09-12T18:06:37.663 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.664+0000 7f481a7be9c0 20 remove_watcher() i=7 2024-09-12T18:06:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:37.676 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:06:37.676 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-change-reshard-state id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:06:37.676 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:37.677 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T18:06:37.708 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:37.708 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:37.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.748+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.752+0000 7f8f8fa649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.752+0000 7f8f8fa649c0 20 realm 2024-09-12T18:06:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.752+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.752+0000 7f8f8fa649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.752+0000 7f8f8fa649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.752+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.752+0000 7f8f8fa649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:37.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.752+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.752+0000 7f8f8fa649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:37.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.752+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:37.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.756+0000 7f8f8fa649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:37.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.756+0000 7f8f8fa649c0 20 searching for the correct realm 2024-09-12T18:06:37.758 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.756+0000 7f8f8cd69640 0 -- 172.21.15.157:0/528254528 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f8f78003100 msgr2=0x7f8f8401e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:37.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:37.972+0000 7f8f8d56a640 0 -- 172.21.15.157:0/528254528 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f8f84038910 msgr2=0x7f8f8401d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:38.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.188+0000 7f8f8fa649c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:38.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.188+0000 7f8f8fa649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:38.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.188+0000 7f8f8fa649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:38.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.188+0000 7f8f8fa649c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:38.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.188+0000 7f8f8fa649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:38.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.188+0000 7f8f8fa649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:38.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.188+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.188+0000 7f8f8fa649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.188+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.191 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:38.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:38.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 zone default found 2024-09-12T18:06:38.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 4 Realm: () 2024-09-12T18:06:38.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:38.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:38.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:38.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 zonegroup default 2024-09-12T18:06:38.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.194 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 started sync module instance, tier type = 2024-09-12T18:06:38.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.192+0000 7f8f8fa649c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:38.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.216+0000 7f8f8fa649c0 20 add_watcher() i=0 2024-09-12T18:06:38.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.216+0000 7f8f8fa649c0 20 add_watcher() i=1 2024-09-12T18:06:38.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.216+0000 7f8f8fa649c0 20 add_watcher() i=2 2024-09-12T18:06:38.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.216+0000 7f8f8fa649c0 20 add_watcher() i=3 2024-09-12T18:06:38.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.216+0000 7f8f8fa649c0 20 add_watcher() i=4 2024-09-12T18:06:38.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.216+0000 7f8f8fa649c0 20 add_watcher() i=5 2024-09-12T18:06:38.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.216+0000 7f8f8fa649c0 20 add_watcher() i=6 2024-09-12T18:06:38.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.220+0000 7f8f8fa649c0 20 add_watcher() i=7 2024-09-12T18:06:38.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.220+0000 7f8f8fa649c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:38.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8e437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:38.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:38.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:38.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 5 note: GC not initialized 2024-09-12T18:06:38.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8e427e4640 20 reqs_thread_entry: start 2024-09-12T18:06:38.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:38.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 20 Filter name: none 2024-09-12T18:06:38.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8db3fff640 20 reqs_thread_entry: start 2024-09-12T18:06:38.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:06:38.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:38.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:06:38.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:06:38.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 : miss 2024-09-12T18:06:38.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.224+0000 7f8f8fa649c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.228+0000 7f8f8fa649c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:38.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.228+0000 7f8f8fa649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.228+0000 7f8f8fa649c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.228+0000 7f8f8fa649c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:38.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.228+0000 7f8f8fa649c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.228+0000 7f8f8fa649c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 2024-09-12T18:06:38.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.236+0000 7f8f8fa649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.236+0000 7f8f8fa649c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.236+0000 7f8f8fa649c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.236+0000 7f8f8fa649c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37, ofs0, ns] 2024-09-12T18:06:38.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.236+0000 7f8e5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94760265136592 notifier 7352 bl.length()=931 2024-09-12T18:06:38.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.236+0000 7f8e5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.236+0000 7f8e5ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.236+0000 7f8e5ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.240+0000 7f8f8fa649c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): orig_sources= new_sources= 2024-09-12T18:06:38.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.240+0000 7f8f8fa649c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): potential sources added=[] removed=[] 2024-09-12T18:06:38.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.240+0000 7f8f8fa649c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): orig_dests= new_dests= 2024-09-12T18:06:38.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.240+0000 7f8f8fa649c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): potential dests added=[] removed=[] 2024-09-12T18:06:38.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.244+0000 7f8f8fa649c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37.1.0 2024-09-12T18:06:38.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.244+0000 7f8f8fa649c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37.1.0 2024-09-12T18:06:38.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.244+0000 7f8f8fa649c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37.1.1 2024-09-12T18:06:38.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.244+0000 7f8f8fa649c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37.1.1 2024-09-12T18:06:38.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.244+0000 7f8f8fa649c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37.0 2024-09-12T18:06:38.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.252+0000 7f8f8fa649c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T18:06:38.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.252+0000 7f8f8fa649c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T18:06:38.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.264+0000 7f8f8fa649c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:38.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.264+0000 7f8f8fa649c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 2024-09-12T18:06:38.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.264+0000 7f8f8fa649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.264+0000 7f8f8fa649c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.264+0000 7f8f8fa649c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.264+0000 7f8f8fa649c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37, ofs0, ns] 2024-09-12T18:06:38.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.268+0000 7f8e5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464320 cookie 94760265136592 notifier 7352 bl.length()=899 2024-09-12T18:06:38.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.268+0000 7f8e5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.268+0000 7f8e5ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.268+0000 7f8e5ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.268+0000 7f8f8fa649c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): orig_sources= new_sources= 2024-09-12T18:06:38.269 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.268+0000 7f8f8fa649c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): potential sources added=[] removed=[] 2024-09-12T18:06:38.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.268+0000 7f8f8fa649c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): orig_dests= new_dests= 2024-09-12T18:06:38.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.268+0000 7f8f8fa649c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): potential dests added=[] removed=[] 2024-09-12T18:06:38.270 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.268+0000 7f8f8fa649c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T18:06:38.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.272+0000 7f8e437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:38.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.280+0000 7f8f8fa649c0 20 remove_watcher() i=0 2024-09-12T18:06:38.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.280+0000 7f8f8fa649c0 2 removed watcher, disabling cache 2024-09-12T18:06:38.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.280+0000 7f8f8fa649c0 20 remove_watcher() i=1 2024-09-12T18:06:38.284 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.284+0000 7f8f8fa649c0 20 remove_watcher() i=2 2024-09-12T18:06:38.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.284+0000 7f8f8fa649c0 20 remove_watcher() i=3 2024-09-12T18:06:38.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.288+0000 7f8f8fa649c0 20 remove_watcher() i=4 2024-09-12T18:06:38.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.288+0000 7f8f8fa649c0 20 remove_watcher() i=5 2024-09-12T18:06:38.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.292+0000 7f8f8fa649c0 20 remove_watcher() i=6 2024-09-12T18:06:38.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.292+0000 7f8f8fa649c0 20 remove_watcher() i=7 2024-09-12T18:06:38.308 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:06:38.339 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:38.339 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:38.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.380+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 20 realm 2024-09-12T18:06:38.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:38.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:38.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:38.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.384+0000 7f4ff093e9c0 20 searching for the correct realm 2024-09-12T18:06:38.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.392+0000 7f4feec45640 0 -- 172.21.15.157:0/4147490513 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x561d18972f20 msgr2=0x561d18975310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:38.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.396+0000 7f4fee444640 0 -- 172.21.15.157:0/4147490513 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f4fe4105440 msgr2=0x7f4fe41230c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:38.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.404+0000 7f4ff093e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:38.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.404+0000 7f4ff093e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:38.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.404+0000 7f4ff093e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:38.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.404+0000 7f4ff093e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:38.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.404+0000 7f4ff093e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:38.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.404+0000 7f4ff093e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:38.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.404+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.404+0000 7f4ff093e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.404+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:38.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:38.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 zone default found 2024-09-12T18:06:38.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 4 Realm: () 2024-09-12T18:06:38.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:38.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:38.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:38.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 zonegroup default 2024-09-12T18:06:38.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 started sync module instance, tier type = 2024-09-12T18:06:38.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.408+0000 7f4ff093e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:38.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.424+0000 7f4ff093e9c0 20 add_watcher() i=0 2024-09-12T18:06:38.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.424+0000 7f4ff093e9c0 20 add_watcher() i=1 2024-09-12T18:06:38.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.424+0000 7f4ff093e9c0 20 add_watcher() i=2 2024-09-12T18:06:38.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.424+0000 7f4ff093e9c0 20 add_watcher() i=3 2024-09-12T18:06:38.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.424+0000 7f4ff093e9c0 20 add_watcher() i=4 2024-09-12T18:06:38.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.424+0000 7f4ff093e9c0 20 add_watcher() i=5 2024-09-12T18:06:38.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.424+0000 7f4ff093e9c0 20 add_watcher() i=6 2024-09-12T18:06:38.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.424+0000 7f4ff093e9c0 20 add_watcher() i=7 2024-09-12T18:06:38.425 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.424+0000 7f4ff093e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:38.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ea4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:38.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ff093e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:38.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ff093e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:38.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ff093e9c0 5 note: GC not initialized 2024-09-12T18:06:38.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4e1f7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:38.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ff093e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:38.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ff093e9c0 20 Filter name: none 2024-09-12T18:06:38.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4e1d7fa640 20 reqs_thread_entry: start 2024-09-12T18:06:38.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ff093e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:38.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ff093e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:38.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ff093e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:38.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.428+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.432+0000 7f4ff093e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:38.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.432+0000 7f4ff093e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.432+0000 7f4ff093e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:38.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.432+0000 7f4ff093e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:38.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.432+0000 7f4ea4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:38.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.436+0000 7f4ff093e9c0 20 remove_watcher() i=0 2024-09-12T18:06:38.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.436+0000 7f4ff093e9c0 2 removed watcher, disabling cache 2024-09-12T18:06:38.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.440+0000 7f4ff093e9c0 20 remove_watcher() i=1 2024-09-12T18:06:38.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.440+0000 7f4ff093e9c0 20 remove_watcher() i=2 2024-09-12T18:06:38.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.444+0000 7f4ff093e9c0 20 remove_watcher() i=3 2024-09-12T18:06:38.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.444+0000 7f4ff093e9c0 20 remove_watcher() i=4 2024-09-12T18:06:38.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.448+0000 7f4ff093e9c0 20 remove_watcher() i=5 2024-09-12T18:06:38.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.448+0000 7f4ff093e9c0 20 remove_watcher() i=6 2024-09-12T18:06:38.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.448+0000 7f4ff093e9c0 20 remove_watcher() i=7 2024-09-12T18:06:38.462 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:38.462 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:06:38.462 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-change-reshard-state id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:06:38.462 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:38.568 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:06:38.603 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:38.603 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:38.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.644+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.644+0000 7f79b0aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.644+0000 7f79b0aa39c0 20 realm 2024-09-12T18:06:38.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.648+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.648+0000 7f79b0aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.648+0000 7f79b0aa39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:38.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.648+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.648+0000 7f79b0aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.648+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.648+0000 7f79b0aa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:38.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.648+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.648+0000 7f79b0aa39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:38.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.648+0000 7f79b0aa39c0 20 searching for the correct realm 2024-09-12T18:06:38.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.656+0000 7f79aedaa640 0 -- 172.21.15.157:0/4005268096 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x564e986bd520 msgr2=0x564e986bf990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:38.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.660+0000 7f79adda8640 0 -- 172.21.15.157:0/4005268096 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f79a4090b60 msgr2=0x7f79a405c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:38.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:38.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:38.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:38.668 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:38.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:38.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:38.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.669 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:38.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:38.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 zone default found 2024-09-12T18:06:38.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 4 Realm: () 2024-09-12T18:06:38.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:38.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:38.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:38.670 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 zonegroup default 2024-09-12T18:06:38.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.668+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.672+0000 7f79b0aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.672 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.672+0000 7f79b0aa39c0 20 started sync module instance, tier type = 2024-09-12T18:06:38.672 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.672+0000 7f79b0aa39c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:38.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.684+0000 7f79b0aa39c0 20 add_watcher() i=0 2024-09-12T18:06:38.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.684+0000 7f79b0aa39c0 20 add_watcher() i=1 2024-09-12T18:06:38.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.684+0000 7f79b0aa39c0 20 add_watcher() i=2 2024-09-12T18:06:38.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.684+0000 7f79b0aa39c0 20 add_watcher() i=3 2024-09-12T18:06:38.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.684+0000 7f79b0aa39c0 20 add_watcher() i=4 2024-09-12T18:06:38.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.684+0000 7f79b0aa39c0 20 add_watcher() i=5 2024-09-12T18:06:38.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.684+0000 7f79b0aa39c0 20 add_watcher() i=6 2024-09-12T18:06:38.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f79b0aa39c0 20 add_watcher() i=7 2024-09-12T18:06:38.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f79b0aa39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:38.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f7864fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:38.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f79b0aa39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:38.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f79b0aa39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:38.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f79b0aa39c0 5 note: GC not initialized 2024-09-12T18:06:38.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f77df7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:38.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f79b0aa39c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:38.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f79b0aa39c0 20 Filter name: none 2024-09-12T18:06:38.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f77dd7fa640 20 reqs_thread_entry: start 2024-09-12T18:06:38.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f79b0aa39c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:06:38.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.688+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.692+0000 7f79b0aa39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:38.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.692+0000 7f79b0aa39c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:06:38.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.692+0000 7f79b0aa39c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:06:38.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.692+0000 7f79b0aa39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 : miss 2024-09-12T18:06:38.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.692+0000 7f79b0aa39c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.692+0000 7f79b0aa39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:38.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.692+0000 7f79b0aa39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.692+0000 7f79b0aa39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.692+0000 7f79b0aa39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:38.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.692+0000 7f79b0aa39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.692 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.692+0000 7f79b0aa39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 2024-09-12T18:06:38.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.696+0000 7f79b0aa39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.696+0000 7f79b0aa39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.696+0000 7f79b0aa39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.696+0000 7f79b0aa39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37, ofs0, ns] 2024-09-12T18:06:38.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.700+0000 7f7891ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464321 cookie 94895564707712 notifier 7941 bl.length()=931 2024-09-12T18:06:38.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.700+0000 7f7891ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.700+0000 7f7891ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.700+0000 7f7891ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.700+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): orig_sources= new_sources= 2024-09-12T18:06:38.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.700+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): potential sources added=[] removed=[] 2024-09-12T18:06:38.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.700+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): orig_dests= new_dests= 2024-09-12T18:06:38.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.700+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): potential dests added=[] removed=[] 2024-09-12T18:06:38.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.708+0000 7f79b0aa39c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37.1.0 2024-09-12T18:06:38.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.708+0000 7f79b0aa39c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37.1.0 2024-09-12T18:06:38.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.708+0000 7f79b0aa39c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37.1.1 2024-09-12T18:06:38.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.708+0000 7f79b0aa39c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37.1.1 2024-09-12T18:06:38.708 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.708+0000 7f79b0aa39c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37.0 2024-09-12T18:06:38.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.712+0000 7f79b0aa39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:38.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.712+0000 7f79b0aa39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 2024-09-12T18:06:38.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.716+0000 7f79b0aa39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.716+0000 7f79b0aa39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.716+0000 7f79b0aa39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.716+0000 7f79b0aa39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37, ofs0, ns] 2024-09-12T18:06:38.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.716+0000 7f7891ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464322 cookie 94895564707712 notifier 7941 bl.length()=931 2024-09-12T18:06:38.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.716+0000 7f7891ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.716+0000 7f7891ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.716+0000 7f7891ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.720+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): orig_sources= new_sources= 2024-09-12T18:06:38.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.720+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): potential sources added=[] removed=[] 2024-09-12T18:06:38.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.720+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): orig_dests= new_dests= 2024-09-12T18:06:38.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.720+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): potential dests added=[] removed=[] 2024-09-12T18:06:38.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.720+0000 7f79b0aa39c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37.0 2024-09-12T18:06:38.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.724+0000 7f79b0aa39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:38.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.724+0000 7f79b0aa39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 2024-09-12T18:06:38.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.724+0000 7f79b0aa39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.724+0000 7f79b0aa39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.724+0000 7f79b0aa39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.724+0000 7f79b0aa39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37, ofs0, ns] 2024-09-12T18:06:38.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.724+0000 7f78917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464323 cookie 94895564707712 notifier 7941 bl.length()=899 2024-09-12T18:06:38.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.724+0000 7f78917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 info.flags=0x17 2024-09-12T18:06:38.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.724+0000 7f78917fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 to cache LRU end 2024-09-12T18:06:38.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.724+0000 7f78917fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:38.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.728+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): orig_sources= new_sources= 2024-09-12T18:06:38.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.728+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): potential sources added=[] removed=[] 2024-09-12T18:06:38.728 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.728+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): orig_dests= new_dests= 2024-09-12T18:06:38.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.728+0000 7f79b0aa39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37]): potential dests added=[] removed=[] 2024-09-12T18:06:38.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.732+0000 7f79b0aa39c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T18:06:38.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.732+0000 7f7864fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:38.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.740+0000 7f79b0aa39c0 20 remove_watcher() i=0 2024-09-12T18:06:38.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.740+0000 7f79b0aa39c0 2 removed watcher, disabling cache 2024-09-12T18:06:38.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.740+0000 7f79b0aa39c0 20 remove_watcher() i=1 2024-09-12T18:06:38.743 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.744+0000 7f79b0aa39c0 20 remove_watcher() i=2 2024-09-12T18:06:38.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.744+0000 7f79b0aa39c0 20 remove_watcher() i=3 2024-09-12T18:06:38.747 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.748+0000 7f79b0aa39c0 20 remove_watcher() i=4 2024-09-12T18:06:38.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.748+0000 7f79b0aa39c0 20 remove_watcher() i=5 2024-09-12T18:06:38.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.748+0000 7f79b0aa39c0 20 remove_watcher() i=6 2024-09-12T18:06:38.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.752+0000 7f79b0aa39c0 20 remove_watcher() i=7 2024-09-12T18:06:38.767 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:06:38.798 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:38.798 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:38.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.840+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 20 realm 2024-09-12T18:06:38.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:38.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:38.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:38.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:38.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:38.847 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.844+0000 7f27ea8259c0 20 searching for the correct realm 2024-09-12T18:06:38.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:38.852+0000 7f27e8b2c640 0 -- 172.21.15.157:0/3058799944 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f27dc017b90 msgr2=0x7f27dc00c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:39.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.068+0000 7f27e832b640 0 -- 172.21.15.157:0/3058799944 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x562d6f1bf480 msgr2=0x562d6f1c1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:39.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:39.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:39.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:39.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:39.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:39.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:39.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:39.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:39.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:39.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:39.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:39.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:39.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 zone default found 2024-09-12T18:06:39.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 4 Realm: () 2024-09-12T18:06:39.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:39.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:39.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:39.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 zonegroup default 2024-09-12T18:06:39.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:39.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:39.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.076+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:39.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.080+0000 7f27ea8259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:39.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.080+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:39.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.080+0000 7f27ea8259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:39.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.080+0000 7f27ea8259c0 20 started sync module instance, tier type = 2024-09-12T18:06:39.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.080+0000 7f27ea8259c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:39.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.100+0000 7f27ea8259c0 20 add_watcher() i=0 2024-09-12T18:06:39.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.100+0000 7f27ea8259c0 20 add_watcher() i=1 2024-09-12T18:06:39.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.100+0000 7f27ea8259c0 20 add_watcher() i=2 2024-09-12T18:06:39.100 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.100+0000 7f27ea8259c0 20 add_watcher() i=3 2024-09-12T18:06:39.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.100+0000 7f27ea8259c0 20 add_watcher() i=4 2024-09-12T18:06:39.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.100+0000 7f27ea8259c0 20 add_watcher() i=5 2024-09-12T18:06:39.101 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.100+0000 7f27ea8259c0 20 add_watcher() i=6 2024-09-12T18:06:39.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.100+0000 7f27ea8259c0 20 add_watcher() i=7 2024-09-12T18:06:39.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.100+0000 7f27ea8259c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:39.105 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.104+0000 7f269efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:39.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.104+0000 7f27ea8259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:39.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.104+0000 7f27ea8259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:39.106 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.104+0000 7f27ea8259c0 5 note: GC not initialized 2024-09-12T18:06:39.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.104+0000 7f269dfdb640 20 reqs_thread_entry: start 2024-09-12T18:06:39.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.104+0000 7f27ea8259c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:39.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.104+0000 7f27ea8259c0 20 Filter name: none 2024-09-12T18:06:39.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.104+0000 7f260f7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:39.107 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.104+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:39.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.108+0000 7f27ea8259c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:39.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.108+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:39.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.108+0000 7f27ea8259c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:39.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.108+0000 7f27ea8259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:39.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.108+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:39.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.108+0000 7f27ea8259c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:39.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.108+0000 7f27ea8259c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:39.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.108+0000 7f27ea8259c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:39.110 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.108+0000 7f27ea8259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:39.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.112+0000 7f269efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:39.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.116+0000 7f27ea8259c0 20 remove_watcher() i=0 2024-09-12T18:06:39.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.116+0000 7f27ea8259c0 2 removed watcher, disabling cache 2024-09-12T18:06:39.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.120+0000 7f27ea8259c0 20 remove_watcher() i=1 2024-09-12T18:06:39.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.120+0000 7f27ea8259c0 20 remove_watcher() i=2 2024-09-12T18:06:39.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.124+0000 7f27ea8259c0 20 remove_watcher() i=3 2024-09-12T18:06:39.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.124+0000 7f27ea8259c0 20 remove_watcher() i=4 2024-09-12T18:06:39.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.124+0000 7f27ea8259c0 20 remove_watcher() i=5 2024-09-12T18:06:39.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.128+0000 7f27ea8259c0 20 remove_watcher() i=6 2024-09-12T18:06:39.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:39.128+0000 7f27ea8259c0 20 remove_watcher() i=7 2024-09-12T18:06:39.148 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:39.148 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:06:39.148 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-change-reshard-state id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:06:39.148 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:39.857 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T18:06:39.857 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:42.005 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:06:42.037 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:42.038 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:42.284 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.284+0000 7f1545e13640 0 --2- 172.21.15.157:0/973950687 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x559865111710 0x5598651170a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:06:42.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.288+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.288+0000 7f1548b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.288+0000 7f1548b0e9c0 20 realm 2024-09-12T18:06:42.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.288+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.288+0000 7f1548b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.288+0000 7f1548b0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:42.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.288+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.288+0000 7f1548b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.288+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.292+0000 7f1548b0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:42.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.292+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.292+0000 7f1548b0e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:42.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.292+0000 7f1548b0e9c0 20 searching for the correct realm 2024-09-12T18:06:42.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.296+0000 7f1545e13640 0 -- 172.21.15.157:0/973950687 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f153c0ed040 msgr2=0x7f153c0e0460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:42.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.512+0000 7f1546614640 0 -- 172.21.15.157:0/973950687 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f153c0c4410 msgr2=0x7f153c0c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:42.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.728+0000 7f1548b0e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:42.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.728+0000 7f1548b0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:42.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.728+0000 7f1548b0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:42.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.728+0000 7f1548b0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:42.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.728+0000 7f1548b0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:42.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.728+0000 7f1548b0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:42.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.728+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.730 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.728+0000 7f1548b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.728+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:42.731 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:42.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 zone default found 2024-09-12T18:06:42.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 4 Realm: () 2024-09-12T18:06:42.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:42.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:42.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:42.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 zonegroup default 2024-09-12T18:06:42.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 started sync module instance, tier type = 2024-09-12T18:06:42.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.732+0000 7f1548b0e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:42.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.756+0000 7f1548b0e9c0 20 add_watcher() i=0 2024-09-12T18:06:42.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.756+0000 7f1548b0e9c0 20 add_watcher() i=1 2024-09-12T18:06:42.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.756+0000 7f1548b0e9c0 20 add_watcher() i=2 2024-09-12T18:06:42.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.756+0000 7f1548b0e9c0 20 add_watcher() i=3 2024-09-12T18:06:42.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.756+0000 7f1548b0e9c0 20 add_watcher() i=4 2024-09-12T18:06:42.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.756+0000 7f1548b0e9c0 20 add_watcher() i=5 2024-09-12T18:06:42.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.756+0000 7f1548b0e9c0 20 add_watcher() i=6 2024-09-12T18:06:42.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.760+0000 7f1548b0e9c0 20 add_watcher() i=7 2024-09-12T18:06:42.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.760+0000 7f1548b0e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:42.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.764+0000 7f13fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:42.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f1548b0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:42.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f1548b0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:42.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f1548b0e9c0 5 note: GC not initialized 2024-09-12T18:06:42.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f13777fe640 20 reqs_thread_entry: start 2024-09-12T18:06:42.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f1548b0e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:42.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f1548b0e9c0 20 Filter name: none 2024-09-12T18:06:42.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f13757fa640 20 reqs_thread_entry: start 2024-09-12T18:06:42.768 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.769 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f1548b0e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:42.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f1548b0e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:42.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f1548b0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:42.770 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.768+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.771 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.772+0000 7f1548b0e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:42.771 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.772+0000 7f1548b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.772+0000 7f1548b0e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:42.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.772+0000 7f1548b0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:42.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.772+0000 7f13fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:42.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.780+0000 7f1548b0e9c0 20 remove_watcher() i=0 2024-09-12T18:06:42.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.780+0000 7f1548b0e9c0 2 removed watcher, disabling cache 2024-09-12T18:06:42.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.780+0000 7f1548b0e9c0 20 remove_watcher() i=1 2024-09-12T18:06:42.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.784+0000 7f1548b0e9c0 20 remove_watcher() i=2 2024-09-12T18:06:42.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.784+0000 7f1548b0e9c0 20 remove_watcher() i=3 2024-09-12T18:06:42.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.788+0000 7f1548b0e9c0 20 remove_watcher() i=4 2024-09-12T18:06:42.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.788+0000 7f1548b0e9c0 20 remove_watcher() i=5 2024-09-12T18:06:42.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.792+0000 7f1548b0e9c0 20 remove_watcher() i=6 2024-09-12T18:06:42.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.792+0000 7f1548b0e9c0 20 remove_watcher() i=7 2024-09-12T18:06:42.810 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:42.810 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:06:42.810 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-change-reshard-state id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:06:42.810 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:42.810 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T18:06:42.846 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:42.846 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:42.888 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.888+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.888+0000 7f12bae129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.888+0000 7f12bae129c0 20 realm 2024-09-12T18:06:42.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.888+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.888+0000 7f12bae129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.888+0000 7f12bae129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:42.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.888+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.888+0000 7f12bae129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.888+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.892+0000 7f12bae129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:42.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.892+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.892+0000 7f12bae129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:42.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.892+0000 7f12bae129c0 20 searching for the correct realm 2024-09-12T18:06:42.897 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.896+0000 7f12b9119640 0 -- 172.21.15.157:0/115957416 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x5586f498e920 msgr2=0x5586f4990d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:42.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.904+0000 7f12b8117640 0 -- 172.21.15.157:0/115957416 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f12ac036060 msgr2=0x7f12ac0644d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.908+0000 7f12bae129c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.908+0000 7f12bae129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.908+0000 7f12bae129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.908+0000 7f12bae129c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.908+0000 7f12bae129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.908+0000 7f12bae129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:42.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.908+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.908+0000 7f12bae129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.908+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:42.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:42.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 zone default found 2024-09-12T18:06:42.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 4 Realm: () 2024-09-12T18:06:42.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:42.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:42.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:42.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 zonegroup default 2024-09-12T18:06:42.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:42.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 started sync module instance, tier type = 2024-09-12T18:06:42.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.912+0000 7f12bae129c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:42.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.928+0000 7f12bae129c0 20 add_watcher() i=0 2024-09-12T18:06:42.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.928+0000 7f12bae129c0 20 add_watcher() i=1 2024-09-12T18:06:42.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.928+0000 7f12bae129c0 20 add_watcher() i=2 2024-09-12T18:06:42.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.928+0000 7f12bae129c0 20 add_watcher() i=3 2024-09-12T18:06:42.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.928+0000 7f12bae129c0 20 add_watcher() i=4 2024-09-12T18:06:42.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.928+0000 7f12bae129c0 20 add_watcher() i=5 2024-09-12T18:06:42.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.928+0000 7f12bae129c0 20 add_watcher() i=6 2024-09-12T18:06:42.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.928+0000 7f12bae129c0 20 add_watcher() i=7 2024-09-12T18:06:42.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.928+0000 7f12bae129c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:42.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f116f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:42.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:42.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:42.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 5 note: GC not initialized 2024-09-12T18:06:42.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f116e7e4640 20 reqs_thread_entry: start 2024-09-12T18:06:42.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:42.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 20 Filter name: none 2024-09-12T18:06:42.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f11677fe640 20 reqs_thread_entry: start 2024-09-12T18:06:42.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:06:42.934 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:42.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:06:42.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:06:42.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 : miss 2024-09-12T18:06:42.935 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:42.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:42.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 info.flags=0x17 2024-09-12T18:06:42.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 to cache LRU end 2024-09-12T18:06:42.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:42.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:42.936 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.932+0000 7f12bae129c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 2024-09-12T18:06:42.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.940+0000 7f12bae129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 info.flags=0x17 2024-09-12T18:06:42.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.940+0000 7f12bae129c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 to cache LRU end 2024-09-12T18:06:42.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.940+0000 7f12bae129c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:42.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.940+0000 7f12bae129c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38, ofs0, ns] 2024-09-12T18:06:42.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.940+0000 7f118ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464326 cookie 94038117704720 notifier 7436 bl.length()=931 2024-09-12T18:06:42.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.940+0000 7f118ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 info.flags=0x17 2024-09-12T18:06:42.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.940+0000 7f118ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 to cache LRU end 2024-09-12T18:06:42.943 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.940+0000 7f118ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:42.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.944+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): orig_sources= new_sources= 2024-09-12T18:06:42.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.944+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): potential sources added=[] removed=[] 2024-09-12T18:06:42.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.944+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): orig_dests= new_dests= 2024-09-12T18:06:42.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.944+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): potential dests added=[] removed=[] 2024-09-12T18:06:42.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.948+0000 7f12bae129c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38.1.0 2024-09-12T18:06:42.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.948+0000 7f12bae129c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38.1.0 2024-09-12T18:06:42.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.948+0000 7f12bae129c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38.1.1 2024-09-12T18:06:42.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.948+0000 7f12bae129c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38.1.1 2024-09-12T18:06:42.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.948+0000 7f12bae129c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38.0 2024-09-12T18:06:42.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.952+0000 7f12bae129c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T18:06:42.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.952+0000 7f12bae129c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:42.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.952+0000 7f12bae129c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 2024-09-12T18:06:42.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.952+0000 7f12bae129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 info.flags=0x17 2024-09-12T18:06:42.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.952+0000 7f12bae129c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 to cache LRU end 2024-09-12T18:06:42.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.952+0000 7f12bae129c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:42.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.952+0000 7f12bae129c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38, ofs0, ns] 2024-09-12T18:06:42.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.952+0000 7f118f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464327 cookie 94038117704720 notifier 7436 bl.length()=931 2024-09-12T18:06:42.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.952+0000 7f118f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 info.flags=0x17 2024-09-12T18:06:42.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.952+0000 7f118f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 to cache LRU end 2024-09-12T18:06:42.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.952+0000 7f118f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:42.957 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.956+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): orig_sources= new_sources= 2024-09-12T18:06:42.957 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.956+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): potential sources added=[] removed=[] 2024-09-12T18:06:42.957 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.956+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): orig_dests= new_dests= 2024-09-12T18:06:42.957 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.956+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): potential dests added=[] removed=[] 2024-09-12T18:06:42.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.956+0000 7f12bae129c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38.0 2024-09-12T18:06:42.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.956+0000 7f12bae129c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:42.958 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.956+0000 7f12bae129c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 2024-09-12T18:06:42.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.960+0000 7f12bae129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 info.flags=0x17 2024-09-12T18:06:42.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.960+0000 7f12bae129c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 to cache LRU end 2024-09-12T18:06:42.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.960+0000 7f12bae129c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:42.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.960+0000 7f12bae129c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38, ofs0, ns] 2024-09-12T18:06:42.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.960+0000 7f118f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464328 cookie 94038117704720 notifier 7436 bl.length()=899 2024-09-12T18:06:42.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.960+0000 7f118f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 info.flags=0x17 2024-09-12T18:06:42.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.960+0000 7f118f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 to cache LRU end 2024-09-12T18:06:42.962 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.960+0000 7f118f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:42.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.964+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): orig_sources= new_sources= 2024-09-12T18:06:42.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.964+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): potential sources added=[] removed=[] 2024-09-12T18:06:42.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.964+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): orig_dests= new_dests= 2024-09-12T18:06:42.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.964+0000 7f12bae129c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38]): potential dests added=[] removed=[] 2024-09-12T18:06:42.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.964+0000 7f12bae129c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T18:06:42.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.968+0000 7f116f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:42.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.972+0000 7f12bae129c0 20 remove_watcher() i=0 2024-09-12T18:06:42.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.972+0000 7f12bae129c0 2 removed watcher, disabling cache 2024-09-12T18:06:42.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.976+0000 7f12bae129c0 20 remove_watcher() i=1 2024-09-12T18:06:42.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.976+0000 7f12bae129c0 20 remove_watcher() i=2 2024-09-12T18:06:42.979 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.980+0000 7f12bae129c0 20 remove_watcher() i=3 2024-09-12T18:06:42.982 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.980+0000 7f12bae129c0 20 remove_watcher() i=4 2024-09-12T18:06:42.983 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.980+0000 7f12bae129c0 20 remove_watcher() i=5 2024-09-12T18:06:42.984 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.984+0000 7f12bae129c0 20 remove_watcher() i=6 2024-09-12T18:06:42.985 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:42.984+0000 7f12bae129c0 20 remove_watcher() i=7 2024-09-12T18:06:42.998 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:06:43.025 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:43.025 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:43.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.068+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.068+0000 7f38b94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:43.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.068+0000 7f38b94c09c0 20 realm 2024-09-12T18:06:43.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.068+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.068+0000 7f38b94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:43.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.068+0000 7f38b94c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:43.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.068+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.068+0000 7f38b94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:43.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.068+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.071 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.068+0000 7f38b94c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:43.071 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.068+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.071 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.072+0000 7f38b94c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:43.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.072+0000 7f38b94c09c0 20 searching for the correct realm 2024-09-12T18:06:43.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.076+0000 7f38b67c5640 0 -- 172.21.15.157:0/3865943159 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x556f1972f020 msgr2=0x556f197314c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:43.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.084+0000 7f38b67c5640 0 -- 172.21.15.157:0/3865943159 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f38ac0de980 msgr2=0x7f38ac0b63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:43.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.088+0000 7f38b94c09c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:43.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.088+0000 7f38b94c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:43.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.088+0000 7f38b94c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.088+0000 7f38b94c09c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.088+0000 7f38b94c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.088+0000 7f38b94c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.088+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.088+0000 7f38b94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.088+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 zone default found 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 4 Realm: () 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:43.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:43.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 zonegroup default 2024-09-12T18:06:43.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:43.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:43.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:43.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 started sync module instance, tier type = 2024-09-12T18:06:43.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.092+0000 7f38b94c09c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:43.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.108+0000 7f38b94c09c0 20 add_watcher() i=0 2024-09-12T18:06:43.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.108+0000 7f38b94c09c0 20 add_watcher() i=1 2024-09-12T18:06:43.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.108+0000 7f38b94c09c0 20 add_watcher() i=2 2024-09-12T18:06:43.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.108+0000 7f38b94c09c0 20 add_watcher() i=3 2024-09-12T18:06:43.108 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.108+0000 7f38b94c09c0 20 add_watcher() i=4 2024-09-12T18:06:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.108+0000 7f38b94c09c0 20 add_watcher() i=5 2024-09-12T18:06:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.108+0000 7f38b94c09c0 20 add_watcher() i=6 2024-09-12T18:06:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.108+0000 7f38b94c09c0 20 add_watcher() i=7 2024-09-12T18:06:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.108+0000 7f38b94c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:43.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f376d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:43.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f38b94c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:43.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f38b94c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:43.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f38b94c09c0 5 note: GC not initialized 2024-09-12T18:06:43.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f36e7fff640 20 reqs_thread_entry: start 2024-09-12T18:06:43.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f38b94c09c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:43.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f38b94c09c0 20 Filter name: none 2024-09-12T18:06:43.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f36e5ffb640 20 reqs_thread_entry: start 2024-09-12T18:06:43.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f38b94c09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:43.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f38b94c09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:43.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f38b94c09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:43.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.112+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.116+0000 7f38b94c09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:43.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.116+0000 7f38b94c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:43.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.116+0000 7f38b94c09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:43.116 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.116+0000 7f38b94c09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:43.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.116+0000 7f376d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:43.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.124+0000 7f38b94c09c0 20 remove_watcher() i=0 2024-09-12T18:06:43.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.124+0000 7f38b94c09c0 2 removed watcher, disabling cache 2024-09-12T18:06:43.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.124+0000 7f38b94c09c0 20 remove_watcher() i=1 2024-09-12T18:06:43.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.128+0000 7f38b94c09c0 20 remove_watcher() i=2 2024-09-12T18:06:43.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.128+0000 7f38b94c09c0 20 remove_watcher() i=3 2024-09-12T18:06:43.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.132+0000 7f38b94c09c0 20 remove_watcher() i=4 2024-09-12T18:06:43.132 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.132+0000 7f38b94c09c0 20 remove_watcher() i=5 2024-09-12T18:06:43.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.132+0000 7f38b94c09c0 20 remove_watcher() i=6 2024-09-12T18:06:43.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:43.132+0000 7f38b94c09c0 20 remove_watcher() i=7 2024-09-12T18:06:43.148 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:43.148 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:06:43.148 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: error-at-change-reshard-state id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T18:06:43.148 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:43.888 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T18:06:43.888 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.007 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:06:46.041 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:46.041 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:46.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.084+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.088+0000 7f2a00a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.088+0000 7f2a00a9b9c0 20 realm 2024-09-12T18:06:46.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.088+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.088+0000 7f2a00a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.088+0000 7f2a00a9b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:46.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.088+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.088+0000 7f2a00a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.088+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.088+0000 7f2a00a9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:46.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.088+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.092+0000 7f2a00a9b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:46.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.092+0000 7f2a00a9b9c0 20 searching for the correct realm 2024-09-12T18:06:46.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.096+0000 7f29feda2640 0 -- 172.21.15.157:0/2162203625 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x562551be7400 msgr2=0x562551be9850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:46.102 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.100+0000 7f29fdda0640 0 -- 172.21.15.157:0/2162203625 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f29f4008050 msgr2=0x7f29f4067a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:46.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:46.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:46.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:46.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:46.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:46.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:46.111 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.112 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 zone default found 2024-09-12T18:06:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 4 Realm: () 2024-09-12T18:06:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 zonegroup default 2024-09-12T18:06:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 started sync module instance, tier type = 2024-09-12T18:06:46.114 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.112+0000 7f2a00a9b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:46.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.128+0000 7f2a00a9b9c0 20 add_watcher() i=0 2024-09-12T18:06:46.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.128+0000 7f2a00a9b9c0 20 add_watcher() i=1 2024-09-12T18:06:46.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.128+0000 7f2a00a9b9c0 20 add_watcher() i=2 2024-09-12T18:06:46.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.128+0000 7f2a00a9b9c0 20 add_watcher() i=3 2024-09-12T18:06:46.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.128+0000 7f2a00a9b9c0 20 add_watcher() i=4 2024-09-12T18:06:46.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.128+0000 7f2a00a9b9c0 20 add_watcher() i=5 2024-09-12T18:06:46.130 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.128+0000 7f2a00a9b9c0 20 add_watcher() i=6 2024-09-12T18:06:46.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.128+0000 7f2a00a9b9c0 20 add_watcher() i=7 2024-09-12T18:06:46.131 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.128+0000 7f2a00a9b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:46.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.132+0000 7f28b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:46.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.132+0000 7f2a00a9b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:46.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.132+0000 7f2a00a9b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:46.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.132+0000 7f2a00a9b9c0 5 note: GC not initialized 2024-09-12T18:06:46.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.132+0000 7f282f7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:46.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.132+0000 7f2a00a9b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:46.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.132+0000 7f2a00a9b9c0 20 Filter name: none 2024-09-12T18:06:46.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.132+0000 7f282d7fa640 20 reqs_thread_entry: start 2024-09-12T18:06:46.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.132+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.132+0000 7f2a00a9b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:46.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.132+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.136+0000 7f2a00a9b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:46.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.136+0000 7f2a00a9b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:46.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.136+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.136+0000 7f2a00a9b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:46.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.136+0000 7f2a00a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.136+0000 7f2a00a9b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:46.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.136+0000 7f2a00a9b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:46.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.136+0000 7f28b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:46.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.140+0000 7f2a00a9b9c0 20 remove_watcher() i=0 2024-09-12T18:06:46.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.140+0000 7f2a00a9b9c0 2 removed watcher, disabling cache 2024-09-12T18:06:46.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.144+0000 7f2a00a9b9c0 20 remove_watcher() i=1 2024-09-12T18:06:46.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.144+0000 7f2a00a9b9c0 20 remove_watcher() i=2 2024-09-12T18:06:46.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.148+0000 7f2a00a9b9c0 20 remove_watcher() i=3 2024-09-12T18:06:46.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.148+0000 7f2a00a9b9c0 20 remove_watcher() i=4 2024-09-12T18:06:46.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.152+0000 7f2a00a9b9c0 20 remove_watcher() i=5 2024-09-12T18:06:46.152 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.152+0000 7f2a00a9b9c0 20 remove_watcher() i=6 2024-09-12T18:06:46.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.152+0000 7f2a00a9b9c0 20 remove_watcher() i=7 2024-09-12T18:06:46.168 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.168 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:06:46.168 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-change-reshard-state id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:06:46.168 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.168 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T18:06:46.200 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:46.201 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:46.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.240+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 realm 2024-09-12T18:06:46.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.244+0000 7f9c8140b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:46.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:46.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.248+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:46.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.248+0000 7f9c8140b9c0 20 searching for the correct realm 2024-09-12T18:06:46.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.252+0000 7f9c7e710640 0 -- 172.21.15.157:0/339816652 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f9c740f8c20 msgr2=0x7f9c740fd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:46.469 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.468+0000 7f9c7ef11640 0 -- 172.21.15.157:0/339816652 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f9c740082b0 msgr2=0x7f9c74001ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:46.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:46.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:46.686 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:46.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:46.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:46.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:46.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.687 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:46.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.688 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:46.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 zone default found 2024-09-12T18:06:46.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 4 Realm: () 2024-09-12T18:06:46.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:46.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:46.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:46.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 zonegroup default 2024-09-12T18:06:46.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.689 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.690 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 started sync module instance, tier type = 2024-09-12T18:06:46.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:46.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=0 2024-09-12T18:06:46.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=1 2024-09-12T18:06:46.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=2 2024-09-12T18:06:46.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=3 2024-09-12T18:06:46.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=4 2024-09-12T18:06:46.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=5 2024-09-12T18:06:46.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=6 2024-09-12T18:06:46.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=7 2024-09-12T18:06:46.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.716+0000 7f9c8140b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:46.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.720+0000 7f9b357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:46.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.720+0000 7f9c8140b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:46.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.720+0000 7f9c8140b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:46.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 note: GC not initialized 2024-09-12T18:06:46.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9aaffff640 20 reqs_thread_entry: start 2024-09-12T18:06:46.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:46.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 Filter name: none 2024-09-12T18:06:46.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9aadffb640 20 reqs_thread_entry: start 2024-09-12T18:06:46.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:06:46.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:46.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:06:46.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:06:46.725 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 : miss 2024-09-12T18:06:46.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:46.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:06:46.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:06:46.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:46.726 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:46.727 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 2024-09-12T18:06:46.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:06:46.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:06:46.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:46.734 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39, ofs0, ns] 2024-09-12T18:06:46.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 93932435209840 notifier 8055 bl.length()=931 2024-09-12T18:06:46.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:06:46.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:06:46.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:46.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_sources= new_sources= 2024-09-12T18:06:46.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential sources added=[] removed=[] 2024-09-12T18:06:46.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_dests= new_dests= 2024-09-12T18:06:46.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential dests added=[] removed=[] 2024-09-12T18:06:46.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.744+0000 7f9c8140b9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.0 2024-09-12T18:06:46.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.744+0000 7f9c8140b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.0 2024-09-12T18:06:46.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.744+0000 7f9c8140b9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.1 2024-09-12T18:06:46.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.744+0000 7f9c8140b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.1 2024-09-12T18:06:46.745 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.744+0000 7f9c8140b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.0 2024-09-12T18:06:46.751 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9c8140b9c0 time 2024-09-12T18:06:46.755396+0000 2024-09-12T18:06:46.751 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:46.754 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:46.754 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9c84ce52eb] 2024-09-12T18:06:46.754 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9c84ce549f] 2024-09-12T18:06:46.754 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e57b400c1] 2024-09-12T18:06:46.754 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x556e57b514f1] 2024-09-12T18:06:46.754 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556e57b52b44] 2024-09-12T18:06:46.754 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:06:46.754 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9c83b4bd90] 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f9c8140b9c0 thread_name:radosgw-admin 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.752+0000 7f9c8140b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9c8140b9c0 time 2024-09-12T18:06:46.755396+0000 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9c84ce52eb] 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9c84ce549f] 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e57b400c1] 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x556e57b514f1] 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556e57b52b44] 2024-09-12T18:06:46.755 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:06:46.756 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9c83b4bd90] 2024-09-12T18:06:46.756 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:06:46.756 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:06:46.756 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.757 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9c83b64520] 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9c84ce5345] 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9c84ce549f] 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e57b400c1] 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x556e57b514f1] 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556e57b52b44] 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9c83b4bd90] 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:06:46.758 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.756+0000 7f9c8140b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f9c8140b9c0 thread_name:radosgw-admin 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9c83b64520] 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9c84ce5345] 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9c84ce549f] 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e57b400c1] 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x556e57b514f1] 2024-09-12T18:06:46.759 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556e57b52b44] 2024-09-12T18:06:46.760 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:06:46.760 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9c83b4bd90] 2024-09-12T18:06:46.760 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:06:46.760 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:06:46.760 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:06:46.760 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.760 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:06:46.792 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:06:46.220+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.792 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:06:46.220+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.792 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:06:46.220+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.793 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:06:46.220+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.793 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:06:46.220+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.793 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:06:46.220+0000 7f9c7e710640 10 monclient(hunting): handle_auth_done global_id 8043 payload 274 2024-09-12T18:06:46.793 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:06:46.220+0000 7f9c7e710640 10 monclient: _finish_hunting 0 2024-09-12T18:06:46.793 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:06:46.220+0000 7f9c7e710640 1 monclient: found mon.noname-a 2024-09-12T18:06:46.793 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:06:46.220+0000 7f9c7e710640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.793 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.793 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:46.793 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: dump: 2024-09-12T18:06:46.793 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.793 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.794 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.794 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.794 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.794 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.794 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.794 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.794 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.794 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.794 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: _finish_auth 0 2024-09-12T18:06:46.794 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: _check_auth_tickets 2024-09-12T18:06:46.794 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: dump: 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.795 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.796 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:06:46.220+0000 7f9c8140b9c0 5 monclient: authenticate success, global_id 8043 2024-09-12T18:06:46.796 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:06:46.220+0000 7f9c8140b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:46.796 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:06:46.220+0000 7f9c8140b9c0 4 set_mon_vals no callback set 2024-09-12T18:06:46.796 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: shutdown 2024-09-12T18:06:46.796 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) unregister_commands rotate-key 2024-09-12T18:06:46.796 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:46.796 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:46.796 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: monmap: 2024-09-12T18:06:46.796 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:46.796 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:46.796 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding auth protocol: cephx 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding auth protocol: cephx 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding auth protocol: cephx 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.797 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 librados: starting msgr at 2024-09-12T18:06:46.798 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 librados: starting objecter 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command objecter_requests hook 0x556e595fa5b0 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 librados: setting wanted keys 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 librados: calling monclient init 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: init 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding auth protocol: cephx 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding auth protocol: cephx 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding auth protocol: cephx 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.799 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command rotate-key hook 0x556e595f5338 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-c con 0x556e5961e910 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-a con 0x556e5961f230 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:46.800 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-b con 0x7f9c68003100 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): authenticate will time out at 2568.449692s 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request con 0x556e5961e910 auth_method 0 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): get_auth_request con 0x556e5961f230 auth_method 0 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.801 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): handle_auth_done global_id 8046 payload 824 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient: _finish_hunting 0 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:06:46.224+0000 7f9c7e710640 1 monclient: found mon.noname-a 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.802 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.803 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:46.803 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: dump: 2024-09-12T18:06:46.803 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.803 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.803 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.803 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.803 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.803 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.803 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.803 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.803 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: _finish_auth 0 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: _check_auth_tickets 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: dump: 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.804 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 monclient: authenticate success, global_id 8046 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:06:46.224+0000 7f9b6ce09640 4 set_mon_vals no callback set 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 librados: init done 2024-09-12T18:06:46.805 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:06:46.228+0000 7f9b6b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:06:46.228+0000 7f9b6b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:06:46.228+0000 7f9b6b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:06:46.228+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x7f9b64070ae0 auth_method 0 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:06:46.228+0000 7f9c7f712640 10 monclient: get_auth_request con 0x556e5961d620 auth_method 0 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:06:46.228+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x556e59640680 auth_method 0 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:06:46.228+0000 7f9c7e710640 10 monclient: get_auth_request con 0x556e596448c0 auth_method 0 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: monmap: 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:46.806 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding auth protocol: cephx 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding auth protocol: cephx 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding auth protocol: cephx 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.807 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.808 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x556e5964d180 EEXIST 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: init 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding auth protocol: cephx 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding auth protocol: cephx 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding auth protocol: cephx 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.809 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command rotate-key cmddesc rotate-key hook 0x556e59647f40 EEXIST 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-b con 0x556e59671330 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-c con 0x556e59670c60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:46.810 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-a con 0x556e5966f640 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): authenticate will time out at 2568.458728s 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): get_auth_request con 0x556e59670c60 auth_method 0 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): get_auth_request con 0x556e5966f640 auth_method 0 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.811 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): handle_auth_done global_id 7478 payload 824 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient: _finish_hunting 0 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:06:46.232+0000 7f9c7e710640 1 monclient: found mon.noname-c 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: dump: 2024-09-12T18:06:46.812 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.813 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.813 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.813 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.813 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.813 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.813 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.813 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.813 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.813 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.813 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: _finish_auth 0 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: _check_auth_tickets 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 monclient: authenticate success, global_id 7478 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: dump: 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.814 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:06:46.232+0000 7f9c7ff13640 4 set_mon_vals no callback set 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:06:46.236+0000 7f9b68e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:06:46.236+0000 7f9b68e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:06:46.236+0000 7f9b68e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x7f9b58070a20 auth_method 0 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: get_monmap_and_config 2024-09-12T18:06:46.815 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: monmap: 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:46.816 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding auth protocol: cephx 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding auth protocol: cephx 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding auth protocol: cephx 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.817 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: init 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding auth protocol: cephx 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding auth protocol: cephx 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding auth protocol: cephx 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.818 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe5964ed48 EEXIST 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:46.819 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:06:46.820 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-c con 0x556e59694430 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:46.820 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-a con 0x556e59694810 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:46.820 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-b con 0x556e596bef60 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:46.820 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.820 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.820 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.820 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:46.820 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): authenticate will time out at 2568.462681s 2024-09-12T18:06:46.820 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): get_auth_request con 0x556e59694810 auth_method 0 2024-09-12T18:06:46.820 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.820 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.821 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.821 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request con 0x556e59694430 auth_method 0 2024-09-12T18:06:46.821 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.821 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.821 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.821 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.821 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.821 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): handle_auth_done global_id 8052 payload 274 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient: _finish_hunting 0 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:06:46.236+0000 7f9c7e710640 1 monclient: found mon.noname-a 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: dump: 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.822 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: _finish_auth 0 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: _check_auth_tickets 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.823 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: dump: 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.824 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 monclient: authenticate success, global_id 8052 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 4 set_mon_vals no callback set 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: shutdown 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: monmap: 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:46.825 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding auth protocol: cephx 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding auth protocol: cephx 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding auth protocol: cephx 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.826 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 librados: starting msgr at 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 librados: starting objecter 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x556e596c49e0 EEXIST 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 librados: setting wanted keys 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 librados: calling monclient init 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: init 2024-09-12T18:06:46.827 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding auth protocol: cephx 2024-09-12T18:06:46.828 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding auth protocol: cephx 2024-09-12T18:06:46.828 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding auth protocol: cephx 2024-09-12T18:06:46.828 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.828 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.828 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.828 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.828 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.828 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.828 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.828 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.828 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command rotate-key cmddesc rotate-key hook 0x556e59673298 EEXIST 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-a con 0x556e59694430 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-c con 0x556e596bef60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-b con 0x556e596b8c30 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:46.829 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): authenticate will time out at 2568.465154s 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request con 0x556e59694430 auth_method 0 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): get_auth_request con 0x556e596bef60 auth_method 0 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.830 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_done global_id 8055 payload 824 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient: _finish_hunting 0 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 1 monclient: found mon.noname-a 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:06:46.240+0000 7f9c7f712640 10 monclient: get_auth_request con 0x556e596b8c30 auth_method 0 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:46.831 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: dump: 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: _finish_auth 0 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:06:46.832 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: dump: 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.833 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 monclient: authenticate success, global_id 8055 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:06:46.240+0000 7f9b627fc640 4 set_mon_vals no callback set 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 librados: init done 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command cr dump hook 0x556e596be108 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:06:46.244+0000 7f9b60ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:06:46.244+0000 7f9b60ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.834 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:06:46.244+0000 7f9b60ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:06:46.244+0000 7f9c7e710640 10 monclient: get_auth_request con 0x7f9b48070ae0 auth_method 0 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:06:46.244+0000 7f9c7f712640 10 monclient: get_auth_request con 0x556e596de400 auth_method 0 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 realm 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:06:46.244+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x556e596e2640 auth_method 0 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:46.835 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.836 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:06:46.244+0000 7f9c7e710640 10 monclient: get_auth_request con 0x556e596e5ea0 auth_method 0 2024-09-12T18:06:46.836 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:06:46.248+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:46.836 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:06:46.248+0000 7f9c8140b9c0 20 searching for the correct realm 2024-09-12T18:06:46.836 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:06:46.248+0000 7f9c7f712640 10 monclient: get_auth_request con 0x556e596eac60 auth_method 0 2024-09-12T18:06:46.836 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:06:46.248+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x556e594a4dc0 auth_method 0 2024-09-12T18:06:46.836 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:06:46.252+0000 7f9c7e710640 10 monclient: get_auth_request con 0x7f9c740f8c20 auth_method 0 2024-09-12T18:06:46.836 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:06:46.252+0000 7f9c7e710640 0 -- 172.21.15.157:0/339816652 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f9c740f8c20 msgr2=0x7f9c740fd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:46.836 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:06:46.456+0000 7f9c7e710640 10 monclient: get_auth_request con 0x7f9c740f8c20 auth_method 0 2024-09-12T18:06:46.836 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:06:46.460+0000 7f9c7f712640 10 monclient: get_auth_request con 0x7f9c740ff040 auth_method 0 2024-09-12T18:06:46.836 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:06:46.468+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x7f9c740082b0 auth_method 0 2024-09-12T18:06:46.836 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:06:46.468+0000 7f9c7ef11640 0 -- 172.21.15.157:0/339816652 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f9c740082b0 msgr2=0x7f9c74001ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:06:46.672+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x7f9c740082b0 auth_method 0 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.837 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 zone default found 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 4 Realm: () 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 zonegroup default 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.838 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 started sync module instance, tier type = 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=0 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=1 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=2 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=3 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=4 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=5 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=6 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=7 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:46.839 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding auth protocol: cephx 2024-09-12T18:06:46.840 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding auth protocol: cephx 2024-09-12T18:06:46.840 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding auth protocol: cephx 2024-09-12T18:06:46.840 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.840 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.840 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.840 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.840 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.840 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.840 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.840 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.840 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:06:46.720+0000 7f9b357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command cache list hook 0x556e596b77d0 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command cache inspect hook 0x556e596b77d0 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command cache erase hook 0x556e596b77d0 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command cache zap hook 0x556e596b77d0 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 note: GC not initialized 2024-09-12T18:06:46.841 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:06:46.724+0000 7f9aaffff640 20 reqs_thread_entry: start 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command sync trace show hook 0x7f9c68001d40 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command sync trace history hook 0x7f9c68001d40 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command sync trace active hook 0x7f9c68001d40 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command sync trace active_short hook 0x7f9c68001d40 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 Filter name: none 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:06:46.724+0000 7f9aadffb640 20 reqs_thread_entry: start 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:06:46.842 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:06:46.843 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 : miss 2024-09-12T18:06:46.843 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.843 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:46.843 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:06:46.843 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:06:46.843 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:46.843 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:46.843 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 2024-09-12T18:06:46.843 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:06:46.843 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:06:46.843 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39, ofs0, ns] 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 93932435209840 notifier 8055 bl.length()=931 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_sources= new_sources= 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential sources added=[] removed=[] 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_dests= new_dests= 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential dests added=[] removed=[] 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:06:46.744+0000 7f9c8140b9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.0 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:06:46.744+0000 7f9c8140b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.0 2024-09-12T18:06:46.844 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:06:46.744+0000 7f9c8140b9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.1 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:06:46.744+0000 7f9c8140b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.1 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:06:46.744+0000 7f9c8140b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.0 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:06:46.752+0000 7f9c8140b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9c8140b9c0 time 2024-09-12T18:06:46.755396+0000 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9c84ce52eb] 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9c84ce549f] 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e57b400c1] 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x556e57b514f1] 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556e57b52b44] 2024-09-12T18:06:46.845 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9c83b4bd90] 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:06:46.756+0000 7f9c8140b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f9c8140b9c0 thread_name:radosgw-admin 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9c83b64520] 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:06:46.846 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9c84ce5345] 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9c84ce549f] 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e57b400c1] 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x556e57b514f1] 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556e57b52b44] 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9c83b4bd90] 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:06:46.847 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:06:46.848 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:06:46.849 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:06:46.850 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:06:46.851 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:06:46.851 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:06:46.851 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:06:46.851 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:06:46.851 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:06:46.851 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:06:46.851 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:06:46.851 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:06:46.851 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:06:46.851 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:06:46.851 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:06:46.852 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:06:46.853 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:06:46.854 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9aadffb640 / http_manager 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9aaffff640 / http_manager 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b357e2640 / rgw_dt_lg_renew 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b60ff9640 / ms_dispatch 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b627fc640 / io_context_pool 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b68e01640 / ms_dispatch 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b6b606640 / ms_dispatch 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b6ce09640 / io_context_pool 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9c7e710640 / msgr-worker-2 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9c7ef11640 / msgr-worker-1 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9c7f712640 / msgr-worker-0 2024-09-12T18:06:46.855 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9c7ff13640 / io_context_pool 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9c8140b9c0 / radosgw-admin 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.132948.log 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:06:46.220+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:06:46.220+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:06:46.220+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:06:46.220+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:06:46.220+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.856 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:06:46.220+0000 7f9c7e710640 10 monclient(hunting): handle_auth_done global_id 8043 payload 274 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:06:46.220+0000 7f9c7e710640 10 monclient: _finish_hunting 0 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:06:46.220+0000 7f9c7e710640 1 monclient: found mon.noname-a 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:06:46.220+0000 7f9c7e710640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: dump: 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.857 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: _finish_auth 0 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: _check_auth_tickets 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:06:46.220+0000 7f9b6ce09640 10 monclient: dump: 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.858 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:06:46.220+0000 7f9c8140b9c0 5 monclient: authenticate success, global_id 8043 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:06:46.220+0000 7f9c8140b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:06:46.220+0000 7f9c8140b9c0 4 set_mon_vals no callback set 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: shutdown 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) unregister_commands rotate-key 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:46.859 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: monmap: 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding auth protocol: cephx 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding auth protocol: cephx 2024-09-12T18:06:46.860 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding auth protocol: cephx 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: crc 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f72d0) adding con mode: secure 2024-09-12T18:06:46.861 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 librados: starting msgr at 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 librados: starting objecter 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command objecter_requests hook 0x556e595fa5b0 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 librados: setting wanted keys 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 librados: calling monclient init 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: init 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding auth protocol: cephx 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding auth protocol: cephx 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding auth protocol: cephx 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.862 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: crc 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 AuthRegistry(0x556e595f51f0) adding con mode: secure 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command rotate-key hook 0x556e595f5338 2024-09-12T18:06:46.863 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-c con 0x556e5961e910 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-a con 0x556e5961f230 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-b con 0x7f9c68003100 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient(hunting): authenticate will time out at 2568.449692s 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request con 0x556e5961e910 auth_method 0 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.864 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): get_auth_request con 0x556e5961f230 auth_method 0 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:06:46.224+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.865 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient(hunting): handle_auth_done global_id 8046 payload 824 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient: _finish_hunting 0 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:06:46.224+0000 7f9c7e710640 1 monclient: found mon.noname-a 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:06:46.224+0000 7f9c7e710640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: dump: 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.866 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: _finish_auth 0 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: _check_auth_tickets 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:06:46.224+0000 7f9b6b606640 10 monclient: dump: 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.867 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 5 monclient: authenticate success, global_id 8046 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:06:46.224+0000 7f9b6ce09640 4 set_mon_vals no callback set 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.868 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:06:46.224+0000 7f9c8140b9c0 1 librados: init done 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:06:46.228+0000 7f9b6b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:06:46.228+0000 7f9b6b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:06:46.228+0000 7f9b6b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:06:46.228+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x7f9b64070ae0 auth_method 0 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:06:46.228+0000 7f9c7f712640 10 monclient: get_auth_request con 0x556e5961d620 auth_method 0 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:06:46.228+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x556e59640680 auth_method 0 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:06:46.228+0000 7f9c7e710640 10 monclient: get_auth_request con 0x556e596448c0 auth_method 0 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: monmap: 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:46.869 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding auth protocol: cephx 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding auth protocol: cephx 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding auth protocol: cephx 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.870 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: crc 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596497d0) adding con mode: secure 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x556e5964d180 EEXIST 2024-09-12T18:06:46.871 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: init 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding auth protocol: cephx 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding auth protocol: cephx 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding auth protocol: cephx 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.872 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: crc 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59647df8) adding con mode: secure 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command rotate-key cmddesc rotate-key hook 0x556e59647f40 EEXIST 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-b con 0x556e59671330 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-c con 0x556e59670c60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-a con 0x556e5966f640 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.873 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient(hunting): authenticate will time out at 2568.458728s 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): get_auth_request con 0x556e59670c60 auth_method 0 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): get_auth_request con 0x556e5966f640 auth_method 0 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.874 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:06:46.232+0000 7f9c7f712640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient(hunting): handle_auth_done global_id 7478 payload 824 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient: _finish_hunting 0 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:06:46.232+0000 7f9c7e710640 1 monclient: found mon.noname-c 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:06:46.232+0000 7f9c7e710640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: dump: 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.875 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: _finish_auth 0 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: _check_auth_tickets 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 5 monclient: authenticate success, global_id 7478 2024-09-12T18:06:46.876 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:06:46.232+0000 7f9b68e01640 10 monclient: dump: 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.877 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:06:46.232+0000 7f9c7ff13640 4 set_mon_vals no callback set 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:06:46.232+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:06:46.236+0000 7f9b68e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:06:46.236+0000 7f9b68e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:06:46.236+0000 7f9b68e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x7f9b58070a20 auth_method 0 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: get_monmap_and_config 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:46.878 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: monmap: 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding auth protocol: cephx 2024-09-12T18:06:46.879 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding auth protocol: cephx 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding auth protocol: cephx 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.880 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: crc 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596905b0) adding con mode: secure 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: init 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding auth protocol: cephx 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding auth protocol: cephx 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding auth protocol: cephx 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.881 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: crc 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964ec00) adding con mode: secure 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe5964ed48 EEXIST 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-c con 0x556e59694430 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:46.882 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-a con 0x556e59694810 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-b con 0x556e596bef60 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient(hunting): authenticate will time out at 2568.462681s 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): get_auth_request con 0x556e59694810 auth_method 0 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request con 0x556e59694430 auth_method 0 2024-09-12T18:06:46.883 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.884 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.884 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.884 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.884 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.884 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.884 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.884 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.884 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:06:46.236+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.884 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient(hunting): handle_auth_done global_id 8052 payload 274 2024-09-12T18:06:46.884 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient: _finish_hunting 0 2024-09-12T18:06:46.884 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:06:46.236+0000 7f9c7e710640 1 monclient: found mon.noname-a 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:06:46.236+0000 7f9c7e710640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: dump: 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.885 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: _finish_auth 0 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: _check_auth_tickets 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:06:46.236+0000 7f9b627fc640 10 monclient: dump: 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.886 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 5 monclient: authenticate success, global_id 8052 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 4 set_mon_vals no callback set 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:06:46.236+0000 7f9c8140b9c0 10 monclient: shutdown 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:46.887 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: monmap: 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding auth protocol: cephx 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding auth protocol: cephx 2024-09-12T18:06:46.888 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding auth protocol: cephx 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: crc 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e596c9c70) adding con mode: secure 2024-09-12T18:06:46.889 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 librados: starting msgr at 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 librados: starting objecter 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x556e596c49e0 EEXIST 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 librados: setting wanted keys 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 librados: calling monclient init 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: init 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding auth protocol: cephx 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding auth protocol: cephx 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding auth protocol: cephx 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.890 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: crc 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 AuthRegistry(0x556e59673150) adding con mode: secure 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command rotate-key cmddesc rotate-key hook 0x556e59673298 EEXIST 2024-09-12T18:06:46.891 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-a con 0x556e59694430 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-c con 0x556e596bef60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): picked mon.noname-b con 0x556e596b8c30 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient(hunting): authenticate will time out at 2568.465154s 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request con 0x556e59694430 auth_method 0 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.892 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): get_auth_request con 0x556e596bef60 auth_method 0 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:06:46.240+0000 7f9c7e710640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient(hunting): handle_auth_done global_id 8055 payload 824 2024-09-12T18:06:46.893 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient: _finish_hunting 0 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 1 monclient: found mon.noname-a 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:06:46.240+0000 7f9c7ef11640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:06:46.240+0000 7f9c7f712640 10 monclient: get_auth_request con 0x556e596b8c30 auth_method 0 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: dump: 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.894 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: _finish_auth 0 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:06:46.240+0000 7f9b60ff9640 10 monclient: dump: 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.895 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 monclient: authenticate success, global_id 8055 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:06:46.240+0000 7f9b627fc640 4 set_mon_vals no callback set 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _renew_subs 2024-09-12T18:06:46.896 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 1 librados: init done 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command cr dump hook 0x556e596be108 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:06:46.240+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:06:46.244+0000 7f9b60ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:06:46.244+0000 7f9b60ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:06:46.244+0000 7f9b60ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:06:46.244+0000 7f9c7e710640 10 monclient: get_auth_request con 0x7f9b48070ae0 auth_method 0 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:06:46.244+0000 7f9c7f712640 10 monclient: get_auth_request con 0x556e596de400 auth_method 0 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 realm 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.897 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:06:46.244+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x556e596e2640 auth_method 0 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:06:46.244+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:06:46.244+0000 7f9c7e710640 10 monclient: get_auth_request con 0x556e596e5ea0 auth_method 0 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:06:46.248+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:06:46.248+0000 7f9c8140b9c0 20 searching for the correct realm 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:06:46.248+0000 7f9c7f712640 10 monclient: get_auth_request con 0x556e596eac60 auth_method 0 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:06:46.248+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x556e594a4dc0 auth_method 0 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:06:46.252+0000 7f9c7e710640 10 monclient: get_auth_request con 0x7f9c740f8c20 auth_method 0 2024-09-12T18:06:46.898 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:06:46.252+0000 7f9c7e710640 0 -- 172.21.15.157:0/339816652 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f9c740f8c20 msgr2=0x7f9c740fd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:06:46.456+0000 7f9c7e710640 10 monclient: get_auth_request con 0x7f9c740f8c20 auth_method 0 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:06:46.460+0000 7f9c7f712640 10 monclient: get_auth_request con 0x7f9c740ff040 auth_method 0 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:06:46.468+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x7f9c740082b0 auth_method 0 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:06:46.468+0000 7f9c7ef11640 0 -- 172.21.15.157:0/339816652 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f9c740082b0 msgr2=0x7f9c74001ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:06:46.672+0000 7f9c7ef11640 10 monclient: get_auth_request con 0x7f9c740082b0 auth_method 0 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.899 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:06:46.684+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 zone default found 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 4 Realm: () 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 zonegroup default 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.900 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 started sync module instance, tier type = 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:06:46.688+0000 7f9c8140b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=0 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=1 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=2 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=3 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=4 2024-09-12T18:06:46.901 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=5 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=6 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 20 add_watcher() i=7 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:06:46.716+0000 7f9c8140b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding auth protocol: cephx 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding auth protocol: cephx 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding auth protocol: cephx 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.902 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:06:46.720+0000 7f9b357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: crc 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 5 AuthRegistry(0x7ffe5964f0d0) adding con mode: secure 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:06:46.720+0000 7f9c8140b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command cache list hook 0x556e596b77d0 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command cache inspect hook 0x556e596b77d0 2024-09-12T18:06:46.903 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command cache erase hook 0x556e596b77d0 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command cache zap hook 0x556e596b77d0 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 note: GC not initialized 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:06:46.724+0000 7f9aaffff640 20 reqs_thread_entry: start 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command sync trace show hook 0x7f9c68001d40 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command sync trace history hook 0x7f9c68001d40 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command sync trace active hook 0x7f9c68001d40 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 5 asok(0x556e593ea2b0) register_command sync trace active_short hook 0x7f9c68001d40 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 Filter name: none 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:06:46.724+0000 7f9aadffb640 20 reqs_thread_entry: start 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:46.904 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 : miss 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:06:46.724+0000 7f9c8140b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:46.905 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:06:46.732+0000 7f9c8140b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39, ofs0, ns] 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 93932435209840 notifier 8055 bl.length()=931 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:06:46.732+0000 7f9b627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_sources= new_sources= 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential sources added=[] removed=[] 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_dests= new_dests= 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:06:46.736+0000 7f9c8140b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential dests added=[] removed=[] 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:06:46.744+0000 7f9c8140b9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.0 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:06:46.744+0000 7f9c8140b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.0 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:06:46.744+0000 7f9c8140b9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.1 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:06:46.744+0000 7f9c8140b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.1.1 2024-09-12T18:06:46.906 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:06:46.744+0000 7f9c8140b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.0 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:06:46.752+0000 7f9c8140b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9c8140b9c0 time 2024-09-12T18:06:46.755396+0000 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9c84ce52eb] 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9c84ce549f] 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e57b400c1] 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x556e57b514f1] 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556e57b52b44] 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9c83b4bd90] 2024-09-12T18:06:46.907 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:06:46.756+0000 7f9c8140b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7f9c8140b9c0 thread_name:radosgw-admin 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9c83b64520] 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9c84ce5345] 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9c84ce549f] 2024-09-12T18:06:46.908 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e57b400c1] 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x556e57b514f1] 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556e57b52b44] 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9c83b4bd90] 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:06:46.909 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:06:46.910 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:06:46.911 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:06:46.912 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:06:46.913 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:06:46.914 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:06:46.915 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9aadffb640 / http_manager 2024-09-12T18:06:46.916 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9aaffff640 / http_manager 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b357e2640 / rgw_dt_lg_renew 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b60ff9640 / ms_dispatch 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b627fc640 / io_context_pool 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b68e01640 / ms_dispatch 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b6b606640 / ms_dispatch 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9b6ce09640 / io_context_pool 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9c7e710640 / msgr-worker-2 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9c7ef11640 / msgr-worker-1 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9c7f712640 / msgr-worker-0 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9c7ff13640 / io_context_pool 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: 7f9c8140b9c0 / radosgw-admin 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:06:46.917 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:06:46.762024Z_a43f4f34-95d6-467d-b8a7-d491f5f6a6a5/log 2024-09-12T18:06:46.918 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:06:46.918 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:06:46.918 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:06:46.919 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:46.919 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:46.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.844+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.848+0000 7f1cd18699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.919 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.848+0000 7f1cd18699c0 20 realm 2024-09-12T18:06:46.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.848+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.848+0000 7f1cd18699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.848+0000 7f1cd18699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:46.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.848+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.848+0000 7f1cd18699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:46.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.848+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.848+0000 7f1cd18699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:46.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.848+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:46.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.852+0000 7f1cd18699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:46.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.852+0000 7f1cd18699c0 20 searching for the correct realm 2024-09-12T18:06:46.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:46.852+0000 7f1cceb6e640 0 -- 172.21.15.157:0/2574995419 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f1cc41161c0 msgr2=0x7f1cc40f5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:47.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.068+0000 7f1ccf36f640 0 -- 172.21.15.157:0/2574995419 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f1cc41101e0 msgr2=0x7f1cc40fe890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:47.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.284+0000 7f1cd18699c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:47.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.284+0000 7f1cd18699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:47.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.284+0000 7f1cd18699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:47.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.284+0000 7f1cd18699c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:47.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.284+0000 7f1cd18699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:47.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.284+0000 7f1cd18699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:47.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.284+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:47.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:47.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:47.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 20 zone default found 2024-09-12T18:06:47.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 4 Realm: () 2024-09-12T18:06:47.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:47.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:47.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:47.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 20 zonegroup default 2024-09-12T18:06:47.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:47.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.288+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.292+0000 7f1cd18699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:47.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.292+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.292+0000 7f1cd18699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:47.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.292+0000 7f1cd18699c0 20 started sync module instance, tier type = 2024-09-12T18:06:47.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.292+0000 7f1cd18699c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:47.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.316+0000 7f1cd18699c0 20 add_watcher() i=0 2024-09-12T18:06:47.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.316+0000 7f1cd18699c0 20 add_watcher() i=1 2024-09-12T18:06:47.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.316+0000 7f1cd18699c0 20 add_watcher() i=2 2024-09-12T18:06:47.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.316+0000 7f1cd18699c0 20 add_watcher() i=3 2024-09-12T18:06:47.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.316+0000 7f1cd18699c0 20 add_watcher() i=4 2024-09-12T18:06:47.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.316+0000 7f1cd18699c0 20 add_watcher() i=5 2024-09-12T18:06:47.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.316+0000 7f1cd18699c0 20 add_watcher() i=6 2024-09-12T18:06:47.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.316+0000 7f1cd18699c0 20 add_watcher() i=7 2024-09-12T18:06:47.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.316+0000 7f1cd18699c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:47.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.320+0000 7f1b85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:47.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1cd18699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:47.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1cd18699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:47.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1cd18699c0 5 note: GC not initialized 2024-09-12T18:06:47.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1b84fe1640 20 reqs_thread_entry: start 2024-09-12T18:06:47.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1cd18699c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:47.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1cd18699c0 20 Filter name: none 2024-09-12T18:06:47.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1afe7fc640 20 reqs_thread_entry: start 2024-09-12T18:06:47.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1cd18699c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:47.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1cd18699c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:06:47.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1cd18699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:47.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.324+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.328+0000 7f1cd18699c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:47.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.328+0000 7f1cd18699c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.328+0000 7f1cd18699c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:06:47.328 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.328+0000 7f1cd18699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:47.331 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.332+0000 7f1b85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:47.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.336+0000 7f1cd18699c0 20 remove_watcher() i=0 2024-09-12T18:06:47.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.336+0000 7f1cd18699c0 2 removed watcher, disabling cache 2024-09-12T18:06:47.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.336+0000 7f1cd18699c0 20 remove_watcher() i=1 2024-09-12T18:06:47.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.340+0000 7f1cd18699c0 20 remove_watcher() i=2 2024-09-12T18:06:47.343 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.344+0000 7f1cd18699c0 20 remove_watcher() i=3 2024-09-12T18:06:47.345 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.344+0000 7f1cd18699c0 20 remove_watcher() i=4 2024-09-12T18:06:47.347 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.348+0000 7f1cd18699c0 20 remove_watcher() i=5 2024-09-12T18:06:47.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.348+0000 7f1cd18699c0 20 remove_watcher() i=6 2024-09-12T18:06:47.350 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.348+0000 7f1cd18699c0 20 remove_watcher() i=7 2024-09-12T18:06:47.365 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:47.365 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:06:47.365 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-change-reshard-state id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T18:06:47.365 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:06:47.473 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:06:47.509 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:47.509 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:47.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.552+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.552+0000 7f46f6fb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:47.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.552+0000 7f46f6fb69c0 20 realm 2024-09-12T18:06:47.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.552+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.552+0000 7f46f6fb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:47.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.552+0000 7f46f6fb69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:47.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.552+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.552+0000 7f46f6fb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:47.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.552+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.556+0000 7f46f6fb69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:47.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.556+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.556+0000 7f46f6fb69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:47.557 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.556+0000 7f46f6fb69c0 20 searching for the correct realm 2024-09-12T18:06:47.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.560+0000 7f46f52bd640 0 -- 172.21.15.157:0/1688704159 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55bb1eb4f390 msgr2=0x55bb1eb51800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:47.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.568+0000 7f46f4abc640 0 -- 172.21.15.157:0/1688704159 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f46e8104950 msgr2=0x7f46e80eb460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:47.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:06:47.577 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:47.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:47.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:06:47.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:47.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:47.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:47.578 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:47.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:47.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 zone default found 2024-09-12T18:06:47.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 4 Realm: () 2024-09-12T18:06:47.579 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:06:47.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:06:47.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:47.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 zonegroup default 2024-09-12T18:06:47.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.576+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.580+0000 7f46f6fb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:47.580 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.580+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.580+0000 7f46f6fb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:47.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.580+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.580+0000 7f46f6fb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:47.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.580+0000 7f46f6fb69c0 20 started sync module instance, tier type = 2024-09-12T18:06:47.581 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.580+0000 7f46f6fb69c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:06:47.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.596+0000 7f46f6fb69c0 20 add_watcher() i=0 2024-09-12T18:06:47.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.596+0000 7f46f6fb69c0 20 add_watcher() i=1 2024-09-12T18:06:47.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.596+0000 7f46f6fb69c0 20 add_watcher() i=2 2024-09-12T18:06:47.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.596+0000 7f46f6fb69c0 20 add_watcher() i=3 2024-09-12T18:06:47.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.596+0000 7f46f6fb69c0 20 add_watcher() i=4 2024-09-12T18:06:47.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.596+0000 7f46f6fb69c0 20 add_watcher() i=5 2024-09-12T18:06:47.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.596+0000 7f46f6fb69c0 20 add_watcher() i=6 2024-09-12T18:06:47.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.596+0000 7f46f6fb69c0 20 add_watcher() i=7 2024-09-12T18:06:47.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.596+0000 7f46f6fb69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:47.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f45aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:47.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:47.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:47.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 5 note: GC not initialized 2024-09-12T18:06:47.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f45a9fe3640 20 reqs_thread_entry: start 2024-09-12T18:06:47.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 20 init_complete bucket index max shards: 1 2024-09-12T18:06:47.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 20 Filter name: none 2024-09-12T18:06:47.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f451b7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:47.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:06:47.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:06:47.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:06:47.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:06:47.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 : miss 2024-09-12T18:06:47.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:47.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:06:47.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:06:47.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:06:47.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:47.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:47.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.600+0000 7f46f6fb69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 2024-09-12T18:06:47.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.604+0000 7f46f6fb69c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to be held by another RGW process; skipping for now 2024-09-12T18:06:47.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.604+0000 7f45aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:47.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.608+0000 7f46f6fb69c0 20 remove_watcher() i=0 2024-09-12T18:06:47.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.608+0000 7f46f6fb69c0 2 removed watcher, disabling cache 2024-09-12T18:06:47.611 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.612+0000 7f46f6fb69c0 20 remove_watcher() i=1 2024-09-12T18:06:47.613 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.612+0000 7f46f6fb69c0 20 remove_watcher() i=2 2024-09-12T18:06:47.615 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.616+0000 7f46f6fb69c0 20 remove_watcher() i=3 2024-09-12T18:06:47.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.616+0000 7f46f6fb69c0 20 remove_watcher() i=4 2024-09-12T18:06:47.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.616+0000 7f46f6fb69c0 20 remove_watcher() i=5 2024-09-12T18:06:47.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.620+0000 7f46f6fb69c0 20 remove_watcher() i=6 2024-09-12T18:06:47.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:06:47.620+0000 7f46f6fb69c0 20 remove_watcher() i=7 2024-09-12T18:06:47.634 INFO:tasks.workunit.client.0.smithi157.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:07:17.692 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:17.692 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:17.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.739+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.739+0000 7fecd3fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.739+0000 7fecd3fac9c0 20 realm 2024-09-12T18:07:17.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.739+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.739+0000 7fecd3fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.739+0000 7fecd3fac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:17.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.739+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.739+0000 7fecd3fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.739+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.743+0000 7fecd3fac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.743+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.743+0000 7fecd3fac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:17.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.743+0000 7fecd3fac9c0 20 searching for the correct realm 2024-09-12T18:07:17.747 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.751+0000 7fecd12b1640 0 -- 172.21.15.157:0/3768409421 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fecc8105c20 msgr2=0x7fecc81350b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.755+0000 7fecd22b3640 0 -- 172.21.15.157:0/3768409421 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fecc8133c10 msgr2=0x7fecc8109700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:17.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:17.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:17.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:17.761 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:17.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:17.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:17.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:17.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 zone default found 2024-09-12T18:07:17.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 4 Realm: () 2024-09-12T18:07:17.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:17.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:17.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:17.763 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 zonegroup default 2024-09-12T18:07:17.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.763+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.767+0000 7fecd3fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.767+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.767+0000 7fecd3fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.767+0000 7fecd3fac9c0 20 started sync module instance, tier type = 2024-09-12T18:07:17.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.767+0000 7fecd3fac9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:17.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.783+0000 7fecd3fac9c0 20 add_watcher() i=0 2024-09-12T18:07:17.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.783+0000 7fecd3fac9c0 20 add_watcher() i=1 2024-09-12T18:07:17.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.783+0000 7fecd3fac9c0 20 add_watcher() i=2 2024-09-12T18:07:17.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.783+0000 7fecd3fac9c0 20 add_watcher() i=3 2024-09-12T18:07:17.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.783+0000 7fecd3fac9c0 20 add_watcher() i=4 2024-09-12T18:07:17.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.783+0000 7fecd3fac9c0 20 add_watcher() i=5 2024-09-12T18:07:17.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.783+0000 7fecd3fac9c0 20 add_watcher() i=6 2024-09-12T18:07:17.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.783+0000 7fecd3fac9c0 20 add_watcher() i=7 2024-09-12T18:07:17.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.783+0000 7fecd3fac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:17.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7feb837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:17.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:17.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:17.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 5 note: GC not initialized 2024-09-12T18:07:17.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7feb827fc640 20 reqs_thread_entry: start 2024-09-12T18:07:17.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:17.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 20 Filter name: none 2024-09-12T18:07:17.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7feaf3fff640 20 reqs_thread_entry: start 2024-09-12T18:07:17.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:07:17.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:17.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:07:17.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:07:17.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 : miss 2024-09-12T18:07:17.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:07:17.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:07:17.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:07:17.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:17.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.787+0000 7fecd3fac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 2024-09-12T18:07:17.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.791+0000 7fecd3fac9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:07:17.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.795+0000 7fecd3fac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:07:17.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.795+0000 7fecd3fac9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:07:17.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.795+0000 7fecd3fac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.795+0000 7fecd3fac9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39, ofs0, ns] 2024-09-12T18:07:17.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.799+0000 7febb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464376 cookie 94316593448176 notifier 7535 bl.length()=931 2024-09-12T18:07:17.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.799+0000 7febb57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:07:17.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.799+0000 7febb57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:07:17.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.799+0000 7febb57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.799+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_sources= new_sources= 2024-09-12T18:07:17.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.799+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential sources added=[] removed=[] 2024-09-12T18:07:17.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.799+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_dests= new_dests= 2024-09-12T18:07:17.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.799+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential dests added=[] removed=[] 2024-09-12T18:07:17.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.807+0000 7fecd3fac9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.2.0 2024-09-12T18:07:17.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.807+0000 7fecd3fac9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.2.0 2024-09-12T18:07:17.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.807+0000 7fecd3fac9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.2.1 2024-09-12T18:07:17.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.807+0000 7fecd3fac9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.2.1 2024-09-12T18:07:17.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.807+0000 7fecd3fac9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.0 2024-09-12T18:07:17.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.815+0000 7fecd3fac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 : hit (requested=0x17, cached=0x17) 2024-09-12T18:07:17.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.815+0000 7fecd3fac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 2024-09-12T18:07:17.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7fecd3fac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:07:17.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7fecd3fac9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:07:17.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7fecd3fac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7fecd3fac9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39, ofs0, ns] 2024-09-12T18:07:17.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7febb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464377 cookie 94316593448176 notifier 7535 bl.length()=931 2024-09-12T18:07:17.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7febb4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:07:17.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7febb4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:07:17.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7febb4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_sources= new_sources= 2024-09-12T18:07:17.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential sources added=[] removed=[] 2024-09-12T18:07:17.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_dests= new_dests= 2024-09-12T18:07:17.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.819+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential dests added=[] removed=[] 2024-09-12T18:07:17.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.823+0000 7fecd3fac9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39.0 2024-09-12T18:07:17.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.823+0000 7fecd3fac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 : hit (requested=0x17, cached=0x17) 2024-09-12T18:07:17.823 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.823+0000 7fecd3fac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 2024-09-12T18:07:17.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.827+0000 7fecd3fac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:07:17.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.827+0000 7fecd3fac9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:07:17.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.827+0000 7fecd3fac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.827+0000 7fecd3fac9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39, ofs0, ns] 2024-09-12T18:07:17.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.827+0000 7febb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464378 cookie 94316593448176 notifier 7535 bl.length()=899 2024-09-12T18:07:17.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.827+0000 7febb4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 info.flags=0x17 2024-09-12T18:07:17.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.827+0000 7febb4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 to cache LRU end 2024-09-12T18:07:17.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.827+0000 7febb4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.831+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_sources= new_sources= 2024-09-12T18:07:17.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.831+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential sources added=[] removed=[] 2024-09-12T18:07:17.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.831+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): orig_dests= new_dests= 2024-09-12T18:07:17.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.831+0000 7fecd3fac9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39]): potential dests added=[] removed=[] 2024-09-12T18:07:17.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.831+0000 7fecd3fac9c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T18:07:17.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.835+0000 7feb837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:17.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.843+0000 7fecd3fac9c0 20 remove_watcher() i=0 2024-09-12T18:07:17.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.843+0000 7fecd3fac9c0 2 removed watcher, disabling cache 2024-09-12T18:07:17.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.843+0000 7fecd3fac9c0 20 remove_watcher() i=1 2024-09-12T18:07:17.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.847+0000 7fecd3fac9c0 20 remove_watcher() i=2 2024-09-12T18:07:17.846 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.847+0000 7fecd3fac9c0 20 remove_watcher() i=3 2024-09-12T18:07:17.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.851+0000 7fecd3fac9c0 20 remove_watcher() i=4 2024-09-12T18:07:17.849 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.851+0000 7fecd3fac9c0 20 remove_watcher() i=5 2024-09-12T18:07:17.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.855+0000 7fecd3fac9c0 20 remove_watcher() i=6 2024-09-12T18:07:17.853 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.855+0000 7fecd3fac9c0 20 remove_watcher() i=7 2024-09-12T18:07:17.874 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:07:17.905 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:17.905 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:17.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.951+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.951+0000 7f13a53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.951+0000 7f13a53b49c0 20 realm 2024-09-12T18:07:17.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.951+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.951+0000 7f13a53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.951+0000 7f13a53b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:17.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.951+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.955+0000 7f13a53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.955+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.955+0000 7f13a53b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.955+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.953 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.955+0000 7f13a53b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:17.954 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.955+0000 7f13a53b49c0 20 searching for the correct realm 2024-09-12T18:07:17.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:17.963+0000 7f13a36bb640 0 -- 172.21.15.157:0/756092596 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f13980652d0 msgr2=0x7f139802a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:18.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.179+0000 7f13a2eba640 0 -- 172.21.15.157:0/756092596 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55f11bcbd290 msgr2=0x55f11bcbf680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:18.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:18.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:18.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:18.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:18.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:18.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:18.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:18.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:18.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:18.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:18.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:18.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:18.186 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 zone default found 2024-09-12T18:07:18.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 4 Realm: () 2024-09-12T18:07:18.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:18.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:18.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:18.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 zonegroup default 2024-09-12T18:07:18.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:18.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.187+0000 7f13a53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:18.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.191+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:18.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.191+0000 7f13a53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:18.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.191+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:18.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.191+0000 7f13a53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:18.188 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.191+0000 7f13a53b49c0 20 started sync module instance, tier type = 2024-09-12T18:07:18.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.191+0000 7f13a53b49c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:18.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.215+0000 7f13a53b49c0 20 add_watcher() i=0 2024-09-12T18:07:18.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.215+0000 7f13a53b49c0 20 add_watcher() i=1 2024-09-12T18:07:18.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.215+0000 7f13a53b49c0 20 add_watcher() i=2 2024-09-12T18:07:18.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.215+0000 7f13a53b49c0 20 add_watcher() i=3 2024-09-12T18:07:18.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.215+0000 7f13a53b49c0 20 add_watcher() i=4 2024-09-12T18:07:18.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.215+0000 7f13a53b49c0 20 add_watcher() i=5 2024-09-12T18:07:18.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.215+0000 7f13a53b49c0 20 add_watcher() i=6 2024-09-12T18:07:18.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.219+0000 7f13a53b49c0 20 add_watcher() i=7 2024-09-12T18:07:18.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.219+0000 7f13a53b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:18.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f12597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:18.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:18.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:18.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 5 note: GC not initialized 2024-09-12T18:07:18.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f11d3fff640 20 reqs_thread_entry: start 2024-09-12T18:07:18.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:18.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 Filter name: none 2024-09-12T18:07:18.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f11d1ffb640 20 reqs_thread_entry: start 2024-09-12T18:07:18.221 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:18.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:18.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:18.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:18.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:18.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:18.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:18.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.223+0000 7f13a53b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:18.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.227+0000 7f13a53b49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:18.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.227+0000 7f13a53b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:18.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.227+0000 7f12597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:18.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.231+0000 7f13a53b49c0 20 remove_watcher() i=0 2024-09-12T18:07:18.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.231+0000 7f13a53b49c0 2 removed watcher, disabling cache 2024-09-12T18:07:18.233 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.235+0000 7f13a53b49c0 20 remove_watcher() i=1 2024-09-12T18:07:18.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.239+0000 7f13a53b49c0 20 remove_watcher() i=2 2024-09-12T18:07:18.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.239+0000 7f13a53b49c0 20 remove_watcher() i=3 2024-09-12T18:07:18.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.243+0000 7f13a53b49c0 20 remove_watcher() i=4 2024-09-12T18:07:18.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.243+0000 7f13a53b49c0 20 remove_watcher() i=5 2024-09-12T18:07:18.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.243+0000 7f13a53b49c0 20 remove_watcher() i=6 2024-09-12T18:07:18.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:18.247+0000 7f13a53b49c0 20 remove_watcher() i=7 2024-09-12T18:07:18.259 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:18.259 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:07:18.259 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: abort-at-change-reshard-state id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T18:07:18.259 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:18.930 INFO:tasks.workunit.client.0.smithi157.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T18:07:18.930 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:07:18.964 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:18.964 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:19.008 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.011+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.011+0000 7f89295599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.011+0000 7f89295599c0 20 realm 2024-09-12T18:07:19.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.011+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.011+0000 7f89295599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.010 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.011+0000 7f89295599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:19.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.011+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.011+0000 7f89295599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.011 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.011+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.015+0000 7f89295599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:19.012 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.015+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.015+0000 7f89295599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:19.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.015+0000 7f89295599c0 20 searching for the correct realm 2024-09-12T18:07:19.019 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.019+0000 7f892685e640 0 -- 172.21.15.157:0/711466068 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f891c083c20 msgr2=0x7f891c0616a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:19.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.027+0000 7f892685e640 0 -- 172.21.15.157:0/711466068 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f87f0080900 msgr2=0x7f87f0082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:19.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:19.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:19.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:19.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:19.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:19.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:19.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:19.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:19.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 zone default found 2024-09-12T18:07:19.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 4 Realm: () 2024-09-12T18:07:19.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:19.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:19.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:19.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 zonegroup default 2024-09-12T18:07:19.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 started sync module instance, tier type = 2024-09-12T18:07:19.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.035+0000 7f89295599c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:19.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.051+0000 7f89295599c0 20 add_watcher() i=0 2024-09-12T18:07:19.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.051+0000 7f89295599c0 20 add_watcher() i=1 2024-09-12T18:07:19.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.051+0000 7f89295599c0 20 add_watcher() i=2 2024-09-12T18:07:19.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.051+0000 7f89295599c0 20 add_watcher() i=3 2024-09-12T18:07:19.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.051+0000 7f89295599c0 20 add_watcher() i=4 2024-09-12T18:07:19.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.051+0000 7f89295599c0 20 add_watcher() i=5 2024-09-12T18:07:19.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.051+0000 7f89295599c0 20 add_watcher() i=6 2024-09-12T18:07:19.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.055+0000 7f89295599c0 20 add_watcher() i=7 2024-09-12T18:07:19.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.055+0000 7f89295599c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:19.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.055+0000 7f87de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:19.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.055+0000 7f89295599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:19.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.055+0000 7f89295599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:19.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.055+0000 7f89295599c0 5 note: GC not initialized 2024-09-12T18:07:19.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.055+0000 7f87dd7e2640 20 reqs_thread_entry: start 2024-09-12T18:07:19.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.055+0000 7f89295599c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:19.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.055+0000 7f89295599c0 20 Filter name: none 2024-09-12T18:07:19.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.055+0000 7f87d67fc640 20 reqs_thread_entry: start 2024-09-12T18:07:19.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.055+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.059+0000 7f89295599c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:19.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.059+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.059+0000 7f89295599c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:19.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.059+0000 7f89295599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:19.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.059+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.059+0000 7f89295599c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:19.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.059+0000 7f89295599c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.059+0000 7f89295599c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:19.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.059+0000 7f89295599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:19.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.063+0000 7f87de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:19.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.067+0000 7f89295599c0 20 remove_watcher() i=0 2024-09-12T18:07:19.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.067+0000 7f89295599c0 2 removed watcher, disabling cache 2024-09-12T18:07:19.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.067+0000 7f89295599c0 20 remove_watcher() i=1 2024-09-12T18:07:19.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.071+0000 7f89295599c0 20 remove_watcher() i=2 2024-09-12T18:07:19.072 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.071+0000 7f89295599c0 20 remove_watcher() i=3 2024-09-12T18:07:19.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.075+0000 7f89295599c0 20 remove_watcher() i=4 2024-09-12T18:07:19.074 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.075+0000 7f89295599c0 20 remove_watcher() i=5 2024-09-12T18:07:19.075 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.075+0000 7f89295599c0 20 remove_watcher() i=6 2024-09-12T18:07:19.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.079+0000 7f89295599c0 20 remove_watcher() i=7 2024-09-12T18:07:19.089 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:19.089 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:07:19.089 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: a-bucket id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T18:07:19.090 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:19.090 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:07:19.116 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:19.116 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:19.159 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.163+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.161 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.163+0000 7fe4dbfc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.163+0000 7fe4dbfc89c0 20 realm 2024-09-12T18:07:19.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.163+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.163+0000 7fe4dbfc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.163+0000 7fe4dbfc89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:19.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.163+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.163+0000 7fe4dbfc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.162 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.163+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.163 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.167+0000 7fe4dbfc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:19.163 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.167+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.167+0000 7fe4dbfc89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:19.164 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.167+0000 7fe4dbfc89c0 20 searching for the correct realm 2024-09-12T18:07:19.167 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.171+0000 7fe4d92cd640 0 -- 172.21.15.157:0/3920006443 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fe4d00d3040 msgr2=0x7fe4d00a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:19.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.387+0000 7fe4d9ace640 0 -- 172.21.15.157:0/3920006443 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fe4d0136190 msgr2=0x7fe4d012f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:19.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.603+0000 7fe4dbfc89c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:19.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.603+0000 7fe4dbfc89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:19.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.603+0000 7fe4dbfc89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:19.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.603+0000 7fe4dbfc89c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:19.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.603+0000 7fe4dbfc89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:19.603 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.603+0000 7fe4dbfc89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:19.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.603+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.604 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:19.605 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 20 zone default found 2024-09-12T18:07:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 4 Realm: () 2024-09-12T18:07:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 20 zonegroup default 2024-09-12T18:07:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.607+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.611+0000 7fe4dbfc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.611+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.611+0000 7fe4dbfc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.611+0000 7fe4dbfc89c0 20 started sync module instance, tier type = 2024-09-12T18:07:19.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.611+0000 7fe4dbfc89c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:19.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.631+0000 7fe4dbfc89c0 20 add_watcher() i=0 2024-09-12T18:07:19.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.631+0000 7fe4dbfc89c0 20 add_watcher() i=1 2024-09-12T18:07:19.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.631+0000 7fe4dbfc89c0 20 add_watcher() i=2 2024-09-12T18:07:19.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.631+0000 7fe4dbfc89c0 20 add_watcher() i=3 2024-09-12T18:07:19.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.631+0000 7fe4dbfc89c0 20 add_watcher() i=4 2024-09-12T18:07:19.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.631+0000 7fe4dbfc89c0 20 add_watcher() i=5 2024-09-12T18:07:19.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.631+0000 7fe4dbfc89c0 20 add_watcher() i=6 2024-09-12T18:07:19.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.635+0000 7fe4dbfc89c0 20 add_watcher() i=7 2024-09-12T18:07:19.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.635+0000 7fe4dbfc89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:19.636 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.639+0000 7fe38b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:19.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.639+0000 7fe4dbfc89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:19.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.639+0000 7fe4dbfc89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:19.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.639+0000 7fe4dbfc89c0 5 note: GC not initialized 2024-09-12T18:07:19.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.639+0000 7fe38a7fc640 20 reqs_thread_entry: start 2024-09-12T18:07:19.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.639+0000 7fe4dbfc89c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:19.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.639+0000 7fe4dbfc89c0 20 Filter name: none 2024-09-12T18:07:19.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.639+0000 7fe2fbfff640 20 reqs_thread_entry: start 2024-09-12T18:07:19.639 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.639+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.643+0000 7fe4dbfc89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:19.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.643+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.643+0000 7fe4dbfc89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:19.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.643+0000 7fe4dbfc89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:19.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.643+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.641 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.643+0000 7fe4dbfc89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:19.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.643+0000 7fe4dbfc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.642 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.643+0000 7fe4dbfc89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:19.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.643+0000 7fe4dbfc89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:19.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.647+0000 7fe38b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:19.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.651+0000 7fe4dbfc89c0 20 remove_watcher() i=0 2024-09-12T18:07:19.650 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.651+0000 7fe4dbfc89c0 2 removed watcher, disabling cache 2024-09-12T18:07:19.652 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.655+0000 7fe4dbfc89c0 20 remove_watcher() i=1 2024-09-12T18:07:19.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.655+0000 7fe4dbfc89c0 20 remove_watcher() i=2 2024-09-12T18:07:19.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.659+0000 7fe4dbfc89c0 20 remove_watcher() i=3 2024-09-12T18:07:19.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.663+0000 7fe4dbfc89c0 20 remove_watcher() i=4 2024-09-12T18:07:19.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.663+0000 7fe4dbfc89c0 20 remove_watcher() i=5 2024-09-12T18:07:19.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.663+0000 7fe4dbfc89c0 20 remove_watcher() i=6 2024-09-12T18:07:19.664 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.667+0000 7fe4dbfc89c0 20 remove_watcher() i=7 2024-09-12T18:07:19.679 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T18:07:19.716 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:19.717 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:19.762 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.763+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 realm 2024-09-12T18:07:19.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:19.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:19.766 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:19.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 searching for the correct realm 2024-09-12T18:07:19.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.775+0000 7fb7109a5640 0 -- 172.21.15.157:0/2117843431 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fb704008040 msgr2=0x7fb70406f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:19.989 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.991+0000 7fb7101a4640 0 -- 172.21.15.157:0/2117843431 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55c4081f8740 msgr2=0x55c4081fab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:19.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:19.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:19.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:19.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:19.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:19.997 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:19.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:19.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:19.998 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:19.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:19.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 zone default found 2024-09-12T18:07:19.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 4 Realm: () 2024-09-12T18:07:19.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:19.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:19.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:19.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 zonegroup default 2024-09-12T18:07:19.999 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 started sync module instance, tier type = 2024-09-12T18:07:20.001 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:20.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=0 2024-09-12T18:07:20.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=1 2024-09-12T18:07:20.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=2 2024-09-12T18:07:20.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=3 2024-09-12T18:07:20.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=4 2024-09-12T18:07:20.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=5 2024-09-12T18:07:20.025 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=6 2024-09-12T18:07:20.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=7 2024-09-12T18:07:20.026 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.027+0000 7fb71269e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:20.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.031+0000 7fb5c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:20.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:20.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:20.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 note: GC not initialized 2024-09-12T18:07:20.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb5c5fdb640 20 reqs_thread_entry: start 2024-09-12T18:07:20.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:20.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 Filter name: none 2024-09-12T18:07:20.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb5377fe640 20 reqs_thread_entry: start 2024-09-12T18:07:20.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:20.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:20.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:20.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:20.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:07:20.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.039+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:20.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:20.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:20.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:20.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:20.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:07:20.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:20.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:20.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:20.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:07:20.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464330 cookie 94300438286128 notifier 8181 bl.length()=827 2024-09-12T18:07:20.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:20.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:20.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:20.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:07:20.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:07:20.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:07:20.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:07:20.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.0 2024-09-12T18:07:20.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.0 2024-09-12T18:07:20.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.1 2024-09-12T18:07:20.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.1 2024-09-12T18:07:20.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.2 2024-09-12T18:07:20.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.2 2024-09-12T18:07:20.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.3 2024-09-12T18:07:20.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.3 2024-09-12T18:07:20.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:20.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:20.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:20.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:20.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.059+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:20.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.059+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:20.061 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb71269e9c0 time 2024-09-12T18:07:20.065675+0000 2024-09-12T18:07:20.061 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:20.062 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:20.062 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb715f782eb] 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb715f7849f] 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c40549d0c1] 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55c4054ae4f1] 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c4054afb44] 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb714dded90] 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7fb71269e9c0 thread_name:radosgw-admin 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.063+0000 7fb71269e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb71269e9c0 time 2024-09-12T18:07:20.065675+0000 2024-09-12T18:07:20.063 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb715f782eb] 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb715f7849f] 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c40549d0c1] 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55c4054ae4f1] 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c4054afb44] 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb714dded90] 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:07:20.064 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.070 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:20.070 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb714df7520] 2024-09-12T18:07:20.070 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:07:20.070 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb715f78345] 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb715f7849f] 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c40549d0c1] 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55c4054ae4f1] 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c4054afb44] 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb714dded90] 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.067+0000 7fb71269e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7fb71269e9c0 thread_name:radosgw-admin 2024-09-12T18:07:20.071 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb714df7520] 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb715f78345] 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb715f7849f] 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c40549d0c1] 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55c4054ae4f1] 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c4054afb44] 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb714dded90] 2024-09-12T18:07:20.072 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: _finish_auth 0 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: _check_auth_tickets 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: dump: 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.073 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 monclient: authenticate success, global_id 8169 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 4 set_mon_vals no callback set 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 10 monclient: shutdown 2024-09-12T18:07:20.074 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) unregister_commands rotate-key 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 10 monclient: monmap: 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:20.075 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding auth protocol: cephx 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding auth protocol: cephx 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding auth protocol: cephx 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.076 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 1 librados: starting msgr at 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 1 librados: starting objecter 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command objecter_requests hook 0x55c40813c400 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 1 librados: setting wanted keys 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 1 librados: calling monclient init 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 10 monclient: init 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding auth protocol: cephx 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding auth protocol: cephx 2024-09-12T18:07:20.077 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding auth protocol: cephx 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.078 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command rotate-key hook 0x55c40810b598 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-c con 0x55c407fbb760 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-a con 0x55c407fbbb40 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-b con 0x55c408053a70 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): authenticate will time out at 2601.968201s 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): get_auth_request con 0x55c407fbb760 auth_method 0 2024-09-12T18:07:20.079 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): get_auth_request con 0x55c407fbbb40 auth_method 0 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.080 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_done global_id 8172 payload 824 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient: _finish_hunting 0 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 1 monclient: found mon.noname-a 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: dump: 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.081 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: _finish_auth 0 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: _check_auth_tickets 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: dump: 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.082 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 5 monclient: authenticate success, global_id 8172 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:07:19.747+0000 7fb5fe60c640 4 set_mon_vals no callback set 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.083 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 1 librados: init done 2024-09-12T18:07:20.084 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:07:19.747+0000 7fb5fce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:20.084 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:07:19.747+0000 7fb5fce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.084 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:07:19.747+0000 7fb5fce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.084 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb5f8070b10 auth_method 0 2024-09-12T18:07:20.084 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:07:19.747+0000 7fb7109a5640 10 monclient: get_auth_request con 0x55c40813dfb0 auth_method 0 2024-09-12T18:07:20.084 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:07:19.751+0000 7fb7101a4640 10 monclient: get_auth_request con 0x55c408155db0 auth_method 0 2024-09-12T18:07:20.084 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:07:19.751+0000 7fb70f9a3640 10 monclient: get_auth_request con 0x55c40815a1a0 auth_method 0 2024-09-12T18:07:20.084 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:20.084 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:20.084 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: monmap: 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding auth protocol: cephx 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding auth protocol: cephx 2024-09-12T18:07:20.085 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding auth protocol: cephx 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.086 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c408162ac0 EEXIST 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: init 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding auth protocol: cephx 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding auth protocol: cephx 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding auth protocol: cephx 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.087 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command rotate-key cmddesc rotate-key hook 0x55c40815d820 EEXIST 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-b con 0x55c408186c70 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-c con 0x55c4081865a0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:20.088 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-a con 0x55c408184f80 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): authenticate will time out at 2601.977751s 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): get_auth_request con 0x55c4081865a0 auth_method 0 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): get_auth_request con 0x55c408184f80 auth_method 0 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.089 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_done global_id 7598 payload 824 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient: _finish_hunting 0 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 1 monclient: found mon.noname-c 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:07:19.755+0000 7fb7101a4640 10 monclient: get_auth_request con 0x55c408186c70 auth_method 0 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:20.090 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: dump: 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: _finish_auth 0 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:07:20.091 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: dump: 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.092 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 monclient: authenticate success, global_id 7598 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:07:19.755+0000 7fb7111a6640 4 set_mon_vals no callback set 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:07:19.759+0000 7fb5f5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:07:19.759+0000 7fb5f5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:07:19.759+0000 7fb5f5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb5e8070a20 auth_method 0 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: get_monmap_and_config 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:20.093 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: monmap: 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding auth protocol: cephx 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding auth protocol: cephx 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding auth protocol: cephx 2024-09-12T18:07:20.094 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.095 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: init 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding auth protocol: cephx 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding auth protocol: cephx 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding auth protocol: cephx 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.096 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc9b977188 EEXIST 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-a con 0x55c4081dab70 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-b con 0x55c4081aa590 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-c con 0x55c4081d6340 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.097 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): authenticate will time out at 2601.981797s 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): get_auth_request con 0x55c4081dab70 auth_method 0 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): get_auth_request con 0x55c4081d6340 auth_method 0 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.098 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): handle_auth_done global_id 8178 payload 274 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient: _finish_hunting 0 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:07:19.759+0000 7fb7101a4640 1 monclient: found mon.noname-a 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: dump: 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.099 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: _finish_auth 0 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: _check_auth_tickets 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.100 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: dump: 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 monclient: authenticate success, global_id 8178 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:20.101 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 4 set_mon_vals no callback set 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: shutdown 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: monmap: 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:20.102 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding auth protocol: cephx 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding auth protocol: cephx 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding auth protocol: cephx 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.103 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 librados: starting msgr at 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 librados: starting objecter 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c408184bf0 EEXIST 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 librados: setting wanted keys 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 librados: calling monclient init 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: init 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding auth protocol: cephx 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding auth protocol: cephx 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding auth protocol: cephx 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.104 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.105 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command rotate-key cmddesc rotate-key hook 0x55c408188bd8 EEXIST 2024-09-12T18:07:20.106 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:20.106 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:07:20.106 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-c con 0x55c4081aa590 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:20.106 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-b con 0x55c4081d6340 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:20.108 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-a con 0x55c4081dab70 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:20.108 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.108 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.108 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.108 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:20.108 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): authenticate will time out at 2601.984424s 2024-09-12T18:07:20.108 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): get_auth_request con 0x55c4081dab70 auth_method 0 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): get_auth_request con 0x55c4081aa590 auth_method 0 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.109 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): handle_auth_done global_id 8181 payload 824 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient: _finish_hunting 0 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:07:19.763+0000 7fb7109a5640 1 monclient: found mon.noname-a 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: dump: 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.110 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: _finish_auth 0 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: dump: 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.111 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 5 monclient: authenticate success, global_id 8181 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:07:19.763+0000 7fb5e77fe640 4 set_mon_vals no callback set 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.112 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 1 librados: init done 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command cr dump hook 0x55c4081d69f8 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb5d8070ae0 auth_method 0 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:07:19.767+0000 7fb70f9a3640 10 monclient: get_auth_request con 0x55c4081f44d0 auth_method 0 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 realm 2024-09-12T18:07:20.113 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:07:19.767+0000 7fb7101a4640 10 monclient: get_auth_request con 0x55c4081f8740 auth_method 0 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:07:19.767+0000 7fb70f9a3640 10 monclient: get_auth_request con 0x55c4081fbf80 auth_method 0 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 searching for the correct realm 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:07:19.771+0000 7fb7109a5640 10 monclient: get_auth_request con 0x55c408200c70 auth_method 0 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:07:19.771+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb708031030 auth_method 0 2024-09-12T18:07:20.114 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:07:19.771+0000 7fb70f9a3640 10 monclient: get_auth_request con 0x7fb70406d040 auth_method 0 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:07:19.775+0000 7fb7109a5640 10 monclient: get_auth_request con 0x7fb704008040 auth_method 0 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:07:19.775+0000 7fb7109a5640 0 -- 172.21.15.157:0/2117843431 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fb704008040 msgr2=0x7fb70406f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:07:19.979+0000 7fb7109a5640 10 monclient: get_auth_request con 0x7fb704008040 auth_method 0 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:07:19.983+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb70407a1d0 auth_method 0 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:07:19.991+0000 7fb7101a4640 0 -- 172.21.15.157:0/2117843431 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55c4081f8740 msgr2=0x55c4081fab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:07:19.991+0000 7fb5e5ffb640 1 client.8181.objecter ms_handle_reset 0x55c4081f8740 session 0x55c4081f80c0 osd.5 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:07:19.991+0000 7fb5e5ffb640 10 monclient: _renew_subs 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:07:19.991+0000 7fb5e5ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:07:19.991+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb5d8080980 auth_method 0 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:20.115 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 zone default found 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 4 Realm: () 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:20.116 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 zonegroup default 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 started sync module instance, tier type = 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=0 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=1 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=2 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=3 2024-09-12T18:07:20.117 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=4 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=5 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=6 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=7 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding auth protocol: cephx 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding auth protocol: cephx 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding auth protocol: cephx 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.118 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:07:20.031+0000 7fb5c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command cache list hook 0x55c4081aa300 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command cache inspect hook 0x55c4081aa300 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command cache erase hook 0x55c4081aa300 2024-09-12T18:07:20.119 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command cache zap hook 0x55c4081aa300 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 note: GC not initialized 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:07:20.035+0000 7fb5c5fdb640 20 reqs_thread_entry: start 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command sync trace show hook 0x7fb7000ca050 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command sync trace history hook 0x7fb7000ca050 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command sync trace active hook 0x7fb7000ca050 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command sync trace active_short hook 0x7fb7000ca050 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 Filter name: none 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:07:20.035+0000 7fb5377fe640 20 reqs_thread_entry: start 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:20.120 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:07:20.121 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464330 cookie 94300438286128 notifier 8181 bl.length()=827 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.0 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.0 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.1 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.1 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.2 2024-09-12T18:07:20.122 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.2 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.3 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.3 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:07:20.059+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:07:20.059+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:07:20.063+0000 7fb71269e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb71269e9c0 time 2024-09-12T18:07:20.065675+0000 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:20.123 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb715f782eb] 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb715f7849f] 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c40549d0c1] 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55c4054ae4f1] 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c4054afb44] 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb714dded90] 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:07:20.067+0000 7fb71269e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7fb71269e9c0 thread_name:radosgw-admin 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:20.124 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb714df7520] 2024-09-12T18:07:20.125 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:07:20.125 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:07:20.125 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:07:20.125 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb715f78345] 2024-09-12T18:07:20.125 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb715f7849f] 2024-09-12T18:07:20.125 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c40549d0c1] 2024-09-12T18:07:20.125 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55c4054ae4f1] 2024-09-12T18:07:20.125 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c4054afb44] 2024-09-12T18:07:20.125 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:07:20.125 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb714dded90] 2024-09-12T18:07:20.125 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:07:20.126 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:07:20.127 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:07:20.128 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:07:20.129 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:07:20.130 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:07:20.131 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:07:20.132 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5377fe640 / http_manager 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5c5fdb640 / http_manager 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5c6fdd640 / rgw_dt_lg_renew 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5e5ffb640 / ms_dispatch 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5e77fe640 / io_context_pool 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5f5ffb640 / ms_dispatch 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5fce09640 / ms_dispatch 2024-09-12T18:07:20.133 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5fe60c640 / io_context_pool 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb70f9a3640 / msgr-worker-2 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb7101a4640 / msgr-worker-1 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb7109a5640 / msgr-worker-0 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb7111a6640 / io_context_pool 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb71269e9c0 / radosgw-admin 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.137079.log 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: _finish_auth 0 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: _check_auth_tickets 2024-09-12T18:07:20.134 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:07:19.743+0000 7fb5fe60c640 10 monclient: dump: 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.135 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 monclient: authenticate success, global_id 8169 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 4 set_mon_vals no callback set 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 10 monclient: shutdown 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) unregister_commands rotate-key 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 10 monclient: monmap: 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:20.136 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding auth protocol: cephx 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding auth protocol: cephx 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding auth protocol: cephx 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.137 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: crc 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c408110c30) adding con mode: secure 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 1 librados: starting msgr at 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 1 librados: starting objecter 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command objecter_requests hook 0x55c40813c400 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 1 librados: setting wanted keys 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 1 librados: calling monclient init 2024-09-12T18:07:20.138 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 10 monclient: init 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding auth protocol: cephx 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding auth protocol: cephx 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding auth protocol: cephx 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.139 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: crc 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 5 AuthRegistry(0x55c40810b450) adding con mode: secure 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:07:19.743+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command rotate-key hook 0x55c40810b598 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-c con 0x55c407fbb760 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-a con 0x55c407fbbb40 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-b con 0x55c408053a70 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.140 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.141 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:20.141 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient(hunting): authenticate will time out at 2601.968201s 2024-09-12T18:07:20.141 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): get_auth_request con 0x55c407fbb760 auth_method 0 2024-09-12T18:07:20.141 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.141 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.141 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.141 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): get_auth_request con 0x55c407fbbb40 auth_method 0 2024-09-12T18:07:20.141 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.141 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_done global_id 8172 payload 824 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient: _finish_hunting 0 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 1 monclient: found mon.noname-a 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:07:19.747+0000 7fb70f9a3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.142 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: dump: 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: _finish_auth 0 2024-09-12T18:07:20.143 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: _check_auth_tickets 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:07:19.747+0000 7fb5fce09640 10 monclient: dump: 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.144 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 5 monclient: authenticate success, global_id 8172 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:07:19.747+0000 7fb5fe60c640 4 set_mon_vals no callback set 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:07:19.747+0000 7fb71269e9c0 1 librados: init done 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:07:19.747+0000 7fb5fce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:07:19.747+0000 7fb5fce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:07:19.747+0000 7fb5fce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:07:19.747+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb5f8070b10 auth_method 0 2024-09-12T18:07:20.145 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:07:19.747+0000 7fb7109a5640 10 monclient: get_auth_request con 0x55c40813dfb0 auth_method 0 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:07:19.751+0000 7fb7101a4640 10 monclient: get_auth_request con 0x55c408155db0 auth_method 0 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:07:19.751+0000 7fb70f9a3640 10 monclient: get_auth_request con 0x55c40815a1a0 auth_method 0 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: monmap: 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.146 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding auth protocol: cephx 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding auth protocol: cephx 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding auth protocol: cephx 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.147 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: crc 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815f0b0) adding con mode: secure 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c408162ac0 EEXIST 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: init 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding auth protocol: cephx 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding auth protocol: cephx 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding auth protocol: cephx 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.148 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: crc 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 AuthRegistry(0x55c40815d6d8) adding con mode: secure 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command rotate-key cmddesc rotate-key hook 0x55c40815d820 EEXIST 2024-09-12T18:07:20.149 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-b con 0x55c408186c70 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-c con 0x55c4081865a0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-a con 0x55c408184f80 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient(hunting): authenticate will time out at 2601.977751s 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): get_auth_request con 0x55c4081865a0 auth_method 0 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.150 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): get_auth_request con 0x55c408184f80 auth_method 0 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:07:19.755+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient(hunting): handle_auth_done global_id 7598 payload 824 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient: _finish_hunting 0 2024-09-12T18:07:20.151 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 1 monclient: found mon.noname-c 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:07:19.755+0000 7fb70f9a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:07:19.755+0000 7fb7101a4640 10 monclient: get_auth_request con 0x55c408186c70 auth_method 0 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: dump: 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.152 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: _finish_auth 0 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:07:19.755+0000 7fb5f5ffb640 10 monclient: dump: 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.153 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 5 monclient: authenticate success, global_id 7598 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:07:19.755+0000 7fb7111a6640 4 set_mon_vals no callback set 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:07:19.755+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:07:19.759+0000 7fb5f5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:20.154 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:07:19.759+0000 7fb5f5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:07:19.759+0000 7fb5f5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb5e8070a20 auth_method 0 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: get_monmap_and_config 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: monmap: 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:20.155 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding auth protocol: cephx 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding auth protocol: cephx 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding auth protocol: cephx 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.156 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: crc 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081a65f0) adding con mode: secure 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: init 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding auth protocol: cephx 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding auth protocol: cephx 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding auth protocol: cephx 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.157 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: crc 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977040) adding con mode: secure 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc9b977188 EEXIST 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-a con 0x55c4081dab70 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:20.158 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-b con 0x55c4081aa590 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-c con 0x55c4081d6340 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient(hunting): authenticate will time out at 2601.981797s 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): get_auth_request con 0x55c4081dab70 auth_method 0 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): get_auth_request con 0x55c4081d6340 auth_method 0 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.159 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:07:19.759+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient(hunting): handle_auth_done global_id 8178 payload 274 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient: _finish_hunting 0 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:07:19.759+0000 7fb7101a4640 1 monclient: found mon.noname-a 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:07:19.759+0000 7fb7101a4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:20.160 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: dump: 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: _finish_auth 0 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: _check_auth_tickets 2024-09-12T18:07:20.161 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:07:19.759+0000 7fb5e77fe640 10 monclient: dump: 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.162 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 monclient: authenticate success, global_id 8178 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 4 set_mon_vals no callback set 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: shutdown 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: monmap: 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.163 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding auth protocol: cephx 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding auth protocol: cephx 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding auth protocol: cephx 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.164 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.165 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.165 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.165 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.165 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: crc 2024-09-12T18:07:20.165 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c4081cd090) adding con mode: secure 2024-09-12T18:07:20.165 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.165 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 librados: starting msgr at 2024-09-12T18:07:20.165 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 librados: starting objecter 2024-09-12T18:07:20.165 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c408184bf0 EEXIST 2024-09-12T18:07:20.165 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 librados: setting wanted keys 2024-09-12T18:07:20.165 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 1 librados: calling monclient init 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 10 monclient: init 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding auth protocol: cephx 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding auth protocol: cephx 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding auth protocol: cephx 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.166 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: crc 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:07:19.759+0000 7fb71269e9c0 5 AuthRegistry(0x55c408188a90) adding con mode: secure 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command rotate-key cmddesc rotate-key hook 0x55c408188bd8 EEXIST 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-c con 0x55c4081aa590 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-b con 0x55c4081d6340 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): picked mon.noname-a con 0x55c4081dab70 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.167 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient(hunting): authenticate will time out at 2601.984424s 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): get_auth_request con 0x55c4081dab70 auth_method 0 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): get_auth_request con 0x55c4081aa590 auth_method 0 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.168 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient(hunting): handle_auth_done global_id 8181 payload 824 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient: _finish_hunting 0 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:07:19.763+0000 7fb7109a5640 1 monclient: found mon.noname-a 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:07:19.763+0000 7fb7109a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: dump: 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.169 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: _finish_auth 0 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:20.170 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 10 monclient: dump: 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 5 monclient: authenticate success, global_id 8181 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:07:19.763+0000 7fb5e77fe640 4 set_mon_vals no callback set 2024-09-12T18:07:20.171 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _renew_subs 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 1 librados: init done 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command cr dump hook 0x55c4081d69f8 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:07:19.763+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:07:19.763+0000 7fb5e5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:07:19.763+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb5d8070ae0 auth_method 0 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:07:19.767+0000 7fb70f9a3640 10 monclient: get_auth_request con 0x55c4081f44d0 auth_method 0 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 realm 2024-09-12T18:07:20.172 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:07:19.767+0000 7fb7101a4640 10 monclient: get_auth_request con 0x55c4081f8740 auth_method 0 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:07:19.767+0000 7fb70f9a3640 10 monclient: get_auth_request con 0x55c4081fbf80 auth_method 0 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:07:19.767+0000 7fb71269e9c0 20 searching for the correct realm 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:07:19.771+0000 7fb7109a5640 10 monclient: get_auth_request con 0x55c408200c70 auth_method 0 2024-09-12T18:07:20.173 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:07:19.771+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb708031030 auth_method 0 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:07:19.771+0000 7fb70f9a3640 10 monclient: get_auth_request con 0x7fb70406d040 auth_method 0 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:07:19.775+0000 7fb7109a5640 10 monclient: get_auth_request con 0x7fb704008040 auth_method 0 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:07:19.775+0000 7fb7109a5640 0 -- 172.21.15.157:0/2117843431 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fb704008040 msgr2=0x7fb70406f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:07:19.979+0000 7fb7109a5640 10 monclient: get_auth_request con 0x7fb704008040 auth_method 0 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:07:19.983+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb70407a1d0 auth_method 0 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:07:19.991+0000 7fb7101a4640 0 -- 172.21.15.157:0/2117843431 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55c4081f8740 msgr2=0x55c4081fab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:07:19.991+0000 7fb5e5ffb640 1 client.8181.objecter ms_handle_reset 0x55c4081f8740 session 0x55c4081f80c0 osd.5 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:07:19.991+0000 7fb5e5ffb640 10 monclient: _renew_subs 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:07:19.991+0000 7fb5e5ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:07:19.991+0000 7fb7101a4640 10 monclient: get_auth_request con 0x7fb5d8080980 auth_method 0 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:20.174 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:07:19.999+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 zone default found 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 4 Realm: () 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:20.175 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 zonegroup default 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 started sync module instance, tier type = 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:07:20.003+0000 7fb71269e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=0 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=1 2024-09-12T18:07:20.176 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=2 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=3 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=4 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=5 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=6 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 20 add_watcher() i=7 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:07:20.027+0000 7fb71269e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding auth protocol: cephx 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding auth protocol: cephx 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding auth protocol: cephx 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.177 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:07:20.031+0000 7fb5c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: crc 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:07:20.031+0000 7fb71269e9c0 5 AuthRegistry(0x7ffc9b977510) adding con mode: secure 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:20.178 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command cache list hook 0x55c4081aa300 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command cache inspect hook 0x55c4081aa300 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command cache erase hook 0x55c4081aa300 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command cache zap hook 0x55c4081aa300 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 note: GC not initialized 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:07:20.035+0000 7fb5c5fdb640 20 reqs_thread_entry: start 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command sync trace show hook 0x7fb7000ca050 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command sync trace history hook 0x7fb7000ca050 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command sync trace active hook 0x7fb7000ca050 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 5 asok(0x55c407efe2b0) register_command sync trace active_short hook 0x7fb7000ca050 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 Filter name: none 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:07:20.035+0000 7fb5377fe640 20 reqs_thread_entry: start 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:20.179 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:07:20.035+0000 7fb71269e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:07:20.039+0000 7fb71269e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:20.180 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:07:20.047+0000 7fb71269e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464330 cookie 94300438286128 notifier 8181 bl.length()=827 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:07:20.047+0000 7fb5e77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:07:20.051+0000 7fb71269e9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.0 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.0 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.1 2024-09-12T18:07:20.181 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.1 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.2 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.2 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.3 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.3 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:07:20.055+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:07:20.059+0000 7fb71269e9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:07:20.059+0000 7fb71269e9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:07:20.063+0000 7fb71269e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb71269e9c0 time 2024-09-12T18:07:20.065675+0000 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.182 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb715f782eb] 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb715f7849f] 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c40549d0c1] 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55c4054ae4f1] 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c4054afb44] 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb714dded90] 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:07:20.067+0000 7fb71269e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7fb71269e9c0 thread_name:radosgw-admin 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.183 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:20.184 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb714df7520] 2024-09-12T18:07:20.184 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:07:20.184 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:07:20.184 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:07:20.184 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb715f78345] 2024-09-12T18:07:20.184 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb715f7849f] 2024-09-12T18:07:20.184 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c40549d0c1] 2024-09-12T18:07:20.184 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55c4054ae4f1] 2024-09-12T18:07:20.184 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c4054afb44] 2024-09-12T18:07:20.184 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:07:20.184 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb714dded90] 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:07:20.185 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:07:20.186 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:07:20.187 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:07:20.188 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:07:20.189 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:07:20.190 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:07:20.191 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5377fe640 / http_manager 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5c5fdb640 / http_manager 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5c6fdd640 / rgw_dt_lg_renew 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5e5ffb640 / ms_dispatch 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5e77fe640 / io_context_pool 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5f5ffb640 / ms_dispatch 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5fce09640 / ms_dispatch 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb5fe60c640 / io_context_pool 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb70f9a3640 / msgr-worker-2 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb7101a4640 / msgr-worker-1 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb7109a5640 / msgr-worker-0 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb7111a6640 / io_context_pool 2024-09-12T18:07:20.192 INFO:tasks.workunit.client.0.smithi157.stderr: 7fb71269e9c0 / radosgw-admin 2024-09-12T18:07:20.193 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:07:20.193 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:07:20.193 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:07:20.068232Z_717c06f8-1f61-454a-838e-602e1b29488f/log 2024-09-12T18:07:20.193 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:07:20.194 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.147+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.147+0000 7f01958019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.147+0000 7f01958019c0 20 realm 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.147+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.147+0000 7f01958019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.147+0000 7f01958019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.147+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.147+0000 7f01958019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.147+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.195 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.151+0000 7f01958019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:20.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.151+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.151+0000 7f01958019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:20.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.151+0000 7f01958019c0 20 searching for the correct realm 2024-09-12T18:07:20.196 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.155+0000 7f0192b06640 0 -- 172.21.15.157:0/3976299810 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f01880b9030 msgr2=0x7f01880fd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:20.369 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.371+0000 7f0193307640 0 -- 172.21.15.157:0/3976299810 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f0188115040 msgr2=0x7f018812a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:20.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.587+0000 7f01958019c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:20.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.587+0000 7f01958019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:20.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.587+0000 7f01958019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:20.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.587+0000 7f01958019c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:20.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.587+0000 7f01958019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:20.586 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.587+0000 7f01958019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:20.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.587+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.587+0000 7f01958019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.587+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:20.587 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:20.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 zone default found 2024-09-12T18:07:20.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 4 Realm: () 2024-09-12T18:07:20.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:20.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:20.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:20.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 zonegroup default 2024-09-12T18:07:20.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 started sync module instance, tier type = 2024-09-12T18:07:20.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.591+0000 7f01958019c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:20.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.619+0000 7f01958019c0 20 add_watcher() i=0 2024-09-12T18:07:20.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.619+0000 7f01958019c0 20 add_watcher() i=1 2024-09-12T18:07:20.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.619+0000 7f01958019c0 20 add_watcher() i=2 2024-09-12T18:07:20.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.619+0000 7f01958019c0 20 add_watcher() i=3 2024-09-12T18:07:20.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.619+0000 7f01958019c0 20 add_watcher() i=4 2024-09-12T18:07:20.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.619+0000 7f01958019c0 20 add_watcher() i=5 2024-09-12T18:07:20.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.623+0000 7f01958019c0 20 add_watcher() i=6 2024-09-12T18:07:20.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.623+0000 7f01958019c0 20 add_watcher() i=7 2024-09-12T18:07:20.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.623+0000 7f01958019c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:20.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.627+0000 7f0049fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.627+0000 7f01958019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.627+0000 7f01958019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.627+0000 7f01958019c0 5 note: GC not initialized 2024-09-12T18:07:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.627+0000 7f0048fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.627+0000 7f01958019c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.627+0000 7f01958019c0 20 Filter name: none 2024-09-12T18:07:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.627+0000 7effc27fc640 20 reqs_thread_entry: start 2024-09-12T18:07:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.627+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.631+0000 7f01958019c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:20.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.631+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.631+0000 7f01958019c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:07:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.631+0000 7f01958019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.631+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.631+0000 7f01958019c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:20.629 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.631+0000 7f01958019c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.631+0000 7f01958019c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:07:20.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.631+0000 7f01958019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:20.633 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.635+0000 7f0049fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:20.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.639+0000 7f01958019c0 20 remove_watcher() i=0 2024-09-12T18:07:20.638 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.639+0000 7f01958019c0 2 removed watcher, disabling cache 2024-09-12T18:07:20.640 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.643+0000 7f01958019c0 20 remove_watcher() i=1 2024-09-12T18:07:20.643 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.643+0000 7f01958019c0 20 remove_watcher() i=2 2024-09-12T18:07:20.645 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.647+0000 7f01958019c0 20 remove_watcher() i=3 2024-09-12T18:07:20.647 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.651+0000 7f01958019c0 20 remove_watcher() i=4 2024-09-12T18:07:20.648 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.651+0000 7f01958019c0 20 remove_watcher() i=5 2024-09-12T18:07:20.649 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.651+0000 7f01958019c0 20 remove_watcher() i=6 2024-09-12T18:07:20.651 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.655+0000 7f01958019c0 20 remove_watcher() i=7 2024-09-12T18:07:20.733 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:07:20.761 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:20.761 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:20.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.807+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 20 realm 2024-09-12T18:07:20.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:20.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:20.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:20.811 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.811+0000 7f2ccdbf49c0 20 searching for the correct realm 2024-09-12T18:07:20.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.819+0000 7f2ccaef9640 0 -- 172.21.15.157:0/2031355396 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f2cb40c1020 msgr2=0x7f2cb41110c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:20.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.823+0000 7f2ccaef9640 0 -- 172.21.15.157:0/2031355396 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f2b94080880 msgr2=0x7f2b94082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:20.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:20.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:20.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:20.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:20.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:20.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:20.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:20.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:20.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 zone default found 2024-09-12T18:07:20.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 4 Realm: () 2024-09-12T18:07:20.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:20.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:20.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:20.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 zonegroup default 2024-09-12T18:07:20.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.831+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.835+0000 7f2ccdbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.835+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.835+0000 7f2ccdbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:20.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.835+0000 7f2ccdbf49c0 20 started sync module instance, tier type = 2024-09-12T18:07:20.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.835+0000 7f2ccdbf49c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:20.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.855+0000 7f2ccdbf49c0 20 add_watcher() i=0 2024-09-12T18:07:20.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.855+0000 7f2ccdbf49c0 20 add_watcher() i=1 2024-09-12T18:07:20.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.855+0000 7f2ccdbf49c0 20 add_watcher() i=2 2024-09-12T18:07:20.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.855+0000 7f2ccdbf49c0 20 add_watcher() i=3 2024-09-12T18:07:20.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.855+0000 7f2ccdbf49c0 20 add_watcher() i=4 2024-09-12T18:07:20.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.855+0000 7f2ccdbf49c0 20 add_watcher() i=5 2024-09-12T18:07:20.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.855+0000 7f2ccdbf49c0 20 add_watcher() i=6 2024-09-12T18:07:20.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.855+0000 7f2ccdbf49c0 20 add_watcher() i=7 2024-09-12T18:07:20.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.855+0000 7f2ccdbf49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:20.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.855+0000 7f2b827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:20.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:20.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:20.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 5 note: GC not initialized 2024-09-12T18:07:20.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2b817e2640 20 reqs_thread_entry: start 2024-09-12T18:07:20.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:20.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 20 Filter name: none 2024-09-12T18:07:20.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2b7a7fc640 20 reqs_thread_entry: start 2024-09-12T18:07:20.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:20.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:20.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:20.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:20.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:07:20.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:20.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:07:20.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:20.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:07:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:20.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:20.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:20.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.859+0000 7f2ccdbf49c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:20.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.863+0000 7f2b827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:20.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.867+0000 7f2ccdbf49c0 20 remove_watcher() i=0 2024-09-12T18:07:20.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.871+0000 7f2ccdbf49c0 2 removed watcher, disabling cache 2024-09-12T18:07:20.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.871+0000 7f2ccdbf49c0 20 remove_watcher() i=1 2024-09-12T18:07:20.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.875+0000 7f2ccdbf49c0 20 remove_watcher() i=2 2024-09-12T18:07:20.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.879+0000 7f2ccdbf49c0 20 remove_watcher() i=3 2024-09-12T18:07:20.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.883+0000 7f2ccdbf49c0 20 remove_watcher() i=4 2024-09-12T18:07:20.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.887+0000 7f2ccdbf49c0 20 remove_watcher() i=5 2024-09-12T18:07:20.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.887+0000 7f2ccdbf49c0 20 remove_watcher() i=6 2024-09-12T18:07:20.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:20.887+0000 7f2ccdbf49c0 20 remove_watcher() i=7 2024-09-12T18:07:50.933 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:07:50.967 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:50.967 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:51.013 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.014+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.014+0000 7f6b31c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.014+0000 7f6b31c319c0 20 realm 2024-09-12T18:07:51.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.014+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.014+0000 7f6b31c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.014+0000 7f6b31c319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:51.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.014+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.014+0000 7f6b31c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.014+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.018+0000 7f6b31c319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:51.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.018+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.018+0000 7f6b31c319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:51.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.018+0000 7f6b31c319c0 20 searching for the correct realm 2024-09-12T18:07:51.024 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.026+0000 7f6b2ff38640 0 -- 172.21.15.157:0/1281083605 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f6b24065040 msgr2=0x7f6b2409f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:51.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.242+0000 7f6b2f737640 0 -- 172.21.15.157:0/1281083605 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x558b66803300 msgr2=0x558b668056f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:51.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:51.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:51.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:51.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:51.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:51.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:51.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:51.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:51.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 zone default found 2024-09-12T18:07:51.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 4 Realm: () 2024-09-12T18:07:51.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:51.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:51.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:51.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 zonegroup default 2024-09-12T18:07:51.251 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.250+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.254+0000 7f6b31c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.254+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.254+0000 7f6b31c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.254+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.254+0000 7f6b31c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.254+0000 7f6b31c319c0 20 started sync module instance, tier type = 2024-09-12T18:07:51.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.254+0000 7f6b31c319c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:51.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.278+0000 7f6b31c319c0 20 add_watcher() i=0 2024-09-12T18:07:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.278+0000 7f6b31c319c0 20 add_watcher() i=1 2024-09-12T18:07:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.278+0000 7f6b31c319c0 20 add_watcher() i=2 2024-09-12T18:07:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.278+0000 7f6b31c319c0 20 add_watcher() i=3 2024-09-12T18:07:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.278+0000 7f6b31c319c0 20 add_watcher() i=4 2024-09-12T18:07:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.278+0000 7f6b31c319c0 20 add_watcher() i=5 2024-09-12T18:07:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.278+0000 7f6b31c319c0 20 add_watcher() i=6 2024-09-12T18:07:51.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.282+0000 7f6b31c319c0 20 add_watcher() i=7 2024-09-12T18:07:51.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.282+0000 7f6b31c319c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:51.284 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.286+0000 7f69e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:51.285 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.286+0000 7f6b31c319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:51.285 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.286+0000 7f6b31c319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:51.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.286+0000 7f6b31c319c0 5 note: GC not initialized 2024-09-12T18:07:51.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.286+0000 7f69e4fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:51.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.286+0000 7f6b31c319c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:51.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.286+0000 7f6b31c319c0 20 Filter name: none 2024-09-12T18:07:51.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.286+0000 7f695e7fc640 20 reqs_thread_entry: start 2024-09-12T18:07:51.287 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.286+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.290+0000 7f6b31c319c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:51.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.290+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.290+0000 7f6b31c319c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:07:51.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.290+0000 7f6b31c319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:51.289 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.290+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.290+0000 7f6b31c319c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:51.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.290+0000 7f6b31c319c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.290+0000 7f6b31c319c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:07:51.290 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.290+0000 7f6b31c319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:51.292 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.294+0000 7f69e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:51.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.298+0000 7f6b31c319c0 20 remove_watcher() i=0 2024-09-12T18:07:51.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.298+0000 7f6b31c319c0 2 removed watcher, disabling cache 2024-09-12T18:07:51.299 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.302+0000 7f6b31c319c0 20 remove_watcher() i=1 2024-09-12T18:07:51.302 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.302+0000 7f6b31c319c0 20 remove_watcher() i=2 2024-09-12T18:07:51.304 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.306+0000 7f6b31c319c0 20 remove_watcher() i=3 2024-09-12T18:07:51.306 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.306+0000 7f6b31c319c0 20 remove_watcher() i=4 2024-09-12T18:07:51.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.310+0000 7f6b31c319c0 20 remove_watcher() i=5 2024-09-12T18:07:51.309 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.310+0000 7f6b31c319c0 20 remove_watcher() i=6 2024-09-12T18:07:51.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.314+0000 7f6b31c319c0 20 remove_watcher() i=7 2024-09-12T18:07:51.430 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:07:51.458 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:51.458 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:51.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.502+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 20 realm 2024-09-12T18:07:51.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:51.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.505 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:51.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:51.506 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.506+0000 7fcc92b579c0 20 searching for the correct realm 2024-09-12T18:07:51.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.514+0000 7fcc90e5e640 0 -- 172.21.15.157:0/1391311738 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fcc7811da60 msgr2=0x7fcc78001000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:51.729 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.730+0000 7fcc9065d640 0 -- 172.21.15.157:0/1391311738 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5607bae43ff0 msgr2=0x5607bae463e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:51.736 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:51.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:51.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:51.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:51.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:51.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:51.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:51.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:51.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 zone default found 2024-09-12T18:07:51.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 4 Realm: () 2024-09-12T18:07:51.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:51.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:51.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:51.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 zonegroup default 2024-09-12T18:07:51.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.738+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.742+0000 7fcc92b579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.742+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.741 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.742+0000 7fcc92b579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.742+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.742+0000 7fcc92b579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.742+0000 7fcc92b579c0 20 started sync module instance, tier type = 2024-09-12T18:07:51.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.742+0000 7fcc92b579c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:51.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.766+0000 7fcc92b579c0 20 add_watcher() i=0 2024-09-12T18:07:51.764 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.766+0000 7fcc92b579c0 20 add_watcher() i=1 2024-09-12T18:07:51.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.766+0000 7fcc92b579c0 20 add_watcher() i=2 2024-09-12T18:07:51.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.766+0000 7fcc92b579c0 20 add_watcher() i=3 2024-09-12T18:07:51.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.766+0000 7fcc92b579c0 20 add_watcher() i=4 2024-09-12T18:07:51.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.766+0000 7fcc92b579c0 20 add_watcher() i=5 2024-09-12T18:07:51.765 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.766+0000 7fcc92b579c0 20 add_watcher() i=6 2024-09-12T18:07:51.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.766+0000 7fcc92b579c0 20 add_watcher() i=7 2024-09-12T18:07:51.767 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.766+0000 7fcc92b579c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:51.771 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.770+0000 7fcb46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:51.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:51.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:51.772 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 5 note: GC not initialized 2024-09-12T18:07:51.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcb45fdb640 20 reqs_thread_entry: start 2024-09-12T18:07:51.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:51.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 20 Filter name: none 2024-09-12T18:07:51.773 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcab77fe640 20 reqs_thread_entry: start 2024-09-12T18:07:51.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:51.774 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:51.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:51.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:51.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:07:51.775 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.774+0000 7fcc92b579c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:51.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:51.776 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:51.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:51.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:51.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:07:51.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:51.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:51.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:51.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:51.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:51.778 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.778+0000 7fcc92b579c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:51.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.782+0000 7fcb46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:51.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.786+0000 7fcc92b579c0 20 remove_watcher() i=0 2024-09-12T18:07:51.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.786+0000 7fcc92b579c0 2 removed watcher, disabling cache 2024-09-12T18:07:51.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.786+0000 7fcc92b579c0 20 remove_watcher() i=1 2024-09-12T18:07:51.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.790+0000 7fcc92b579c0 20 remove_watcher() i=2 2024-09-12T18:07:51.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.794+0000 7fcc92b579c0 20 remove_watcher() i=3 2024-09-12T18:07:51.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.794+0000 7fcc92b579c0 20 remove_watcher() i=4 2024-09-12T18:07:51.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.794+0000 7fcc92b579c0 20 remove_watcher() i=5 2024-09-12T18:07:51.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.798+0000 7fcc92b579c0 20 remove_watcher() i=6 2024-09-12T18:07:51.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.798+0000 7fcc92b579c0 20 remove_watcher() i=7 2024-09-12T18:07:51.814 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:07:51.840 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:51.840 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:51.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.882+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 20 realm 2024-09-12T18:07:51.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:51.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.884 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:51.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:51.886 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.886+0000 7f6fedb369c0 20 searching for the correct realm 2024-09-12T18:07:51.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.894+0000 7f6feae3b640 0 -- 172.21.15.157:0/1898799131 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f6fdc0b7b30 msgr2=0x7f6fdc0dea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:51.899 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.898+0000 7f6febe3d640 0 -- 172.21.15.157:0/1898799131 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f6fdc0cdb40 msgr2=0x7f6fdc0ed450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:51.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:51.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:51.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:51.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:51.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:51.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:51.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:51.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:51.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 zone default found 2024-09-12T18:07:51.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 4 Realm: () 2024-09-12T18:07:51.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:51.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:51.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:51.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 zonegroup default 2024-09-12T18:07:51.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.906+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.910+0000 7f6fedb369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:51.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.910+0000 7f6fedb369c0 20 started sync module instance, tier type = 2024-09-12T18:07:51.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.910+0000 7f6fedb369c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:51.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.922+0000 7f6fedb369c0 20 add_watcher() i=0 2024-09-12T18:07:51.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.922+0000 7f6fedb369c0 20 add_watcher() i=1 2024-09-12T18:07:51.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.922+0000 7f6fedb369c0 20 add_watcher() i=2 2024-09-12T18:07:51.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.922+0000 7f6fedb369c0 20 add_watcher() i=3 2024-09-12T18:07:51.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.922+0000 7f6fedb369c0 20 add_watcher() i=4 2024-09-12T18:07:51.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.922+0000 7f6fedb369c0 20 add_watcher() i=5 2024-09-12T18:07:51.922 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.922+0000 7f6fedb369c0 20 add_watcher() i=6 2024-09-12T18:07:51.923 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.922+0000 7f6fedb369c0 20 add_watcher() i=7 2024-09-12T18:07:51.923 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.922+0000 7f6fedb369c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:51.925 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.926+0000 7f6ea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:51.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.926+0000 7f6fedb369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:51.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.926+0000 7f6fedb369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:51.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.926+0000 7f6fedb369c0 5 note: GC not initialized 2024-09-12T18:07:51.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.926+0000 7f6ea0fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:51.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.926+0000 7f6fedb369c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:51.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.926+0000 7f6fedb369c0 20 Filter name: none 2024-09-12T18:07:51.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.926+0000 7f6e1a7fc640 20 reqs_thread_entry: start 2024-09-12T18:07:51.926 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.926+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.926+0000 7f6fedb369c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:51.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.926+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.930+0000 7f6fedb369c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:51.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.930+0000 7f6fedb369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:51.927 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.930+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.930+0000 7f6fedb369c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:51.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.930+0000 7f6fedb369c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:51.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.930+0000 7f6fedb369c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:51.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.930+0000 7f6fedb369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:51.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.930+0000 7f6ea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:51.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.938+0000 7f6fedb369c0 20 remove_watcher() i=0 2024-09-12T18:07:51.937 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.938+0000 7f6fedb369c0 2 removed watcher, disabling cache 2024-09-12T18:07:51.939 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.942+0000 7f6fedb369c0 20 remove_watcher() i=1 2024-09-12T18:07:51.942 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.942+0000 7f6fedb369c0 20 remove_watcher() i=2 2024-09-12T18:07:51.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.946+0000 7f6fedb369c0 20 remove_watcher() i=3 2024-09-12T18:07:51.946 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.946+0000 7f6fedb369c0 20 remove_watcher() i=4 2024-09-12T18:07:51.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.950+0000 7f6fedb369c0 20 remove_watcher() i=5 2024-09-12T18:07:51.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.950+0000 7f6fedb369c0 20 remove_watcher() i=6 2024-09-12T18:07:51.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:51.950+0000 7f6fedb369c0 20 remove_watcher() i=7 2024-09-12T18:07:51.964 INFO:tasks.workunit.client.0.smithi157.stderr: test: duplicated entries should be purged before reshard 2024-09-12T18:07:51.964 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:07:51.989 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:51.989 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:52.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.030+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.034+0000 7f6cd84259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.034+0000 7f6cd84259c0 20 realm 2024-09-12T18:07:52.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.034+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.034+0000 7f6cd84259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.034+0000 7f6cd84259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:52.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.034+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.033 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.034+0000 7f6cd84259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.034 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.034+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.034+0000 7f6cd84259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:52.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.034+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.038+0000 7f6cd84259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:52.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.038+0000 7f6cd84259c0 20 searching for the correct realm 2024-09-12T18:07:52.042 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.042+0000 7f6cd672c640 0 -- 172.21.15.157:0/4256094132 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f6ccc11ac00 msgr2=0x7f6ccc0e7a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:52.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.050+0000 7f6cd5f2b640 0 -- 172.21.15.157:0/4256094132 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5599a5ecbdc0 msgr2=0x5599a5ece1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:52.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:52.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:52.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:52.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:52.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:52.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:52.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:52.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:52.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 zone default found 2024-09-12T18:07:52.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 4 Realm: () 2024-09-12T18:07:52.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:52.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:52.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:52.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 zonegroup default 2024-09-12T18:07:52.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 started sync module instance, tier type = 2024-09-12T18:07:52.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.058+0000 7f6cd84259c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:52.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.074+0000 7f6cd84259c0 20 add_watcher() i=0 2024-09-12T18:07:52.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.074+0000 7f6cd84259c0 20 add_watcher() i=1 2024-09-12T18:07:52.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.074+0000 7f6cd84259c0 20 add_watcher() i=2 2024-09-12T18:07:52.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.074+0000 7f6cd84259c0 20 add_watcher() i=3 2024-09-12T18:07:52.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.074+0000 7f6cd84259c0 20 add_watcher() i=4 2024-09-12T18:07:52.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.074+0000 7f6cd84259c0 20 add_watcher() i=5 2024-09-12T18:07:52.073 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.074+0000 7f6cd84259c0 20 add_watcher() i=6 2024-09-12T18:07:52.074 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.074+0000 7f6cd84259c0 20 add_watcher() i=7 2024-09-12T18:07:52.074 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.074+0000 7f6cd84259c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:52.076 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6b877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:52.077 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6cd84259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:52.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6cd84259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:52.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6cd84259c0 5 note: GC not initialized 2024-09-12T18:07:52.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6b867fc640 20 reqs_thread_entry: start 2024-09-12T18:07:52.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6cd84259c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:52.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6cd84259c0 20 Filter name: none 2024-09-12T18:07:52.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6af7fff640 20 reqs_thread_entry: start 2024-09-12T18:07:52.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6cd84259c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:52.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6cd84259c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:52.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6cd84259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:52.079 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.078+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.082+0000 7f6cd84259c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:52.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.082+0000 7f6cd84259c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.082+0000 7f6cd84259c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:52.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.082+0000 7f6cd84259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:52.082 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.082+0000 7f6b877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:52.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.086+0000 7f6cd84259c0 20 remove_watcher() i=0 2024-09-12T18:07:52.086 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.086+0000 7f6cd84259c0 2 removed watcher, disabling cache 2024-09-12T18:07:52.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.090+0000 7f6cd84259c0 20 remove_watcher() i=1 2024-09-12T18:07:52.090 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.090+0000 7f6cd84259c0 20 remove_watcher() i=2 2024-09-12T18:07:52.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.094+0000 7f6cd84259c0 20 remove_watcher() i=3 2024-09-12T18:07:52.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.094+0000 7f6cd84259c0 20 remove_watcher() i=4 2024-09-12T18:07:52.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.098+0000 7f6cd84259c0 20 remove_watcher() i=5 2024-09-12T18:07:52.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.098+0000 7f6cd84259c0 20 remove_watcher() i=6 2024-09-12T18:07:52.097 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.098+0000 7f6cd84259c0 20 remove_watcher() i=7 2024-09-12T18:07:52.111 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.111 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:07:52.111 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: a-bucket id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-12T18:07:52.111 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.111 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:07:52.143 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:52.143 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:52.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 realm 2024-09-12T18:07:52.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.186+0000 7fec75eca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:52.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.187 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:52.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.189 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:52.190 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 searching for the correct realm 2024-09-12T18:07:52.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.194+0000 7fec731cf640 0 -- 172.21.15.157:0/1635977054 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fec6808b020 msgr2=0x7fec6806a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:52.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.410+0000 7fec739d0640 0 -- 172.21.15.157:0/1635977054 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fec6804f560 msgr2=0x7fec6804f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:52.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:52.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:52.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:52.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:52.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:52.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:52.627 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:52.628 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:52.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 zone default found 2024-09-12T18:07:52.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 4 Realm: () 2024-09-12T18:07:52.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:52.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:52.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:52.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 zonegroup default 2024-09-12T18:07:52.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.631 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 started sync module instance, tier type = 2024-09-12T18:07:52.632 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:52.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=0 2024-09-12T18:07:52.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=1 2024-09-12T18:07:52.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=2 2024-09-12T18:07:52.654 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=3 2024-09-12T18:07:52.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=4 2024-09-12T18:07:52.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=5 2024-09-12T18:07:52.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=6 2024-09-12T18:07:52.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.658+0000 7fec75eca9c0 20 add_watcher() i=7 2024-09-12T18:07:52.656 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.658+0000 7fec75eca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:52.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.658+0000 7feb29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:52.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:52.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:52.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 note: GC not initialized 2024-09-12T18:07:52.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7feb28fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:52.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:52.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 Filter name: none 2024-09-12T18:07:52.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7feaa27fc640 20 reqs_thread_entry: start 2024-09-12T18:07:52.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:52.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:52.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:52.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:52.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:07:52.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:52.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:52.662 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:52.663 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:52.663 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:52.663 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:07:52.672 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:52.672 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:52.672 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:52.672 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:07:52.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 94901164060816 notifier 7724 bl.length()=827 2024-09-12T18:07:52.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:52.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:52.673 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:52.675 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:07:52.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:07:52.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:07:52.676 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:07:52.681 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec75eca9c0 time 2024-09-12T18:07:52.685446+0000 2024-09-12T18:07:52.681 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:52.682 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:52.682 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fec797a42eb] 2024-09-12T18:07:52.682 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fec797a449f] 2024-09-12T18:07:52.682 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe49e90c1] 2024-09-12T18:07:52.682 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe49fb1fa] 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fec7860ad90] 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.682+0000 7fec75eca9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec75eca9c0 time 2024-09-12T18:07:52.685446+0000 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fec797a42eb] 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fec797a449f] 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe49e90c1] 2024-09-12T18:07:52.683 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe49fb1fa] 2024-09-12T18:07:52.684 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:07:52.684 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fec7860ad90] 2024-09-12T18:07:52.684 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:07:52.684 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:07:52.684 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.684 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:07:52.684 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7fec75eca9c0 thread_name:radosgw-admin 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fec78623520] 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fec797a4345] 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fec797a449f] 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe49e90c1] 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe49fb1fa] 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fec7860ad90] 2024-09-12T18:07:52.705 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:07:52.706 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:07:52.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.686+0000 7fec75eca9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:52.706 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7fec75eca9c0 thread_name:radosgw-admin 2024-09-12T18:07:52.706 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.706 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:52.706 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fec78623520] 2024-09-12T18:07:52.706 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:07:52.706 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:07:52.706 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:07:52.706 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fec797a4345] 2024-09-12T18:07:52.706 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fec797a449f] 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe49e90c1] 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe49fb1fa] 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fec7860ad90] 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:07:52.166+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:07:52.166+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:07:52.166+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.707 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:07:52.166+0000 7fec739d0640 10 monclient(hunting): get_auth_request con 0x7fec5c003be0 auth_method 0 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:07:52.166+0000 7fec739d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:07:52.166+0000 7fec739d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:07:52.166+0000 7fec739d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:07:52.166+0000 7fec731cf640 10 monclient(hunting): handle_auth_done global_id 8298 payload 274 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:07:52.166+0000 7fec731cf640 10 monclient: _finish_hunting 0 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:07:52.166+0000 7fec731cf640 1 monclient: found mon.noname-a 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:07:52.166+0000 7fec731cf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: dump: 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.708 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: _finish_auth 0 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: _check_auth_tickets 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.709 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: dump: 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 monclient: authenticate success, global_id 8298 2024-09-12T18:07:52.710 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 4 set_mon_vals no callback set 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 10 monclient: shutdown 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) unregister_commands rotate-key 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 10 monclient: monmap: 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:52.711 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding auth protocol: cephx 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding auth protocol: cephx 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding auth protocol: cephx 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.712 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 1 librados: starting msgr at 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 1 librados: starting objecter 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command objecter_requests hook 0x564fe5f366d0 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 1 librados: setting wanted keys 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 1 librados: calling monclient init 2024-09-12T18:07:52.713 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 10 monclient: init 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding auth protocol: cephx 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding auth protocol: cephx 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding auth protocol: cephx 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.714 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command rotate-key hook 0x564fe61c4b48 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-b con 0x564fe61cbdc0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-c con 0x564fe61f9fd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-a con 0x7fec5c003be0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.715 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): authenticate will time out at 2634.392169s 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): get_auth_request con 0x564fe61f9fd0 auth_method 0 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): get_auth_request con 0x7fec5c003be0 auth_method 0 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.716 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): handle_auth_done global_id 7715 payload 824 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient: _finish_hunting 0 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:07:52.170+0000 7fec731cf640 1 monclient: found mon.noname-c 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: dump: 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.717 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: _finish_auth 0 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: _check_auth_tickets 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: dump: 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.718 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 5 monclient: authenticate success, global_id 7715 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:07:52.170+0000 7feb61e0b640 4 set_mon_vals no callback set 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.719 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 1 librados: init done 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:07:52.170+0000 7feb5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:07:52.170+0000 7feb5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:07:52.170+0000 7feb5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:07:52.170+0000 7fec739d0640 10 monclient: get_auth_request con 0x7feb5c070b10 auth_method 0 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient: get_auth_request con 0x564fe61f1080 auth_method 0 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:07:52.174+0000 7fec739d0640 10 monclient: get_auth_request con 0x564fe6211180 auth_method 0 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:07:52.174+0000 7fec731cf640 10 monclient: get_auth_request con 0x564fe6215820 auth_method 0 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 10 monclient: monmap: 2024-09-12T18:07:52.720 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding auth protocol: cephx 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding auth protocol: cephx 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding auth protocol: cephx 2024-09-12T18:07:52.721 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x564fe621df50 EEXIST 2024-09-12T18:07:52.722 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: init 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding auth protocol: cephx 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding auth protocol: cephx 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding auth protocol: cephx 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.723 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x564fe6218cf0 EEXIST 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-a con 0x564fe6242100 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-c con 0x564fe6241a30 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-b con 0x564fe6240410 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.724 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): authenticate will time out at 2634.400882s 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): get_auth_request con 0x564fe6242100 auth_method 0 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): get_auth_request con 0x564fe6241a30 auth_method 0 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.725 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): handle_auth_done global_id 8304 payload 824 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient: _finish_hunting 0 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:07:52.178+0000 7fec739d0640 1 monclient: found mon.noname-a 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: dump: 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.726 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: _finish_auth 0 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: _check_auth_tickets 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: dump: 2024-09-12T18:07:52.727 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 monclient: authenticate success, global_id 8304 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:07:52.178+0000 7fec749d2640 4 set_mon_vals no callback set 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.728 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:07:52.178+0000 7feb597fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:07:52.178+0000 7feb597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:07:52.178+0000 7feb597fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient: get_auth_request con 0x7feb4c070a20 auth_method 0 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: get_monmap_and_config 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: monmap: 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:52.729 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding auth protocol: cephx 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding auth protocol: cephx 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding auth protocol: cephx 2024-09-12T18:07:52.730 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.731 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: init 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding auth protocol: cephx 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding auth protocol: cephx 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding auth protocol: cephx 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.732 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff731d52e8 EEXIST 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-c con 0x564fe628ffc0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-b con 0x564fe62903a0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-a con 0x564fe6291860 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.733 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): authenticate will time out at 2634.405129s 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): get_auth_request con 0x564fe628ffc0 auth_method 0 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): get_auth_request con 0x564fe6291860 auth_method 0 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.734 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): get_auth_request con 0x564fe62903a0 auth_method 0 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): handle_auth_done global_id 7721 payload 274 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient: _finish_hunting 0 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:07:52.182+0000 7fec739d0640 1 monclient: found mon.noname-c 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.735 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: dump: 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: _finish_auth 0 2024-09-12T18:07:52.736 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: dump: 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.737 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 monclient: authenticate success, global_id 7721 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 4 set_mon_vals no callback set 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: shutdown 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: monmap: 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:52.738 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding auth protocol: cephx 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding auth protocol: cephx 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding auth protocol: cephx 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.739 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 librados: starting msgr at 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 librados: starting objecter 2024-09-12T18:07:52.740 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x564fe6290b00 EEXIST 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 librados: setting wanted keys 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 librados: calling monclient init 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: init 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding auth protocol: cephx 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding auth protocol: cephx 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding auth protocol: cephx 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.741 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x564fe6244068 EEXIST 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-b con 0x564fe628ffc0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-c con 0x564fe6291860 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:52.742 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-a con 0x564fe62843c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): authenticate will time out at 2634.407703s 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): get_auth_request con 0x564fe6291860 auth_method 0 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): get_auth_request con 0x564fe62843c0 auth_method 0 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.743 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:07:52.186+0000 7fec731cf640 10 monclient(hunting): handle_auth_done global_id 7724 payload 824 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:07:52.186+0000 7fec731cf640 10 monclient: _finish_hunting 0 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:07:52.186+0000 7fec731cf640 1 monclient: found mon.noname-c 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:07:52.186+0000 7fec731cf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.744 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: dump: 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: _finish_auth 0 2024-09-12T18:07:52.745 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: _check_auth_tickets 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: dump: 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.746 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 5 monclient: authenticate success, global_id 7724 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:07:52.186+0000 7feb52ffd640 4 set_mon_vals no callback set 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 1 librados: init done 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command cr dump hook 0x564fe628eb18 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:07:52.186+0000 7feb517fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:52.747 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:07:52.186+0000 7feb517fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:07:52.186+0000 7feb517fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:07:52.186+0000 7fec739d0640 10 monclient: get_auth_request con 0x7feb3c070ae0 auth_method 0 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:07:52.186+0000 7fec741d1640 10 monclient: get_auth_request con 0x564fe62afda0 auth_method 0 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 realm 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:07:52.190+0000 7fec739d0640 10 monclient: get_auth_request con 0x564fe62b3fe0 auth_method 0 2024-09-12T18:07:52.748 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:07:52.190+0000 7fec731cf640 10 monclient: get_auth_request con 0x564fe62b7840 auth_method 0 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 searching for the correct realm 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:07:52.190+0000 7fec741d1640 10 monclient: get_auth_request con 0x564fe62bc5e0 auth_method 0 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:07:52.190+0000 7fec739d0640 10 monclient: get_auth_request con 0x564fe6078210 auth_method 0 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:07:52.194+0000 7fec731cf640 10 monclient: get_auth_request con 0x7fec6808b020 auth_method 0 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:07:52.194+0000 7fec731cf640 0 -- 172.21.15.157:0/1635977054 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fec6808b020 msgr2=0x7fec6806a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:07:52.398+0000 7fec731cf640 10 monclient: get_auth_request con 0x7fec6808b020 auth_method 0 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:07:52.402+0000 7fec741d1640 10 monclient: get_auth_request con 0x7fec68008040 auth_method 0 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:07:52.410+0000 7fec739d0640 10 monclient: get_auth_request con 0x7fec6804f560 auth_method 0 2024-09-12T18:07:52.749 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:07:52.410+0000 7fec739d0640 0 -- 172.21.15.157:0/1635977054 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fec6804f560 msgr2=0x7fec6804f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:07:52.614+0000 7fec739d0640 10 monclient: get_auth_request con 0x7fec6804f560 auth_method 0 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:52.750 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 zone default found 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 4 Realm: () 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 zonegroup default 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.751 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 started sync module instance, tier type = 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=0 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=1 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=2 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=3 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=4 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=5 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=6 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 20 add_watcher() i=7 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding auth protocol: cephx 2024-09-12T18:07:52.752 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding auth protocol: cephx 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding auth protocol: cephx 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.753 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:07:52.658+0000 7feb29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command cache list hook 0x564fe628b040 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command cache inspect hook 0x564fe628b040 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command cache erase hook 0x564fe628b040 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command cache zap hook 0x564fe628b040 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 note: GC not initialized 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:07:52.662+0000 7feb28fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command sync trace show hook 0x7fec68004550 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command sync trace history hook 0x7fec68004550 2024-09-12T18:07:52.754 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command sync trace active hook 0x7fec68004550 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command sync trace active_short hook 0x7fec68004550 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 Filter name: none 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:07:52.662+0000 7feaa27fc640 20 reqs_thread_entry: start 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:52.755 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 94901164060816 notifier 7724 bl.length()=827 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:52.756 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:07:52.682+0000 7fec75eca9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec75eca9c0 time 2024-09-12T18:07:52.685446+0000 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fec797a42eb] 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fec797a449f] 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe49e90c1] 2024-09-12T18:07:52.757 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe49fb1fa] 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fec7860ad90] 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:07:52.686+0000 7fec75eca9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7fec75eca9c0 thread_name:radosgw-admin 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fec78623520] 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:07:52.758 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fec797a4345] 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fec797a449f] 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe49e90c1] 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe49fb1fa] 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fec7860ad90] 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:07:52.759 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:07:52.760 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:07:52.761 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:07:52.762 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:07:52.763 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:07:52.764 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:07:52.765 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:07:52.766 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:07:52.766 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:07:52.766 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:07:52.766 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:07:52.766 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:07:52.766 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:07:52.766 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:07:52.766 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:07:52.766 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:07:52.766 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:07:52.766 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: 7feaa27fc640 / http_manager 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb28fe1640 / http_manager 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb29fe3640 / rgw_dt_lg_renew 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb517fa640 / ms_dispatch 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb52ffd640 / io_context_pool 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb597fa640 / ms_dispatch 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb5bfff640 / ms_dispatch 2024-09-12T18:07:52.767 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb61e0b640 / io_context_pool 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr: 7fec731cf640 / msgr-worker-2 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr: 7fec739d0640 / msgr-worker-1 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr: 7fec741d1640 / msgr-worker-0 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr: 7fec749d2640 / io_context_pool 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr: 7fec75eca9c0 / radosgw-admin 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.141211.log 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:07:52.166+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.768 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:07:52.166+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:07:52.166+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:07:52.166+0000 7fec739d0640 10 monclient(hunting): get_auth_request con 0x7fec5c003be0 auth_method 0 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:07:52.166+0000 7fec739d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:07:52.166+0000 7fec739d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:07:52.166+0000 7fec739d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:07:52.166+0000 7fec731cf640 10 monclient(hunting): handle_auth_done global_id 8298 payload 274 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:07:52.166+0000 7fec731cf640 10 monclient: _finish_hunting 0 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:07:52.166+0000 7fec731cf640 1 monclient: found mon.noname-a 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:07:52.166+0000 7fec731cf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:52.769 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: dump: 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: _finish_auth 0 2024-09-12T18:07:52.770 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: _check_auth_tickets 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:07:52.166+0000 7feb61e0b640 10 monclient: dump: 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.771 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 monclient: authenticate success, global_id 8298 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 4 set_mon_vals no callback set 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 10 monclient: shutdown 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) unregister_commands rotate-key 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 10 monclient: monmap: 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:52.772 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding auth protocol: cephx 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding auth protocol: cephx 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding auth protocol: cephx 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.773 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: crc 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61fa480) adding con mode: secure 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 1 librados: starting msgr at 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 1 librados: starting objecter 2024-09-12T18:07:52.774 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command objecter_requests hook 0x564fe5f366d0 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 1 librados: setting wanted keys 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 1 librados: calling monclient init 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 10 monclient: init 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding auth protocol: cephx 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding auth protocol: cephx 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding auth protocol: cephx 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.775 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.776 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.776 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.776 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.776 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: crc 2024-09-12T18:07:52.776 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 5 AuthRegistry(0x564fe61c4a00) adding con mode: secure 2024-09-12T18:07:52.776 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:07:52.166+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.776 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.776 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command rotate-key hook 0x564fe61c4b48 2024-09-12T18:07:52.776 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:52.776 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:07:52.776 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-b con 0x564fe61cbdc0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-c con 0x564fe61f9fd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-a con 0x7fec5c003be0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient(hunting): authenticate will time out at 2634.392169s 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): get_auth_request con 0x564fe61f9fd0 auth_method 0 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.777 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): get_auth_request con 0x7fec5c003be0 auth_method 0 2024-09-12T18:07:52.778 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.778 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.778 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.778 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.778 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.778 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.779 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.779 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient(hunting): handle_auth_done global_id 7715 payload 824 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient: _finish_hunting 0 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:07:52.170+0000 7fec731cf640 1 monclient: found mon.noname-c 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:07:52.170+0000 7fec731cf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: dump: 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.780 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: _finish_auth 0 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: _check_auth_tickets 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:52.781 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:07:52.170+0000 7feb5bfff640 10 monclient: dump: 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 5 monclient: authenticate success, global_id 7715 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:07:52.170+0000 7feb61e0b640 4 set_mon_vals no callback set 2024-09-12T18:07:52.782 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:07:52.170+0000 7fec75eca9c0 1 librados: init done 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:07:52.170+0000 7feb5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:07:52.170+0000 7feb5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:07:52.170+0000 7feb5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:07:52.170+0000 7fec739d0640 10 monclient: get_auth_request con 0x7feb5c070b10 auth_method 0 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:07:52.170+0000 7fec741d1640 10 monclient: get_auth_request con 0x564fe61f1080 auth_method 0 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:07:52.174+0000 7fec739d0640 10 monclient: get_auth_request con 0x564fe6211180 auth_method 0 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:07:52.174+0000 7fec731cf640 10 monclient: get_auth_request con 0x564fe6215820 auth_method 0 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 10 monclient: monmap: 2024-09-12T18:07:52.783 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding auth protocol: cephx 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding auth protocol: cephx 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding auth protocol: cephx 2024-09-12T18:07:52.784 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.785 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.785 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.785 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.785 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.785 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.785 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.785 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.785 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.785 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.785 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: crc 2024-09-12T18:07:52.785 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:07:52.174+0000 7fec75eca9c0 5 AuthRegistry(0x564fe621a5e0) adding con mode: secure 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x564fe621df50 EEXIST 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: init 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding auth protocol: cephx 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding auth protocol: cephx 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding auth protocol: cephx 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.786 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: crc 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6218ba8) adding con mode: secure 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x564fe6218cf0 EEXIST 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-a con 0x564fe6242100 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-c con 0x564fe6241a30 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:52.787 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-b con 0x564fe6240410 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient(hunting): authenticate will time out at 2634.400882s 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): get_auth_request con 0x564fe6242100 auth_method 0 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): get_auth_request con 0x564fe6241a30 auth_method 0 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.788 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient(hunting): handle_auth_done global_id 8304 payload 824 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient: _finish_hunting 0 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:07:52.178+0000 7fec739d0640 1 monclient: found mon.noname-a 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:07:52.178+0000 7fec739d0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:07:52.789 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: dump: 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: _finish_auth 0 2024-09-12T18:07:52.790 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: _check_auth_tickets 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:07:52.178+0000 7feb597fa640 10 monclient: dump: 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.791 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 5 monclient: authenticate success, global_id 8304 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:07:52.178+0000 7fec749d2640 4 set_mon_vals no callback set 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:07:52.178+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:07:52.178+0000 7feb597fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:07:52.178+0000 7feb597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:07:52.178+0000 7feb597fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:07:52.178+0000 7fec731cf640 10 monclient: get_auth_request con 0x7feb4c070a20 auth_method 0 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: get_monmap_and_config 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:52.792 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: monmap: 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding auth protocol: cephx 2024-09-12T18:07:52.793 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding auth protocol: cephx 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding auth protocol: cephx 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: crc 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6261a00) adding con mode: secure 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.794 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: init 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding auth protocol: cephx 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding auth protocol: cephx 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding auth protocol: cephx 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.795 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.796 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: crc 2024-09-12T18:07:52.796 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d51a0) adding con mode: secure 2024-09-12T18:07:52.796 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.796 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.796 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff731d52e8 EEXIST 2024-09-12T18:07:52.796 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:52.796 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:07:52.796 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-c con 0x564fe628ffc0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:52.796 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-b con 0x564fe62903a0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:52.796 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-a con 0x564fe6291860 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:52.796 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): authenticate will time out at 2634.405129s 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): get_auth_request con 0x564fe628ffc0 auth_method 0 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): get_auth_request con 0x564fe6291860 auth_method 0 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.797 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): get_auth_request con 0x564fe62903a0 auth_method 0 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient(hunting): handle_auth_done global_id 7721 payload 274 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient: _finish_hunting 0 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:07:52.182+0000 7fec739d0640 1 monclient: found mon.noname-c 2024-09-12T18:07:52.798 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:07:52.182+0000 7fec739d0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: dump: 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.799 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: _finish_auth 0 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:07:52.182+0000 7feb52ffd640 10 monclient: dump: 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.800 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 monclient: authenticate success, global_id 7721 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 4 set_mon_vals no callback set 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: shutdown 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: build_initial_monmap 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: monmap: 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:07:52.801 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:52.802 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:07:52.802 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:07:52.802 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:52.802 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.802 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:07:52.802 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:07:52.802 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:07:52.802 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.802 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding auth protocol: cephx 2024-09-12T18:07:52.802 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding auth protocol: cephx 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding auth protocol: cephx 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: crc 2024-09-12T18:07:52.803 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe62884e0) adding con mode: secure 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 librados: starting msgr at 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 librados: starting objecter 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x564fe6290b00 EEXIST 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 librados: setting wanted keys 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 1 librados: calling monclient init 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: init 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding auth protocol: cephx 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding auth protocol: cephx 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding auth protocol: cephx 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.804 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: crc 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 AuthRegistry(0x564fe6243f20) adding con mode: secure 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x564fe6244068 EEXIST 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:52.805 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-b con 0x564fe628ffc0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-c con 0x564fe6291860 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): picked mon.noname-a con 0x564fe62843c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:07:52.182+0000 7fec75eca9c0 10 monclient(hunting): authenticate will time out at 2634.407703s 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): get_auth_request con 0x564fe6291860 auth_method 0 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.806 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): get_auth_request con 0x564fe62843c0 auth_method 0 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:07:52.182+0000 7fec731cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:07:52.182+0000 7fec741d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:07:52.186+0000 7fec731cf640 10 monclient(hunting): handle_auth_done global_id 7724 payload 824 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:07:52.186+0000 7fec731cf640 10 monclient: _finish_hunting 0 2024-09-12T18:07:52.807 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:07:52.186+0000 7fec731cf640 1 monclient: found mon.noname-c 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:07:52.186+0000 7fec731cf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: dump: 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.808 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: _finish_auth 0 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: _check_auth_tickets 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:07:52.186+0000 7feb517fa640 10 monclient: dump: 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:07:52.809 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:52.810 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:07:52.810 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:07:52.810 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:07:52.810 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:07:52.810 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.810 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 5 monclient: authenticate success, global_id 7724 2024-09-12T18:07:52.810 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:07:52.186+0000 7feb52ffd640 4 set_mon_vals no callback set 2024-09-12T18:07:52.810 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.810 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.810 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 10 monclient: _renew_subs 2024-09-12T18:07:52.810 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 1 librados: init done 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command cr dump hook 0x564fe628eb18 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:07:52.186+0000 7feb517fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:07:52.186+0000 7feb517fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:07:52.186+0000 7feb517fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:07:52.186+0000 7fec739d0640 10 monclient: get_auth_request con 0x7feb3c070ae0 auth_method 0 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:07:52.186+0000 7fec741d1640 10 monclient: get_auth_request con 0x564fe62afda0 auth_method 0 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 realm 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.811 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:07:52.186+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:07:52.190+0000 7fec739d0640 10 monclient: get_auth_request con 0x564fe62b3fe0 auth_method 0 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:07:52.190+0000 7fec731cf640 10 monclient: get_auth_request con 0x564fe62b7840 auth_method 0 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:07:52.190+0000 7fec75eca9c0 20 searching for the correct realm 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:07:52.190+0000 7fec741d1640 10 monclient: get_auth_request con 0x564fe62bc5e0 auth_method 0 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:07:52.190+0000 7fec739d0640 10 monclient: get_auth_request con 0x564fe6078210 auth_method 0 2024-09-12T18:07:52.812 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:07:52.194+0000 7fec731cf640 10 monclient: get_auth_request con 0x7fec6808b020 auth_method 0 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:07:52.194+0000 7fec731cf640 0 -- 172.21.15.157:0/1635977054 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7fec6808b020 msgr2=0x7fec6806a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:07:52.398+0000 7fec731cf640 10 monclient: get_auth_request con 0x7fec6808b020 auth_method 0 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:07:52.402+0000 7fec741d1640 10 monclient: get_auth_request con 0x7fec68008040 auth_method 0 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:07:52.410+0000 7fec739d0640 10 monclient: get_auth_request con 0x7fec6804f560 auth_method 0 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:07:52.410+0000 7fec739d0640 0 -- 172.21.15.157:0/1635977054 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fec6804f560 msgr2=0x7fec6804f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:07:52.614+0000 7fec739d0640 10 monclient: get_auth_request con 0x7fec6804f560 auth_method 0 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:52.813 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:07:52.626+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 zone default found 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 4 Realm: () 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 zonegroup default 2024-09-12T18:07:52.814 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:07:52.630+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 started sync module instance, tier type = 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:07:52.634+0000 7fec75eca9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=0 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=1 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=2 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=3 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=4 2024-09-12T18:07:52.815 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=5 2024-09-12T18:07:52.816 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:07:52.654+0000 7fec75eca9c0 20 add_watcher() i=6 2024-09-12T18:07:52.816 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 20 add_watcher() i=7 2024-09-12T18:07:52.816 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:52.816 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding auth protocol: cephx 2024-09-12T18:07:52.816 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding auth protocol: cephx 2024-09-12T18:07:52.816 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding auth protocol: cephx 2024-09-12T18:07:52.816 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.816 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.816 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.816 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.816 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: crc 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:07:52.658+0000 7fec75eca9c0 5 AuthRegistry(0x7fff731d5670) adding con mode: secure 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:07:52.658+0000 7feb29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:52.817 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command cache list hook 0x564fe628b040 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command cache inspect hook 0x564fe628b040 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command cache erase hook 0x564fe628b040 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command cache zap hook 0x564fe628b040 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 note: GC not initialized 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:07:52.662+0000 7feb28fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command sync trace show hook 0x7fec68004550 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command sync trace history hook 0x7fec68004550 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command sync trace active hook 0x7fec68004550 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 5 asok(0x564fe5fbe2b0) register_command sync trace active_short hook 0x7fec68004550 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 Filter name: none 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:07:52.662+0000 7feaa27fc640 20 reqs_thread_entry: start 2024-09-12T18:07:52.818 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:07:52.662+0000 7fec75eca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:07:52.819 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:52.820 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:52.820 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:52.820 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:07:52.674+0000 7fec75eca9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:07:52.820 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 94901164060816 notifier 7724 bl.length()=827 2024-09-12T18:07:52.820 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:52.820 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:52.820 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:07:52.674+0000 7feb52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:52.820 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:07:52.820 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:07:52.820 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:07:52.820 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:07:52.678+0000 7fec75eca9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:07:52.682+0000 7fec75eca9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec75eca9c0 time 2024-09-12T18:07:52.685446+0000 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fec797a42eb] 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fec797a449f] 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe49e90c1] 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe49fb1fa] 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fec7860ad90] 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:07:52.821 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:07:52.686+0000 7fec75eca9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7fec75eca9c0 thread_name:radosgw-admin 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fec78623520] 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fec797a4345] 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fec797a449f] 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe49e90c1] 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe49fb1fa] 2024-09-12T18:07:52.822 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fec7860ad90] 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:07:52.823 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:07:52.824 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:07:52.825 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:07:52.826 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:07:52.827 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:07:52.828 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:07:52.829 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:07:52.830 INFO:tasks.workunit.client.0.smithi157.stderr: 7feaa27fc640 / http_manager 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb28fe1640 / http_manager 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb29fe3640 / rgw_dt_lg_renew 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb517fa640 / ms_dispatch 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb52ffd640 / io_context_pool 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb597fa640 / ms_dispatch 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb5bfff640 / ms_dispatch 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7feb61e0b640 / io_context_pool 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7fec731cf640 / msgr-worker-2 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7fec739d0640 / msgr-worker-1 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7fec741d1640 / msgr-worker-0 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7fec749d2640 / io_context_pool 2024-09-12T18:07:52.831 INFO:tasks.workunit.client.0.smithi157.stderr: 7fec75eca9c0 / radosgw-admin 2024-09-12T18:07:52.832 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:07:52.832 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:07:52.832 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:07:52.687782Z_05a76467-7367-47d3-8932-abb4b350e831/log 2024-09-12T18:07:52.832 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:07:52.832 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:07:52.832 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:07:52.837 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:52.837 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:52.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.770+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.770+0000 7f03ff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.770+0000 7f03ff1ad9c0 20 realm 2024-09-12T18:07:52.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.770+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.770+0000 7f03ff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.770+0000 7f03ff1ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:52.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.770+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.770+0000 7f03ff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.770+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.774+0000 7f03ff1ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:52.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.774+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.774+0000 7f03ff1ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:52.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.774+0000 7f03ff1ad9c0 20 searching for the correct realm 2024-09-12T18:07:52.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.782+0000 7f03fd4b4640 0 -- 172.21.15.157:0/2331882771 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x5613ea16e710 msgr2=0x5613ea170bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:52.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.786+0000 7f03fccb3640 0 -- 172.21.15.157:0/2331882771 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f03f004e900 msgr2=0x7f03f004b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:52.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:52.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:52.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:52.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:52.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.794+0000 7f03ff1ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 20 zone default found 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 4 Realm: () 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 20 zonegroup default 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 20 started sync module instance, tier type = 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.798+0000 7f03ff1ad9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.814+0000 7f03ff1ad9c0 20 add_watcher() i=0 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.814+0000 7f03ff1ad9c0 20 add_watcher() i=1 2024-09-12T18:07:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.814+0000 7f03ff1ad9c0 20 add_watcher() i=2 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.814+0000 7f03ff1ad9c0 20 add_watcher() i=3 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.814+0000 7f03ff1ad9c0 20 add_watcher() i=4 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.814+0000 7f03ff1ad9c0 20 add_watcher() i=5 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.814+0000 7f03ff1ad9c0 20 add_watcher() i=6 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.814+0000 7f03ff1ad9c0 20 add_watcher() i=7 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.814+0000 7f03ff1ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f02b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 5 note: GC not initialized 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f02b1fe3640 20 reqs_thread_entry: start 2024-09-12T18:07:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 Filter name: none 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f02237fe640 20 reqs_thread_entry: start 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.818+0000 7f03ff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.822+0000 7f03ff1ad9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.822+0000 7f03ff1ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:52.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.822+0000 7f02b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:52.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.826+0000 7f03ff1ad9c0 20 remove_watcher() i=0 2024-09-12T18:07:52.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.826+0000 7f03ff1ad9c0 2 removed watcher, disabling cache 2024-09-12T18:07:52.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.830+0000 7f03ff1ad9c0 20 remove_watcher() i=1 2024-09-12T18:07:52.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.830+0000 7f03ff1ad9c0 20 remove_watcher() i=2 2024-09-12T18:07:52.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.834+0000 7f03ff1ad9c0 20 remove_watcher() i=3 2024-09-12T18:07:52.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.834+0000 7f03ff1ad9c0 20 remove_watcher() i=4 2024-09-12T18:07:52.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.838+0000 7f03ff1ad9c0 20 remove_watcher() i=5 2024-09-12T18:07:52.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.838+0000 7f03ff1ad9c0 20 remove_watcher() i=6 2024-09-12T18:07:52.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.838+0000 7f03ff1ad9c0 20 remove_watcher() i=7 2024-09-12T18:07:52.896 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:07:52.928 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:52.928 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:52.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.970+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.970+0000 7fbba6db99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.971 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.970+0000 7fbba6db99c0 20 realm 2024-09-12T18:07:52.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.970+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.974+0000 7fbba6db99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.974+0000 7fbba6db99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:52.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.974+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.974+0000 7fbba6db99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:52.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.974+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.974+0000 7fbba6db99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:52.973 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.974+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:52.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.974+0000 7fbba6db99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:52.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.974+0000 7fbba6db99c0 20 searching for the correct realm 2024-09-12T18:07:52.980 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:52.982+0000 7fbba50c0640 0 -- 172.21.15.157:0/1217951946 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fbb980dcc00 msgr2=0x7fbb980f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:53.198 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.198+0000 7fbba48bf640 0 -- 172.21.15.157:0/1217951946 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x560680957d80 msgr2=0x56068095a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:53.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.206+0000 7fbba6db99c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:07:53.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.206+0000 7fbba6db99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:53.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.206+0000 7fbba6db99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:53.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.206+0000 7fbba6db99c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:07:53.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.206+0000 7fbba6db99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:53.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.206+0000 7fbba6db99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:53.206 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.206+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:53.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.206+0000 7fbba6db99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:53.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.206+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:53.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:53.207 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:53.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:53.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 zone default found 2024-09-12T18:07:53.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 4 Realm: () 2024-09-12T18:07:53.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:07:53.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:07:53.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:53.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 zonegroup default 2024-09-12T18:07:53.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:53.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:53.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:53.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:53.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:53.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:53.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 started sync module instance, tier type = 2024-09-12T18:07:53.210 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.210+0000 7fbba6db99c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:07:53.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.234+0000 7fbba6db99c0 20 add_watcher() i=0 2024-09-12T18:07:53.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.234+0000 7fbba6db99c0 20 add_watcher() i=1 2024-09-12T18:07:53.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.234+0000 7fbba6db99c0 20 add_watcher() i=2 2024-09-12T18:07:53.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.234+0000 7fbba6db99c0 20 add_watcher() i=3 2024-09-12T18:07:53.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.234+0000 7fbba6db99c0 20 add_watcher() i=4 2024-09-12T18:07:53.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.234+0000 7fbba6db99c0 20 add_watcher() i=5 2024-09-12T18:07:53.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.234+0000 7fbba6db99c0 20 add_watcher() i=6 2024-09-12T18:07:53.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.238+0000 7fbba6db99c0 20 add_watcher() i=7 2024-09-12T18:07:53.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.238+0000 7fbba6db99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:53.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.242+0000 7fba5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:53.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.242+0000 7fbba6db99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:53.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.242+0000 7fbba6db99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:53.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.242+0000 7fbba6db99c0 5 note: GC not initialized 2024-09-12T18:07:53.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.242+0000 7fba59fe3640 20 reqs_thread_entry: start 2024-09-12T18:07:53.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.242+0000 7fbba6db99c0 20 init_complete bucket index max shards: 1 2024-09-12T18:07:53.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 20 Filter name: none 2024-09-12T18:07:53.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fb9cb7fe640 20 reqs_thread_entry: start 2024-09-12T18:07:53.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:53.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:53.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:53.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:53.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:53.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:07:53.245 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:53.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:07:53.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:07:53.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:07:53.246 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:53.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:53.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:07:53.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:53.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:07:53.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:53.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:07:53.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:53.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.246+0000 7fbba6db99c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:07:53.249 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.250+0000 7fba5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:53.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.254+0000 7fbba6db99c0 20 remove_watcher() i=0 2024-09-12T18:07:53.254 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.254+0000 7fbba6db99c0 2 removed watcher, disabling cache 2024-09-12T18:07:53.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.258+0000 7fbba6db99c0 20 remove_watcher() i=1 2024-09-12T18:07:53.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.258+0000 7fbba6db99c0 20 remove_watcher() i=2 2024-09-12T18:07:53.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.262+0000 7fbba6db99c0 20 remove_watcher() i=3 2024-09-12T18:07:53.263 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.262+0000 7fbba6db99c0 20 remove_watcher() i=4 2024-09-12T18:07:53.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.266+0000 7fbba6db99c0 20 remove_watcher() i=5 2024-09-12T18:07:53.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.266+0000 7fbba6db99c0 20 remove_watcher() i=6 2024-09-12T18:07:53.268 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:07:53.270+0000 7fbba6db99c0 20 remove_watcher() i=7 2024-09-12T18:08:23.301 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T18:08:23.341 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:23.341 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:23.385 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 realm 2024-09-12T18:08:23.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.389+0000 7ff8716fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:23.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.388 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:23.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:23.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 searching for the correct realm 2024-09-12T18:08:23.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.397+0000 7ff86fa04640 0 -- 172.21.15.157:0/1920092515 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x562413b50f80 msgr2=0x562413b53440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:23.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.401+0000 7ff86f203640 0 -- 172.21.15.157:0/1920092515 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7ff864015600 msgr2=0x7ff864069b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:23.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:08:23.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:23.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:23.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:08:23.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:23.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:23.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:23.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:23.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 zone default found 2024-09-12T18:08:23.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 4 Realm: () 2024-09-12T18:08:23.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:08:23.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:08:23.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:23.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 zonegroup default 2024-09-12T18:08:23.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.413+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.413+0000 7ff8716fd9c0 20 started sync module instance, tier type = 2024-09-12T18:08:23.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.413+0000 7ff8716fd9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:08:23.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=0 2024-09-12T18:08:23.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=1 2024-09-12T18:08:23.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=2 2024-09-12T18:08:23.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=3 2024-09-12T18:08:23.427 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=4 2024-09-12T18:08:23.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=5 2024-09-12T18:08:23.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=6 2024-09-12T18:08:23.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.429+0000 7ff8716fd9c0 20 add_watcher() i=7 2024-09-12T18:08:23.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.429+0000 7ff8716fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:23.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.429+0000 7ff725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:23.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:23.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:23.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 note: GC not initialized 2024-09-12T18:08:23.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff724fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:23.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:08:23.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 Filter name: none 2024-09-12T18:08:23.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff69e7fc640 20 reqs_thread_entry: start 2024-09-12T18:08:23.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:23.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:23.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:23.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:23.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:08:23.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:23.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:23.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:23.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:23.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:23.434 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:08:23.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.437+0000 7ff8716fd9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:08:23.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:23.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:23.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:23.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:08:23.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464333 cookie 94712949460560 notifier 8361 bl.length()=827 2024-09-12T18:08:23.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:23.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:23.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:23.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:08:23.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:08:23.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:08:23.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:08:23.454 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff8716fd9c0 time 2024-09-12T18:08:23.458262+0000 2024-09-12T18:08:23.454 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:23.456 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:23.456 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff874fd72eb] 2024-09-12T18:08:23.456 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff874fd749f] 2024-09-12T18:08:23.456 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624113900c1] 2024-09-12T18:08:23.456 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x14100ec) [0x562411de60ec] 2024-09-12T18:08:23.456 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5624113a218d] 2024-09-12T18:08:23.456 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:08:23.456 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff873e3dd90] 2024-09-12T18:08:23.456 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:08:23.456 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:08:23.456 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:08:23.457 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff8716fd9c0 thread_name:radosgw-admin 2024-09-12T18:08:23.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.457+0000 7ff8716fd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff8716fd9c0 time 2024-09-12T18:08:23.458262+0000 2024-09-12T18:08:23.457 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:23.457 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.457 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:23.457 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff874fd72eb] 2024-09-12T18:08:23.457 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff874fd749f] 2024-09-12T18:08:23.457 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624113900c1] 2024-09-12T18:08:23.457 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x14100ec) [0x562411de60ec] 2024-09-12T18:08:23.458 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5624113a218d] 2024-09-12T18:08:23.458 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:08:23.458 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff873e3dd90] 2024-09-12T18:08:23.458 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:08:23.458 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:08:23.458 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.481 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:23.481 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff873e56520] 2024-09-12T18:08:23.481 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:08:23.481 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:08:23.481 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:08:23.481 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff874fd7345] 2024-09-12T18:08:23.481 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff874fd749f] 2024-09-12T18:08:23.481 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624113900c1] 2024-09-12T18:08:23.481 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x14100ec) [0x562411de60ec] 2024-09-12T18:08:23.481 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5624113a218d] 2024-09-12T18:08:23.481 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff873e3dd90] 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.457+0000 7ff8716fd9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff8716fd9c0 thread_name:radosgw-admin 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff873e56520] 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff874fd7345] 2024-09-12T18:08:23.482 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff874fd749f] 2024-09-12T18:08:23.483 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624113900c1] 2024-09-12T18:08:23.483 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x14100ec) [0x562411de60ec] 2024-09-12T18:08:23.483 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5624113a218d] 2024-09-12T18:08:23.483 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:08:23.483 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff873e3dd90] 2024-09-12T18:08:23.483 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:08:23.483 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:08:23.483 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:23.483 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.484 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:08:23.484 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: dump: 2024-09-12T18:08:23.484 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.484 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.484 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.484 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.484 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.484 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.484 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.484 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.484 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.485 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.485 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: _finish_auth 0 2024-09-12T18:08:23.485 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: _check_auth_tickets 2024-09-12T18:08:23.485 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:23.485 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.485 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:23.485 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: dump: 2024-09-12T18:08:23.485 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.485 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.485 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.485 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 monclient: authenticate success, global_id 8349 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 4 set_mon_vals no callback set 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: shutdown 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) unregister_commands rotate-key 2024-09-12T18:08:23.486 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: monmap: 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.487 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding auth protocol: cephx 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding auth protocol: cephx 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding auth protocol: cephx 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.488 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 1 librados: starting msgr at 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 1 librados: starting objecter 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command objecter_requests hook 0x562413a8a9b0 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 1 librados: setting wanted keys 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 1 librados: calling monclient init 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: init 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding auth protocol: cephx 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding auth protocol: cephx 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding auth protocol: cephx 2024-09-12T18:08:23.489 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.490 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.490 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.490 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.490 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.490 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.490 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.490 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.490 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.490 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.490 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.490 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.491 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.491 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.491 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command rotate-key hook 0x562413a5c258 2024-09-12T18:08:23.491 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:23.491 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:08:23.491 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-b con 0x56241390c760 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:23.491 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-c con 0x56241390cb40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:23.491 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-a con 0x5624139a4a70 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:23.491 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.492 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.492 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.492 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:23.492 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): authenticate will time out at 2665.591598s 2024-09-12T18:08:23.492 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): get_auth_request con 0x56241390cb40 auth_method 0 2024-09-12T18:08:23.492 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.492 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.492 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.492 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): get_auth_request con 0x5624139a4a70 auth_method 0 2024-09-12T18:08:23.492 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): handle_auth_done global_id 7763 payload 824 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:08:23.369+0000 7ff86ea02640 10 monclient: _finish_hunting 0 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:08:23.369+0000 7ff86ea02640 1 monclient: found mon.noname-c 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:08:23.369+0000 7ff86ea02640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.493 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: dump: 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: _finish_auth 0 2024-09-12T18:08:23.494 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: _check_auth_tickets 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: dump: 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.495 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:08:23.369+0000 7ff75d60a640 4 set_mon_vals no callback set 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 5 monclient: authenticate success, global_id 7763 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 1 librados: init done 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:08:23.369+0000 7ff75be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:08:23.369+0000 7ff75be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:08:23.369+0000 7ff75be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:08:23.369+0000 7ff86f203640 10 monclient: get_auth_request con 0x7ff754070b10 auth_method 0 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:08:23.369+0000 7ff86fa04640 10 monclient: get_auth_request con 0x562413a882a0 auth_method 0 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:08:23.373+0000 7ff86f203640 10 monclient: get_auth_request con 0x562413aa6b50 auth_method 0 2024-09-12T18:08:23.496 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:08:23.373+0000 7ff86ea02640 10 monclient: get_auth_request con 0x562413aaaeb0 auth_method 0 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 10 monclient: monmap: 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:23.497 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding auth protocol: cephx 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding auth protocol: cephx 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding auth protocol: cephx 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.498 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562413ab36a0 EEXIST 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: init 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding auth protocol: cephx 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding auth protocol: cephx 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding auth protocol: cephx 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.499 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.500 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.500 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.500 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.500 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.500 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.500 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.500 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.500 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.500 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.500 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.501 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command rotate-key cmddesc rotate-key hook 0x562413aae4e0 EEXIST 2024-09-12T18:08:23.501 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:23.501 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:08:23.501 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-b con 0x562413ad7850 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:23.501 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-a con 0x562413ad7180 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:23.501 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-c con 0x562413ad5b60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:23.501 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.501 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): authenticate will time out at 2665.601102s 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): get_auth_request con 0x562413ad7180 auth_method 0 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): get_auth_request con 0x562413ad5b60 auth_method 0 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.502 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:08:23.377+0000 7ff86f203640 10 monclient(hunting): get_auth_request con 0x562413ad7850 auth_method 0 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:08:23.377+0000 7ff86f203640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:08:23.377+0000 7ff86f203640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:08:23.377+0000 7ff86f203640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): handle_auth_done global_id 8355 payload 824 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient: _finish_hunting 0 2024-09-12T18:08:23.503 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:08:23.377+0000 7ff86ea02640 1 monclient: found mon.noname-a 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: dump: 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.504 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: _finish_auth 0 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: _check_auth_tickets 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: dump: 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.505 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 monclient: authenticate success, global_id 8355 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:08:23.377+0000 7ff870205640 4 set_mon_vals no callback set 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:08:23.377+0000 7ff759602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:08:23.377+0000 7ff759602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:08:23.377+0000 7ff759602640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.506 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient: get_auth_request con 0x7ff748070a20 auth_method 0 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: get_monmap_and_config 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: monmap: 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:23.507 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding auth protocol: cephx 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding auth protocol: cephx 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding auth protocol: cephx 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.508 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: init 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding auth protocol: cephx 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding auth protocol: cephx 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding auth protocol: cephx 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.509 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffff57aa598 EEXIST 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-a con 0x562413afb140 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-c con 0x562413b269a0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-b con 0x562413b1c120 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:23.510 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.511 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.511 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.511 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:23.511 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): authenticate will time out at 2665.605371s 2024-09-12T18:08:23.511 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): get_auth_request con 0x562413afb140 auth_method 0 2024-09-12T18:08:23.511 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.511 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.511 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.511 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): get_auth_request con 0x562413b269a0 auth_method 0 2024-09-12T18:08:23.511 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.511 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.512 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.512 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.512 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.512 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.512 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.512 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.512 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:08:23.381+0000 7ff86fa04640 10 monclient(hunting): get_auth_request con 0x562413b1c120 auth_method 0 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:08:23.381+0000 7ff86fa04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:08:23.381+0000 7ff86fa04640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:08:23.381+0000 7ff86fa04640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): handle_auth_done global_id 7769 payload 274 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient: _finish_hunting 0 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:08:23.381+0000 7ff86ea02640 1 monclient: found mon.noname-c 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: dump: 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.513 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: _finish_auth 0 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 monclient: authenticate success, global_id 7769 2024-09-12T18:08:23.514 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 4 set_mon_vals no callback set 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: dump: 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.515 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: shutdown 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: monmap: 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.516 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding auth protocol: cephx 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding auth protocol: cephx 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding auth protocol: cephx 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.517 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 librados: starting msgr at 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 librados: starting objecter 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562413b25ed0 EEXIST 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 librados: setting wanted keys 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 librados: calling monclient init 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: init 2024-09-12T18:08:23.518 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding auth protocol: cephx 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding auth protocol: cephx 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding auth protocol: cephx 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.519 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command rotate-key cmddesc rotate-key hook 0x562413ad97b8 EEXIST 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-c con 0x562413afb140 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-a con 0x562413b1c120 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-b con 0x562413b269a0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.520 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): authenticate will time out at 2665.607958s 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): get_auth_request con 0x562413afb140 auth_method 0 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): get_auth_request con 0x562413b1c120 auth_method 0 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.521 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:08:23.385+0000 7ff86fa04640 10 monclient(hunting): get_auth_request con 0x562413b269a0 auth_method 0 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:08:23.385+0000 7ff86fa04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:08:23.385+0000 7ff86fa04640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:08:23.385+0000 7ff86fa04640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): handle_auth_done global_id 8361 payload 824 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient: _finish_hunting 0 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:08:23.385+0000 7ff86ea02640 1 monclient: found mon.noname-a 2024-09-12T18:08:23.522 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.523 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.523 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:23.523 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: dump: 2024-09-12T18:08:23.523 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.523 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.523 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.523 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.523 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: _finish_auth 0 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: _check_auth_tickets 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: dump: 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.524 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:08:23.385+0000 7ff752ffd640 4 set_mon_vals no callback set 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 5 monclient: authenticate success, global_id 8361 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.525 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 1 librados: init done 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command cr dump hook 0x562413b2b5b8 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:08:23.385+0000 7ff7517fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:08:23.385+0000 7ff7517fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:08:23.385+0000 7ff7517fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient: get_auth_request con 0x7ff738070ae0 auth_method 0 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:08:23.385+0000 7ff86fa04640 10 monclient: get_auth_request con 0x562413b447d0 auth_method 0 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 realm 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.526 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:08:23.389+0000 7ff86f203640 10 monclient: get_auth_request con 0x562413b48a70 auth_method 0 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:08:23.389+0000 7ff86ea02640 10 monclient: get_auth_request con 0x562413b4c200 auth_method 0 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 searching for the correct realm 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:08:23.389+0000 7ff86fa04640 10 monclient: get_auth_request con 0x562413b50f80 auth_method 0 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:08:23.393+0000 7ff86f203640 10 monclient: get_auth_request con 0x7ff860018040 auth_method 0 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:08:23.393+0000 7ff86ea02640 10 monclient: get_auth_request con 0x7ff864065bd0 auth_method 0 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:08:23.397+0000 7ff86fa04640 0 -- 172.21.15.157:0/1920092515 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x562413b50f80 msgr2=0x562413b53440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:23.527 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:08:23.397+0000 7ff7517fa640 1 client.8361.objecter ms_handle_reset 0x562413b50f80 session 0x562413b50900 osd.3 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:08:23.397+0000 7ff7517fa640 10 monclient: _renew_subs 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:08:23.397+0000 7ff7517fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:08:23.397+0000 7ff86fa04640 10 monclient: get_auth_request con 0x7ff738080900 auth_method 0 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:08:23.397+0000 7ff86fa04640 10 monclient: get_auth_request con 0x7ff864055910 auth_method 0 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:08:23.401+0000 7ff86f203640 10 monclient: get_auth_request con 0x7ff864015600 auth_method 0 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:08:23.401+0000 7ff86f203640 0 -- 172.21.15.157:0/1920092515 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7ff864015600 msgr2=0x7ff864069b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:08:23.401+0000 7ff7517fa640 1 client.8361.objecter ms_handle_reset 0x7ff864015600 session 0x7ff8640019b0 osd.0 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:08:23.401+0000 7ff86f203640 10 monclient: get_auth_request con 0x562413b50f80 auth_method 0 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:23.528 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 zone default found 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 4 Realm: () 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:08:23.529 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 zonegroup default 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:08:23.413+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:08:23.413+0000 7ff8716fd9c0 20 started sync module instance, tier type = 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:08:23.413+0000 7ff8716fd9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=0 2024-09-12T18:08:23.530 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=1 2024-09-12T18:08:23.531 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=2 2024-09-12T18:08:23.531 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=3 2024-09-12T18:08:23.531 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=4 2024-09-12T18:08:23.531 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=5 2024-09-12T18:08:23.531 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=6 2024-09-12T18:08:23.531 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 20 add_watcher() i=7 2024-09-12T18:08:23.531 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:23.531 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding auth protocol: cephx 2024-09-12T18:08:23.531 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding auth protocol: cephx 2024-09-12T18:08:23.531 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding auth protocol: cephx 2024-09-12T18:08:23.532 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.532 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.532 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.532 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.532 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.532 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.532 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:08:23.429+0000 7ff725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:23.532 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.532 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.532 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.532 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.533 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.533 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.533 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.533 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:23.533 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:23.533 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command cache list hook 0x562413af81f0 2024-09-12T18:08:23.533 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command cache inspect hook 0x562413af81f0 2024-09-12T18:08:23.533 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command cache erase hook 0x562413af81f0 2024-09-12T18:08:23.533 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command cache zap hook 0x562413af81f0 2024-09-12T18:08:23.534 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 note: GC not initialized 2024-09-12T18:08:23.534 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:08:23.433+0000 7ff724fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:23.534 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command sync trace show hook 0x7ff864080070 2024-09-12T18:08:23.534 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command sync trace history hook 0x7ff864080070 2024-09-12T18:08:23.534 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command sync trace active hook 0x7ff864080070 2024-09-12T18:08:23.534 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command sync trace active_short hook 0x7ff864080070 2024-09-12T18:08:23.534 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:08:23.534 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 Filter name: none 2024-09-12T18:08:23.534 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:08:23.433+0000 7ff69e7fc640 20 reqs_thread_entry: start 2024-09-12T18:08:23.534 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:23.535 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.535 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:23.535 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:23.535 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:23.535 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:08:23.535 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.535 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:23.535 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:23.535 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:23.535 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:23.535 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:08:23.437+0000 7ff8716fd9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464333 cookie 94712949460560 notifier 8361 bl.length()=827 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:08:23.536 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:08:23.457+0000 7ff8716fd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff8716fd9c0 time 2024-09-12T18:08:23.458262+0000 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff874fd72eb] 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff874fd749f] 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624113900c1] 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x14100ec) [0x562411de60ec] 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5624113a218d] 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff873e3dd90] 2024-09-12T18:08:23.537 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:08:23.457+0000 7ff8716fd9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff8716fd9c0 thread_name:radosgw-admin 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff873e56520] 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff874fd7345] 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff874fd749f] 2024-09-12T18:08:23.538 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624113900c1] 2024-09-12T18:08:23.539 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x14100ec) [0x562411de60ec] 2024-09-12T18:08:23.539 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5624113a218d] 2024-09-12T18:08:23.539 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:08:23.539 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff873e3dd90] 2024-09-12T18:08:23.539 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:08:23.539 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:08:23.539 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:23.539 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.539 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:08:23.539 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:08:23.540 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:08:23.541 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:08:23.542 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:08:23.543 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:08:23.544 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:08:23.544 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:08:23.544 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:08:23.544 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:08:23.544 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:08:23.544 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:08:23.544 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:08:23.544 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:08:23.544 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:08:23.545 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:08:23.545 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:08:23.545 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:08:23.545 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:08:23.545 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:08:23.545 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:08:23.545 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:08:23.545 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:08:23.545 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:08:23.545 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:08:23.545 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:08:23.546 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff69e7fc640 / http_manager 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff724fe1640 / http_manager 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff725fe3640 / rgw_dt_lg_renew 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff7517fa640 / ms_dispatch 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff752ffd640 / io_context_pool 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff759602640 / ms_dispatch 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff75be07640 / ms_dispatch 2024-09-12T18:08:23.547 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff75d60a640 / io_context_pool 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff86ea02640 / msgr-worker-2 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff86f203640 / msgr-worker-1 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff86fa04640 / msgr-worker-0 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff870205640 / io_context_pool 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff8716fd9c0 / radosgw-admin 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.142981.log 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: dump: 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.548 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: _finish_auth 0 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: _check_auth_tickets 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:23.549 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:08:23.365+0000 7ff75d60a640 10 monclient: dump: 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 monclient: authenticate success, global_id 8349 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 4 set_mon_vals no callback set 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: shutdown 2024-09-12T18:08:23.550 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) unregister_commands rotate-key 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: monmap: 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:23.551 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.552 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding auth protocol: cephx 2024-09-12T18:08:23.552 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding auth protocol: cephx 2024-09-12T18:08:23.552 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding auth protocol: cephx 2024-09-12T18:08:23.552 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.552 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.552 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.552 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.552 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.552 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.552 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.552 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.553 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.553 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.553 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: crc 2024-09-12T18:08:23.553 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a61490) adding con mode: secure 2024-09-12T18:08:23.553 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.553 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 1 librados: starting msgr at 2024-09-12T18:08:23.553 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 1 librados: starting objecter 2024-09-12T18:08:23.553 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command objecter_requests hook 0x562413a8a9b0 2024-09-12T18:08:23.554 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 1 librados: setting wanted keys 2024-09-12T18:08:23.554 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 1 librados: calling monclient init 2024-09-12T18:08:23.554 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: init 2024-09-12T18:08:23.554 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding auth protocol: cephx 2024-09-12T18:08:23.554 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding auth protocol: cephx 2024-09-12T18:08:23.554 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding auth protocol: cephx 2024-09-12T18:08:23.554 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.554 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.554 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.554 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.554 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.555 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.555 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.555 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.555 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.555 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.555 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: crc 2024-09-12T18:08:23.555 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 AuthRegistry(0x562413a5c110) adding con mode: secure 2024-09-12T18:08:23.555 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command rotate-key hook 0x562413a5c258 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-b con 0x56241390c760 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-c con 0x56241390cb40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-a con 0x5624139a4a70 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:08:23.365+0000 7ff8716fd9c0 10 monclient(hunting): authenticate will time out at 2665.591598s 2024-09-12T18:08:23.556 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): get_auth_request con 0x56241390cb40 auth_method 0 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): get_auth_request con 0x5624139a4a70 auth_method 0 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.557 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:08:23.365+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.558 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:08:23.365+0000 7ff86ea02640 10 monclient(hunting): handle_auth_done global_id 7763 payload 824 2024-09-12T18:08:23.558 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:08:23.369+0000 7ff86ea02640 10 monclient: _finish_hunting 0 2024-09-12T18:08:23.558 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:08:23.369+0000 7ff86ea02640 1 monclient: found mon.noname-c 2024-09-12T18:08:23.558 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:08:23.369+0000 7ff86ea02640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:08:23.558 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.558 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:23.558 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: dump: 2024-09-12T18:08:23.558 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.558 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.558 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.558 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: _finish_auth 0 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: _check_auth_tickets 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:23.559 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:08:23.369+0000 7ff75be07640 10 monclient: dump: 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:08:23.369+0000 7ff75d60a640 4 set_mon_vals no callback set 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 5 monclient: authenticate success, global_id 7763 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.560 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:08:23.369+0000 7ff8716fd9c0 1 librados: init done 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:08:23.369+0000 7ff75be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:08:23.369+0000 7ff75be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:08:23.369+0000 7ff75be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:08:23.369+0000 7ff86f203640 10 monclient: get_auth_request con 0x7ff754070b10 auth_method 0 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:08:23.369+0000 7ff86fa04640 10 monclient: get_auth_request con 0x562413a882a0 auth_method 0 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:08:23.373+0000 7ff86f203640 10 monclient: get_auth_request con 0x562413aa6b50 auth_method 0 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:08:23.373+0000 7ff86ea02640 10 monclient: get_auth_request con 0x562413aaaeb0 auth_method 0 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:23.561 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 10 monclient: monmap: 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding auth protocol: cephx 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding auth protocol: cephx 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding auth protocol: cephx 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.562 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: crc 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:08:23.373+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aafd80) adding con mode: secure 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562413ab36a0 EEXIST 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: init 2024-09-12T18:08:23.563 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding auth protocol: cephx 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding auth protocol: cephx 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding auth protocol: cephx 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.564 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: crc 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 AuthRegistry(0x562413aae398) adding con mode: secure 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command rotate-key cmddesc rotate-key hook 0x562413aae4e0 EEXIST 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-b con 0x562413ad7850 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-a con 0x562413ad7180 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-c con 0x562413ad5b60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.565 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:23.566 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient(hunting): authenticate will time out at 2665.601102s 2024-09-12T18:08:23.566 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): get_auth_request con 0x562413ad7180 auth_method 0 2024-09-12T18:08:23.566 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.566 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.566 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.566 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): get_auth_request con 0x562413ad5b60 auth_method 0 2024-09-12T18:08:23.566 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.566 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.566 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:08:23.377+0000 7ff86fa04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:08:23.377+0000 7ff86f203640 10 monclient(hunting): get_auth_request con 0x562413ad7850 auth_method 0 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:08:23.377+0000 7ff86f203640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:08:23.377+0000 7ff86f203640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:08:23.377+0000 7ff86f203640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient(hunting): handle_auth_done global_id 8355 payload 824 2024-09-12T18:08:23.567 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient: _finish_hunting 0 2024-09-12T18:08:23.568 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:08:23.377+0000 7ff86ea02640 1 monclient: found mon.noname-a 2024-09-12T18:08:23.568 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:08:23.377+0000 7ff86ea02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.568 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.568 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:23.568 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: dump: 2024-09-12T18:08:23.568 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.568 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.568 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.568 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: _finish_auth 0 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: _check_auth_tickets 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:08:23.377+0000 7ff759602640 10 monclient: dump: 2024-09-12T18:08:23.569 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.570 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.570 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.570 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.570 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.570 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.570 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 5 monclient: authenticate success, global_id 8355 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:08:23.377+0000 7ff870205640 4 set_mon_vals no callback set 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:08:23.377+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:08:23.377+0000 7ff759602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:08:23.377+0000 7ff759602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.571 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:08:23.377+0000 7ff759602640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient: get_auth_request con 0x7ff748070a20 auth_method 0 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: get_monmap_and_config 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: monmap: 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:23.572 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding auth protocol: cephx 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding auth protocol: cephx 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding auth protocol: cephx 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.573 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: crc 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413af70e0) adding con mode: secure 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: init 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding auth protocol: cephx 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding auth protocol: cephx 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding auth protocol: cephx 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.574 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: crc 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa450) adding con mode: secure 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffff57aa598 EEXIST 2024-09-12T18:08:23.575 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:23.576 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:08:23.576 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-a con 0x562413afb140 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:23.576 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-c con 0x562413b269a0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:23.576 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-b con 0x562413b1c120 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:23.576 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.576 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.576 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.576 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:23.577 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): authenticate will time out at 2665.605371s 2024-09-12T18:08:23.577 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): get_auth_request con 0x562413afb140 auth_method 0 2024-09-12T18:08:23.577 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.577 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.577 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.577 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): get_auth_request con 0x562413b269a0 auth_method 0 2024-09-12T18:08:23.577 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.577 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.577 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.577 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:08:23.381+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:08:23.381+0000 7ff86fa04640 10 monclient(hunting): get_auth_request con 0x562413b1c120 auth_method 0 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:08:23.381+0000 7ff86fa04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:08:23.381+0000 7ff86fa04640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:08:23.381+0000 7ff86fa04640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient(hunting): handle_auth_done global_id 7769 payload 274 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient: _finish_hunting 0 2024-09-12T18:08:23.578 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:08:23.381+0000 7ff86ea02640 1 monclient: found mon.noname-c 2024-09-12T18:08:23.579 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:08:23.381+0000 7ff86ea02640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:08:23.579 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.579 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:23.579 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: dump: 2024-09-12T18:08:23.579 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.579 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.579 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.579 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.579 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.579 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.580 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.580 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.580 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.580 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.580 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: _finish_auth 0 2024-09-12T18:08:23.580 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:08:23.580 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:23.580 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 monclient: authenticate success, global_id 7769 2024-09-12T18:08:23.580 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:23.580 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 4 set_mon_vals no callback set 2024-09-12T18:08:23.581 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.581 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:23.581 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:08:23.381+0000 7ff752ffd640 10 monclient: dump: 2024-09-12T18:08:23.581 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.581 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.581 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.581 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.581 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.581 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.581 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.581 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: shutdown 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: monmap: 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:23.582 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding auth protocol: cephx 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding auth protocol: cephx 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding auth protocol: cephx 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.583 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: crc 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413b256c0) adding con mode: secure 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 librados: starting msgr at 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 librados: starting objecter 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562413b25ed0 EEXIST 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 librados: setting wanted keys 2024-09-12T18:08:23.584 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 1 librados: calling monclient init 2024-09-12T18:08:23.585 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: init 2024-09-12T18:08:23.585 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding auth protocol: cephx 2024-09-12T18:08:23.585 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding auth protocol: cephx 2024-09-12T18:08:23.585 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding auth protocol: cephx 2024-09-12T18:08:23.585 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.585 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.585 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.585 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: crc 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 AuthRegistry(0x562413ad9670) adding con mode: secure 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command rotate-key cmddesc rotate-key hook 0x562413ad97b8 EEXIST 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:23.586 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:08:23.587 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-c con 0x562413afb140 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:23.587 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-a con 0x562413b1c120 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:23.587 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): picked mon.noname-b con 0x562413b269a0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:23.587 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.587 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.587 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:23.587 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:23.588 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:08:23.381+0000 7ff8716fd9c0 10 monclient(hunting): authenticate will time out at 2665.607958s 2024-09-12T18:08:23.588 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): get_auth_request con 0x562413afb140 auth_method 0 2024-09-12T18:08:23.588 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.588 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.588 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.588 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): get_auth_request con 0x562413b1c120 auth_method 0 2024-09-12T18:08:23.588 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.588 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.588 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:08:23.385+0000 7ff86fa04640 10 monclient(hunting): get_auth_request con 0x562413b269a0 auth_method 0 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:08:23.385+0000 7ff86fa04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:08:23.385+0000 7ff86fa04640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:08:23.385+0000 7ff86fa04640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient(hunting): handle_auth_done global_id 8361 payload 824 2024-09-12T18:08:23.589 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient: _finish_hunting 0 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:08:23.385+0000 7ff86ea02640 1 monclient: found mon.noname-a 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:08:23.385+0000 7ff86ea02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: dump: 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.590 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: _finish_auth 0 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: _check_auth_tickets 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:08:23.385+0000 7ff7517fa640 10 monclient: dump: 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:23.591 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:08:23.385+0000 7ff752ffd640 4 set_mon_vals no callback set 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 5 monclient: authenticate success, global_id 8361 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 10 monclient: _renew_subs 2024-09-12T18:08:23.592 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 1 librados: init done 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command cr dump hook 0x562413b2b5b8 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:08:23.385+0000 7ff7517fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:08:23.385+0000 7ff7517fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:08:23.385+0000 7ff7517fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:08:23.385+0000 7ff86f203640 10 monclient: get_auth_request con 0x7ff738070ae0 auth_method 0 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:08:23.385+0000 7ff86fa04640 10 monclient: get_auth_request con 0x562413b447d0 auth_method 0 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 realm 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:08:23.385+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.593 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:08:23.389+0000 7ff86f203640 10 monclient: get_auth_request con 0x562413b48a70 auth_method 0 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:08:23.389+0000 7ff86ea02640 10 monclient: get_auth_request con 0x562413b4c200 auth_method 0 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:08:23.389+0000 7ff8716fd9c0 20 searching for the correct realm 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:08:23.389+0000 7ff86fa04640 10 monclient: get_auth_request con 0x562413b50f80 auth_method 0 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:08:23.393+0000 7ff86f203640 10 monclient: get_auth_request con 0x7ff860018040 auth_method 0 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:08:23.393+0000 7ff86ea02640 10 monclient: get_auth_request con 0x7ff864065bd0 auth_method 0 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:08:23.397+0000 7ff86fa04640 0 -- 172.21.15.157:0/1920092515 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x562413b50f80 msgr2=0x562413b53440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:23.594 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:08:23.397+0000 7ff7517fa640 1 client.8361.objecter ms_handle_reset 0x562413b50f80 session 0x562413b50900 osd.3 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:08:23.397+0000 7ff7517fa640 10 monclient: _renew_subs 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:08:23.397+0000 7ff7517fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:08:23.397+0000 7ff86fa04640 10 monclient: get_auth_request con 0x7ff738080900 auth_method 0 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:08:23.397+0000 7ff86fa04640 10 monclient: get_auth_request con 0x7ff864055910 auth_method 0 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:08:23.401+0000 7ff86f203640 10 monclient: get_auth_request con 0x7ff864015600 auth_method 0 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:08:23.401+0000 7ff86f203640 0 -- 172.21.15.157:0/1920092515 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7ff864015600 msgr2=0x7ff864069b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:08:23.401+0000 7ff7517fa640 1 client.8361.objecter ms_handle_reset 0x7ff864015600 session 0x7ff8640019b0 osd.0 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:08:23.401+0000 7ff86f203640 10 monclient: get_auth_request con 0x562413b50f80 auth_method 0 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:08:23.595 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 zone default found 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 4 Realm: () 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 zonegroup default 2024-09-12T18:08:23.596 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:08:23.409+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:08:23.413+0000 7ff8716fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:08:23.413+0000 7ff8716fd9c0 20 started sync module instance, tier type = 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:08:23.413+0000 7ff8716fd9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=0 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=1 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=2 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=3 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=4 2024-09-12T18:08:23.597 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=5 2024-09-12T18:08:23.598 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:08:23.425+0000 7ff8716fd9c0 20 add_watcher() i=6 2024-09-12T18:08:23.598 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 20 add_watcher() i=7 2024-09-12T18:08:23.598 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:23.598 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding auth protocol: cephx 2024-09-12T18:08:23.598 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding auth protocol: cephx 2024-09-12T18:08:23.598 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding auth protocol: cephx 2024-09-12T18:08:23.598 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.599 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.599 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.599 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.599 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.599 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.599 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:08:23.429+0000 7ff725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:23.599 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: crc 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:08:23.429+0000 7ff8716fd9c0 5 AuthRegistry(0x7ffff57aa920) adding con mode: secure 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command cache list hook 0x562413af81f0 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command cache inspect hook 0x562413af81f0 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command cache erase hook 0x562413af81f0 2024-09-12T18:08:23.600 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command cache zap hook 0x562413af81f0 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 note: GC not initialized 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:08:23.433+0000 7ff724fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command sync trace show hook 0x7ff864080070 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command sync trace history hook 0x7ff864080070 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command sync trace active hook 0x7ff864080070 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 5 asok(0x56241384f2b0) register_command sync trace active_short hook 0x7ff864080070 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 Filter name: none 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:08:23.433+0000 7ff69e7fc640 20 reqs_thread_entry: start 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.601 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:08:23.433+0000 7ff8716fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:08:23.437+0000 7ff8716fd9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:23.602 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:23.603 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:08:23.445+0000 7ff8716fd9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:08:23.603 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464333 cookie 94712949460560 notifier 8361 bl.length()=827 2024-09-12T18:08:23.603 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:23.603 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:23.603 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:08:23.445+0000 7ff752ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:23.603 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:08:23.603 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:08:23.603 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:08:23.603 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:08:23.449+0000 7ff8716fd9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:08:23.603 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:08:23.457+0000 7ff8716fd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff8716fd9c0 time 2024-09-12T18:08:23.458262+0000 2024-09-12T18:08:23.603 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff874fd72eb] 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff874fd749f] 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624113900c1] 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 4: radosgw-admin(+0x14100ec) [0x562411de60ec] 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5624113a218d] 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 6: main() 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff873e3dd90] 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 8: __libc_start_main() 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 9: _start() 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.604 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:08:23.457+0000 7ff8716fd9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:23.605 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff8716fd9c0 thread_name:radosgw-admin 2024-09-12T18:08:23.605 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.605 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:23.605 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff873e56520] 2024-09-12T18:08:23.605 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:08:23.605 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:08:23.605 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:08:23.605 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff874fd7345] 2024-09-12T18:08:23.605 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff874fd749f] 2024-09-12T18:08:23.605 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624113900c1] 2024-09-12T18:08:23.605 INFO:tasks.workunit.client.0.smithi157.stderr: 8: radosgw-admin(+0x14100ec) [0x562411de60ec] 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5624113a218d] 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 10: main() 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff873e3dd90] 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 12: __libc_start_main() 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 13: _start() 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:08:23.606 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:08:23.607 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:08:23.608 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:08:23.609 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:08:23.610 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:08:23.610 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:08:23.610 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:08:23.610 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:08:23.610 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:08:23.610 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:08:23.610 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:08:23.610 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:08:23.611 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:08:23.612 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff69e7fc640 / http_manager 2024-09-12T18:08:23.613 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff724fe1640 / http_manager 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff725fe3640 / rgw_dt_lg_renew 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff7517fa640 / ms_dispatch 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff752ffd640 / io_context_pool 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff759602640 / ms_dispatch 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff75be07640 / ms_dispatch 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff75d60a640 / io_context_pool 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff86ea02640 / msgr-worker-2 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff86f203640 / msgr-worker-1 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff86fa04640 / msgr-worker-0 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff870205640 / io_context_pool 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff8716fd9c0 / radosgw-admin 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:08:23.614 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:08:23.461748Z_d0377bad-e223-4c4b-8405-936ae7d0a173/log 2024-09-12T18:08:23.615 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:08:23.615 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:08:23.615 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:08:23.616 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:23.616 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.545+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.545+0000 7f7f4b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.545+0000 7f7f4b5a59c0 20 realm 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.545+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.549+0000 7f7f4b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.549+0000 7f7f4b5a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.549+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.549+0000 7f7f4b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.549+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.549+0000 7f7f4b5a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.549+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.549+0000 7f7f4b5a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:23.617 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.549+0000 7f7f4b5a59c0 20 searching for the correct realm 2024-09-12T18:08:23.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.553+0000 7f7f490ab640 0 -- 172.21.15.157:0/2029817814 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f7f440c1040 msgr2=0x7f7f44104a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:23.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.561+0000 7f7f490ab640 0 -- 172.21.15.157:0/2029817814 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f7f4008f220 msgr2=0x7f7f4005adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:23.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.777+0000 7f7f4b5a59c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:08:23.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.777+0000 7f7f4b5a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:23.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.777+0000 7f7f4b5a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:23.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.777+0000 7f7f4b5a59c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:08:23.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.777+0000 7f7f4b5a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:23.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.777+0000 7f7f4b5a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:23.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.777+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.780 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:23.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.781 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:23.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 20 zone default found 2024-09-12T18:08:23.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 4 Realm: () 2024-09-12T18:08:23.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:08:23.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:08:23.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:23.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 20 zonegroup default 2024-09-12T18:08:23.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.782 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.781+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.785+0000 7f7f4b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.785+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.785+0000 7f7f4b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:23.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.785+0000 7f7f4b5a59c0 20 started sync module instance, tier type = 2024-09-12T18:08:23.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.785+0000 7f7f4b5a59c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:08:23.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.805+0000 7f7f4b5a59c0 20 add_watcher() i=0 2024-09-12T18:08:23.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.805+0000 7f7f4b5a59c0 20 add_watcher() i=1 2024-09-12T18:08:23.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.805+0000 7f7f4b5a59c0 20 add_watcher() i=2 2024-09-12T18:08:23.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.805+0000 7f7f4b5a59c0 20 add_watcher() i=3 2024-09-12T18:08:23.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.805+0000 7f7f4b5a59c0 20 add_watcher() i=4 2024-09-12T18:08:23.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.805+0000 7f7f4b5a59c0 20 add_watcher() i=5 2024-09-12T18:08:23.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.805+0000 7f7f4b5a59c0 20 add_watcher() i=6 2024-09-12T18:08:23.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.809+0000 7f7f4b5a59c0 20 add_watcher() i=7 2024-09-12T18:08:23.809 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.809+0000 7f7f4b5a59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:23.813 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.813+0000 7f7dff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:23.814 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.813+0000 7f7f4b5a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:23.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.813+0000 7f7f4b5a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:23.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.813+0000 7f7f4b5a59c0 5 note: GC not initialized 2024-09-12T18:08:23.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.813+0000 7f7dfe7e4640 20 reqs_thread_entry: start 2024-09-12T18:08:23.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 20 init_complete bucket index max shards: 1 2024-09-12T18:08:23.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 20 Filter name: none 2024-09-12T18:08:23.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7d6ffff640 20 reqs_thread_entry: start 2024-09-12T18:08:23.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:23.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:23.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:23.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:23.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:08:23.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:23.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:23.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:23.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:23.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:23.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:23.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:08:23.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:08:23.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:08:23.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:08:23.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:08:23.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:08:23.819 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.817+0000 7f7f4b5a59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:08:23.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.821+0000 7f7dff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:23.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.825+0000 7f7f4b5a59c0 20 remove_watcher() i=0 2024-09-12T18:08:23.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.825+0000 7f7f4b5a59c0 2 removed watcher, disabling cache 2024-09-12T18:08:23.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.829+0000 7f7f4b5a59c0 20 remove_watcher() i=1 2024-09-12T18:08:23.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.829+0000 7f7f4b5a59c0 20 remove_watcher() i=2 2024-09-12T18:08:23.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.833+0000 7f7f4b5a59c0 20 remove_watcher() i=3 2024-09-12T18:08:23.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.837+0000 7f7f4b5a59c0 20 remove_watcher() i=4 2024-09-12T18:08:23.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.837+0000 7f7f4b5a59c0 20 remove_watcher() i=5 2024-09-12T18:08:23.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.837+0000 7f7f4b5a59c0 20 remove_watcher() i=6 2024-09-12T18:08:23.840 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:23.841+0000 7f7f4b5a59c0 20 remove_watcher() i=7 2024-09-12T18:08:23.856 INFO:tasks.workunit.client.0.smithi157.stderr: test: duplicated entries can be purged manually 2024-09-12T18:08:53.888 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:08:53.921 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:53.921 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:53.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.965+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:53.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.965+0000 7f5c53dcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:53.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.965+0000 7f5c53dcd9c0 20 realm 2024-09-12T18:08:53.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.965+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:53.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.965+0000 7f5c53dcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:53.967 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.965+0000 7f5c53dcd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:53.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.965+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:53.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.969+0000 7f5c53dcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:53.968 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.969+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:53.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.969+0000 7f5c53dcd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:53.969 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.969+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:53.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.969+0000 7f5c53dcd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:53.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.969+0000 7f5c53dcd9c0 20 searching for the correct realm 2024-09-12T18:08:53.977 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:53.977+0000 7f5c520d4640 0 -- 172.21.15.157:0/1631178978 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f5c480baa30 msgr2=0x7f5c480e0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.192 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.193+0000 7f5c518d3640 0 -- 172.21.15.157:0/1631178978 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5555e7d5fe60 msgr2=0x5555e7d62320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:08:54.199 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:08:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.200 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:54.201 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:54.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 zone default found 2024-09-12T18:08:54.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 4 Realm: () 2024-09-12T18:08:54.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:08:54.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:08:54.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:54.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 zonegroup default 2024-09-12T18:08:54.202 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.201+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.203 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.205+0000 7f5c53dcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.205+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.205+0000 7f5c53dcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.205+0000 7f5c53dcd9c0 20 started sync module instance, tier type = 2024-09-12T18:08:54.204 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.205+0000 7f5c53dcd9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:08:54.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.225+0000 7f5c53dcd9c0 20 add_watcher() i=0 2024-09-12T18:08:54.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.225+0000 7f5c53dcd9c0 20 add_watcher() i=1 2024-09-12T18:08:54.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.225+0000 7f5c53dcd9c0 20 add_watcher() i=2 2024-09-12T18:08:54.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.225+0000 7f5c53dcd9c0 20 add_watcher() i=3 2024-09-12T18:08:54.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.225+0000 7f5c53dcd9c0 20 add_watcher() i=4 2024-09-12T18:08:54.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.225+0000 7f5c53dcd9c0 20 add_watcher() i=5 2024-09-12T18:08:54.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.229+0000 7f5c53dcd9c0 20 add_watcher() i=6 2024-09-12T18:08:54.230 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.229+0000 7f5c53dcd9c0 20 add_watcher() i=7 2024-09-12T18:08:54.230 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.229+0000 7f5c53dcd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:54.234 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.233+0000 7f5b07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.233+0000 7f5c53dcd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.233+0000 7f5c53dcd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.233+0000 7f5c53dcd9c0 5 note: GC not initialized 2024-09-12T18:08:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.237+0000 7f5b06fe5640 20 reqs_thread_entry: start 2024-09-12T18:08:54.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.237+0000 7f5c53dcd9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:08:54.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.237+0000 7f5c53dcd9c0 20 Filter name: none 2024-09-12T18:08:54.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.237+0000 7f5b04fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:54.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.237+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.237+0000 7f5c53dcd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:54.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.237+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.237+0000 7f5c53dcd9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:54.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.237+0000 7f5c53dcd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:54.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.237+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.241+0000 7f5c53dcd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:54.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.241+0000 7f5c53dcd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.241+0000 7f5c53dcd9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:54.240 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.241+0000 7f5c53dcd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:54.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.241+0000 7f5b07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:54.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.249+0000 7f5c53dcd9c0 20 remove_watcher() i=0 2024-09-12T18:08:54.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.249+0000 7f5c53dcd9c0 2 removed watcher, disabling cache 2024-09-12T18:08:54.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.249+0000 7f5c53dcd9c0 20 remove_watcher() i=1 2024-09-12T18:08:54.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.253+0000 7f5c53dcd9c0 20 remove_watcher() i=2 2024-09-12T18:08:54.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.253+0000 7f5c53dcd9c0 20 remove_watcher() i=3 2024-09-12T18:08:54.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.257+0000 7f5c53dcd9c0 20 remove_watcher() i=4 2024-09-12T18:08:54.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.257+0000 7f5c53dcd9c0 20 remove_watcher() i=5 2024-09-12T18:08:54.259 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.261+0000 7f5c53dcd9c0 20 remove_watcher() i=6 2024-09-12T18:08:54.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.261+0000 7f5c53dcd9c0 20 remove_watcher() i=7 2024-09-12T18:08:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.277 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:08:54.277 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: a-bucket id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-12T18:08:54.277 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.277 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:08:54.310 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:54.310 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:54.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 realm 2024-09-12T18:08:54.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:54.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.354 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.356 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:54.356 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:54.357 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 searching for the correct realm 2024-09-12T18:08:54.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.361+0000 7ff3f7870640 0 -- 172.21.15.157:0/3518221233 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7ff3e00e0400 msgr2=0x7ff3e00e0820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.369+0000 7ff3f7870640 0 -- 172.21.15.157:0/3518221233 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7ff2c0080880 msgr2=0x7ff2c0082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:08:54.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:54.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:54.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:08:54.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:54.376 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:54.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:54.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:54.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 zone default found 2024-09-12T18:08:54.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 4 Realm: () 2024-09-12T18:08:54.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:08:54.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:08:54.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:54.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 zonegroup default 2024-09-12T18:08:54.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.379 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 started sync module instance, tier type = 2024-09-12T18:08:54.380 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:08:54.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=0 2024-09-12T18:08:54.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=1 2024-09-12T18:08:54.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=2 2024-09-12T18:08:54.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=3 2024-09-12T18:08:54.394 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=4 2024-09-12T18:08:54.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=5 2024-09-12T18:08:54.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=6 2024-09-12T18:08:54.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 add_watcher() i=7 2024-09-12T18:08:54.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:54.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff2ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:54.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:54.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:54.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 note: GC not initialized 2024-09-12T18:08:54.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff2ad7e2640 20 reqs_thread_entry: start 2024-09-12T18:08:54.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:08:54.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 Filter name: none 2024-09-12T18:08:54.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff21effd640 20 reqs_thread_entry: start 2024-09-12T18:08:54.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:54.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:08:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:54.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:08:54.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.405+0000 7ff3fa56b9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:08:54.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:54.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:54.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:54.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:08:54.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464334 cookie 93946086622976 notifier 7823 bl.length()=827 2024-09-12T18:08:54.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:54.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:54.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:54.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:08:54.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:08:54.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:08:54.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:08:54.422 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3fa56b9c0 time 2024-09-12T18:08:54.426624+0000 2024-09-12T18:08:54.422 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:54.423 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:54.423 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3fde452eb] 2024-09-12T18:08:54.423 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3fde4549f] 2024-09-12T18:08:54.423 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571853100c1] 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5571853221fa] 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3fccabd90] 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.425+0000 7ff3fa56b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3fa56b9c0 time 2024-09-12T18:08:54.426624+0000 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3fde452eb] 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3fde4549f] 2024-09-12T18:08:54.424 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571853100c1] 2024-09-12T18:08:54.425 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5571853221fa] 2024-09-12T18:08:54.425 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:08:54.425 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3fccabd90] 2024-09-12T18:08:54.425 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:08:54.425 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:08:54.425 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.425 INFO:tasks.workunit.client.0.smithi157.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:08:54.425 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff3fa56b9c0 thread_name:radosgw-admin 2024-09-12T18:08:54.431 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:54.431 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff3fccc4520] 2024-09-12T18:08:54.431 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:08:54.431 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:08:54.431 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:08:54.431 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3fde45345] 2024-09-12T18:08:54.431 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3fde4549f] 2024-09-12T18:08:54.431 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571853100c1] 2024-09-12T18:08:54.431 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5571853221fa] 2024-09-12T18:08:54.431 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3fccabd90] 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.425+0000 7ff3fa56b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff3fa56b9c0 thread_name:radosgw-admin 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff3fccc4520] 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:08:54.432 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3fde45345] 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3fde4549f] 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571853100c1] 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5571853221fa] 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3fccabd90] 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:08:54.333+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): handle_auth_done global_id 7811 payload 274 2024-09-12T18:08:54.433 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient: _finish_hunting 0 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:08:54.333+0000 7ff3f8872640 1 monclient: found mon.noname-c 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: dump: 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.434 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: _finish_auth 0 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: _check_auth_tickets 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: dump: 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.435 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 monclient: authenticate success, global_id 7811 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 4 set_mon_vals no callback set 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: shutdown 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) unregister_commands rotate-key 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:54.436 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: monmap: 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding auth protocol: cephx 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding auth protocol: cephx 2024-09-12T18:08:54.437 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding auth protocol: cephx 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.438 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 1 librados: starting msgr at 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 1 librados: starting objecter 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command objecter_requests hook 0x557186e96740 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 1 librados: setting wanted keys 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 1 librados: calling monclient init 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: init 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding auth protocol: cephx 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding auth protocol: cephx 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding auth protocol: cephx 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.439 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command rotate-key hook 0x5571870f72c8 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:54.440 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-a con 0x557186f89040 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-b con 0x557186fb1c80 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-c con 0x5571871205c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): authenticate will time out at 2696.559317s 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): get_auth_request con 0x557186f89040 auth_method 0 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.441 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): get_auth_request con 0x5571871205c0 auth_method 0 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): handle_auth_done global_id 8400 payload 824 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient: _finish_hunting 0 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:08:54.333+0000 7ff3f8071640 1 monclient: found mon.noname-a 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:08:54.442 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: dump: 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.443 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: _finish_auth 0 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: _check_auth_tickets 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: dump: 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.444 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 5 monclient: authenticate success, global_id 8400 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:08:54.337+0000 7ff2e660c640 4 set_mon_vals no callback set 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 1 librados: init done 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.445 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:08:54.337+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff2e0070b10 auth_method 0 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:08:54.337+0000 7ff3f8872640 10 monclient: get_auth_request con 0x55718711f780 auth_method 0 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:08:54.337+0000 7ff3f8071640 10 monclient: get_auth_request con 0x557187141d30 auth_method 0 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:08:54.341+0000 7ff3f7870640 10 monclient: get_auth_request con 0x5571871463d0 auth_method 0 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient: monmap: 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.446 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding auth protocol: cephx 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding auth protocol: cephx 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding auth protocol: cephx 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.447 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.448 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.448 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.448 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.448 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.448 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.448 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.448 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55718714ea80 EEXIST 2024-09-12T18:08:54.448 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient: init 2024-09-12T18:08:54.448 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding auth protocol: cephx 2024-09-12T18:08:54.448 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding auth protocol: cephx 2024-09-12T18:08:54.448 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding auth protocol: cephx 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.449 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command rotate-key cmddesc rotate-key hook 0x557187149880 EEXIST 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-c con 0x557187172c30 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-b con 0x557187172560 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-a con 0x557187170f40 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): authenticate will time out at 2696.567866s 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): get_auth_request con 0x557187172c30 auth_method 0 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.450 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): get_auth_request con 0x557187170f40 auth_method 0 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:08:54.345+0000 7ff3f7870640 10 monclient(hunting): get_auth_request con 0x557187172560 auth_method 0 2024-09-12T18:08:54.451 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:08:54.345+0000 7ff3f7870640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:08:54.345+0000 7ff3f7870640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:08:54.345+0000 7ff3f7870640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): handle_auth_done global_id 7817 payload 824 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient: _finish_hunting 0 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:08:54.345+0000 7ff3f8071640 1 monclient: found mon.noname-c 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: dump: 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.452 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: _finish_auth 0 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: _check_auth_tickets 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.453 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: dump: 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.454 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 monclient: authenticate success, global_id 7817 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:08:54.345+0000 7ff3f706f640 4 set_mon_vals no callback set 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:08:54.345+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff2d0070a20 auth_method 0 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: get_monmap_and_config 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: monmap: 2024-09-12T18:08:54.455 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding auth protocol: cephx 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding auth protocol: cephx 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding auth protocol: cephx 2024-09-12T18:08:54.456 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.457 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: init 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding auth protocol: cephx 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding auth protocol: cephx 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding auth protocol: cephx 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.458 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.459 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.459 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.459 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffeff7b2b88 EEXIST 2024-09-12T18:08:54.459 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:54.459 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:08:54.459 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-b con 0x5571871c68e0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:54.459 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-c con 0x5571871976c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:54.459 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-a con 0x5571871b83d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): authenticate will time out at 2696.572035s 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): get_auth_request con 0x5571871976c0 auth_method 0 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): get_auth_request con 0x5571871b83d0 auth_method 0 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.460 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.461 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.461 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.461 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.461 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.461 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.461 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.461 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): handle_auth_done global_id 8406 payload 274 2024-09-12T18:08:54.461 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient: _finish_hunting 0 2024-09-12T18:08:54.461 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:08:54.349+0000 7ff3f8872640 1 monclient: found mon.noname-a 2024-09-12T18:08:54.461 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:08:54.461 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient: get_auth_request con 0x5571871c68e0 auth_method 0 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: dump: 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.462 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: _finish_auth 0 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 monclient: authenticate success, global_id 8406 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 4 set_mon_vals no callback set 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: dump: 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: shutdown 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: monmap: 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:54.464 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding auth protocol: cephx 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding auth protocol: cephx 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding auth protocol: cephx 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.465 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 librados: starting msgr at 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 librados: starting objecter 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5571871b9810 EEXIST 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 librados: setting wanted keys 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 librados: calling monclient init 2024-09-12T18:08:54.466 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: init 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding auth protocol: cephx 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding auth protocol: cephx 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding auth protocol: cephx 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.467 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.468 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.468 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.468 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.468 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command rotate-key cmddesc rotate-key hook 0x557187174b98 EEXIST 2024-09-12T18:08:54.468 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:54.468 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:08:54.468 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-c con 0x5571871976c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:54.468 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-a con 0x5571871b83d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:54.468 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-b con 0x5571871c68e0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:54.468 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.468 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): authenticate will time out at 2696.574701s 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): get_auth_request con 0x5571871976c0 auth_method 0 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): get_auth_request con 0x5571871b83d0 auth_method 0 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.469 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): handle_auth_done global_id 7823 payload 824 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient: _finish_hunting 0 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:08:54.349+0000 7ff3f8071640 1 monclient: found mon.noname-c 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: dump: 2024-09-12T18:08:54.470 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: _finish_auth 0 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: _check_auth_tickets 2024-09-12T18:08:54.471 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 monclient: authenticate success, global_id 7823 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: dump: 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.472 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 4 set_mon_vals no callback set 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 librados: init done 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command cr dump hook 0x5571871bf848 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:08:54.353+0000 7ff2cdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:08:54.353+0000 7ff2cdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:08:54.353+0000 7ff2cdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:08:54.353+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff2c0070ae0 auth_method 0 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:08:54.353+0000 7ff3f8872640 10 monclient: get_auth_request con 0x5571871dfd20 auth_method 0 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.473 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 realm 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:08:54.353+0000 7ff3f8071640 10 monclient: get_auth_request con 0x5571871e3f30 auth_method 0 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:08:54.357+0000 7ff3f7870640 10 monclient: get_auth_request con 0x5571871e7790 auth_method 0 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 searching for the correct realm 2024-09-12T18:08:54.474 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:08:54.357+0000 7ff3f8872640 10 monclient: get_auth_request con 0x5571871ec550 auth_method 0 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:08:54.357+0000 7ff3f8071640 10 monclient: get_auth_request con 0x7ff3e8039040 auth_method 0 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:08:54.361+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff3e00e0400 auth_method 0 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:08:54.361+0000 7ff3f7870640 0 -- 172.21.15.157:0/3518221233 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7ff3e00e0400 msgr2=0x7ff3e00e0820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:08:54.361+0000 7ff2cdffb640 1 client.7823.objecter ms_handle_reset 0x7ff3e00e0400 session 0x7ff3e00b7040 osd.4 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:08:54.361+0000 7ff2cdffb640 10 monclient: _renew_subs 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:08:54.361+0000 7ff2cdffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:08:54.365+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff2c0080880 auth_method 0 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:08:54.365+0000 7ff3f8872640 10 monclient: get_auth_request con 0x7ff3e00f1040 auth_method 0 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:08:54.369+0000 7ff3f8071640 10 monclient: get_auth_request con 0x7ff3e00f1960 auth_method 0 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:08:54.369+0000 7ff3f7870640 0 -- 172.21.15.157:0/3518221233 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7ff2c0080880 msgr2=0x7ff2c0082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:08:54.369+0000 7ff2cdffb640 1 client.7823.objecter ms_handle_reset 0x7ff2c0080880 session 0x7ff3e00b7040 osd.4 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:08:54.369+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff3e00e0400 auth_method 0 2024-09-12T18:08:54.475 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:54.476 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 zone default found 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 4 Realm: () 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 zonegroup default 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 started sync module instance, tier type = 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:08:54.477 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=0 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=1 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=2 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=3 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=4 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=5 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=6 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 add_watcher() i=7 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding auth protocol: cephx 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding auth protocol: cephx 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding auth protocol: cephx 2024-09-12T18:08:54.478 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:08:54.397+0000 7ff2ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.479 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command cache list hook 0x5571871bc690 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command cache inspect hook 0x5571871bc690 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command cache erase hook 0x5571871bc690 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command cache zap hook 0x5571871bc690 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 note: GC not initialized 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:08:54.397+0000 7ff2ad7e2640 20 reqs_thread_entry: start 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command sync trace show hook 0x7ff3e8005fd0 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command sync trace history hook 0x7ff3e8005fd0 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command sync trace active hook 0x7ff3e8005fd0 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command sync trace active_short hook 0x7ff3e8005fd0 2024-09-12T18:08:54.480 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 Filter name: none 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:08:54.397+0000 7ff21effd640 20 reqs_thread_entry: start 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:54.481 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:08:54.405+0000 7ff3fa56b9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464334 cookie 93946086622976 notifier 7823 bl.length()=827 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:54.482 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:08:54.425+0000 7ff3fa56b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3fa56b9c0 time 2024-09-12T18:08:54.426624+0000 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3fde452eb] 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3fde4549f] 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571853100c1] 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5571853221fa] 2024-09-12T18:08:54.483 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3fccabd90] 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:08:54.425+0000 7ff3fa56b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff3fa56b9c0 thread_name:radosgw-admin 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff3fccc4520] 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3fde45345] 2024-09-12T18:08:54.484 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3fde4549f] 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571853100c1] 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5571853221fa] 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3fccabd90] 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:08:54.485 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:08:54.486 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:08:54.487 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:08:54.488 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:08:54.489 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:08:54.490 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:08:54.491 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:08:54.492 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff21effd640 / http_manager 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2ad7e2640 / http_manager 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2ae7e4640 / rgw_dt_lg_renew 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2cdffb640 / ms_dispatch 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2cf7fe640 / io_context_pool 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2ddffb640 / ms_dispatch 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2e4e09640 / ms_dispatch 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2e660c640 / io_context_pool 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff3f706f640 / io_context_pool 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff3f7870640 / msgr-worker-2 2024-09-12T18:08:54.493 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff3f8071640 / msgr-worker-1 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff3f8872640 / msgr-worker-0 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff3fa56b9c0 / radosgw-admin 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/log/ceph/ceph-client.admin.144751.log 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr:--- begin dump of recent events --- 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: -499> 2024-09-12T18:08:54.333+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: -498> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): handle_auth_done global_id 7811 payload 274 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: -497> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient: _finish_hunting 0 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: -496> 2024-09-12T18:08:54.333+0000 7ff3f8872640 1 monclient: found mon.noname-c 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: -495> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: -494> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: -493> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:54.494 INFO:tasks.workunit.client.0.smithi157.stderr: -492> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: dump: 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr: -491> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: _finish_auth 0 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr: -490> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: _check_auth_tickets 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr: -489> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:54.495 INFO:tasks.workunit.client.0.smithi157.stderr: -488> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr: -487> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr: -486> 2024-09-12T18:08:54.333+0000 7ff2e660c640 10 monclient: dump: 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.496 INFO:tasks.workunit.client.0.smithi157.stderr: -485> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 monclient: authenticate success, global_id 7811 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr: -484> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr: -483> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 4 set_mon_vals no callback set 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr: -482> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: shutdown 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr: -481> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) unregister_commands rotate-key 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr: -480> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr: -479> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr: -478> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: monmap: 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:54.497 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr: -477> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding auth protocol: cephx 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr: -476> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding auth protocol: cephx 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr: -475> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding auth protocol: cephx 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr: -474> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr: -473> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr: -472> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr: -471> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.498 INFO:tasks.workunit.client.0.smithi157.stderr: -470> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -469> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -468> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -467> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -466> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -465> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -464> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: crc 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -463> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870fc850) adding con mode: secure 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -462> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -461> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 1 librados: starting msgr at 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -460> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 1 librados: starting objecter 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -459> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command objecter_requests hook 0x557186e96740 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -458> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 1 librados: setting wanted keys 2024-09-12T18:08:54.499 INFO:tasks.workunit.client.0.smithi157.stderr: -457> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 1 librados: calling monclient init 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -456> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: init 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -455> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding auth protocol: cephx 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -454> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding auth protocol: cephx 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -453> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding auth protocol: cephx 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -452> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -451> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -450> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -449> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -448> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -447> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -446> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.500 INFO:tasks.workunit.client.0.smithi157.stderr: -445> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -444> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -443> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -442> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: crc 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -441> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571870f7180) adding con mode: secure 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -440> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -439> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -438> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command rotate-key hook 0x5571870f72c8 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -437> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -436> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -435> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-a con 0x557186f89040 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -434> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-b con 0x557186fb1c80 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -433> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-c con 0x5571871205c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:54.501 INFO:tasks.workunit.client.0.smithi157.stderr: -432> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -431> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -430> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -429> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -428> 2024-09-12T18:08:54.333+0000 7ff3fa56b9c0 10 monclient(hunting): authenticate will time out at 2696.559317s 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -427> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): get_auth_request con 0x557186f89040 auth_method 0 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -426> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -425> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -424> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -423> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): get_auth_request con 0x5571871205c0 auth_method 0 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -422> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -421> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.502 INFO:tasks.workunit.client.0.smithi157.stderr: -420> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -419> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -418> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -417> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -416> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -415> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -414> 2024-09-12T18:08:54.333+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -413> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient(hunting): handle_auth_done global_id 8400 payload 824 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -412> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient: _finish_hunting 0 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -411> 2024-09-12T18:08:54.333+0000 7ff3f8071640 1 monclient: found mon.noname-a 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -410> 2024-09-12T18:08:54.333+0000 7ff3f8071640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -409> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.503 INFO:tasks.workunit.client.0.smithi157.stderr: -408> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr: -407> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: dump: 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr: -406> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: _finish_auth 0 2024-09-12T18:08:54.504 INFO:tasks.workunit.client.0.smithi157.stderr: -405> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: _check_auth_tickets 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr: -404> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr: -403> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr: -402> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr: -401> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 10 monclient: dump: 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -400> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 5 monclient: authenticate success, global_id 8400 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -399> 2024-09-12T18:08:54.337+0000 7ff2e660c640 4 set_mon_vals no callback set 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -398> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -397> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -396> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -395> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.157:3300/0 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -394> 2024-09-12T18:08:54.337+0000 7ff3fa56b9c0 1 librados: init done 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -393> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -392> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -391> 2024-09-12T18:08:54.337+0000 7ff2e4e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -390> 2024-09-12T18:08:54.337+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff2e0070b10 auth_method 0 2024-09-12T18:08:54.506 INFO:tasks.workunit.client.0.smithi157.stderr: -389> 2024-09-12T18:08:54.337+0000 7ff3f8872640 10 monclient: get_auth_request con 0x55718711f780 auth_method 0 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr: -388> 2024-09-12T18:08:54.337+0000 7ff3f8071640 10 monclient: get_auth_request con 0x557187141d30 auth_method 0 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr: -387> 2024-09-12T18:08:54.341+0000 7ff3f7870640 10 monclient: get_auth_request con 0x5571871463d0 auth_method 0 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr: -386> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr: -385> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr: -384> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient: monmap: 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: -383> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding auth protocol: cephx 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: -382> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding auth protocol: cephx 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: -381> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding auth protocol: cephx 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: -380> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: -379> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: -378> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: -377> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: -376> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: -375> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: -374> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.508 INFO:tasks.workunit.client.0.smithi157.stderr: -373> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -372> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -371> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -370> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: crc 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -369> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x55718714b0b0) adding con mode: secure 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -368> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -367> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55718714ea80 EEXIST 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -366> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient: init 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -365> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding auth protocol: cephx 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -364> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding auth protocol: cephx 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -363> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding auth protocol: cephx 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -362> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -361> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.509 INFO:tasks.workunit.client.0.smithi157.stderr: -360> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -359> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -358> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -357> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -356> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -355> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -354> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -353> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -352> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: crc 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -351> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187149738) adding con mode: secure 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -350> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -349> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -348> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command rotate-key cmddesc rotate-key hook 0x557187149880 EEXIST 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -347> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:54.510 INFO:tasks.workunit.client.0.smithi157.stderr: -346> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -345> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-c con 0x557187172c30 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -344> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-b con 0x557187172560 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -343> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-a con 0x557187170f40 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -342> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -341> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -340> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -339> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -338> 2024-09-12T18:08:54.341+0000 7ff3fa56b9c0 10 monclient(hunting): authenticate will time out at 2696.567866s 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -337> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): get_auth_request con 0x557187172c30 auth_method 0 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -336> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -335> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.511 INFO:tasks.workunit.client.0.smithi157.stderr: -334> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -333> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): get_auth_request con 0x557187170f40 auth_method 0 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -332> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -331> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -330> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -329> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -328> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -327> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -326> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -325> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -324> 2024-09-12T18:08:54.345+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -323> 2024-09-12T18:08:54.345+0000 7ff3f7870640 10 monclient(hunting): get_auth_request con 0x557187172560 auth_method 0 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -322> 2024-09-12T18:08:54.345+0000 7ff3f7870640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.512 INFO:tasks.workunit.client.0.smithi157.stderr: -321> 2024-09-12T18:08:54.345+0000 7ff3f7870640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr: -320> 2024-09-12T18:08:54.345+0000 7ff3f7870640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr: -319> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient(hunting): handle_auth_done global_id 7817 payload 824 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr: -318> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient: _finish_hunting 0 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr: -317> 2024-09-12T18:08:54.345+0000 7ff3f8071640 1 monclient: found mon.noname-c 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr: -316> 2024-09-12T18:08:54.345+0000 7ff3f8071640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr: -315> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr: -314> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr: -313> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: dump: 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.513 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr: -312> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: _finish_auth 0 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr: -311> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: _check_auth_tickets 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr: -310> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr: -309> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr: -308> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr: -307> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 10 monclient: dump: 2024-09-12T18:08:54.514 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr: -306> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 monclient: authenticate success, global_id 7817 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr: -305> 2024-09-12T18:08:54.345+0000 7ff3f706f640 4 set_mon_vals no callback set 2024-09-12T18:08:54.515 INFO:tasks.workunit.client.0.smithi157.stderr: -304> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.516 INFO:tasks.workunit.client.0.smithi157.stderr: -303> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.516 INFO:tasks.workunit.client.0.smithi157.stderr: -302> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.516 INFO:tasks.workunit.client.0.smithi157.stderr: -301> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.516 INFO:tasks.workunit.client.0.smithi157.stderr: -300> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:54.516 INFO:tasks.workunit.client.0.smithi157.stderr: -299> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.516 INFO:tasks.workunit.client.0.smithi157.stderr: -298> 2024-09-12T18:08:54.345+0000 7ff2ddffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.516 INFO:tasks.workunit.client.0.smithi157.stderr: -297> 2024-09-12T18:08:54.345+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff2d0070a20 auth_method 0 2024-09-12T18:08:54.516 INFO:tasks.workunit.client.0.smithi157.stderr: -296> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: get_monmap_and_config 2024-09-12T18:08:54.516 INFO:tasks.workunit.client.0.smithi157.stderr: -295> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:54.516 INFO:tasks.workunit.client.0.smithi157.stderr: -294> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr: -293> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: monmap: 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr: -292> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding auth protocol: cephx 2024-09-12T18:08:54.517 INFO:tasks.workunit.client.0.smithi157.stderr: -291> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding auth protocol: cephx 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -290> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding auth protocol: cephx 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -289> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -288> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -287> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -286> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -285> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -284> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -283> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -282> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -281> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -280> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.518 INFO:tasks.workunit.client.0.smithi157.stderr: -279> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: crc 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -278> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187192430) adding con mode: secure 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -277> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -276> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: init 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -275> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding auth protocol: cephx 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -274> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding auth protocol: cephx 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -273> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding auth protocol: cephx 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -272> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -271> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -270> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -269> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -268> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.519 INFO:tasks.workunit.client.0.smithi157.stderr: -267> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -266> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -265> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -264> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -263> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -262> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: crc 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -261> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2a40) adding con mode: secure 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -260> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -259> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -258> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffeff7b2b88 EEXIST 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -257> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -256> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:08:54.520 INFO:tasks.workunit.client.0.smithi157.stderr: -255> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-b con 0x5571871c68e0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -254> 2024-09-12T18:08:54.345+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-c con 0x5571871976c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -253> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-a con 0x5571871b83d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -252> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -251> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -250> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -249> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -248> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): authenticate will time out at 2696.572035s 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -247> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): get_auth_request con 0x5571871976c0 auth_method 0 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -246> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -245> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -244> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -243> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): get_auth_request con 0x5571871b83d0 auth_method 0 2024-09-12T18:08:54.521 INFO:tasks.workunit.client.0.smithi157.stderr: -242> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -241> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -240> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -239> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -238> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -237> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -236> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -235> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -234> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -233> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient(hunting): handle_auth_done global_id 8406 payload 274 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -232> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient: _finish_hunting 0 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -231> 2024-09-12T18:08:54.349+0000 7ff3f8872640 1 monclient: found mon.noname-a 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -230> 2024-09-12T18:08:54.349+0000 7ff3f8872640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.157:3300/0 2024-09-12T18:08:54.522 INFO:tasks.workunit.client.0.smithi157.stderr: -229> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient: get_auth_request con 0x5571871c68e0 auth_method 0 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr: -228> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr: -227> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr: -226> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: dump: 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.523 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr: -225> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: _finish_auth 0 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr: -224> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr: -223> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr: -222> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 monclient: authenticate success, global_id 8406 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr: -221> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr: -220> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 4 set_mon_vals no callback set 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr: -219> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr: -218> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr: -217> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 10 monclient: dump: 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.524 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr: -216> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: shutdown 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr: -215> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: build_initial_monmap 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr: -214> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr: -213> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: monmap: 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 0 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 0.000000 2024-09-12T18:08:54.525 INFO:tasks.workunit.client.0.smithi157.stderr:created 0.000000 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-a 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.noname-b 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-c 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr: -212> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding auth protocol: cephx 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr: -211> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding auth protocol: cephx 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr: -210> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding auth protocol: cephx 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr: -209> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr: -208> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.526 INFO:tasks.workunit.client.0.smithi157.stderr: -207> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -206> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -205> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -204> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -203> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -202> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -201> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -200> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -199> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: crc 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -198> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x5571871b8880) adding con mode: secure 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -197> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -196> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 librados: starting msgr at 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -195> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 librados: starting objecter 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -194> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5571871b9810 EEXIST 2024-09-12T18:08:54.527 INFO:tasks.workunit.client.0.smithi157.stderr: -193> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 librados: setting wanted keys 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -192> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 librados: calling monclient init 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -191> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: init 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -190> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding auth protocol: cephx 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -189> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding auth protocol: cephx 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -188> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding auth protocol: cephx 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -187> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -186> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -185> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -184> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -183> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -182> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.528 INFO:tasks.workunit.client.0.smithi157.stderr: -181> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -180> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -179> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -178> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -177> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: crc 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -176> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 AuthRegistry(0x557187174a50) adding con mode: secure 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -175> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -174> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -173> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command rotate-key cmddesc rotate-key hook 0x557187174b98 EEXIST 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -172> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -171> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -170> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-c con 0x5571871976c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -169> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-a con 0x5571871b83d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-12T18:08:54.529 INFO:tasks.workunit.client.0.smithi157.stderr: -168> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): picked mon.noname-b con 0x5571871c68e0 addr [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -167> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -166> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -165> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -164> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -163> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient(hunting): authenticate will time out at 2696.574701s 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -162> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): get_auth_request con 0x5571871976c0 auth_method 0 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -161> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -160> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -159> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -158> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): get_auth_request con 0x5571871b83d0 auth_method 0 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -157> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -156> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:54.530 INFO:tasks.workunit.client.0.smithi157.stderr: -155> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -154> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -153> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -152> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -151> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -150> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -149> 2024-09-12T18:08:54.349+0000 7ff3f7870640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -148> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient(hunting): handle_auth_done global_id 7823 payload 824 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -147> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient: _finish_hunting 0 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -146> 2024-09-12T18:08:54.349+0000 7ff3f8071640 1 monclient: found mon.noname-c 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -145> 2024-09-12T18:08:54.349+0000 7ff3f8071640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -144> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -143> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:54.531 INFO:tasks.workunit.client.0.smithi157.stderr: -142> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: dump: 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr: -141> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: _finish_auth 0 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr: -140> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: _check_auth_tickets 2024-09-12T18:08:54.532 INFO:tasks.workunit.client.0.smithi157.stderr: -139> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 monclient: authenticate success, global_id 7823 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr: -138> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr: -137> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr: -136> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr: -135> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr: -134> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr: -133> 2024-09-12T18:08:54.349+0000 7ff2cdffb640 10 monclient: dump: 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr:epoch 1 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr:fsid 634e9294-a45c-40c3-b542-a6fcc3acc794 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr:last_changed 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr:created 2024-09-12T17:39:11.218869+0000 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr:election_strategy: 1 2024-09-12T18:08:54.533 INFO:tasks.workunit.client.0.smithi157.stderr:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr: -132> 2024-09-12T18:08:54.349+0000 7ff2cf7fe640 4 set_mon_vals no callback set 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr: -131> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _renew_subs 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr: -130> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr: -129> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 1 librados: init done 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr: -128> 2024-09-12T18:08:54.349+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command cr dump hook 0x5571871bf848 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr: -127> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr: -126> 2024-09-12T18:08:54.353+0000 7ff2cdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr: -125> 2024-09-12T18:08:54.353+0000 7ff2cdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr: -124> 2024-09-12T18:08:54.353+0000 7ff2cdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.157:6832/1922186176,v1:172.21.15.157:6833/1922186176] 2024-09-12T18:08:54.534 INFO:tasks.workunit.client.0.smithi157.stderr: -123> 2024-09-12T18:08:54.353+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff2c0070ae0 auth_method 0 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -122> 2024-09-12T18:08:54.353+0000 7ff3f8872640 10 monclient: get_auth_request con 0x5571871dfd20 auth_method 0 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -121> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -120> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 realm 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -119> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -118> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -117> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -116> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -115> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -114> 2024-09-12T18:08:54.353+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -113> 2024-09-12T18:08:54.353+0000 7ff3f8071640 10 monclient: get_auth_request con 0x5571871e3f30 auth_method 0 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -112> 2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -111> 2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.535 INFO:tasks.workunit.client.0.smithi157.stderr: -110> 2024-09-12T18:08:54.357+0000 7ff3f7870640 10 monclient: get_auth_request con 0x5571871e7790 auth_method 0 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -109> 2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -108> 2024-09-12T18:08:54.357+0000 7ff3fa56b9c0 20 searching for the correct realm 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -107> 2024-09-12T18:08:54.357+0000 7ff3f8872640 10 monclient: get_auth_request con 0x5571871ec550 auth_method 0 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -106> 2024-09-12T18:08:54.357+0000 7ff3f8071640 10 monclient: get_auth_request con 0x7ff3e8039040 auth_method 0 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -105> 2024-09-12T18:08:54.361+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff3e00e0400 auth_method 0 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -104> 2024-09-12T18:08:54.361+0000 7ff3f7870640 0 -- 172.21.15.157:0/3518221233 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7ff3e00e0400 msgr2=0x7ff3e00e0820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -103> 2024-09-12T18:08:54.361+0000 7ff2cdffb640 1 client.7823.objecter ms_handle_reset 0x7ff3e00e0400 session 0x7ff3e00b7040 osd.4 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -102> 2024-09-12T18:08:54.361+0000 7ff2cdffb640 10 monclient: _renew_subs 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -101> 2024-09-12T18:08:54.361+0000 7ff2cdffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.157:3301/0 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -100> 2024-09-12T18:08:54.365+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff2c0080880 auth_method 0 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -99> 2024-09-12T18:08:54.365+0000 7ff3f8872640 10 monclient: get_auth_request con 0x7ff3e00f1040 auth_method 0 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -98> 2024-09-12T18:08:54.369+0000 7ff3f8071640 10 monclient: get_auth_request con 0x7ff3e00f1960 auth_method 0 2024-09-12T18:08:54.536 INFO:tasks.workunit.client.0.smithi157.stderr: -97> 2024-09-12T18:08:54.369+0000 7ff3f7870640 0 -- 172.21.15.157:0/3518221233 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7ff2c0080880 msgr2=0x7ff2c0082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -96> 2024-09-12T18:08:54.369+0000 7ff2cdffb640 1 client.7823.objecter ms_handle_reset 0x7ff2c0080880 session 0x7ff3e00b7040 osd.4 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -95> 2024-09-12T18:08:54.369+0000 7ff3f7870640 10 monclient: get_auth_request con 0x7ff3e00e0400 auth_method 0 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -94> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -93> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -92> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -91> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -90> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -89> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -88> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -87> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -86> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -85> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:54.537 INFO:tasks.workunit.client.0.smithi157.stderr: -84> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -83> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -82> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 zone default found 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -81> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 4 Realm: () 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -80> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -79> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -78> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -77> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 zonegroup default 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -76> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -75> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -74> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -73> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -72> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.538 INFO:tasks.workunit.client.0.smithi157.stderr: -71> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -70> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 started sync module instance, tier type = 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -69> 2024-09-12T18:08:54.377+0000 7ff3fa56b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -68> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=0 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -67> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=1 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -66> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=2 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -65> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=3 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -64> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=4 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -63> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=5 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -62> 2024-09-12T18:08:54.393+0000 7ff3fa56b9c0 20 add_watcher() i=6 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -61> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 add_watcher() i=7 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -60> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -59> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding auth protocol: cephx 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -58> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding auth protocol: cephx 2024-09-12T18:08:54.539 INFO:tasks.workunit.client.0.smithi157.stderr: -57> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding auth protocol: cephx 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -56> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -55> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -54> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -53> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -52> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -51> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -50> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -49> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -48> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -47> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -46> 2024-09-12T18:08:54.397+0000 7ff2ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:54.540 INFO:tasks.workunit.client.0.smithi157.stderr: -45> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: crc 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -44> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 AuthRegistry(0x7ffeff7b2f10) adding con mode: secure 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -43> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -42> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -41> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -40> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command cache list hook 0x5571871bc690 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -39> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command cache inspect hook 0x5571871bc690 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -38> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command cache erase hook 0x5571871bc690 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -37> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command cache zap hook 0x5571871bc690 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -36> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 note: GC not initialized 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -35> 2024-09-12T18:08:54.397+0000 7ff2ad7e2640 20 reqs_thread_entry: start 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -34> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command sync trace show hook 0x7ff3e8005fd0 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -33> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command sync trace history hook 0x7ff3e8005fd0 2024-09-12T18:08:54.541 INFO:tasks.workunit.client.0.smithi157.stderr: -32> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command sync trace active hook 0x7ff3e8005fd0 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -31> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 5 asok(0x557186eef2b0) register_command sync trace active_short hook 0x7ff3e8005fd0 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -30> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -29> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 Filter name: none 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -28> 2024-09-12T18:08:54.397+0000 7ff21effd640 20 reqs_thread_entry: start 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -27> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -26> 2024-09-12T18:08:54.397+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -25> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -24> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -23> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -22> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -21> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -20> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:54.542 INFO:tasks.workunit.client.0.smithi157.stderr: -19> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -18> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -17> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -16> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -15> 2024-09-12T18:08:54.401+0000 7ff3fa56b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -14> 2024-09-12T18:08:54.405+0000 7ff3fa56b9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -13> 2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -12> 2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -11> 2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -10> 2024-09-12T18:08:54.413+0000 7ff3fa56b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -9> 2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464334 cookie 93946086622976 notifier 7823 bl.length()=827 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -8> 2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:54.543 INFO:tasks.workunit.client.0.smithi157.stderr: -7> 2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: -6> 2024-09-12T18:08:54.413+0000 7ff2cf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: -5> 2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: -4> 2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: -3> 2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: -2> 2024-09-12T18:08:54.417+0000 7ff3fa56b9c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: -1> 2024-09-12T18:08:54.425+0000 7ff3fa56b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3fa56b9c0 time 2024-09-12T18:08:54.426624+0000 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3fde452eb] 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3fde4549f] 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571853100c1] 2024-09-12T18:08:54.544 INFO:tasks.workunit.client.0.smithi157.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5571853221fa] 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: 5: main() 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3fccabd90] 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: 7: __libc_start_main() 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: 8: _start() 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: 0> 2024-09-12T18:08:54.425+0000 7ff3fa56b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: in thread 7ff3fa56b9c0 thread_name:radosgw-admin 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff3fccc4520] 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: 2: pthread_kill() 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: 3: raise() 2024-09-12T18:08:54.545 INFO:tasks.workunit.client.0.smithi157.stderr: 4: abort() 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3fde45345] 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3fde4549f] 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571853100c1] 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5571853221fa] 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 9: main() 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3fccabd90] 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 11: __libc_start_main() 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 12: _start() 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr:--- logging levels --- 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 none 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 lockdep 2024-09-12T18:08:54.546 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 context 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 crush 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_balancer 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_locker 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_log_expire 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mds_migrator 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 3/ 5 mds_quiesce 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 buffer 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 timer 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 filer 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 striper 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 1 objecter 2024-09-12T18:08:54.547 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rados 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_mirror 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_replay 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 rbd_pwl 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 journaler 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objectcacher 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 client 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 osd 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 optracker 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 objclass 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 filestore 2024-09-12T18:08:54.548 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 journal 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 ms 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mon 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 0/10 monc 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 paxos 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 tp 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 auth 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 crypto 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 finisher 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 reserver 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 heartbeatmap 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 perfcounter 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw 2024-09-12T18:08:54.549 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_sync 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_datacache 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_access 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_flight 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 20/20 rgw_notification 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 javaclient 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 asok 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 1 throttle 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 0 refs 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 compressor 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluestore 2024-09-12T18:08:54.550 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 bluefs 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 3 bdev 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 kstore 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 4/ 5 rocksdb 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 fuse 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 2/ 5 mgr 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mgrc 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 dpdk 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 eventtrace 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 prioritycache 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 test 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cephsqlite 2024-09-12T18:08:54.551 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_onode 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_odata 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_omap 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_tm 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_t 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_epm 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_lba 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_cache 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_journal 2024-09-12T18:08:54.552 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_device 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 seastore_backref 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 alienstore 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 mclock 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 cyanstore 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 ceph_exporter 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 memstore 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 1/ 5 trace 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 0/ 5 ceph_dedup 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: -2/-2 (syslog threshold) 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 99/99 (stderr threshold) 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff21effd640 / http_manager 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2ad7e2640 / http_manager 2024-09-12T18:08:54.553 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2ae7e4640 / rgw_dt_lg_renew 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2cdffb640 / ms_dispatch 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2cf7fe640 / io_context_pool 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2ddffb640 / ms_dispatch 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2e4e09640 / ms_dispatch 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff2e660c640 / io_context_pool 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff3f706f640 / io_context_pool 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff3f7870640 / msgr-worker-2 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff3f8071640 / msgr-worker-1 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff3f8872640 / msgr-worker-0 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: 7ff3fa56b9c0 / radosgw-admin 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: max_recent 500 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: max_new 1000 2024-09-12T18:08:54.554 INFO:tasks.workunit.client.0.smithi157.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:08:54.428633Z_154328de-06dd-49ae-8df6-81d616400630/log 2024-09-12T18:08:54.555 INFO:tasks.workunit.client.0.smithi157.stderr:--- end dump of recent events --- 2024-09-12T18:08:54.559 INFO:tasks.workunit.client.0.smithi157.stderr:Aborted 2024-09-12T18:08:54.559 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:08:54.559 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:54.559 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:54.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.501+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 20 realm 2024-09-12T18:08:54.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.505+0000 7f24055009c0 20 searching for the correct realm 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.513+0000 7f2403807640 0 -- 172.21.15.157:0/4246494853 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x5584280009c0 msgr2=0x558428002e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.517+0000 7f2403006640 0 -- 172.21.15.157:0/4246494853 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f23f8044910 msgr2=0x7f23f801b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:54.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 zone default found 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 4 Realm: () 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 zonegroup default 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.525+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.529+0000 7f24055009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.529+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.529+0000 7f24055009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.529+0000 7f24055009c0 20 started sync module instance, tier type = 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.529+0000 7f24055009c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:08:54.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.545+0000 7f24055009c0 20 add_watcher() i=0 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.545+0000 7f24055009c0 20 add_watcher() i=1 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.545+0000 7f24055009c0 20 add_watcher() i=2 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.545+0000 7f24055009c0 20 add_watcher() i=3 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.545+0000 7f24055009c0 20 add_watcher() i=4 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.545+0000 7f24055009c0 20 add_watcher() i=5 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.545+0000 7f24055009c0 20 add_watcher() i=6 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.545+0000 7f24055009c0 20 add_watcher() i=7 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.545+0000 7f24055009c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f22b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 5 note: GC not initialized 2024-09-12T18:08:54.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f22b8fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 init_complete bucket index max shards: 1 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 Filter name: none 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f22327fc640 20 reqs_thread_entry: start 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:54.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.549+0000 7f24055009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:54.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.553+0000 7f22b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:54.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.557+0000 7f24055009c0 20 remove_watcher() i=0 2024-09-12T18:08:54.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.557+0000 7f24055009c0 2 removed watcher, disabling cache 2024-09-12T18:08:54.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.561+0000 7f24055009c0 20 remove_watcher() i=1 2024-09-12T18:08:54.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.561+0000 7f24055009c0 20 remove_watcher() i=2 2024-09-12T18:08:54.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.565+0000 7f24055009c0 20 remove_watcher() i=3 2024-09-12T18:08:54.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.565+0000 7f24055009c0 20 remove_watcher() i=4 2024-09-12T18:08:54.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.565+0000 7f24055009c0 20 remove_watcher() i=5 2024-09-12T18:08:54.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.569+0000 7f24055009c0 20 remove_watcher() i=6 2024-09-12T18:08:54.569 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.569+0000 7f24055009c0 20 remove_watcher() i=7 2024-09-12T18:08:54.625 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:08:54.651 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:54.651 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:54.691 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.689+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.693+0000 7f7c093759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.693+0000 7f7c093759c0 20 realm 2024-09-12T18:08:54.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.693+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.693+0000 7f7c093759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.693+0000 7f7c093759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:54.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.693+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.693+0000 7f7c093759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.693 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.693+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.694 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.693+0000 7f7c093759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:54.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.693+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.697+0000 7f7c093759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:54.695 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.697+0000 7f7c093759c0 20 searching for the correct realm 2024-09-12T18:08:54.701 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.701+0000 7f7c0767c640 0 -- 172.21.15.157:0/3144159442 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55ddb13756f0 msgr2=0x55ddb1377ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.705+0000 7f7c06e7b640 0 -- 172.21.15.157:0/3144159442 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f7bfc0671b0 msgr2=0x7f7bfc065320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:54.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.713+0000 7f7c093759c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:08:54.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.713+0000 7f7c093759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:54.714 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.713+0000 7f7c093759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:54.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.713+0000 7f7c093759c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:08:54.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.713+0000 7f7c093759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:54.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.713+0000 7f7c093759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:54.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.713+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.713+0000 7f7c093759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.713+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 zone default found 2024-09-12T18:08:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 4 Realm: () 2024-09-12T18:08:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:08:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:08:54.716 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:54.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 zonegroup default 2024-09-12T18:08:54.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:54.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 started sync module instance, tier type = 2024-09-12T18:08:54.718 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.717+0000 7f7c093759c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:08:54.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.733+0000 7f7c093759c0 20 add_watcher() i=0 2024-09-12T18:08:54.732 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.733+0000 7f7c093759c0 20 add_watcher() i=1 2024-09-12T18:08:54.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.733+0000 7f7c093759c0 20 add_watcher() i=2 2024-09-12T18:08:54.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.733+0000 7f7c093759c0 20 add_watcher() i=3 2024-09-12T18:08:54.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.733+0000 7f7c093759c0 20 add_watcher() i=4 2024-09-12T18:08:54.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.733+0000 7f7c093759c0 20 add_watcher() i=5 2024-09-12T18:08:54.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.733+0000 7f7c093759c0 20 add_watcher() i=6 2024-09-12T18:08:54.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.733+0000 7f7c093759c0 20 add_watcher() i=7 2024-09-12T18:08:54.733 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.733+0000 7f7c093759c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:54.735 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7abdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:54.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:54.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:54.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 5 note: GC not initialized 2024-09-12T18:08:54.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7abcfe1640 20 reqs_thread_entry: start 2024-09-12T18:08:54.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 20 init_complete bucket index max shards: 1 2024-09-12T18:08:54.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 20 Filter name: none 2024-09-12T18:08:54.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7ab5ffb640 20 reqs_thread_entry: start 2024-09-12T18:08:54.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:54.737 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.738 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:08:54.739 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:08:54.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:08:54.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:08:54.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:08:54.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.737+0000 7f7c093759c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:08:54.740 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.741+0000 7f7abdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:54.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.745+0000 7f7c093759c0 20 remove_watcher() i=0 2024-09-12T18:08:54.744 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.745+0000 7f7c093759c0 2 removed watcher, disabling cache 2024-09-12T18:08:54.746 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.745+0000 7f7c093759c0 20 remove_watcher() i=1 2024-09-12T18:08:54.748 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.749+0000 7f7c093759c0 20 remove_watcher() i=2 2024-09-12T18:08:54.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.749+0000 7f7c093759c0 20 remove_watcher() i=3 2024-09-12T18:08:54.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.753+0000 7f7c093759c0 20 remove_watcher() i=4 2024-09-12T18:08:54.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.753+0000 7f7c093759c0 20 remove_watcher() i=5 2024-09-12T18:08:54.754 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.753+0000 7f7c093759c0 20 remove_watcher() i=6 2024-09-12T18:08:54.756 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:08:54.757+0000 7f7c093759c0 20 remove_watcher() i=7 2024-09-12T18:09:24.782 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T18:09:24.814 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:24.814 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:24.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.856+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 20 realm 2024-09-12T18:09:24.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:24.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:24.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:24.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.860+0000 7f334bca09c0 20 searching for the correct realm 2024-09-12T18:09:24.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.868+0000 7f3349fa7640 0 -- 172.21.15.157:0/1281193259 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x557fa66b97c0 msgr2=0x557fa66bbc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:24.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:24.872+0000 7f33497a6640 0 -- 172.21.15.157:0/1281193259 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f3334054970 msgr2=0x7f33340523e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:25.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.088+0000 7f334bca09c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:25.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.088+0000 7f334bca09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:25.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.088+0000 7f334bca09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:25.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.088+0000 7f334bca09c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:25.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.088+0000 7f334bca09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:25.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.088+0000 7f334bca09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:25.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.088+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.092 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:25.093 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:25.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 zone default found 2024-09-12T18:09:25.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 4 Realm: () 2024-09-12T18:09:25.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:25.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:25.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:25.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 zonegroup default 2024-09-12T18:09:25.094 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.095 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.092+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.096+0000 7f334bca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.096+0000 7f334bca09c0 20 started sync module instance, tier type = 2024-09-12T18:09:25.096 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.096+0000 7f334bca09c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:25.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.116+0000 7f334bca09c0 20 add_watcher() i=0 2024-09-12T18:09:25.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.116+0000 7f334bca09c0 20 add_watcher() i=1 2024-09-12T18:09:25.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.116+0000 7f334bca09c0 20 add_watcher() i=2 2024-09-12T18:09:25.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.116+0000 7f334bca09c0 20 add_watcher() i=3 2024-09-12T18:09:25.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.116+0000 7f334bca09c0 20 add_watcher() i=4 2024-09-12T18:09:25.118 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.116+0000 7f334bca09c0 20 add_watcher() i=5 2024-09-12T18:09:25.119 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.116+0000 7f334bca09c0 20 add_watcher() i=6 2024-09-12T18:09:25.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.120+0000 7f334bca09c0 20 add_watcher() i=7 2024-09-12T18:09:25.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.120+0000 7f334bca09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:25.124 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.124+0000 7f31ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:25.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.124+0000 7f334bca09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:25.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.124+0000 7f334bca09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:25.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.124+0000 7f334bca09c0 5 note: GC not initialized 2024-09-12T18:09:25.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.124+0000 7f31fe7e4640 20 reqs_thread_entry: start 2024-09-12T18:09:25.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.124+0000 7f334bca09c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:25.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.124+0000 7f334bca09c0 20 Filter name: none 2024-09-12T18:09:25.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.124+0000 7f316ffff640 20 reqs_thread_entry: start 2024-09-12T18:09:25.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.124+0000 7f334bca09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:09:25.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.124+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.127 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.128+0000 7f334bca09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:25.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.128+0000 7f334bca09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:09:25.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.128+0000 7f334bca09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:09:25.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.128+0000 7f334bca09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:09:25.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.128+0000 7f334bca09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.128+0000 7f334bca09c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:25.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.128+0000 7f334bca09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:09:25.128 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.128+0000 7f334bca09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:09:25.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.128+0000 7f334bca09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:25.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.128+0000 7f334bca09c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:25.129 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.128+0000 7f334bca09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:09:25.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.132+0000 7f31ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:25.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.140+0000 7f334bca09c0 20 remove_watcher() i=0 2024-09-12T18:09:25.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.140+0000 7f334bca09c0 2 removed watcher, disabling cache 2024-09-12T18:09:25.142 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.140+0000 7f334bca09c0 20 remove_watcher() i=1 2024-09-12T18:09:25.144 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.144+0000 7f334bca09c0 20 remove_watcher() i=2 2024-09-12T18:09:25.146 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.144+0000 7f334bca09c0 20 remove_watcher() i=3 2024-09-12T18:09:25.148 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.148+0000 7f334bca09c0 20 remove_watcher() i=4 2024-09-12T18:09:25.150 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.148+0000 7f334bca09c0 20 remove_watcher() i=5 2024-09-12T18:09:25.151 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.148+0000 7f334bca09c0 20 remove_watcher() i=6 2024-09-12T18:09:25.152 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.152+0000 7f334bca09c0 20 remove_watcher() i=7 2024-09-12T18:09:25.169 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:09:25.196 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:25.196 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:25.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.240+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.240+0000 7f0032e0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.240+0000 7f0032e0b9c0 20 realm 2024-09-12T18:09:25.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.240+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.240+0000 7f0032e0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.241 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.240+0000 7f0032e0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:25.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.240+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.240+0000 7f0032e0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.242 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.240+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.240+0000 7f0032e0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:25.243 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.240+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.244+0000 7f0032e0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:25.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.244+0000 7f0032e0b9c0 20 searching for the correct realm 2024-09-12T18:09:25.250 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.248+0000 7f0031112640 0 -- 172.21.15.157:0/358551367 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f001c01cc00 msgr2=0x7f001c0911d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:25.466 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.464+0000 7f0030911640 0 -- 172.21.15.157:0/358551367 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x557fe270b470 msgr2=0x557fe270d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:25.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.472+0000 7f0032e0b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:25.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.472+0000 7f0032e0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:25.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.472+0000 7f0032e0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:25.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.472+0000 7f0032e0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:25.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.472+0000 7f0032e0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:25.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.472+0000 7f0032e0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:25.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.472+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.474 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.472+0000 7f0032e0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.472+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.472+0000 7f0032e0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:25.475 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.472+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:25.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 20 zone default found 2024-09-12T18:09:25.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 4 Realm: () 2024-09-12T18:09:25.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:25.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:25.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:25.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 20 zonegroup default 2024-09-12T18:09:25.476 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.477 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 20 started sync module instance, tier type = 2024-09-12T18:09:25.478 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.476+0000 7f0032e0b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:25.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.500+0000 7f0032e0b9c0 20 add_watcher() i=0 2024-09-12T18:09:25.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.500+0000 7f0032e0b9c0 20 add_watcher() i=1 2024-09-12T18:09:25.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.500+0000 7f0032e0b9c0 20 add_watcher() i=2 2024-09-12T18:09:25.501 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.500+0000 7f0032e0b9c0 20 add_watcher() i=3 2024-09-12T18:09:25.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.500+0000 7f0032e0b9c0 20 add_watcher() i=4 2024-09-12T18:09:25.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.500+0000 7f0032e0b9c0 20 add_watcher() i=5 2024-09-12T18:09:25.502 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.500+0000 7f0032e0b9c0 20 add_watcher() i=6 2024-09-12T18:09:25.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.504+0000 7f0032e0b9c0 20 add_watcher() i=7 2024-09-12T18:09:25.504 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.504+0000 7f0032e0b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:25.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7efee6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:25.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:25.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:25.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 5 note: GC not initialized 2024-09-12T18:09:25.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7efee5fe3640 20 reqs_thread_entry: start 2024-09-12T18:09:25.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:25.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 20 Filter name: none 2024-09-12T18:09:25.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7efe577fe640 20 reqs_thread_entry: start 2024-09-12T18:09:25.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:09:25.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:25.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:09:25.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:09:25.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:09:25.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.508+0000 7f0032e0b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:25.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:09:25.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:09:25.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:25.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:25.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:09:25.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:09:25.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:09:25.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:09:25.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:09:25.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:09:25.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.512+0000 7f0032e0b9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:09:25.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.516+0000 7efee6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:25.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.520+0000 7f0032e0b9c0 20 remove_watcher() i=0 2024-09-12T18:09:25.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.520+0000 7f0032e0b9c0 2 removed watcher, disabling cache 2024-09-12T18:09:25.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.520+0000 7f0032e0b9c0 20 remove_watcher() i=1 2024-09-12T18:09:25.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.524+0000 7f0032e0b9c0 20 remove_watcher() i=2 2024-09-12T18:09:25.527 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.528+0000 7f0032e0b9c0 20 remove_watcher() i=3 2024-09-12T18:09:25.529 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.528+0000 7f0032e0b9c0 20 remove_watcher() i=4 2024-09-12T18:09:25.531 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.532+0000 7f0032e0b9c0 20 remove_watcher() i=5 2024-09-12T18:09:25.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.532+0000 7f0032e0b9c0 20 remove_watcher() i=6 2024-09-12T18:09:25.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.532+0000 7f0032e0b9c0 20 remove_watcher() i=7 2024-09-12T18:09:25.549 INFO:tasks.workunit.client.0.smithi157.stderr:check reshard logrecord successfully 2024-09-12T18:09:25.549 INFO:tasks.workunit.client.0.smithi157.stderr: test: reshard versioned bucket 2024-09-12T18:09:25.550 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:09:25.578 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:25.578 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:25.621 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.620+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.620+0000 7f45aaac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.623 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.620+0000 7f45aaac29c0 20 realm 2024-09-12T18:09:25.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.620+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.624+0000 7f45aaac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.624+0000 7f45aaac29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:25.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.624+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.624+0000 7f45aaac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.624+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.624+0000 7f45aaac29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:25.625 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.624+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.624+0000 7f45aaac29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:25.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.624+0000 7f45aaac29c0 20 searching for the correct realm 2024-09-12T18:09:25.630 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.628+0000 7f45a85c8640 0 -- 172.21.15.157:0/2409749411 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f45a00666c0 msgr2=0x7f45a005c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:25.637 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.636+0000 7f45a85c8640 0 -- 172.21.15.157:0/2409749411 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f4598088050 msgr2=0x7f459806c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:25.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.852+0000 7f45aaac29c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:25.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.852+0000 7f45aaac29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:25.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.852+0000 7f45aaac29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:25.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.852+0000 7f45aaac29c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:25.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.852+0000 7f45aaac29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:25.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.852+0000 7f45aaac29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:25.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.852+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.852+0000 7f45aaac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.852+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:25.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:25.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 zone default found 2024-09-12T18:09:25.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 4 Realm: () 2024-09-12T18:09:25.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:25.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:25.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:25.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 zonegroup default 2024-09-12T18:09:25.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:25.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 started sync module instance, tier type = 2024-09-12T18:09:25.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.856+0000 7f45aaac29c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:25.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.880+0000 7f45aaac29c0 20 add_watcher() i=0 2024-09-12T18:09:25.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.880+0000 7f45aaac29c0 20 add_watcher() i=1 2024-09-12T18:09:25.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.880+0000 7f45aaac29c0 20 add_watcher() i=2 2024-09-12T18:09:25.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.880+0000 7f45aaac29c0 20 add_watcher() i=3 2024-09-12T18:09:25.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.880+0000 7f45aaac29c0 20 add_watcher() i=4 2024-09-12T18:09:25.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.880+0000 7f45aaac29c0 20 add_watcher() i=5 2024-09-12T18:09:25.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.880+0000 7f45aaac29c0 20 add_watcher() i=6 2024-09-12T18:09:25.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.884+0000 7f45aaac29c0 20 add_watcher() i=7 2024-09-12T18:09:25.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.884+0000 7f45aaac29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:25.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.888+0000 7f445efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:25.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.888+0000 7f45aaac29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:25.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.888+0000 7f45aaac29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:25.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.888+0000 7f45aaac29c0 5 note: GC not initialized 2024-09-12T18:09:25.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.888+0000 7f445dfdb640 20 reqs_thread_entry: start 2024-09-12T18:09:25.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.888+0000 7f45aaac29c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:25.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.888+0000 7f45aaac29c0 20 Filter name: none 2024-09-12T18:09:25.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.888+0000 7f43cf7fe640 20 reqs_thread_entry: start 2024-09-12T18:09:25.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.892+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.892+0000 7f45aaac29c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:25.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.892+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.892+0000 7f45aaac29c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:25.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.892+0000 7f45aaac29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:25.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.892+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.892+0000 7f45aaac29c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:25.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.892+0000 7f45aaac29c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:25.895 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.892+0000 7f45aaac29c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:25.895 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.892+0000 7f45aaac29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:25.898 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.896+0000 7f445efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:25.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.904+0000 7f45aaac29c0 20 remove_watcher() i=0 2024-09-12T18:09:25.904 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.904+0000 7f45aaac29c0 2 removed watcher, disabling cache 2024-09-12T18:09:25.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.904+0000 7f45aaac29c0 20 remove_watcher() i=1 2024-09-12T18:09:25.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.908+0000 7f45aaac29c0 20 remove_watcher() i=2 2024-09-12T18:09:25.910 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.908+0000 7f45aaac29c0 20 remove_watcher() i=3 2024-09-12T18:09:25.912 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.912+0000 7f45aaac29c0 20 remove_watcher() i=4 2024-09-12T18:09:25.914 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.912+0000 7f45aaac29c0 20 remove_watcher() i=5 2024-09-12T18:09:25.916 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.916+0000 7f45aaac29c0 20 remove_watcher() i=6 2024-09-12T18:09:25.917 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:25.916+0000 7f45aaac29c0 20 remove_watcher() i=7 2024-09-12T18:09:25.934 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:09:25.934 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:09:25.934 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: myver id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T18:09:25.934 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:09:25.935 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-12T18:09:25.968 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:25.968 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:26.212 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.212+0000 7fbeae5bb640 0 --2- 172.21.15.157:0/3764821290 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ad6d19edf0 0x55ad6d1a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:09:26.222 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.220+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 20 realm 2024-09-12T18:09:26.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.224 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:26.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.225 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:26.226 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:26.227 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.224+0000 7fbeb0ab59c0 20 searching for the correct realm 2024-09-12T18:09:26.228 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.228+0000 7fbeaedbc640 0 -- 172.21.15.157:0/3752696475 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x55ad6d1ca830 msgr2=0x55ad6d1cccf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:26.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.232+0000 7fbeaedbc640 0 -- 172.21.15.157:0/3752696475 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fbea40d0040 msgr2=0x7fbea40f6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:26.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.456+0000 7fbeb0ab59c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:26.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.456+0000 7fbeb0ab59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:26.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.456+0000 7fbeb0ab59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:26.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.456+0000 7fbeb0ab59c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:26.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.456+0000 7fbeb0ab59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:26.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.456+0000 7fbeb0ab59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:26.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.456+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.456+0000 7fbeb0ab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.456+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:26.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:26.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 20 zone default found 2024-09-12T18:09:26.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 4 Realm: () 2024-09-12T18:09:26.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:26.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:26.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:26.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 20 zonegroup default 2024-09-12T18:09:26.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.460+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.464+0000 7fbeb0ab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.464+0000 7fbeb0ab59c0 20 started sync module instance, tier type = 2024-09-12T18:09:26.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.464+0000 7fbeb0ab59c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:26.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.484+0000 7fbeb0ab59c0 20 add_watcher() i=0 2024-09-12T18:09:26.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.484+0000 7fbeb0ab59c0 20 add_watcher() i=1 2024-09-12T18:09:26.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.484+0000 7fbeb0ab59c0 20 add_watcher() i=2 2024-09-12T18:09:26.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.484+0000 7fbeb0ab59c0 20 add_watcher() i=3 2024-09-12T18:09:26.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.484+0000 7fbeb0ab59c0 20 add_watcher() i=4 2024-09-12T18:09:26.486 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.484+0000 7fbeb0ab59c0 20 add_watcher() i=5 2024-09-12T18:09:26.487 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.484+0000 7fbeb0ab59c0 20 add_watcher() i=6 2024-09-12T18:09:26.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.488+0000 7fbeb0ab59c0 20 add_watcher() i=7 2024-09-12T18:09:26.488 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.488+0000 7fbeb0ab59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:26.492 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.492+0000 7fbd657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:26.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.492+0000 7fbeb0ab59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:26.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.492+0000 7fbeb0ab59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:26.493 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.492+0000 7fbeb0ab59c0 5 note: GC not initialized 2024-09-12T18:09:26.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.492+0000 7fbd5f7fe640 20 reqs_thread_entry: start 2024-09-12T18:09:26.494 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.492+0000 7fbeb0ab59c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:26.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.492+0000 7fbeb0ab59c0 20 Filter name: none 2024-09-12T18:09:26.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.492+0000 7fbd5d7fa640 20 reqs_thread_entry: start 2024-09-12T18:09:26.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.492+0000 7fbeb0ab59c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:09:26.495 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.492+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.496+0000 7fbeb0ab59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:26.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.496+0000 7fbeb0ab59c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:09:26.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.496+0000 7fbeb0ab59c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:09:26.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.496+0000 7fbeb0ab59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 : miss 2024-09-12T18:09:26.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.496+0000 7fbeb0ab59c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.496 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.496+0000 7fbeb0ab59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:26.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.496+0000 7fbeb0ab59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:26.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.496+0000 7fbeb0ab59c0 10 adding default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:26.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.496+0000 7fbeb0ab59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:26.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.496+0000 7fbeb0ab59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:26.497 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.496+0000 7fbeb0ab59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 2024-09-12T18:09:26.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.504+0000 7fbeb0ab59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:26.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.504+0000 7fbeb0ab59c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:26.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.504+0000 7fbeb0ab59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:26.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.504+0000 7fbeb0ab59c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18, ofs0, ns] 2024-09-12T18:09:26.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.504+0000 7fbd91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464303 cookie 94203348316560 notifier 8523 bl.length()=821 2024-09-12T18:09:26.507 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.504+0000 7fbd91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:26.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.504+0000 7fbd91ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:26.508 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.504+0000 7fbd91ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:26.510 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.508+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_sources= new_sources= 2024-09-12T18:09:26.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.508+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential sources added=[] removed=[] 2024-09-12T18:09:26.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.508+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_dests= new_dests= 2024-09-12T18:09:26.511 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.508+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential dests added=[] removed=[] 2024-09-12T18:09:26.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.516+0000 7fbeb0ab59c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.0 2024-09-12T18:09:26.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.516+0000 7fbeb0ab59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.0 2024-09-12T18:09:26.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.516+0000 7fbeb0ab59c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.1 2024-09-12T18:09:26.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.516+0000 7fbeb0ab59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.1 2024-09-12T18:09:26.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.516+0000 7fbeb0ab59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.0 2024-09-12T18:09:26.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.516+0000 7fbeb0ab59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:26.518 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.516+0000 7fbeb0ab59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 2024-09-12T18:09:26.521 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.520+0000 7fbeb0ab59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:26.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.520+0000 7fbeb0ab59c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:26.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.520+0000 7fbeb0ab59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:26.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.520+0000 7fbeb0ab59c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18, ofs0, ns] 2024-09-12T18:09:26.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.520+0000 7fbd91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94203348316560 notifier 8523 bl.length()=821 2024-09-12T18:09:26.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.520+0000 7fbd91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:26.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.520+0000 7fbd91ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:26.522 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.520+0000 7fbd91ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:26.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.524+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_sources= new_sources= 2024-09-12T18:09:26.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.524+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential sources added=[] removed=[] 2024-09-12T18:09:26.525 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.524+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_dests= new_dests= 2024-09-12T18:09:26.526 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.524+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential dests added=[] removed=[] 2024-09-12T18:09:26.528 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.528+0000 7fbeb0ab59c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.0 2024-09-12T18:09:26.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.528+0000 7fbeb0ab59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:26.530 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.528+0000 7fbeb0ab59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 2024-09-12T18:09:26.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.532+0000 7fbeb0ab59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:26.533 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.532+0000 7fbeb0ab59c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:26.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.532+0000 7fbeb0ab59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:26.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.532+0000 7fbeb0ab59c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18, ofs0, ns] 2024-09-12T18:09:26.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.532+0000 7fbd91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464305 cookie 94203348316560 notifier 8523 bl.length()=789 2024-09-12T18:09:26.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.532+0000 7fbd91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:26.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.532+0000 7fbd91ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:26.534 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.532+0000 7fbd91ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:26.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.536+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_sources= new_sources= 2024-09-12T18:09:26.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.536+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential sources added=[] removed=[] 2024-09-12T18:09:26.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.536+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_dests= new_dests= 2024-09-12T18:09:26.536 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.536+0000 7fbeb0ab59c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential dests added=[] removed=[] 2024-09-12T18:09:26.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.540+0000 7fbeb0ab59c0 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-12T18:09:26.544 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.544+0000 7fbd657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:26.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.548+0000 7fbeb0ab59c0 20 remove_watcher() i=0 2024-09-12T18:09:26.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.548+0000 7fbeb0ab59c0 2 removed watcher, disabling cache 2024-09-12T18:09:26.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.548+0000 7fbeb0ab59c0 20 remove_watcher() i=1 2024-09-12T18:09:26.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.552+0000 7fbeb0ab59c0 20 remove_watcher() i=2 2024-09-12T18:09:26.556 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.556+0000 7fbeb0ab59c0 20 remove_watcher() i=3 2024-09-12T18:09:26.558 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.556+0000 7fbeb0ab59c0 20 remove_watcher() i=4 2024-09-12T18:09:26.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.560+0000 7fbeb0ab59c0 20 remove_watcher() i=5 2024-09-12T18:09:26.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.560+0000 7fbeb0ab59c0 20 remove_watcher() i=6 2024-09-12T18:09:26.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.560+0000 7fbeb0ab59c0 20 remove_watcher() i=7 2024-09-12T18:09:26.580 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:09:26.611 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:26.611 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:26.655 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.656+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.656+0000 7f373631b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.656+0000 7f373631b9c0 20 realm 2024-09-12T18:09:26.657 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.656+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.656+0000 7f373631b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.656+0000 7f373631b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:26.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.656+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.656+0000 7f373631b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.658 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.656+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.659 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.660+0000 7f373631b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:26.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.660+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.660 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.660+0000 7f373631b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:26.661 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.660+0000 7f373631b9c0 20 searching for the correct realm 2024-09-12T18:09:26.666 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.664+0000 7f3734622640 0 -- 172.21.15.157:0/2103213532 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55874de81640 msgr2=0x55874de83a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:26.671 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.672+0000 7f3733e21640 0 -- 172.21.15.157:0/2103213532 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f37280adbe0 msgr2=0x7f37281019a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:26.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:26.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:26.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:26.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:26.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:26.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:26.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.680 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:26.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.681 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:26.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 zone default found 2024-09-12T18:09:26.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 4 Realm: () 2024-09-12T18:09:26.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:26.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:26.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:26.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 zonegroup default 2024-09-12T18:09:26.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.682 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:26.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 started sync module instance, tier type = 2024-09-12T18:09:26.683 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.680+0000 7f373631b9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:26.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.696+0000 7f373631b9c0 20 add_watcher() i=0 2024-09-12T18:09:26.698 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.696+0000 7f373631b9c0 20 add_watcher() i=1 2024-09-12T18:09:26.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.696+0000 7f373631b9c0 20 add_watcher() i=2 2024-09-12T18:09:26.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.696+0000 7f373631b9c0 20 add_watcher() i=3 2024-09-12T18:09:26.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.696+0000 7f373631b9c0 20 add_watcher() i=4 2024-09-12T18:09:26.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.696+0000 7f373631b9c0 20 add_watcher() i=5 2024-09-12T18:09:26.699 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.696+0000 7f373631b9c0 20 add_watcher() i=6 2024-09-12T18:09:26.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.700+0000 7f373631b9c0 20 add_watcher() i=7 2024-09-12T18:09:26.700 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.700+0000 7f373631b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:26.702 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.700+0000 7f35e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:26.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.700+0000 7f373631b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:26.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.700+0000 7f373631b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:26.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.700+0000 7f373631b9c0 5 note: GC not initialized 2024-09-12T18:09:26.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.700+0000 7f35e8fe1640 20 reqs_thread_entry: start 2024-09-12T18:09:26.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.700+0000 7f373631b9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:26.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.700+0000 7f373631b9c0 20 Filter name: none 2024-09-12T18:09:26.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.700+0000 7f35627fc640 20 reqs_thread_entry: start 2024-09-12T18:09:26.703 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.700+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.704+0000 7f373631b9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:26.704 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.704+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.704+0000 7f373631b9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:26.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.704+0000 7f373631b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:26.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.704+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.704+0000 7f373631b9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:26.705 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.704+0000 7f373631b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:26.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.704+0000 7f373631b9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:26.706 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.704+0000 7f373631b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:26.707 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.708+0000 7f35e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:26.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.712+0000 7f373631b9c0 20 remove_watcher() i=0 2024-09-12T18:09:26.713 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.712+0000 7f373631b9c0 2 removed watcher, disabling cache 2024-09-12T18:09:26.715 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.712+0000 7f373631b9c0 20 remove_watcher() i=1 2024-09-12T18:09:26.717 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.716+0000 7f373631b9c0 20 remove_watcher() i=2 2024-09-12T18:09:26.719 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.716+0000 7f373631b9c0 20 remove_watcher() i=3 2024-09-12T18:09:26.721 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.720+0000 7f373631b9c0 20 remove_watcher() i=4 2024-09-12T18:09:26.722 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.720+0000 7f373631b9c0 20 remove_watcher() i=5 2024-09-12T18:09:26.723 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.724+0000 7f373631b9c0 20 remove_watcher() i=6 2024-09-12T18:09:26.724 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:26.724+0000 7f373631b9c0 20 remove_watcher() i=7 2024-09-12T18:09:26.738 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:09:26.738 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:09:26.738 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: myver id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T18:09:26.738 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:09:26.816 INFO:tasks.workunit.client.0.smithi157.stderr: test: reshard removes olh entries with empty name 2024-09-12T18:09:27.513 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:09:27.545 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:27.545 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:27.588 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.588+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.588+0000 7f41ebd679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:27.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.588+0000 7f41ebd679c0 20 realm 2024-09-12T18:09:27.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.588+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.588+0000 7f41ebd679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:27.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.588+0000 7f41ebd679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:27.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.588+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.588+0000 7f41ebd679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:27.591 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.588+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.593 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.592+0000 7f41ebd679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:27.593 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.592+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.592+0000 7f41ebd679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:27.594 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.592+0000 7f41ebd679c0 20 searching for the correct realm 2024-09-12T18:09:27.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.600+0000 7f41ea06e640 0 -- 172.21.15.157:0/1124306140 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f41e0008040 msgr2=0x7f41e00519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:27.818 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.816+0000 7f41e986d640 0 -- 172.21.15.157:0/1124306140 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5624c56857e0 msgr2=0x5624c5687ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:27.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.824+0000 7f41ebd679c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:27.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.824+0000 7f41ebd679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:27.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.824+0000 7f41ebd679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:27.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.824+0000 7f41ebd679c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:27.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.824+0000 7f41ebd679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:27.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.824+0000 7f41ebd679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:27.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.824+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.824+0000 7f41ebd679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:27.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.824+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.824+0000 7f41ebd679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:27.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.824+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:27.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 20 zone default found 2024-09-12T18:09:27.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 4 Realm: () 2024-09-12T18:09:27.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:27.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:27.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:27.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 20 zonegroup default 2024-09-12T18:09:27.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:27.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:27.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:27.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 20 started sync module instance, tier type = 2024-09-12T18:09:27.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.828+0000 7f41ebd679c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:27.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.848+0000 7f41ebd679c0 20 add_watcher() i=0 2024-09-12T18:09:27.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.848+0000 7f41ebd679c0 20 add_watcher() i=1 2024-09-12T18:09:27.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.848+0000 7f41ebd679c0 20 add_watcher() i=2 2024-09-12T18:09:27.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.848+0000 7f41ebd679c0 20 add_watcher() i=3 2024-09-12T18:09:27.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.848+0000 7f41ebd679c0 20 add_watcher() i=4 2024-09-12T18:09:27.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.848+0000 7f41ebd679c0 20 add_watcher() i=5 2024-09-12T18:09:27.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.848+0000 7f41ebd679c0 20 add_watcher() i=6 2024-09-12T18:09:27.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.852+0000 7f41ebd679c0 20 add_watcher() i=7 2024-09-12T18:09:27.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.852+0000 7f41ebd679c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:27.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.856+0000 7f409ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:27.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.856+0000 7f41ebd679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:27.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.856+0000 7f41ebd679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:27.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.856+0000 7f41ebd679c0 5 note: GC not initialized 2024-09-12T18:09:27.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.856+0000 7f409efe5640 20 reqs_thread_entry: start 2024-09-12T18:09:27.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.856+0000 7f41ebd679c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:27.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.856+0000 7f41ebd679c0 20 Filter name: none 2024-09-12T18:09:27.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.856+0000 7f409cfe1640 20 reqs_thread_entry: start 2024-09-12T18:09:27.858 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.856+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.856+0000 7f41ebd679c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:27.859 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.856+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.860+0000 7f41ebd679c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:27.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.860+0000 7f41ebd679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:27.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.860+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.860+0000 7f41ebd679c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:27.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.860+0000 7f41ebd679c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.860+0000 7f41ebd679c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:27.862 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.860+0000 7f41ebd679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:27.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.864+0000 7f409ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:27.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.868+0000 7f41ebd679c0 20 remove_watcher() i=0 2024-09-12T18:09:27.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.868+0000 7f41ebd679c0 2 removed watcher, disabling cache 2024-09-12T18:09:27.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.868+0000 7f41ebd679c0 20 remove_watcher() i=1 2024-09-12T18:09:27.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.872+0000 7f41ebd679c0 20 remove_watcher() i=2 2024-09-12T18:09:27.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.872+0000 7f41ebd679c0 20 remove_watcher() i=3 2024-09-12T18:09:27.877 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.876+0000 7f41ebd679c0 20 remove_watcher() i=4 2024-09-12T18:09:27.878 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.876+0000 7f41ebd679c0 20 remove_watcher() i=5 2024-09-12T18:09:27.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.880+0000 7f41ebd679c0 20 remove_watcher() i=6 2024-09-12T18:09:27.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.880+0000 7f41ebd679c0 20 remove_watcher() i=7 2024-09-12T18:09:27.897 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:09:27.897 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:09:27.897 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: a-bucket id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-12T18:09:27.897 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:09:27.898 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T18:09:27.925 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:27.925 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:27.970 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.968+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:27.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 20 realm 2024-09-12T18:09:27.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:27.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:27.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:27.972 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:27.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:27.974 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:27.975 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.972+0000 7f9370f609c0 20 searching for the correct realm 2024-09-12T18:09:27.978 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:27.976+0000 7f9366265640 0 -- 172.21.15.157:0/3294689195 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f9358019070 msgr2=0x7f935805b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:28.193 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.192+0000 7f936ea66640 0 -- 172.21.15.157:0/3294689195 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f935805ca70 msgr2=0x7f93580810d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:28.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.408+0000 7f9370f609c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:28.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.408+0000 7f9370f609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:28.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.408+0000 7f9370f609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:28.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.408+0000 7f9370f609c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:28.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.408+0000 7f9370f609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:28.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.408+0000 7f9370f609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:28.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.408+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.408+0000 7f9370f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.408+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:28.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:28.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 zone default found 2024-09-12T18:09:28.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 4 Realm: () 2024-09-12T18:09:28.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:28.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:28.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:28.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 zonegroup default 2024-09-12T18:09:28.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.414 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 started sync module instance, tier type = 2024-09-12T18:09:28.415 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.412+0000 7f9370f609c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:28.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.436+0000 7f9370f609c0 20 add_watcher() i=0 2024-09-12T18:09:28.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.436+0000 7f9370f609c0 20 add_watcher() i=1 2024-09-12T18:09:28.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.436+0000 7f9370f609c0 20 add_watcher() i=2 2024-09-12T18:09:28.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.436+0000 7f9370f609c0 20 add_watcher() i=3 2024-09-12T18:09:28.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.436+0000 7f9370f609c0 20 add_watcher() i=4 2024-09-12T18:09:28.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.436+0000 7f9370f609c0 20 add_watcher() i=5 2024-09-12T18:09:28.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.436+0000 7f9370f609c0 20 add_watcher() i=6 2024-09-12T18:09:28.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.440+0000 7f9370f609c0 20 add_watcher() i=7 2024-09-12T18:09:28.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.440+0000 7f9370f609c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:28.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.444+0000 7f92257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:28.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.444+0000 7f9370f609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:28.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.444+0000 7f9370f609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:28.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.444+0000 7f9370f609c0 5 note: GC not initialized 2024-09-12T18:09:28.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.444+0000 7f919ffff640 20 reqs_thread_entry: start 2024-09-12T18:09:28.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.444+0000 7f9370f609c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:28.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.444+0000 7f9370f609c0 20 Filter name: none 2024-09-12T18:09:28.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.448+0000 7f919dffb640 20 reqs_thread_entry: start 2024-09-12T18:09:28.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.448+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.448+0000 7f9370f609c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:28.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.448+0000 7f9370f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.448+0000 7f9370f609c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:28.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.448+0000 7f9370f609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:28.450 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.448+0000 7f92257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:28.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.456+0000 7f9370f609c0 20 remove_watcher() i=0 2024-09-12T18:09:28.455 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.456+0000 7f9370f609c0 2 removed watcher, disabling cache 2024-09-12T18:09:28.457 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.456+0000 7f9370f609c0 20 remove_watcher() i=1 2024-09-12T18:09:28.459 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.460+0000 7f9370f609c0 20 remove_watcher() i=2 2024-09-12T18:09:28.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.460+0000 7f9370f609c0 20 remove_watcher() i=3 2024-09-12T18:09:28.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.464+0000 7f9370f609c0 20 remove_watcher() i=4 2024-09-12T18:09:28.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.464+0000 7f9370f609c0 20 remove_watcher() i=5 2024-09-12T18:09:28.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.464+0000 7f9370f609c0 20 remove_watcher() i=6 2024-09-12T18:09:28.468 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.468+0000 7f9370f609c0 20 remove_watcher() i=7 2024-09-12T18:09:28.483 INFO:tasks.workunit.client.0.smithi157.stderr:rados -p default.rgw.buckets.index setomapval .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T18:09:28.509 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:28.510 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:28.529 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T18:09:28.554 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:28.555 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:28.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.596+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.596+0000 7f279e5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.596+0000 7f279e5769c0 20 realm 2024-09-12T18:09:28.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.596+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.596+0000 7f279e5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.596+0000 7f279e5769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:28.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.596+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.596+0000 7f279e5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.596+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.600+0000 7f279e5769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:28.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.600+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.600+0000 7f279e5769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:28.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.600+0000 7f279e5769c0 20 searching for the correct realm 2024-09-12T18:09:28.609 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.608+0000 7f279c87d640 0 -- 172.21.15.157:0/2746807662 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f279006b7d0 msgr2=0x7f2790060da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:28.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.824+0000 7f279c07c640 0 -- 172.21.15.157:0/2746807662 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55db84668890 msgr2=0x55db8466ac80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:28.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.832+0000 7f279e5769c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:28.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.832+0000 7f279e5769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:28.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.832+0000 7f279e5769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:28.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.832+0000 7f279e5769c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:28.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.832+0000 7f279e5769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:28.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.832+0000 7f279e5769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:28.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.832+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.832+0000 7f279e5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.832+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.832+0000 7f279e5769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:28.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.832+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:28.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 20 zone default found 2024-09-12T18:09:28.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 4 Realm: () 2024-09-12T18:09:28.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:28.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:28.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:28.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 20 zonegroup default 2024-09-12T18:09:28.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 20 started sync module instance, tier type = 2024-09-12T18:09:28.838 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.836+0000 7f279e5769c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:28.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.860+0000 7f279e5769c0 20 add_watcher() i=0 2024-09-12T18:09:28.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.860+0000 7f279e5769c0 20 add_watcher() i=1 2024-09-12T18:09:28.860 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.860+0000 7f279e5769c0 20 add_watcher() i=2 2024-09-12T18:09:28.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.860+0000 7f279e5769c0 20 add_watcher() i=3 2024-09-12T18:09:28.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.860+0000 7f279e5769c0 20 add_watcher() i=4 2024-09-12T18:09:28.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.860+0000 7f279e5769c0 20 add_watcher() i=5 2024-09-12T18:09:28.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.860+0000 7f279e5769c0 20 add_watcher() i=6 2024-09-12T18:09:28.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.860+0000 7f279e5769c0 20 add_watcher() i=7 2024-09-12T18:09:28.863 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.860+0000 7f279e5769c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:28.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.864+0000 7f26527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:28.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:28.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:28.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 5 note: GC not initialized 2024-09-12T18:09:28.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f26517e2640 20 reqs_thread_entry: start 2024-09-12T18:09:28.868 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:28.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 Filter name: none 2024-09-12T18:09:28.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f25c2ffd640 20 reqs_thread_entry: start 2024-09-12T18:09:28.869 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:28.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:28.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:28.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T18:09:28.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 INFO: main: starting shard=0 2024-09-12T18:09:28.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:09:28.871 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.868+0000 7f279e5769c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:09:28.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.872+0000 7f279e5769c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:09:28.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.872+0000 7f279e5769c0 20 INFO: main: starting shard=1 2024-09-12T18:09:28.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.872+0000 7f279e5769c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:09:28.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.872+0000 7f279e5769c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:09:28.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.872+0000 7f279e5769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:28.872 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.872+0000 7f279e5769c0 20 INFO: main: starting shard=2 2024-09-12T18:09:28.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.872+0000 7f279e5769c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:09:28.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.872+0000 7f279e5769c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:09:28.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.872+0000 7f279e5769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:28.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.872+0000 7f279e5769c0 20 INFO: main: done 2024-09-12T18:09:28.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.872+0000 7f26527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:28.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.880+0000 7f279e5769c0 20 remove_watcher() i=0 2024-09-12T18:09:28.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.880+0000 7f279e5769c0 2 removed watcher, disabling cache 2024-09-12T18:09:28.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.880+0000 7f279e5769c0 20 remove_watcher() i=1 2024-09-12T18:09:28.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.884+0000 7f279e5769c0 20 remove_watcher() i=2 2024-09-12T18:09:28.887 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.888+0000 7f279e5769c0 20 remove_watcher() i=3 2024-09-12T18:09:28.890 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.888+0000 7f279e5769c0 20 remove_watcher() i=4 2024-09-12T18:09:28.891 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.892+0000 7f279e5769c0 20 remove_watcher() i=5 2024-09-12T18:09:28.892 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.892+0000 7f279e5769c0 20 remove_watcher() i=6 2024-09-12T18:09:28.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.892+0000 7f279e5769c0 20 remove_watcher() i=7 2024-09-12T18:09:28.911 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T18:09:28.947 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:28.947 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:28.990 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.988+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.988+0000 7f017d8249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.991 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.988+0000 7f017d8249c0 20 realm 2024-09-12T18:09:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.988+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.992+0000 7f017d8249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.992+0000 7f017d8249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.992+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.992+0000 7f017d8249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:28.992 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.992+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.992+0000 7f017d8249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:28.993 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.992+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:28.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.992+0000 7f017d8249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:28.994 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:28.992+0000 7f017d8249c0 20 searching for the correct realm 2024-09-12T18:09:29.000 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.000+0000 7f017ab29640 0 -- 172.21.15.157:0/950879496 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f017001a040 msgr2=0x7f017002f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:29.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.004+0000 7f017bb2b640 0 -- 172.21.15.157:0/950879496 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f0170047400 msgr2=0x7f0170047860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:29.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:29.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:29.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:29.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:29.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:29.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:29.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.015 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 zone default found 2024-09-12T18:09:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 4 Realm: () 2024-09-12T18:09:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 zonegroup default 2024-09-12T18:09:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.012+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.016+0000 7f017d8249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.016 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.016+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.016+0000 7f017d8249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.016+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.016+0000 7f017d8249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.016+0000 7f017d8249c0 20 started sync module instance, tier type = 2024-09-12T18:09:29.017 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.016+0000 7f017d8249c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:29.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.028+0000 7f017d8249c0 20 add_watcher() i=0 2024-09-12T18:09:29.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.032+0000 7f017d8249c0 20 add_watcher() i=1 2024-09-12T18:09:29.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.032+0000 7f017d8249c0 20 add_watcher() i=2 2024-09-12T18:09:29.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.032+0000 7f017d8249c0 20 add_watcher() i=3 2024-09-12T18:09:29.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.032+0000 7f017d8249c0 20 add_watcher() i=4 2024-09-12T18:09:29.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.032+0000 7f017d8249c0 20 add_watcher() i=5 2024-09-12T18:09:29.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.032+0000 7f017d8249c0 20 add_watcher() i=6 2024-09-12T18:09:29.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.032+0000 7f017d8249c0 20 add_watcher() i=7 2024-09-12T18:09:29.032 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.032+0000 7f017d8249c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:29.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.032+0000 7f00327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:29.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.032+0000 7f017d8249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:29.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.032+0000 7f017d8249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:29.035 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 5 note: GC not initialized 2024-09-12T18:09:29.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f00317e2640 20 reqs_thread_entry: start 2024-09-12T18:09:29.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:29.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 20 Filter name: none 2024-09-12T18:09:29.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f002a7fc640 20 reqs_thread_entry: start 2024-09-12T18:09:29.036 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:09:29.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:29.037 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:09:29.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:09:29.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : miss 2024-09-12T18:09:29.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:29.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:09:29.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:09:29.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:29.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:29.038 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.036+0000 7f017d8249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:09:29.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.044+0000 7f017d8249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:09:29.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.044+0000 7f017d8249c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:09:29.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.044+0000 7f017d8249c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:29.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.044+0000 7f017d8249c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:09:29.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.044+0000 7f005e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 94867037837120 notifier 8015 bl.length()=827 2024-09-12T18:09:29.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.044+0000 7f005e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:09:29.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.044+0000 7f005e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:09:29.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.044+0000 7f005e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:29.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.048+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:09:29.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.048+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:09:29.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.048+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:09:29.048 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.048+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:09:29.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.052+0000 7f017d8249c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.0 2024-09-12T18:09:29.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.052+0000 7f017d8249c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.0 2024-09-12T18:09:29.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.052+0000 7f017d8249c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:09:29.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.052+0000 7f017d8249c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:09:29.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.052+0000 7f017d8249c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T18:09:29.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.052+0000 7f017d8249c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:09:29.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.052+0000 7f017d8249c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:09:29.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.052+0000 7f017d8249c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:09:29.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.052+0000 7f017d8249c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:09:29.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.052+0000 7f017d8249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:29.055 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.052+0000 7f017d8249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:09:29.056 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.056+0000 7f017d8249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:09:29.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.056+0000 7f017d8249c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:09:29.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.056+0000 7f017d8249c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:29.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.056+0000 7f017d8249c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:09:29.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.056+0000 7f005e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464337 cookie 94867037837120 notifier 8015 bl.length()=827 2024-09-12T18:09:29.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.056+0000 7f005e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:09:29.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.056+0000 7f005e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:09:29.057 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.056+0000 7f005e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:29.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:09:29.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:09:29.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:09:29.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:09:29.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:09:29.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.0 2024-09-12T18:09:29.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:09:29.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.1 2024-09-12T18:09:29.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:09:29.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.2.2 2024-09-12T18:09:29.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:29.063 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.060+0000 7f017d8249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 2024-09-12T18:09:29.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f017d8249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:09:29.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f017d8249c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:09:29.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f017d8249c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:29.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f017d8249c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17, ofs0, ns] 2024-09-12T18:09:29.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f005effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94867037837120 notifier 8015 bl.length()=795 2024-09-12T18:09:29.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f005effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 info.flags=0x17 2024-09-12T18:09:29.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f005effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17 to cache LRU end 2024-09-12T18:09:29.065 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f005effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:29.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_sources= new_sources= 2024-09-12T18:09:29.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential sources added=[] removed=[] 2024-09-12T18:09:29.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): orig_dests= new_dests= 2024-09-12T18:09:29.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.064+0000 7f017d8249c0 20 handle_bi_update(): bucket=:a-bucket[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17]): potential dests added=[] removed=[] 2024-09-12T18:09:29.070 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.068+0000 7f017d8249c0 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-12T18:09:29.074 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.072+0000 7f00327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:29.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.076+0000 7f017d8249c0 20 remove_watcher() i=0 2024-09-12T18:09:29.078 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.076+0000 7f017d8249c0 2 removed watcher, disabling cache 2024-09-12T18:09:29.080 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.080+0000 7f017d8249c0 20 remove_watcher() i=1 2024-09-12T18:09:29.083 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.080+0000 7f017d8249c0 20 remove_watcher() i=2 2024-09-12T18:09:29.085 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.084+0000 7f017d8249c0 20 remove_watcher() i=3 2024-09-12T18:09:29.087 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.084+0000 7f017d8249c0 20 remove_watcher() i=4 2024-09-12T18:09:29.088 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.088+0000 7f017d8249c0 20 remove_watcher() i=5 2024-09-12T18:09:29.089 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.088+0000 7f017d8249c0 20 remove_watcher() i=6 2024-09-12T18:09:29.091 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.088+0000 7f017d8249c0 20 remove_watcher() i=7 2024-09-12T18:09:29.105 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T18:09:29.132 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:29.132 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:29.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.172+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 20 realm 2024-09-12T18:09:29.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:29.176 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.177 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:29.178 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:29.179 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.176+0000 7f5f083ea9c0 20 searching for the correct realm 2024-09-12T18:09:29.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.184+0000 7f5f066f1640 0 -- 172.21.15.157:0/245521681 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f5efc02d970 msgr2=0x7f5efc00a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:29.401 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.400+0000 7f5f05ef0640 0 -- 172.21.15.157:0/245521681 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x559154a00710 msgr2=0x559154a02b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:29.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:29.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:29.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:29.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:29.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:29.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:29.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:29.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:29.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 zone default found 2024-09-12T18:09:29.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 4 Realm: () 2024-09-12T18:09:29.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:29.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:29.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:29.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 zonegroup default 2024-09-12T18:09:29.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.411 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.408+0000 7f5f083ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.412+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.412+0000 7f5f083ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.412+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.412+0000 7f5f083ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.412+0000 7f5f083ea9c0 20 started sync module instance, tier type = 2024-09-12T18:09:29.413 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.412+0000 7f5f083ea9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:29.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.436+0000 7f5f083ea9c0 20 add_watcher() i=0 2024-09-12T18:09:29.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.436+0000 7f5f083ea9c0 20 add_watcher() i=1 2024-09-12T18:09:29.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.436+0000 7f5f083ea9c0 20 add_watcher() i=2 2024-09-12T18:09:29.436 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.436+0000 7f5f083ea9c0 20 add_watcher() i=3 2024-09-12T18:09:29.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.436+0000 7f5f083ea9c0 20 add_watcher() i=4 2024-09-12T18:09:29.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.436+0000 7f5f083ea9c0 20 add_watcher() i=5 2024-09-12T18:09:29.437 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.436+0000 7f5f083ea9c0 20 add_watcher() i=6 2024-09-12T18:09:29.438 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.436+0000 7f5f083ea9c0 20 add_watcher() i=7 2024-09-12T18:09:29.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.436+0000 7f5f083ea9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:29.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.440+0000 7f5dbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:29.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.440+0000 7f5f083ea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:29.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.440+0000 7f5f083ea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:29.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.440+0000 7f5f083ea9c0 5 note: GC not initialized 2024-09-12T18:09:29.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.440+0000 7f5dbafe5640 20 reqs_thread_entry: start 2024-09-12T18:09:29.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5f083ea9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:29.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5f083ea9c0 20 Filter name: none 2024-09-12T18:09:29.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5db8fe1640 20 reqs_thread_entry: start 2024-09-12T18:09:29.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5f083ea9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:29.445 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5f083ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5f083ea9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:29.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5f083ea9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:29.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5f083ea9c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T18:09:29.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5f083ea9c0 20 INFO: main: starting shard=0 2024-09-12T18:09:29.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5f083ea9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.0 2024-09-12T18:09:29.446 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.444+0000 7f5f083ea9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17.3.0 2024-09-12T18:09:29.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.448+0000 7f5f083ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:29.447 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.448+0000 7f5f083ea9c0 20 INFO: main: done 2024-09-12T18:09:29.448 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.448+0000 7f5dbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:29.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.452+0000 7f5f083ea9c0 20 remove_watcher() i=0 2024-09-12T18:09:29.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.452+0000 7f5f083ea9c0 2 removed watcher, disabling cache 2024-09-12T18:09:29.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.456+0000 7f5f083ea9c0 20 remove_watcher() i=1 2024-09-12T18:09:29.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.456+0000 7f5f083ea9c0 20 remove_watcher() i=2 2024-09-12T18:09:29.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.460+0000 7f5f083ea9c0 20 remove_watcher() i=3 2024-09-12T18:09:29.462 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.460+0000 7f5f083ea9c0 20 remove_watcher() i=4 2024-09-12T18:09:29.464 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.464+0000 7f5f083ea9c0 20 remove_watcher() i=5 2024-09-12T18:09:29.465 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.464+0000 7f5f083ea9c0 20 remove_watcher() i=6 2024-09-12T18:09:29.467 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.464+0000 7f5f083ea9c0 20 remove_watcher() i=7 2024-09-12T18:09:29.484 INFO:tasks.workunit.client.0.smithi157.stderr: test: PUT succeeds during reshard 2024-09-12T18:09:29.484 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:09:29.515 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:29.515 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:29.559 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.560+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.560+0000 7f620fa149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.560+0000 7f620fa149c0 20 realm 2024-09-12T18:09:29.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.560+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.561 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.560+0000 7f620fa149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.560+0000 7f620fa149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:29.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.560+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.560+0000 7f620fa149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.560+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.564+0000 7f620fa149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:29.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.564+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.564+0000 7f620fa149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:29.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.564+0000 7f620fa149c0 20 searching for the correct realm 2024-09-12T18:09:29.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.568+0000 7f620dd1b640 0 -- 172.21.15.157:0/3127959846 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f6204056130 msgr2=0x7f6204088ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:29.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.784+0000 7f620d51a640 0 -- 172.21.15.157:0/3127959846 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5593292fd990 msgr2=0x5593292ffd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:29.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.792+0000 7f620fa149c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:29.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.792+0000 7f620fa149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:29.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.792+0000 7f620fa149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:29.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.792+0000 7f620fa149c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:29.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.792+0000 7f620fa149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:29.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.792+0000 7f620fa149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:29.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.792+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.792+0000 7f620fa149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.794 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.792+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.792+0000 7f620fa149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:29.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.792+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:29.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 20 zone default found 2024-09-12T18:09:29.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 4 Realm: () 2024-09-12T18:09:29.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:29.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:29.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:29.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 20 zonegroup default 2024-09-12T18:09:29.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 20 started sync module instance, tier type = 2024-09-12T18:09:29.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.796+0000 7f620fa149c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:29.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.820+0000 7f620fa149c0 20 add_watcher() i=0 2024-09-12T18:09:29.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.820+0000 7f620fa149c0 20 add_watcher() i=1 2024-09-12T18:09:29.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.820+0000 7f620fa149c0 20 add_watcher() i=2 2024-09-12T18:09:29.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.820+0000 7f620fa149c0 20 add_watcher() i=3 2024-09-12T18:09:29.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.820+0000 7f620fa149c0 20 add_watcher() i=4 2024-09-12T18:09:29.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.820+0000 7f620fa149c0 20 add_watcher() i=5 2024-09-12T18:09:29.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.820+0000 7f620fa149c0 20 add_watcher() i=6 2024-09-12T18:09:29.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.824+0000 7f620fa149c0 20 add_watcher() i=7 2024-09-12T18:09:29.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.824+0000 7f620fa149c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:29.827 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.828+0000 7f60c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:29.828 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.828+0000 7f620fa149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:29.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.828+0000 7f620fa149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:29.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.828+0000 7f620fa149c0 5 note: GC not initialized 2024-09-12T18:09:29.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.828+0000 7f60c27e4640 20 reqs_thread_entry: start 2024-09-12T18:09:29.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.828+0000 7f620fa149c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:29.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.828+0000 7f620fa149c0 20 Filter name: none 2024-09-12T18:09:29.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.828+0000 7f6033fff640 20 reqs_thread_entry: start 2024-09-12T18:09:29.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.828+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.828+0000 7f620fa149c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:29.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.828+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.832+0000 7f620fa149c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:29.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.832+0000 7f620fa149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:29.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.832+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.832+0000 7f620fa149c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:29.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.832+0000 7f620fa149c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.832+0000 7f620fa149c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:29.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.832+0000 7f620fa149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:29.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.836+0000 7f60c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:29.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.840+0000 7f620fa149c0 20 remove_watcher() i=0 2024-09-12T18:09:29.841 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.840+0000 7f620fa149c0 2 removed watcher, disabling cache 2024-09-12T18:09:29.843 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.840+0000 7f620fa149c0 20 remove_watcher() i=1 2024-09-12T18:09:29.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.844+0000 7f620fa149c0 20 remove_watcher() i=2 2024-09-12T18:09:29.848 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.848+0000 7f620fa149c0 20 remove_watcher() i=3 2024-09-12T18:09:29.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.848+0000 7f620fa149c0 20 remove_watcher() i=4 2024-09-12T18:09:29.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.852+0000 7f620fa149c0 20 remove_watcher() i=5 2024-09-12T18:09:29.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.852+0000 7f620fa149c0 20 remove_watcher() i=6 2024-09-12T18:09:29.855 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.856+0000 7f620fa149c0 20 remove_watcher() i=7 2024-09-12T18:09:29.872 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:09:29.872 INFO:tasks.workunit.client.0.smithi157.stderr:BUCKET_STATS: 2024-09-12T18:09:29.872 INFO:tasks.workunit.client.0.smithi157.stderr:bucket: myver id: e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T18:09:29.872 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:09:29.873 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-12T18:09:29.905 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:29.905 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:29.948 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.948+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.948+0000 7f3419f619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.948+0000 7f3419f619c0 20 realm 2024-09-12T18:09:29.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.948+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.948+0000 7f3419f619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.948+0000 7f3419f619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:29.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.948+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.948+0000 7f3419f619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:29.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.948+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.948+0000 7f3419f619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:29.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.948+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:29.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.952+0000 7f3419f619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:29.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.952+0000 7f3419f619c0 20 searching for the correct realm 2024-09-12T18:09:29.959 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:29.956+0000 7f3418268640 0 -- 172.21.15.157:0/1198098597 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f3400041900 msgr2=0x7f3400018430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:30.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.172+0000 7f3417a67640 0 -- 172.21.15.157:0/1198098597 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x56483cf52d20 msgr2=0x56483cf55150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:30.181 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:30.181 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:30.181 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:30.181 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:30.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:30.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:30.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:30.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:30.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:30.182 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:30.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:30.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:30.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 zone default found 2024-09-12T18:09:30.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 4 Realm: () 2024-09-12T18:09:30.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:30.183 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:30.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:30.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 zonegroup default 2024-09-12T18:09:30.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.180+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:30.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.184+0000 7f3419f619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:30.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.184+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:30.184 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.184+0000 7f3419f619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:30.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.184+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:30.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.184+0000 7f3419f619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:30.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.184+0000 7f3419f619c0 20 started sync module instance, tier type = 2024-09-12T18:09:30.185 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.184+0000 7f3419f619c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:30.208 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.208+0000 7f3419f619c0 20 add_watcher() i=0 2024-09-12T18:09:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.208+0000 7f3419f619c0 20 add_watcher() i=1 2024-09-12T18:09:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.208+0000 7f3419f619c0 20 add_watcher() i=2 2024-09-12T18:09:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.208+0000 7f3419f619c0 20 add_watcher() i=3 2024-09-12T18:09:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.208+0000 7f3419f619c0 20 add_watcher() i=4 2024-09-12T18:09:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.208+0000 7f3419f619c0 20 add_watcher() i=5 2024-09-12T18:09:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.208+0000 7f3419f619c0 20 add_watcher() i=6 2024-09-12T18:09:30.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.208+0000 7f3419f619c0 20 add_watcher() i=7 2024-09-12T18:09:30.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.208+0000 7f3419f619c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:30.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.212+0000 7f32cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:30.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:30.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:30.217 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 5 note: GC not initialized 2024-09-12T18:09:30.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f32ccfe1640 20 reqs_thread_entry: start 2024-09-12T18:09:30.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:30.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 20 Filter name: none 2024-09-12T18:09:30.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f32467fc640 20 reqs_thread_entry: start 2024-09-12T18:09:30.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:09:30.218 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:30.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:30.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:09:30.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:09:30.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 : miss 2024-09-12T18:09:30.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.216+0000 7f3419f619c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:30.219 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.220+0000 7f3419f619c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:30.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.220+0000 7f3419f619c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:30.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.220+0000 7f3419f619c0 10 adding default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:30.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.220+0000 7f3419f619c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:30.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.220+0000 7f3419f619c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:30.220 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.220+0000 7f3419f619c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 2024-09-12T18:09:30.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.228+0000 7f3419f619c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:30.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.228+0000 7f3419f619c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:30.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.228+0000 7f3419f619c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:30.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.228+0000 7f3419f619c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18, ofs0, ns] 2024-09-12T18:09:30.229 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.228+0000 7f32f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464306 cookie 94868260386784 notifier 8069 bl.length()=821 2024-09-12T18:09:30.230 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.228+0000 7f32f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:30.230 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.228+0000 7f32f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:30.230 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.228+0000 7f32f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:30.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.232+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_sources= new_sources= 2024-09-12T18:09:30.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.232+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential sources added=[] removed=[] 2024-09-12T18:09:30.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.232+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_dests= new_dests= 2024-09-12T18:09:30.232 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.232+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential dests added=[] removed=[] 2024-09-12T18:09:30.237 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:30.236+0000 7f3419f619c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T18:09:31.029 INFO:tasks.workunit.client.0.smithi157.stderr:put object successful 2024-09-12T18:09:35.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.236+0000 7f3419f619c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:35.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.236+0000 7f3419f619c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:35.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.236+0000 7f3419f619c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:35.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.236+0000 7f3419f619c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:35.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.236+0000 7f3419f619c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:35.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.236+0000 7f3419f619c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:35.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.236+0000 7f3419f619c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.0 2024-09-12T18:09:35.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.236+0000 7f3419f619c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.0 2024-09-12T18:09:35.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.236+0000 7f3419f619c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.1 2024-09-12T18:09:35.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.236+0000 7f3419f619c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.1 2024-09-12T18:09:35.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.244+0000 7f3419f619c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:35.244 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.244+0000 7f3419f619c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 2024-09-12T18:09:35.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.248+0000 7f3419f619c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:35.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.248+0000 7f3419f619c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:35.247 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.248+0000 7f3419f619c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:35.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.248+0000 7f3419f619c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18, ofs0, ns] 2024-09-12T18:09:35.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.248+0000 7f32f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464307 cookie 94868260386784 notifier 8069 bl.length()=821 2024-09-12T18:09:35.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.248+0000 7f32f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:35.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.248+0000 7f32f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:35.248 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.248+0000 7f32f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:35.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.252+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_sources= new_sources= 2024-09-12T18:09:35.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.252+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential sources added=[] removed=[] 2024-09-12T18:09:35.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.252+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_dests= new_dests= 2024-09-12T18:09:35.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.252+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential dests added=[] removed=[] 2024-09-12T18:09:35.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.256+0000 7f3419f619c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.0 2024-09-12T18:09:35.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.256+0000 7f3419f619c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.0 2024-09-12T18:09:35.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.256+0000 7f3419f619c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.1 2024-09-12T18:09:35.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.256+0000 7f3419f619c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.1.1 2024-09-12T18:09:35.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.260+0000 7f3419f619c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:35.262 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.260+0000 7f3419f619c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 2024-09-12T18:09:35.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.264+0000 7f3419f619c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:35.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.264+0000 7f3419f619c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:35.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.264+0000 7f3419f619c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:35.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.264+0000 7f3419f619c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18, ofs0, ns] 2024-09-12T18:09:35.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.264+0000 7f32f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464308 cookie 94868260386784 notifier 8069 bl.length()=789 2024-09-12T18:09:35.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.264+0000 7f32f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:35.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.264+0000 7f32f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:35.267 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.264+0000 7f32f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:35.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.268+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_sources= new_sources= 2024-09-12T18:09:35.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.268+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential sources added=[] removed=[] 2024-09-12T18:09:35.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.268+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_dests= new_dests= 2024-09-12T18:09:35.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.268+0000 7f3419f619c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential dests added=[] removed=[] 2024-09-12T18:09:35.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.272+0000 7f3419f619c0 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-12T18:09:35.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.280+0000 7f32cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:35.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.284+0000 7f3419f619c0 20 remove_watcher() i=0 2024-09-12T18:09:35.286 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.284+0000 7f3419f619c0 2 removed watcher, disabling cache 2024-09-12T18:09:35.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.288+0000 7f3419f619c0 20 remove_watcher() i=1 2024-09-12T18:09:35.291 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.288+0000 7f3419f619c0 20 remove_watcher() i=2 2024-09-12T18:09:35.293 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.292+0000 7f3419f619c0 20 remove_watcher() i=3 2024-09-12T18:09:35.295 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.296+0000 7f3419f619c0 20 remove_watcher() i=4 2024-09-12T18:09:35.297 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.296+0000 7f3419f619c0 20 remove_watcher() i=5 2024-09-12T18:09:35.299 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.300+0000 7f3419f619c0 20 remove_watcher() i=6 2024-09-12T18:09:35.302 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:35.300+0000 7f3419f619c0 20 remove_watcher() i=7 2024-09-12T18:09:36.035 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T18:09:36.035 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:09:36.892 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:09:37.339 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T18:09:38.925 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:09:38.926 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T18:09:38.961 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:38.961 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:39.003 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.000+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.004+0000 7f51f31ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.005 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.004+0000 7f51f31ab9c0 20 realm 2024-09-12T18:09:39.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.004+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.004+0000 7f51f31ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.004+0000 7f51f31ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:39.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.004+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.006 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.004+0000 7f51f31ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.004+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.004+0000 7f51f31ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:39.007 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.004+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.008 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.008+0000 7f51f31ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:39.008 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.008+0000 7f51f31ab9c0 20 searching for the correct realm 2024-09-12T18:09:39.014 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.012+0000 7f51f04b0640 0 -- 172.21.15.157:0/272041564 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f51d8019040 msgr2=0x7f51d8033440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:39.020 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.020+0000 7f51f14b2640 0 -- 172.21.15.157:0/272041564 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f51d80243f0 msgr2=0x7f51d8024870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:39.027 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.024+0000 7f51f31ab9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:39.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.024+0000 7f51f31ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:39.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.024+0000 7f51f31ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:39.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.024+0000 7f51f31ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:39.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.024+0000 7f51f31ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:39.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.024+0000 7f51f31ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:39.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.024+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.028 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.029 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 zone default found 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 4 Realm: () 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 zonegroup default 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.030 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 started sync module instance, tier type = 2024-09-12T18:09:39.031 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.028+0000 7f51f31ab9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:39.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.044+0000 7f51f31ab9c0 20 add_watcher() i=0 2024-09-12T18:09:39.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.044+0000 7f51f31ab9c0 20 add_watcher() i=1 2024-09-12T18:09:39.044 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.044+0000 7f51f31ab9c0 20 add_watcher() i=2 2024-09-12T18:09:39.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.044+0000 7f51f31ab9c0 20 add_watcher() i=3 2024-09-12T18:09:39.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.044+0000 7f51f31ab9c0 20 add_watcher() i=4 2024-09-12T18:09:39.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.044+0000 7f51f31ab9c0 20 add_watcher() i=5 2024-09-12T18:09:39.045 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.044+0000 7f51f31ab9c0 20 add_watcher() i=6 2024-09-12T18:09:39.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.044+0000 7f51f31ab9c0 20 add_watcher() i=7 2024-09-12T18:09:39.046 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.044+0000 7f51f31ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:39.047 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f50a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:39.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:39.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:39.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 5 note: GC not initialized 2024-09-12T18:09:39.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f50a5fe3640 20 reqs_thread_entry: start 2024-09-12T18:09:39.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:39.049 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 Filter name: none 2024-09-12T18:09:39.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f50177fe640 20 reqs_thread_entry: start 2024-09-12T18:09:39.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:39.050 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.051 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:39.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:39.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T18:09:39.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 INFO: main: starting shard=0 2024-09-12T18:09:39.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:39.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:39.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:09:39.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 INFO: main: starting shard=1 2024-09-12T18:09:39.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:39.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.048+0000 7f51f31ab9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:39.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.052+0000 7f51f31ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:39.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.052+0000 7f51f31ab9c0 20 INFO: main: starting shard=2 2024-09-12T18:09:39.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.052+0000 7f51f31ab9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:39.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.052+0000 7f51f31ab9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:39.053 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.052+0000 7f51f31ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:39.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.052+0000 7f51f31ab9c0 20 INFO: main: done 2024-09-12T18:09:39.054 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.052+0000 7f50a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:39.058 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.056+0000 7f51f31ab9c0 20 remove_watcher() i=0 2024-09-12T18:09:39.059 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.056+0000 7f51f31ab9c0 2 removed watcher, disabling cache 2024-09-12T18:09:39.061 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.060+0000 7f51f31ab9c0 20 remove_watcher() i=1 2024-09-12T18:09:39.062 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.060+0000 7f51f31ab9c0 20 remove_watcher() i=2 2024-09-12T18:09:39.064 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.064+0000 7f51f31ab9c0 20 remove_watcher() i=3 2024-09-12T18:09:39.066 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.064+0000 7f51f31ab9c0 20 remove_watcher() i=4 2024-09-12T18:09:39.067 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.068+0000 7f51f31ab9c0 20 remove_watcher() i=5 2024-09-12T18:09:39.068 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.068+0000 7f51f31ab9c0 20 remove_watcher() i=6 2024-09-12T18:09:39.069 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.068+0000 7f51f31ab9c0 20 remove_watcher() i=7 2024-09-12T18:09:39.204 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:09:39.205 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T18:09:39.237 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:39.237 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:39.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.276+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.276+0000 7f4328f5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.276+0000 7f4328f5f9c0 20 realm 2024-09-12T18:09:39.279 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.276+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.280+0000 7f4328f5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.280+0000 7f4328f5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:39.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.280+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.280+0000 7f4328f5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.280+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.280+0000 7f4328f5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:39.282 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.280+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.282 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.280+0000 7f4328f5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:39.283 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.280+0000 7f4328f5f9c0 20 searching for the correct realm 2024-09-12T18:09:39.288 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.288+0000 7f4327266640 0 -- 172.21.15.157:0/2233377415 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f4310008070 msgr2=0x7f4310039930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:39.505 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.504+0000 7f4326a65640 0 -- 172.21.15.157:0/2233377415 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55ffb1c954f0 msgr2=0x55ffb1c978e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:39.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:39.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:39.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:39.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:39.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:39.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:39.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.512 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:39.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:39.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 zone default found 2024-09-12T18:09:39.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 4 Realm: () 2024-09-12T18:09:39.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:39.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:39.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:39.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 zonegroup default 2024-09-12T18:09:39.514 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.512+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.516+0000 7f4328f5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.516+0000 7f4328f5f9c0 20 started sync module instance, tier type = 2024-09-12T18:09:39.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.516+0000 7f4328f5f9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:39.539 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.540+0000 7f4328f5f9c0 20 add_watcher() i=0 2024-09-12T18:09:39.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.540+0000 7f4328f5f9c0 20 add_watcher() i=1 2024-09-12T18:09:39.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.540+0000 7f4328f5f9c0 20 add_watcher() i=2 2024-09-12T18:09:39.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.540+0000 7f4328f5f9c0 20 add_watcher() i=3 2024-09-12T18:09:39.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.540+0000 7f4328f5f9c0 20 add_watcher() i=4 2024-09-12T18:09:39.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.540+0000 7f4328f5f9c0 20 add_watcher() i=5 2024-09-12T18:09:39.540 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.540+0000 7f4328f5f9c0 20 add_watcher() i=6 2024-09-12T18:09:39.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.540+0000 7f4328f5f9c0 20 add_watcher() i=7 2024-09-12T18:09:39.542 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.540+0000 7f4328f5f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:39.546 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.544+0000 7f41ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:39.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.544+0000 7f4328f5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:39.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.544+0000 7f4328f5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:39.547 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 5 note: GC not initialized 2024-09-12T18:09:39.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f41dcfe1640 20 reqs_thread_entry: start 2024-09-12T18:09:39.548 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:39.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 20 Filter name: none 2024-09-12T18:09:39.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f41d5ffb640 20 reqs_thread_entry: start 2024-09-12T18:09:39.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.549 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:39.550 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:39.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:39.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T18:09:39.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 20 INFO: main: starting shard=0 2024-09-12T18:09:39.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:39.551 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.548+0000 7f4328f5f9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:39.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.552+0000 7f4328f5f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:39.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.552+0000 7f4328f5f9c0 20 INFO: main: starting shard=1 2024-09-12T18:09:39.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.552+0000 7f4328f5f9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:39.552 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.552+0000 7f4328f5f9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:39.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.552+0000 7f4328f5f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:39.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.552+0000 7f4328f5f9c0 20 INFO: main: starting shard=2 2024-09-12T18:09:39.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.552+0000 7f4328f5f9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:39.553 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.552+0000 7f4328f5f9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:39.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.552+0000 7f4328f5f9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:09:39.554 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.552+0000 7f4328f5f9c0 20 INFO: main: done 2024-09-12T18:09:39.555 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.556+0000 7f41ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:39.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.560+0000 7f4328f5f9c0 20 remove_watcher() i=0 2024-09-12T18:09:39.560 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.560+0000 7f4328f5f9c0 2 removed watcher, disabling cache 2024-09-12T18:09:39.562 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.560+0000 7f4328f5f9c0 20 remove_watcher() i=1 2024-09-12T18:09:39.564 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.564+0000 7f4328f5f9c0 20 remove_watcher() i=2 2024-09-12T18:09:39.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.564+0000 7f4328f5f9c0 20 remove_watcher() i=3 2024-09-12T18:09:39.568 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.568+0000 7f4328f5f9c0 20 remove_watcher() i=4 2024-09-12T18:09:39.570 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.568+0000 7f4328f5f9c0 20 remove_watcher() i=5 2024-09-12T18:09:39.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.568+0000 7f4328f5f9c0 20 remove_watcher() i=6 2024-09-12T18:09:39.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.572+0000 7f4328f5f9c0 20 remove_watcher() i=7 2024-09-12T18:09:39.748 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:09:39.749 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T18:09:39.784 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:39.784 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:39.829 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.828+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.828+0000 7f9e76a219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.828+0000 7f9e76a219c0 20 realm 2024-09-12T18:09:39.831 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.828+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.832+0000 7f9e76a219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.832+0000 7f9e76a219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:39.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.832+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.832+0000 7f9e76a219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:39.832 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.832+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.832+0000 7f9e76a219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:39.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.832+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:39.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.832+0000 7f9e76a219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:39.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.832+0000 7f9e76a219c0 20 searching for the correct realm 2024-09-12T18:09:39.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:39.836+0000 7f9e73d26640 0 -- 172.21.15.157:0/3060830965 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f9e6801b040 msgr2=0x7f9e6801b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:40.052 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.052+0000 7f9e74527640 0 -- 172.21.15.157:0/3060830965 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f9e6804b450 msgr2=0x7f9e6804b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:40.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.268+0000 7f9e76a219c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:40.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.268+0000 7f9e76a219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:40.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.268+0000 7f9e76a219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:40.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.268+0000 7f9e76a219c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:40.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.268+0000 7f9e76a219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:40.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.268+0000 7f9e76a219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:40.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.268+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:40.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:40.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:40.272 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:40.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:40.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:40.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 zone default found 2024-09-12T18:09:40.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 4 Realm: () 2024-09-12T18:09:40.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:40.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:40.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:40.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 zonegroup default 2024-09-12T18:09:40.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:40.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:40.274 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:40.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:40.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.272+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:40.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.276+0000 7f9e76a219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:40.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.276+0000 7f9e76a219c0 20 started sync module instance, tier type = 2024-09-12T18:09:40.276 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.276+0000 7f9e76a219c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:40.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.300+0000 7f9e76a219c0 20 add_watcher() i=0 2024-09-12T18:09:40.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.300+0000 7f9e76a219c0 20 add_watcher() i=1 2024-09-12T18:09:40.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.300+0000 7f9e76a219c0 20 add_watcher() i=2 2024-09-12T18:09:40.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.300+0000 7f9e76a219c0 20 add_watcher() i=3 2024-09-12T18:09:40.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.300+0000 7f9e76a219c0 20 add_watcher() i=4 2024-09-12T18:09:40.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.300+0000 7f9e76a219c0 20 add_watcher() i=5 2024-09-12T18:09:40.301 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.300+0000 7f9e76a219c0 20 add_watcher() i=6 2024-09-12T18:09:40.303 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.304+0000 7f9e76a219c0 20 add_watcher() i=7 2024-09-12T18:09:40.303 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.304+0000 7f9e76a219c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:40.308 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.308+0000 7f9d2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:40.309 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.308+0000 7f9e76a219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:40.309 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.308+0000 7f9e76a219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:40.309 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.308+0000 7f9e76a219c0 5 note: GC not initialized 2024-09-12T18:09:40.309 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.308+0000 7f9d29fdb640 20 reqs_thread_entry: start 2024-09-12T18:09:40.309 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.308+0000 7f9e76a219c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:40.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.308+0000 7f9e76a219c0 20 Filter name: none 2024-09-12T18:09:40.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.308+0000 7f9c9b7fe640 20 reqs_thread_entry: start 2024-09-12T18:09:40.310 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.308+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:40.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.308+0000 7f9e76a219c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:40.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.308+0000 7f9e76a219c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:40.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:40.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:40.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T18:09:40.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 INFO: main: starting shard=0 2024-09-12T18:09:40.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:40.312 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:40.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:40.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 INFO: main: starting shard=1 2024-09-12T18:09:40.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:40.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:40.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:09:40.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 INFO: main: starting shard=2 2024-09-12T18:09:40.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:40.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:40.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:40.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.312+0000 7f9e76a219c0 20 INFO: main: done 2024-09-12T18:09:40.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.316+0000 7f9d2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:40.321 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.320+0000 7f9e76a219c0 20 remove_watcher() i=0 2024-09-12T18:09:40.322 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.320+0000 7f9e76a219c0 2 removed watcher, disabling cache 2024-09-12T18:09:40.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.324+0000 7f9e76a219c0 20 remove_watcher() i=1 2024-09-12T18:09:40.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.324+0000 7f9e76a219c0 20 remove_watcher() i=2 2024-09-12T18:09:40.329 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.328+0000 7f9e76a219c0 20 remove_watcher() i=3 2024-09-12T18:09:40.331 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.328+0000 7f9e76a219c0 20 remove_watcher() i=4 2024-09-12T18:09:40.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.332+0000 7f9e76a219c0 20 remove_watcher() i=5 2024-09-12T18:09:40.334 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.332+0000 7f9e76a219c0 20 remove_watcher() i=6 2024-09-12T18:09:40.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:40.336+0000 7f9e76a219c0 20 remove_watcher() i=7 2024-09-12T18:09:40.383 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:09:40.822 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T18:09:41.251 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T18:09:41.284 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:41.284 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.320+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.324+0000 7fcf212fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.324+0000 7fcf212fd9c0 20 realm 2024-09-12T18:09:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.324+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.324+0000 7fcf212fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.324+0000 7fcf212fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.324+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.324+0000 7fcf212fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.324+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.324+0000 7fcf212fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:41.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.324+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.324+0000 7fcf212fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:41.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.328+0000 7fcf212fd9c0 20 searching for the correct realm 2024-09-12T18:09:41.332 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.332+0000 7fcf1f604640 0 -- 172.21.15.157:0/3591739255 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x562dfcc786b0 msgr2=0x562dfcc7ab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:41.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.336+0000 7fcf1ee03640 0 -- 172.21.15.157:0/3591739255 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fcf1006b8d0 msgr2=0x7fcf100846e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:41.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:41.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:41.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:41.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:41.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:41.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:41.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.346 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 zone default found 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 4 Realm: () 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 zonegroup default 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.348 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.344+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.348+0000 7fcf212fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.348+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.348+0000 7fcf212fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.348+0000 7fcf212fd9c0 20 started sync module instance, tier type = 2024-09-12T18:09:41.349 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.348+0000 7fcf212fd9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:41.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.360+0000 7fcf212fd9c0 20 add_watcher() i=0 2024-09-12T18:09:41.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.360+0000 7fcf212fd9c0 20 add_watcher() i=1 2024-09-12T18:09:41.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.360+0000 7fcf212fd9c0 20 add_watcher() i=2 2024-09-12T18:09:41.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.360+0000 7fcf212fd9c0 20 add_watcher() i=3 2024-09-12T18:09:41.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.360+0000 7fcf212fd9c0 20 add_watcher() i=4 2024-09-12T18:09:41.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.360+0000 7fcf212fd9c0 20 add_watcher() i=5 2024-09-12T18:09:41.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.360+0000 7fcf212fd9c0 20 add_watcher() i=6 2024-09-12T18:09:41.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.360+0000 7fcf212fd9c0 20 add_watcher() i=7 2024-09-12T18:09:41.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.360+0000 7fcf212fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:41.365 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcdd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 5 note: GC not initialized 2024-09-12T18:09:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcd4ffff640 20 reqs_thread_entry: start 2024-09-12T18:09:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 20 Filter name: none 2024-09-12T18:09:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcd4dffb640 20 reqs_thread_entry: start 2024-09-12T18:09:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:09:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.366 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:41.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:09:41.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:09:41.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 : miss 2024-09-12T18:09:41.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:41.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:41.367 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:41.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:41.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:41.368 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.364+0000 7fcf212fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 2024-09-12T18:09:41.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fcf212fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:41.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fcf212fd9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:41.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fcf212fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:41.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fcf212fd9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18, ofs0, ns] 2024-09-12T18:09:41.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fce01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94755514470256 notifier 8153 bl.length()=821 2024-09-12T18:09:41.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fce01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:41.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fce01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:41.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fce01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:41.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_sources= new_sources= 2024-09-12T18:09:41.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential sources added=[] removed=[] 2024-09-12T18:09:41.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_dests= new_dests= 2024-09-12T18:09:41.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.380+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential dests added=[] removed=[] 2024-09-12T18:09:41.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.0 2024-09-12T18:09:41.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.0 2024-09-12T18:09:41.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.1 2024-09-12T18:09:41.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.1 2024-09-12T18:09:41.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.2 2024-09-12T18:09:41.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.2 2024-09-12T18:09:41.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.3 2024-09-12T18:09:41.389 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.3 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.4 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.4 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.5 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.5 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.6 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.6 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.7 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.7 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.8 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.8 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.390 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.10 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.10 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.11 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.11 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.12 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.12 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.13 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.13 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.14 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.14 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.15 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.15 2024-09-12T18:09:41.391 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.16 2024-09-12T18:09:41.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.16 2024-09-12T18:09:41.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:41.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:41.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:41.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:41.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:41.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.388+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:41.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.392+0000 7fcf212fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:41.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.392+0000 7fcf212fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 2024-09-12T18:09:41.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.396+0000 7fcf212fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:41.398 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.396+0000 7fcf212fd9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:41.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.396+0000 7fcf212fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:41.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.396+0000 7fcf212fd9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18, ofs0, ns] 2024-09-12T18:09:41.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.396+0000 7fce01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464310 cookie 94755514470256 notifier 8153 bl.length()=821 2024-09-12T18:09:41.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.396+0000 7fce01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:41.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.396+0000 7fce01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:41.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.396+0000 7fce01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:41.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.400+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_sources= new_sources= 2024-09-12T18:09:41.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.400+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential sources added=[] removed=[] 2024-09-12T18:09:41.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.400+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_dests= new_dests= 2024-09-12T18:09:41.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.400+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential dests added=[] removed=[] 2024-09-12T18:09:41.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.400+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:41.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.400+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.0 2024-09-12T18:09:41.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.404+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:41.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.404+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.1 2024-09-12T18:09:41.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.404+0000 7fcf212fd9c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:41.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.404+0000 7fcf212fd9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.2.2 2024-09-12T18:09:41.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.404+0000 7fcf212fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:41.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.404+0000 7fcf212fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 2024-09-12T18:09:41.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fcf212fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:41.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fcf212fd9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:41.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fcf212fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:41.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fcf212fd9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18, ofs0, ns] 2024-09-12T18:09:41.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fce027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464311 cookie 94755514470256 notifier 8153 bl.length()=789 2024-09-12T18:09:41.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fce027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:41.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fce027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:41.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fce027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:41.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_sources= new_sources= 2024-09-12T18:09:41.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential sources added=[] removed=[] 2024-09-12T18:09:41.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): orig_dests= new_dests= 2024-09-12T18:09:41.410 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.408+0000 7fcf212fd9c0 20 handle_bi_update(): bucket=:myver[e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18]): potential dests added=[] removed=[] 2024-09-12T18:09:41.412 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.412+0000 7fcf212fd9c0 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-12T18:09:41.416 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.416+0000 7fcdd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:41.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.420+0000 7fcf212fd9c0 20 remove_watcher() i=0 2024-09-12T18:09:41.420 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.420+0000 7fcf212fd9c0 2 removed watcher, disabling cache 2024-09-12T18:09:41.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.420+0000 7fcf212fd9c0 20 remove_watcher() i=1 2024-09-12T18:09:41.424 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.424+0000 7fcf212fd9c0 20 remove_watcher() i=2 2024-09-12T18:09:41.426 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.424+0000 7fcf212fd9c0 20 remove_watcher() i=3 2024-09-12T18:09:41.428 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.428+0000 7fcf212fd9c0 20 remove_watcher() i=4 2024-09-12T18:09:41.429 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.428+0000 7fcf212fd9c0 20 remove_watcher() i=5 2024-09-12T18:09:41.430 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.428+0000 7fcf212fd9c0 20 remove_watcher() i=6 2024-09-12T18:09:41.431 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.432+0000 7fcf212fd9c0 20 remove_watcher() i=7 2024-09-12T18:09:41.443 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T18:09:41.474 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:41.474 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:41.513 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.512+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.512+0000 7f6ee02929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.512+0000 7f6ee02929c0 20 realm 2024-09-12T18:09:41.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.512+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.512+0000 7f6ee02929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.512+0000 7f6ee02929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:41.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.512+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.512+0000 7f6ee02929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.515 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.512+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.516+0000 7f6ee02929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:41.516 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.516+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.516+0000 7f6ee02929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:41.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.516+0000 7f6ee02929c0 20 searching for the correct realm 2024-09-12T18:09:41.523 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.524+0000 7f6ede599640 0 -- 172.21.15.157:0/861399714 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f6ec80e6070 msgr2=0x7f6ec80aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:41.742 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.740+0000 7f6eddd98640 0 -- 172.21.15.157:0/861399714 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55641b7e90e0 msgr2=0x55641b7eb4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:41.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:41.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:41.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:41.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:41.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:41.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:41.749 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:41.750 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:41.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 zone default found 2024-09-12T18:09:41.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 4 Realm: () 2024-09-12T18:09:41.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:41.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:41.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:41.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 zonegroup default 2024-09-12T18:09:41.751 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.748+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.752+0000 7f6ee02929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.752+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.752 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.752+0000 7f6ee02929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.752+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.752+0000 7f6ee02929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:41.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.752+0000 7f6ee02929c0 20 started sync module instance, tier type = 2024-09-12T18:09:41.753 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.752+0000 7f6ee02929c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:41.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.776+0000 7f6ee02929c0 20 add_watcher() i=0 2024-09-12T18:09:41.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.776+0000 7f6ee02929c0 20 add_watcher() i=1 2024-09-12T18:09:41.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.776+0000 7f6ee02929c0 20 add_watcher() i=2 2024-09-12T18:09:41.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.776+0000 7f6ee02929c0 20 add_watcher() i=3 2024-09-12T18:09:41.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.776+0000 7f6ee02929c0 20 add_watcher() i=4 2024-09-12T18:09:41.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.776+0000 7f6ee02929c0 20 add_watcher() i=5 2024-09-12T18:09:41.777 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.776+0000 7f6ee02929c0 20 add_watcher() i=6 2024-09-12T18:09:41.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.776+0000 7f6ee02929c0 20 add_watcher() i=7 2024-09-12T18:09:41.779 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.776+0000 7f6ee02929c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:41.783 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.780+0000 7f6d8ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:41.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:41.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:41.784 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 5 note: GC not initialized 2024-09-12T18:09:41.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6d8effd640 20 reqs_thread_entry: start 2024-09-12T18:09:41.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:41.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 20 Filter name: none 2024-09-12T18:09:41.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6d8cff9640 20 reqs_thread_entry: start 2024-09-12T18:09:41.785 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:09:41.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:41.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:09:41.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:09:41.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 : miss 2024-09-12T18:09:41.786 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:41.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:41.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 info.flags=0x17 2024-09-12T18:09:41.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 10 adding default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 to cache LRU end 2024-09-12T18:09:41.787 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:41.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:41.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.784+0000 7f6ee02929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18 2024-09-12T18:09:41.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.788+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.0 2024-09-12T18:09:41.788 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.788+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.0 2024-09-12T18:09:41.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.788+0000 7f6ee02929c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T18:09:41.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.788+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.1 2024-09-12T18:09:41.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.788+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.1 2024-09-12T18:09:41.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.788+0000 7f6ee02929c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T18:09:41.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.788+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.2 2024-09-12T18:09:41.789 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.788+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.2 2024-09-12T18:09:41.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.788+0000 7f6ee02929c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T18:09:41.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.788+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.3 2024-09-12T18:09:41.790 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.788+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.3 2024-09-12T18:09:41.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T18:09:41.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.4 2024-09-12T18:09:41.791 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.4 2024-09-12T18:09:41.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T18:09:41.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.5 2024-09-12T18:09:41.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.5 2024-09-12T18:09:41.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T18:09:41.792 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.6 2024-09-12T18:09:41.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.6 2024-09-12T18:09:41.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T18:09:41.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.7 2024-09-12T18:09:41.793 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.7 2024-09-12T18:09:41.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T18:09:41.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.8 2024-09-12T18:09:41.795 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.792+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.8 2024-09-12T18:09:41.796 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.796+0000 7f6ee02929c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T18:09:41.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.796+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.797 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.796+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.798 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.796+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.10 2024-09-12T18:09:41.799 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.796+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.10 2024-09-12T18:09:41.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T18:09:41.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.11 2024-09-12T18:09:41.800 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.11 2024-09-12T18:09:41.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T18:09:41.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.12 2024-09-12T18:09:41.801 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.12 2024-09-12T18:09:41.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T18:09:41.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.13 2024-09-12T18:09:41.802 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.13 2024-09-12T18:09:41.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T18:09:41.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.14 2024-09-12T18:09:41.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.800+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.14 2024-09-12T18:09:41.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.804+0000 7f6ee02929c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T18:09:41.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.804+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.15 2024-09-12T18:09:41.803 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.804+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.15 2024-09-12T18:09:41.804 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.804+0000 7f6ee02929c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T18:09:41.804 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.804+0000 7f6ee02929c0 10 bucket_obj is .dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.16 2024-09-12T18:09:41.804 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.804+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.16 2024-09-12T18:09:41.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.804+0000 7f6ee02929c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T18:09:41.806 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.804+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.804+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:x state=0x55641b822fc8 s->prefetch_data=0 2024-09-12T18:09:41.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.808+0000 7f6ee02929c0 20 get_obj_state: setting s->obj_tag to qanxtaqizaaxbnez1kvso5pu87s8snzw 2024-09-12T18:09:41.807 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.808+0000 7f6ee02929c0 20 get_obj_state_impl: setting s->olh_tag to i8344lzxacgihxbkh85yp17qvl664tv1 2024-09-12T18:09:41.808 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.808+0000 7f6ee02929c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=i8344lzxacgihxbkh85yp17qvl664tv1 2024-09-12T18:09:41.810 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.808+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.812+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.816 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.812+0000 7f6ee02929c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T18:09:41.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.812+0000 7f6ee02929c0 20 olh_log_entry: epoch=2 op=3 key=x[TXjv-ZgXOJRTg8U2BftXo6-KqPRHvLs] 2024-09-12T18:09:41.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.816+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:_:TXjv-ZgXOJRTg8U2BftXo6-KqPRHvLs_x state=0x55641b821c18 s->prefetch_data=0 2024-09-12T18:09:41.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.816+0000 7f6ee02929c0 10 manifest: total_size = 22 2024-09-12T18:09:41.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.816+0000 7f6ee02929c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5417786163882943538 2024-09-12T18:09:41.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.816+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:_:TXjv-ZgXOJRTg8U2BftXo6-KqPRHvLs_x state=0x55641b821c18 s->prefetch_data=0 2024-09-12T18:09:41.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.816+0000 7f6ee02929c0 20 prepare_atomic_modification: state is not atomic. state=0x55641b821c18 2024-09-12T18:09:41.817 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.816+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.820+0000 7f6ee02929c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:09:41.821 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.820+0000 7f6ee02929c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T18:09:41.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.820+0000 7f6ee02929c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:09:41.822 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.820+0000 7f6ee02929c0 5 delete_objs_inline: removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18__shadow:TXjv-ZgXOJRTg8U2BftXo6-KqPRHvLs_.i4M8VwqIgQcDLbkGH0r4Xiy5JF-TapU_0 2024-09-12T18:09:41.824 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.824+0000 7f6ee02929c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:09:41.825 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.824+0000 7f6dc0ff9640 20 handle_completion(): completion ok for obj=x[TXjv-ZgXOJRTg8U2BftXo6-KqPRHvLs] 2024-09-12T18:09:41.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.824+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:x state=0x55641b822fc8 s->prefetch_data=0 2024-09-12T18:09:41.826 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.824+0000 7f6ee02929c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=i8344lzxacgihxbkh85yp17qvl664tv1 2024-09-12T18:09:41.830 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.828+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.833 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.832+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.834 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.832+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.835 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.836+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:y state=0x55641b857fc8 s->prefetch_data=0 2024-09-12T18:09:41.836 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.836+0000 7f6ee02929c0 20 get_obj_state: setting s->obj_tag to u0wx5mq1r0djjbvb7w9p4pncqb80nqqi 2024-09-12T18:09:41.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.836+0000 7f6ee02929c0 20 get_obj_state_impl: setting s->olh_tag to q55arjycfyxkjgacvmfu5k4pxsg8l8v4 2024-09-12T18:09:41.837 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.836+0000 7f6ee02929c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=q55arjycfyxkjgacvmfu5k4pxsg8l8v4 2024-09-12T18:09:41.839 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.840+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.842 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.840+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.844+0000 7f6ee02929c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T18:09:41.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.844+0000 7f6ee02929c0 20 olh_log_entry: epoch=2 op=3 key=y[rb5Fc7nHiAWWm-yPE27OEyOsVyPuPsi] 2024-09-12T18:09:41.844 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.844+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:_:rb5Fc7nHiAWWm-yPE27OEyOsVyPuPsi_y state=0x55641b81cbc8 s->prefetch_data=0 2024-09-12T18:09:41.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.844+0000 7f6ee02929c0 10 manifest: total_size = 22 2024-09-12T18:09:41.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.844+0000 7f6ee02929c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.50821261801010893 2024-09-12T18:09:41.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.844+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:_:rb5Fc7nHiAWWm-yPE27OEyOsVyPuPsi_y state=0x55641b81cbc8 s->prefetch_data=0 2024-09-12T18:09:41.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.844+0000 7f6ee02929c0 20 prepare_atomic_modification: state is not atomic. state=0x55641b81cbc8 2024-09-12T18:09:41.845 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.844+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.852+0000 7f6ee02929c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:09:41.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.852+0000 7f6ee02929c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T18:09:41.851 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.852+0000 7f6ee02929c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:09:41.852 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.852+0000 7f6ee02929c0 5 delete_objs_inline: removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18__shadow:rb5Fc7nHiAWWm-yPE27OEyOsVyPuPsi_.336tq-bAGh87XbJLKLyFaiYu00b3u2g_0 2024-09-12T18:09:41.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.852+0000 7f6ee02929c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:09:41.854 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.852+0000 7f6dc0ff9640 20 handle_completion(): completion ok for obj=y[rb5Fc7nHiAWWm-yPE27OEyOsVyPuPsi] 2024-09-12T18:09:41.856 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.856+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:y state=0x55641b857fc8 s->prefetch_data=0 2024-09-12T18:09:41.857 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.856+0000 7f6ee02929c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=q55arjycfyxkjgacvmfu5k4pxsg8l8v4 2024-09-12T18:09:41.861 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.860+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.864 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.864+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.865 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.864+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.866 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.864+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:z state=0x55641b857fc8 s->prefetch_data=0 2024-09-12T18:09:41.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.864+0000 7f6ee02929c0 20 get_obj_state: setting s->obj_tag to ual548y09nn2eyazsaeki40vr86wz7hr 2024-09-12T18:09:41.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.864+0000 7f6ee02929c0 20 get_obj_state_impl: setting s->olh_tag to uc26t4xseg3x7wkdioixuutttu9l8k26 2024-09-12T18:09:41.867 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.864+0000 7f6ee02929c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=uc26t4xseg3x7wkdioixuutttu9l8k26 2024-09-12T18:09:41.870 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.868+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.873 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.872+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.872+0000 7f6ee02929c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T18:09:41.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.872+0000 7f6ee02929c0 20 olh_log_entry: epoch=2 op=3 key=z[Y4YHD7uiOxXg92z3m28o.j5VeeSP2PI] 2024-09-12T18:09:41.874 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.872+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:_:Y4YHD7uiOxXg92z3m28o.j5VeeSP2PI_z state=0x55641b81cbc8 s->prefetch_data=0 2024-09-12T18:09:41.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.872+0000 7f6ee02929c0 10 manifest: total_size = 22 2024-09-12T18:09:41.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.872+0000 7f6ee02929c0 20 get_obj_state: setting s->obj_tag to e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7467967344687207231 2024-09-12T18:09:41.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.872+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:_:Y4YHD7uiOxXg92z3m28o.j5VeeSP2PI_z state=0x55641b81cbc8 s->prefetch_data=0 2024-09-12T18:09:41.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.872+0000 7f6ee02929c0 20 prepare_atomic_modification: state is not atomic. state=0x55641b81cbc8 2024-09-12T18:09:41.875 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.872+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.880+0000 7f6ee02929c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:09:41.880 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.880+0000 7f6ee02929c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T18:09:41.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.880+0000 7f6ee02929c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:09:41.881 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.880+0000 7f6ee02929c0 5 delete_objs_inline: removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18__shadow:Y4YHD7uiOxXg92z3m28o.j5VeeSP2PI_.PCjf18e23sb5srN1qTK0OG-NpPMBOEy_0 2024-09-12T18:09:41.882 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.880+0000 7f6ee02929c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:09:41.883 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.880+0000 7f6dc0ff9640 20 handle_completion(): completion ok for obj=z[Y4YHD7uiOxXg92z3m28o.j5VeeSP2PI] 2024-09-12T18:09:41.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.884+0000 7f6ee02929c0 20 get_obj_state: octx=0x55641b575200 obj=myver:z state=0x55641b857fc8 s->prefetch_data=0 2024-09-12T18:09:41.885 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.884+0000 7f6ee02929c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=uc26t4xseg3x7wkdioixuutttu9l8k26 2024-09-12T18:09:41.889 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.888+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.892+0000 7f6ee02929c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18.3.9 2024-09-12T18:09:41.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.892+0000 7f6ee02929c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T18:09:41.893 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.892+0000 7f6ee02929c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T18:09:41.894 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.892+0000 7f6d8ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:41.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.900+0000 7f6ee02929c0 20 remove_watcher() i=0 2024-09-12T18:09:41.900 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.900+0000 7f6ee02929c0 2 removed watcher, disabling cache 2024-09-12T18:09:41.902 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.900+0000 7f6ee02929c0 20 remove_watcher() i=1 2024-09-12T18:09:41.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.904+0000 7f6ee02929c0 20 remove_watcher() i=2 2024-09-12T18:09:41.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.908+0000 7f6ee02929c0 20 remove_watcher() i=3 2024-09-12T18:09:41.909 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.908+0000 7f6ee02929c0 20 remove_watcher() i=4 2024-09-12T18:09:41.911 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.912+0000 7f6ee02929c0 20 remove_watcher() i=5 2024-09-12T18:09:41.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.912+0000 7f6ee02929c0 20 remove_watcher() i=6 2024-09-12T18:09:41.915 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:41.912+0000 7f6ee02929c0 20 remove_watcher() i=7 2024-09-12T18:09:42.257 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:09:42.289 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:42.290 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:42.333 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.332+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.332+0000 7f15812cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:42.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.332+0000 7f15812cd9c0 20 realm 2024-09-12T18:09:42.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.332+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.335 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.336+0000 7f15812cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:42.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.336+0000 7f15812cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:42.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.336+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.336+0000 7f15812cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:42.336 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.336+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.336+0000 7f15812cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:42.337 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.336+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.336+0000 7f15812cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:42.338 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.336+0000 7f15812cd9c0 20 searching for the correct realm 2024-09-12T18:09:42.344 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.344+0000 7f157e5d2640 0 -- 172.21.15.157:0/1527238354 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f1574120410 msgr2=0x7f15740e5030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:42.352 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.352+0000 7f157e5d2640 0 -- 172.21.15.157:0/1527238354 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f1448080930 msgr2=0x7f1448082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:42.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.356+0000 7f15812cd9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:09:42.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.356+0000 7f15812cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:42.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.356+0000 7f15812cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:42.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.356+0000 7f15812cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:09:42.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.356+0000 7f15812cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:42.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.356+0000 7f15812cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:42.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.356+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.356+0000 7f15812cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:42.359 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.356+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.360 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:42.360 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:42.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 zone default found 2024-09-12T18:09:42.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 4 Realm: () 2024-09-12T18:09:42.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:09:42.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:09:42.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:42.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 zonegroup default 2024-09-12T18:09:42.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:42.361 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:42.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:42.362 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 started sync module instance, tier type = 2024-09-12T18:09:42.363 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.360+0000 7f15812cd9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:09:42.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.376+0000 7f15812cd9c0 20 add_watcher() i=0 2024-09-12T18:09:42.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.376+0000 7f15812cd9c0 20 add_watcher() i=1 2024-09-12T18:09:42.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.376+0000 7f15812cd9c0 20 add_watcher() i=2 2024-09-12T18:09:42.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.376+0000 7f15812cd9c0 20 add_watcher() i=3 2024-09-12T18:09:42.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.376+0000 7f15812cd9c0 20 add_watcher() i=4 2024-09-12T18:09:42.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.376+0000 7f15812cd9c0 20 add_watcher() i=5 2024-09-12T18:09:42.377 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.376+0000 7f15812cd9c0 20 add_watcher() i=6 2024-09-12T18:09:42.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.376+0000 7f15812cd9c0 20 add_watcher() i=7 2024-09-12T18:09:42.378 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.376+0000 7f15812cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:42.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f1435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:42.381 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:42.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:42.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 5 note: GC not initialized 2024-09-12T18:09:42.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f1434fe1640 20 reqs_thread_entry: start 2024-09-12T18:09:42.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:09:42.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 Filter name: none 2024-09-12T18:09:42.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f142dffb640 20 reqs_thread_entry: start 2024-09-12T18:09:42.382 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:42.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:42.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:42.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:42.383 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.380+0000 7f15812cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:42.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.384+0000 7f15812cd9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:42.384 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.384+0000 7f15812cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:42.387 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.384+0000 7f1435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:42.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.392+0000 7f15812cd9c0 20 remove_watcher() i=0 2024-09-12T18:09:42.392 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.392+0000 7f15812cd9c0 2 removed watcher, disabling cache 2024-09-12T18:09:42.393 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.392+0000 7f15812cd9c0 20 remove_watcher() i=1 2024-09-12T18:09:42.395 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.396+0000 7f15812cd9c0 20 remove_watcher() i=2 2024-09-12T18:09:42.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.396+0000 7f15812cd9c0 20 remove_watcher() i=3 2024-09-12T18:09:42.399 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.400+0000 7f15812cd9c0 20 remove_watcher() i=4 2024-09-12T18:09:42.400 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.400+0000 7f15812cd9c0 20 remove_watcher() i=5 2024-09-12T18:09:42.402 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.400+0000 7f15812cd9c0 20 remove_watcher() i=6 2024-09-12T18:09:42.403 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:09:42.400+0000 7f15812cd9c0 20 remove_watcher() i=7 2024-09-12T18:09:42.417 INFO:tasks.workunit.client.0.smithi157.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T18:09:42.417 INFO:tasks.workunit.client.0.smithi157.stderr:Deleting bucket a-bucket 2024-09-12T18:09:42.548 INFO:tasks.workunit.client.0.smithi157.stderr:Deleting bucket myver 2024-09-12T18:09:43.143 INFO:tasks.workunit.client.0.smithi157.stderr:Completed resharding tests 2024-09-12T18:09:43.144 INFO:tasks.workunit.client.0.smithi157.stdout:connected to http://localhost:80 2024-09-12T18:09:43.267 INFO:tasks.workunit.client.0.smithi157.stderr:+ deactivate 2024-09-12T18:09:43.267 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T18:09:43.267 INFO:tasks.workunit.client.0.smithi157.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:09:43.267 INFO:tasks.workunit.client.0.smithi157.stderr:+ export PATH 2024-09-12T18:09:43.267 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:09:43.267 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n '' ']' 2024-09-12T18:09:43.267 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:09:43.267 INFO:tasks.workunit.client.0.smithi157.stderr:+ hash -r 2024-09-12T18:09:43.267 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n '' ']' 2024-09-12T18:09:43.267 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:09:43.267 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:09:43.268 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:09:43.268 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset -f deactivate 2024-09-12T18:09:43.268 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo OK. 2024-09-12T18:09:43.269 INFO:tasks.workunit.client.0.smithi157.stdout:OK. 2024-09-12T18:09:43.269 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:09:43.269 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:09:43.322 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T18:09:43.322 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:09:43.754 DEBUG:teuthology.parallel:result is None 2024-09-12T18:09:43.754 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:09:43.766 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:09:43.766 DEBUG:teuthology.orchestra.run.smithi157:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:09:43.812 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:09:43.812 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T18:09:43.826 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T18:09:43.826 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T18:09:43.826 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T18:09:43.826 DEBUG:teuthology.orchestra.run.smithi157:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:09:43.860 INFO:teuthology.orchestra.run.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T18:09:48.438 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T18:09:48.438 DEBUG:teuthology.orchestra.run.smithi157:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T18:09:48.528 INFO:teuthology.orchestra.run.smithi157.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T18:09:48.591 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-12T18:09:48.803 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-12T18:09:48.804 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-12T18:09:49.009 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:09:49.009 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:09:49.009 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:09:49.009 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:09:49.010 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:09:49.010 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:09:49.010 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:09:49.011 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-09-12T18:09:49.011 INFO:teuthology.orchestra.run.smithi157.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T18:09:49.012 INFO:teuthology.orchestra.run.smithi157.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T18:09:49.013 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-09-12T18:09:49.013 INFO:teuthology.orchestra.run.smithi157.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T18:09:49.013 INFO:teuthology.orchestra.run.smithi157.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T18:09:49.013 INFO:teuthology.orchestra.run.smithi157.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T18:09:49.047 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-09-12T18:09:49.048 INFO:teuthology.orchestra.run.smithi157.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T18:09:49.048 INFO:teuthology.orchestra.run.smithi157.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T18:09:49.231 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:09:49.231 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 46.0 MB of archives. 2024-09-12T18:09:49.231 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T18:09:49.231 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T18:09:49.597 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T18:09:49.951 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T18:09:49.952 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T18:09:49.958 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T18:09:49.959 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T18:09:51.021 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T18:09:51.023 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T18:09:51.268 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T18:09:51.671 INFO:teuthology.orchestra.run.smithi157.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T18:09:51.671 INFO:teuthology.orchestra.run.smithi157.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T18:09:51.671 INFO:teuthology.orchestra.run.smithi157.stderr:debconf: falling back to frontend: Readline 2024-09-12T18:09:51.683 INFO:teuthology.orchestra.run.smithi157.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T18:09:51.683 INFO:teuthology.orchestra.run.smithi157.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T18:09:51.683 INFO:teuthology.orchestra.run.smithi157.stderr:debconf: falling back to frontend: Teletype 2024-09-12T18:09:51.687 INFO:teuthology.orchestra.run.smithi157.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T18:09:51.721 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 46.0 MB in 2s (19.8 MB/s) 2024-09-12T18:09:51.832 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T18:09:51.923 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T18:09:51.929 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T18:09:52.063 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T18:09:52.876 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T18:09:52.905 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:09:52.968 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:09:53.455 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T18:09:53.484 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:09:53.522 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:09:53.791 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T18:09:53.808 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:09:53.849 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:09:54.102 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T18:09:54.119 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:09:54.160 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T18:09:54.672 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T18:09:54.701 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:09:54.743 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:09:56.286 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T18:09:56.315 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:09:56.356 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:09:56.816 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T18:09:56.845 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:09:56.886 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:09:57.662 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T18:09:57.691 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:09:57.732 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:09:58.057 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:09:59.153 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T18:09:59.180 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T18:09:59.204 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T18:09:59.587 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T18:09:59.755 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:00.124 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:10:00.216 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T18:10:00.284 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:10:00.377 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T18:10:00.405 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T18:10:00.430 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T18:10:00.455 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T18:10:00.590 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T18:10:00.768 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T18:10:00.896 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T18:10:01.005 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T18:10:01.056 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T18:10:01.106 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T18:10:01.133 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T18:10:01.158 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T18:10:01.222 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:01.357 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:01.516 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:10:01.625 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T18:10:01.743 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:01.870 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:10:02.971 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:10:03.072 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T18:10:03.332 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:10:03.855 INFO:teuthology.orchestra.run.smithi157.stdout: Gradle will be installed under /opt/gradle 2024-09-12T18:10:03.889 INFO:teuthology.orchestra.run.smithi157.stderr:--2024-09-12 18:10:03-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T18:10:03.894 INFO:teuthology.orchestra.run.smithi157.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4865, ... 2024-09-12T18:10:03.902 INFO:teuthology.orchestra.run.smithi157.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T18:10:03.942 INFO:teuthology.orchestra.run.smithi157.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T18:10:03.943 INFO:teuthology.orchestra.run.smithi157.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T18:10:03.943 INFO:teuthology.orchestra.run.smithi157.stderr:--2024-09-12 18:10:03-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T18:10:03.944 INFO:teuthology.orchestra.run.smithi157.stderr:Resolving github.com (github.com)... 140.82.113.3 2024-09-12T18:10:03.953 INFO:teuthology.orchestra.run.smithi157.stderr:Connecting to github.com (github.com)|140.82.113.3|:443... connected. 2024-09-12T18:10:04.050 INFO:teuthology.orchestra.run.smithi157.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T18:10:04.050 INFO:teuthology.orchestra.run.smithi157.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T181004Z&X-Amz-Expires=300&X-Amz-Signature=6f104673b0dba0c034b82f69909d336441ddc63a010fa3712998da31452db7de&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T18:10:04.050 INFO:teuthology.orchestra.run.smithi157.stderr:--2024-09-12 18:10:04-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T181004Z&X-Amz-Expires=300&X-Amz-Signature=6f104673b0dba0c034b82f69909d336441ddc63a010fa3712998da31452db7de&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T18:10:04.052 INFO:teuthology.orchestra.run.smithi157.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.111.133, 185.199.109.133, ... 2024-09-12T18:10:04.065 INFO:teuthology.orchestra.run.smithi157.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-12T18:10:04.146 INFO:teuthology.orchestra.run.smithi157.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T18:10:04.146 INFO:teuthology.orchestra.run.smithi157.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T18:10:04.146 INFO:teuthology.orchestra.run.smithi157.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T18:10:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-09-12T18:10:04.158 INFO:teuthology.orchestra.run.smithi157.stderr: 0K .......... .......... .......... .......... .......... 0% 3.87M 23s 2024-09-12T18:10:04.168 INFO:teuthology.orchestra.run.smithi157.stderr: 50K .......... .......... .......... .......... .......... 0% 4.66M 21s 2024-09-12T18:10:04.171 INFO:teuthology.orchestra.run.smithi157.stderr: 100K .......... .......... .......... .......... .......... 0% 20.8M 16s 2024-09-12T18:10:04.174 INFO:teuthology.orchestra.run.smithi157.stderr: 150K .......... .......... .......... .......... .......... 0% 19.7M 13s 2024-09-12T18:10:04.180 INFO:teuthology.orchestra.run.smithi157.stderr: 200K .......... .......... .......... .......... .......... 0% 7.72M 13s 2024-09-12T18:10:04.182 INFO:teuthology.orchestra.run.smithi157.stderr: 250K .......... .......... .......... .......... .......... 0% 25.9M 11s 2024-09-12T18:10:04.183 INFO:teuthology.orchestra.run.smithi157.stderr: 300K .......... .......... .......... .......... .......... 0% 42.5M 10s 2024-09-12T18:10:04.185 INFO:teuthology.orchestra.run.smithi157.stderr: 350K .......... .......... .......... .......... .......... 0% 30.4M 9s 2024-09-12T18:10:04.186 INFO:teuthology.orchestra.run.smithi157.stderr: 400K .......... .......... .......... .......... .......... 0% 39.4M 8s 2024-09-12T18:10:04.186 INFO:teuthology.orchestra.run.smithi157.stderr: 450K .......... .......... .......... .......... .......... 0% 50.2M 8s 2024-09-12T18:10:04.192 INFO:teuthology.orchestra.run.smithi157.stderr: 500K .......... .......... .......... .......... .......... 0% 9.44M 8s 2024-09-12T18:10:04.199 INFO:teuthology.orchestra.run.smithi157.stderr: 550K .......... .......... .......... .......... .......... 0% 30.3M 7s 2024-09-12T18:10:04.200 INFO:teuthology.orchestra.run.smithi157.stderr: 600K .......... .......... .......... .......... .......... 0% 81.5M 7s 2024-09-12T18:10:04.200 INFO:teuthology.orchestra.run.smithi157.stderr: 650K .......... .......... .......... .......... .......... 0% 88.6M 6s 2024-09-12T18:10:04.200 INFO:teuthology.orchestra.run.smithi157.stderr: 700K .......... .......... .......... .......... .......... 0% 56.0M 6s 2024-09-12T18:10:04.200 INFO:teuthology.orchestra.run.smithi157.stderr: 750K .......... .......... .......... .......... .......... 0% 74.4M 6s 2024-09-12T18:10:04.200 INFO:teuthology.orchestra.run.smithi157.stderr: 800K .......... .......... .......... .......... .......... 0% 88.3M 6s 2024-09-12T18:10:04.200 INFO:teuthology.orchestra.run.smithi157.stderr: 850K .......... .......... .......... .......... .......... 0% 72.1M 5s 2024-09-12T18:10:04.200 INFO:teuthology.orchestra.run.smithi157.stderr: 900K .......... .......... .......... .......... .......... 1% 82.3M 5s 2024-09-12T18:10:04.200 INFO:teuthology.orchestra.run.smithi157.stderr: 950K .......... .......... .......... .......... .......... 1% 89.3M 5s 2024-09-12T18:10:04.219 INFO:teuthology.orchestra.run.smithi157.stderr: 1000K .......... .......... .......... .......... .......... 1% 10.4M 5s 2024-09-12T18:10:04.219 INFO:teuthology.orchestra.run.smithi157.stderr: 1050K .......... .......... .......... .......... .......... 1% 84.9M 5s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1100K .......... .......... .......... .......... .......... 1% 53.9M 5s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1150K .......... .......... .......... .......... .......... 1% 85.3M 5s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1200K .......... .......... .......... .......... .......... 1% 92.6M 4s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1250K .......... .......... .......... .......... .......... 1% 82.0M 4s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1300K .......... .......... .......... .......... .......... 1% 81.4M 4s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1350K .......... .......... .......... .......... .......... 1% 85.6M 4s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1400K .......... .......... .......... .......... .......... 1% 88.1M 4s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1450K .......... .......... .......... .......... .......... 1% 89.2M 4s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1500K .......... .......... .......... .......... .......... 1% 73.4M 4s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1550K .......... .......... .......... .......... .......... 1% 85.3M 4s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1600K .......... .......... .......... .......... .......... 1% 85.2M 4s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1650K .......... .......... .......... .......... .......... 1% 89.0M 4s 2024-09-12T18:10:04.220 INFO:teuthology.orchestra.run.smithi157.stderr: 1700K .......... .......... .......... .......... .......... 1% 78.0M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 1750K .......... .......... .......... .......... .......... 1% 90.0M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 1800K .......... .......... .......... .......... .......... 1% 91.8M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 1850K .......... .......... .......... .......... .......... 2% 91.8M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 1900K .......... .......... .......... .......... .......... 2% 75.1M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 1950K .......... .......... .......... .......... .......... 2% 90.3M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 2000K .......... .......... .......... .......... .......... 2% 84.9M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 2050K .......... .......... .......... .......... .......... 2% 84.7M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 2100K .......... .......... .......... .......... .......... 2% 79.0M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 2150K .......... .......... .......... .......... .......... 2% 86.0M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 2200K .......... .......... .......... .......... .......... 2% 82.5M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 2250K .......... .......... .......... .......... .......... 2% 84.4M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 2300K .......... .......... .......... .......... .......... 2% 69.8M 3s 2024-09-12T18:10:04.221 INFO:teuthology.orchestra.run.smithi157.stderr: 2350K .......... .......... .......... .......... .......... 2% 81.8M 3s 2024-09-12T18:10:04.228 INFO:teuthology.orchestra.run.smithi157.stderr: 2400K .......... .......... .......... .......... .......... 2% 82.0M 3s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 2450K .......... .......... .......... .......... .......... 2% 82.9M 3s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 2500K .......... .......... .......... .......... .......... 2% 76.6M 3s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 2550K .......... .......... .......... .......... .......... 2% 84.4M 3s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 2600K .......... .......... .......... .......... .......... 2% 83.6M 3s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 2650K .......... .......... .......... .......... .......... 2% 86.2M 3s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 2700K .......... .......... .......... .......... .......... 2% 74.4M 3s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 2750K .......... .......... .......... .......... .......... 3% 85.0M 3s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 2800K .......... .......... .......... .......... .......... 3% 89.9M 2s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 2850K .......... .......... .......... .......... .......... 3% 89.2M 2s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 2900K .......... .......... .......... .......... .......... 3% 78.8M 2s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 2950K .......... .......... .......... .......... .......... 3% 89.0M 2s 2024-09-12T18:10:04.229 INFO:teuthology.orchestra.run.smithi157.stderr: 3000K .......... .......... .......... .......... .......... 3% 82.1M 2s 2024-09-12T18:10:04.230 INFO:teuthology.orchestra.run.smithi157.stderr: 3050K .......... .......... .......... .......... .......... 3% 83.1M 2s 2024-09-12T18:10:05.386 INFO:teuthology.orchestra.run.smithi157.stderr: 3100K .......... .......... .......... .......... .......... 3% 71.7M 2s 2024-09-12T18:10:05.386 INFO:teuthology.orchestra.run.smithi157.stderr: 3150K .......... .......... .......... .......... .......... 3% 81.6M 2s 2024-09-12T18:10:05.386 INFO:teuthology.orchestra.run.smithi157.stderr: 3200K .......... .......... .......... .......... .......... 3% 76.2M 2s 2024-09-12T18:10:05.386 INFO:teuthology.orchestra.run.smithi157.stderr: 3250K .......... .......... .......... .......... .......... 3% 83.1M 2s 2024-09-12T18:10:05.386 INFO:teuthology.orchestra.run.smithi157.stderr: 3300K .......... .......... .......... .......... .......... 3% 73.8M 2s 2024-09-12T18:10:05.386 INFO:teuthology.orchestra.run.smithi157.stderr: 3350K .......... .......... .......... .......... .......... 3% 83.1M 2s 2024-09-12T18:10:05.386 INFO:teuthology.orchestra.run.smithi157.stderr: 3400K .......... .......... .......... .......... .......... 3% 78.4M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 3450K .......... .......... .......... .......... .......... 3% 87.5M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 3500K .......... .......... .......... .......... .......... 3% 68.4M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 3550K .......... .......... .......... .......... .......... 3% 84.1M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 3600K .......... .......... .......... .......... .......... 3% 87.9M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 3650K .......... .......... .......... .......... .......... 3% 87.3M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 3700K .......... .......... .......... .......... .......... 4% 81.1M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 3750K .......... .......... .......... .......... .......... 4% 86.0M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 3800K .......... .......... .......... .......... .......... 4% 95.6M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 3850K .......... .......... .......... .......... .......... 4% 94.4M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 3900K .......... .......... .......... .......... .......... 4% 76.0M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 3950K .......... .......... .......... .......... .......... 4% 86.1M 2s 2024-09-12T18:10:05.387 INFO:teuthology.orchestra.run.smithi157.stderr: 4000K .......... .......... .......... .......... .......... 4% 91.8M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4050K .......... .......... .......... .......... .......... 4% 92.5M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4100K .......... .......... .......... .......... .......... 4% 78.5M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4150K .......... .......... .......... .......... .......... 4% 93.7M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4200K .......... .......... .......... .......... .......... 4% 77.9M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4250K .......... .......... .......... .......... .......... 4% 102M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4300K .......... .......... .......... .......... .......... 4% 80.1M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4350K .......... .......... .......... .......... .......... 4% 99.9M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4400K .......... .......... .......... .......... .......... 4% 97.7M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4450K .......... .......... .......... .......... .......... 4% 94.9M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4500K .......... .......... .......... .......... .......... 4% 96.4M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4550K .......... .......... .......... .......... .......... 4% 110M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4600K .......... .......... .......... .......... .......... 5% 106M 2s 2024-09-12T18:10:05.388 INFO:teuthology.orchestra.run.smithi157.stderr: 4650K .......... .......... .......... .......... .......... 5% 109M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 4700K .......... .......... .......... .......... .......... 5% 85.4M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 4750K .......... .......... .......... .......... .......... 5% 109M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 4800K .......... .......... .......... .......... .......... 5% 107M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 4850K .......... .......... .......... .......... .......... 5% 109M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 4900K .......... .......... .......... .......... .......... 5% 92.8M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 4950K .......... .......... .......... .......... .......... 5% 113M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 5000K .......... .......... .......... .......... .......... 5% 114M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 5050K .......... .......... .......... .......... .......... 5% 114M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 5100K .......... .......... .......... .......... .......... 5% 91.5M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 5150K .......... .......... .......... .......... .......... 5% 109M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 5200K .......... .......... .......... .......... .......... 5% 110M 2s 2024-09-12T18:10:05.389 INFO:teuthology.orchestra.run.smithi157.stderr: 5250K .......... .......... .......... .......... .......... 5% 107M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5300K .......... .......... .......... .......... .......... 5% 96.3M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5350K .......... .......... .......... .......... .......... 5% 180M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5400K .......... .......... .......... .......... .......... 5% 152M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5450K .......... .......... .......... .......... .......... 5% 186M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5500K .......... .......... .......... .......... .......... 5% 137M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5550K .......... .......... .......... .......... .......... 6% 198M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5600K .......... .......... .......... .......... .......... 6% 204M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5650K .......... .......... .......... .......... .......... 6% 163M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5700K .......... .......... .......... .......... .......... 6% 175M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5750K .......... .......... .......... .......... .......... 6% 206M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5800K .......... .......... .......... .......... .......... 6% 168M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5850K .......... .......... .......... .......... .......... 6% 197M 2s 2024-09-12T18:10:05.390 INFO:teuthology.orchestra.run.smithi157.stderr: 5900K .......... .......... .......... .......... .......... 6% 157M 2s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 5950K .......... .......... .......... .......... .......... 6% 174M 2s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6000K .......... .......... .......... .......... .......... 6% 185M 2s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6050K .......... .......... .......... .......... .......... 6% 185M 2s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6100K .......... .......... .......... .......... .......... 6% 137M 2s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6150K .......... .......... .......... .......... .......... 6% 200M 2s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6200K .......... .......... .......... .......... .......... 6% 209M 2s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6250K .......... .......... .......... .......... .......... 6% 171M 2s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6300K .......... .......... .......... .......... .......... 6% 175M 2s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6350K .......... .......... .......... .......... .......... 6% 213M 2s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6400K .......... .......... .......... .......... .......... 6% 207M 2s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6450K .......... .......... .......... .......... .......... 6% 214M 1s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6500K .......... .......... .......... .......... .......... 7% 133M 1s 2024-09-12T18:10:05.391 INFO:teuthology.orchestra.run.smithi157.stderr: 6550K .......... .......... .......... .......... .......... 7% 168M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 6600K .......... .......... .......... .......... .......... 7% 215M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 6650K .......... .......... .......... .......... .......... 7% 200M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 6700K .......... .......... .......... .......... .......... 7% 181M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 6750K .......... .......... .......... .......... .......... 7% 186M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 6800K .......... .......... .......... .......... .......... 7% 212M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 6850K .......... .......... .......... .......... .......... 7% 212M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 6900K .......... .......... .......... .......... .......... 7% 200M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 6950K .......... .......... .......... .......... .......... 7% 225M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 7000K .......... .......... .......... .......... .......... 7% 224M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 7050K .......... .......... .......... .......... .......... 7% 159M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 7100K .......... .......... .......... .......... .......... 7% 102M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 7150K .......... .......... .......... .......... .......... 7% 171M 1s 2024-09-12T18:10:05.392 INFO:teuthology.orchestra.run.smithi157.stderr: 7200K .......... .......... .......... .......... .......... 7% 228M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7250K .......... .......... .......... .......... .......... 7% 175M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7300K .......... .......... .......... .......... .......... 7% 200M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7350K .......... .......... .......... .......... .......... 7% 165M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7400K .......... .......... .......... .......... .......... 8% 163M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7450K .......... .......... .......... .......... .......... 8% 180M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7500K .......... .......... .......... .......... .......... 8% 128M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7550K .......... .......... .......... .......... .......... 8% 181M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7600K .......... .......... .......... .......... .......... 8% 147M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7650K .......... .......... .......... .......... .......... 8% 209M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7700K .......... .......... .......... .......... .......... 8% 171M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7750K .......... .......... .......... .......... .......... 8% 139M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7800K .......... .......... .......... .......... .......... 8% 240M 1s 2024-09-12T18:10:05.393 INFO:teuthology.orchestra.run.smithi157.stderr: 7850K .......... .......... .......... .......... .......... 8% 200M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 7900K .......... .......... .......... .......... .......... 8% 157M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 7950K .......... .......... .......... .......... .......... 8% 211M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 8000K .......... .......... .......... .......... .......... 8% 237M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 8050K .......... .......... .......... .......... .......... 8% 178M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 8100K .......... .......... .......... .......... .......... 8% 209M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 8150K .......... .......... .......... .......... .......... 8% 244M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 8200K .......... .......... .......... .......... .......... 8% 233M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 8250K .......... .......... .......... .......... .......... 8% 180M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 8300K .......... .......... .......... .......... .......... 8% 144M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 8350K .......... .......... .......... .......... .......... 9% 218M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 8400K .......... .......... .......... .......... .......... 9% 213M 1s 2024-09-12T18:10:05.394 INFO:teuthology.orchestra.run.smithi157.stderr: 8450K .......... .......... .......... .......... .......... 9% 189M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 8500K .......... .......... .......... .......... .......... 9% 171M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 8550K .......... .......... .......... .......... .......... 9% 175M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 8600K .......... .......... .......... .......... .......... 9% 191M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 8650K .......... .......... .......... .......... .......... 9% 239M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 8700K .......... .......... .......... .......... .......... 9% 127M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 8750K .......... .......... .......... .......... .......... 9% 152M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 8800K .......... .......... .......... .......... .......... 9% 162M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 8850K .......... .......... .......... .......... .......... 9% 197M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 8900K .......... .......... .......... .......... .......... 9% 147M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 8950K .......... .......... .......... .......... .......... 9% 149M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 9000K .......... .......... .......... .......... .......... 9% 200M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 9050K .......... .......... .......... .......... .......... 9% 233M 1s 2024-09-12T18:10:05.395 INFO:teuthology.orchestra.run.smithi157.stderr: 9100K .......... .......... .......... .......... .......... 9% 174M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9150K .......... .......... .......... .......... .......... 9% 172M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9200K .......... .......... .......... .......... .......... 9% 139M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9250K .......... .......... .......... .......... .......... 10% 153M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9300K .......... .......... .......... .......... .......... 10% 151M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9350K .......... .......... .......... .......... .......... 10% 185M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9400K .......... .......... .......... .......... .......... 10% 225M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9450K .......... .......... .......... .......... .......... 10% 144M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9500K .......... .......... .......... .......... .......... 10% 172M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9550K .......... .......... .......... .......... .......... 10% 229M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9600K .......... .......... .......... .......... .......... 10% 164M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9650K .......... .......... .......... .......... .......... 10% 157M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9700K .......... .......... .......... .......... .......... 10% 141M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9750K .......... .......... .......... .......... .......... 10% 236M 1s 2024-09-12T18:10:05.396 INFO:teuthology.orchestra.run.smithi157.stderr: 9800K .......... .......... .......... .......... .......... 10% 228M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 9850K .......... .......... .......... .......... .......... 10% 189M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 9900K .......... .......... .......... .......... .......... 10% 137M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 9950K .......... .......... .......... .......... .......... 10% 231M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 10000K .......... .......... .......... .......... .......... 10% 195M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 10050K .......... .......... .......... .......... .......... 10% 170M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 10100K .......... .......... .......... .......... .......... 10% 199M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 10150K .......... .......... .......... .......... .......... 10% 172M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 10200K .......... .......... .......... .......... .......... 11% 216M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 10250K .......... .......... .......... .......... .......... 11% 265M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 10300K .......... .......... .......... .......... .......... 11% 225M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 10350K .......... .......... .......... .......... .......... 11% 162M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 10400K .......... .......... .......... .......... .......... 11% 164M 1s 2024-09-12T18:10:05.397 INFO:teuthology.orchestra.run.smithi157.stderr: 10450K .......... .......... .......... .......... .......... 11% 214M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 10500K .......... .......... .......... .......... .......... 11% 180M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 10550K .......... .......... .......... .......... .......... 11% 193M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 10600K .......... .......... .......... .......... .......... 11% 269M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 10650K .......... .......... .......... .......... .......... 11% 220M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 10700K .......... .......... .......... .......... .......... 11% 249M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 10750K .......... .......... .......... .......... .......... 11% 191M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 10800K .......... .......... .......... .......... .......... 11% 266M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 10850K .......... .......... .......... .......... .......... 11% 225M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 10900K .......... .......... .......... .......... .......... 11% 155M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 10950K .......... .......... .......... .......... .......... 11% 201M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 11000K .......... .......... .......... .......... .......... 11% 237M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 11050K .......... .......... .......... .......... .......... 11% 246M 1s 2024-09-12T18:10:05.398 INFO:teuthology.orchestra.run.smithi157.stderr: 11100K .......... .......... .......... .......... .......... 12% 280M 1s 2024-09-12T18:10:05.399 INFO:teuthology.orchestra.run.smithi157.stderr: 11150K .......... .......... .......... .......... .......... 12% 209M 1s 2024-09-12T18:10:05.399 INFO:teuthology.orchestra.run.smithi157.stderr: 11200K .......... .......... .......... .......... .......... 12% 262M 1s 2024-09-12T18:10:05.399 INFO:teuthology.orchestra.run.smithi157.stderr: 11250K .......... .......... .......... .......... .......... 12% 241M 1s 2024-09-12T18:10:05.399 INFO:teuthology.orchestra.run.smithi157.stderr: 11300K .......... .......... .......... .......... .......... 12% 269M 1s 2024-09-12T18:10:05.399 INFO:teuthology.orchestra.run.smithi157.stderr: 11350K .......... .......... .......... .......... .......... 12% 218M 1s 2024-09-12T18:10:05.399 INFO:teuthology.orchestra.run.smithi157.stderr: 11400K .......... .......... .......... .......... .......... 12% 249M 1s 2024-09-12T18:10:05.399 INFO:teuthology.orchestra.run.smithi157.stderr: 11450K .......... .......... .......... .......... .......... 12% 250M 1s 2024-09-12T18:10:05.399 INFO:teuthology.orchestra.run.smithi157.stderr: 11500K .......... .......... .......... .......... .......... 12% 253M 1s 2024-09-12T18:10:05.399 INFO:teuthology.orchestra.run.smithi157.stderr: 11550K .......... .......... .......... .......... .......... 12% 153M 1s 2024-09-12T18:10:05.399 INFO:teuthology.orchestra.run.smithi157.stderr: 11600K .......... .......... .......... .......... .......... 12% 152M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 11650K .......... .......... .......... .......... .......... 12% 177M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 11700K .......... .......... .......... .......... .......... 12% 200M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 11750K .......... .......... .......... .......... .......... 12% 176M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 11800K .......... .......... .......... .......... .......... 12% 247M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 11850K .......... .......... .......... .......... .......... 12% 267M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 11900K .......... .......... .......... .......... .......... 12% 233M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 11950K .......... .......... .......... .......... .......... 12% 240M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 12000K .......... .......... .......... .......... .......... 12% 257M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 12050K .......... .......... .......... .......... .......... 13% 276M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 12100K .......... .......... .......... .......... .......... 13% 261M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 12150K .......... .......... .......... .......... .......... 13% 215M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 12200K .......... .......... .......... .......... .......... 13% 240M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 12250K .......... .......... .......... .......... .......... 13% 212M 1s 2024-09-12T18:10:05.400 INFO:teuthology.orchestra.run.smithi157.stderr: 12300K .......... .......... .......... .......... .......... 13% 296M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12350K .......... .......... .......... .......... .......... 13% 247M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12400K .......... .......... .......... .......... .......... 13% 161M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12450K .......... .......... .......... .......... .......... 13% 253M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12500K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12550K .......... .......... .......... .......... .......... 13% 240M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12600K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12650K .......... .......... .......... .......... .......... 13% 211M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12700K .......... .......... .......... .......... .......... 13% 270M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12750K .......... .......... .......... .......... .......... 13% 174M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12800K .......... .......... .......... .......... .......... 13% 270M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12850K .......... .......... .......... .......... .......... 13% 280M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12900K .......... .......... .......... .......... .......... 13% 263M 1s 2024-09-12T18:10:05.401 INFO:teuthology.orchestra.run.smithi157.stderr: 12950K .......... .......... .......... .......... .......... 13% 241M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13000K .......... .......... .......... .......... .......... 14% 222M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13050K .......... .......... .......... .......... .......... 14% 222M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13100K .......... .......... .......... .......... .......... 14% 253M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13150K .......... .......... .......... .......... .......... 14% 180M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13200K .......... .......... .......... .......... .......... 14% 224M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13250K .......... .......... .......... .......... .......... 14% 233M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13300K .......... .......... .......... .......... .......... 14% 288M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13350K .......... .......... .......... .......... .......... 14% 247M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13400K .......... .......... .......... .......... .......... 14% 241M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13450K .......... .......... .......... .......... .......... 14% 293M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13500K .......... .......... .......... .......... .......... 14% 273M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13550K .......... .......... .......... .......... .......... 14% 202M 1s 2024-09-12T18:10:05.402 INFO:teuthology.orchestra.run.smithi157.stderr: 13600K .......... .......... .......... .......... .......... 14% 240M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 13650K .......... .......... .......... .......... .......... 14% 207M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 13700K .......... .......... .......... .......... .......... 14% 261M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 13750K .......... .......... .......... .......... .......... 14% 210M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 13800K .......... .......... .......... .......... .......... 14% 284M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 13850K .......... .......... .......... .......... .......... 14% 294M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 13900K .......... .......... .......... .......... .......... 15% 279M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 13950K .......... .......... .......... .......... .......... 15% 237M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 14000K .......... .......... .......... .......... .......... 15% 296M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 14050K .......... .......... .......... .......... .......... 15% 267M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 14100K .......... .......... .......... .......... .......... 15% 302M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 14150K .......... .......... .......... .......... .......... 15% 220M 1s 2024-09-12T18:10:05.403 INFO:teuthology.orchestra.run.smithi157.stderr: 14200K .......... .......... .......... .......... .......... 15% 283M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14250K .......... .......... .......... .......... .......... 15% 93.8M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14300K .......... .......... .......... .......... .......... 15% 230M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14350K .......... .......... .......... .......... .......... 15% 209M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14400K .......... .......... .......... .......... .......... 15% 224M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14450K .......... .......... .......... .......... .......... 15% 223M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14500K .......... .......... .......... .......... .......... 15% 230M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14550K .......... .......... .......... .......... .......... 15% 221M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14600K .......... .......... .......... .......... .......... 15% 295M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14650K .......... .......... .......... .......... .......... 15% 213M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14700K .......... .......... .......... .......... .......... 15% 270M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14750K .......... .......... .......... .......... .......... 15% 265M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14800K .......... .......... .......... .......... .......... 15% 305M 1s 2024-09-12T18:10:05.404 INFO:teuthology.orchestra.run.smithi157.stderr: 14850K .......... .......... .......... .......... .......... 16% 324M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 14900K .......... .......... .......... .......... .......... 16% 274M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 14950K .......... .......... .......... .......... .......... 16% 218M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 15000K .......... .......... .......... .......... .......... 16% 227M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 15050K .......... .......... .......... .......... .......... 16% 270M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 15100K .......... .......... .......... .......... .......... 16% 325M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 15150K .......... .......... .......... .......... .......... 16% 225M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 15200K .......... .......... .......... .......... .......... 16% 248M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 15250K .......... .......... .......... .......... .......... 16% 225M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 15300K .......... .......... .......... .......... .......... 16% 217M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 15350K .......... .......... .......... .......... .......... 16% 273M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 15400K .......... .......... .......... .......... .......... 16% 323M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 15450K .......... .......... .......... .......... .......... 16% 195M 1s 2024-09-12T18:10:05.405 INFO:teuthology.orchestra.run.smithi157.stderr: 15500K .......... .......... .......... .......... .......... 16% 252M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 15550K .......... .......... .......... .......... .......... 16% 194M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 15600K .......... .......... .......... .......... .......... 16% 314M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 15650K .......... .......... .......... .......... .......... 16% 271M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 15700K .......... .......... .......... .......... .......... 16% 305M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 15750K .......... .......... .......... .......... .......... 17% 328M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 15800K .......... .......... .......... .......... .......... 17% 298M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 15850K .......... .......... .......... .......... .......... 17% 271M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 15900K .......... .......... .......... .......... .......... 17% 204M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 15950K .......... .......... .......... .......... .......... 17% 177M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 16000K .......... .......... .......... .......... .......... 17% 247M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 16050K .......... .......... .......... .......... .......... 17% 275M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 16100K .......... .......... .......... .......... .......... 17% 329M 1s 2024-09-12T18:10:05.406 INFO:teuthology.orchestra.run.smithi157.stderr: 16150K .......... .......... .......... .......... .......... 17% 266M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16200K .......... .......... .......... .......... .......... 17% 268M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16250K .......... .......... .......... .......... .......... 17% 247M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16300K .......... .......... .......... .......... .......... 17% 291M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16350K .......... .......... .......... .......... .......... 17% 274M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16400K .......... .......... .......... .......... .......... 17% 90.6M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16450K .......... .......... .......... .......... .......... 17% 206M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16500K .......... .......... .......... .......... .......... 17% 194M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16550K .......... .......... .......... .......... .......... 17% 223M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16600K .......... .......... .......... .......... .......... 17% 236M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16650K .......... .......... .......... .......... .......... 17% 294M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16700K .......... .......... .......... .......... .......... 18% 283M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16750K .......... .......... .......... .......... .......... 18% 271M 1s 2024-09-12T18:10:05.407 INFO:teuthology.orchestra.run.smithi157.stderr: 16800K .......... .......... .......... .......... .......... 18% 268M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 16850K .......... .......... .......... .......... .......... 18% 324M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 16900K .......... .......... .......... .......... .......... 18% 47.2M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 16950K .......... .......... .......... .......... .......... 18% 184M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 17000K .......... .......... .......... .......... .......... 18% 235M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 17050K .......... .......... .......... .......... .......... 18% 227M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 17100K .......... .......... .......... .......... .......... 18% 234M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 17150K .......... .......... .......... .......... .......... 18% 195M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 17200K .......... .......... .......... .......... .......... 18% 241M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 17250K .......... .......... .......... .......... .......... 18% 246M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 17300K .......... .......... .......... .......... .......... 18% 245M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 17350K .......... .......... .......... .......... .......... 18% 195M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 17400K .......... .......... .......... .......... .......... 18% 286M 1s 2024-09-12T18:10:05.408 INFO:teuthology.orchestra.run.smithi157.stderr: 17450K .......... .......... .......... .......... .......... 18% 311M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 17500K .......... .......... .......... .......... .......... 18% 329M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 17550K .......... .......... .......... .......... .......... 18% 201M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 17600K .......... .......... .......... .......... .......... 18% 218M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 17650K .......... .......... .......... .......... .......... 19% 250M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 17700K .......... .......... .......... .......... .......... 19% 235M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 17750K .......... .......... .......... .......... .......... 19% 248M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 17800K .......... .......... .......... .......... .......... 19% 289M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 17850K .......... .......... .......... .......... .......... 19% 199M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 17900K .......... .......... .......... .......... .......... 19% 303M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 17950K .......... .......... .......... .......... .......... 19% 196M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 18000K .......... .......... .......... .......... .......... 19% 312M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 18050K .......... .......... .......... .......... .......... 19% 272M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 18100K .......... .......... .......... .......... .......... 19% 224M 1s 2024-09-12T18:10:05.409 INFO:teuthology.orchestra.run.smithi157.stderr: 18150K .......... .......... .......... .......... .......... 19% 243M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18200K .......... .......... .......... .......... .......... 19% 260M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18250K .......... .......... .......... .......... .......... 19% 279M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18300K .......... .......... .......... .......... .......... 19% 335M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18350K .......... .......... .......... .......... .......... 19% 255M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18400K .......... .......... .......... .......... .......... 19% 329M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18450K .......... .......... .......... .......... .......... 19% 317M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18500K .......... .......... .......... .......... .......... 19% 299M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18550K .......... .......... .......... .......... .......... 20% 289M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18600K .......... .......... .......... .......... .......... 20% 271M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18650K .......... .......... .......... .......... .......... 20% 263M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18700K .......... .......... .......... .......... .......... 20% 269M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18750K .......... .......... .......... .......... .......... 20% 209M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18800K .......... .......... .......... .......... .......... 20% 307M 1s 2024-09-12T18:10:05.410 INFO:teuthology.orchestra.run.smithi157.stderr: 18850K .......... .......... .......... .......... .......... 20% 318M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 18900K .......... .......... .......... .......... .......... 20% 300M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 18950K .......... .......... .......... .......... .......... 20% 246M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 19000K .......... .......... .......... .......... .......... 20% 190M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 19050K .......... .......... .......... .......... .......... 20% 280M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 19100K .......... .......... .......... .......... .......... 20% 321M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 19150K .......... .......... .......... .......... .......... 20% 201M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 19200K .......... .......... .......... .......... .......... 20% 254M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 19250K .......... .......... .......... .......... .......... 20% 230M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 19300K .......... .......... .......... .......... .......... 20% 268M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 19350K .......... .......... .......... .......... .......... 20% 230M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 19400K .......... .......... .......... .......... .......... 20% 272M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 19450K .......... .......... .......... .......... .......... 20% 318M 1s 2024-09-12T18:10:05.411 INFO:teuthology.orchestra.run.smithi157.stderr: 19500K .......... .......... .......... .......... .......... 21% 288M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 19550K .......... .......... .......... .......... .......... 21% 296M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 19600K .......... .......... .......... .......... .......... 21% 326M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 19650K .......... .......... .......... .......... .......... 21% 297M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 19700K .......... .......... .......... .......... .......... 21% 44.7M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 19750K .......... .......... .......... .......... .......... 21% 175M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 19800K .......... .......... .......... .......... .......... 21% 221M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 19850K .......... .......... .......... .......... .......... 21% 170M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 19900K .......... .......... .......... .......... .......... 21% 180M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 19950K .......... .......... .......... .......... .......... 21% 166M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 20000K .......... .......... .......... .......... .......... 21% 201M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 20050K .......... .......... .......... .......... .......... 21% 208M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 20100K .......... .......... .......... .......... .......... 21% 178M 1s 2024-09-12T18:10:05.412 INFO:teuthology.orchestra.run.smithi157.stderr: 20150K .......... .......... .......... .......... .......... 21% 223M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20200K .......... .......... .......... .......... .......... 21% 216M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20250K .......... .......... .......... .......... .......... 21% 163M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20300K .......... .......... .......... .......... .......... 21% 185M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20350K .......... .......... .......... .......... .......... 21% 192M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20400K .......... .......... .......... .......... .......... 22% 218M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20450K .......... .......... .......... .......... .......... 22% 155M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20500K .......... .......... .......... .......... .......... 22% 185M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20550K .......... .......... .......... .......... .......... 22% 168M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20600K .......... .......... .......... .......... .......... 22% 170M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20650K .......... .......... .......... .......... .......... 22% 168M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20700K .......... .......... .......... .......... .......... 22% 163M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20750K .......... .......... .......... .......... .......... 22% 230M 1s 2024-09-12T18:10:05.413 INFO:teuthology.orchestra.run.smithi157.stderr: 20800K .......... .......... .......... .......... .......... 22% 256M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 20850K .......... .......... .......... .......... .......... 22% 253M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 20900K .......... .......... .......... .......... .......... 22% 207M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 20950K .......... .......... .......... .......... .......... 22% 250M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 21000K .......... .......... .......... .......... .......... 22% 188M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 21050K .......... .......... .......... .......... .......... 22% 169M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 21100K .......... .......... .......... .......... .......... 22% 143M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 21150K .......... .......... .......... .......... .......... 22% 201M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 21200K .......... .......... .......... .......... .......... 22% 237M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 21250K .......... .......... .......... .......... .......... 22% 202M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 21300K .......... .......... .......... .......... .......... 22% 143M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 21350K .......... .......... .......... .......... .......... 23% 169M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 21400K .......... .......... .......... .......... .......... 23% 154M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 21450K .......... .......... .......... .......... .......... 23% 248M 1s 2024-09-12T18:10:05.414 INFO:teuthology.orchestra.run.smithi157.stderr: 21500K .......... .......... .......... .......... .......... 23% 157M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 21550K .......... .......... .......... .......... .......... 23% 186M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 21600K .......... .......... .......... .......... .......... 23% 221M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 21650K .......... .......... .......... .......... .......... 23% 260M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 21700K .......... .......... .......... .......... .......... 23% 234M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 21750K .......... .......... .......... .......... .......... 23% 238M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 21800K .......... .......... .......... .......... .......... 23% 263M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 21850K .......... .......... .......... .......... .......... 23% 245M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 21900K .......... .......... .......... .......... .......... 23% 215M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 21950K .......... .......... .......... .......... .......... 23% 248M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 22000K .......... .......... .......... .......... .......... 23% 251M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 22050K .......... .......... .......... .......... .......... 23% 166M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 22100K .......... .......... .......... .......... .......... 23% 151M 1s 2024-09-12T18:10:05.415 INFO:teuthology.orchestra.run.smithi157.stderr: 22150K .......... .......... .......... .......... .......... 23% 183M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22200K .......... .......... .......... .......... .......... 23% 162M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22250K .......... .......... .......... .......... .......... 24% 213M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22300K .......... .......... .......... .......... .......... 24% 166M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22350K .......... .......... .......... .......... .......... 24% 268M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22400K .......... .......... .......... .......... .......... 24% 204M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22450K .......... .......... .......... .......... .......... 24% 196M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22500K .......... .......... .......... .......... .......... 24% 195M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22550K .......... .......... .......... .......... .......... 24% 169M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22600K .......... .......... .......... .......... .......... 24% 168M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22650K .......... .......... .......... .......... .......... 24% 179M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22700K .......... .......... .......... .......... .......... 24% 154M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22750K .......... .......... .......... .......... .......... 24% 217M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22800K .......... .......... .......... .......... .......... 24% 194M 1s 2024-09-12T18:10:05.416 INFO:teuthology.orchestra.run.smithi157.stderr: 22850K .......... .......... .......... .......... .......... 24% 244M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 22900K .......... .......... .......... .......... .......... 24% 218M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 22950K .......... .......... .......... .......... .......... 24% 198M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 23000K .......... .......... .......... .......... .......... 24% 235M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 23050K .......... .......... .......... .......... .......... 24% 214M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 23100K .......... .......... .......... .......... .......... 24% 234M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 23150K .......... .......... .......... .......... .......... 24% 225M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 23200K .......... .......... .......... .......... .......... 25% 284M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 23250K .......... .......... .......... .......... .......... 25% 245M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 23300K .......... .......... .......... .......... .......... 25% 256M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 23350K .......... .......... .......... .......... .......... 25% 266M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 23400K .......... .......... .......... .......... .......... 25% 213M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 23450K .......... .......... .......... .......... .......... 25% 237M 1s 2024-09-12T18:10:05.417 INFO:teuthology.orchestra.run.smithi157.stderr: 23500K .......... .......... .......... .......... .......... 25% 155M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 23550K .......... .......... .......... .......... .......... 25% 188M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 23600K .......... .......... .......... .......... .......... 25% 221M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 23650K .......... .......... .......... .......... .......... 25% 204M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 23700K .......... .......... .......... .......... .......... 25% 235M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 23750K .......... .......... .......... .......... .......... 25% 186M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 23800K .......... .......... .......... .......... .......... 25% 227M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 23850K .......... .......... .......... .......... .......... 25% 200M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 23900K .......... .......... .......... .......... .......... 25% 217M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 23950K .......... .......... .......... .......... .......... 25% 220M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 24000K .......... .......... .......... .......... .......... 25% 205M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 24050K .......... .......... .......... .......... .......... 25% 207M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 24100K .......... .......... .......... .......... .......... 25% 257M 1s 2024-09-12T18:10:05.418 INFO:teuthology.orchestra.run.smithi157.stderr: 24150K .......... .......... .......... .......... .......... 26% 276M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24200K .......... .......... .......... .......... .......... 26% 293M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24250K .......... .......... .......... .......... .......... 26% 256M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24300K .......... .......... .......... .......... .......... 26% 244M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24350K .......... .......... .......... .......... .......... 26% 254M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24400K .......... .......... .......... .......... .......... 26% 294M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24450K .......... .......... .......... .......... .......... 26% 295M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24500K .......... .......... .......... .......... .......... 26% 248M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24550K .......... .......... .......... .......... .......... 26% 183M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24600K .......... .......... .......... .......... .......... 26% 184M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24650K .......... .......... .......... .......... .......... 26% 203M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24700K .......... .......... .......... .......... .......... 26% 171M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24750K .......... .......... .......... .......... .......... 26% 196M 1s 2024-09-12T18:10:05.419 INFO:teuthology.orchestra.run.smithi157.stderr: 24800K .......... .......... .......... .......... .......... 26% 185M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 24850K .......... .......... .......... .......... .......... 26% 302M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 24900K .......... .......... .......... .......... .......... 26% 244M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 24950K .......... .......... .......... .......... .......... 26% 232M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 25000K .......... .......... .......... .......... .......... 26% 219M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 25050K .......... .......... .......... .......... .......... 27% 225M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 25100K .......... .......... .......... .......... .......... 27% 215M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 25150K .......... .......... .......... .......... .......... 27% 234M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 25200K .......... .......... .......... .......... .......... 27% 313M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 25250K .......... .......... .......... .......... .......... 27% 237M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 25300K .......... .......... .......... .......... .......... 27% 233M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 25350K .......... .......... .......... .......... .......... 27% 256M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 25400K .......... .......... .......... .......... .......... 27% 226M 1s 2024-09-12T18:10:05.420 INFO:teuthology.orchestra.run.smithi157.stderr: 25450K .......... .......... .......... .......... .......... 27% 257M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 25500K .......... .......... .......... .......... .......... 27% 199M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 25550K .......... .......... .......... .......... .......... 27% 289M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 25600K .......... .......... .......... .......... .......... 27% 258M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 25650K .......... .......... .......... .......... .......... 27% 240M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 25700K .......... .......... .......... .......... .......... 27% 204M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 25750K .......... .......... .......... .......... .......... 27% 247M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 25800K .......... .......... .......... .......... .......... 27% 283M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 25850K .......... .......... .......... .......... .......... 27% 254M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 25900K .......... .......... .......... .......... .......... 27% 299M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 25950K .......... .......... .......... .......... .......... 27% 320M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 26000K .......... .......... .......... .......... .......... 28% 325M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 26050K .......... .......... .......... .......... .......... 28% 272M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 26100K .......... .......... .......... .......... .......... 28% 257M 1s 2024-09-12T18:10:05.421 INFO:teuthology.orchestra.run.smithi157.stderr: 26150K .......... .......... .......... .......... .......... 28% 282M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26200K .......... .......... .......... .......... .......... 28% 265M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26250K .......... .......... .......... .......... .......... 28% 222M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26300K .......... .......... .......... .......... .......... 28% 189M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26350K .......... .......... .......... .......... .......... 28% 262M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26400K .......... .......... .......... .......... .......... 28% 238M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26450K .......... .......... .......... .......... .......... 28% 260M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26500K .......... .......... .......... .......... .......... 28% 233M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26550K .......... .......... .......... .......... .......... 28% 325M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26600K .......... .......... .......... .......... .......... 28% 296M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26650K .......... .......... .......... .......... .......... 28% 226M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26700K .......... .......... .......... .......... .......... 28% 251M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26750K .......... .......... .......... .......... .......... 28% 275M 1s 2024-09-12T18:10:05.422 INFO:teuthology.orchestra.run.smithi157.stderr: 26800K .......... .......... .......... .......... .......... 28% 228M 1s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 26850K .......... .......... .......... .......... .......... 28% 237M 1s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 26900K .......... .......... .......... .......... .......... 29% 286M 1s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 26950K .......... .......... .......... .......... .......... 29% 295M 1s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 27000K .......... .......... .......... .......... .......... 29% 278M 1s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 27050K .......... .......... .......... .......... .......... 29% 361M 1s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 27100K .......... .......... .......... .......... .......... 29% 272M 1s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 27150K .......... .......... .......... .......... .......... 29% 310M 1s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 27200K .......... .......... .......... .......... .......... 29% 236M 0s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 27250K .......... .......... .......... .......... .......... 29% 54.6M 1s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 27300K .......... .......... .......... .......... .......... 29% 237M 0s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 27350K .......... .......... .......... .......... .......... 29% 235M 0s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 27400K .......... .......... .......... .......... .......... 29% 261M 0s 2024-09-12T18:10:05.423 INFO:teuthology.orchestra.run.smithi157.stderr: 27450K .......... .......... .......... .......... .......... 29% 242M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 27500K .......... .......... .......... .......... .......... 29% 207M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 27550K .......... .......... .......... .......... .......... 29% 265M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 27600K .......... .......... .......... .......... .......... 29% 257M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 27650K .......... .......... .......... .......... .......... 29% 306M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 27700K .......... .......... .......... .......... .......... 29% 270M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 27750K .......... .......... .......... .......... .......... 29% 267M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 27800K .......... .......... .......... .......... .......... 29% 194M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 27850K .......... .......... .......... .......... .......... 30% 261M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 27900K .......... .......... .......... .......... .......... 30% 246M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 27950K .......... .......... .......... .......... .......... 30% 294M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 28000K .......... .......... .......... .......... .......... 30% 239M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 28050K .......... .......... .......... .......... .......... 30% 252M 0s 2024-09-12T18:10:05.424 INFO:teuthology.orchestra.run.smithi157.stderr: 28100K .......... .......... .......... .......... .......... 30% 343M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28150K .......... .......... .......... .......... .......... 30% 253M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28200K .......... .......... .......... .......... .......... 30% 220M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28250K .......... .......... .......... .......... .......... 30% 220M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28300K .......... .......... .......... .......... .......... 30% 322M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28350K .......... .......... .......... .......... .......... 30% 303M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28400K .......... .......... .......... .......... .......... 30% 270M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28450K .......... .......... .......... .......... .......... 30% 329M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28500K .......... .......... .......... .......... .......... 30% 311M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28550K .......... .......... .......... .......... .......... 30% 247M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28600K .......... .......... .......... .......... .......... 30% 186M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28650K .......... .......... .......... .......... .......... 30% 284M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28700K .......... .......... .......... .......... .......... 30% 321M 0s 2024-09-12T18:10:05.425 INFO:teuthology.orchestra.run.smithi157.stderr: 28750K .......... .......... .......... .......... .......... 31% 326M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 28800K .......... .......... .......... .......... .......... 31% 188M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 28850K .......... .......... .......... .......... .......... 31% 95.7M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 28900K .......... .......... .......... .......... .......... 31% 230M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 28950K .......... .......... .......... .......... .......... 31% 243M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 29000K .......... .......... .......... .......... .......... 31% 206M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 29050K .......... .......... .......... .......... .......... 31% 215M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 29100K .......... .......... .......... .......... .......... 31% 236M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 29150K .......... .......... .......... .......... .......... 31% 253M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 29200K .......... .......... .......... .......... .......... 31% 250M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 29250K .......... .......... .......... .......... .......... 31% 325M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 29300K .......... .......... .......... .......... .......... 31% 277M 0s 2024-09-12T18:10:05.426 INFO:teuthology.orchestra.run.smithi157.stderr: 29350K .......... .......... .......... .......... .......... 31% 259M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29400K .......... .......... .......... .......... .......... 31% 201M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29450K .......... .......... .......... .......... .......... 31% 252M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29500K .......... .......... .......... .......... .......... 31% 302M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29550K .......... .......... .......... .......... .......... 31% 285M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29600K .......... .......... .......... .......... .......... 31% 240M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29650K .......... .......... .......... .......... .......... 31% 276M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29700K .......... .......... .......... .......... .......... 32% 309M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29750K .......... .......... .......... .......... .......... 32% 309M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29800K .......... .......... .......... .......... .......... 32% 257M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29850K .......... .......... .......... .......... .......... 32% 325M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29900K .......... .......... .......... .......... .......... 32% 295M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 29950K .......... .......... .......... .......... .......... 32% 225M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 30000K .......... .......... .......... .......... .......... 32% 208M 0s 2024-09-12T18:10:05.427 INFO:teuthology.orchestra.run.smithi157.stderr: 30050K .......... .......... .......... .......... .......... 32% 322M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30100K .......... .......... .......... .......... .......... 32% 308M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30150K .......... .......... .......... .......... .......... 32% 345M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30200K .......... .......... .......... .......... .......... 32% 267M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30250K .......... .......... .......... .......... .......... 32% 287M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30300K .......... .......... .......... .......... .......... 32% 346M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30350K .......... .......... .......... .......... .......... 32% 97.8M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30400K .......... .......... .......... .......... .......... 32% 145M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30450K .......... .......... .......... .......... .......... 32% 268M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30500K .......... .......... .......... .......... .......... 32% 258M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30550K .......... .......... .......... .......... .......... 32% 267M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30600K .......... .......... .......... .......... .......... 32% 279M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30650K .......... .......... .......... .......... .......... 33% 273M 0s 2024-09-12T18:10:05.428 INFO:teuthology.orchestra.run.smithi157.stderr: 30700K .......... .......... .......... .......... .......... 33% 221M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 30750K .......... .......... .......... .......... .......... 33% 252M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 30800K .......... .......... .......... .......... .......... 33% 177M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 30850K .......... .......... .......... .......... .......... 33% 250M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 30900K .......... .......... .......... .......... .......... 33% 220M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 30950K .......... .......... .......... .......... .......... 33% 201M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 31000K .......... .......... .......... .......... .......... 33% 237M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 31050K .......... .......... .......... .......... .......... 33% 343M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 31100K .......... .......... .......... .......... .......... 33% 243M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 31150K .......... .......... .......... .......... .......... 33% 232M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 31200K .......... .......... .......... .......... .......... 33% 329M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 31250K .......... .......... .......... .......... .......... 33% 299M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 31300K .......... .......... .......... .......... .......... 33% 337M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 31350K .......... .......... .......... .......... .......... 33% 277M 0s 2024-09-12T18:10:05.429 INFO:teuthology.orchestra.run.smithi157.stderr: 31400K .......... .......... .......... .......... .......... 33% 250M 0s 2024-09-12T18:10:05.430 INFO:teuthology.orchestra.run.smithi157.stderr: 31450K .......... .......... .......... .......... .......... 33% 306M 0s 2024-09-12T18:10:05.430 INFO:teuthology.orchestra.run.smithi157.stderr: 31500K .......... .......... .......... .......... .......... 33% 243M 0s 2024-09-12T18:10:05.430 INFO:teuthology.orchestra.run.smithi157.stderr: 31550K .......... .......... .......... .......... .......... 34% 253M 0s 2024-09-12T18:10:05.430 INFO:teuthology.orchestra.run.smithi157.stderr: 31600K .......... .......... .......... .......... .......... 34% 302M 0s 2024-09-12T18:10:05.430 INFO:teuthology.orchestra.run.smithi157.stderr: 31650K .......... .......... .......... .......... .......... 34% 342M 0s 2024-09-12T18:10:05.430 INFO:teuthology.orchestra.run.smithi157.stderr: 31700K .......... .......... .......... .......... .......... 34% 307M 0s 2024-09-12T18:10:05.430 INFO:teuthology.orchestra.run.smithi157.stderr: 31750K .......... .......... .......... .......... .......... 34% 78.6M 0s 2024-09-12T18:10:05.430 INFO:teuthology.orchestra.run.smithi157.stderr: 31800K .......... .......... .......... .......... .......... 34% 249M 0s 2024-09-12T18:10:05.430 INFO:teuthology.orchestra.run.smithi157.stderr: 31850K .......... .......... .......... .......... .......... 34% 282M 0s 2024-09-12T18:10:05.430 INFO:teuthology.orchestra.run.smithi157.stderr: 31900K .......... .......... .......... .......... .......... 34% 256M 0s 2024-09-12T18:10:05.431 INFO:teuthology.orchestra.run.smithi157.stderr: 31950K .......... .......... .......... .......... .......... 34% 234M 0s 2024-09-12T18:10:05.431 INFO:teuthology.orchestra.run.smithi157.stderr: 32000K .......... .......... .......... .......... .......... 34% 296M 0s 2024-09-12T18:10:05.431 INFO:teuthology.orchestra.run.smithi157.stderr: 32050K .......... .......... .......... .......... .......... 34% 233M 0s 2024-09-12T18:10:05.431 INFO:teuthology.orchestra.run.smithi157.stderr: 32100K .......... .......... .......... .......... .......... 34% 316M 0s 2024-09-12T18:10:05.431 INFO:teuthology.orchestra.run.smithi157.stderr: 32150K .......... .......... .......... .......... .......... 34% 276M 0s 2024-09-12T18:10:05.431 INFO:teuthology.orchestra.run.smithi157.stderr: 32200K .......... .......... .......... .......... .......... 34% 320M 0s 2024-09-12T18:10:05.431 INFO:teuthology.orchestra.run.smithi157.stderr: 32250K .......... .......... .......... .......... .......... 34% 293M 0s 2024-09-12T18:10:05.431 INFO:teuthology.orchestra.run.smithi157.stderr: 32300K .......... .......... .......... .......... .......... 34% 250M 0s 2024-09-12T18:10:05.431 INFO:teuthology.orchestra.run.smithi157.stderr: 32350K .......... .......... .......... .......... .......... 34% 202M 0s 2024-09-12T18:10:05.431 INFO:teuthology.orchestra.run.smithi157.stderr: 32400K .......... .......... .......... .......... .......... 34% 319M 0s 2024-09-12T18:10:05.431 INFO:teuthology.orchestra.run.smithi157.stderr: 32450K .......... .......... .......... .......... .......... 34% 310M 0s 2024-09-12T18:10:05.432 INFO:teuthology.orchestra.run.smithi157.stderr: 32500K .......... .......... .......... .......... .......... 35% 277M 0s 2024-09-12T18:10:05.432 INFO:teuthology.orchestra.run.smithi157.stderr: 32550K .......... .......... .......... .......... .......... 35% 195M 0s 2024-09-12T18:10:05.432 INFO:teuthology.orchestra.run.smithi157.stderr: 32600K .......... .......... .......... .......... .......... 35% 226M 0s 2024-09-12T18:10:05.432 INFO:teuthology.orchestra.run.smithi157.stderr: 32650K .......... .......... .......... .......... .......... 35% 345M 0s 2024-09-12T18:10:05.432 INFO:teuthology.orchestra.run.smithi157.stderr: 32700K .......... .......... .......... .......... .......... 35% 314M 0s 2024-09-12T18:10:05.432 INFO:teuthology.orchestra.run.smithi157.stderr: 32750K .......... .......... .......... .......... .......... 35% 84.7M 0s 2024-09-12T18:10:05.432 INFO:teuthology.orchestra.run.smithi157.stderr: 32800K .......... .......... .......... .......... .......... 35% 240M 0s 2024-09-12T18:10:05.432 INFO:teuthology.orchestra.run.smithi157.stderr: 32850K .......... .......... .......... .......... .......... 35% 205M 0s 2024-09-12T18:10:05.432 INFO:teuthology.orchestra.run.smithi157.stderr: 32900K .......... .......... .......... .......... .......... 35% 271M 0s 2024-09-12T18:10:05.432 INFO:teuthology.orchestra.run.smithi157.stderr: 32950K .......... .......... .......... .......... .......... 35% 289M 0s 2024-09-12T18:10:05.432 INFO:teuthology.orchestra.run.smithi157.stderr: 33000K .......... .......... .......... .......... .......... 35% 216M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33050K .......... .......... .......... .......... .......... 35% 240M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33100K .......... .......... .......... .......... .......... 35% 343M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33150K .......... .......... .......... .......... .......... 35% 214M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33200K .......... .......... .......... .......... .......... 35% 332M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33250K .......... .......... .......... .......... .......... 35% 335M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33300K .......... .......... .......... .......... .......... 35% 269M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33350K .......... .......... .......... .......... .......... 35% 309M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33400K .......... .......... .......... .......... .......... 36% 310M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33450K .......... .......... .......... .......... .......... 36% 306M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33500K .......... .......... .......... .......... .......... 36% 268M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33550K .......... .......... .......... .......... .......... 36% 232M 0s 2024-09-12T18:10:05.433 INFO:teuthology.orchestra.run.smithi157.stderr: 33600K .......... .......... .......... .......... .......... 36% 262M 0s 2024-09-12T18:10:05.434 INFO:teuthology.orchestra.run.smithi157.stderr: 33650K .......... .......... .......... .......... .......... 36% 278M 0s 2024-09-12T18:10:05.434 INFO:teuthology.orchestra.run.smithi157.stderr: 33700K .......... .......... .......... .......... .......... 36% 320M 0s 2024-09-12T18:10:05.434 INFO:teuthology.orchestra.run.smithi157.stderr: 33750K .......... .......... .......... .......... .......... 36% 239M 0s 2024-09-12T18:10:05.434 INFO:teuthology.orchestra.run.smithi157.stderr: 33800K .......... .......... .......... .......... .......... 36% 319M 0s 2024-09-12T18:10:05.434 INFO:teuthology.orchestra.run.smithi157.stderr: 33850K .......... .......... .......... .......... .......... 36% 303M 0s 2024-09-12T18:10:05.434 INFO:teuthology.orchestra.run.smithi157.stderr: 33900K .......... .......... .......... .......... .......... 36% 313M 0s 2024-09-12T18:10:05.434 INFO:teuthology.orchestra.run.smithi157.stderr: 33950K .......... .......... .......... .......... .......... 36% 219M 0s 2024-09-12T18:10:05.434 INFO:teuthology.orchestra.run.smithi157.stderr: 34000K .......... .......... .......... .......... .......... 36% 330M 0s 2024-09-12T18:10:05.434 INFO:teuthology.orchestra.run.smithi157.stderr: 34050K .......... .......... .......... .......... .......... 36% 313M 0s 2024-09-12T18:10:05.434 INFO:teuthology.orchestra.run.smithi157.stderr: 34100K .......... .......... .......... .......... .......... 36% 223M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34150K .......... .......... .......... .......... .......... 36% 225M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34200K .......... .......... .......... .......... .......... 36% 287M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34250K .......... .......... .......... .......... .......... 36% 326M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34300K .......... .......... .......... .......... .......... 36% 81.0M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34350K .......... .......... .......... .......... .......... 37% 226M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34400K .......... .......... .......... .......... .......... 37% 249M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34450K .......... .......... .......... .......... .......... 37% 349M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34500K .......... .......... .......... .......... .......... 37% 359M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34550K .......... .......... .......... .......... .......... 37% 274M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34600K .......... .......... .......... .......... .......... 37% 83.8M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34650K .......... .......... .......... .......... .......... 37% 224M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34700K .......... .......... .......... .......... .......... 37% 291M 0s 2024-09-12T18:10:05.435 INFO:teuthology.orchestra.run.smithi157.stderr: 34750K .......... .......... .......... .......... .......... 37% 218M 0s 2024-09-12T18:10:05.436 INFO:teuthology.orchestra.run.smithi157.stderr: 34800K .......... .......... .......... .......... .......... 37% 296M 0s 2024-09-12T18:10:05.436 INFO:teuthology.orchestra.run.smithi157.stderr: 34850K .......... .......... .......... .......... .......... 37% 247M 0s 2024-09-12T18:10:05.436 INFO:teuthology.orchestra.run.smithi157.stderr: 34900K .......... .......... .......... .......... .......... 37% 304M 0s 2024-09-12T18:10:05.436 INFO:teuthology.orchestra.run.smithi157.stderr: 34950K .......... .......... .......... .......... .......... 37% 260M 0s 2024-09-12T18:10:05.436 INFO:teuthology.orchestra.run.smithi157.stderr: 35000K .......... .......... .......... .......... .......... 37% 287M 0s 2024-09-12T18:10:05.436 INFO:teuthology.orchestra.run.smithi157.stderr: 35050K .......... .......... .......... .......... .......... 37% 336M 0s 2024-09-12T18:10:05.436 INFO:teuthology.orchestra.run.smithi157.stderr: 35100K .......... .......... .......... .......... .......... 37% 366M 0s 2024-09-12T18:10:05.436 INFO:teuthology.orchestra.run.smithi157.stderr: 35150K .......... .......... .......... .......... .......... 37% 227M 0s 2024-09-12T18:10:05.436 INFO:teuthology.orchestra.run.smithi157.stderr: 35200K .......... .......... .......... .......... .......... 37% 307M 0s 2024-09-12T18:10:05.436 INFO:teuthology.orchestra.run.smithi157.stderr: 35250K .......... .......... .......... .......... .......... 37% 279M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35300K .......... .......... .......... .......... .......... 38% 357M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35350K .......... .......... .......... .......... .......... 38% 265M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35400K .......... .......... .......... .......... .......... 38% 137M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35450K .......... .......... .......... .......... .......... 38% 264M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35500K .......... .......... .......... .......... .......... 38% 299M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35550K .......... .......... .......... .......... .......... 38% 277M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35600K .......... .......... .......... .......... .......... 38% 312M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35650K .......... .......... .......... .......... .......... 38% 173M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35700K .......... .......... .......... .......... .......... 38% 265M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35750K .......... .......... .......... .......... .......... 38% 293M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35800K .......... .......... .......... .......... .......... 38% 273M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35850K .......... .......... .......... .......... .......... 38% 321M 0s 2024-09-12T18:10:05.437 INFO:teuthology.orchestra.run.smithi157.stderr: 35900K .......... .......... .......... .......... .......... 38% 313M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 35950K .......... .......... .......... .......... .......... 38% 233M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36000K .......... .......... .......... .......... .......... 38% 348M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36050K .......... .......... .......... .......... .......... 38% 289M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36100K .......... .......... .......... .......... .......... 38% 304M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36150K .......... .......... .......... .......... .......... 38% 310M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36200K .......... .......... .......... .......... .......... 39% 159M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36250K .......... .......... .......... .......... .......... 39% 270M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36300K .......... .......... .......... .......... .......... 39% 279M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36350K .......... .......... .......... .......... .......... 39% 245M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36400K .......... .......... .......... .......... .......... 39% 232M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36450K .......... .......... .......... .......... .......... 39% 243M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36500K .......... .......... .......... .......... .......... 39% 251M 0s 2024-09-12T18:10:05.438 INFO:teuthology.orchestra.run.smithi157.stderr: 36550K .......... .......... .......... .......... .......... 39% 293M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 36600K .......... .......... .......... .......... .......... 39% 254M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 36650K .......... .......... .......... .......... .......... 39% 249M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 36700K .......... .......... .......... .......... .......... 39% 248M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 36750K .......... .......... .......... .......... .......... 39% 206M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 36800K .......... .......... .......... .......... .......... 39% 336M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 36850K .......... .......... .......... .......... .......... 39% 242M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 36900K .......... .......... .......... .......... .......... 39% 325M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 36950K .......... .......... .......... .......... .......... 39% 238M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 37000K .......... .......... .......... .......... .......... 39% 338M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 37050K .......... .......... .......... .......... .......... 39% 292M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 37100K .......... .......... .......... .......... .......... 39% 280M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 37150K .......... .......... .......... .......... .......... 40% 309M 0s 2024-09-12T18:10:05.439 INFO:teuthology.orchestra.run.smithi157.stderr: 37200K .......... .......... .......... .......... .......... 40% 82.6M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37250K .......... .......... .......... .......... .......... 40% 304M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37300K .......... .......... .......... .......... .......... 40% 331M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37350K .......... .......... .......... .......... .......... 40% 192M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37400K .......... .......... .......... .......... .......... 40% 308M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37450K .......... .......... .......... .......... .......... 40% 61.1M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37500K .......... .......... .......... .......... .......... 40% 294M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37550K .......... .......... .......... .......... .......... 40% 210M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37600K .......... .......... .......... .......... .......... 40% 269M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37650K .......... .......... .......... .......... .......... 40% 285M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37700K .......... .......... .......... .......... .......... 40% 330M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37750K .......... .......... .......... .......... .......... 40% 225M 0s 2024-09-12T18:10:05.440 INFO:teuthology.orchestra.run.smithi157.stderr: 37800K .......... .......... .......... .......... .......... 40% 270M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 37850K .......... .......... .......... .......... .......... 40% 312M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 37900K .......... .......... .......... .......... .......... 40% 309M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 37950K .......... .......... .......... .......... .......... 40% 288M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 38000K .......... .......... .......... .......... .......... 40% 302M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 38050K .......... .......... .......... .......... .......... 41% 264M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 38100K .......... .......... .......... .......... .......... 41% 262M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 38150K .......... .......... .......... .......... .......... 41% 247M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 38200K .......... .......... .......... .......... .......... 41% 366M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 38250K .......... .......... .......... .......... .......... 41% 304M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 38300K .......... .......... .......... .......... .......... 41% 307M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 38350K .......... .......... .......... .......... .......... 41% 228M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 38400K .......... .......... .......... .......... .......... 41% 270M 0s 2024-09-12T18:10:05.441 INFO:teuthology.orchestra.run.smithi157.stderr: 38450K .......... .......... .......... .......... .......... 41% 326M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 38500K .......... .......... .......... .......... .......... 41% 357M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 38550K .......... .......... .......... .......... .......... 41% 321M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 38600K .......... .......... .......... .......... .......... 41% 142M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 38650K .......... .......... .......... .......... .......... 41% 229M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 38700K .......... .......... .......... .......... .......... 41% 334M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 38750K .......... .......... .......... .......... .......... 41% 227M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 38800K .......... .......... .......... .......... .......... 41% 281M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 38850K .......... .......... .......... .......... .......... 41% 293M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 38900K .......... .......... .......... .......... .......... 41% 335M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 38950K .......... .......... .......... .......... .......... 41% 235M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 39000K .......... .......... .......... .......... .......... 42% 320M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 39050K .......... .......... .......... .......... .......... 42% 310M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 39100K .......... .......... .......... .......... .......... 42% 272M 0s 2024-09-12T18:10:05.442 INFO:teuthology.orchestra.run.smithi157.stderr: 39150K .......... .......... .......... .......... .......... 42% 295M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39200K .......... .......... .......... .......... .......... 42% 279M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39250K .......... .......... .......... .......... .......... 42% 289M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39300K .......... .......... .......... .......... .......... 42% 362M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39350K .......... .......... .......... .......... .......... 42% 83.0M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39400K .......... .......... .......... .......... .......... 42% 263M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39450K .......... .......... .......... .......... .......... 42% 301M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39500K .......... .......... .......... .......... .......... 42% 265M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39550K .......... .......... .......... .......... .......... 42% 255M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39600K .......... .......... .......... .......... .......... 42% 383M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39650K .......... .......... .......... .......... .......... 42% 352M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39700K .......... .......... .......... .......... .......... 42% 372M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39750K .......... .......... .......... .......... .......... 42% 154M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39800K .......... .......... .......... .......... .......... 42% 276M 0s 2024-09-12T18:10:05.443 INFO:teuthology.orchestra.run.smithi157.stderr: 39850K .......... .......... .......... .......... .......... 42% 275M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 39900K .......... .......... .......... .......... .......... 43% 282M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 39950K .......... .......... .......... .......... .......... 43% 274M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40000K .......... .......... .......... .......... .......... 43% 377M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40050K .......... .......... .......... .......... .......... 43% 384M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40100K .......... .......... .......... .......... .......... 43% 162M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40150K .......... .......... .......... .......... .......... 43% 240M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40200K .......... .......... .......... .......... .......... 43% 278M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40250K .......... .......... .......... .......... .......... 43% 358M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40300K .......... .......... .......... .......... .......... 43% 334M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40350K .......... .......... .......... .......... .......... 43% 210M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40400K .......... .......... .......... .......... .......... 43% 340M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40450K .......... .......... .......... .......... .......... 43% 79.5M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40500K .......... .......... .......... .......... .......... 43% 156M 0s 2024-09-12T18:10:05.444 INFO:teuthology.orchestra.run.smithi157.stderr: 40550K .......... .......... .......... .......... .......... 43% 216M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 40600K .......... .......... .......... .......... .......... 43% 363M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 40650K .......... .......... .......... .......... .......... 43% 124M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 40700K .......... .......... .......... .......... .......... 43% 224M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 40750K .......... .......... .......... .......... .......... 43% 208M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 40800K .......... .......... .......... .......... .......... 43% 201M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 40850K .......... .......... .......... .......... .......... 44% 201M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 40900K .......... .......... .......... .......... .......... 44% 216M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 40950K .......... .......... .......... .......... .......... 44% 249M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 41000K .......... .......... .......... .......... .......... 44% 219M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 41050K .......... .......... .......... .......... .......... 44% 210M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 41100K .......... .......... .......... .......... .......... 44% 268M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 41150K .......... .......... .......... .......... .......... 44% 236M 0s 2024-09-12T18:10:05.445 INFO:teuthology.orchestra.run.smithi157.stderr: 41200K .......... .......... .......... .......... .......... 44% 324M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41250K .......... .......... .......... .......... .......... 44% 273M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41300K .......... .......... .......... .......... .......... 44% 345M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41350K .......... .......... .......... .......... .......... 44% 276M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41400K .......... .......... .......... .......... .......... 44% 345M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41450K .......... .......... .......... .......... .......... 44% 236M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41500K .......... .......... .......... .......... .......... 44% 240M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41550K .......... .......... .......... .......... .......... 44% 220M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41600K .......... .......... .......... .......... .......... 44% 238M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41650K .......... .......... .......... .......... .......... 44% 296M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41700K .......... .......... .......... .......... .......... 44% 250M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41750K .......... .......... .......... .......... .......... 44% 249M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41800K .......... .......... .......... .......... .......... 45% 349M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41850K .......... .......... .......... .......... .......... 45% 366M 0s 2024-09-12T18:10:05.446 INFO:teuthology.orchestra.run.smithi157.stderr: 41900K .......... .......... .......... .......... .......... 45% 311M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 41950K .......... .......... .......... .......... .......... 45% 273M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42000K .......... .......... .......... .......... .......... 45% 310M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42050K .......... .......... .......... .......... .......... 45% 228M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42100K .......... .......... .......... .......... .......... 45% 349M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42150K .......... .......... .......... .......... .......... 45% 327M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42200K .......... .......... .......... .......... .......... 45% 332M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42250K .......... .......... .......... .......... .......... 45% 372M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42300K .......... .......... .......... .......... .......... 45% 13.9M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42350K .......... .......... .......... .......... .......... 45% 139M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42400K .......... .......... .......... .......... .......... 45% 252M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42450K .......... .......... .......... .......... .......... 45% 279M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42500K .......... .......... .......... .......... .......... 45% 251M 0s 2024-09-12T18:10:05.447 INFO:teuthology.orchestra.run.smithi157.stderr: 42550K .......... .......... .......... .......... .......... 45% 219M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 42600K .......... .......... .......... .......... .......... 45% 233M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 42650K .......... .......... .......... .......... .......... 45% 275M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 42700K .......... .......... .......... .......... .......... 46% 257M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 42750K .......... .......... .......... .......... .......... 46% 203M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 42800K .......... .......... .......... .......... .......... 46% 257M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 42850K .......... .......... .......... .......... .......... 46% 243M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 42900K .......... .......... .......... .......... .......... 46% 274M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 42950K .......... .......... .......... .......... .......... 46% 226M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 43000K .......... .......... .......... .......... .......... 46% 332M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 43050K .......... .......... .......... .......... .......... 46% 277M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 43100K .......... .......... .......... .......... .......... 46% 283M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 43150K .......... .......... .......... .......... .......... 46% 225M 0s 2024-09-12T18:10:05.448 INFO:teuthology.orchestra.run.smithi157.stderr: 43200K .......... .......... .......... .......... .......... 46% 292M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43250K .......... .......... .......... .......... .......... 46% 358M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43300K .......... .......... .......... .......... .......... 46% 315M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43350K .......... .......... .......... .......... .......... 46% 239M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43400K .......... .......... .......... .......... .......... 46% 288M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43450K .......... .......... .......... .......... .......... 46% 276M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43500K .......... .......... .......... .......... .......... 46% 283M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43550K .......... .......... .......... .......... .......... 46% 201M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43600K .......... .......... .......... .......... .......... 46% 264M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43650K .......... .......... .......... .......... .......... 47% 345M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43700K .......... .......... .......... .......... .......... 47% 283M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43750K .......... .......... .......... .......... .......... 47% 215M 0s 2024-09-12T18:10:05.449 INFO:teuthology.orchestra.run.smithi157.stderr: 43800K .......... .......... .......... .......... .......... 47% 248M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 43850K .......... .......... .......... .......... .......... 47% 252M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 43900K .......... .......... .......... .......... .......... 47% 248M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 43950K .......... .......... .......... .......... .......... 47% 222M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 44000K .......... .......... .......... .......... .......... 47% 225M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 44050K .......... .......... .......... .......... .......... 47% 296M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 44100K .......... .......... .......... .......... .......... 47% 233M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 44150K .......... .......... .......... .......... .......... 47% 241M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 44200K .......... .......... .......... .......... .......... 47% 303M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 44250K .......... .......... .......... .......... .......... 47% 275M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 44300K .......... .......... .......... .......... .......... 47% 357M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 44350K .......... .......... .......... .......... .......... 47% 306M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 44400K .......... .......... .......... .......... .......... 47% 341M 0s 2024-09-12T18:10:05.450 INFO:teuthology.orchestra.run.smithi157.stderr: 44450K .......... .......... .......... .......... .......... 47% 365M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 44500K .......... .......... .......... .......... .......... 47% 336M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 44550K .......... .......... .......... .......... .......... 48% 268M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 44600K .......... .......... .......... .......... .......... 48% 353M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 44650K .......... .......... .......... .......... .......... 48% 321M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 44700K .......... .......... .......... .......... .......... 48% 342M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 44750K .......... .......... .......... .......... .......... 48% 295M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 44800K .......... .......... .......... .......... .......... 48% 365M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 44850K .......... .......... .......... .......... .......... 48% 300M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 44900K .......... .......... .......... .......... .......... 48% 293M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 44950K .......... .......... .......... .......... .......... 48% 285M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 45000K .......... .......... .......... .......... .......... 48% 315M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 45050K .......... .......... .......... .......... .......... 48% 356M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 45100K .......... .......... .......... .......... .......... 48% 285M 0s 2024-09-12T18:10:05.451 INFO:teuthology.orchestra.run.smithi157.stderr: 45150K .......... .......... .......... .......... .......... 48% 16.6M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45200K .......... .......... .......... .......... .......... 48% 257M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45250K .......... .......... .......... .......... .......... 48% 342M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45300K .......... .......... .......... .......... .......... 48% 351M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45350K .......... .......... .......... .......... .......... 48% 99.7M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45400K .......... .......... .......... .......... .......... 48% 296M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45450K .......... .......... .......... .......... .......... 48% 276M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45500K .......... .......... .......... .......... .......... 49% 243M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45550K .......... .......... .......... .......... .......... 49% 248M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45600K .......... .......... .......... .......... .......... 49% 289M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45650K .......... .......... .......... .......... .......... 49% 299M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45700K .......... .......... .......... .......... .......... 49% 242M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45750K .......... .......... .......... .......... .......... 49% 253M 0s 2024-09-12T18:10:05.452 INFO:teuthology.orchestra.run.smithi157.stderr: 45800K .......... .......... .......... .......... .......... 49% 205M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 45850K .......... .......... .......... .......... .......... 49% 247M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 45900K .......... .......... .......... .......... .......... 49% 226M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 45950K .......... .......... .......... .......... .......... 49% 250M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 46000K .......... .......... .......... .......... .......... 49% 283M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 46050K .......... .......... .......... .......... .......... 49% 293M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 46100K .......... .......... .......... .......... .......... 49% 192M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 46150K .......... .......... .......... .......... .......... 49% 206M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 46200K .......... .......... .......... .......... .......... 49% 284M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 46250K .......... .......... .......... .......... .......... 49% 263M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 46300K .......... .......... .......... .......... .......... 49% 288M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 46350K .......... .......... .......... .......... .......... 49% 213M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 46400K .......... .......... .......... .......... .......... 49% 321M 0s 2024-09-12T18:10:05.453 INFO:teuthology.orchestra.run.smithi157.stderr: 46450K .......... .......... .......... .......... .......... 50% 246M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 46500K .......... .......... .......... .......... .......... 50% 286M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 46550K .......... .......... .......... .......... .......... 50% 179M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 46600K .......... .......... .......... .......... .......... 50% 275M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 46650K .......... .......... .......... .......... .......... 50% 244M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 46700K .......... .......... .......... .......... .......... 50% 349M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 46750K .......... .......... .......... .......... .......... 50% 278M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 46800K .......... .......... .......... .......... .......... 50% 311M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 46850K .......... .......... .......... .......... .......... 50% 338M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 46900K .......... .......... .......... .......... .......... 50% 359M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 46950K .......... .......... .......... .......... .......... 50% 271M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 47000K .......... .......... .......... .......... .......... 50% 369M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 47050K .......... .......... .......... .......... .......... 50% 352M 0s 2024-09-12T18:10:05.454 INFO:teuthology.orchestra.run.smithi157.stderr: 47100K .......... .......... .......... .......... .......... 50% 353M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47150K .......... .......... .......... .......... .......... 50% 266M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47200K .......... .......... .......... .......... .......... 50% 304M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47250K .......... .......... .......... .......... .......... 50% 356M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47300K .......... .......... .......... .......... .......... 50% 316M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47350K .......... .......... .......... .......... .......... 51% 323M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47400K .......... .......... .......... .......... .......... 51% 287M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47450K .......... .......... .......... .......... .......... 51% 365M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47500K .......... .......... .......... .......... .......... 51% 15.9M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47550K .......... .......... .......... .......... .......... 51% 246M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47600K .......... .......... .......... .......... .......... 51% 220M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47650K .......... .......... .......... .......... .......... 51% 240M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47700K .......... .......... .......... .......... .......... 51% 261M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47750K .......... .......... .......... .......... .......... 51% 221M 0s 2024-09-12T18:10:05.455 INFO:teuthology.orchestra.run.smithi157.stderr: 47800K .......... .......... .......... .......... .......... 51% 227M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 47850K .......... .......... .......... .......... .......... 51% 233M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 47900K .......... .......... .......... .......... .......... 51% 242M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 47950K .......... .......... .......... .......... .......... 51% 210M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 48000K .......... .......... .......... .......... .......... 51% 244M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 48050K .......... .......... .......... .......... .......... 51% 280M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 48100K .......... .......... .......... .......... .......... 51% 299M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 48150K .......... .......... .......... .......... .......... 51% 246M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 48200K .......... .......... .......... .......... .......... 51% 291M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 48250K .......... .......... .......... .......... .......... 51% 294M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 48300K .......... .......... .......... .......... .......... 52% 284M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 48350K .......... .......... .......... .......... .......... 52% 243M 0s 2024-09-12T18:10:05.456 INFO:teuthology.orchestra.run.smithi157.stderr: 48400K .......... .......... .......... .......... .......... 52% 363M 0s 2024-09-12T18:10:05.457 INFO:teuthology.orchestra.run.smithi157.stderr: 48450K .......... .......... .......... .......... .......... 52% 300M 0s 2024-09-12T18:10:05.457 INFO:teuthology.orchestra.run.smithi157.stderr: 48500K .......... .......... .......... .......... .......... 52% 316M 0s 2024-09-12T18:10:05.457 INFO:teuthology.orchestra.run.smithi157.stderr: 48550K .......... .......... .......... .......... .......... 52% 279M 0s 2024-09-12T18:10:05.457 INFO:teuthology.orchestra.run.smithi157.stderr: 48600K .......... .......... .......... .......... .......... 52% 313M 0s 2024-09-12T18:10:05.457 INFO:teuthology.orchestra.run.smithi157.stderr: 48650K .......... .......... .......... .......... .......... 52% 287M 0s 2024-09-12T18:10:05.457 INFO:teuthology.orchestra.run.smithi157.stderr: 48700K .......... .......... .......... .......... .......... 52% 259M 0s 2024-09-12T18:10:05.457 INFO:teuthology.orchestra.run.smithi157.stderr: 48750K .......... .......... .......... .......... .......... 52% 258M 0s 2024-09-12T18:10:05.457 INFO:teuthology.orchestra.run.smithi157.stderr: 48800K .......... .......... .......... .......... .......... 52% 229M 0s 2024-09-12T18:10:05.457 INFO:teuthology.orchestra.run.smithi157.stderr: 48850K .......... .......... .......... .......... .......... 52% 255M 0s 2024-09-12T18:10:05.457 INFO:teuthology.orchestra.run.smithi157.stderr: 48900K .......... .......... .......... .......... .......... 52% 266M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 48950K .......... .......... .......... .......... .......... 52% 284M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49000K .......... .......... .......... .......... .......... 52% 285M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49050K .......... .......... .......... .......... .......... 52% 294M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49100K .......... .......... .......... .......... .......... 52% 221M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49150K .......... .......... .......... .......... .......... 52% 221M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49200K .......... .......... .......... .......... .......... 53% 300M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49250K .......... .......... .......... .......... .......... 53% 266M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49300K .......... .......... .......... .......... .......... 53% 364M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49350K .......... .......... .......... .......... .......... 53% 302M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49400K .......... .......... .......... .......... .......... 53% 330M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49450K .......... .......... .......... .......... .......... 53% 323M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49500K .......... .......... .......... .......... .......... 53% 360M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49550K .......... .......... .......... .......... .......... 53% 264M 0s 2024-09-12T18:10:05.458 INFO:teuthology.orchestra.run.smithi157.stderr: 49600K .......... .......... .......... .......... .......... 53% 307M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 49650K .......... .......... .......... .......... .......... 53% 319M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 49700K .......... .......... .......... .......... .......... 53% 333M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 49750K .......... .......... .......... .......... .......... 53% 327M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 49800K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 49850K .......... .......... .......... .......... .......... 53% 365M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 49900K .......... .......... .......... .......... .......... 53% 379M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 49950K .......... .......... .......... .......... .......... 53% 14.3M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 50000K .......... .......... .......... .......... .......... 53% 225M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 50050K .......... .......... .......... .......... .......... 53% 284M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 50100K .......... .......... .......... .......... .......... 53% 276M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 50150K .......... .......... .......... .......... .......... 54% 228M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 50200K .......... .......... .......... .......... .......... 54% 302M 0s 2024-09-12T18:10:05.459 INFO:teuthology.orchestra.run.smithi157.stderr: 50250K .......... .......... .......... .......... .......... 54% 326M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50300K .......... .......... .......... .......... .......... 54% 247M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50350K .......... .......... .......... .......... .......... 54% 238M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50400K .......... .......... .......... .......... .......... 54% 253M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50450K .......... .......... .......... .......... .......... 54% 239M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50500K .......... .......... .......... .......... .......... 54% 215M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50550K .......... .......... .......... .......... .......... 54% 264M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50600K .......... .......... .......... .......... .......... 54% 262M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50650K .......... .......... .......... .......... .......... 54% 284M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50700K .......... .......... .......... .......... .......... 54% 279M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50750K .......... .......... .......... .......... .......... 54% 175M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50800K .......... .......... .......... .......... .......... 54% 226M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50850K .......... .......... .......... .......... .......... 54% 262M 0s 2024-09-12T18:10:05.460 INFO:teuthology.orchestra.run.smithi157.stderr: 50900K .......... .......... .......... .......... .......... 54% 275M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 50950K .......... .......... .......... .......... .......... 54% 301M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51000K .......... .......... .......... .......... .......... 54% 249M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51050K .......... .......... .......... .......... .......... 55% 226M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51100K .......... .......... .......... .......... .......... 55% 299M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51150K .......... .......... .......... .......... .......... 55% 221M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51200K .......... .......... .......... .......... .......... 55% 307M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51250K .......... .......... .......... .......... .......... 55% 303M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51300K .......... .......... .......... .......... .......... 55% 261M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51350K .......... .......... .......... .......... .......... 55% 316M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51400K .......... .......... .......... .......... .......... 55% 320M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51450K .......... .......... .......... .......... .......... 55% 333M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51500K .......... .......... .......... .......... .......... 55% 261M 0s 2024-09-12T18:10:05.461 INFO:teuthology.orchestra.run.smithi157.stderr: 51550K .......... .......... .......... .......... .......... 55% 265M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 51600K .......... .......... .......... .......... .......... 55% 332M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 51650K .......... .......... .......... .......... .......... 55% 310M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 51700K .......... .......... .......... .......... .......... 55% 294M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 51750K .......... .......... .......... .......... .......... 55% 304M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 51800K .......... .......... .......... .......... .......... 55% 333M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 51850K .......... .......... .......... .......... .......... 55% 306M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 51900K .......... .......... .......... .......... .......... 55% 291M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 51950K .......... .......... .......... .......... .......... 55% 251M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 52000K .......... .......... .......... .......... .......... 56% 329M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 52050K .......... .......... .......... .......... .......... 56% 349M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 52100K .......... .......... .......... .......... .......... 56% 238M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 52150K .......... .......... .......... .......... .......... 56% 348M 0s 2024-09-12T18:10:05.462 INFO:teuthology.orchestra.run.smithi157.stderr: 52200K .......... .......... .......... .......... .......... 56% 314M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52250K .......... .......... .......... .......... .......... 56% 361M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52300K .......... .......... .......... .......... .......... 56% 286M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52350K .......... .......... .......... .......... .......... 56% 391M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52400K .......... .......... .......... .......... .......... 56% 16.0M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52450K .......... .......... .......... .......... .......... 56% 265M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52500K .......... .......... .......... .......... .......... 56% 245M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52550K .......... .......... .......... .......... .......... 56% 317M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52600K .......... .......... .......... .......... .......... 56% 292M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52650K .......... .......... .......... .......... .......... 56% 299M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52700K .......... .......... .......... .......... .......... 56% 237M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52750K .......... .......... .......... .......... .......... 56% 290M 0s 2024-09-12T18:10:05.463 INFO:teuthology.orchestra.run.smithi157.stderr: 52800K .......... .......... .......... .......... .......... 56% 310M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 52850K .......... .......... .......... .......... .......... 56% 268M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 52900K .......... .......... .......... .......... .......... 56% 261M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 52950K .......... .......... .......... .......... .......... 57% 275M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 53000K .......... .......... .......... .......... .......... 57% 342M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 53050K .......... .......... .......... .......... .......... 57% 237M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 53100K .......... .......... .......... .......... .......... 57% 236M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 53150K .......... .......... .......... .......... .......... 57% 284M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 53200K .......... .......... .......... .......... .......... 57% 249M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 53250K .......... .......... .......... .......... .......... 57% 255M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 53300K .......... .......... .......... .......... .......... 57% 230M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 53350K .......... .......... .......... .......... .......... 57% 249M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 53400K .......... .......... .......... .......... .......... 57% 268M 0s 2024-09-12T18:10:05.464 INFO:teuthology.orchestra.run.smithi157.stderr: 53450K .......... .......... .......... .......... .......... 57% 257M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 53500K .......... .......... .......... .......... .......... 57% 256M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 53550K .......... .......... .......... .......... .......... 57% 345M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 53600K .......... .......... .......... .......... .......... 57% 343M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 53650K .......... .......... .......... .......... .......... 57% 228M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 53700K .......... .......... .......... .......... .......... 57% 216M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 53750K .......... .......... .......... .......... .......... 57% 241M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 53800K .......... .......... .......... .......... .......... 57% 242M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 53850K .......... .......... .......... .......... .......... 58% 249M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 53900K .......... .......... .......... .......... .......... 58% 244M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 53950K .......... .......... .......... .......... .......... 58% 273M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 54000K .......... .......... .......... .......... .......... 58% 316M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 54050K .......... .......... .......... .......... .......... 58% 238M 0s 2024-09-12T18:10:05.465 INFO:teuthology.orchestra.run.smithi157.stderr: 54100K .......... .......... .......... .......... .......... 58% 272M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54150K .......... .......... .......... .......... .......... 58% 282M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54200K .......... .......... .......... .......... .......... 58% 350M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54250K .......... .......... .......... .......... .......... 58% 302M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54300K .......... .......... .......... .......... .......... 58% 306M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54350K .......... .......... .......... .......... .......... 58% 295M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54400K .......... .......... .......... .......... .......... 58% 301M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54450K .......... .......... .......... .......... .......... 58% 328M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54500K .......... .......... .......... .......... .......... 58% 256M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54550K .......... .......... .......... .......... .......... 58% 366M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54600K .......... .......... .......... .......... .......... 58% 282M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54650K .......... .......... .......... .......... .......... 58% 361M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54700K .......... .......... .......... .......... .......... 58% 230M 0s 2024-09-12T18:10:05.466 INFO:teuthology.orchestra.run.smithi157.stderr: 54750K .......... .......... .......... .......... .......... 58% 314M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 54800K .......... .......... .......... .......... .......... 59% 295M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 54850K .......... .......... .......... .......... .......... 59% 15.3M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 54900K .......... .......... .......... .......... .......... 59% 211M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 54950K .......... .......... .......... .......... .......... 59% 267M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 55000K .......... .......... .......... .......... .......... 59% 257M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 55050K .......... .......... .......... .......... .......... 59% 238M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 55100K .......... .......... .......... .......... .......... 59% 299M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 55150K .......... .......... .......... .......... .......... 59% 289M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 55200K .......... .......... .......... .......... .......... 59% 285M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 55250K .......... .......... .......... .......... .......... 59% 275M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 55300K .......... .......... .......... .......... .......... 59% 260M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 55350K .......... .......... .......... .......... .......... 59% 212M 0s 2024-09-12T18:10:05.467 INFO:teuthology.orchestra.run.smithi157.stderr: 55400K .......... .......... .......... .......... .......... 59% 230M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 55450K .......... .......... .......... .......... .......... 59% 271M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 55500K .......... .......... .......... .......... .......... 59% 282M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 55550K .......... .......... .......... .......... .......... 59% 227M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 55600K .......... .......... .......... .......... .......... 59% 257M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 55650K .......... .......... .......... .......... .......... 59% 244M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 55700K .......... .......... .......... .......... .......... 60% 258M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 55750K .......... .......... .......... .......... .......... 60% 292M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 55800K .......... .......... .......... .......... .......... 60% 252M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 55850K .......... .......... .......... .......... .......... 60% 272M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 55900K .......... .......... .......... .......... .......... 60% 283M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 55950K .......... .......... .......... .......... .......... 60% 297M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 56000K .......... .......... .......... .......... .......... 60% 214M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 56050K .......... .......... .......... .......... .......... 60% 287M 0s 2024-09-12T18:10:05.468 INFO:teuthology.orchestra.run.smithi157.stderr: 56100K .......... .......... .......... .......... .......... 60% 344M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56150K .......... .......... .......... .......... .......... 60% 275M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56200K .......... .......... .......... .......... .......... 60% 211M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56250K .......... .......... .......... .......... .......... 60% 289M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56300K .......... .......... .......... .......... .......... 60% 294M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56350K .......... .......... .......... .......... .......... 60% 304M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56400K .......... .......... .......... .......... .......... 60% 281M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56450K .......... .......... .......... .......... .......... 60% 275M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56500K .......... .......... .......... .......... .......... 60% 294M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56550K .......... .......... .......... .......... .......... 60% 322M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56600K .......... .......... .......... .......... .......... 60% 251M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56650K .......... .......... .......... .......... .......... 61% 308M 0s 2024-09-12T18:10:05.469 INFO:teuthology.orchestra.run.smithi157.stderr: 56700K .......... .......... .......... .......... .......... 61% 252M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 56750K .......... .......... .......... .......... .......... 61% 255M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 56800K .......... .......... .......... .......... .......... 61% 258M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 56850K .......... .......... .......... .......... .......... 61% 279M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 56900K .......... .......... .......... .......... .......... 61% 362M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 56950K .......... .......... .......... .......... .......... 61% 363M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 57000K .......... .......... .......... .......... .......... 61% 257M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 57050K .......... .......... .......... .......... .......... 61% 391M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 57100K .......... .......... .......... .......... .......... 61% 251M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 57150K .......... .......... .......... .......... .......... 61% 359M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 57200K .......... .......... .......... .......... .......... 61% 341M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 57250K .......... .......... .......... .......... .......... 61% 304M 0s 2024-09-12T18:10:05.470 INFO:teuthology.orchestra.run.smithi157.stderr: 57300K .......... .......... .......... .......... .......... 61% 256M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57350K .......... .......... .......... .......... .......... 61% 359M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57400K .......... .......... .......... .......... .......... 61% 322M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57450K .......... .......... .......... .......... .......... 61% 265M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57500K .......... .......... .......... .......... .......... 61% 20.6M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57550K .......... .......... .......... .......... .......... 62% 248M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57600K .......... .......... .......... .......... .......... 62% 219M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57650K .......... .......... .......... .......... .......... 62% 248M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57700K .......... .......... .......... .......... .......... 62% 315M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57750K .......... .......... .......... .......... .......... 62% 256M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57800K .......... .......... .......... .......... .......... 62% 258M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57850K .......... .......... .......... .......... .......... 62% 298M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57900K .......... .......... .......... .......... .......... 62% 273M 0s 2024-09-12T18:10:05.471 INFO:teuthology.orchestra.run.smithi157.stderr: 57950K .......... .......... .......... .......... .......... 62% 304M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58000K .......... .......... .......... .......... .......... 62% 253M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58050K .......... .......... .......... .......... .......... 62% 305M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58100K .......... .......... .......... .......... .......... 62% 308M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58150K .......... .......... .......... .......... .......... 62% 326M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58200K .......... .......... .......... .......... .......... 62% 242M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58250K .......... .......... .......... .......... .......... 62% 285M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58300K .......... .......... .......... .......... .......... 62% 268M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58350K .......... .......... .......... .......... .......... 62% 257M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58400K .......... .......... .......... .......... .......... 62% 233M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58450K .......... .......... .......... .......... .......... 62% 263M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58500K .......... .......... .......... .......... .......... 63% 328M 0s 2024-09-12T18:10:05.472 INFO:teuthology.orchestra.run.smithi157.stderr: 58550K .......... .......... .......... .......... .......... 63% 277M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 58600K .......... .......... .......... .......... .......... 63% 306M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 58650K .......... .......... .......... .......... .......... 63% 307M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 58700K .......... .......... .......... .......... .......... 63% 287M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 58750K .......... .......... .......... .......... .......... 63% 273M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 58800K .......... .......... .......... .......... .......... 63% 236M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 58850K .......... .......... .......... .......... .......... 63% 236M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 58900K .......... .......... .......... .......... .......... 63% 347M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 58950K .......... .......... .......... .......... .......... 63% 315M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 59000K .......... .......... .......... .......... .......... 63% 239M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 59050K .......... .......... .......... .......... .......... 63% 338M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 59100K .......... .......... .......... .......... .......... 63% 257M 0s 2024-09-12T18:10:05.473 INFO:teuthology.orchestra.run.smithi157.stderr: 59150K .......... .......... .......... .......... .......... 63% 314M 0s 2024-09-12T18:10:05.474 INFO:teuthology.orchestra.run.smithi157.stderr: 59200K .......... .......... .......... .......... .......... 63% 255M 0s 2024-09-12T18:10:05.474 INFO:teuthology.orchestra.run.smithi157.stderr: 59250K .......... .......... .......... .......... .......... 63% 342M 0s 2024-09-12T18:10:05.474 INFO:teuthology.orchestra.run.smithi157.stderr: 59300K .......... .......... .......... .......... .......... 63% 329M 0s 2024-09-12T18:10:05.474 INFO:teuthology.orchestra.run.smithi157.stderr: 59350K .......... .......... .......... .......... .......... 63% 303M 0s 2024-09-12T18:10:05.474 INFO:teuthology.orchestra.run.smithi157.stderr: 59400K .......... .......... .......... .......... .......... 63% 375M 0s 2024-09-12T18:10:05.474 INFO:teuthology.orchestra.run.smithi157.stderr: 59450K .......... .......... .......... .......... .......... 64% 231M 0s 2024-09-12T18:10:05.474 INFO:teuthology.orchestra.run.smithi157.stderr: 59500K .......... .......... .......... .......... .......... 64% 188M 0s 2024-09-12T18:10:05.474 INFO:teuthology.orchestra.run.smithi157.stderr: 59550K .......... .......... .......... .......... .......... 64% 288M 0s 2024-09-12T18:10:05.474 INFO:teuthology.orchestra.run.smithi157.stderr: 59600K .......... .......... .......... .......... .......... 64% 307M 0s 2024-09-12T18:10:05.474 INFO:teuthology.orchestra.run.smithi157.stderr: 59650K .......... .......... .......... .......... .......... 64% 350M 0s 2024-09-12T18:10:05.475 INFO:teuthology.orchestra.run.smithi157.stderr: 59700K .......... .......... .......... .......... .......... 64% 295M 0s 2024-09-12T18:10:05.475 INFO:teuthology.orchestra.run.smithi157.stderr: 59750K .......... .......... .......... .......... .......... 64% 326M 0s 2024-09-12T18:10:05.475 INFO:teuthology.orchestra.run.smithi157.stderr: 59800K .......... .......... .......... .......... .......... 64% 299M 0s 2024-09-12T18:10:05.475 INFO:teuthology.orchestra.run.smithi157.stderr: 59850K .......... .......... .......... .......... .......... 64% 365M 0s 2024-09-12T18:10:05.475 INFO:teuthology.orchestra.run.smithi157.stderr: 59900K .......... .......... .......... .......... .......... 64% 308M 0s 2024-09-12T18:10:05.475 INFO:teuthology.orchestra.run.smithi157.stderr: 59950K .......... .......... .......... .......... .......... 64% 16.3M 0s 2024-09-12T18:10:05.475 INFO:teuthology.orchestra.run.smithi157.stderr: 60000K .......... .......... .......... .......... .......... 64% 239M 0s 2024-09-12T18:10:05.475 INFO:teuthology.orchestra.run.smithi157.stderr: 60050K .......... .......... .......... .......... .......... 64% 241M 0s 2024-09-12T18:10:05.475 INFO:teuthology.orchestra.run.smithi157.stderr: 60100K .......... .......... .......... .......... .......... 64% 236M 0s 2024-09-12T18:10:05.475 INFO:teuthology.orchestra.run.smithi157.stderr: 60150K .......... .......... .......... .......... .......... 64% 244M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60200K .......... .......... .......... .......... .......... 64% 261M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60250K .......... .......... .......... .......... .......... 64% 251M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60300K .......... .......... .......... .......... .......... 64% 215M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60350K .......... .......... .......... .......... .......... 65% 271M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60400K .......... .......... .......... .......... .......... 65% 222M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60450K .......... .......... .......... .......... .......... 65% 317M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60500K .......... .......... .......... .......... .......... 65% 295M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60550K .......... .......... .......... .......... .......... 65% 360M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60600K .......... .......... .......... .......... .......... 65% 309M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60650K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60700K .......... .......... .......... .......... .......... 65% 285M 0s 2024-09-12T18:10:05.476 INFO:teuthology.orchestra.run.smithi157.stderr: 60750K .......... .......... .......... .......... .......... 65% 300M 0s 2024-09-12T18:10:05.477 INFO:teuthology.orchestra.run.smithi157.stderr: 60800K .......... .......... .......... .......... .......... 65% 337M 0s 2024-09-12T18:10:05.477 INFO:teuthology.orchestra.run.smithi157.stderr: 60850K .......... .......... .......... .......... .......... 65% 281M 0s 2024-09-12T18:10:05.477 INFO:teuthology.orchestra.run.smithi157.stderr: 60900K .......... .......... .......... .......... .......... 65% 284M 0s 2024-09-12T18:10:05.477 INFO:teuthology.orchestra.run.smithi157.stderr: 60950K .......... .......... .......... .......... .......... 65% 249M 0s 2024-09-12T18:10:05.477 INFO:teuthology.orchestra.run.smithi157.stderr: 61000K .......... .......... .......... .......... .......... 65% 269M 0s 2024-09-12T18:10:05.477 INFO:teuthology.orchestra.run.smithi157.stderr: 61050K .......... .......... .......... .......... .......... 65% 256M 0s 2024-09-12T18:10:05.477 INFO:teuthology.orchestra.run.smithi157.stderr: 61100K .......... .......... .......... .......... .......... 65% 282M 0s 2024-09-12T18:10:05.477 INFO:teuthology.orchestra.run.smithi157.stderr: 61150K .......... .......... .......... .......... .......... 65% 266M 0s 2024-09-12T18:10:05.477 INFO:teuthology.orchestra.run.smithi157.stderr: 61200K .......... .......... .......... .......... .......... 65% 299M 0s 2024-09-12T18:10:05.477 INFO:teuthology.orchestra.run.smithi157.stderr: 61250K .......... .......... .......... .......... .......... 65% 318M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61300K .......... .......... .......... .......... .......... 66% 248M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61350K .......... .......... .......... .......... .......... 66% 247M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61400K .......... .......... .......... .......... .......... 66% 300M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61450K .......... .......... .......... .......... .......... 66% 276M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61500K .......... .......... .......... .......... .......... 66% 276M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61550K .......... .......... .......... .......... .......... 66% 220M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61600K .......... .......... .......... .......... .......... 66% 313M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61650K .......... .......... .......... .......... .......... 66% 272M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61700K .......... .......... .......... .......... .......... 66% 292M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61750K .......... .......... .......... .......... .......... 66% 320M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61800K .......... .......... .......... .......... .......... 66% 371M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61850K .......... .......... .......... .......... .......... 66% 325M 0s 2024-09-12T18:10:05.478 INFO:teuthology.orchestra.run.smithi157.stderr: 61900K .......... .......... .......... .......... .......... 66% 304M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 61950K .......... .......... .......... .......... .......... 66% 240M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 62000K .......... .......... .......... .......... .......... 66% 311M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 62050K .......... .......... .......... .......... .......... 66% 230M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 62100K .......... .......... .......... .......... .......... 66% 374M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 62150K .......... .......... .......... .......... .......... 66% 269M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 62200K .......... .......... .......... .......... .......... 67% 345M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 62250K .......... .......... .......... .......... .......... 67% 360M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 62300K .......... .......... .......... .......... .......... 67% 305M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 62350K .......... .......... .......... .......... .......... 67% 257M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 62400K .......... .......... .......... .......... .......... 67% 294M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 62450K .......... .......... .......... .......... .......... 67% 316M 0s 2024-09-12T18:10:05.479 INFO:teuthology.orchestra.run.smithi157.stderr: 62500K .......... .......... .......... .......... .......... 67% 317M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 62550K .......... .......... .......... .......... .......... 67% 295M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 62600K .......... .......... .......... .......... .......... 67% 339M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 62650K .......... .......... .......... .......... .......... 67% 334M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 62700K .......... .......... .......... .......... .......... 67% 21.3M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 62750K .......... .......... .......... .......... .......... 67% 216M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 62800K .......... .......... .......... .......... .......... 67% 255M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 62850K .......... .......... .......... .......... .......... 67% 265M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 62900K .......... .......... .......... .......... .......... 67% 269M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 62950K .......... .......... .......... .......... .......... 67% 227M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 63000K .......... .......... .......... .......... .......... 67% 282M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 63050K .......... .......... .......... .......... .......... 67% 326M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 63100K .......... .......... .......... .......... .......... 67% 280M 0s 2024-09-12T18:10:05.480 INFO:teuthology.orchestra.run.smithi157.stderr: 63150K .......... .......... .......... .......... .......... 68% 243M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63200K .......... .......... .......... .......... .......... 68% 281M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63250K .......... .......... .......... .......... .......... 68% 285M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63300K .......... .......... .......... .......... .......... 68% 344M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63350K .......... .......... .......... .......... .......... 68% 276M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63400K .......... .......... .......... .......... .......... 68% 259M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63450K .......... .......... .......... .......... .......... 68% 286M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63500K .......... .......... .......... .......... .......... 68% 274M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63550K .......... .......... .......... .......... .......... 68% 259M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63600K .......... .......... .......... .......... .......... 68% 321M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63650K .......... .......... .......... .......... .......... 68% 249M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63700K .......... .......... .......... .......... .......... 68% 345M 0s 2024-09-12T18:10:05.481 INFO:teuthology.orchestra.run.smithi157.stderr: 63750K .......... .......... .......... .......... .......... 68% 271M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 63800K .......... .......... .......... .......... .......... 68% 258M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 63850K .......... .......... .......... .......... .......... 68% 328M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 63900K .......... .......... .......... .......... .......... 68% 269M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 63950K .......... .......... .......... .......... .......... 68% 252M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 64000K .......... .......... .......... .......... .......... 68% 391M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 64050K .......... .......... .......... .......... .......... 68% 301M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 64100K .......... .......... .......... .......... .......... 69% 241M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 64150K .......... .......... .......... .......... .......... 69% 275M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 64200K .......... .......... .......... .......... .......... 69% 340M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 64250K .......... .......... .......... .......... .......... 69% 271M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 64300K .......... .......... .......... .......... .......... 69% 311M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 64350K .......... .......... .......... .......... .......... 69% 238M 0s 2024-09-12T18:10:05.482 INFO:teuthology.orchestra.run.smithi157.stderr: 64400K .......... .......... .......... .......... .......... 69% 329M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 64450K .......... .......... .......... .......... .......... 69% 290M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 64500K .......... .......... .......... .......... .......... 69% 307M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 64550K .......... .......... .......... .......... .......... 69% 294M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 64600K .......... .......... .......... .......... .......... 69% 322M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 64650K .......... .......... .......... .......... .......... 69% 324M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 64700K .......... .......... .......... .......... .......... 69% 325M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 64750K .......... .......... .......... .......... .......... 69% 244M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 64800K .......... .......... .......... .......... .......... 69% 268M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 64850K .......... .......... .......... .......... .......... 69% 263M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 64900K .......... .......... .......... .......... .......... 69% 303M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 64950K .......... .......... .......... .......... .......... 69% 333M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 65000K .......... .......... .......... .......... .......... 70% 354M 0s 2024-09-12T18:10:05.483 INFO:teuthology.orchestra.run.smithi157.stderr: 65050K .......... .......... .......... .......... .......... 70% 350M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65100K .......... .......... .......... .......... .......... 70% 338M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65150K .......... .......... .......... .......... .......... 70% 283M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65200K .......... .......... .......... .......... .......... 70% 373M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65250K .......... .......... .......... .......... .......... 70% 15.8M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65300K .......... .......... .......... .......... .......... 70% 260M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65350K .......... .......... .......... .......... .......... 70% 236M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65400K .......... .......... .......... .......... .......... 70% 264M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65450K .......... .......... .......... .......... .......... 70% 250M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65500K .......... .......... .......... .......... .......... 70% 283M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65550K .......... .......... .......... .......... .......... 70% 242M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65600K .......... .......... .......... .......... .......... 70% 271M 0s 2024-09-12T18:10:05.484 INFO:teuthology.orchestra.run.smithi157.stderr: 65650K .......... .......... .......... .......... .......... 70% 262M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 65700K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 65750K .......... .......... .......... .......... .......... 70% 258M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 65800K .......... .......... .......... .......... .......... 70% 330M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 65850K .......... .......... .......... .......... .......... 70% 300M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 65900K .......... .......... .......... .......... .......... 70% 300M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 65950K .......... .......... .......... .......... .......... 71% 309M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 66000K .......... .......... .......... .......... .......... 71% 320M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 66050K .......... .......... .......... .......... .......... 71% 245M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 66100K .......... .......... .......... .......... .......... 71% 234M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 66150K .......... .......... .......... .......... .......... 71% 331M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 66200K .......... .......... .......... .......... .......... 71% 349M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 66250K .......... .......... .......... .......... .......... 71% 289M 0s 2024-09-12T18:10:05.485 INFO:teuthology.orchestra.run.smithi157.stderr: 66300K .......... .......... .......... .......... .......... 71% 308M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66350K .......... .......... .......... .......... .......... 71% 232M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66400K .......... .......... .......... .......... .......... 71% 311M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66450K .......... .......... .......... .......... .......... 71% 257M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66500K .......... .......... .......... .......... .......... 71% 277M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66550K .......... .......... .......... .......... .......... 71% 262M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66600K .......... .......... .......... .......... .......... 71% 265M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66650K .......... .......... .......... .......... .......... 71% 251M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66700K .......... .......... .......... .......... .......... 71% 281M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66750K .......... .......... .......... .......... .......... 71% 245M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66800K .......... .......... .......... .......... .......... 71% 274M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66850K .......... .......... .......... .......... .......... 72% 280M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66900K .......... .......... .......... .......... .......... 72% 286M 0s 2024-09-12T18:10:05.486 INFO:teuthology.orchestra.run.smithi157.stderr: 66950K .......... .......... .......... .......... .......... 72% 223M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67000K .......... .......... .......... .......... .......... 72% 229M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67050K .......... .......... .......... .......... .......... 72% 367M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67100K .......... .......... .......... .......... .......... 72% 379M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67150K .......... .......... .......... .......... .......... 72% 267M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67200K .......... .......... .......... .......... .......... 72% 272M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67250K .......... .......... .......... .......... .......... 72% 272M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67300K .......... .......... .......... .......... .......... 72% 230M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67350K .......... .......... .......... .......... .......... 72% 241M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67400K .......... .......... .......... .......... .......... 72% 319M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67450K .......... .......... .......... .......... .......... 72% 375M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67500K .......... .......... .......... .......... .......... 72% 360M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67550K .......... .......... .......... .......... .......... 72% 275M 0s 2024-09-12T18:10:05.487 INFO:teuthology.orchestra.run.smithi157.stderr: 67600K .......... .......... .......... .......... .......... 72% 317M 0s 2024-09-12T18:10:05.488 INFO:teuthology.orchestra.run.smithi157.stderr: 67650K .......... .......... .......... .......... .......... 72% 365M 0s 2024-09-12T18:10:05.488 INFO:teuthology.orchestra.run.smithi157.stderr: 67700K .......... .......... .......... .......... .......... 72% 339M 0s 2024-09-12T18:10:05.488 INFO:teuthology.orchestra.run.smithi157.stderr: 67750K .......... .......... .......... .......... .......... 72% 268M 0s 2024-09-12T18:10:05.488 INFO:teuthology.orchestra.run.smithi157.stderr: 67800K .......... .......... .......... .......... .......... 73% 366M 0s 2024-09-12T18:10:05.488 INFO:teuthology.orchestra.run.smithi157.stderr: 67850K .......... .......... .......... .......... .......... 73% 377M 0s 2024-09-12T18:10:05.488 INFO:teuthology.orchestra.run.smithi157.stderr: 67900K .......... .......... .......... .......... .......... 73% 322M 0s 2024-09-12T18:10:05.488 INFO:teuthology.orchestra.run.smithi157.stderr: 67950K .......... .......... .......... .......... .......... 73% 333M 0s 2024-09-12T18:10:05.488 INFO:teuthology.orchestra.run.smithi157.stderr: 68000K .......... .......... .......... .......... .......... 73% 20.0M 0s 2024-09-12T18:10:05.488 INFO:teuthology.orchestra.run.smithi157.stderr: 68050K .......... .......... .......... .......... .......... 73% 238M 0s 2024-09-12T18:10:05.488 INFO:teuthology.orchestra.run.smithi157.stderr: 68100K .......... .......... .......... .......... .......... 73% 233M 0s 2024-09-12T18:10:05.489 INFO:teuthology.orchestra.run.smithi157.stderr: 68150K .......... .......... .......... .......... .......... 73% 269M 0s 2024-09-12T18:10:05.489 INFO:teuthology.orchestra.run.smithi157.stderr: 68200K .......... .......... .......... .......... .......... 73% 263M 0s 2024-09-12T18:10:05.489 INFO:teuthology.orchestra.run.smithi157.stderr: 68250K .......... .......... .......... .......... .......... 73% 266M 0s 2024-09-12T18:10:05.489 INFO:teuthology.orchestra.run.smithi157.stderr: 68300K .......... .......... .......... .......... .......... 73% 264M 0s 2024-09-12T18:10:05.489 INFO:teuthology.orchestra.run.smithi157.stderr: 68350K .......... .......... .......... .......... .......... 73% 196M 0s 2024-09-12T18:10:05.489 INFO:teuthology.orchestra.run.smithi157.stderr: 68400K .......... .......... .......... .......... .......... 73% 246M 0s 2024-09-12T18:10:05.489 INFO:teuthology.orchestra.run.smithi157.stderr: 68450K .......... .......... .......... .......... .......... 73% 289M 0s 2024-09-12T18:10:05.489 INFO:teuthology.orchestra.run.smithi157.stderr: 68500K .......... .......... .......... .......... .......... 73% 255M 0s 2024-09-12T18:10:05.489 INFO:teuthology.orchestra.run.smithi157.stderr: 68550K .......... .......... .......... .......... .......... 73% 254M 0s 2024-09-12T18:10:05.489 INFO:teuthology.orchestra.run.smithi157.stderr: 68600K .......... .......... .......... .......... .......... 73% 295M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 68650K .......... .......... .......... .......... .......... 73% 281M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 68700K .......... .......... .......... .......... .......... 74% 285M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 68750K .......... .......... .......... .......... .......... 74% 217M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 68800K .......... .......... .......... .......... .......... 74% 341M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 68850K .......... .......... .......... .......... .......... 74% 267M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 68900K .......... .......... .......... .......... .......... 74% 265M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 68950K .......... .......... .......... .......... .......... 74% 290M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 69000K .......... .......... .......... .......... .......... 74% 332M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 69050K .......... .......... .......... .......... .......... 74% 272M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 69100K .......... .......... .......... .......... .......... 74% 334M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 69150K .......... .......... .......... .......... .......... 74% 204M 0s 2024-09-12T18:10:05.490 INFO:teuthology.orchestra.run.smithi157.stderr: 69200K .......... .......... .......... .......... .......... 74% 354M 0s 2024-09-12T18:10:05.491 INFO:teuthology.orchestra.run.smithi157.stderr: 69250K .......... .......... .......... .......... .......... 74% 266M 0s 2024-09-12T18:10:05.491 INFO:teuthology.orchestra.run.smithi157.stderr: 69300K .......... .......... .......... .......... .......... 74% 233M 0s 2024-09-12T18:10:05.491 INFO:teuthology.orchestra.run.smithi157.stderr: 69350K .......... .......... .......... .......... .......... 74% 253M 0s 2024-09-12T18:10:05.491 INFO:teuthology.orchestra.run.smithi157.stderr: 69400K .......... .......... .......... .......... .......... 74% 253M 0s 2024-09-12T18:10:05.491 INFO:teuthology.orchestra.run.smithi157.stderr: 69450K .......... .......... .......... .......... .......... 74% 284M 0s 2024-09-12T18:10:05.491 INFO:teuthology.orchestra.run.smithi157.stderr: 69500K .......... .......... .......... .......... .......... 74% 259M 0s 2024-09-12T18:10:05.491 INFO:teuthology.orchestra.run.smithi157.stderr: 69550K .......... .......... .......... .......... .......... 74% 217M 0s 2024-09-12T18:10:05.491 INFO:teuthology.orchestra.run.smithi157.stderr: 69600K .......... .......... .......... .......... .......... 74% 314M 0s 2024-09-12T18:10:05.491 INFO:teuthology.orchestra.run.smithi157.stderr: 69650K .......... .......... .......... .......... .......... 75% 287M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 69700K .......... .......... .......... .......... .......... 75% 399M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 69750K .......... .......... .......... .......... .......... 75% 269M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 69800K .......... .......... .......... .......... .......... 75% 303M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 69850K .......... .......... .......... .......... .......... 75% 343M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 69900K .......... .......... .......... .......... .......... 75% 283M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 69950K .......... .......... .......... .......... .......... 75% 260M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 70000K .......... .......... .......... .......... .......... 75% 355M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 70050K .......... .......... .......... .......... .......... 75% 307M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 70100K .......... .......... .......... .......... .......... 75% 355M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 70150K .......... .......... .......... .......... .......... 75% 301M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 70200K .......... .......... .......... .......... .......... 75% 354M 0s 2024-09-12T18:10:05.492 INFO:teuthology.orchestra.run.smithi157.stderr: 70250K .......... .......... .......... .......... .......... 75% 347M 0s 2024-09-12T18:10:05.493 INFO:teuthology.orchestra.run.smithi157.stderr: 70300K .......... .......... .......... .......... .......... 75% 314M 0s 2024-09-12T18:10:05.493 INFO:teuthology.orchestra.run.smithi157.stderr: 70350K .......... .......... .......... .......... .......... 75% 292M 0s 2024-09-12T18:10:05.493 INFO:teuthology.orchestra.run.smithi157.stderr: 70400K .......... .......... .......... .......... .......... 75% 306M 0s 2024-09-12T18:10:05.493 INFO:teuthology.orchestra.run.smithi157.stderr: 70450K .......... .......... .......... .......... .......... 75% 360M 0s 2024-09-12T18:10:05.493 INFO:teuthology.orchestra.run.smithi157.stderr: 70500K .......... .......... .......... .......... .......... 75% 350M 0s 2024-09-12T18:10:05.493 INFO:teuthology.orchestra.run.smithi157.stderr: 70550K .......... .......... .......... .......... .......... 75% 16.9M 0s 2024-09-12T18:10:05.493 INFO:teuthology.orchestra.run.smithi157.stderr: 70600K .......... .......... .......... .......... .......... 76% 309M 0s 2024-09-12T18:10:05.493 INFO:teuthology.orchestra.run.smithi157.stderr: 70650K .......... .......... .......... .......... .......... 76% 305M 0s 2024-09-12T18:10:05.493 INFO:teuthology.orchestra.run.smithi157.stderr: 70700K .......... .......... .......... .......... .......... 76% 245M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 70750K .......... .......... .......... .......... .......... 76% 260M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 70800K .......... .......... .......... .......... .......... 76% 301M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 70850K .......... .......... .......... .......... .......... 76% 318M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 70900K .......... .......... .......... .......... .......... 76% 298M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 70950K .......... .......... .......... .......... .......... 76% 321M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 71000K .......... .......... .......... .......... .......... 76% 235M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 71050K .......... .......... .......... .......... .......... 76% 258M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 71100K .......... .......... .......... .......... .......... 76% 255M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 71150K .......... .......... .......... .......... .......... 76% 232M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 71200K .......... .......... .......... .......... .......... 76% 283M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 71250K .......... .......... .......... .......... .......... 76% 317M 0s 2024-09-12T18:10:05.494 INFO:teuthology.orchestra.run.smithi157.stderr: 71300K .......... .......... .......... .......... .......... 76% 289M 0s 2024-09-12T18:10:05.495 INFO:teuthology.orchestra.run.smithi157.stderr: 71350K .......... .......... .......... .......... .......... 76% 248M 0s 2024-09-12T18:10:05.495 INFO:teuthology.orchestra.run.smithi157.stderr: 71400K .......... .......... .......... .......... .......... 76% 292M 0s 2024-09-12T18:10:05.495 INFO:teuthology.orchestra.run.smithi157.stderr: 71450K .......... .......... .......... .......... .......... 76% 248M 0s 2024-09-12T18:10:05.495 INFO:teuthology.orchestra.run.smithi157.stderr: 71500K .......... .......... .......... .......... .......... 77% 308M 0s 2024-09-12T18:10:05.495 INFO:teuthology.orchestra.run.smithi157.stderr: 71550K .......... .......... .......... .......... .......... 77% 241M 0s 2024-09-12T18:10:05.495 INFO:teuthology.orchestra.run.smithi157.stderr: 71600K .......... .......... .......... .......... .......... 77% 252M 0s 2024-09-12T18:10:05.495 INFO:teuthology.orchestra.run.smithi157.stderr: 71650K .......... .......... .......... .......... .......... 77% 318M 0s 2024-09-12T18:10:05.495 INFO:teuthology.orchestra.run.smithi157.stderr: 71700K .......... .......... .......... .......... .......... 77% 324M 0s 2024-09-12T18:10:05.495 INFO:teuthology.orchestra.run.smithi157.stderr: 71750K .......... .......... .......... .......... .......... 77% 243M 0s 2024-09-12T18:10:05.495 INFO:teuthology.orchestra.run.smithi157.stderr: 71800K .......... .......... .......... .......... .......... 77% 248M 0s 2024-09-12T18:10:05.496 INFO:teuthology.orchestra.run.smithi157.stderr: 71850K .......... .......... .......... .......... .......... 77% 259M 0s 2024-09-12T18:10:05.496 INFO:teuthology.orchestra.run.smithi157.stderr: 71900K .......... .......... .......... .......... .......... 77% 279M 0s 2024-09-12T18:10:05.496 INFO:teuthology.orchestra.run.smithi157.stderr: 71950K .......... .......... .......... .......... .......... 77% 268M 0s 2024-09-12T18:10:05.496 INFO:teuthology.orchestra.run.smithi157.stderr: 72000K .......... .......... .......... .......... .......... 77% 245M 0s 2024-09-12T18:10:05.496 INFO:teuthology.orchestra.run.smithi157.stderr: 72050K .......... .......... .......... .......... .......... 77% 322M 0s 2024-09-12T18:10:05.496 INFO:teuthology.orchestra.run.smithi157.stderr: 72100K .......... .......... .......... .......... .......... 77% 325M 0s 2024-09-12T18:10:05.496 INFO:teuthology.orchestra.run.smithi157.stderr: 72150K .......... .......... .......... .......... .......... 77% 291M 0s 2024-09-12T18:10:05.496 INFO:teuthology.orchestra.run.smithi157.stderr: 72200K .......... .......... .......... .......... .......... 77% 326M 0s 2024-09-12T18:10:05.496 INFO:teuthology.orchestra.run.smithi157.stderr: 72250K .......... .......... .......... .......... .......... 77% 310M 0s 2024-09-12T18:10:05.496 INFO:teuthology.orchestra.run.smithi157.stderr: 72300K .......... .......... .......... .......... .......... 77% 241M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72350K .......... .......... .......... .......... .......... 77% 333M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72400K .......... .......... .......... .......... .......... 77% 334M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72450K .......... .......... .......... .......... .......... 78% 370M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72500K .......... .......... .......... .......... .......... 78% 280M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72550K .......... .......... .......... .......... .......... 78% 343M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72600K .......... .......... .......... .......... .......... 78% 334M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72650K .......... .......... .......... .......... .......... 78% 285M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72700K .......... .......... .......... .......... .......... 78% 238M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72750K .......... .......... .......... .......... .......... 78% 295M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72800K .......... .......... .......... .......... .......... 78% 335M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72850K .......... .......... .......... .......... .......... 78% 290M 0s 2024-09-12T18:10:05.497 INFO:teuthology.orchestra.run.smithi157.stderr: 72900K .......... .......... .......... .......... .......... 78% 282M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 72950K .......... .......... .......... .......... .......... 78% 282M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 73000K .......... .......... .......... .......... .......... 78% 340M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 73050K .......... .......... .......... .......... .......... 78% 336M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 73100K .......... .......... .......... .......... .......... 78% 233M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 73150K .......... .......... .......... .......... .......... 78% 331M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 73200K .......... .......... .......... .......... .......... 78% 17.8M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 73250K .......... .......... .......... .......... .......... 78% 241M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 73300K .......... .......... .......... .......... .......... 78% 218M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 73350K .......... .......... .......... .......... .......... 79% 268M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 73400K .......... .......... .......... .......... .......... 79% 264M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 73450K .......... .......... .......... .......... .......... 79% 295M 0s 2024-09-12T18:10:05.498 INFO:teuthology.orchestra.run.smithi157.stderr: 73500K .......... .......... .......... .......... .......... 79% 214M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 73550K .......... .......... .......... .......... .......... 79% 313M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 73600K .......... .......... .......... .......... .......... 79% 235M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 73650K .......... .......... .......... .......... .......... 79% 251M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 73700K .......... .......... .......... .......... .......... 79% 231M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 73750K .......... .......... .......... .......... .......... 79% 272M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 73800K .......... .......... .......... .......... .......... 79% 291M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 73850K .......... .......... .......... .......... .......... 79% 249M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 73900K .......... .......... .......... .......... .......... 79% 219M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 73950K .......... .......... .......... .......... .......... 79% 286M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 74000K .......... .......... .......... .......... .......... 79% 257M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 74050K .......... .......... .......... .......... .......... 79% 282M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 74100K .......... .......... .......... .......... .......... 79% 319M 0s 2024-09-12T18:10:05.499 INFO:teuthology.orchestra.run.smithi157.stderr: 74150K .......... .......... .......... .......... .......... 79% 244M 0s 2024-09-12T18:10:05.500 INFO:teuthology.orchestra.run.smithi157.stderr: 74200K .......... .......... .......... .......... .......... 79% 236M 0s 2024-09-12T18:10:05.500 INFO:teuthology.orchestra.run.smithi157.stderr: 74250K .......... .......... .......... .......... .......... 79% 361M 0s 2024-09-12T18:10:05.500 INFO:teuthology.orchestra.run.smithi157.stderr: 74300K .......... .......... .......... .......... .......... 80% 247M 0s 2024-09-12T18:10:05.500 INFO:teuthology.orchestra.run.smithi157.stderr: 74350K .......... .......... .......... .......... .......... 80% 286M 0s 2024-09-12T18:10:05.500 INFO:teuthology.orchestra.run.smithi157.stderr: 74400K .......... .......... .......... .......... .......... 80% 253M 0s 2024-09-12T18:10:05.500 INFO:teuthology.orchestra.run.smithi157.stderr: 74450K .......... .......... .......... .......... .......... 80% 334M 0s 2024-09-12T18:10:05.500 INFO:teuthology.orchestra.run.smithi157.stderr: 74500K .......... .......... .......... .......... .......... 80% 304M 0s 2024-09-12T18:10:05.500 INFO:teuthology.orchestra.run.smithi157.stderr: 74550K .......... .......... .......... .......... .......... 80% 360M 0s 2024-09-12T18:10:05.500 INFO:teuthology.orchestra.run.smithi157.stderr: 74600K .......... .......... .......... .......... .......... 80% 342M 0s 2024-09-12T18:10:05.500 INFO:teuthology.orchestra.run.smithi157.stderr: 74650K .......... .......... .......... .......... .......... 80% 304M 0s 2024-09-12T18:10:05.500 INFO:teuthology.orchestra.run.smithi157.stderr: 74700K .......... .......... .......... .......... .......... 80% 224M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 74750K .......... .......... .......... .......... .......... 80% 262M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 74800K .......... .......... .......... .......... .......... 80% 234M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 74850K .......... .......... .......... .......... .......... 80% 253M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 74900K .......... .......... .......... .......... .......... 80% 330M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 74950K .......... .......... .......... .......... .......... 80% 347M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 75000K .......... .......... .......... .......... .......... 80% 327M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 75050K .......... .......... .......... .......... .......... 80% 329M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 75100K .......... .......... .......... .......... .......... 80% 276M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 75150K .......... .......... .......... .......... .......... 80% 345M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 75200K .......... .......... .......... .......... .......... 81% 275M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 75250K .......... .......... .......... .......... .......... 81% 297M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 75300K .......... .......... .......... .......... .......... 81% 235M 0s 2024-09-12T18:10:05.501 INFO:teuthology.orchestra.run.smithi157.stderr: 75350K .......... .......... .......... .......... .......... 81% 282M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75400K .......... .......... .......... .......... .......... 81% 341M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75450K .......... .......... .......... .......... .......... 81% 379M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75500K .......... .......... .......... .......... .......... 81% 312M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75550K .......... .......... .......... .......... .......... 81% 357M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75600K .......... .......... .......... .......... .......... 81% 335M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75650K .......... .......... .......... .......... .......... 81% 377M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75700K .......... .......... .......... .......... .......... 81% 303M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75750K .......... .......... .......... .......... .......... 81% 361M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75800K .......... .......... .......... .......... .......... 81% 299M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75850K .......... .......... .......... .......... .......... 81% 413M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75900K .......... .......... .......... .......... .......... 81% 19.0M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 75950K .......... .......... .......... .......... .......... 81% 246M 0s 2024-09-12T18:10:05.502 INFO:teuthology.orchestra.run.smithi157.stderr: 76000K .......... .......... .......... .......... .......... 81% 245M 0s 2024-09-12T18:10:05.503 INFO:teuthology.orchestra.run.smithi157.stderr: 76050K .......... .......... .......... .......... .......... 81% 229M 0s 2024-09-12T18:10:05.503 INFO:teuthology.orchestra.run.smithi157.stderr: 76100K .......... .......... .......... .......... .......... 81% 206M 0s 2024-09-12T18:10:05.503 INFO:teuthology.orchestra.run.smithi157.stderr: 76150K .......... .......... .......... .......... .......... 82% 276M 0s 2024-09-12T18:10:05.503 INFO:teuthology.orchestra.run.smithi157.stderr: 76200K .......... .......... .......... .......... .......... 82% 273M 0s 2024-09-12T18:10:05.503 INFO:teuthology.orchestra.run.smithi157.stderr: 76250K .......... .......... .......... .......... .......... 82% 271M 0s 2024-09-12T18:10:05.503 INFO:teuthology.orchestra.run.smithi157.stderr: 76300K .......... .......... .......... .......... .......... 82% 248M 0s 2024-09-12T18:10:05.503 INFO:teuthology.orchestra.run.smithi157.stderr: 76350K .......... .......... .......... .......... .......... 82% 283M 0s 2024-09-12T18:10:05.503 INFO:teuthology.orchestra.run.smithi157.stderr: 76400K .......... .......... .......... .......... .......... 82% 282M 0s 2024-09-12T18:10:05.503 INFO:teuthology.orchestra.run.smithi157.stderr: 76450K .......... .......... .......... .......... .......... 82% 235M 0s 2024-09-12T18:10:05.503 INFO:teuthology.orchestra.run.smithi157.stderr: 76500K .......... .......... .......... .......... .......... 82% 243M 0s 2024-09-12T18:10:05.503 INFO:teuthology.orchestra.run.smithi157.stderr: 76550K .......... .......... .......... .......... .......... 82% 271M 0s 2024-09-12T18:10:05.504 INFO:teuthology.orchestra.run.smithi157.stderr: 76600K .......... .......... .......... .......... .......... 82% 353M 0s 2024-09-12T18:10:05.504 INFO:teuthology.orchestra.run.smithi157.stderr: 76650K .......... .......... .......... .......... .......... 82% 279M 0s 2024-09-12T18:10:05.504 INFO:teuthology.orchestra.run.smithi157.stderr: 76700K .......... .......... .......... .......... .......... 82% 250M 0s 2024-09-12T18:10:05.504 INFO:teuthology.orchestra.run.smithi157.stderr: 76750K .......... .......... .......... .......... .......... 82% 314M 0s 2024-09-12T18:10:05.504 INFO:teuthology.orchestra.run.smithi157.stderr: 76800K .......... .......... .......... .......... .......... 82% 280M 0s 2024-09-12T18:10:05.504 INFO:teuthology.orchestra.run.smithi157.stderr: 76850K .......... .......... .......... .......... .......... 82% 254M 0s 2024-09-12T18:10:05.504 INFO:teuthology.orchestra.run.smithi157.stderr: 76900K .......... .......... .......... .......... .......... 82% 204M 0s 2024-09-12T18:10:05.504 INFO:teuthology.orchestra.run.smithi157.stderr: 76950K .......... .......... .......... .......... .......... 82% 278M 0s 2024-09-12T18:10:05.504 INFO:teuthology.orchestra.run.smithi157.stderr: 77000K .......... .......... .......... .......... .......... 82% 271M 0s 2024-09-12T18:10:05.504 INFO:teuthology.orchestra.run.smithi157.stderr: 77050K .......... .......... .......... .......... .......... 82% 237M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77100K .......... .......... .......... .......... .......... 83% 273M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77150K .......... .......... .......... .......... .......... 83% 315M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77200K .......... .......... .......... .......... .......... 83% 325M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77250K .......... .......... .......... .......... .......... 83% 332M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77300K .......... .......... .......... .......... .......... 83% 203M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77350K .......... .......... .......... .......... .......... 83% 259M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77400K .......... .......... .......... .......... .......... 83% 260M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77450K .......... .......... .......... .......... .......... 83% 274M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77500K .......... .......... .......... .......... .......... 83% 200M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77550K .......... .......... .......... .......... .......... 83% 350M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77600K .......... .......... .......... .......... .......... 83% 358M 0s 2024-09-12T18:10:05.505 INFO:teuthology.orchestra.run.smithi157.stderr: 77650K .......... .......... .......... .......... .......... 83% 310M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 77700K .......... .......... .......... .......... .......... 83% 367M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 77750K .......... .......... .......... .......... .......... 83% 365M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 77800K .......... .......... .......... .......... .......... 83% 342M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 77850K .......... .......... .......... .......... .......... 83% 285M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 77900K .......... .......... .......... .......... .......... 83% 205M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 77950K .......... .......... .......... .......... .......... 83% 272M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 78000K .......... .......... .......... .......... .......... 84% 289M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 78050K .......... .......... .......... .......... .......... 84% 265M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 78100K .......... .......... .......... .......... .......... 84% 251M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 78150K .......... .......... .......... .......... .......... 84% 324M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 78200K .......... .......... .......... .......... .......... 84% 359M 0s 2024-09-12T18:10:05.506 INFO:teuthology.orchestra.run.smithi157.stderr: 78250K .......... .......... .......... .......... .......... 84% 282M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78300K .......... .......... .......... .......... .......... 84% 277M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78350K .......... .......... .......... .......... .......... 84% 347M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78400K .......... .......... .......... .......... .......... 84% 359M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78450K .......... .......... .......... .......... .......... 84% 331M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78500K .......... .......... .......... .......... .......... 84% 18.8M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78550K .......... .......... .......... .......... .......... 84% 273M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78600K .......... .......... .......... .......... .......... 84% 247M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78650K .......... .......... .......... .......... .......... 84% 231M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78700K .......... .......... .......... .......... .......... 84% 192M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78750K .......... .......... .......... .......... .......... 84% 264M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78800K .......... .......... .......... .......... .......... 84% 252M 0s 2024-09-12T18:10:05.507 INFO:teuthology.orchestra.run.smithi157.stderr: 78850K .......... .......... .......... .......... .......... 84% 256M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 78900K .......... .......... .......... .......... .......... 84% 302M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 78950K .......... .......... .......... .......... .......... 85% 298M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 79000K .......... .......... .......... .......... .......... 85% 360M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 79050K .......... .......... .......... .......... .......... 85% 334M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 79100K .......... .......... .......... .......... .......... 85% 222M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 79150K .......... .......... .......... .......... .......... 85% 316M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 79200K .......... .......... .......... .......... .......... 85% 328M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 79250K .......... .......... .......... .......... .......... 85% 384M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 79300K .......... .......... .......... .......... .......... 85% 318M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 79350K .......... .......... .......... .......... .......... 85% 328M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 79400K .......... .......... .......... .......... .......... 85% 289M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 79450K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-12T18:10:05.508 INFO:teuthology.orchestra.run.smithi157.stderr: 79500K .......... .......... .......... .......... .......... 85% 239M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 79550K .......... .......... .......... .......... .......... 85% 304M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 79600K .......... .......... .......... .......... .......... 85% 279M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 79650K .......... .......... .......... .......... .......... 85% 302M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 79700K .......... .......... .......... .......... .......... 85% 258M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 79750K .......... .......... .......... .......... .......... 85% 292M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 79800K .......... .......... .......... .......... .......... 85% 355M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 79850K .......... .......... .......... .......... .......... 86% 297M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 79900K .......... .......... .......... .......... .......... 86% 280M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 79950K .......... .......... .......... .......... .......... 86% 311M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 80000K .......... .......... .......... .......... .......... 86% 318M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 80050K .......... .......... .......... .......... .......... 86% 289M 0s 2024-09-12T18:10:05.509 INFO:teuthology.orchestra.run.smithi157.stderr: 80100K .......... .......... .......... .......... .......... 86% 251M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80150K .......... .......... .......... .......... .......... 86% 350M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80200K .......... .......... .......... .......... .......... 86% 284M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80250K .......... .......... .......... .......... .......... 86% 285M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80300K .......... .......... .......... .......... .......... 86% 243M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80350K .......... .......... .......... .......... .......... 86% 317M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80400K .......... .......... .......... .......... .......... 86% 299M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80450K .......... .......... .......... .......... .......... 86% 340M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80500K .......... .......... .......... .......... .......... 86% 290M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80550K .......... .......... .......... .......... .......... 86% 363M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80600K .......... .......... .......... .......... .......... 86% 323M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80650K .......... .......... .......... .......... .......... 86% 280M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80700K .......... .......... .......... .......... .......... 86% 217M 0s 2024-09-12T18:10:05.510 INFO:teuthology.orchestra.run.smithi157.stderr: 80750K .......... .......... .......... .......... .......... 86% 307M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 80800K .......... .......... .......... .......... .......... 87% 320M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 80850K .......... .......... .......... .......... .......... 87% 266M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 80900K .......... .......... .......... .......... .......... 87% 312M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 80950K .......... .......... .......... .......... .......... 87% 334M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 81000K .......... .......... .......... .......... .......... 87% 362M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 81050K .......... .......... .......... .......... .......... 87% 358M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 81100K .......... .......... .......... .......... .......... 87% 272M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 81150K .......... .......... .......... .......... .......... 87% 317M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 81200K .......... .......... .......... .......... .......... 87% 18.5M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 81250K .......... .......... .......... .......... .......... 87% 280M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 81300K .......... .......... .......... .......... .......... 87% 279M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 81350K .......... .......... .......... .......... .......... 87% 245M 0s 2024-09-12T18:10:05.511 INFO:teuthology.orchestra.run.smithi157.stderr: 81400K .......... .......... .......... .......... .......... 87% 257M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 81450K .......... .......... .......... .......... .......... 87% 356M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 81500K .......... .......... .......... .......... .......... 87% 235M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 81550K .......... .......... .......... .......... .......... 87% 317M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 81600K .......... .......... .......... .......... .......... 87% 265M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 81650K .......... .......... .......... .......... .......... 87% 308M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 81700K .......... .......... .......... .......... .......... 87% 286M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 81750K .......... .......... .......... .......... .......... 88% 326M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 81800K .......... .......... .......... .......... .......... 88% 277M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 81850K .......... .......... .......... .......... .......... 88% 279M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 81900K .......... .......... .......... .......... .......... 88% 228M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 81950K .......... .......... .......... .......... .......... 88% 305M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 82000K .......... .......... .......... .......... .......... 88% 252M 0s 2024-09-12T18:10:05.512 INFO:teuthology.orchestra.run.smithi157.stderr: 82050K .......... .......... .......... .......... .......... 88% 330M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82100K .......... .......... .......... .......... .......... 88% 328M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82150K .......... .......... .......... .......... .......... 88% 275M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82200K .......... .......... .......... .......... .......... 88% 299M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82250K .......... .......... .......... .......... .......... 88% 280M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82300K .......... .......... .......... .......... .......... 88% 336M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82350K .......... .......... .......... .......... .......... 88% 271M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82400K .......... .......... .......... .......... .......... 88% 319M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82450K .......... .......... .......... .......... .......... 88% 321M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82500K .......... .......... .......... .......... .......... 88% 313M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82550K .......... .......... .......... .......... .......... 88% 313M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82600K .......... .......... .......... .......... .......... 88% 340M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82650K .......... .......... .......... .......... .......... 89% 325M 0s 2024-09-12T18:10:05.513 INFO:teuthology.orchestra.run.smithi157.stderr: 82700K .......... .......... .......... .......... .......... 89% 353M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 82750K .......... .......... .......... .......... .......... 89% 258M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 82800K .......... .......... .......... .......... .......... 89% 356M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 82850K .......... .......... .......... .......... .......... 89% 260M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 82900K .......... .......... .......... .......... .......... 89% 345M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 82950K .......... .......... .......... .......... .......... 89% 286M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 83000K .......... .......... .......... .......... .......... 89% 294M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 83050K .......... .......... .......... .......... .......... 89% 302M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 83100K .......... .......... .......... .......... .......... 89% 276M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 83150K .......... .......... .......... .......... .......... 89% 276M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 83200K .......... .......... .......... .......... .......... 89% 329M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 83250K .......... .......... .......... .......... .......... 89% 337M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 83300K .......... .......... .......... .......... .......... 89% 322M 0s 2024-09-12T18:10:05.514 INFO:teuthology.orchestra.run.smithi157.stderr: 83350K .......... .......... .......... .......... .......... 89% 321M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83400K .......... .......... .......... .......... .......... 89% 262M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83450K .......... .......... .......... .......... .......... 89% 348M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83500K .......... .......... .......... .......... .......... 89% 287M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83550K .......... .......... .......... .......... .......... 89% 196M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83600K .......... .......... .......... .......... .......... 90% 222M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83650K .......... .......... .......... .......... .......... 90% 324M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83700K .......... .......... .......... .......... .......... 90% 395M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83750K .......... .......... .......... .......... .......... 90% 293M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83800K .......... .......... .......... .......... .......... 90% 312M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83850K .......... .......... .......... .......... .......... 90% 358M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83900K .......... .......... .......... .......... .......... 90% 326M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 83950K .......... .......... .......... .......... .......... 90% 18.2M 0s 2024-09-12T18:10:05.515 INFO:teuthology.orchestra.run.smithi157.stderr: 84000K .......... .......... .......... .......... .......... 90% 217M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84050K .......... .......... .......... .......... .......... 90% 310M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84100K .......... .......... .......... .......... .......... 90% 271M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84150K .......... .......... .......... .......... .......... 90% 213M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84200K .......... .......... .......... .......... .......... 90% 236M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84250K .......... .......... .......... .......... .......... 90% 270M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84300K .......... .......... .......... .......... .......... 90% 255M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84350K .......... .......... .......... .......... .......... 90% 214M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84400K .......... .......... .......... .......... .......... 90% 319M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84450K .......... .......... .......... .......... .......... 90% 292M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84500K .......... .......... .......... .......... .......... 91% 291M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84550K .......... .......... .......... .......... .......... 91% 239M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84600K .......... .......... .......... .......... .......... 91% 301M 0s 2024-09-12T18:10:05.516 INFO:teuthology.orchestra.run.smithi157.stderr: 84650K .......... .......... .......... .......... .......... 91% 263M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 84700K .......... .......... .......... .......... .......... 91% 339M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 84750K .......... .......... .......... .......... .......... 91% 254M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 84800K .......... .......... .......... .......... .......... 91% 263M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 84850K .......... .......... .......... .......... .......... 91% 275M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 84900K .......... .......... .......... .......... .......... 91% 299M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 84950K .......... .......... .......... .......... .......... 91% 263M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 85000K .......... .......... .......... .......... .......... 91% 311M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 85050K .......... .......... .......... .......... .......... 91% 265M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 85100K .......... .......... .......... .......... .......... 91% 300M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 85150K .......... .......... .......... .......... .......... 91% 258M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 85200K .......... .......... .......... .......... .......... 91% 333M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 85250K .......... .......... .......... .......... .......... 91% 295M 0s 2024-09-12T18:10:05.517 INFO:teuthology.orchestra.run.smithi157.stderr: 85300K .......... .......... .......... .......... .......... 91% 334M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85350K .......... .......... .......... .......... .......... 91% 272M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85400K .......... .......... .......... .......... .......... 91% 324M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85450K .......... .......... .......... .......... .......... 92% 336M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85500K .......... .......... .......... .......... .......... 92% 341M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85550K .......... .......... .......... .......... .......... 92% 245M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85600K .......... .......... .......... .......... .......... 92% 284M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85650K .......... .......... .......... .......... .......... 92% 316M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85700K .......... .......... .......... .......... .......... 92% 321M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85750K .......... .......... .......... .......... .......... 92% 273M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85800K .......... .......... .......... .......... .......... 92% 358M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85850K .......... .......... .......... .......... .......... 92% 319M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85900K .......... .......... .......... .......... .......... 92% 342M 0s 2024-09-12T18:10:05.518 INFO:teuthology.orchestra.run.smithi157.stderr: 85950K .......... .......... .......... .......... .......... 92% 302M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86000K .......... .......... .......... .......... .......... 92% 300M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86050K .......... .......... .......... .......... .......... 92% 305M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86100K .......... .......... .......... .......... .......... 92% 234M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86150K .......... .......... .......... .......... .......... 92% 274M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86200K .......... .......... .......... .......... .......... 92% 299M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86250K .......... .......... .......... .......... .......... 92% 317M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86300K .......... .......... .......... .......... .......... 92% 297M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86350K .......... .......... .......... .......... .......... 93% 239M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86400K .......... .......... .......... .......... .......... 93% 337M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86450K .......... .......... .......... .......... .......... 93% 356M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86500K .......... .......... .......... .......... .......... 93% 343M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86550K .......... .......... .......... .......... .......... 93% 296M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86600K .......... .......... .......... .......... .......... 93% 361M 0s 2024-09-12T18:10:05.519 INFO:teuthology.orchestra.run.smithi157.stderr: 86650K .......... .......... .......... .......... .......... 93% 324M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 86700K .......... .......... .......... .......... .......... 93% 20.1M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 86750K .......... .......... .......... .......... .......... 93% 267M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 86800K .......... .......... .......... .......... .......... 93% 334M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 86850K .......... .......... .......... .......... .......... 93% 289M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 86900K .......... .......... .......... .......... .......... 93% 272M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 86950K .......... .......... .......... .......... .......... 93% 262M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 87000K .......... .......... .......... .......... .......... 93% 360M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 87050K .......... .......... .......... .......... .......... 93% 286M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 87100K .......... .......... .......... .......... .......... 93% 302M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 87150K .......... .......... .......... .......... .......... 93% 245M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 87200K .......... .......... .......... .......... .......... 93% 395M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 87250K .......... .......... .......... .......... .......... 93% 378M 0s 2024-09-12T18:10:05.520 INFO:teuthology.orchestra.run.smithi157.stderr: 87300K .......... .......... .......... .......... .......... 94% 251M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87350K .......... .......... .......... .......... .......... 94% 310M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87400K .......... .......... .......... .......... .......... 94% 279M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87450K .......... .......... .......... .......... .......... 94% 351M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87500K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87550K .......... .......... .......... .......... .......... 94% 311M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87600K .......... .......... .......... .......... .......... 94% 369M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87650K .......... .......... .......... .......... .......... 94% 292M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87700K .......... .......... .......... .......... .......... 94% 260M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87750K .......... .......... .......... .......... .......... 94% 227M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87800K .......... .......... .......... .......... .......... 94% 266M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87850K .......... .......... .......... .......... .......... 94% 271M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87900K .......... .......... .......... .......... .......... 94% 287M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87950K .......... .......... .......... .......... .......... 94% 245M 0s 2024-09-12T18:10:05.521 INFO:teuthology.orchestra.run.smithi157.stderr: 88000K .......... .......... .......... .......... .......... 94% 255M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88050K .......... .......... .......... .......... .......... 94% 331M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88100K .......... .......... .......... .......... .......... 94% 378M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88150K .......... .......... .......... .......... .......... 94% 337M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88200K .......... .......... .......... .......... .......... 94% 372M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88250K .......... .......... .......... .......... .......... 95% 367M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88300K .......... .......... .......... .......... .......... 95% 206M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88350K .......... .......... .......... .......... .......... 95% 210M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88400K .......... .......... .......... .......... .......... 95% 259M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88450K .......... .......... .......... .......... .......... 95% 242M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88500K .......... .......... .......... .......... .......... 95% 264M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88550K .......... .......... .......... .......... .......... 95% 225M 0s 2024-09-12T18:10:05.522 INFO:teuthology.orchestra.run.smithi157.stderr: 88600K .......... .......... .......... .......... .......... 95% 314M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 88650K .......... .......... .......... .......... .......... 95% 306M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 88700K .......... .......... .......... .......... .......... 95% 364M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 88750K .......... .......... .......... .......... .......... 95% 264M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 88800K .......... .......... .......... .......... .......... 95% 283M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 88850K .......... .......... .......... .......... .......... 95% 261M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 88900K .......... .......... .......... .......... .......... 95% 236M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 88950K .......... .......... .......... .......... .......... 95% 256M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 89000K .......... .......... .......... .......... .......... 95% 297M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 89050K .......... .......... .......... .......... .......... 95% 277M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 89100K .......... .......... .......... .......... .......... 95% 379M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 89150K .......... .......... .......... .......... .......... 96% 278M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 89200K .......... .......... .......... .......... .......... 96% 336M 0s 2024-09-12T18:10:05.523 INFO:teuthology.orchestra.run.smithi157.stderr: 89250K .......... .......... .......... .......... .......... 96% 339M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89300K .......... .......... .......... .......... .......... 96% 325M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89350K .......... .......... .......... .......... .......... 96% 307M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89400K .......... .......... .......... .......... .......... 96% 359M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89450K .......... .......... .......... .......... .......... 96% 19.3M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89500K .......... .......... .......... .......... .......... 96% 224M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89550K .......... .......... .......... .......... .......... 96% 218M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89600K .......... .......... .......... .......... .......... 96% 239M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89650K .......... .......... .......... .......... .......... 96% 257M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89700K .......... .......... .......... .......... .......... 96% 272M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89750K .......... .......... .......... .......... .......... 96% 216M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89800K .......... .......... .......... .......... .......... 96% 239M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89850K .......... .......... .......... .......... .......... 96% 278M 0s 2024-09-12T18:10:05.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89900K .......... .......... .......... .......... .......... 96% 225M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 89950K .......... .......... .......... .......... .......... 96% 222M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90000K .......... .......... .......... .......... .......... 96% 307M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90050K .......... .......... .......... .......... .......... 96% 260M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90100K .......... .......... .......... .......... .......... 97% 236M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90150K .......... .......... .......... .......... .......... 97% 209M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90200K .......... .......... .......... .......... .......... 97% 243M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90250K .......... .......... .......... .......... .......... 97% 259M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90300K .......... .......... .......... .......... .......... 97% 285M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90350K .......... .......... .......... .......... .......... 97% 265M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90400K .......... .......... .......... .......... .......... 97% 326M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90450K .......... .......... .......... .......... .......... 97% 302M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90500K .......... .......... .......... .......... .......... 97% 303M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90550K .......... .......... .......... .......... .......... 97% 247M 0s 2024-09-12T18:10:05.525 INFO:teuthology.orchestra.run.smithi157.stderr: 90600K .......... .......... .......... .......... .......... 97% 309M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 90650K .......... .......... .......... .......... .......... 97% 334M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 90700K .......... .......... .......... .......... .......... 97% 374M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 90750K .......... .......... .......... .......... .......... 97% 312M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 90800K .......... .......... .......... .......... .......... 97% 367M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 90850K .......... .......... .......... .......... .......... 97% 340M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 90900K .......... .......... .......... .......... .......... 97% 344M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 90950K .......... .......... .......... .......... .......... 97% 318M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 91000K .......... .......... .......... .......... .......... 98% 292M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 91050K .......... .......... .......... .......... .......... 98% 221M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 91100K .......... .......... .......... .......... .......... 98% 255M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 91150K .......... .......... .......... .......... .......... 98% 214M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 91200K .......... .......... .......... .......... .......... 98% 235M 0s 2024-09-12T18:10:05.526 INFO:teuthology.orchestra.run.smithi157.stderr: 91250K .......... .......... .......... .......... .......... 98% 348M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91300K .......... .......... .......... .......... .......... 98% 325M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91350K .......... .......... .......... .......... .......... 98% 263M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91400K .......... .......... .......... .......... .......... 98% 250M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91450K .......... .......... .......... .......... .......... 98% 254M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91500K .......... .......... .......... .......... .......... 98% 297M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91550K .......... .......... .......... .......... .......... 98% 224M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91600K .......... .......... .......... .......... .......... 98% 273M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91650K .......... .......... .......... .......... .......... 98% 300M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91700K .......... .......... .......... .......... .......... 98% 315M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91750K .......... .......... .......... .......... .......... 98% 293M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91800K .......... .......... .......... .......... .......... 98% 327M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91850K .......... .......... .......... .......... .......... 98% 373M 0s 2024-09-12T18:10:05.527 INFO:teuthology.orchestra.run.smithi157.stderr: 91900K .......... .......... .......... .......... .......... 98% 350M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 91950K .......... .......... .......... .......... .......... 99% 312M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92000K .......... .......... .......... .......... .......... 99% 346M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92050K .......... .......... .......... .......... .......... 99% 373M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92100K .......... .......... .......... .......... .......... 99% 381M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92150K .......... .......... .......... .......... .......... 99% 22.7M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92200K .......... .......... .......... .......... .......... 99% 272M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92250K .......... .......... .......... .......... .......... 99% 246M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92300K .......... .......... .......... .......... .......... 99% 265M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92350K .......... .......... .......... .......... .......... 99% 254M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92400K .......... .......... .......... .......... .......... 99% 260M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92450K .......... .......... .......... .......... .......... 99% 304M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92500K .......... .......... .......... .......... .......... 99% 364M 0s 2024-09-12T18:10:05.528 INFO:teuthology.orchestra.run.smithi157.stderr: 92550K .......... .......... .......... .......... .......... 99% 298M 0s 2024-09-12T18:10:05.529 INFO:teuthology.orchestra.run.smithi157.stderr: 92600K .......... .......... .......... .......... .......... 99% 269M 0s 2024-09-12T18:10:05.529 INFO:teuthology.orchestra.run.smithi157.stderr: 92650K .......... .......... .......... .......... .......... 99% 347M 0s 2024-09-12T18:10:05.529 INFO:teuthology.orchestra.run.smithi157.stderr: 92700K .......... .......... .......... .......... .......... 99% 298M 0s 2024-09-12T18:10:05.529 INFO:teuthology.orchestra.run.smithi157.stderr: 92750K .......... .......... .......... .......... .......... 99% 266M 0s 2024-09-12T18:10:05.529 INFO:teuthology.orchestra.run.smithi157.stderr: 92800K .......... .......... .......... .......... .......... 99% 362M 0s 2024-09-12T18:10:05.529 INFO:teuthology.orchestra.run.smithi157.stderr: 92850K .......... .......... .......... .......... .......... 99% 348M 0s 2024-09-12T18:10:05.529 INFO:teuthology.orchestra.run.smithi157.stderr: 92900K 100% 134G=0.5s 2024-09-12T18:10:05.529 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-09-12T18:10:05.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12 18:10:04 (183 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T18:10:05.529 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-09-12T18:10:05.563 INFO:teuthology.orchestra.run.smithi157.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T18:10:05.563 INFO:teuthology.orchestra.run.smithi157.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T18:10:05.563 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T18:10:05.563 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T18:10:05.563 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T18:10:05.564 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T18:10:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T18:10:05.566 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T18:10:05.567 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T18:10:05.568 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T18:10:05.569 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T18:10:05.570 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T18:10:05.571 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T18:10:05.572 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T18:10:05.572 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T18:10:05.572 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T18:10:05.572 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T18:10:05.572 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T18:10:05.572 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T18:10:05.572 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T18:10:05.572 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T18:10:05.572 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T18:10:05.572 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T18:10:05.572 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T18:10:05.573 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T18:10:05.574 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T18:10:05.575 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T18:10:05.576 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T18:10:05.577 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T18:10:05.578 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T18:10:05.579 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T18:10:05.580 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T18:10:05.581 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T18:10:05.581 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T18:10:05.581 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T18:10:05.581 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T18:10:05.581 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T18:10:05.581 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T18:10:05.581 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T18:10:05.581 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T18:10:05.581 INFO:teuthology.orchestra.run.smithi157.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T18:10:05.581 INFO:teuthology.orchestra.run.smithi157.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T18:10:05.798 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:05.798 INFO:teuthology.orchestra.run.smithi157.stdout:Welcome to Gradle 6.0.1! 2024-09-12T18:10:05.798 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:05.798 INFO:teuthology.orchestra.run.smithi157.stdout:Here are the highlights of this release: 2024-09-12T18:10:05.798 INFO:teuthology.orchestra.run.smithi157.stdout: - Substantial improvements in dependency management, including 2024-09-12T18:10:05.798 INFO:teuthology.orchestra.run.smithi157.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T18:10:05.798 INFO:teuthology.orchestra.run.smithi157.stdout: - Advanced control of transitive versions 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout: - Support for optional features and dependencies 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout: - Rules to tweak published metadata 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout: - Support for Java 13 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout: - New Zinc compiler for Scala 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout: - VS2019 support 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout:------------------------------------------------------------ 2024-09-12T18:10:05.799 INFO:teuthology.orchestra.run.smithi157.stdout:Gradle 6.0.1 2024-09-12T18:10:05.800 INFO:teuthology.orchestra.run.smithi157.stdout:------------------------------------------------------------ 2024-09-12T18:10:05.800 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:05.800 INFO:teuthology.orchestra.run.smithi157.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T18:10:05.800 INFO:teuthology.orchestra.run.smithi157.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T18:10:05.800 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:05.800 INFO:teuthology.orchestra.run.smithi157.stdout:Kotlin: 1.3.50 2024-09-12T18:10:05.800 INFO:teuthology.orchestra.run.smithi157.stdout:Groovy: 2.5.8 2024-09-12T18:10:05.800 INFO:teuthology.orchestra.run.smithi157.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T18:10:05.800 INFO:teuthology.orchestra.run.smithi157.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T18:10:05.800 INFO:teuthology.orchestra.run.smithi157.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T18:10:05.800 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:05.805 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T18:10:05.805 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T18:10:05.805 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T18:10:05.805 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T18:10:05.805 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T18:10:05.805 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T18:10:06.041 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T18:10:06.041 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T18:10:06.041 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'RKBEVYWUFQMJUSFSWRFB', 'access_secret': 'v3/lR/EFR7LsxcwV6fDGZgy7geTH0IlwAq17sMUwyJofNj3rlfoEFQ==', 'region': 'mexico', 'endpoint': 'smithi157.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi157.front.sepia.ceph.com'} 2024-09-12T18:10:06.041 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T18:10:06.042 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'RKBEVYWUFQMJUSFSWRFB', '--secret', 'v3/lR/EFR7LsxcwV6fDGZgy7geTH0IlwAq17sMUwyJofNj3rlfoEFQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T18:10:06.042 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key RKBEVYWUFQMJUSFSWRFB --secret v3/lR/EFR7LsxcwV6fDGZgy7geTH0IlwAq17sMUwyJofNj3rlfoEFQ== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T18:10:06.087 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:06.088 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:06.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.123+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.127+0000 7f46978e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.127+0000 7f46978e89c0 20 realm 2024-09-12T18:10:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.127+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.127+0000 7f46978e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.127+0000 7f46978e89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.127+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.127+0000 7f46978e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.127+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.127+0000 7f46978e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:06.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.127+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.127+0000 7f46978e89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:06.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.131+0000 7f46978e89c0 20 searching for the correct realm 2024-09-12T18:10:06.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.135+0000 7f4695bef640 0 -- 172.21.15.157:0/633284990 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f468c028040 msgr2=0x7f468c028930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:06.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.351+0000 7f46953ee640 0 -- 172.21.15.157:0/633284990 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55e36674c510 msgr2=0x55e36674e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:06.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.359+0000 7f46978e89c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:10:06.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.359+0000 7f46978e89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:06.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.359+0000 7f46978e89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:06.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.359+0000 7f46978e89c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:10:06.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.359+0000 7f46978e89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:06.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.359+0000 7f46978e89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:06.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.359+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.359+0000 7f46978e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.359+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.359+0000 7f46978e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:06.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.359+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:06.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 20 zone default found 2024-09-12T18:10:06.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 4 Realm: () 2024-09-12T18:10:06.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:10:06.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:10:06.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:06.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 20 zonegroup default 2024-09-12T18:10:06.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 20 started sync module instance, tier type = 2024-09-12T18:10:06.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.363+0000 7f46978e89c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:10:06.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.391+0000 7f46978e89c0 20 add_watcher() i=0 2024-09-12T18:10:06.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.391+0000 7f46978e89c0 20 add_watcher() i=1 2024-09-12T18:10:06.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.391+0000 7f46978e89c0 20 add_watcher() i=2 2024-09-12T18:10:06.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.391+0000 7f46978e89c0 20 add_watcher() i=3 2024-09-12T18:10:06.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.391+0000 7f46978e89c0 20 add_watcher() i=4 2024-09-12T18:10:06.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.391+0000 7f46978e89c0 20 add_watcher() i=5 2024-09-12T18:10:06.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.395+0000 7f46978e89c0 20 add_watcher() i=6 2024-09-12T18:10:06.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.395+0000 7f46978e89c0 20 add_watcher() i=7 2024-09-12T18:10:06.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.395+0000 7f46978e89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:06.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f454bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:06.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:06.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:06.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 5 note: GC not initialized 2024-09-12T18:10:06.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f454afe5640 20 reqs_thread_entry: start 2024-09-12T18:10:06.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 20 init_complete bucket index max shards: 1 2024-09-12T18:10:06.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 20 Filter name: none 2024-09-12T18:10:06.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f4548fe1640 20 reqs_thread_entry: start 2024-09-12T18:10:06.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:10:06.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T18:10:06.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:10:06.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T18:10:06.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T18:10:06.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:10:06.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 10 cache get: name=default.rgw.meta+users.keys+RKBEVYWUFQMJUSFSWRFB : miss 2024-09-12T18:10:06.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.399+0000 7f46978e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.403+0000 7f46978e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.403+0000 7f46978e89c0 10 cache put: name=default.rgw.meta+users.keys+RKBEVYWUFQMJUSFSWRFB info.flags=0x0 2024-09-12T18:10:06.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.403+0000 7f46978e89c0 10 adding default.rgw.meta+users.keys+RKBEVYWUFQMJUSFSWRFB to cache LRU end 2024-09-12T18:10:06.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.403+0000 7f46978e89c0 10 cache get: name=default.rgw.meta+users.keys+RKBEVYWUFQMJUSFSWRFB : hit (negative entry) 2024-09-12T18:10:06.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.403+0000 7f46978e89c0 10 cache get: name=default.rgw.meta+users.keys+RKBEVYWUFQMJUSFSWRFB : hit (negative entry) 2024-09-12T18:10:06.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.403+0000 7f46978e89c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T18:10:06.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.403+0000 7f46978e89c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:10:06.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.403+0000 7f46978e89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:10:06.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.407+0000 7f4578ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94435164928464 notifier 8832 bl.length()=670 2024-09-12T18:10:06.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.407+0000 7f4578ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T18:10:06.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.407+0000 7f4578ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:10:06.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.411+0000 7f46978e89c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T18:10:06.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.411+0000 7f46978e89c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:10:06.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.411+0000 7f46978e89c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:10:06.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.411+0000 7f456bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464314 cookie 94435164921744 notifier 8832 bl.length()=200 2024-09-12T18:10:06.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.411+0000 7f456bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T18:10:06.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.411+0000 7f456bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:10:06.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.415+0000 7f46978e89c0 10 cache put: name=default.rgw.meta+users.keys+RKBEVYWUFQMJUSFSWRFB info.flags=0x7 2024-09-12T18:10:06.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.415+0000 7f46978e89c0 10 moving default.rgw.meta+users.keys+RKBEVYWUFQMJUSFSWRFB to cache LRU end 2024-09-12T18:10:06.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.415+0000 7f46978e89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:RKBEVYWUFQMJUSFSWRFB, ofs0, ns] 2024-09-12T18:10:06.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.415+0000 7f456bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464340 cookie 94435164920272 notifier 8832 bl.length()=189 2024-09-12T18:10:06.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.415+0000 7f456bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RKBEVYWUFQMJUSFSWRFB info.flags=0x7 2024-09-12T18:10:06.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.415+0000 7f456bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RKBEVYWUFQMJUSFSWRFB to cache LRU end 2024-09-12T18:10:06.419 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: "user_id": "tester.client.0", 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: "suspended": 0, 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: "subusers": [], 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: "keys": [ 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: "user": "tester.client.0", 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: "access_key": "RKBEVYWUFQMJUSFSWRFB", 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: "secret_key": "v3/lR/EFR7LsxcwV6fDGZgy7geTH0IlwAq17sMUwyJofNj3rlfoEFQ==", 2024-09-12T18:10:06.420 INFO:teuthology.orchestra.run.smithi157.stdout: "active": true, 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:10:06.408162Z" 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: "swift_keys": [], 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": [], 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: "default_placement": "", 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: "default_storage_class": "", 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: "placement_tags": [], 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:10:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "user_quota": { 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "temp_url_keys": [], 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "rgw", 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "mfa_ids": [], 2024-09-12T18:10:06.422 INFO:teuthology.orchestra.run.smithi157.stdout: "account_id": "", 2024-09-12T18:10:06.423 INFO:teuthology.orchestra.run.smithi157.stdout: "path": "/", 2024-09-12T18:10:06.423 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:10:06.408112Z", 2024-09-12T18:10:06.423 INFO:teuthology.orchestra.run.smithi157.stdout: "tags": [], 2024-09-12T18:10:06.423 INFO:teuthology.orchestra.run.smithi157.stdout: "group_ids": [] 2024-09-12T18:10:06.423 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T18:10:06.423 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:06.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.419+0000 7f454bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:06.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.423+0000 7f46978e89c0 20 remove_watcher() i=0 2024-09-12T18:10:06.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.423+0000 7f46978e89c0 2 removed watcher, disabling cache 2024-09-12T18:10:06.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.427+0000 7f46978e89c0 20 remove_watcher() i=1 2024-09-12T18:10:06.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.427+0000 7f46978e89c0 20 remove_watcher() i=2 2024-09-12T18:10:06.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.431+0000 7f46978e89c0 20 remove_watcher() i=3 2024-09-12T18:10:06.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.435+0000 7f46978e89c0 20 remove_watcher() i=4 2024-09-12T18:10:06.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.435+0000 7f46978e89c0 20 remove_watcher() i=5 2024-09-12T18:10:06.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.435+0000 7f46978e89c0 20 remove_watcher() i=6 2024-09-12T18:10:06.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.439+0000 7f46978e89c0 20 remove_watcher() i=7 2024-09-12T18:10:06.455 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T18:10:06.455 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T18:10:06.463 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T18:10:06.463 DEBUG:teuthology.orchestra.run.smithi157:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T18:10:06.508 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:10:06.585 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:06.585 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:06.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.627+0000 7f297d85a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 20 realm 2024-09-12T18:10:06.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:06.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:06.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:06.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.631+0000 7f297d85a9c0 20 searching for the correct realm 2024-09-12T18:10:06.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.639+0000 7f297ab5f640 0 -- 172.21.15.157:0/237480783 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f2970044950 msgr2=0x7f2970036400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:06.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.643+0000 7f297ab5f640 0 -- 172.21.15.157:0/237480783 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f2844080a80 msgr2=0x7f2844082eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:06.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:10:06.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:06.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:06.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:10:06.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:06.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:06.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:06.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:06.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 zone default found 2024-09-12T18:10:06.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 4 Realm: () 2024-09-12T18:10:06.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:10:06.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:10:06.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:06.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 zonegroup default 2024-09-12T18:10:06.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:06.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:06.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 started sync module instance, tier type = 2024-09-12T18:10:06.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.651+0000 7f297d85a9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:10:06.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.671+0000 7f297d85a9c0 20 add_watcher() i=0 2024-09-12T18:10:06.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.671+0000 7f297d85a9c0 20 add_watcher() i=1 2024-09-12T18:10:06.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.671+0000 7f297d85a9c0 20 add_watcher() i=2 2024-09-12T18:10:06.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.671+0000 7f297d85a9c0 20 add_watcher() i=3 2024-09-12T18:10:06.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.671+0000 7f297d85a9c0 20 add_watcher() i=4 2024-09-12T18:10:06.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.671+0000 7f297d85a9c0 20 add_watcher() i=5 2024-09-12T18:10:06.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.671+0000 7f297d85a9c0 20 add_watcher() i=6 2024-09-12T18:10:06.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.671+0000 7f297d85a9c0 20 add_watcher() i=7 2024-09-12T18:10:06.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.671+0000 7f297d85a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:06.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.675+0000 7f28327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:06.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.675+0000 7f297d85a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:06.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.675+0000 7f297d85a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:06.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.739+0000 7f28317e2640 20 reqs_thread_entry: start 2024-09-12T18:10:06.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.739+0000 7f297d85a9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:10:06.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.739+0000 7f297d85a9c0 20 Filter name: none 2024-09-12T18:10:06.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.739+0000 7f282a7fc640 20 reqs_thread_entry: start 2024-09-12T18:10:06.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.739+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:10:06.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:10:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_JHgK-PZF0gQIJxKhGHtZyOAkwOKH_CB', time=2024-09-12T20:00:24.047767+0000, chain.objs.size()=2 2024-09-12T18:10:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.Kb36t-GMa25HMfJJs7lmmfZ_4tbygXK_0 2024-09-12T18:10:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.Kb36t-GMa25HMfJJs7lmmfZ_4tbygXK_1 2024-09-12T18:10:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7353019561117745275', time=2024-09-12T20:02:30.519870+0000, chain.objs.size()=1 2024-09-12T18:10:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.JN9H1RHv1grvWRnIcsYs7aC1FP1CVZl_0 2024-09-12T18:10:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10616340105406975602', time=2024-09-12T20:03:09.261283+0000, chain.objs.size()=1 2024-09-12T18:10:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.w4PlAcYhibCGXycMXSbiBjM2CAzxqYP_0 2024-09-12T18:10:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9917468409259639729', time=2024-09-12T20:03:17.025383+0000, chain.objs.size()=1 2024-09-12T18:10:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_._15DKOqyq3Hk0h31-YAMzHuyewddjeT_0 2024-09-12T18:10:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6415259699814022882', time=2024-09-12T20:03:55.616622+0000, chain.objs.size()=1 2024-09-12T18:10:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.4vo5QAbJ-hzI5iu0GMQ_Cp0ZTMsu0Wa_0 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2032749936806207539', time=2024-09-12T20:03:56.813665+0000, chain.objs.size()=1 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.hNrgO2yo7LEgjl01LuV9yFNinF5FXzN_0 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13550700918866815039', time=2024-09-12T20:04:31.285241+0000, chain.objs.size()=1 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.iQuh_MUcqtUe1Z9Z61Oe_lB1qD3haMc_0 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10432430966941386294', time=2024-09-12T20:04:31.357380+0000, chain.objs.size()=1 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.3TQ_9oVdirGPTo4WWAEwjhVSjUvmaLf_0 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8560548085743792292', time=2024-09-12T20:04:40.497886+0000, chain.objs.size()=1 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.NMR3_97Tib78lUFOVyEqoa7NJJ7tTxm_0 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14779370002746124064', time=2024-09-12T20:05:23.437011+0000, chain.objs.size()=1 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.S0ZrXWnC4Ok8PxiAl1FA12sRfuLPboh_0 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7882630767002911073', time=2024-09-12T20:06:43.592112+0000, chain.objs.size()=1 2024-09-12T18:10:06.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.743+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.KKy3PusrOXCd5kMM3z2_I2W4KKGz3fI_0 2024-09-12T18:10:06.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.747+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6658671551052434621', time=2024-09-12T20:07:18.612539+0000, chain.objs.size()=1 2024-09-12T18:10:06.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.747+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.XX9ElOvp_DvWVxCVUZ-d1hO5uzDwdk4_0 2024-09-12T18:10:06.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.751+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.751+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:10:06.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:10:06.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4105333526654961927', time=2024-09-12T20:00:23.713863+0000, chain.objs.size()=1 2024-09-12T18:10:06.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.WB-EkMa4hIFJtW13IQzqY4SzciEM0h5_0 2024-09-12T18:10:06.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9360549162407355637', time=2024-09-12T20:00:24.172105+0000, chain.objs.size()=5 2024-09-12T18:10:06.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.1 2024-09-12T18:10:06.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.1_1 2024-09-12T18:10:06.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.2 2024-09-12T18:10:06.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.2_1 2024-09-12T18:10:06.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.3 2024-09-12T18:10:06.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_KgGFnzkid6DvL1j-HPW6AYMWojPb56L', time=2024-09-12T20:00:24.265617+0000, chain.objs.size()=1 2024-09-12T18:10:06.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.leZkeyn77ZXNJUXo768Yr4V9tswImUD_0 2024-09-12T18:10:06.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6893195716112997355', time=2024-09-12T20:01:46.354890+0000, chain.objs.size()=1 2024-09-12T18:10:06.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.OIyqwQMG4Gh3yXkFRT9M-IW5o2jZ2N2_0 2024-09-12T18:10:06.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14860533532526969994', time=2024-09-12T20:03:17.206478+0000, chain.objs.size()=1 2024-09-12T18:10:06.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.gfXGndu38icU1HteOHds3cCiz46czV6_0 2024-09-12T18:10:06.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14547737412685686642', time=2024-09-12T20:03:17.220314+0000, chain.objs.size()=1 2024-09-12T18:10:06.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.j-BajVFo7fcxTFef3KQVfCUHV9XKFX0_0 2024-09-12T18:10:06.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12353376519671394587', time=2024-09-12T20:03:20.493592+0000, chain.objs.size()=1 2024-09-12T18:10:06.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.UiSJ4A9wERo9luQ-6L9tNW40-DoTHZY_0 2024-09-12T18:10:06.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7975850929120257606', time=2024-09-12T20:03:56.986290+0000, chain.objs.size()=1 2024-09-12T18:10:06.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.755+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.3QKc89GyYRCmzZkl_TglqNPEjLsQ1Zn_0 2024-09-12T18:10:06.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11341061011103598785', time=2024-09-12T20:04:31.336408+0000, chain.objs.size()=1 2024-09-12T18:10:06.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.Hq93lcQ_qW_eP1XQXZbzW-wYGVOoxsV_0 2024-09-12T18:10:06.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3038334401558717205', time=2024-09-12T20:04:36.523937+0000, chain.objs.size()=1 2024-09-12T18:10:06.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.j1zVlX6mRvMGZ8EkN7HM_PRxMSykWq1_0 2024-09-12T18:10:06.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17604800449166202645', time=2024-09-12T20:05:14.410921+0000, chain.objs.size()=1 2024-09-12T18:10:06.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.5k2m98f96388P1zlS-YWP9BpGF3uTqu_0 2024-09-12T18:10:06.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5206617410585467892', time=2024-09-12T20:05:20.208324+0000, chain.objs.size()=1 2024-09-12T18:10:06.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.XZIwDnvlFpizr6Ho3aULKYMb9i7EtL7_0 2024-09-12T18:10:06.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15924095933190560383', time=2024-09-12T20:05:59.804178+0000, chain.objs.size()=1 2024-09-12T18:10:06.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.aLcUvzcinzJ1GdnHxY4NYlEyignq3GV_0 2024-09-12T18:10:06.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9027181558047886171', time=2024-09-12T20:06:03.523008+0000, chain.objs.size()=1 2024-09-12T18:10:06.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.bwoSvkaTY3n5ARuN_U0Q5v3hlG2mrVS_0 2024-09-12T18:10:06.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3135546485695866679', time=2024-09-12T20:06:43.553480+0000, chain.objs.size()=1 2024-09-12T18:10:06.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.759+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.seQ9508n5jBOhj5vJaEtE_XYcK2SrqU_0 2024-09-12T18:10:06.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.763+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4538258186861370476', time=2024-09-12T20:09:42.189858+0000, chain.objs.size()=1 2024-09-12T18:10:06.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.763+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18__shadow:aM0FaimkbOFLTzeykTFgb6l7xfgVtfw_.5BU6AEKJZbS3OL-xzh-9WBVwikV3pWA_0 2024-09-12T18:10:06.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.767+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.771+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:10:06.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.771+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.771+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:10:06.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8296622762564448588', time=2024-09-12T20:00:23.776476+0000, chain.objs.size()=1 2024-09-12T18:10:06.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.hEIyVYIJbrSoKsNHnCQzbUkHVeeksz3_0 2024-09-12T18:10:06.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2450402505805135554', time=2024-09-12T20:00:24.405432+0000, chain.objs.size()=3 2024-09-12T18:10:06.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.lGcGxcUK2qhcoFZbUFoAXBQHZ91xVhL_0 2024-09-12T18:10:06.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.lGcGxcUK2qhcoFZbUFoAXBQHZ91xVhL_1 2024-09-12T18:10:06.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.lGcGxcUK2qhcoFZbUFoAXBQHZ91xVhL_2 2024-09-12T18:10:06.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6498230611073723961', time=2024-09-12T20:00:24.620477+0000, chain.objs.size()=1 2024-09-12T18:10:06.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8__shadow_.x-D1DmgV8uShrHg1zdHpcqQ0uZaAI7B_0 2024-09-12T18:10:06.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12834722987882498197', time=2024-09-12T20:01:46.275722+0000, chain.objs.size()=1 2024-09-12T18:10:06.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.FrKX6-R_EUpUPYu7fQKjuafdQbUuDQC_0 2024-09-12T18:10:06.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10951267555310567459', time=2024-09-12T20:01:50.767854+0000, chain.objs.size()=1 2024-09-12T18:10:06.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.gV_77-minEYYO2-uywo8_Ienf82QYnV_0 2024-09-12T18:10:06.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3251175763501618626', time=2024-09-12T20:02:25.979868+0000, chain.objs.size()=1 2024-09-12T18:10:06.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.lZNZKJ9z1uv4lkB4IlBH1VxdHAxAmqS_0 2024-09-12T18:10:06.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9881968663389051971', time=2024-09-12T20:03:09.279120+0000, chain.objs.size()=1 2024-09-12T18:10:06.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.k8u-JXNO41PbwPrxRSp20ogYE4J8g7K_0 2024-09-12T18:10:06.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17888331714889974196', time=2024-09-12T20:03:13.308103+0000, chain.objs.size()=1 2024-09-12T18:10:06.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.P_hqkmN-21grfMRJwrR9r0dFq_hEn7N_0 2024-09-12T18:10:06.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15655854703188037828', time=2024-09-12T20:03:56.801226+0000, chain.objs.size()=1 2024-09-12T18:10:06.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.IleVniarZ-GURcXc1B94_nWibkNG3YS_0 2024-09-12T18:10:06.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2450562269101336489', time=2024-09-12T20:04:31.265833+0000, chain.objs.size()=1 2024-09-12T18:10:06.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.pdIOKE7Dn6fVN4NQk4qzMpi4xEXrM8o_0 2024-09-12T18:10:06.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3772019322041773566', time=2024-09-12T20:04:36.612395+0000, chain.objs.size()=1 2024-09-12T18:10:06.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.775+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.LdqzRWIEpWA-wyHEWXQA5ZFw-YmSBFl_0 2024-09-12T18:10:06.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.467071369121515527', time=2024-09-12T20:04:40.590635+0000, chain.objs.size()=1 2024-09-12T18:10:06.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.d6bbg2UNEq_WBp7tsssNLAIJuCME2fo_0 2024-09-12T18:10:06.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.431221387402014387', time=2024-09-12T20:05:20.137418+0000, chain.objs.size()=1 2024-09-12T18:10:06.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.kxefyYlUxxYm9LJxPesv5kHgqWYhq7W_0 2024-09-12T18:10:06.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8013215143474259418', time=2024-09-12T20:05:54.813172+0000, chain.objs.size()=1 2024-09-12T18:10:06.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.Z_OEQQGAsRpRs2qBrlHe8uSV29HS_ai_0 2024-09-12T18:10:06.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7371498592061891883', time=2024-09-12T20:05:54.874443+0000, chain.objs.size()=1 2024-09-12T18:10:06.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.J1DTWlwHmSjkEcSP3AQbo_LaOiiL20U_0 2024-09-12T18:10:06.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11952836331655744027', time=2024-09-12T20:05:54.967572+0000, chain.objs.size()=1 2024-09-12T18:10:06.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.F8REtVQtT2gyV4nu1CXzlnLjeUY1viH_0 2024-09-12T18:10:06.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3396851089517220149', time=2024-09-12T20:06:35.178937+0000, chain.objs.size()=1 2024-09-12T18:10:06.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.YuAu7uIl0BOTcSRuDtl4EquNoz1nprB_0 2024-09-12T18:10:06.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16779507574613467642', time=2024-09-12T20:09:27.483593+0000, chain.objs.size()=1 2024-09-12T18:10:06.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.779+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.6ZK0Mr0XuxaHZS5inYQM3k-prJIvpwm_0 2024-09-12T18:10:06.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.783+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.787+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:10:06.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18097607764368096550', time=2024-09-12T20:00:23.783985+0000, chain.objs.size()=1 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.wPhDQZG2ZQUAVszIiFgwP0Rc6cjFS8d_0 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9546547041418684407', time=2024-09-12T20:00:24.179720+0000, chain.objs.size()=5 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.1 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.1_1 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.2 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.2_1 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-FROZEN.2~1oljt4AP1HmN8_xNj1I9f0xOGb_eXqQ.3 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13154565718140634223', time=2024-09-12T20:00:24.509611+0000, chain.objs.size()=1 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7__shadow_._j7BrnJMCFujVlfdoeoLhdWKMjvsGqO_0 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1517625131170219112', time=2024-09-12T20:01:45.050717+0000, chain.objs.size()=1 2024-09-12T18:10:06.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.0a2FNTG8gHHXLP6AR1VCmLmNZMuNxMN_0 2024-09-12T18:10:06.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13714414917973655996', time=2024-09-12T20:02:25.932774+0000, chain.objs.size()=1 2024-09-12T18:10:06.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.bMqwUjMcrerGNwc0HnG1p0AtNwHOMj6_0 2024-09-12T18:10:06.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8712211536382915995', time=2024-09-12T20:02:34.621789+0000, chain.objs.size()=1 2024-09-12T18:10:06.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.d7Ei2WxGGfn3rrQYho0VN9p7cQyNzkC_0 2024-09-12T18:10:06.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3673531244675378334', time=2024-09-12T20:02:34.623929+0000, chain.objs.size()=1 2024-09-12T18:10:06.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.P2n90iAdPbpmKTb4m7DFbiP2pSX_NRp_0 2024-09-12T18:10:06.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16180519972862090929', time=2024-09-12T20:03:09.382796+0000, chain.objs.size()=1 2024-09-12T18:10:06.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.791+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.pElFgiETo89X_IlS4xLvqqM0oA018we_0 2024-09-12T18:10:06.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.795+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16401161475213380865', time=2024-09-12T20:03:13.272214+0000, chain.objs.size()=1 2024-09-12T18:10:06.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.795+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.dQvaT2gO8O6Z_fFWfN3hxcYlJbx8H2o_0 2024-09-12T18:10:06.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3864062591633295738', time=2024-09-12T20:03:52.095883+0000, chain.objs.size()=1 2024-09-12T18:10:06.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.Wec3Bc0ExCLBKvtKkOq0ExxJAuM5qy7_0 2024-09-12T18:10:06.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9197024879933034058', time=2024-09-12T20:03:52.289180+0000, chain.objs.size()=1 2024-09-12T18:10:06.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.R-HGu7tkjlUHAKsumSwoewZIzY9a4f4_0 2024-09-12T18:10:06.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8985832396755552762', time=2024-09-12T20:03:57.036470+0000, chain.objs.size()=1 2024-09-12T18:10:06.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.7faddJLxOH0bc4jmlifiLxii-Rd6KKd_0 2024-09-12T18:10:06.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16346722907814106516', time=2024-09-12T20:04:36.348940+0000, chain.objs.size()=1 2024-09-12T18:10:06.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.CB0Cu2n0gMweewz6IjvSwZ1e_iCNMvJ_0 2024-09-12T18:10:06.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11341836606662255589', time=2024-09-12T20:04:36.425311+0000, chain.objs.size()=1 2024-09-12T18:10:06.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.q5__z3cJgYOs5nQ8JhC1fPofiAl1GFr_0 2024-09-12T18:10:06.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.109929274728040577', time=2024-09-12T20:04:40.588485+0000, chain.objs.size()=1 2024-09-12T18:10:06.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.4KONhkPXONAkAdifSbWII4ASf1rWNnT_0 2024-09-12T18:10:06.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6781940151547618113', time=2024-09-12T20:05:15.506327+0000, chain.objs.size()=1 2024-09-12T18:10:06.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.XFEo7JD4GkmFnK1RsuIjMQ-tRQOMpeJ_0 2024-09-12T18:10:06.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4048721798319657039', time=2024-09-12T20:05:59.530050+0000, chain.objs.size()=1 2024-09-12T18:10:06.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.NhI47fZIDk0jVwPoHRn_EkQo5AObI0Y_0 2024-09-12T18:10:06.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13894671415868544993', time=2024-09-12T20:05:59.640458+0000, chain.objs.size()=1 2024-09-12T18:10:06.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.F8tOf6mpF4cnTvEHrlQBulT-vk1SbJd_0 2024-09-12T18:10:06.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.701027554672233397', time=2024-09-12T20:06:39.562201+0000, chain.objs.size()=1 2024-09-12T18:10:06.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.kjXCNn0OA1wSKLrl4swR2Cw9EJgWiOX_0 2024-09-12T18:10:06.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1692220777068138575', time=2024-09-12T20:06:39.652605+0000, chain.objs.size()=1 2024-09-12T18:10:06.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.7GZu4P9ZIoxUGwUQZubNCraQp6P_dmd_0 2024-09-12T18:10:06.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5648943194263048210', time=2024-09-12T20:06:43.512671+0000, chain.objs.size()=1 2024-09-12T18:10:06.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.799+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.pNllmJ2qv6SAt0Ry5V5VHWeTXTrAJan_0 2024-09-12T18:10:06.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.803+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.811+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:10:06.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:10:06.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8695782655401351633', time=2024-09-12T20:00:23.765440+0000, chain.objs.size()=1 2024-09-12T18:10:06.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.dVs7ncFat1o0LtYBZ894v5YX_ly10W7_0 2024-09-12T18:10:06.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12470642450522487730', time=2024-09-12T20:01:46.307782+0000, chain.objs.size()=1 2024-09-12T18:10:06.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.zEKNKAMRW75i9ulVlwW8QFXwFRyRU2a_0 2024-09-12T18:10:06.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7310192704763601730', time=2024-09-12T20:02:30.663283+0000, chain.objs.size()=1 2024-09-12T18:10:06.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.9gfBuBdMg_V8i5lw3MeDO_PEifdiJ8s_0 2024-09-12T18:10:06.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13600040222817616591', time=2024-09-12T20:03:12.479210+0000, chain.objs.size()=1 2024-09-12T18:10:06.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.L2USo4LDDVipUsiahh9YtJ7Q7lBDuJY_0 2024-09-12T18:10:06.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15388648896971497806', time=2024-09-12T20:03:13.307429+0000, chain.objs.size()=1 2024-09-12T18:10:06.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.BhRZCGLS3aZr1azBRxUm0JoyQXcfOrZ_0 2024-09-12T18:10:06.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10682433106225375931', time=2024-09-12T20:03:16.943496+0000, chain.objs.size()=1 2024-09-12T18:10:06.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.K-9-i4B8BS4WzwOljSsmPbvRAwYUAAX_0 2024-09-12T18:10:06.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8430218690591247255', time=2024-09-12T20:03:52.213867+0000, chain.objs.size()=1 2024-09-12T18:10:06.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.i2kEn5n6vDBV8yDxoBsts-w89SxhzSp_0 2024-09-12T18:10:06.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10129509002643591086', time=2024-09-12T20:03:52.276524+0000, chain.objs.size()=1 2024-09-12T18:10:06.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.d89Mbz4k2Aam8_CFU5D83baHiQMwihR_0 2024-09-12T18:10:06.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5800341450071197331', time=2024-09-12T20:03:56.813680+0000, chain.objs.size()=1 2024-09-12T18:10:06.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.7C9CoQsbTyajkWd4tM9Anl1MRSxRUri_0 2024-09-12T18:10:06.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12809704229643439123', time=2024-09-12T20:04:36.430736+0000, chain.objs.size()=1 2024-09-12T18:10:06.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.MCg7veM2hgT2pITzz-JAvhKKR5E1jEi_0 2024-09-12T18:10:06.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17515355981543047389', time=2024-09-12T20:04:36.432735+0000, chain.objs.size()=1 2024-09-12T18:10:06.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.565QvlaWpuMlQv-xjE9_n_1ktQGzP_O_0 2024-09-12T18:10:06.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11307129247656366642', time=2024-09-12T20:05:15.392147+0000, chain.objs.size()=1 2024-09-12T18:10:06.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.815+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.5vL_1hNo8IntBFRA4OFP9vX8yTlGFKv_0 2024-09-12T18:10:06.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7427391412408014614', time=2024-09-12T20:05:20.244047+0000, chain.objs.size()=1 2024-09-12T18:10:06.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.xpYEHJlNVHDDv5YHVqjL331JY-WRDuC_0 2024-09-12T18:10:06.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17306317950277650096', time=2024-09-12T20:06:35.011804+0000, chain.objs.size()=1 2024-09-12T18:10:06.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.K3qD_GImKKMz7sko_EKnOn-oPYo3QO7_0 2024-09-12T18:10:06.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8174387562909820903', time=2024-09-12T20:06:39.457613+0000, chain.objs.size()=1 2024-09-12T18:10:06.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.uVe748vO6LhQwY3h0WutLVkMVcxiyKC_0 2024-09-12T18:10:06.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8227773034741868176', time=2024-09-12T20:07:18.664392+0000, chain.objs.size()=1 2024-09-12T18:10:06.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.hBmZhcXoGH7PnOSmLiWvcnK3vlGolzO_0 2024-09-12T18:10:06.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13405512383958932262', time=2024-09-12T20:09:27.391126+0000, chain.objs.size()=1 2024-09-12T18:10:06.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.V-BABnaqZ3nUWm70JHFdscTV6e9n9yr_0 2024-09-12T18:10:06.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10312792209152110872', time=2024-09-12T20:09:42.193649+0000, chain.objs.size()=1 2024-09-12T18:10:06.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.819+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18__shadow:H7elGQih0mEbUfpf9Yy55fK-hDOornh_.HOiHxiFBDBZBFFITfvLBklyHag3Rgmm_0 2024-09-12T18:10:06.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.823+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.827+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:10:06.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.827+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.827+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:10:06.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_O1wJfzLa9UmudiWNNqCoz9pOaPu1X3C', time=2024-09-12T20:00:24.201627+0000, chain.objs.size()=3 2024-09-12T18:10:06.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.Hij_XzkrRD0-aqWK2_9F6xVZN8eFVRf_0 2024-09-12T18:10:06.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.Hij_XzkrRD0-aqWK2_9F6xVZN8eFVRf_1 2024-09-12T18:10:06.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.Hij_XzkrRD0-aqWK2_9F6xVZN8eFVRf_2 2024-09-12T18:10:06.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5673654690284775691', time=2024-09-12T20:00:24.607037+0000, chain.objs.size()=1 2024-09-12T18:10:06.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8__shadow_.YJwSntjMNd3EExcvh4i9h9lZDG2aRoH_0 2024-09-12T18:10:06.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7963837918960458792', time=2024-09-12T20:01:50.787556+0000, chain.objs.size()=1 2024-09-12T18:10:06.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.gCfG4_rjVtN-Teefr31T9LS5ODuK_f0_0 2024-09-12T18:10:06.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5930767079014059010', time=2024-09-12T20:01:50.789712+0000, chain.objs.size()=1 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.t4em6g5cSWCs55k9dJ2DSGEg6dhS0jZ_0 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8935015114272898084', time=2024-09-12T20:02:26.145623+0000, chain.objs.size()=1 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.KScdK3jgJObXdozRNbdOTg_GBghD6Mq_0 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5116797119645501759', time=2024-09-12T20:02:30.516731+0000, chain.objs.size()=1 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.27sGtarivsPCukjte4pEdO5eyP3o5qT_0 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10557406218259176517', time=2024-09-12T20:02:34.503694+0000, chain.objs.size()=1 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.-7I2Axa5Hm7Qo1QOIRCixwRVYMvpuHW_0 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5618893768034986065', time=2024-09-12T20:03:09.196561+0000, chain.objs.size()=1 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.ezJU9YnYrvxUNLZFQlcVRc1vjGbva7-_0 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8596751634085392611', time=2024-09-12T20:03:09.397895+0000, chain.objs.size()=1 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.kg1U-mocLyBw_izbTPJ60ztMqqE_naj_0 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2912873248198378972', time=2024-09-12T20:03:17.180764+0000, chain.objs.size()=1 2024-09-12T18:10:06.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.831+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.WPMIGnSufwKGRFKOBH24hPR5pGTH3I8_0 2024-09-12T18:10:06.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5504312103227787879', time=2024-09-12T20:03:56.965845+0000, chain.objs.size()=1 2024-09-12T18:10:06.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.xljPQBMbhetlf-0OCUHThCUSl45swtn_0 2024-09-12T18:10:06.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5095821303742024806', time=2024-09-12T20:04:31.400653+0000, chain.objs.size()=1 2024-09-12T18:10:06.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.Kon337SqAaa-66Gnbss85khCfns6q9h_0 2024-09-12T18:10:06.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5991226393716220256', time=2024-09-12T20:04:40.439827+0000, chain.objs.size()=1 2024-09-12T18:10:06.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.LzKTiujQS3-yOvz5WXtUX2IJ6nT_OPe_0 2024-09-12T18:10:06.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2801700914308056651', time=2024-09-12T20:05:55.048059+0000, chain.objs.size()=1 2024-09-12T18:10:06.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.2kXDU2KGJJ8w6Mg2g0ZJVsNOkBz_ZGg_0 2024-09-12T18:10:06.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3532006285410536157', time=2024-09-12T20:06:39.544227+0000, chain.objs.size()=1 2024-09-12T18:10:06.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.hfX1ZLmpyVZY4VFW5PWDjFlzt8syv_1_0 2024-09-12T18:10:06.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18194276550218107489', time=2024-09-12T20:07:18.752244+0000, chain.objs.size()=1 2024-09-12T18:10:06.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.839+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_._YHh0ZN2HDqNRi2HJW58qLz0A6Ei6oK_0 2024-09-12T18:10:06.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.843+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.847+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:10:06.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.847+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.847+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:10:06.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4391775437182898236', time=2024-09-12T20:00:23.733970+0000, chain.objs.size()=1 2024-09-12T18:10:06.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.1d1CbVJe3Nh7TkGnFnupSBLzGPm5vXQ_0 2024-09-12T18:10:06.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_uwUE0Z792PFvYfApzU8xDXiQRAoq-DK', time=2024-09-12T20:00:24.244830+0000, chain.objs.size()=3 2024-09-12T18:10:06.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-iBB14pB5zz2ZHlmj49KNQOL9G_oYXm_0 2024-09-12T18:10:06.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-iBB14pB5zz2ZHlmj49KNQOL9G_oYXm_1 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-iBB14pB5zz2ZHlmj49KNQOL9G_oYXm_2 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8649862084124409180', time=2024-09-12T20:01:46.225586+0000, chain.objs.size()=1 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.L1Jle7eQtUQhA-UjUPJ1-6xL4Bodoam_0 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15002372870825661812', time=2024-09-12T20:02:26.139279+0000, chain.objs.size()=1 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.AglpXnqUICPltAZ3YW0u_GpPm91AlUK_0 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12771117501263972612', time=2024-09-12T20:02:34.572124+0000, chain.objs.size()=1 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.dmqJAiTVfeEOi5UySjJgdlx2VW700Du_0 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8946025276081085922', time=2024-09-12T20:04:31.351874+0000, chain.objs.size()=1 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.cjf_C52ujELnaW2TRxegEq5ooAvWB0Q_0 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14848997308270279399', time=2024-09-12T20:05:15.446799+0000, chain.objs.size()=1 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.QUsEYy2E-cckWsekR4wRSdmdUHb-7vt_0 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3922188488178104514', time=2024-09-12T20:05:54.735557+0000, chain.objs.size()=1 2024-09-12T18:10:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.cfSPIjLI6RVRRa1hFQdXw6ysoBJlaR-_0 2024-09-12T18:10:06.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5165540593153083490', time=2024-09-12T20:05:59.650669+0000, chain.objs.size()=1 2024-09-12T18:10:06.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.UXaE8sv7Audwv5mBKntJ7mcnTE2fSZ__0 2024-09-12T18:10:06.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12888223793373891094', time=2024-09-12T20:05:59.652430+0000, chain.objs.size()=1 2024-09-12T18:10:06.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.851+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.UYBz6ndZpF6_SUZRZOp4DDH5WY-Kh61_0 2024-09-12T18:10:06.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.855+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8447937031777381332', time=2024-09-12T20:06:39.469854+0000, chain.objs.size()=1 2024-09-12T18:10:06.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.855+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.dVkHuR-jhp8mwFVpceVMvUoErykizBc_0 2024-09-12T18:10:06.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.855+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7906375685955695554', time=2024-09-12T20:09:27.505231+0000, chain.objs.size()=1 2024-09-12T18:10:06.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.855+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.5meRJE01KnIFWbW7mW3S-kGk5aDtHSl_0 2024-09-12T18:10:06.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.859+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.863+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:10:06.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:10:06.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_C02eXcyzs-m2MqW5RPCOMjINhptrNTF', time=2024-09-12T20:00:24.272366+0000, chain.objs.size()=1 2024-09-12T18:10:06.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.F8xJw9S4rhI7UaxJMIZEFi0STEANlAe_0 2024-09-12T18:10:06.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8447515574075961011', time=2024-09-12T20:01:46.369237+0000, chain.objs.size()=1 2024-09-12T18:10:06.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.opDgWJTmYZwSySaseUZBtyDtJhpVyxq_0 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5521070681363916325', time=2024-09-12T20:01:50.917347+0000, chain.objs.size()=1 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.d3vMAIrBWBVKbnL2sCy2ml89URMlfXH_0 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16273357220616147585', time=2024-09-12T20:01:50.928887+0000, chain.objs.size()=1 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.8WAaIjYNL46Ti8Zvjh2PcWwZFaGatCx_0 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13035464767479839015', time=2024-09-12T20:01:51.035282+0000, chain.objs.size()=1 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.FnFQ-bjCcGUY6-JEV-DwXNPwVF1qYq__0 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3358755831648959471', time=2024-09-12T20:02:26.013141+0000, chain.objs.size()=1 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.BtxTmZxut9zr3f19cyOk0Cjxt2_-QPy_0 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4347843713320623497', time=2024-09-12T20:02:38.059478+0000, chain.objs.size()=1 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.lg4f2Zctz9YF6wjeLPUDa4EN9NKaKVY_0 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13838342665815432368', time=2024-09-12T20:03:09.190886+0000, chain.objs.size()=1 2024-09-12T18:10:06.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.PSRu1ZL2nOUUZblA2ggM4pTHJkVj0cu_0 2024-09-12T18:10:06.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7941492792343051419', time=2024-09-12T20:03:13.272215+0000, chain.objs.size()=1 2024-09-12T18:10:06.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.qtzRx7NsQl48HDVdX7gVDNbysNM4lx3_0 2024-09-12T18:10:06.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12158875348473335612', time=2024-09-12T20:03:17.003760+0000, chain.objs.size()=1 2024-09-12T18:10:06.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.ncL31bhqxCuontP9EfJ9BJ4Wo-zrO7e_0 2024-09-12T18:10:06.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11765484979746325712', time=2024-09-12T20:03:17.006022+0000, chain.objs.size()=1 2024-09-12T18:10:06.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.3PVkeXqeutE0Q30a5fD0ZmYS1Gvn2sj_0 2024-09-12T18:10:06.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15623074324256249312', time=2024-09-12T20:04:36.425326+0000, chain.objs.size()=1 2024-09-12T18:10:06.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.867+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.h82aKGemsialLMBhf4aeQ2HaAaZCJxU_0 2024-09-12T18:10:06.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.871+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10552876787613456329', time=2024-09-12T20:06:35.002648+0000, chain.objs.size()=1 2024-09-12T18:10:06.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.871+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.cczLIAP-__z5lPr_NVe_wi2jIjHAO0m_0 2024-09-12T18:10:06.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.871+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13354258598386666739', time=2024-09-12T20:06:35.004437+0000, chain.objs.size()=1 2024-09-12T18:10:06.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.871+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.jf8CAIBBai_-dcjq9mdGaORFiWX5KW4_0 2024-09-12T18:10:06.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.871+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10327216727028234595', time=2024-09-12T20:06:35.006378+0000, chain.objs.size()=1 2024-09-12T18:10:06.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.871+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.A52lxYMTZh0vpU0ozWAz6CPVhAK1xe9_0 2024-09-12T18:10:06.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.871+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16281904590249675615', time=2024-09-12T20:06:35.008736+0000, chain.objs.size()=1 2024-09-12T18:10:06.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.871+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.XMwBoA2s7ehSfR16QzwVyyaq_L9irW__0 2024-09-12T18:10:06.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.875+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.879+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:10:06.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:10:06.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7634816290725527890', time=2024-09-12T20:00:24.332069+0000, chain.objs.size()=5 2024-09-12T18:10:06.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-LUKEWARM.2~dzxm8DhaMEbf-LA4ixr7V5f59IMZbUC.1 2024-09-12T18:10:06.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__shadow_foo-LUKEWARM.2~dzxm8DhaMEbf-LA4ixr7V5f59IMZbUC.1_1 2024-09-12T18:10:06.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-LUKEWARM.2~dzxm8DhaMEbf-LA4ixr7V5f59IMZbUC.2 2024-09-12T18:10:06.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__shadow_foo-LUKEWARM.2~dzxm8DhaMEbf-LA4ixr7V5f59IMZbUC.2_1 2024-09-12T18:10:06.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-LUKEWARM.2~dzxm8DhaMEbf-LA4ixr7V5f59IMZbUC.3 2024-09-12T18:10:06.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.428066299063785998', time=2024-09-12T20:01:46.370471+0000, chain.objs.size()=1 2024-09-12T18:10:06.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.V6wUZ1U53WCyNNc6_sjvLYuRiq_GhUY_0 2024-09-12T18:10:06.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4868715756306803836', time=2024-09-12T20:01:50.809088+0000, chain.objs.size()=1 2024-09-12T18:10:06.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.Ykj_8OcY6ALVsdycpRd6Y3NgAStL6p__0 2024-09-12T18:10:06.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15686985421664258133', time=2024-09-12T20:01:50.896189+0000, chain.objs.size()=1 2024-09-12T18:10:06.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.654eJKB33BMFhNJH26_JkAhORm876g__0 2024-09-12T18:10:06.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11228696232489171477', time=2024-09-12T20:02:25.933599+0000, chain.objs.size()=1 2024-09-12T18:10:06.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.RuVsv0ooWfZ52fYfVg1on-AJsSOwrnJ_0 2024-09-12T18:10:06.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6973587932451089763', time=2024-09-12T20:02:29.449922+0000, chain.objs.size()=1 2024-09-12T18:10:06.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.-ZrJZkffr3YFLKRiTgjgnNDCWkLG5tt_0 2024-09-12T18:10:06.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3997934308110786830', time=2024-09-12T20:03:09.190852+0000, chain.objs.size()=1 2024-09-12T18:10:06.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.883+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.q-mZGgp5lduY_zuFWp1dZG6RBlfRw6o_0 2024-09-12T18:10:06.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.887+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16074870973629713027', time=2024-09-12T20:03:52.091608+0000, chain.objs.size()=1 2024-09-12T18:10:06.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.887+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.tPmvvJcqAiXGFoVafQCXn_Nfo5FxolS_0 2024-09-12T18:10:06.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.891+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11552225510202693844', time=2024-09-12T20:05:15.507070+0000, chain.objs.size()=1 2024-09-12T18:10:06.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.891+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.OBo-OIiRcHmK7kcW1wNg8sEBCESPlZi_0 2024-09-12T18:10:06.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.891+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8316288016923904648', time=2024-09-12T20:05:20.290715+0000, chain.objs.size()=1 2024-09-12T18:10:06.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.891+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.Ah-vxBsF94N7aVPKRVHCPSm0TtfLgqq_0 2024-09-12T18:10:06.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.891+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17755107566436633407', time=2024-09-12T20:05:58.586984+0000, chain.objs.size()=1 2024-09-12T18:10:06.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.891+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.FbkJpOnsv8-UirExRq_75Ff2qynU9Nv_0 2024-09-12T18:10:06.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.891+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10816838184505409527', time=2024-09-12T20:05:59.648551+0000, chain.objs.size()=1 2024-09-12T18:10:06.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.891+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.5XqXxAjHLRrsZA1s7vahCod1LpLxy7V_0 2024-09-12T18:10:06.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.891+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8291381010313418788', time=2024-09-12T20:06:43.518655+0000, chain.objs.size()=1 2024-09-12T18:10:06.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.891+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.8jKIHqD3Yg4jOp3W-WbbLob8d8PqCAG_0 2024-09-12T18:10:06.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.895+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.899+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:10:06.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:10:06.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_cmgwKY5g0dKoX8RXyypuKyxm7pZvwcW', time=2024-09-12T20:00:24.222052+0000, chain.objs.size()=3 2024-09-12T18:10:06.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-pIjRffN24oxAicZ_RInpfnQrHock4j_0 2024-09-12T18:10:06.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-pIjRffN24oxAicZ_RInpfnQrHock4j_1 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.-pIjRffN24oxAicZ_RInpfnQrHock4j_2 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8503037469553806158', time=2024-09-12T20:02:30.686227+0000, chain.objs.size()=1 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.HkuWzd08YyUd5wCwaKOBoZ50rysO7ie_0 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2011831143482242289', time=2024-09-12T20:03:52.090306+0000, chain.objs.size()=1 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.0sh-M9uibBRtgeNbmAkHKVpAyh8HUDE_0 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18295928733277150063', time=2024-09-12T20:03:52.091996+0000, chain.objs.size()=1 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.SOPgkmsRDob1e2Tal6ta-zBomLm7evD_0 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4034486322760910453', time=2024-09-12T20:03:52.142940+0000, chain.objs.size()=1 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.beSZ06F2oadTHS1CHoTf5nfqvjK0hpt_0 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5485855951753450727', time=2024-09-12T20:03:52.295791+0000, chain.objs.size()=1 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.fq3i142-k6guJfRwCSQFY0_Qtup_7FO_0 2024-09-12T18:10:06.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16180671648671602672', time=2024-09-12T20:04:40.658733+0000, chain.objs.size()=1 2024-09-12T18:10:06.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.ZdaFCBB34O_lXRW705JL8cUAxAgXCsd_0 2024-09-12T18:10:06.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5783379110649586886', time=2024-09-12T20:05:15.514628+0000, chain.objs.size()=1 2024-09-12T18:10:06.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.cqv5ZT6HWHpI-WOZiLEM9Ci5yfGzbwb_0 2024-09-12T18:10:06.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3452107929751636965', time=2024-09-12T20:05:15.516189+0000, chain.objs.size()=1 2024-09-12T18:10:06.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.PleLHRv3oYzfTSHipNiHPsQVLoVCCes_0 2024-09-12T18:10:06.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16510538054192283773', time=2024-09-12T20:05:20.196668+0000, chain.objs.size()=1 2024-09-12T18:10:06.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.903+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.JoU4xrQC78aRj9_UVuvsx2S9BYsTWel_0 2024-09-12T18:10:06.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.907+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15058304028349871499', time=2024-09-12T20:05:54.902162+0000, chain.objs.size()=1 2024-09-12T18:10:06.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.907+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.CV91ubACd3O3D-uqn9D-w8YGwIwcLLx_0 2024-09-12T18:10:06.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.907+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3277736006155943748', time=2024-09-12T20:05:59.648722+0000, chain.objs.size()=1 2024-09-12T18:10:06.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.907+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.KxmbGtkXP5YjgwLf0iF-0K5TfeuIvJe_0 2024-09-12T18:10:06.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.911+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3696286780104392149', time=2024-09-12T20:06:39.544844+0000, chain.objs.size()=1 2024-09-12T18:10:06.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.911+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.GsiSVFeX6NjxW51y5wZDooQas1zJ941_0 2024-09-12T18:10:06.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.911+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2663945904973677170', time=2024-09-12T20:07:18.618163+0000, chain.objs.size()=1 2024-09-12T18:10:06.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.911+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.IJ7PMohfmRzaIFfrvIGmnUulI5DLrHJ_0 2024-09-12T18:10:06.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.915+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.919+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:10:06.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.919+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.919+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:10:06.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.529931046012667418', time=2024-09-12T20:00:24.534951+0000, chain.objs.size()=1 2024-09-12T18:10:06.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7__shadow_.dgfhdjBO5ug1aOcoK9jOy0HCpeB5d6V_0 2024-09-12T18:10:06.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18193744509128343580', time=2024-09-12T20:00:24.545727+0000, chain.objs.size()=1 2024-09-12T18:10:06.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7__shadow_.HnAu8HXKyZ40rssOEMig-VHIZgkB6oX_0 2024-09-12T18:10:06.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15170764044314388451', time=2024-09-12T20:01:46.355250+0000, chain.objs.size()=1 2024-09-12T18:10:06.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_._fd0-RKQqqH2hlWsr1pitHgnekCWwV0_0 2024-09-12T18:10:06.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4758540186899309142', time=2024-09-12T20:01:50.893798+0000, chain.objs.size()=1 2024-09-12T18:10:06.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.hAqAydLYiTdFUVJpnVKAtGM17TLChUR_0 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11200113411630580176', time=2024-09-12T20:02:30.569906+0000, chain.objs.size()=1 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.ExMPFhr0_ZpXeLxi485eJ8M9i_Vknmy_0 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9099507584441485606', time=2024-09-12T20:02:34.704908+0000, chain.objs.size()=1 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.KQpd32uKi3wedWnmBf-P-4negMjUIug_0 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2770793913839044880', time=2024-09-12T20:03:09.317319+0000, chain.objs.size()=1 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.3DlPYEpYWBtMRtVDGP1K9Y-ZXcS37XH_0 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18192465558790990847', time=2024-09-12T20:03:52.118825+0000, chain.objs.size()=1 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.JdbWbfMErh49cZNVwmR8XM-wbP8v48m_0 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17663867382557066892', time=2024-09-12T20:03:52.139354+0000, chain.objs.size()=1 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.oWhHuwd-zxhDgsfhB1dTBCYMAQDIQ33_0 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3599121691867156127', time=2024-09-12T20:03:56.893387+0000, chain.objs.size()=1 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_._5G642FwzKTb1Hqv4fPjQm58Q8zHlk3_0 2024-09-12T18:10:06.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13519313883326526466', time=2024-09-12T20:04:40.676497+0000, chain.objs.size()=1 2024-09-12T18:10:06.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.V0q7i5ZjDz51V_fhwEsTye6_zLskeG6_0 2024-09-12T18:10:06.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12232309038420639241', time=2024-09-12T20:05:20.208349+0000, chain.objs.size()=1 2024-09-12T18:10:06.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.Oimc5INA0-5_PQ-z-NcxAhJwEGaac3w_0 2024-09-12T18:10:06.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10557782378733558515', time=2024-09-12T20:05:59.596891+0000, chain.objs.size()=1 2024-09-12T18:10:06.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.ehjsq5krkgeIL8SilhK53WxL2d19Ya4_0 2024-09-12T18:10:06.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8330694607466246727', time=2024-09-12T20:06:35.081990+0000, chain.objs.size()=1 2024-09-12T18:10:06.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.MNzhbkHbdRBvaZY4F9ElKwgO2nyUO1v_0 2024-09-12T18:10:06.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12097981274451931357', time=2024-09-12T20:06:43.457984+0000, chain.objs.size()=1 2024-09-12T18:10:06.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.923+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.Ji09C_DCt4MBpT-g3a5QyomhtrPizcr_0 2024-09-12T18:10:06.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.927+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4028111224998242226', time=2024-09-12T20:06:43.553735+0000, chain.objs.size()=1 2024-09-12T18:10:06.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.927+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.dq2YbvnvegZuK8iPKuSmdbmxyxJAdZ__0 2024-09-12T18:10:06.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.927+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14494130829911963971', time=2024-09-12T20:07:18.501371+0000, chain.objs.size()=1 2024-09-12T18:10:06.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.927+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.ZjwPkWFlipzDtWHzQkqqEB_0eWjE3TC_0 2024-09-12T18:10:06.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.927+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.931+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:10:06.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:10:06.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_V5ERKSxpxN4YuqcKISNPFvniG95HAJo', time=2024-09-12T20:00:24.085849+0000, chain.objs.size()=2 2024-09-12T18:10:06.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.rybvnvGK5tpnwPrVrJJwdxHKRxuthwh_0 2024-09-12T18:10:06.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.rybvnvGK5tpnwPrVrJJwdxHKRxuthwh_1 2024-09-12T18:10:06.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5388628401318038747', time=2024-09-12T20:00:24.520085+0000, chain.objs.size()=1 2024-09-12T18:10:06.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7__shadow_.IyJSG_ownPO8gbY6bxtsqKJXIpTGybK_0 2024-09-12T18:10:06.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9366066458294043026', time=2024-09-12T20:01:46.370399+0000, chain.objs.size()=1 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.gHA5eYtlsTZmcy45nHZykXrS5wmvkxt_0 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11217175261928198541', time=2024-09-12T20:02:25.929446+0000, chain.objs.size()=1 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.VCQkDy8Vwc-o_hcM9Sh92KiGjgy8puD_0 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17709226414678023028', time=2024-09-12T20:02:26.016338+0000, chain.objs.size()=1 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.pPOVCObkUmT1xz_bAjy7tM3uimvIpwg_0 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4442578020024952129', time=2024-09-12T20:02:26.018366+0000, chain.objs.size()=1 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.V_AWqOAaO2xBY7bhOcmriACCb3malcF_0 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14798698810357075455', time=2024-09-12T20:02:30.575439+0000, chain.objs.size()=1 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.AjfFQimY-TfrJeVrr4ySY_6ipD-Z-QN_0 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.704027443152723476', time=2024-09-12T20:02:34.622601+0000, chain.objs.size()=1 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.zPUDndv5uQEdTY1o-JHMT5E2XKzv7zl_0 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6007136724205866455', time=2024-09-12T20:03:09.190005+0000, chain.objs.size()=1 2024-09-12T18:10:06.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.O3IxCTfMsL9RhRApIcEMMRvHFl4u33u_0 2024-09-12T18:10:06.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18141979719380768542', time=2024-09-12T20:03:13.147748+0000, chain.objs.size()=1 2024-09-12T18:10:06.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.OdcGSg51M_g4FMhR6b6oeWe4n3qzx-Y_0 2024-09-12T18:10:06.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17268223834879630414', time=2024-09-12T20:03:13.414440+0000, chain.objs.size()=1 2024-09-12T18:10:06.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.935+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.qP9SIBgE4zKDoGHAi2M-tLZYsQT9Cqa_0 2024-09-12T18:10:06.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15486093332067693680', time=2024-09-12T20:03:52.129035+0000, chain.objs.size()=1 2024-09-12T18:10:06.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.gSHjy3umsYfwTGZ99cRJj_SaQ2oClU-_0 2024-09-12T18:10:06.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16035982858594171137', time=2024-09-12T20:03:56.959268+0000, chain.objs.size()=1 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.9d_QiLz0aUyW3Ki4HL6gMi0unMoLdGv_0 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15707305762446933643', time=2024-09-12T20:05:20.148266+0000, chain.objs.size()=1 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.It3NvknKc8tCOHgj70w-qgdCjtQsVI5_0 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3419088841111977522', time=2024-09-12T20:05:20.362994+0000, chain.objs.size()=1 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_._xqJkHQ7JVfI5HZLosanylRSdAGukVf_0 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17796164979054924501', time=2024-09-12T20:05:54.903165+0000, chain.objs.size()=1 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.7nbV4jgPBcg-S5qIUjDpQM0o6mnp7Lf_0 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14730901868861640081', time=2024-09-12T20:05:55.010754+0000, chain.objs.size()=1 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.lytRZex-PvKZHOQ8z6E-UUY8hWBlDDH_0 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14434475260204397453', time=2024-09-12T20:07:18.621690+0000, chain.objs.size()=1 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.4-PmvP5_U7nSw-DnDvOFQ43EvJGByZy_0 2024-09-12T18:10:06.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7003597874735823050', time=2024-09-12T20:07:18.629716+0000, chain.objs.size()=1 2024-09-12T18:10:06.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.HEn-K62UO9nygv4fWri5EwKrO2uTZWr_0 2024-09-12T18:10:06.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2918498698650380800', time=2024-09-12T20:09:27.399075+0000, chain.objs.size()=1 2024-09-12T18:10:06.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.939+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.NcgaK8aqYB_BAyMLoxexfHjSbSQ84Dx_0 2024-09-12T18:10:06.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.947+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:10:06.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:10:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14548751455957159107', time=2024-09-12T20:00:24.325892+0000, chain.objs.size()=5 2024-09-12T18:10:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-FROZEN.2~fiXN-rjJu18BsPI5mSmhHfplvIIWAUl.1 2024-09-12T18:10:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__shadow_foo-FROZEN.2~fiXN-rjJu18BsPI5mSmhHfplvIIWAUl.1_1 2024-09-12T18:10:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-FROZEN.2~fiXN-rjJu18BsPI5mSmhHfplvIIWAUl.2 2024-09-12T18:10:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__shadow_foo-FROZEN.2~fiXN-rjJu18BsPI5mSmhHfplvIIWAUl.2_1 2024-09-12T18:10:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-FROZEN.2~fiXN-rjJu18BsPI5mSmhHfplvIIWAUl.3 2024-09-12T18:10:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13566920549551722728', time=2024-09-12T20:01:46.448436+0000, chain.objs.size()=1 2024-09-12T18:10:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.Qbod7oJFHwp5yiCZYgPlKtC4BfDlKcy_0 2024-09-12T18:10:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9949197870189694123', time=2024-09-12T20:03:13.307624+0000, chain.objs.size()=1 2024-09-12T18:10:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.6SBsUxlx4MPV1UmDvdSmn_24s4NeeYT_0 2024-09-12T18:10:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9819274653272846312', time=2024-09-12T20:03:52.213925+0000, chain.objs.size()=1 2024-09-12T18:10:06.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.0uqx2qTzUtH4sDMTSgSBajrNc6kNS8Q_0 2024-09-12T18:10:06.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.842748621530976693', time=2024-09-12T20:04:31.186940+0000, chain.objs.size()=1 2024-09-12T18:10:06.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.6Q2qVqQkfltVEXwu-LT4jRiFlCBf4sf_0 2024-09-12T18:10:06.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15303242934947988773', time=2024-09-12T20:05:15.392065+0000, chain.objs.size()=1 2024-09-12T18:10:06.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.4AvWggcMuwJsObIsfzsk4rPy4xot05B_0 2024-09-12T18:10:06.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2475449452135140706', time=2024-09-12T20:05:20.214205+0000, chain.objs.size()=1 2024-09-12T18:10:06.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.94IZdz7Eavf10O7IvE5c-_kCb_nXKAc_0 2024-09-12T18:10:06.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6835565692455323062', time=2024-09-12T20:05:20.216551+0000, chain.objs.size()=1 2024-09-12T18:10:06.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.951+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.JfVRWSMxIWa7TSguquiEfIdg78xNmcP_0 2024-09-12T18:10:06.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.320804707381142312', time=2024-09-12T20:05:20.295747+0000, chain.objs.size()=1 2024-09-12T18:10:06.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.baxmLA1IGqNY7xb4N54-0j0U06SK0DW_0 2024-09-12T18:10:06.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17135110085129577449', time=2024-09-12T20:05:54.920270+0000, chain.objs.size()=1 2024-09-12T18:10:06.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.5tbNWCj8SJai9tCn6KhrOrgAN0Pe3Gb_0 2024-09-12T18:10:06.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11120526505814912733', time=2024-09-12T20:06:35.011848+0000, chain.objs.size()=1 2024-09-12T18:10:06.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.cxfW9CjfSpWeYi0MwDn-WIAmIC0UajF_0 2024-09-12T18:10:06.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12017267220810932845', time=2024-09-12T20:06:43.438184+0000, chain.objs.size()=1 2024-09-12T18:10:06.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.Wz9AIEmlf9AQAwtBQL8bOWGxQkAEC11_0 2024-09-12T18:10:06.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8002283975322734732', time=2024-09-12T20:06:43.537072+0000, chain.objs.size()=1 2024-09-12T18:10:06.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.JbyK-gOaDsFHThm_xmLxLQGRe-hRXLk_0 2024-09-12T18:10:06.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5680845627764589942', time=2024-09-12T20:07:18.612550+0000, chain.objs.size()=1 2024-09-12T18:10:06.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.kgYy65GuDAKMWc2NbHZvfxEyod246WH_0 2024-09-12T18:10:06.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16322437198854729410', time=2024-09-12T20:09:36.239890+0000, chain.objs.size()=1 2024-09-12T18:10:06.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.959+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18__shadow:n1BwGMo6BIZgENKnq3a9.D-33NJYd3l_.QxaQvnsLeSUHTAQxIFXIG1DxsoBRS3o_0 2024-09-12T18:10:06.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.963+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.963+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:10:06.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T18:10:06.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3423026360502821420', time=2024-09-12T20:00:23.723558+0000, chain.objs.size()=1 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.BcW82FKeZryhoV2Avy6LMVHHW42arHF_0 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6005577817119425218', time=2024-09-12T20:00:24.057589+0000, chain.objs.size()=2 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.u3Jo7s9yaoCghaVLjpGp4vAsmilIOHK_0 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.u3Jo7s9yaoCghaVLjpGp4vAsmilIOHK_1 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7125599331851127597', time=2024-09-12T20:00:24.285988+0000, chain.objs.size()=3 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.1 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.2 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.3 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5059347876870978718', time=2024-09-12T20:02:25.945286+0000, chain.objs.size()=1 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.pZWC8hsSIexLzKieYq9ABbgjU-1pU_Y_0 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3596224795360908281', time=2024-09-12T20:02:25.981529+0000, chain.objs.size()=1 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.R-mMEcXD-ikBS9kDvsrz8HAUw2C3_Eq_0 2024-09-12T18:10:06.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2841852867720280319', time=2024-09-12T20:02:26.105503+0000, chain.objs.size()=1 2024-09-12T18:10:06.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.9fgfbo-qkA86PZYjTcU3n1Bz7BWbMoC_0 2024-09-12T18:10:06.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15698136738677221661', time=2024-09-12T20:02:30.436097+0000, chain.objs.size()=1 2024-09-12T18:10:06.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.wujQe3YQjs43Key67Zb6Xn3E78uAakJ_0 2024-09-12T18:10:06.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11216520980817632160', time=2024-09-12T20:02:30.437616+0000, chain.objs.size()=1 2024-09-12T18:10:06.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.UDj5lrQFzK6KjKqOQ_CpUlTpOokriGn_0 2024-09-12T18:10:06.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11088057125751227224', time=2024-09-12T20:02:30.543261+0000, chain.objs.size()=1 2024-09-12T18:10:06.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.967+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.9NTs4DYFeZ8tGn7Mf97VrXzE840qbbu_0 2024-09-12T18:10:06.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16934804194436701112', time=2024-09-12T20:02:34.567856+0000, chain.objs.size()=1 2024-09-12T18:10:06.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.0iVCdkNvN0niTLUJi7tYWhW-UkssV7X_0 2024-09-12T18:10:06.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7893702321554066081', time=2024-09-12T20:03:09.376469+0000, chain.objs.size()=1 2024-09-12T18:10:06.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.gjQfz2gA7St681um636u0rr04SjP7LQ_0 2024-09-12T18:10:06.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11864275214721475756', time=2024-09-12T20:03:52.125167+0000, chain.objs.size()=1 2024-09-12T18:10:06.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.aVGUznFMgqWvmRCkFzPU6VgX4_dkwBm_0 2024-09-12T18:10:06.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16519235173327417205', time=2024-09-12T20:03:52.126557+0000, chain.objs.size()=1 2024-09-12T18:10:06.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.mJWdYv-aDbpQuHtI1T_tIVCz9AgX4JN_0 2024-09-12T18:10:06.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8438603275395420173', time=2024-09-12T20:03:57.017282+0000, chain.objs.size()=1 2024-09-12T18:10:06.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.-_MJT9Tth-gk6hzwiueU3Hv_rlFCfy3_0 2024-09-12T18:10:06.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4338228153339201060', time=2024-09-12T20:04:31.352205+0000, chain.objs.size()=1 2024-09-12T18:10:06.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.bmLfP-ip0cF9Hmg6Mj09YKapZjOd27V_0 2024-09-12T18:10:06.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4905465502061154240', time=2024-09-12T20:04:40.475137+0000, chain.objs.size()=1 2024-09-12T18:10:06.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.971+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.dNdZXmbceaYoi_9UFfxHzdGtRq4K46P_0 2024-09-12T18:10:06.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.975+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7786543648830632420', time=2024-09-12T20:04:40.476871+0000, chain.objs.size()=1 2024-09-12T18:10:06.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.975+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.0YIYjzS59frZfrYjShDTRJXxmVhqRKW_0 2024-09-12T18:10:06.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.975+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.436901800980610297', time=2024-09-12T20:04:40.592893+0000, chain.objs.size()=1 2024-09-12T18:10:06.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.975+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.-PYogjOeqR2VGaU3oOdLP5hov8MkzdI_0 2024-09-12T18:10:06.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.975+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2066320683952269046', time=2024-09-12T20:05:15.396003+0000, chain.objs.size()=1 2024-09-12T18:10:06.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.975+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.IZOchLDYb22CYMW3ElIIIpir7LQc83E_0 2024-09-12T18:10:06.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.975+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.124636418696315883', time=2024-09-12T20:05:15.482598+0000, chain.objs.size()=1 2024-09-12T18:10:06.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.975+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.m1I9Uf0BGbbpG_mQu5KX2RxTU_cx5X6_0 2024-09-12T18:10:06.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.975+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16208465591681235364', time=2024-09-12T20:05:54.875931+0000, chain.objs.size()=1 2024-09-12T18:10:06.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.975+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.ontWT6TFT6ExnAZQkq4EEjU6sT0iJr__0 2024-09-12T18:10:06.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3891243648751110883', time=2024-09-12T20:05:59.650792+0000, chain.objs.size()=1 2024-09-12T18:10:06.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.HHVGxF3FqvRRHF5gHVmXXS_q-Mwe16V_0 2024-09-12T18:10:06.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13984247413599445593', time=2024-09-12T20:06:39.469826+0000, chain.objs.size()=1 2024-09-12T18:10:06.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.rjDG-Gw_8S2DOwPD9VvwP-baLtaWYrb_0 2024-09-12T18:10:06.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7275444942684173235', time=2024-09-12T20:06:39.539411+0000, chain.objs.size()=1 2024-09-12T18:10:06.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.HDRvmu5VOMUxcn8vjt6XXZpGrD54IsA_0 2024-09-12T18:10:06.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2133672137216215029', time=2024-09-12T20:06:39.586470+0000, chain.objs.size()=1 2024-09-12T18:10:06.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.cAHN7RQNGnJbtOtsow6vN47EIc9dM4-_0 2024-09-12T18:10:06.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2093685539191371908', time=2024-09-12T20:06:43.549187+0000, chain.objs.size()=1 2024-09-12T18:10:06.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.yr8o8U3C1ZN4S9bLNpF1BfMs4m_T1lg_0 2024-09-12T18:10:06.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13125572578665472312', time=2024-09-12T20:06:43.702970+0000, chain.objs.size()=1 2024-09-12T18:10:06.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.Et8QyLUxATlJv47UV1uN5PxOy0J0QGd_0 2024-09-12T18:10:06.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8163420059050631457', time=2024-09-12T20:07:18.632061+0000, chain.objs.size()=1 2024-09-12T18:10:06.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.Io0GzavWUYRyL4KhnBXEkKPV5baI47y_0 2024-09-12T18:10:06.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.979+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:06.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.983+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:10:06.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:06.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:06.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T18:10:06.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5309216173189235130', time=2024-09-12T20:00:23.867963+0000, chain.objs.size()=4 2024-09-12T18:10:06.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12__multipart_foo.2~FmaJUOp2hb_J1QZChZffwszqPw4EG7q.1 2024-09-12T18:10:06.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12__multipart_foo.2~FmaJUOp2hb_J1QZChZffwszqPw4EG7q.2 2024-09-12T18:10:06.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12__multipart_foo.2~FmaJUOp2hb_J1QZChZffwszqPw4EG7q.3 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12__multipart_foo.2~FmaJUOp2hb_J1QZChZffwszqPw4EG7q.4 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_n6B33euaEO0emj70od8Itnyg6nsyjq6', time=2024-09-12T20:00:24.116137+0000, chain.objs.size()=1 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.FibpH2bNJQpIdDGl4jcfVpvvg0paDHi_0 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5520568754673004835', time=2024-09-12T20:01:50.867769+0000, chain.objs.size()=1 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.B0U14hHaN45psCL2408YRNCu1A0gTds_0 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13908177331835845736', time=2024-09-12T20:02:30.436234+0000, chain.objs.size()=1 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.WMEnQDwyNTtATEXUkKpS9a3twXcqhEF_0 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10255145080653328434', time=2024-09-12T20:04:31.191486+0000, chain.objs.size()=1 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.xi0bzvmEheodmhTh0m-hcamSh-gzm3G_0 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.591299163579084605', time=2024-09-12T20:04:31.356025+0000, chain.objs.size()=1 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.T-HgEEPGre-VddCNEOXhw7HO4YTCBNa_0 2024-09-12T18:10:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3571492827217362351', time=2024-09-12T20:04:40.551426+0000, chain.objs.size()=1 2024-09-12T18:10:06.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.y6ifEVl0htSEGP6vAClH7l9_pZdVTmD_0 2024-09-12T18:10:06.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15756758226786605577', time=2024-09-12T20:05:15.610165+0000, chain.objs.size()=1 2024-09-12T18:10:06.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.jO9fZUwaPlidEg-iNPQYxwSG3bEtVK1_0 2024-09-12T18:10:06.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8319281602490565172', time=2024-09-12T20:05:20.242385+0000, chain.objs.size()=1 2024-09-12T18:10:06.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.987+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.WQMr7OpaKCDb8Pnt6Ls0XIEE1pKEK07_0 2024-09-12T18:10:06.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.991+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6788172764802730243', time=2024-09-12T20:09:27.438640+0000, chain.objs.size()=1 2024-09-12T18:10:06.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.991+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.HVnxjcvsKUDzkJmcC-1_nFwpPi3AMI1_0 2024-09-12T18:10:06.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.995+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.999+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:10:07.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:06.999+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:10:07.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7895694542691928652', time=2024-09-12T20:00:23.751591+0000, chain.objs.size()=1 2024-09-12T18:10:07.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.B8-nrExFxz3Zxsaxx8cxIGHRngYdDY6_0 2024-09-12T18:10:07.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_0Omh_XQD3CjGLtIWRxRpiK7TzsAwMTJ', time=2024-09-12T20:00:24.105738+0000, chain.objs.size()=1 2024-09-12T18:10:07.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.S7dCserCLm0xE2ZBm_Wk-z-SxHpreD__0 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16135695266771397500', time=2024-09-12T20:02:30.586402+0000, chain.objs.size()=1 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.D9fDVN-iNX6fNqSBDFv5DEgbdzDzv6c_0 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18405515666367942486', time=2024-09-12T20:02:34.725308+0000, chain.objs.size()=1 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_._R8Fmk4RdvTu-39BWSjii2TYyl6IqCy_0 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7252698431052079732', time=2024-09-12T20:02:34.741636+0000, chain.objs.size()=1 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.FYmXEUilrqjf655BMqlqbSMsylrkfAq_0 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6989846838771799175', time=2024-09-12T20:03:09.190815+0000, chain.objs.size()=1 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.iNxdjCiRIfpX8ALofPujS-7sPGm14a2_0 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16240400057299550850', time=2024-09-12T20:03:16.999717+0000, chain.objs.size()=1 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.3TeNtiV_cnZyXy-yFGjexSGbYKuMD0L_0 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13967426448427657044', time=2024-09-12T20:03:17.008479+0000, chain.objs.size()=1 2024-09-12T18:10:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.cp2T6Dm1fvNJYDfSAQdSqIKB7bNkHgP_0 2024-09-12T18:10:07.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11647117035415203412', time=2024-09-12T20:03:52.094111+0000, chain.objs.size()=1 2024-09-12T18:10:07.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.eHMVoE4IvEgWugVh58UsFUL4h-gbPmy_0 2024-09-12T18:10:07.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16588834771800711128', time=2024-09-12T20:04:40.479320+0000, chain.objs.size()=1 2024-09-12T18:10:07.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.NFrG-eNVdY4cqqgL01l23o2LKJRXEpi_0 2024-09-12T18:10:07.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5126668395390882430', time=2024-09-12T20:05:55.031440+0000, chain.objs.size()=1 2024-09-12T18:10:07.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.zt943j5OI_i5B0lJkQxYGF15p5PlI_n_0 2024-09-12T18:10:07.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3932346173911418148', time=2024-09-12T20:05:59.637205+0000, chain.objs.size()=1 2024-09-12T18:10:07.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.003+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.78NvPY8Dz0FibWNK02uRL4q7wkBpMAj_0 2024-09-12T18:10:07.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.007+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15604487239679292750', time=2024-09-12T20:06:35.004663+0000, chain.objs.size()=1 2024-09-12T18:10:07.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.007+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.f3FXvr1kYDrPQ19m9LrZuW2aYJYY1TU_0 2024-09-12T18:10:07.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.007+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8400479797223723428', time=2024-09-12T20:06:39.639593+0000, chain.objs.size()=1 2024-09-12T18:10:07.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.007+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.U4G-4mTB0S6oz_KBJNPzyjfmHSBO0gb_0 2024-09-12T18:10:07.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.007+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.011+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:10:07.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:10:07.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14015376779150380508', time=2024-09-12T20:00:23.704688+0000, chain.objs.size()=1 2024-09-12T18:10:07.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.7P-ktxhtvwzGVB-O2W149Mlr2DfWwRn_0 2024-09-12T18:10:07.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1919321402432304463', time=2024-09-12T20:00:24.255868+0000, chain.objs.size()=3 2024-09-12T18:10:07.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.1 2024-09-12T18:10:07.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.2 2024-09-12T18:10:07.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-STANDARD.2~JNsvOZAETfNe81wqS_oKrx9r-1he14a.3 2024-09-12T18:10:07.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13947571522533191118', time=2024-09-12T20:01:46.461032+0000, chain.objs.size()=1 2024-09-12T18:10:07.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.OGF6pP3pGG5uMrpxzQJsn6A3cohHaac_0 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10202533965272159778', time=2024-09-12T20:01:50.879584+0000, chain.objs.size()=1 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_._UaqY88KSBY-xtgJ2KRW9LS9gaJqDsg_0 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5057516018181943469', time=2024-09-12T20:02:34.627925+0000, chain.objs.size()=1 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.85A6b7j8B9STOdzQncgCZ3RXpWv3BWz_0 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9367820124344067286', time=2024-09-12T20:03:09.195065+0000, chain.objs.size()=1 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.3Fr6BkoNn5EC_QGOr4pIWxvIsDrthfk_0 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17116728990943589906', time=2024-09-12T20:03:13.130507+0000, chain.objs.size()=1 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.53SNcOw9k6FrYPiH8r4wEcEAqpqXeFp_0 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2349235784551031319', time=2024-09-12T20:03:52.097169+0000, chain.objs.size()=1 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.rW7HPvLeeNWe310ROhYi2p4V_prmYVk_0 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1190145846350735458', time=2024-09-12T20:03:56.724690+0000, chain.objs.size()=1 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.7gLe6QlCwKgq1GFEFDLt9gSyRnfsIcK_0 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16917436969574649341', time=2024-09-12T20:03:56.870659+0000, chain.objs.size()=1 2024-09-12T18:10:07.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.015+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.NZMGzHqQz2aQwXrt1JlV6OECbTtqt7-_0 2024-09-12T18:10:07.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8711901832457552535', time=2024-09-12T20:03:56.961331+0000, chain.objs.size()=1 2024-09-12T18:10:07.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.xqnaf7skW2P7pj2IOsgRLSLRneeflsr_0 2024-09-12T18:10:07.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2040015459124254933', time=2024-09-12T20:04:31.357727+0000, chain.objs.size()=1 2024-09-12T18:10:07.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.9iopvNdD334p1aTyn_G8EpvVpav8Q1M_0 2024-09-12T18:10:07.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16447898536900089795', time=2024-09-12T20:05:15.429078+0000, chain.objs.size()=1 2024-09-12T18:10:07.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.dRKQD7GoLM9TK_aMFoj8WJd_oINZ8hi_0 2024-09-12T18:10:07.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16636987951121240872', time=2024-09-12T20:05:20.243910+0000, chain.objs.size()=1 2024-09-12T18:10:07.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.yB0ZuZCgGMD0t0cZcuJMc0W6iJ4-GDL_0 2024-09-12T18:10:07.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11754872507104544391', time=2024-09-12T20:05:59.613566+0000, chain.objs.size()=1 2024-09-12T18:10:07.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.JJS_hNkzRO5bSM3S9VJGEXm7rM35O2B_0 2024-09-12T18:10:07.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15601423800217897042', time=2024-09-12T20:07:18.612395+0000, chain.objs.size()=1 2024-09-12T18:10:07.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.019+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.lLHqUofS2HkQU-wZAbWvhBAYr-sWcJr_0 2024-09-12T18:10:07.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.023+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2248383704325831991', time=2024-09-12T20:09:27.391118+0000, chain.objs.size()=1 2024-09-12T18:10:07.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.023+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.z1w_12Yah9vGX3gYyfqfG3jqaJ4v_Fk_0 2024-09-12T18:10:07.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.023+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.027+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:10:07.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:10:07.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17136895435401302077', time=2024-09-12T20:00:23.741228+0000, chain.objs.size()=1 2024-09-12T18:10:07.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4__shadow_.orx4Wn_vQZmPhkju9Y6nTPR0ELABxCL_0 2024-09-12T18:10:07.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14626757294629210806', time=2024-09-12T20:01:46.288209+0000, chain.objs.size()=1 2024-09-12T18:10:07.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.VdVvZuwtGXVGkhm569le2GkwwfH_ZrD_0 2024-09-12T18:10:07.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14996652698423679060', time=2024-09-12T20:01:50.843018+0000, chain.objs.size()=1 2024-09-12T18:10:07.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.8rfhWgCE9oZb9P-Xl9PeEV-idLnDQJd_0 2024-09-12T18:10:07.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14417491211700690825', time=2024-09-12T20:02:25.973603+0000, chain.objs.size()=1 2024-09-12T18:10:07.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.lBKKkJUyjOUvWX0R9v4kaKzp2sEcf2A_0 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15028326008659372057', time=2024-09-12T20:02:34.568623+0000, chain.objs.size()=1 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.JtlrFAeKpFOHF0ZYJg8ir8rKnh6kKR5_0 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17580765939777314308', time=2024-09-12T20:03:13.247428+0000, chain.objs.size()=1 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.dmY_XjDhAuslhiLo9DUZdRYv_bF6E6q_0 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12689132808112357671', time=2024-09-12T20:03:13.384226+0000, chain.objs.size()=1 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.-wqXcAgtU4pYLZlr3V3UgPu2VT-sUMU_0 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16102774943825071980', time=2024-09-12T20:03:56.817548+0000, chain.objs.size()=1 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.Sxoxv31aYKo240viPLid4B5oPuHpeC5_0 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7650438607044402735', time=2024-09-12T20:04:31.356539+0000, chain.objs.size()=1 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.9TpSf7DxcMs_BQU6CeCG-yeb78oPYOl_0 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15781965222030388719', time=2024-09-12T20:04:36.573997+0000, chain.objs.size()=1 2024-09-12T18:10:07.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.aLHxVXjiki9d3G_KJfa3t-cgnCGrkEE_0 2024-09-12T18:10:07.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2705911826248662144', time=2024-09-12T20:05:20.291602+0000, chain.objs.size()=1 2024-09-12T18:10:07.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.Fmr52PhhSh1A9CbnNBQTAT4JNI5mHlU_0 2024-09-12T18:10:07.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4178891277703452172', time=2024-09-12T20:05:54.918913+0000, chain.objs.size()=1 2024-09-12T18:10:07.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.031+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.pJgZXmPpNCUM_9DJouvV-8O6q603bEM_0 2024-09-12T18:10:07.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.035+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10968284673173749834', time=2024-09-12T20:06:35.001651+0000, chain.objs.size()=1 2024-09-12T18:10:07.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.035+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.nS8GriCLGgoMr1U7BJt0zeLvxMW6mbJ_0 2024-09-12T18:10:07.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.035+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6844584867938408804', time=2024-09-12T20:06:39.494164+0000, chain.objs.size()=1 2024-09-12T18:10:07.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.035+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.UuLg4vDqnBvGIebdDcTHZMDIDjc4cf8_0 2024-09-12T18:10:07.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.035+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5197774686624603348', time=2024-09-12T20:06:43.667777+0000, chain.objs.size()=1 2024-09-12T18:10:07.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.035+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.EUwT05suQ8YIznonN4I6O2mMT83JWKi_0 2024-09-12T18:10:07.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.035+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8773702349240231690', time=2024-09-12T20:07:18.596362+0000, chain.objs.size()=1 2024-09-12T18:10:07.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.035+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.7wYgaBIDym3FpkXjf8ypkhpzMz6ORIh_0 2024-09-12T18:10:07.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.035+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10439938841128072903', time=2024-09-12T20:09:27.436428+0000, chain.objs.size()=1 2024-09-12T18:10:07.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.035+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.RXXGtqVoBrEEH6gw2GdFbHNRNtTD75Q_0 2024-09-12T18:10:07.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.039+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.043+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:10:07.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:10:07.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3819786709348389607', time=2024-09-12T20:02:34.570243+0000, chain.objs.size()=1 2024-09-12T18:10:07.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.9om1e_wmTD2RFXCbq5FGbtp1e5mTCcs_0 2024-09-12T18:10:07.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16029845856354227473', time=2024-09-12T20:02:34.591988+0000, chain.objs.size()=1 2024-09-12T18:10:07.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.BtBpyqYXznF1MOfXtoEDEn5XTovrnKw_0 2024-09-12T18:10:07.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.258135445060157025', time=2024-09-12T20:03:13.157984+0000, chain.objs.size()=1 2024-09-12T18:10:07.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.OHTZEziafK_CmDy6MV-lBEdp2hmrgh-_0 2024-09-12T18:10:07.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12306036156387373043', time=2024-09-12T20:03:13.269355+0000, chain.objs.size()=1 2024-09-12T18:10:07.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.tTNVMGD49-FUUlAbykY6lWksr5vIkiO_0 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4886276784494753851', time=2024-09-12T20:03:56.986844+0000, chain.objs.size()=1 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.zARPMEzQk7loj7SJbwbwjXKwCb8Wbeu_0 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6839106585692467872', time=2024-09-12T20:04:31.098460+0000, chain.objs.size()=1 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.QLgXEa04vfIrXt5u_D7APOgB42e0hmG_0 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1834725264977172601', time=2024-09-12T20:04:36.395485+0000, chain.objs.size()=1 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.8Y8NrZvz5E8CWZTz-4uMJ750tL6qJDg_0 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4714433074527520634', time=2024-09-12T20:04:36.581638+0000, chain.objs.size()=1 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.a6cyZ1nPv0sVUnfB1vxdfJZ-QaJoVV2_0 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17118267700788270678', time=2024-09-12T20:04:40.595028+0000, chain.objs.size()=1 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.hjO1eyQaKhTo-G60XE2nfH-sE1-uWy3_0 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5082193658859029405', time=2024-09-12T20:05:20.380070+0000, chain.objs.size()=1 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.L0mG8jkMQ3HaqlSgyZMygu-gf3CiOWV_0 2024-09-12T18:10:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8711352985029243448', time=2024-09-12T20:06:43.547841+0000, chain.objs.size()=1 2024-09-12T18:10:07.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.6cXspjSvWrBSF4AB-pG1g2xUbKZ4U1v_0 2024-09-12T18:10:07.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.778234823825798904', time=2024-09-12T20:09:27.460552+0000, chain.objs.size()=1 2024-09-12T18:10:07.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.047+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.QOEVFmU_B_fgzk_4FtXCXUcv3HtVQ7X_0 2024-09-12T18:10:07.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.051+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.055+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:10:07.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:10:07.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11072432346249332788', time=2024-09-12T20:00:24.023861+0000, chain.objs.size()=2 2024-09-12T18:10:07.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tI7V6hCbybzws84g3_FjebN-7FsJh6X_0 2024-09-12T18:10:07.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tI7V6hCbybzws84g3_FjebN-7FsJh6X_1 2024-09-12T18:10:07.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_nTudEa9u8T0JL7KX2C4GR8PjFhdhWCv', time=2024-09-12T20:00:24.034665+0000, chain.objs.size()=2 2024-09-12T18:10:07.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.ugy72Nkpq9E286ogIE9ufVjnBgiLnE5_0 2024-09-12T18:10:07.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.ugy72Nkpq9E286ogIE9ufVjnBgiLnE5_1 2024-09-12T18:10:07.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15709237430514522973', time=2024-09-12T20:01:46.303209+0000, chain.objs.size()=1 2024-09-12T18:10:07.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.XMITdx0ex6g7oqm5-DlIsu9jmD3P6qX_0 2024-09-12T18:10:07.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10547576981982663774', time=2024-09-12T20:01:46.470760+0000, chain.objs.size()=1 2024-09-12T18:10:07.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.55RNXdt85OuV-0KT_h-Y6ukl_IlFYyh_0 2024-09-12T18:10:07.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16324570482854848192', time=2024-09-12T20:01:50.998135+0000, chain.objs.size()=1 2024-09-12T18:10:07.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.U78iasbHLHin9Nc6drYwpSQlTpg_8j5_0 2024-09-12T18:10:07.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.671318421365987244', time=2024-09-12T20:02:26.025699+0000, chain.objs.size()=1 2024-09-12T18:10:07.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.3lL6LyQdbZ4-ZAdqufN6fE59K2R767Y_0 2024-09-12T18:10:07.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.891090488831308829', time=2024-09-12T20:02:34.607337+0000, chain.objs.size()=1 2024-09-12T18:10:07.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.rxne1UiLwpgqnT4lJgWiBM6mVuYw1g3_0 2024-09-12T18:10:07.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3830224695430864225', time=2024-09-12T20:03:09.266367+0000, chain.objs.size()=1 2024-09-12T18:10:07.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.uBTX1SMcTnxruKJ2JApVckcGhR4lf-H_0 2024-09-12T18:10:07.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4068083308067506714', time=2024-09-12T20:03:13.239381+0000, chain.objs.size()=1 2024-09-12T18:10:07.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.UZDf5e1_Gy2huvzDB20TWPxdPjxT8-j_0 2024-09-12T18:10:07.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9504987987727058878', time=2024-09-12T20:04:35.217287+0000, chain.objs.size()=1 2024-09-12T18:10:07.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.059+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.TaJx2Qr_X-OmBswug9MZ1dnhzhIQ5I9_0 2024-09-12T18:10:07.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.063+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17704456979381641948', time=2024-09-12T20:04:36.381775+0000, chain.objs.size()=1 2024-09-12T18:10:07.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.063+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.0hrCJmKoavdBjsFXzbk6kIrwfBgHZtO_0 2024-09-12T18:10:07.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.063+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13733521714840258988', time=2024-09-12T20:05:18.971097+0000, chain.objs.size()=1 2024-09-12T18:10:07.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.063+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.Lz3FNPaCZJBsT4xliGwz07Pzxd_OsL8_0 2024-09-12T18:10:07.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.063+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1587950339981642617', time=2024-09-12T20:06:35.001667+0000, chain.objs.size()=1 2024-09-12T18:10:07.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.063+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.f9o6UmJMdli2k3cPxdZpsvev7xU4LzW_0 2024-09-12T18:10:07.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.063+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7843084711516030890', time=2024-09-12T20:09:27.436431+0000, chain.objs.size()=1 2024-09-12T18:10:07.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.063+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.IEaV2AI5e0ZSSjIlpJN9Lkg9JzSZ5va_0 2024-09-12T18:10:07.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.067+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.071+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:10:07.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.071+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.071+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:10:07.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1708333290430433818', time=2024-09-12T20:00:23.825732+0000, chain.objs.size()=4 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11__multipart_foo.2~Udygbt_thBZJCHxo6-eAQ-nLSXdEptF.1 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11__multipart_foo.2~Udygbt_thBZJCHxo6-eAQ-nLSXdEptF.2 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11__multipart_foo.2~Udygbt_thBZJCHxo6-eAQ-nLSXdEptF.3 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11__multipart_foo.2~Udygbt_thBZJCHxo6-eAQ-nLSXdEptF.4 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14976962273211413387', time=2024-09-12T20:01:54.571981+0000, chain.objs.size()=1 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.Yo1MHVPhmPCOidt8z4q_P0TA-3pr8vh_0 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5423428738503557588', time=2024-09-12T20:03:13.250410+0000, chain.objs.size()=1 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.9cfUz845v_rBKayPZgeqnuGBGeIsXFS_0 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.597773598270224059', time=2024-09-12T20:03:13.251974+0000, chain.objs.size()=1 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.QMhhHQwdRHL_XWy05IMt7MHa5S4aEdl_0 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5967696055156216794', time=2024-09-12T20:04:31.437118+0000, chain.objs.size()=1 2024-09-12T18:10:07.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.IMcNAqSEPNmrzK6u9H_bYYQUDWT0FHq_0 2024-09-12T18:10:07.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5517302610496333198', time=2024-09-12T20:04:36.385955+0000, chain.objs.size()=1 2024-09-12T18:10:07.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.QWcossNSsEjNDoWPQQhlO6-4h0bmJaS_0 2024-09-12T18:10:07.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10062181006527093222', time=2024-09-12T20:04:36.570477+0000, chain.objs.size()=1 2024-09-12T18:10:07.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.9LB5lUdkNfBPVMioSElWAqu-xzriqDG_0 2024-09-12T18:10:07.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15105008237574650435', time=2024-09-12T20:04:40.377062+0000, chain.objs.size()=1 2024-09-12T18:10:07.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.lO1y-sqTrG2LIQOfigLw1oKKnbyvNZk_0 2024-09-12T18:10:07.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9238456114397713834', time=2024-09-12T20:04:40.550792+0000, chain.objs.size()=1 2024-09-12T18:10:07.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.075+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.O_ijw-FbaOp0Yml6_nqvf_3vceEYXtb_0 2024-09-12T18:10:07.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12728210635485451646', time=2024-09-12T20:05:15.398442+0000, chain.objs.size()=1 2024-09-12T18:10:07.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.KJ0afPvx-ot8yFMaOZ6evJQXHRZoUDI_0 2024-09-12T18:10:07.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7640711140814374468', time=2024-09-12T20:05:54.787234+0000, chain.objs.size()=1 2024-09-12T18:10:07.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.vOsyEOSF6IVAPIY48ijEo--s3CmwhDK_0 2024-09-12T18:10:07.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.374100009964169021', time=2024-09-12T20:05:59.592735+0000, chain.objs.size()=1 2024-09-12T18:10:07.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.1iCjb9Bm9U3Hy9UIS6dMBuGcrzZY6yM_0 2024-09-12T18:10:07.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.180117719973097971', time=2024-09-12T20:05:59.788280+0000, chain.objs.size()=1 2024-09-12T18:10:07.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.UafPa5LGgls9Dcyucr8_mMqqRyB7DSB_0 2024-09-12T18:10:07.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8306260265705499779', time=2024-09-12T20:05:59.817390+0000, chain.objs.size()=1 2024-09-12T18:10:07.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.avphw4APeFkoKCTqpW54TbaMCD9VAxI_0 2024-09-12T18:10:07.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11938257563117065414', time=2024-09-12T20:06:35.000611+0000, chain.objs.size()=1 2024-09-12T18:10:07.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.BWK2hkkU1AH9-QpQBw53DvZo-1kkJPl_0 2024-09-12T18:10:07.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9732324861763576555', time=2024-09-12T20:06:38.498870+0000, chain.objs.size()=1 2024-09-12T18:10:07.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.CqupstZ1ZBcr8AAjpnPodU7fwp5K8Wf_0 2024-09-12T18:10:07.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1464209549234320326', time=2024-09-12T20:07:18.595873+0000, chain.objs.size()=1 2024-09-12T18:10:07.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.079+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.2O3vfvtCe-FAVVLROezwaunIaO8GM8w_0 2024-09-12T18:10:07.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.083+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.087+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:10:07.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.087+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.087+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:10:07.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12711899203451162307', time=2024-09-12T20:00:23.973891+0000, chain.objs.size()=4 2024-09-12T18:10:07.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9__multipart_foo.2~CIELLqHRKtN5J5lkV1gBOeOI72VBrJC.1 2024-09-12T18:10:07.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9__multipart_foo.2~CIELLqHRKtN5J5lkV1gBOeOI72VBrJC.2 2024-09-12T18:10:07.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9__multipart_foo.2~CIELLqHRKtN5J5lkV1gBOeOI72VBrJC.3 2024-09-12T18:10:07.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9__multipart_foo.2~CIELLqHRKtN5J5lkV1gBOeOI72VBrJC.4 2024-09-12T18:10:07.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4754529603100552825', time=2024-09-12T20:02:25.936489+0000, chain.objs.size()=1 2024-09-12T18:10:07.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.hm3iTx_vrPngckfRj31XQinl80elRUP_0 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13538117624929185292', time=2024-09-12T20:03:09.310359+0000, chain.objs.size()=1 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.nVC7aHkj1_CU-hHxQ04mUr_ogjWofxT_0 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12534460148840794675', time=2024-09-12T20:03:17.020930+0000, chain.objs.size()=1 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.I7M2pelb_4-hQnEVyaN3MgqtsQhIkS5_0 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13000159048275196613', time=2024-09-12T20:03:17.022698+0000, chain.objs.size()=1 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.FBlhfD96yFyQIk6Eh6kP3qngN7Q_zUA_0 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16789926954752000662', time=2024-09-12T20:03:17.024730+0000, chain.objs.size()=1 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.geygUhzi8dm48x8ZN7htf4L32XkAMn8_0 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9185621899489467107', time=2024-09-12T20:03:17.067241+0000, chain.objs.size()=1 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.fQR0yTMcMDe3L4w0d-WlEmeXv4NbMph_0 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4687622538547881103', time=2024-09-12T20:03:52.175371+0000, chain.objs.size()=1 2024-09-12T18:10:07.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.Uxa1PcZkutAsM0W9O_RD0umXAPKGfGt_0 2024-09-12T18:10:07.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6476964279161431103', time=2024-09-12T20:04:40.416240+0000, chain.objs.size()=1 2024-09-12T18:10:07.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.h4fozKjsMePlMxizQEszQQP6wPatG2__0 2024-09-12T18:10:07.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11491022440931092425', time=2024-09-12T20:04:40.595900+0000, chain.objs.size()=1 2024-09-12T18:10:07.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.v0Q5gbt2dCKfrygtmsZ-6x4jP5wG_J__0 2024-09-12T18:10:07.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18095782592995471943', time=2024-09-12T20:05:15.430330+0000, chain.objs.size()=1 2024-09-12T18:10:07.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.cqcSOBOPN3sM9_eduN1-Ma8qQyPiSqs_0 2024-09-12T18:10:07.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.647534304087434154', time=2024-09-12T20:05:59.597139+0000, chain.objs.size()=1 2024-09-12T18:10:07.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.091+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.rqDYat9nfCoFgfiTeFsEFMUNZTMKdeh_0 2024-09-12T18:10:07.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.095+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17803609231393190532', time=2024-09-12T20:06:39.542741+0000, chain.objs.size()=1 2024-09-12T18:10:07.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.095+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.wO-0VBqIsEJXoQ72oCvcVMdjGQhCNYI_0 2024-09-12T18:10:07.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.095+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11507976555425984686', time=2024-09-12T20:07:18.583189+0000, chain.objs.size()=1 2024-09-12T18:10:07.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.095+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.qHdTf4SJq5oyrYGBuaU_twsPNXjiUso_0 2024-09-12T18:10:07.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.095+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.099+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:10:07.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:10:07.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13455726753541873125', time=2024-09-12T20:00:24.075281+0000, chain.objs.size()=2 2024-09-12T18:10:07.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.u3Jo7s9yaoCghaVLjpGp4vAsmilIOHK_0 2024-09-12T18:10:07.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.u3Jo7s9yaoCghaVLjpGp4vAsmilIOHK_1 2024-09-12T18:10:07.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13310377068052479969', time=2024-09-12T20:01:46.370471+0000, chain.objs.size()=1 2024-09-12T18:10:07.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.zlISlY_6G9dK7-vpzu4CDElmEuO1wvC_0 2024-09-12T18:10:07.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13849540308708184818', time=2024-09-12T20:01:46.372913+0000, chain.objs.size()=1 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.X5Ed7Guyj74DQyc7aoVFmm3qbjX05wn_0 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4044098715179164715', time=2024-09-12T20:02:26.016474+0000, chain.objs.size()=1 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.TD4b2-par11iHNG-y0dkQ0vQ6kYPzqN_0 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14982647699056066599', time=2024-09-12T20:02:30.579044+0000, chain.objs.size()=1 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.F2RzWPQo-Wb57iySBWoLd8E4cAEwBME_0 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1642098466534616916', time=2024-09-12T20:02:34.741494+0000, chain.objs.size()=1 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.Ap8M7CfoPHsrk-9NatOlAbLFG6ePotH_0 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11704497837350289343', time=2024-09-12T20:03:52.092574+0000, chain.objs.size()=1 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.27__shadow_.y3Ewb-uPwhOwHPzcrk-EjtAWGYC0Zks_0 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1747204229757369420', time=2024-09-12T20:04:31.369522+0000, chain.objs.size()=1 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.pKoDKoB0ktHphQ-UdmGMc4dkhUJBZNt_0 2024-09-12T18:10:07.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3623395765669095685', time=2024-09-12T20:05:20.198926+0000, chain.objs.size()=1 2024-09-12T18:10:07.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.ulZb1w91nWu86to_iwxzhG-fhIUH7N-_0 2024-09-12T18:10:07.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14637747295703145880', time=2024-09-12T20:05:20.384640+0000, chain.objs.size()=1 2024-09-12T18:10:07.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.nOWv9jBTa1FO7bnEf1F-XXlI2_eiHpA_0 2024-09-12T18:10:07.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14756489719015795479', time=2024-09-12T20:06:39.382873+0000, chain.objs.size()=1 2024-09-12T18:10:07.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.103+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.63o-6hh44vdkLkINjSBXx7m9WRQoj6J_0 2024-09-12T18:10:07.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.107+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16773650997277711236', time=2024-09-12T20:06:43.512571+0000, chain.objs.size()=1 2024-09-12T18:10:07.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.107+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.wfnJvJbxE_nKFoxnLKYYkLBTxcv_TjA_0 2024-09-12T18:10:07.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.107+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17941245093107419861', time=2024-09-12T20:06:47.401047+0000, chain.objs.size()=1 2024-09-12T18:10:07.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.107+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.ofgWcROktzxyNEA5wz0_e59lSFdfRFy_0 2024-09-12T18:10:07.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.111+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:10:07.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:10:07.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4335810843076635339', time=2024-09-12T20:00:24.589317+0000, chain.objs.size()=1 2024-09-12T18:10:07.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8__shadow_._qqacsx7vpNn0pXcbTZ5-Rm-5AO26Z6_0 2024-09-12T18:10:07.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5731838279429254312', time=2024-09-12T20:01:46.220259+0000, chain.objs.size()=1 2024-09-12T18:10:07.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.UtNMbKniqHO_GrEUiIuIKx6U1qkdMFo_0 2024-09-12T18:10:07.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11854060403328611869', time=2024-09-12T20:01:50.913700+0000, chain.objs.size()=1 2024-09-12T18:10:07.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.2YuZNVRodIol6gWZWXetk4w6gSh4Yed_0 2024-09-12T18:10:07.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14206735656817893262', time=2024-09-12T20:02:30.488700+0000, chain.objs.size()=1 2024-09-12T18:10:07.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.AbEpTczePSpzdPFKprVJEcqamEY5olB_0 2024-09-12T18:10:07.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9182940438081163768', time=2024-09-12T20:03:09.311833+0000, chain.objs.size()=1 2024-09-12T18:10:07.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.wK9SCo1CsYAl4gSaIEf8CwUdjJIduiH_0 2024-09-12T18:10:07.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12776393370854699223', time=2024-09-12T20:03:56.986047+0000, chain.objs.size()=1 2024-09-12T18:10:07.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.RjUh_V59XMT4wSQ8Trb5mHfx2Vf5Mpy_0 2024-09-12T18:10:07.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15259508965812445798', time=2024-09-12T20:04:31.266832+0000, chain.objs.size()=1 2024-09-12T18:10:07.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.BE_pJpW-GFUl-9NoWC8Iaypw3HuGS7L_0 2024-09-12T18:10:07.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11740605650121678116', time=2024-09-12T20:04:36.386829+0000, chain.objs.size()=1 2024-09-12T18:10:07.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.3ZSb7zHvrGETmuWi5gE4u3Pbo0NJgra_0 2024-09-12T18:10:07.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17449068165926052259', time=2024-09-12T20:04:40.584398+0000, chain.objs.size()=1 2024-09-12T18:10:07.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.H2V42PTttdh6eIQdEwC-kF1sQMWmIvu_0 2024-09-12T18:10:07.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12466338616946855645', time=2024-09-12T20:04:40.676590+0000, chain.objs.size()=1 2024-09-12T18:10:07.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.KZoNL_rCsg_9PxXkC9CLeGizoIb6xeY_0 2024-09-12T18:10:07.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.115+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16374646327921068290', time=2024-09-12T20:05:54.875596+0000, chain.objs.size()=1 2024-09-12T18:10:07.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.119+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.3G71xlK_qStb6CvMACg0SApFfqUDJ0Z_0 2024-09-12T18:10:07.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.119+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12175074650918955203', time=2024-09-12T20:06:35.015042+0000, chain.objs.size()=1 2024-09-12T18:10:07.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.119+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.Yp8mI71yOv_E2maSDyRG4oRbgd4cFLl_0 2024-09-12T18:10:07.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.119+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12547458659843528325', time=2024-09-12T20:06:35.017065+0000, chain.objs.size()=1 2024-09-12T18:10:07.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.119+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.iLG4AwEo5fPKTT-PwkBF_9fg0yjPk5__0 2024-09-12T18:10:07.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.119+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9586407924767008908', time=2024-09-12T20:06:35.019336+0000, chain.objs.size()=1 2024-09-12T18:10:07.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.119+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.e_rwOuZQrr4HybyKBuCV7WkSJi_gFxo_0 2024-09-12T18:10:07.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.119+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14907230524002726397', time=2024-09-12T20:06:39.542858+0000, chain.objs.size()=1 2024-09-12T18:10:07.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.119+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.J9rJ14BdjO1IqrTIO4vEhkb3nEM2CJ6_0 2024-09-12T18:10:07.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.123+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6701007926893081166', time=2024-09-12T20:09:27.439444+0000, chain.objs.size()=1 2024-09-12T18:10:07.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.123+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.EN3z4xhlFzDeIYCDr1TeonU_OrQQRO7_0 2024-09-12T18:10:07.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.123+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.127+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:10:07.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.127+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T18:10:07.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2671897227266439626', time=2024-09-12T20:00:24.235040+0000, chain.objs.size()=5 2024-09-12T18:10:07.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.1 2024-09-12T18:10:07.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.1_1 2024-09-12T18:10:07.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.2 2024-09-12T18:10:07.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.2_1 2024-09-12T18:10:07.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.3 2024-09-12T18:10:07.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2069971357412571216', time=2024-09-12T20:00:24.396034+0000, chain.objs.size()=3 2024-09-12T18:10:07.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.IIayQaw3647WUbzudZjdd7vCMDG4q1__0 2024-09-12T18:10:07.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.IIayQaw3647WUbzudZjdd7vCMDG4q1__1 2024-09-12T18:10:07.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.IIayQaw3647WUbzudZjdd7vCMDG4q1__2 2024-09-12T18:10:07.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14884639585893450026', time=2024-09-12T20:01:51.002963+0000, chain.objs.size()=1 2024-09-12T18:10:07.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.DXVH2fC0ohXkBJo8WjQFuyivRbmWlak_0 2024-09-12T18:10:07.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17539731365826357675', time=2024-09-12T20:02:26.015238+0000, chain.objs.size()=1 2024-09-12T18:10:07.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.vwCLONyHOjVzWNNQivyRlBVNrZ6o8hJ_0 2024-09-12T18:10:07.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12901157076197865322', time=2024-09-12T20:02:30.519850+0000, chain.objs.size()=1 2024-09-12T18:10:07.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_._Yf9YX2UbfQ4A79DmRp0IW8EIiJI54s_0 2024-09-12T18:10:07.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12152150090024269858', time=2024-09-12T20:03:09.214421+0000, chain.objs.size()=1 2024-09-12T18:10:07.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.m6bk7lJjnfYNodYgJXv69-K8IApUF5__0 2024-09-12T18:10:07.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7082854821401871143', time=2024-09-12T20:03:57.022680+0000, chain.objs.size()=1 2024-09-12T18:10:07.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.NtSuN51qIgAEWUs3XhKCCuSQBeJf9dR_0 2024-09-12T18:10:07.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6211361266350589826', time=2024-09-12T20:05:15.394714+0000, chain.objs.size()=1 2024-09-12T18:10:07.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.ko90K45PetPxTTkVs0yMToPMT_tTtUH_0 2024-09-12T18:10:07.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6607301242105572512', time=2024-09-12T20:05:54.920483+0000, chain.objs.size()=1 2024-09-12T18:10:07.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.131+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.7T-UjaGp9wpLGcpzud9XdNENXfVWyuV_0 2024-09-12T18:10:07.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.135+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5651434754353776406', time=2024-09-12T20:06:43.592041+0000, chain.objs.size()=1 2024-09-12T18:10:07.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.135+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.jpgis_NY-BvPLifTAr-XMXY2uYBzZaQ_0 2024-09-12T18:10:07.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.135+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.514578539503223846', time=2024-09-12T20:09:27.442108+0000, chain.objs.size()=1 2024-09-12T18:10:07.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.135+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.MrVh9GyXlOqA4cXjzFgYl6UOe37spZU_0 2024-09-12T18:10:07.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.135+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.139+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:10:07.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:10:07.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14233719631376618432', time=2024-09-12T20:00:23.923601+0000, chain.objs.size()=4 2024-09-12T18:10:07.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10__multipart_foo.2~-I9W2QPKNQcESzh0D9CCU6dk8p4umdk.1 2024-09-12T18:10:07.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10__multipart_foo.2~-I9W2QPKNQcESzh0D9CCU6dk8p4umdk.2 2024-09-12T18:10:07.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10__multipart_foo.2~-I9W2QPKNQcESzh0D9CCU6dk8p4umdk.3 2024-09-12T18:10:07.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10__multipart_foo.2~-I9W2QPKNQcESzh0D9CCU6dk8p4umdk.4 2024-09-12T18:10:07.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4836635434605221043', time=2024-09-12T20:00:24.017184+0000, chain.objs.size()=2 2024-09-12T18:10:07.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tI7V6hCbybzws84g3_FjebN-7FsJh6X_0 2024-09-12T18:10:07.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tI7V6hCbybzws84g3_FjebN-7FsJh6X_1 2024-09-12T18:10:07.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_m1T5NDShuFK-yhss-SUMiVGDUuxEIMH', time=2024-09-12T20:00:24.195318+0000, chain.objs.size()=3 2024-09-12T18:10:07.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.E804Bo2i-7Infnks4KLwR8uHrBM0FAq_0 2024-09-12T18:10:07.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.E804Bo2i-7Infnks4KLwR8uHrBM0FAq_1 2024-09-12T18:10:07.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_.E804Bo2i-7Infnks4KLwR8uHrBM0FAq_2 2024-09-12T18:10:07.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58447431050167813', time=2024-09-12T20:02:34.550563+0000, chain.objs.size()=1 2024-09-12T18:10:07.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.eeFe-ri7gDpbcCt3DhRN-swnYO5hWMf_0 2024-09-12T18:10:07.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3783134101482046558', time=2024-09-12T20:03:09.212030+0000, chain.objs.size()=1 2024-09-12T18:10:07.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_._fRO7qt58_3YqCZNVem3ua_hwF3gmK__0 2024-09-12T18:10:07.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7235104958427268987', time=2024-09-12T20:03:09.310244+0000, chain.objs.size()=1 2024-09-12T18:10:07.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.143+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.0_XsLsyq1WMl--y_nFIUP47FjSsRalw_0 2024-09-12T18:10:07.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.147+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15037156485425136336', time=2024-09-12T20:03:17.020837+0000, chain.objs.size()=1 2024-09-12T18:10:07.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.147+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.3cqh3GZaIIbbzR-VYSu-Sk6bu0kGv8B_0 2024-09-12T18:10:07.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.147+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7187195193988119499', time=2024-09-12T20:03:56.893862+0000, chain.objs.size()=1 2024-09-12T18:10:07.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.147+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.WaAPCtF19ceiCIi7uYrWfdPqHEU4t5W_0 2024-09-12T18:10:07.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.147+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11135144066801774338', time=2024-09-12T20:04:36.583095+0000, chain.objs.size()=1 2024-09-12T18:10:07.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.147+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.2nB7nkB7TELadTb4fkqvGsSYXWoZyLf_0 2024-09-12T18:10:07.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.147+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14405967410734120835', time=2024-09-12T20:06:35.082073+0000, chain.objs.size()=1 2024-09-12T18:10:07.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.147+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.cNIoP5DMORgGw13jZjI1tLQtHDyW7HI_0 2024-09-12T18:10:07.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.147+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10199072301916727950', time=2024-09-12T20:06:43.553523+0000, chain.objs.size()=1 2024-09-12T18:10:07.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.147+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.S7VFN_2MuZUz3ikDDy_VM0_bV-XQxr7_0 2024-09-12T18:10:07.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.151+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8044975023748230557', time=2024-09-12T20:07:18.731189+0000, chain.objs.size()=1 2024-09-12T18:10:07.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.151+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.9rxBPF_aIr6t-Xe_jnJASW2D2r3KZZH_0 2024-09-12T18:10:07.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.151+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.155+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:10:07.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:10:07.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9457996376369137693', time=2024-09-12T20:00:24.126497+0000, chain.objs.size()=1 2024-09-12T18:10:07.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.Y9WVgfhI7ZahU5r_UzWfOtcW2dYLF5d_0 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11879739060539405566', time=2024-09-12T20:00:24.382687+0000, chain.objs.size()=3 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.uyR-vTXcLTlk0GpE_ZylRstSaMSLKdQ_0 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.uyR-vTXcLTlk0GpE_ZylRstSaMSLKdQ_1 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13__shadow_.uyR-vTXcLTlk0GpE_ZylRstSaMSLKdQ_2 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12343403692924575646', time=2024-09-12T20:01:46.258882+0000, chain.objs.size()=1 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.BAY1QQHTDMFVD7wApdkhrKXiFwUXwRX_0 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4119531743080848963', time=2024-09-12T20:01:50.763774+0000, chain.objs.size()=1 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.TNGI9n1Fl7byL422gWLfmRhAA8mr2y5_0 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13736848841587311272', time=2024-09-12T20:01:50.787840+0000, chain.objs.size()=1 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.lUmtKLz4qPfLfn2JE-VaGdgFe59kb0V_0 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4511502364898272479', time=2024-09-12T20:02:30.487216+0000, chain.objs.size()=1 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.ILCPIpJKFxQ3t-jOLJTb8xbiYB17w27_0 2024-09-12T18:10:07.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12228922838231142639', time=2024-09-12T20:02:30.512398+0000, chain.objs.size()=1 2024-09-12T18:10:07.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.DDdHjTMGvvM0zPSsuCI9bkcyAyub1jE_0 2024-09-12T18:10:07.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18017473183659367358', time=2024-09-12T20:03:13.305895+0000, chain.objs.size()=1 2024-09-12T18:10:07.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.xcB8qFYxVTu6a3ZKhNXIGXPViWM3Kn5_0 2024-09-12T18:10:07.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7906054136417850152', time=2024-09-12T20:03:56.865403+0000, chain.objs.size()=1 2024-09-12T18:10:07.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.WaDCeWHuHqtF2r08kGABFH4k_AbzP_k_0 2024-09-12T18:10:07.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3348131126844614668', time=2024-09-12T20:04:31.357633+0000, chain.objs.size()=1 2024-09-12T18:10:07.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.159+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.OnLKO5ftq6vGBNz4lfhQA8hx3HmRnC2_0 2024-09-12T18:10:07.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5901890926773574727', time=2024-09-12T20:04:31.455904+0000, chain.objs.size()=1 2024-09-12T18:10:07.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.i1dah2gQ1H31UgKH4eiKLdxonmhNYth_0 2024-09-12T18:10:07.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11927806234614293113', time=2024-09-12T20:05:54.867576+0000, chain.objs.size()=1 2024-09-12T18:10:07.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.f1LhH7-nLdeKrM009V9NWpxPGis4a57_0 2024-09-12T18:10:07.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17367669641613119092', time=2024-09-12T20:05:54.869173+0000, chain.objs.size()=1 2024-09-12T18:10:07.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.bGhv9zqurVTVl_nSMqbIHuDWvKqUofz_0 2024-09-12T18:10:07.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2643991747378262214', time=2024-09-12T20:06:39.447316+0000, chain.objs.size()=1 2024-09-12T18:10:07.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.dTFrOmHYui-VDcOKPeeLwamphSlgmVC_0 2024-09-12T18:10:07.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5793573576623159051', time=2024-09-12T20:06:39.540681+0000, chain.objs.size()=1 2024-09-12T18:10:07.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.owTRyMrErjgnbecKUJMV6yY2O4ocUpR_0 2024-09-12T18:10:07.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5669418829393481962', time=2024-09-12T20:06:43.442196+0000, chain.objs.size()=1 2024-09-12T18:10:07.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.163+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.__5metGxA1qLsWKJ7Td7TaHdztyh7Q3_0 2024-09-12T18:10:07.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.167+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.171+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:10:07.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:10:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2177882473492277888', time=2024-09-12T20:00:24.214707+0000, chain.objs.size()=5 2024-09-12T18:10:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.1 2024-09-12T18:10:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.1_1 2024-09-12T18:10:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.2 2024-09-12T18:10:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__shadow_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.2_1 2024-09-12T18:10:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16__multipart_foo-LUKEWARM.2~KrQZqaicdExbMvg0RrckVXmauR6s4ZV.3 2024-09-12T18:10:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5687236333560550573', time=2024-09-12T20:01:51.021994+0000, chain.objs.size()=1 2024-09-12T18:10:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.-LQimSHGEp8rRJrKa4c1MIg7UDgNQai_0 2024-09-12T18:10:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15634604215534104010', time=2024-09-12T20:02:25.945370+0000, chain.objs.size()=1 2024-09-12T18:10:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.OFaQzSATk4Q85q796WJPtQtGIlNOkpx_0 2024-09-12T18:10:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15408639055264506854', time=2024-09-12T20:02:34.567526+0000, chain.objs.size()=1 2024-09-12T18:10:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.Ir0jFz5aeMA03g_aK843EcePMxma1nG_0 2024-09-12T18:10:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15953058172281704077', time=2024-09-12T20:02:34.569865+0000, chain.objs.size()=1 2024-09-12T18:10:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.8Acre3RLs_vI_-tCNZ2Uov_wEBDvwts_0 2024-09-12T18:10:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522812176500555394', time=2024-09-12T20:03:16.997665+0000, chain.objs.size()=1 2024-09-12T18:10:07.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.Ue8jW5j68R9vhkltDKpudYxM0_m-MYZ_0 2024-09-12T18:10:07.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13215142623525117196', time=2024-09-12T20:04:36.395563+0000, chain.objs.size()=1 2024-09-12T18:10:07.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.yDeYeqAVwVJon-7lzskloWYv7QKucH9_0 2024-09-12T18:10:07.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6710202486590662965', time=2024-09-12T20:04:36.581622+0000, chain.objs.size()=1 2024-09-12T18:10:07.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.175+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.K8g7QFhsT_fRRoRZO1zRDKoBxgwVdmI_0 2024-09-12T18:10:07.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4967759033407848129', time=2024-09-12T20:05:54.813050+0000, chain.objs.size()=1 2024-09-12T18:10:07.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.tvliexcXDhw95KD3IsQJCuu36cTUyeV_0 2024-09-12T18:10:07.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8546348067565025189', time=2024-09-12T20:05:59.601702+0000, chain.objs.size()=1 2024-09-12T18:10:07.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.tcGWaveDJ6U_6DEFxUkzyYCdVSA8F4M_0 2024-09-12T18:10:07.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3015048925295382515', time=2024-09-12T20:05:59.603109+0000, chain.objs.size()=1 2024-09-12T18:10:07.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.NK4i8zK4t3TFb5WkXHXmi3LDr-yn8sV_0 2024-09-12T18:10:07.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10318421190094840626', time=2024-09-12T20:06:35.056103+0000, chain.objs.size()=1 2024-09-12T18:10:07.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.-31i5T2xm12j3NCJ99Qih2jwSRJQlIb_0 2024-09-12T18:10:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11949926539409259110', time=2024-09-12T20:06:35.178856+0000, chain.objs.size()=1 2024-09-12T18:10:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.Yz0OT9FICzoptusuedJU_bYmYIb30-K_0 2024-09-12T18:10:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16653403262047442727', time=2024-09-12T20:07:18.530761+0000, chain.objs.size()=1 2024-09-12T18:10:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.Mx2bLX3rLpuPjBTiDkilP_zz-JvwH32_0 2024-09-12T18:10:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5311824016134492370', time=2024-09-12T20:09:42.201805+0000, chain.objs.size()=1 2024-09-12T18:10:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.179+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18__shadow:DUEvpvwuRzpZxzNzfAp0lRT95HlZ8ew_.uVXWRT2e3zBZ8Cvu8CjycF-gG60cvXg_0 2024-09-12T18:10:07.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.183+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.187+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:10:07.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.187+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.187+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:10:07.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_96qDY8LHcRkwZG42kvjA3j9S3nS0qcM', time=2024-09-12T20:00:24.064619+0000, chain.objs.size()=2 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tACtpTQxIBV3hFy10-alu68Fhu6azl3_0 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.tACtpTQxIBV3hFy10-alu68Fhu6azl3_1 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1209068449955984187', time=2024-09-12T20:00:24.596504+0000, chain.objs.size()=1 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8__shadow_.WMvtnx2kI7I3xhpWR6I1o9fXKvzdRCc_0 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13036534658648092198', time=2024-09-12T20:01:50.869676+0000, chain.objs.size()=1 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.OsqheZjt4kLwyj-ap3vNEdDW6Ao3hKh_0 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13857974419167821628', time=2024-09-12T20:02:34.605910+0000, chain.objs.size()=1 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.LnevVMP2Frd4pd-EI3EfPN688ETOn38_0 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17555148877174513557', time=2024-09-12T20:02:34.609210+0000, chain.objs.size()=1 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.23__shadow_.LFcjKcqx68oVS5rEIp8eEvTDJlK8yqJ_0 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10554458073802118279', time=2024-09-12T20:03:13.242967+0000, chain.objs.size()=1 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.hco0GDzRlyMmusR4mPCEf4ZaPC5iD_V_0 2024-09-12T18:10:07.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14190653678764522420', time=2024-09-12T20:04:00.112879+0000, chain.objs.size()=1 2024-09-12T18:10:07.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.bJ4xGx7A6DSIOeDJ0MPxnqEiXAZXDen_0 2024-09-12T18:10:07.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15799612468066525778', time=2024-09-12T20:04:36.444254+0000, chain.objs.size()=1 2024-09-12T18:10:07.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.I7NYEmGzAh11_4tmFeipgqWO0tSbJ_7_0 2024-09-12T18:10:07.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7172724442574726333', time=2024-09-12T20:04:36.573937+0000, chain.objs.size()=1 2024-09-12T18:10:07.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.30__shadow_.Sf4tC5kQlOoz-lh4r_CiEkcJopB_Wpw_0 2024-09-12T18:10:07.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6846871142018316565', time=2024-09-12T20:05:59.591942+0000, chain.objs.size()=1 2024-09-12T18:10:07.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.ZslhYuCYEydnRa9ZAs87GCjE3bZi9Om_0 2024-09-12T18:10:07.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6919665868975818674', time=2024-09-12T20:05:59.593509+0000, chain.objs.size()=1 2024-09-12T18:10:07.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.191+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35__shadow_.-U_fQIe_ekGKZrtCBIeBcsNeq5PN2IA_0 2024-09-12T18:10:07.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.195+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17367738816897711128', time=2024-09-12T20:06:39.563576+0000, chain.objs.size()=1 2024-09-12T18:10:07.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.195+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.ymiguZIxeamlernJVovLiToOuyYgtVl_0 2024-09-12T18:10:07.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.195+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4698795354187896420', time=2024-09-12T20:06:43.685478+0000, chain.objs.size()=1 2024-09-12T18:10:07.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.195+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.5LxJFtSyXU0MvM7JPCIaBYOD2Zh54i1_0 2024-09-12T18:10:07.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.195+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17006166315251904273', time=2024-09-12T20:06:43.698216+0000, chain.objs.size()=1 2024-09-12T18:10:07.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.195+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.P_nUbAO2nzoCOSrvNGzRmjCYFLmGfy3_0 2024-09-12T18:10:07.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.195+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5466153386721141051', time=2024-09-12T20:09:27.432257+0000, chain.objs.size()=1 2024-09-12T18:10:07.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.195+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17__shadow_.CgJdDsOBvVOkbtPh0IiO0svDsguH79C_0 2024-09-12T18:10:07.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.195+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.199+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:10:07.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:10:07.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.800373494044638957', time=2024-09-12T20:00:24.098225+0000, chain.objs.size()=1 2024-09-12T18:10:07.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15__shadow_.Y9WVgfhI7ZahU5r_UzWfOtcW2dYLF5d_0 2024-09-12T18:10:07.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5719650509977574458', time=2024-09-12T20:00:24.345493+0000, chain.objs.size()=3 2024-09-12T18:10:07.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-STANDARD.2~qquJmApbaLjsJg1Kino-LHub8YVdDZn.1 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-STANDARD.2~qquJmApbaLjsJg1Kino-LHub8YVdDZn.2 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14__multipart_foo-STANDARD.2~qquJmApbaLjsJg1Kino-LHub8YVdDZn.3 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6117175637422034494', time=2024-09-12T20:01:46.307649+0000, chain.objs.size()=1 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.i2NBxGQtaBMDYpIhDgbGnXcXOZxxWtS_0 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4786488249573969091', time=2024-09-12T20:02:30.520064+0000, chain.objs.size()=1 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.eBjraCmtLCcsNDOwiwWCN13SyCVIcI3_0 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11806142729645277176', time=2024-09-12T20:02:30.670716+0000, chain.objs.size()=1 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.B8K4XqwLYO_TSNj2SmGczsQOlYss-gQ_0 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16639078008084758023', time=2024-09-12T20:03:09.261141+0000, chain.objs.size()=1 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.24__shadow_.ebMmwyq6oNp8XxmCPmwoWxfxdKgVMw0_0 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12533237609045324540', time=2024-09-12T20:03:17.025784+0000, chain.objs.size()=1 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.ZpUV2F4zjf6VYxgyROh41nyYg0bhV8g_0 2024-09-12T18:10:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14198783082532366707', time=2024-09-12T20:03:17.027667+0000, chain.objs.size()=1 2024-09-12T18:10:07.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.ksKn7ItPV6sRrBy_PnG9C6p6n10q15u_0 2024-09-12T18:10:07.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10439580157012394225', time=2024-09-12T20:03:17.100897+0000, chain.objs.size()=1 2024-09-12T18:10:07.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_._TXo3k-wKZSj0HapnHSBm4iqLdlRgte_0 2024-09-12T18:10:07.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10233241832319148959', time=2024-09-12T20:03:56.917170+0000, chain.objs.size()=1 2024-09-12T18:10:07.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.203+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.28__shadow_.kHXcNZkt0BYA9NTALdd0SWTdMMLk2W0_0 2024-09-12T18:10:07.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17878091288111706925', time=2024-09-12T20:04:31.357625+0000, chain.objs.size()=1 2024-09-12T18:10:07.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.29__shadow_.7yfgTkuZdEAalPZ616szONgf2KL8gFn_0 2024-09-12T18:10:07.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15952195703887222064', time=2024-09-12T20:04:40.662181+0000, chain.objs.size()=1 2024-09-12T18:10:07.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.iVMDTHVXXIbHpx21skmHKvU7unKDtPZ_0 2024-09-12T18:10:07.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16436660093646230798', time=2024-09-12T20:05:15.543342+0000, chain.objs.size()=1 2024-09-12T18:10:07.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.2NBCOiuyr21eqeHvkNJvUaQm16XVtg9_0 2024-09-12T18:10:07.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2796347934418564169', time=2024-09-12T20:05:15.589377+0000, chain.objs.size()=1 2024-09-12T18:10:07.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.paUIEOwrGZOJCkSl3hOTlpcSEHfB1UT_0 2024-09-12T18:10:07.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7099571267726595376', time=2024-09-12T20:05:20.219138+0000, chain.objs.size()=1 2024-09-12T18:10:07.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.yMEafLrtw4KyUiiF279aOfw2rLhHt_4_0 2024-09-12T18:10:07.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14688470199835892114', time=2024-09-12T20:05:54.921781+0000, chain.objs.size()=1 2024-09-12T18:10:07.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.34__shadow_.DNouMwST4ZfxQxUkWxNMdbKM-TybEmu_0 2024-09-12T18:10:07.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16742310352042208369', time=2024-09-12T20:06:35.159835+0000, chain.objs.size()=1 2024-09-12T18:10:07.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36__shadow_.eDLmPqLriphrB8qGUA7fRIX2dwBOrwh_0 2024-09-12T18:10:07.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14125835567360135007', time=2024-09-12T20:06:39.457554+0000, chain.objs.size()=1 2024-09-12T18:10:07.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.ccbg-sg1LaDXxbNIqdbW00ZZDA1fd3t_0 2024-09-12T18:10:07.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3403734159184575061', time=2024-09-12T20:07:18.730548+0000, chain.objs.size()=1 2024-09-12T18:10:07.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.207+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.oKjDbB3zsjHli4TPasidfGUs2r-dOtg_0 2024-09-12T18:10:07.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.211+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:10:07.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T18:10:07.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14096034542509504984', time=2024-09-12T20:01:46.279388+0000, chain.objs.size()=1 2024-09-12T18:10:07.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.19__shadow_.tpI6H4O2T4xQ5UcA1A9hUQO9AfWEJZ1_0 2024-09-12T18:10:07.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4818231158151843365', time=2024-09-12T20:01:50.882358+0000, chain.objs.size()=1 2024-09-12T18:10:07.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.20__shadow_.7e75aQBtjujr4JPC1eHY7AyNRHYrUwM_0 2024-09-12T18:10:07.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2386542349255372346', time=2024-09-12T20:02:25.926475+0000, chain.objs.size()=1 2024-09-12T18:10:07.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21__shadow_.XxuUOdZuzFgU8qm-0dRtaLfo04r9rcQ_0 2024-09-12T18:10:07.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17385388736571912172', time=2024-09-12T20:03:13.402421+0000, chain.objs.size()=1 2024-09-12T18:10:07.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.pGSpoZ9dvWaa4l5-Y2ceaPybdosLviv_0 2024-09-12T18:10:07.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10905026456705995232', time=2024-09-12T20:03:17.050942+0000, chain.objs.size()=1 2024-09-12T18:10:07.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.yHu79F-wTbggDoGA-7KHR9pdaKaf1Fz_0 2024-09-12T18:10:07.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14039041448158720026', time=2024-09-12T20:03:17.189178+0000, chain.objs.size()=1 2024-09-12T18:10:07.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.26__shadow_.all7m189HEARoyIB7luY9AAf7ZHfD3e_0 2024-09-12T18:10:07.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9441827095979851042', time=2024-09-12T20:05:15.457958+0000, chain.objs.size()=1 2024-09-12T18:10:07.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.gvtCf1o2jwHrCnAghMcHKq8s-2bcInd_0 2024-09-12T18:10:07.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4335511528758480299', time=2024-09-12T20:05:15.599157+0000, chain.objs.size()=1 2024-09-12T18:10:07.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.cLsc8L2iZyvecfyJqp7Rq3RgM8qBGTK_0 2024-09-12T18:10:07.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10476279677026149865', time=2024-09-12T20:05:20.242761+0000, chain.objs.size()=1 2024-09-12T18:10:07.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.33__shadow_.XHDcv-buGJQDk94wwubYB-lPhxiQ7sH_0 2024-09-12T18:10:07.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15352369217591338184', time=2024-09-12T20:07:18.557611+0000, chain.objs.size()=1 2024-09-12T18:10:07.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.r2-QcAN38cJOtvs9UNzJuGiP2Z68sPt_0 2024-09-12T18:10:07.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8384494415888228979', time=2024-09-12T20:07:18.696490+0000, chain.objs.size()=1 2024-09-12T18:10:07.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.215+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.jGuX6ZqVCupUKqlz0sGniK10ePXCfaZ_0 2024-09-12T18:10:07.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.219+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.223+0000 7f297d85a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:10:07.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:10:07.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2414573717767605071', time=2024-09-12T20:02:30.506825+0000, chain.objs.size()=1 2024-09-12T18:10:07.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22__shadow_.VX7D0OjD0snK2kuyk0NWUsF2cFji0XT_0 2024-09-12T18:10:07.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1059719966150337584', time=2024-09-12T20:03:13.250537+0000, chain.objs.size()=1 2024-09-12T18:10:07.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.25__shadow_.vdx4jAPzfX9Eg4jT8-xMsv9I0qAD8x0_0 2024-09-12T18:10:07.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16107099298915032933', time=2024-09-12T20:04:40.547257+0000, chain.objs.size()=1 2024-09-12T18:10:07.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.31__shadow_.p7HvK_YR-IweAiaN_KIafSjpd4HpxCC_0 2024-09-12T18:10:07.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7545051751044838896', time=2024-09-12T20:05:15.398577+0000, chain.objs.size()=1 2024-09-12T18:10:07.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.32__shadow_.KAQqMyeOq636YUecNYJx6FQaBgzr-ft_0 2024-09-12T18:10:07.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1192056642861422081', time=2024-09-12T20:06:39.664387+0000, chain.objs.size()=1 2024-09-12T18:10:07.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.37__shadow_.aJDKWM2fqv38CZXkPWqWZXzyiSbWQJE_0 2024-09-12T18:10:07.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2105214363161501465', time=2024-09-12T20:06:43.407384+0000, chain.objs.size()=1 2024-09-12T18:10:07.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.vaZnQxYN8QHB5X0WQiYEFzSHlOqQELT_0 2024-09-12T18:10:07.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6824155711160279331', time=2024-09-12T20:06:43.463141+0000, chain.objs.size()=1 2024-09-12T18:10:07.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.38__shadow_.wdF_DvXWsTW72hpwV1QUDpV97fOmuu__0 2024-09-12T18:10:07.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5237716041109902665', time=2024-09-12T20:07:18.596405+0000, chain.objs.size()=1 2024-09-12T18:10:07.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.227+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.39__shadow_.iJVayNdMstSYWkJ5BOIaqD6qS9knIsC_0 2024-09-12T18:10:07.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.231+0000 7f297d85a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:07.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.235+0000 7f28327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:07.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.239+0000 7f297d85a9c0 20 remove_watcher() i=0 2024-09-12T18:10:07.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.239+0000 7f297d85a9c0 2 removed watcher, disabling cache 2024-09-12T18:10:07.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.243+0000 7f297d85a9c0 20 remove_watcher() i=1 2024-09-12T18:10:07.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.247+0000 7f297d85a9c0 20 remove_watcher() i=2 2024-09-12T18:10:07.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.251+0000 7f297d85a9c0 20 remove_watcher() i=3 2024-09-12T18:10:07.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.251+0000 7f297d85a9c0 20 remove_watcher() i=4 2024-09-12T18:10:07.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.255+0000 7f297d85a9c0 20 remove_watcher() i=5 2024-09-12T18:10:07.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.255+0000 7f297d85a9c0 20 remove_watcher() i=6 2024-09-12T18:10:07.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.259+0000 7f297d85a9c0 20 remove_watcher() i=7 2024-09-12T18:10:07.277 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:10:07.350 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:07.350 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:07.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.575+0000 7fec38449640 0 --2- 172.21.15.157:0/1856460012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55acab4b6560 0x55acab6299f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:10:07.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.599+0000 7fec3a9439c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:07.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:07.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 20 realm 2024-09-12T18:10:07.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:07.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:07.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:07.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:07.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:07.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:07.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:07.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:07.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:07.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.603+0000 7fec3a9439c0 20 searching for the correct realm 2024-09-12T18:10:07.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.607+0000 7fec38449640 0 -- 172.21.15.157:0/3111051175 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7fec300b8040 msgr2=0x7fec300f9af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:07.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.823+0000 7fec37c48640 0 -- 172.21.15.157:0/3111051175 >> [v2:172.21.15.157:6800/2182114182,v1:172.21.15.157:6801/2182114182] conn(0x55acab717190 msgr2=0x55acab7195a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:07.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.839+0000 7fec3a9439c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:10:07.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.839+0000 7fec3a9439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:07.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.839+0000 7fec3a9439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:07.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.839+0000 7fec3a9439c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:10:07.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.839+0000 7fec3a9439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:07.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.839+0000 7fec3a9439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:07.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.839+0000 7fec3a9439c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:07.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.839+0000 7fec3a9439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:07.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.839+0000 7fec3a9439c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:07.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.839+0000 7fec3a9439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:07.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.839+0000 7fec3a9439c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:07.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:07.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 20 zone default found 2024-09-12T18:10:07.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 4 Realm: () 2024-09-12T18:10:07.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:10:07.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:10:07.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:07.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 20 zonegroup default 2024-09-12T18:10:07.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:07.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:07.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:07.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:07.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:07.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:07.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 20 started sync module instance, tier type = 2024-09-12T18:10:07.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.843+0000 7fec3a9439c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:10:07.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.863+0000 7fec3a9439c0 20 add_watcher() i=0 2024-09-12T18:10:07.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.863+0000 7fec3a9439c0 20 add_watcher() i=1 2024-09-12T18:10:07.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.863+0000 7fec3a9439c0 20 add_watcher() i=2 2024-09-12T18:10:07.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.863+0000 7fec3a9439c0 20 add_watcher() i=3 2024-09-12T18:10:07.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.863+0000 7fec3a9439c0 20 add_watcher() i=4 2024-09-12T18:10:07.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.863+0000 7fec3a9439c0 20 add_watcher() i=5 2024-09-12T18:10:07.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.863+0000 7fec3a9439c0 20 add_watcher() i=6 2024-09-12T18:10:07.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.867+0000 7fec3a9439c0 20 add_watcher() i=7 2024-09-12T18:10:07.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.867+0000 7fec3a9439c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:07.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.871+0000 7feaeefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:07.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.871+0000 7fec3a9439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:07.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.871+0000 7fec3a9439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:07.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.959+0000 7feaedfdb640 20 reqs_thread_entry: start 2024-09-12T18:10:07.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.959+0000 7fec3a9439c0 20 init_complete bucket index max shards: 1 2024-09-12T18:10:07.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.959+0000 7fec3a9439c0 20 Filter name: none 2024-09-12T18:10:07.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.959+0000 7fea5f7fe640 20 reqs_thread_entry: start 2024-09-12T18:10:07.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.959+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:10:07.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.963+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.963+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.963+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.967+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:10:07.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.971+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.971+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.971+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.975+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:10:07.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.975+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.975+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.975+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.979+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:10:07.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.983+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.983+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.983+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.983+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:10:07.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.987+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.991+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.991+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.995+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:10:07.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.995+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:07.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.995+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:07.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.999+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:07.999+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:10:08.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.003+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.003+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.003+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.007+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:10:08.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.007+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.011+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.011+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.011+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:10:08.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.015+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.015+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.015+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.019+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:10:08.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.023+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.023+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.023+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.027+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:10:08.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.031+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.031+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.031+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.031+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:10:08.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.035+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.035+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.035+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.039+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:10:08.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.043+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.043+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.043+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.047+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:10:08.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.047+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.051+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.051+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.055+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:10:08.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.055+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.059+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.059+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.059+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:10:08.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.063+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.063+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.067+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.067+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:10:08.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.071+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.071+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.071+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.075+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:10:08.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.079+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.083+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.083+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.083+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:10:08.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.087+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.091+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.091+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.095+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:10:08.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.099+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.099+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.099+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.103+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:10:08.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.107+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.107+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.107+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.111+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:10:08.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.115+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.115+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.115+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.119+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:10:08.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.123+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.123+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.123+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.123+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:10:08.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.127+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.127+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.131+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.131+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:10:08.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.135+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.135+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.139+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.139+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:10:08.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.143+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.147+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.147+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.151+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:10:08.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.151+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.155+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.155+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.159+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:10:08.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.159+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.163+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.163+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.163+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:10:08.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.167+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.167+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.167+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.171+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:10:08.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.175+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.175+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.175+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.179+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:10:08.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.183+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.183+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.183+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.187+0000 7fec3a9439c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:10:08.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.191+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.191+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:08.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.191+0000 7fec3a9439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:08.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.195+0000 7feaeefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:08.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.203+0000 7fec3a9439c0 20 remove_watcher() i=0 2024-09-12T18:10:08.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.203+0000 7fec3a9439c0 2 removed watcher, disabling cache 2024-09-12T18:10:08.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.203+0000 7fec3a9439c0 20 remove_watcher() i=1 2024-09-12T18:10:08.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.207+0000 7fec3a9439c0 20 remove_watcher() i=2 2024-09-12T18:10:08.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.211+0000 7fec3a9439c0 20 remove_watcher() i=3 2024-09-12T18:10:08.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.211+0000 7fec3a9439c0 20 remove_watcher() i=4 2024-09-12T18:10:08.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.215+0000 7fec3a9439c0 20 remove_watcher() i=5 2024-09-12T18:10:08.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.215+0000 7fec3a9439c0 20 remove_watcher() i=6 2024-09-12T18:10:08.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:10:08.219+0000 7fec3a9439c0 20 remove_watcher() i=7 2024-09-12T18:10:08.237 DEBUG:teuthology.orchestra.run.smithi157:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T18:10:08.822 INFO:teuthology.orchestra.run.smithi157.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T18:10:13.223 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :clean UP-TO-DATE 2024-09-12T18:10:32.122 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :compileJava 2024-09-12T18:10:32.122 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :processResources 2024-09-12T18:10:32.122 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :classes 2024-09-12T18:10:33.021 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:33.021 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :compileTestJava 2024-09-12T18:10:33.022 INFO:teuthology.orchestra.run.smithi157.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:10:33.022 INFO:teuthology.orchestra.run.smithi157.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:10:33.023 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:33.023 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:10:33.023 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :testClasses 2024-09-12T18:10:38.921 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:38.921 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :test 2024-09-12T18:10:38.921 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:38.922 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T18:10:46.821 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T18:10:47.421 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:47.421 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T18:10:47.721 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:47.721 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T18:10:48.321 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:10:48.321 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T18:11:08.921 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:08.921 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T18:11:09.721 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:09.722 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T18:11:09.722 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:09.722 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T18:11:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:09.921 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T18:11:10.121 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:10.122 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T18:11:10.721 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:10.721 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T18:11:19.221 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:19.222 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T18:11:20.421 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:20.422 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T18:11:20.821 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:20.821 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T18:11:20.821 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12 18:11:20,789 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:11:58.522 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:58.522 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T18:11:59.621 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:59.621 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T18:11:59.821 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:11:59.822 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T18:12:00.321 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:00.322 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T18:12:00.622 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:00.622 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T18:12:01.521 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:01.522 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T18:12:09.822 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:09.822 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T18:12:10.421 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:10.422 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T18:12:10.522 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:10.522 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T18:12:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:10.721 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T18:12:21.622 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:21.622 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T18:12:22.222 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:22.222 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T18:12:38.722 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:38.722 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T18:12:39.722 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:39.722 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T18:12:43.822 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:43.822 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T18:12:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:12:44.522 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T18:15:10.223 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:10.224 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T18:15:10.822 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:10.823 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T18:15:20.022 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:20.023 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T18:15:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:20.623 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T18:15:28.423 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:28.423 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T18:15:29.123 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:29.123 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T18:15:32.423 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:32.423 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T18:15:47.423 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:47.424 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T18:15:47.623 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:47.623 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T18:15:48.323 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:48.323 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T18:15:48.523 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:48.523 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T18:15:49.123 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:49.123 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T18:15:49.323 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:49.323 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T18:15:50.023 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:50.023 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T18:15:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:50.223 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T18:15:50.923 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:50.923 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T18:15:51.123 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:51.123 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T18:15:51.823 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:51.823 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T18:15:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:52.023 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T18:15:52.723 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:52.723 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T18:15:52.923 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:52.923 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T18:15:53.523 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:15:53.523 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T18:16:11.723 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:11.724 INFO:teuthology.orchestra.run.smithi157.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T18:16:12.423 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:12.423 INFO:teuthology.orchestra.run.smithi157.stdout:---------------------------------------------------------------------- 2024-09-12T18:16:12.423 INFO:teuthology.orchestra.run.smithi157.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T18:16:12.423 INFO:teuthology.orchestra.run.smithi157.stdout:---------------------------------------------------------------------- 2024-09-12T18:16:12.488 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:12.489 INFO:teuthology.orchestra.run.smithi157.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:16:12.489 INFO:teuthology.orchestra.run.smithi157.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:16:12.489 INFO:teuthology.orchestra.run.smithi157.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:16:12.489 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:12.489 INFO:teuthology.orchestra.run.smithi157.stdout:BUILD SUCCESSFUL in 6m 4s 2024-09-12T18:16:12.489 INFO:teuthology.orchestra.run.smithi157.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T18:16:12.818 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:16:12.849 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:16:12.849 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:16:12.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.895+0000 7faf2737d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:12.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.895+0000 7faf2737d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:12.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.895+0000 7faf2737d9c0 20 realm 2024-09-12T18:16:12.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.895+0000 7faf2737d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:12.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.895+0000 7faf2737d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:12.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.895+0000 7faf2737d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:16:12.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.895+0000 7faf2737d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:12.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.895+0000 7faf2737d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:12.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.895+0000 7faf2737d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:12.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.895+0000 7faf2737d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:12.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.895+0000 7faf2737d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:12.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.899+0000 7faf2737d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:16:12.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.899+0000 7faf2737d9c0 20 searching for the correct realm 2024-09-12T18:16:12.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.903+0000 7faf25684640 0 -- 172.21.15.157:0/1786230852 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55951efaf1b0 msgr2=0x55951efb15a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:16:12.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.911+0000 7faf24e83640 0 -- 172.21.15.157:0/1786230852 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7faf1808c990 msgr2=0x7faf1804c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:16:12.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.915+0000 7faf2737d9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:16:12.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.915+0000 7faf2737d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:16:12.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.915+0000 7faf2737d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:16:12.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.915+0000 7faf2737d9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:16:12.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.915+0000 7faf2737d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:16:12.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.915+0000 7faf2737d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:16:12.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.915+0000 7faf2737d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:12.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.915+0000 7faf2737d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:12.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.915+0000 7faf2737d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:12.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:12.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:12.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:16:12.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 zone default found 2024-09-12T18:16:12.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 4 Realm: () 2024-09-12T18:16:12.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:16:12.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:16:12.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:16:12.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 zonegroup default 2024-09-12T18:16:12.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:12.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:12.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:12.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:12.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:12.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:12.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 started sync module instance, tier type = 2024-09-12T18:16:12.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.919+0000 7faf2737d9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:16:12.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.935+0000 7faf2737d9c0 20 add_watcher() i=0 2024-09-12T18:16:12.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.935+0000 7faf2737d9c0 20 add_watcher() i=1 2024-09-12T18:16:12.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.935+0000 7faf2737d9c0 20 add_watcher() i=2 2024-09-12T18:16:12.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.935+0000 7faf2737d9c0 20 add_watcher() i=3 2024-09-12T18:16:12.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.935+0000 7faf2737d9c0 20 add_watcher() i=4 2024-09-12T18:16:12.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.935+0000 7faf2737d9c0 20 add_watcher() i=5 2024-09-12T18:16:12.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.935+0000 7faf2737d9c0 20 add_watcher() i=6 2024-09-12T18:16:12.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.935+0000 7faf2737d9c0 20 add_watcher() i=7 2024-09-12T18:16:12.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.935+0000 7faf2737d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:16:12.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.939+0000 7faddafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:12.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.939+0000 7faf2737d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:16:12.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:12.939+0000 7faf2737d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:16:13.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.007+0000 7fadd9fe3640 20 reqs_thread_entry: start 2024-09-12T18:16:13.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.007+0000 7faf2737d9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:16:13.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.007+0000 7faf2737d9c0 20 Filter name: none 2024-09-12T18:16:13.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.007+0000 7fad4b7fe640 20 reqs_thread_entry: start 2024-09-12T18:16:13.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.007+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:16:13.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.011+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.011+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.011+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:16:13.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.011+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15148883690482555215', time=2024-09-12T20:15:51.366385+0000, chain.objs.size()=1 2024-09-12T18:16:13.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.011+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.63__shadow_.lgK1S8jUBK0nzsWks4elucqTYJBDTg3_0 2024-09-12T18:16:13.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.015+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.019+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:16:13.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.019+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.023+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.023+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.023+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:16:13.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.027+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.027+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1852033293989237427', time=2024-09-12T20:15:20.189121+0000, chain.objs.size()=9 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.56__multipart_key1.2~ad-8jLrzq23zZv-ckqUKH487j5ZT2sb.1 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.56__shadow_key1.2~ad-8jLrzq23zZv-ckqUKH487j5ZT2sb.1_1 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.56__multipart_key1.2~ad-8jLrzq23zZv-ckqUKH487j5ZT2sb.2 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.56__shadow_key1.2~ad-8jLrzq23zZv-ckqUKH487j5ZT2sb.2_1 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.56__multipart_key1.2~ad-8jLrzq23zZv-ckqUKH487j5ZT2sb.3 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.56__shadow_key1.2~ad-8jLrzq23zZv-ckqUKH487j5ZT2sb.3_1 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.56__multipart_key1.2~ad-8jLrzq23zZv-ckqUKH487j5ZT2sb.4 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.56__shadow_key1.2~ad-8jLrzq23zZv-ckqUKH487j5ZT2sb.4_1 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.56__multipart_key1.2~ad-8jLrzq23zZv-ckqUKH487j5ZT2sb.5 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3927463391393627275', time=2024-09-12T20:15:28.694325+0000, chain.objs.size()=9 2024-09-12T18:16:13.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.57__multipart_key1.2~SnUqTBqAZeCN__P08PIAX7TWU_4MsAw.1 2024-09-12T18:16:13.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.57__shadow_key1.2~SnUqTBqAZeCN__P08PIAX7TWU_4MsAw.1_1 2024-09-12T18:16:13.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.031+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.57__multipart_key1.2~SnUqTBqAZeCN__P08PIAX7TWU_4MsAw.2 2024-09-12T18:16:13.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.039+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.57__shadow_key1.2~SnUqTBqAZeCN__P08PIAX7TWU_4MsAw.2_1 2024-09-12T18:16:13.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.039+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.57__multipart_key1.2~SnUqTBqAZeCN__P08PIAX7TWU_4MsAw.3 2024-09-12T18:16:13.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.039+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.57__shadow_key1.2~SnUqTBqAZeCN__P08PIAX7TWU_4MsAw.3_1 2024-09-12T18:16:13.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.039+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.57__multipart_key1.2~SnUqTBqAZeCN__P08PIAX7TWU_4MsAw.4 2024-09-12T18:16:13.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.039+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.57__shadow_key1.2~SnUqTBqAZeCN__P08PIAX7TWU_4MsAw.4_1 2024-09-12T18:16:13.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.039+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.57__multipart_key1.2~SnUqTBqAZeCN__P08PIAX7TWU_4MsAw.5 2024-09-12T18:16:13.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.047+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.051+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:16:13.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:16:13.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.854428182852903226', time=2024-09-12T20:11:39.075735+0000, chain.objs.size()=9 2024-09-12T18:16:13.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~asFFbZUhIuTxUiLr-anERzHT6BPD8jV.1 2024-09-12T18:16:13.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~asFFbZUhIuTxUiLr-anERzHT6BPD8jV.1_1 2024-09-12T18:16:13.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~asFFbZUhIuTxUiLr-anERzHT6BPD8jV.2 2024-09-12T18:16:13.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~asFFbZUhIuTxUiLr-anERzHT6BPD8jV.2_1 2024-09-12T18:16:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~asFFbZUhIuTxUiLr-anERzHT6BPD8jV.3 2024-09-12T18:16:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~asFFbZUhIuTxUiLr-anERzHT6BPD8jV.3_1 2024-09-12T18:16:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~asFFbZUhIuTxUiLr-anERzHT6BPD8jV.4 2024-09-12T18:16:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~asFFbZUhIuTxUiLr-anERzHT6BPD8jV.4_1 2024-09-12T18:16:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~asFFbZUhIuTxUiLr-anERzHT6BPD8jV.5 2024-09-12T18:16:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5855918186268127545', time=2024-09-12T20:12:39.155572+0000, chain.objs.size()=9 2024-09-12T18:16:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__multipart_file2.mpg.2~FzR9J7POVyNwvdR5QSKUgQ0HiwJJnt1.1 2024-09-12T18:16:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__shadow_file2.mpg.2~FzR9J7POVyNwvdR5QSKUgQ0HiwJJnt1.1_1 2024-09-12T18:16:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.055+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__multipart_file2.mpg.2~FzR9J7POVyNwvdR5QSKUgQ0HiwJJnt1.2 2024-09-12T18:16:13.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.063+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__shadow_file2.mpg.2~FzR9J7POVyNwvdR5QSKUgQ0HiwJJnt1.2_1 2024-09-12T18:16:13.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.063+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__multipart_file2.mpg.2~FzR9J7POVyNwvdR5QSKUgQ0HiwJJnt1.3 2024-09-12T18:16:13.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.063+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__shadow_file2.mpg.2~FzR9J7POVyNwvdR5QSKUgQ0HiwJJnt1.3_1 2024-09-12T18:16:13.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.063+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__multipart_file2.mpg.2~FzR9J7POVyNwvdR5QSKUgQ0HiwJJnt1.4 2024-09-12T18:16:13.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.067+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__shadow_file2.mpg.2~FzR9J7POVyNwvdR5QSKUgQ0HiwJJnt1.4_1 2024-09-12T18:16:13.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.067+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__multipart_file2.mpg.2~FzR9J7POVyNwvdR5QSKUgQ0HiwJJnt1.5 2024-09-12T18:16:13.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.067+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10481293074816493104', time=2024-09-12T20:15:49.571245+0000, chain.objs.size()=1 2024-09-12T18:16:13.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.067+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.61__shadow_.I_tQZMhC77pgmmhCpQjDMPIdl6yq3C2_0 2024-09-12T18:16:13.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.075+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.079+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:16:13.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.083+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.083+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:16:13.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9817840747892790105', time=2024-09-12T20:12:39.348337+0000, chain.objs.size()=1 2024-09-12T18:16:13.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__shadow_.AQBIFdb1oVqU2QH_XNwmJH0VC7LwOrN_0 2024-09-12T18:16:13.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10913738387151753005', time=2024-09-12T20:16:11.969508+0000, chain.objs.size()=21 2024-09-12T18:16:13.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__multipart_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.1 2024-09-12T18:16:13.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__shadow_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.1_1 2024-09-12T18:16:13.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__multipart_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.2 2024-09-12T18:16:13.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__shadow_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.2_1 2024-09-12T18:16:13.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__multipart_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.3 2024-09-12T18:16:13.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__shadow_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.3_1 2024-09-12T18:16:13.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__multipart_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.4 2024-09-12T18:16:13.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__shadow_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.4_1 2024-09-12T18:16:13.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__multipart_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.5 2024-09-12T18:16:13.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__shadow_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.5_1 2024-09-12T18:16:13.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.087+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__multipart_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.6 2024-09-12T18:16:13.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.091+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__shadow_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.6_1 2024-09-12T18:16:13.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.095+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__multipart_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.7 2024-09-12T18:16:13.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.095+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__shadow_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.7_1 2024-09-12T18:16:13.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.095+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__multipart_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.8 2024-09-12T18:16:13.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.095+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__shadow_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.8_1 2024-09-12T18:16:13.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.095+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__multipart_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.9 2024-09-12T18:16:13.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.095+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__shadow_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.9_1 2024-09-12T18:16:13.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.095+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__multipart_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.10 2024-09-12T18:16:13.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.095+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__shadow_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.10_1 2024-09-12T18:16:13.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.095+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.66__multipart_key1.2~zZaKXN5KWtx6yyOD0E8KESUXB6Ce2BD.11 2024-09-12T18:16:13.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.103+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.107+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:16:13.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:16:13.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~G6uefqX8jGHf7SlgK7OhVtvVKUWGfyg', time=2024-09-12T20:12:44.252517+0000, chain.objs.size()=5 2024-09-12T18:16:13.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.54__multipart_key1.2~G6uefqX8jGHf7SlgK7OhVtvVKUWGfyg.7 2024-09-12T18:16:13.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.54__shadow_key1.2~G6uefqX8jGHf7SlgK7OhVtvVKUWGfyg.7_1 2024-09-12T18:16:13.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.54__multipart_key1.2~G6uefqX8jGHf7SlgK7OhVtvVKUWGfyg.10 2024-09-12T18:16:13.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.54__shadow_key1.2~G6uefqX8jGHf7SlgK7OhVtvVKUWGfyg.10_1 2024-09-12T18:16:13.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.54__multipart_key1.2~G6uefqX8jGHf7SlgK7OhVtvVKUWGfyg.13 2024-09-12T18:16:13.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4403362074012723006', time=2024-09-12T20:15:10.112066+0000, chain.objs.size()=16 2024-09-12T18:16:13.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.1 2024-09-12T18:16:13.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.1_1 2024-09-12T18:16:13.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.1_2 2024-09-12T18:16:13.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.2 2024-09-12T18:16:13.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.2_1 2024-09-12T18:16:13.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.2_2 2024-09-12T18:16:13.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.111+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.3 2024-09-12T18:16:13.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.119+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.3_1 2024-09-12T18:16:13.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.119+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.3_2 2024-09-12T18:16:13.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.119+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.4 2024-09-12T18:16:13.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.119+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.4_1 2024-09-12T18:16:13.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.119+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.4_2 2024-09-12T18:16:13.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.119+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.5 2024-09-12T18:16:13.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.119+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.5_1 2024-09-12T18:16:13.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.119+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.5_2 2024-09-12T18:16:13.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.119+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pZBly0qkYP8vgLrSPPMij-mCg4vFHri.6 2024-09-12T18:16:13.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.131+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.135+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:16:13.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.139+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.139+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.139+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:16:13.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.139+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8924734851361210857', time=2024-09-12T20:11:53.430490+0000, chain.objs.size()=7 2024-09-12T18:16:13.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.139+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~_KszgW0rZMKELofuA9U_CQya5ZotoTM.1 2024-09-12T18:16:13.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.139+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~_KszgW0rZMKELofuA9U_CQya5ZotoTM.1_1 2024-09-12T18:16:13.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.139+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~_KszgW0rZMKELofuA9U_CQya5ZotoTM.1_2 2024-09-12T18:16:13.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.139+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~_KszgW0rZMKELofuA9U_CQya5ZotoTM.2 2024-09-12T18:16:13.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.139+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~_KszgW0rZMKELofuA9U_CQya5ZotoTM.2_1 2024-09-12T18:16:13.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.139+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~_KszgW0rZMKELofuA9U_CQya5ZotoTM.2_2 2024-09-12T18:16:13.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.139+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~_KszgW0rZMKELofuA9U_CQya5ZotoTM.3 2024-09-12T18:16:13.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.147+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.151+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:16:13.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.155+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.155+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:16:13.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13675079366923680232', time=2024-09-12T20:11:09.211695+0000, chain.objs.size()=9 2024-09-12T18:16:13.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.42__multipart_key1.2~6rmRC75zUGUfi_D8BpGcq5XTmS5o1iK.1 2024-09-12T18:16:13.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.42__shadow_key1.2~6rmRC75zUGUfi_D8BpGcq5XTmS5o1iK.1_1 2024-09-12T18:16:13.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.42__multipart_key1.2~6rmRC75zUGUfi_D8BpGcq5XTmS5o1iK.2 2024-09-12T18:16:13.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.42__shadow_key1.2~6rmRC75zUGUfi_D8BpGcq5XTmS5o1iK.2_1 2024-09-12T18:16:13.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.42__multipart_key1.2~6rmRC75zUGUfi_D8BpGcq5XTmS5o1iK.3 2024-09-12T18:16:13.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.42__shadow_key1.2~6rmRC75zUGUfi_D8BpGcq5XTmS5o1iK.3_1 2024-09-12T18:16:13.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.42__multipart_key1.2~6rmRC75zUGUfi_D8BpGcq5XTmS5o1iK.4 2024-09-12T18:16:13.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.42__shadow_key1.2~6rmRC75zUGUfi_D8BpGcq5XTmS5o1iK.4_1 2024-09-12T18:16:13.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.42__multipart_key1.2~6rmRC75zUGUfi_D8BpGcq5XTmS5o1iK.5 2024-09-12T18:16:13.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9604015250917225150', time=2024-09-12T20:11:44.962328+0000, chain.objs.size()=9 2024-09-12T18:16:13.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~uspK5ORL2yDAxDDnseC5fnRz4PNtVOe.1 2024-09-12T18:16:13.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~uspK5ORL2yDAxDDnseC5fnRz4PNtVOe.1_1 2024-09-12T18:16:13.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.159+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~uspK5ORL2yDAxDDnseC5fnRz4PNtVOe.2 2024-09-12T18:16:13.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.163+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~uspK5ORL2yDAxDDnseC5fnRz4PNtVOe.2_1 2024-09-12T18:16:13.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.163+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~uspK5ORL2yDAxDDnseC5fnRz4PNtVOe.3 2024-09-12T18:16:13.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~uspK5ORL2yDAxDDnseC5fnRz4PNtVOe.3_1 2024-09-12T18:16:13.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~uspK5ORL2yDAxDDnseC5fnRz4PNtVOe.4 2024-09-12T18:16:13.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~uspK5ORL2yDAxDDnseC5fnRz4PNtVOe.4_1 2024-09-12T18:16:13.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~uspK5ORL2yDAxDDnseC5fnRz4PNtVOe.5 2024-09-12T18:16:13.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW', time=2024-09-12T20:15:42.923280+0000, chain.objs.size()=1 2024-09-12T18:16:13.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.12 2024-09-12T18:16:13.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW', time=2024-09-12T20:15:42.999920+0000, chain.objs.size()=1 2024-09-12T18:16:13.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.16 2024-09-12T18:16:13.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW', time=2024-09-12T20:15:43.224694+0000, chain.objs.size()=1 2024-09-12T18:16:13.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.18 2024-09-12T18:16:13.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW', time=2024-09-12T20:15:43.571989+0000, chain.objs.size()=1 2024-09-12T18:16:13.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.167+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.20 2024-09-12T18:16:13.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.171+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW', time=2024-09-12T20:15:44.069621+0000, chain.objs.size()=47 2024-09-12T18:16:13.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.171+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.1 2024-09-12T18:16:13.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.171+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.2 2024-09-12T18:16:13.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.171+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.3 2024-09-12T18:16:13.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.175+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.4 2024-09-12T18:16:13.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.175+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.5 2024-09-12T18:16:13.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.175+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.6 2024-09-12T18:16:13.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.175+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.7 2024-09-12T18:16:13.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.175+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.8 2024-09-12T18:16:13.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.175+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.9 2024-09-12T18:16:13.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.175+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.10 2024-09-12T18:16:13.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.175+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.11 2024-09-12T18:16:13.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.175+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.IBzfwAGLgaw_anXp6c0bOKFBkCE6k2Nz.12 2024-09-12T18:16:13.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.175+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.13 2024-09-12T18:16:13.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.175+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.14 2024-09-12T18:16:13.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.179+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.15 2024-09-12T18:16:13.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.179+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.KZ1Zy__r-PppKsHCV_5QtcFDMqjBX9GN.16 2024-09-12T18:16:13.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.179+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.17 2024-09-12T18:16:13.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.179+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.dlryO8ZdGD-qgtEmMnJNoMoNjs0mh43X.18 2024-09-12T18:16:13.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.179+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.19 2024-09-12T18:16:13.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.179+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.mMyAygK5NU92u0t9a1RGWNAAOnCwLMz3.20 2024-09-12T18:16:13.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.179+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.21 2024-09-12T18:16:13.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.179+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.22 2024-09-12T18:16:13.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.179+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.23 2024-09-12T18:16:13.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.183+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.24 2024-09-12T18:16:13.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.183+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.25 2024-09-12T18:16:13.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.183+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.26 2024-09-12T18:16:13.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.183+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.27 2024-09-12T18:16:13.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.183+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.28 2024-09-12T18:16:13.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.183+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.29 2024-09-12T18:16:13.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.183+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.30 2024-09-12T18:16:13.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.183+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.31 2024-09-12T18:16:13.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.183+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.32 2024-09-12T18:16:13.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.187+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.33 2024-09-12T18:16:13.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.187+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.34 2024-09-12T18:16:13.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.187+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.35 2024-09-12T18:16:13.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.187+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.36 2024-09-12T18:16:13.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.187+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.37 2024-09-12T18:16:13.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.187+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.38 2024-09-12T18:16:13.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.187+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.39 2024-09-12T18:16:13.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.191+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.40 2024-09-12T18:16:13.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.191+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.41 2024-09-12T18:16:13.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.191+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.42 2024-09-12T18:16:13.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.191+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.43 2024-09-12T18:16:13.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.191+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.44 2024-09-12T18:16:13.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.191+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.45 2024-09-12T18:16:13.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.191+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.46 2024-09-12T18:16:13.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.195+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.58__multipart_key1.2~wBCt8XtqIcnleK-f8NJ2xcf9EExy4NW.47 2024-09-12T18:16:13.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.195+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.199+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:16:13.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:16:13.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9199976806138406835', time=2024-09-12T20:14:01.810222+0000, chain.objs.size()=21 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.1 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.1_1 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.2 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.2_1 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.3 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.3_1 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.4 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.4_1 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.5 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.5_1 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.6 2024-09-12T18:16:13.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.203+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.6_1 2024-09-12T18:16:13.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.7 2024-09-12T18:16:13.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.7_1 2024-09-12T18:16:13.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.8 2024-09-12T18:16:13.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.8_1 2024-09-12T18:16:13.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.9 2024-09-12T18:16:13.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.9_1 2024-09-12T18:16:13.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.10 2024-09-12T18:16:13.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.10_1 2024-09-12T18:16:13.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~0ihvmLUv2M7-nQLgOPslcz__tPR1F9c.11 2024-09-12T18:16:13.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14166328361306790182', time=2024-09-12T20:14:53.959362+0000, chain.objs.size()=16 2024-09-12T18:16:13.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.1 2024-09-12T18:16:13.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.1_1 2024-09-12T18:16:13.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.211+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.1_2 2024-09-12T18:16:13.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.215+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.2 2024-09-12T18:16:13.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.219+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.2_1 2024-09-12T18:16:13.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.219+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.2_2 2024-09-12T18:16:13.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.219+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.3 2024-09-12T18:16:13.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.219+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.3_1 2024-09-12T18:16:13.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.219+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.3_2 2024-09-12T18:16:13.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.219+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.4 2024-09-12T18:16:13.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.219+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.4_1 2024-09-12T18:16:13.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.219+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.4_2 2024-09-12T18:16:13.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.219+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.5 2024-09-12T18:16:13.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.219+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.5_1 2024-09-12T18:16:13.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.219+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.5_2 2024-09-12T18:16:13.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.227+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~32exK14WWlV9DmPvI87kLN5Y2JQ_QmG.6 2024-09-12T18:16:13.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.231+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.235+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:16:13.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.239+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.239+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.239+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.243+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:16:13.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.243+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.243+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.243+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.247+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:16:13.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.251+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.251+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.251+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:16:13.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.251+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3646129059435917779', time=2024-09-12T20:12:39.251906+0000, chain.objs.size()=1 2024-09-12T18:16:13.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.251+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__shadow_.kgEJBOwB2rPmGNqhkZs2ikEEp5SLiXz_0 2024-09-12T18:16:13.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.251+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15022864464031961807', time=2024-09-12T20:15:48.718178+0000, chain.objs.size()=1 2024-09-12T18:16:13.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.251+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.60__shadow_.pyYXoZW5N1ObTcmJcqqrq1HBhYAcZ_B_0 2024-09-12T18:16:13.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.255+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.259+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:16:13.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.259+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.263+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.263+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.263+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:16:13.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.267+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.267+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.267+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.271+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:16:13.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.271+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:16:13.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.927223433800515867', time=2024-09-12T20:11:58.776721+0000, chain.objs.size()=6 2024-09-12T18:16:13.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.46__shadow_.hXu2lNNIBA3kXxyQ3dH9L0WxehR3d6L_0 2024-09-12T18:16:13.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.46__shadow_.hXu2lNNIBA3kXxyQ3dH9L0WxehR3d6L_1 2024-09-12T18:16:13.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.46__shadow_.hXu2lNNIBA3kXxyQ3dH9L0WxehR3d6L_2 2024-09-12T18:16:13.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.46__shadow_.hXu2lNNIBA3kXxyQ3dH9L0WxehR3d6L_3 2024-09-12T18:16:13.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.46__shadow_.hXu2lNNIBA3kXxyQ3dH9L0WxehR3d6L_4 2024-09-12T18:16:13.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.46__shadow_.hXu2lNNIBA3kXxyQ3dH9L0WxehR3d6L_5 2024-09-12T18:16:13.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.909719868429687226', time=2024-09-12T20:11:59.247711+0000, chain.objs.size()=7 2024-09-12T18:16:13.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~I_KI88RKqPop8fEtzma3Frn9wSh8KzA.1 2024-09-12T18:16:13.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~I_KI88RKqPop8fEtzma3Frn9wSh8KzA.1_1 2024-09-12T18:16:13.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~I_KI88RKqPop8fEtzma3Frn9wSh8KzA.1_2 2024-09-12T18:16:13.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~I_KI88RKqPop8fEtzma3Frn9wSh8KzA.2 2024-09-12T18:16:13.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~I_KI88RKqPop8fEtzma3Frn9wSh8KzA.2_1 2024-09-12T18:16:13.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.275+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~I_KI88RKqPop8fEtzma3Frn9wSh8KzA.2_2 2024-09-12T18:16:13.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.283+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~I_KI88RKqPop8fEtzma3Frn9wSh8KzA.3 2024-09-12T18:16:13.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.283+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5775884791485742807', time=2024-09-12T20:12:09.971879+0000, chain.objs.size()=9 2024-09-12T18:16:13.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.283+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.51__multipart_key1.2~vb98iFDSAncy2U1Og1idicOQoqW54C_.1 2024-09-12T18:16:13.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.283+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.51__shadow_key1.2~vb98iFDSAncy2U1Og1idicOQoqW54C_.1_1 2024-09-12T18:16:13.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.51__multipart_key1.2~vb98iFDSAncy2U1Og1idicOQoqW54C_.2 2024-09-12T18:16:13.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.51__shadow_key1.2~vb98iFDSAncy2U1Og1idicOQoqW54C_.2_1 2024-09-12T18:16:13.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.51__multipart_key1.2~vb98iFDSAncy2U1Og1idicOQoqW54C_.3 2024-09-12T18:16:13.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.51__shadow_key1.2~vb98iFDSAncy2U1Og1idicOQoqW54C_.3_1 2024-09-12T18:16:13.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.51__multipart_key1.2~vb98iFDSAncy2U1Og1idicOQoqW54C_.4 2024-09-12T18:16:13.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.51__shadow_key1.2~vb98iFDSAncy2U1Og1idicOQoqW54C_.4_1 2024-09-12T18:16:13.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.51__multipart_key1.2~vb98iFDSAncy2U1Og1idicOQoqW54C_.5 2024-09-12T18:16:13.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14890982866289406605', time=2024-09-12T20:12:21.850394+0000, chain.objs.size()=9 2024-09-12T18:16:13.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.52__multipart_key1.2~yPB8UyKkGMtcKiEEqHPIStHvWT_KqDo.1 2024-09-12T18:16:13.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.52__shadow_key1.2~yPB8UyKkGMtcKiEEqHPIStHvWT_KqDo.1_1 2024-09-12T18:16:13.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.52__multipart_key1.2~yPB8UyKkGMtcKiEEqHPIStHvWT_KqDo.2 2024-09-12T18:16:13.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.287+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.52__shadow_key1.2~yPB8UyKkGMtcKiEEqHPIStHvWT_KqDo.2_1 2024-09-12T18:16:13.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.291+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.52__multipart_key1.2~yPB8UyKkGMtcKiEEqHPIStHvWT_KqDo.3 2024-09-12T18:16:13.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.291+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.52__shadow_key1.2~yPB8UyKkGMtcKiEEqHPIStHvWT_KqDo.3_1 2024-09-12T18:16:13.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.291+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.52__multipart_key1.2~yPB8UyKkGMtcKiEEqHPIStHvWT_KqDo.4 2024-09-12T18:16:13.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.291+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.52__shadow_key1.2~yPB8UyKkGMtcKiEEqHPIStHvWT_KqDo.4_1 2024-09-12T18:16:13.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.291+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.52__multipart_key1.2~yPB8UyKkGMtcKiEEqHPIStHvWT_KqDo.5 2024-09-12T18:16:13.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.291+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14615299121276484496', time=2024-09-12T20:15:47.840490+0000, chain.objs.size()=1 2024-09-12T18:16:13.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.291+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.59__shadow_.XsIYa1DWrZ0PKMMVC4qwCWxmV7OZz1H_0 2024-09-12T18:16:13.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.303+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.307+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:16:13.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.307+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.307+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:16:13.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~AGG7vXQ2_GhIFYysLrwNzy8ruB3jSPa', time=2024-09-12T20:10:46.768340+0000, chain.objs.size()=9 2024-09-12T18:16:13.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.40__multipart_key1.2~AGG7vXQ2_GhIFYysLrwNzy8ruB3jSPa.1 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.40__shadow_key1.2~AGG7vXQ2_GhIFYysLrwNzy8ruB3jSPa.1_1 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.40__multipart_key1.2~AGG7vXQ2_GhIFYysLrwNzy8ruB3jSPa.2 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.40__shadow_key1.2~AGG7vXQ2_GhIFYysLrwNzy8ruB3jSPa.2_1 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.40__multipart_key1.2~AGG7vXQ2_GhIFYysLrwNzy8ruB3jSPa.3 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.40__shadow_key1.2~AGG7vXQ2_GhIFYysLrwNzy8ruB3jSPa.3_1 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.40__multipart_key1.2~AGG7vXQ2_GhIFYysLrwNzy8ruB3jSPa.4 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.40__shadow_key1.2~AGG7vXQ2_GhIFYysLrwNzy8ruB3jSPa.4_1 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.40__multipart_key1.2~AGG7vXQ2_GhIFYysLrwNzy8ruB3jSPa.5 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13025462322406789104', time=2024-09-12T20:15:10.426626+0000, chain.objs.size()=16 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.1 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.1_1 2024-09-12T18:16:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.311+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.1_2 2024-09-12T18:16:13.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.315+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.2 2024-09-12T18:16:13.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.315+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.2_1 2024-09-12T18:16:13.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.315+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.2_2 2024-09-12T18:16:13.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.315+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.3 2024-09-12T18:16:13.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.315+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.3_1 2024-09-12T18:16:13.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.315+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.3_2 2024-09-12T18:16:13.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.319+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.4 2024-09-12T18:16:13.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.319+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.4_1 2024-09-12T18:16:13.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.319+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.4_2 2024-09-12T18:16:13.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.319+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.5 2024-09-12T18:16:13.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.319+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.5_1 2024-09-12T18:16:13.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.323+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.5_2 2024-09-12T18:16:13.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.323+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~aEGJtsaSDj8KCW6lAIVg5wKVCZgv7X2.6 2024-09-12T18:16:13.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.327+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.335+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:16:13.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.335+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:16:13.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8412413285441730846', time=2024-09-12T20:11:19.490165+0000, chain.objs.size()=9 2024-09-12T18:16:13.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__multipart_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.1 2024-09-12T18:16:13.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__shadow_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.1_1 2024-09-12T18:16:13.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__multipart_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.2 2024-09-12T18:16:13.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__shadow_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.2_1 2024-09-12T18:16:13.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__multipart_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.3 2024-09-12T18:16:13.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__shadow_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.3_1 2024-09-12T18:16:13.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__multipart_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.4 2024-09-12T18:16:13.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__shadow_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.4_1 2024-09-12T18:16:13.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.339+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__multipart_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.5 2024-09-12T18:16:13.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.343+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.347+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:16:13.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.351+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.351+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.351+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:16:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.351+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14223604880619878433', time=2024-09-12T20:11:19.969033+0000, chain.objs.size()=9 2024-09-12T18:16:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.351+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__multipart_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.1 2024-09-12T18:16:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.351+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__shadow_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.1_1 2024-09-12T18:16:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.351+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__multipart_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.2 2024-09-12T18:16:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.351+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__shadow_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.2_1 2024-09-12T18:16:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.351+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__multipart_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.3 2024-09-12T18:16:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.351+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__shadow_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.3_1 2024-09-12T18:16:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.351+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__multipart_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.4 2024-09-12T18:16:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.355+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__shadow_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.4_1 2024-09-12T18:16:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.355+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44__multipart_key1.2~QKbkrQv-_zSQ0MlhPfULMMAacMkf9P6.5 2024-09-12T18:16:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.355+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16057045875901042608', time=2024-09-12T20:14:36.830737+0000, chain.objs.size()=19 2024-09-12T18:16:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.355+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.1 2024-09-12T18:16:13.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.355+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.1_1 2024-09-12T18:16:13.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.355+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.2 2024-09-12T18:16:13.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.359+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.2_1 2024-09-12T18:16:13.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.359+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.3 2024-09-12T18:16:13.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.359+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.3_1 2024-09-12T18:16:13.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.359+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.4 2024-09-12T18:16:13.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.359+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.4_1 2024-09-12T18:16:13.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.359+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.5 2024-09-12T18:16:13.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.359+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.5_1 2024-09-12T18:16:13.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.359+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.6 2024-09-12T18:16:13.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.359+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.6_1 2024-09-12T18:16:13.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.359+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.7 2024-09-12T18:16:13.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.359+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.7_1 2024-09-12T18:16:13.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.363+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.8 2024-09-12T18:16:13.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.367+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.8_1 2024-09-12T18:16:13.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.367+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.9 2024-09-12T18:16:13.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.367+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.9_1 2024-09-12T18:16:13.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.371+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~n5B7-EXIjxrW3K6ThMuDDyVs4ZH_G3H.10 2024-09-12T18:16:13.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.375+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.379+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:16:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:16:13.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18167112666661414985', time=2024-09-12T20:11:49.102241+0000, chain.objs.size()=9 2024-09-12T18:16:13.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~HmKTKhyJg-8g9t0m0k0pWjAoE1Saua5.1 2024-09-12T18:16:13.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~HmKTKhyJg-8g9t0m0k0pWjAoE1Saua5.1_1 2024-09-12T18:16:13.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~HmKTKhyJg-8g9t0m0k0pWjAoE1Saua5.2 2024-09-12T18:16:13.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~HmKTKhyJg-8g9t0m0k0pWjAoE1Saua5.2_1 2024-09-12T18:16:13.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~HmKTKhyJg-8g9t0m0k0pWjAoE1Saua5.3 2024-09-12T18:16:13.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~HmKTKhyJg-8g9t0m0k0pWjAoE1Saua5.3_1 2024-09-12T18:16:13.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~HmKTKhyJg-8g9t0m0k0pWjAoE1Saua5.4 2024-09-12T18:16:13.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~HmKTKhyJg-8g9t0m0k0pWjAoE1Saua5.4_1 2024-09-12T18:16:13.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.383+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~HmKTKhyJg-8g9t0m0k0pWjAoE1Saua5.5 2024-09-12T18:16:13.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.387+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.391+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:16:13.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.395+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.395+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.395+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.399+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:16:13.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.399+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.403+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.403+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.403+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:16:13.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.407+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.407+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.407+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.407+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:16:13.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.411+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.415+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.415+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:16:13.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.415+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16406482440166120023', time=2024-09-12T20:12:39.074349+0000, chain.objs.size()=1 2024-09-12T18:16:13.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.415+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__shadow_.mNnKQnX6iIs-Zt19OVJCNMxXcl2UvFU_0 2024-09-12T18:16:13.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.415+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.419+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:16:13.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.423+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.423+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.427+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.427+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:16:13.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.431+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.431+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.431+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:16:13.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.431+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8586923688456652121', time=2024-09-12T20:15:50.464021+0000, chain.objs.size()=1 2024-09-12T18:16:13.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.431+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.62__shadow_.IhZ2qtByh-m782XlCKKGA0xK9VwQ1YV_0 2024-09-12T18:16:13.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.435+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.439+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:16:13.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.443+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.443+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.443+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:16:13.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.443+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10256148566812557145', time=2024-09-12T20:11:58.424701+0000, chain.objs.size()=7 2024-09-12T18:16:13.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.443+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~CyL5tscJOOdFhTdQpkC0amYrgmxAd2d.1 2024-09-12T18:16:13.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.443+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~CyL5tscJOOdFhTdQpkC0amYrgmxAd2d.1_1 2024-09-12T18:16:13.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.443+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~CyL5tscJOOdFhTdQpkC0amYrgmxAd2d.1_2 2024-09-12T18:16:13.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.443+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~CyL5tscJOOdFhTdQpkC0amYrgmxAd2d.2 2024-09-12T18:16:13.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.443+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~CyL5tscJOOdFhTdQpkC0amYrgmxAd2d.2_1 2024-09-12T18:16:13.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.443+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__shadow_key1.2~CyL5tscJOOdFhTdQpkC0amYrgmxAd2d.2_2 2024-09-12T18:16:13.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.443+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.47__multipart_key1.2~CyL5tscJOOdFhTdQpkC0amYrgmxAd2d.3 2024-09-12T18:16:13.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.451+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.455+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:16:13.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.455+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.459+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.459+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:16:13.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.459+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10355238487623457404', time=2024-09-12T20:15:52.296357+0000, chain.objs.size()=1 2024-09-12T18:16:13.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.459+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.64__shadow_.N1IWoHtTsKsJZmeuekuB90yBwlgGAsm_0 2024-09-12T18:16:13.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.459+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.463+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:16:13.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.467+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.467+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.471+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.471+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:16:13.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.475+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.475+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:16:13.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5184480825589550896', time=2024-09-12T20:14:18.693528+0000, chain.objs.size()=21 2024-09-12T18:16:13.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.1 2024-09-12T18:16:13.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.1_1 2024-09-12T18:16:13.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.2 2024-09-12T18:16:13.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.2_1 2024-09-12T18:16:13.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.3 2024-09-12T18:16:13.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.3_1 2024-09-12T18:16:13.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.4 2024-09-12T18:16:13.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.4_1 2024-09-12T18:16:13.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.5 2024-09-12T18:16:13.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.5_1 2024-09-12T18:16:13.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.6 2024-09-12T18:16:13.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.479+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.6_1 2024-09-12T18:16:13.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.483+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.7 2024-09-12T18:16:13.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.483+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.7_1 2024-09-12T18:16:13.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.487+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.8 2024-09-12T18:16:13.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.487+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.8_1 2024-09-12T18:16:13.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.487+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.9 2024-09-12T18:16:13.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.487+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.9_1 2024-09-12T18:16:13.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.487+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.10 2024-09-12T18:16:13.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.487+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__shadow_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.10_1 2024-09-12T18:16:13.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.487+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.55__multipart_key1.2~pUvcYDILkvVpeBDCMXYfVC7GKYsLmbG.11 2024-09-12T18:16:13.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.495+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.503+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:16:13.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.503+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.507+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.507+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.507+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:16:13.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.511+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.511+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11271989912491821774', time=2024-09-12T20:12:38.975087+0000, chain.objs.size()=9 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__multipart_file.mpg.2~PFOEWDZVnRUYtXqdvrtguEGPTrGq1Rg.1 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__shadow_file.mpg.2~PFOEWDZVnRUYtXqdvrtguEGPTrGq1Rg.1_1 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__multipart_file.mpg.2~PFOEWDZVnRUYtXqdvrtguEGPTrGq1Rg.2 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__shadow_file.mpg.2~PFOEWDZVnRUYtXqdvrtguEGPTrGq1Rg.2_1 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__multipart_file.mpg.2~PFOEWDZVnRUYtXqdvrtguEGPTrGq1Rg.3 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__shadow_file.mpg.2~PFOEWDZVnRUYtXqdvrtguEGPTrGq1Rg.3_1 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__multipart_file.mpg.2~PFOEWDZVnRUYtXqdvrtguEGPTrGq1Rg.4 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__shadow_file.mpg.2~PFOEWDZVnRUYtXqdvrtguEGPTrGq1Rg.4_1 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53__multipart_file.mpg.2~PFOEWDZVnRUYtXqdvrtguEGPTrGq1Rg.5 2024-09-12T18:16:13.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15824991579029132317', time=2024-09-12T20:15:18.689018+0000, chain.objs.size()=1 2024-09-12T18:16:13.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.515+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.56__shadow_.AWqYcbzinHCN2ld6QRNXN43cPUAsIqw_0 2024-09-12T18:16:13.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.519+0000 7faf2737d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:13.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.527+0000 7faf2737d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:16:13.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.531+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.531+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:13.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.531+0000 7faf2737d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:13.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.535+0000 7faddafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:13.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.539+0000 7faf2737d9c0 20 remove_watcher() i=0 2024-09-12T18:16:13.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.539+0000 7faf2737d9c0 2 removed watcher, disabling cache 2024-09-12T18:16:13.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.543+0000 7faf2737d9c0 20 remove_watcher() i=1 2024-09-12T18:16:13.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.547+0000 7faf2737d9c0 20 remove_watcher() i=2 2024-09-12T18:16:13.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.547+0000 7faf2737d9c0 20 remove_watcher() i=3 2024-09-12T18:16:13.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.551+0000 7faf2737d9c0 20 remove_watcher() i=4 2024-09-12T18:16:13.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.551+0000 7faf2737d9c0 20 remove_watcher() i=5 2024-09-12T18:16:13.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.555+0000 7faf2737d9c0 20 remove_watcher() i=6 2024-09-12T18:16:13.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.555+0000 7faf2737d9c0 20 remove_watcher() i=7 2024-09-12T18:16:13.578 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:16:13.652 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:16:13.652 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:16:13.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.699+0000 7f85ce9c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:13.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.699+0000 7f85ce9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:13.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.699+0000 7f85ce9c39c0 20 realm 2024-09-12T18:16:13.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.699+0000 7f85ce9c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:13.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.699+0000 7f85ce9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:13.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.699+0000 7f85ce9c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:16:13.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.699+0000 7f85ce9c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:13.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.699+0000 7f85ce9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:13.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.699+0000 7f85ce9c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:13.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.703+0000 7f85ce9c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:13.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.703+0000 7f85ce9c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:13.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.703+0000 7f85ce9c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:16:13.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.703+0000 7f85ce9c39c0 20 searching for the correct realm 2024-09-12T18:16:13.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.707+0000 7f85c3fff640 0 -- 172.21.15.157:0/1897149568 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f85b401c040 msgr2=0x7f85b4063a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:16:13.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:13.923+0000 7f85cc4c9640 0 -- 172.21.15.157:0/1897149568 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f85b407e960 msgr2=0x7f85b406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:16:14.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.139+0000 7f85ce9c39c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:16:14.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.139+0000 7f85ce9c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:16:14.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.139+0000 7f85ce9c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:16:14.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.139+0000 7f85ce9c39c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:16:14.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.139+0000 7f85ce9c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:16:14.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.139+0000 7f85ce9c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:16:14.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.139+0000 7f85ce9c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:14.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:14.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:14.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:14.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:14.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:16:14.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 zone default found 2024-09-12T18:16:14.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 4 Realm: () 2024-09-12T18:16:14.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:16:14.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:16:14.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:16:14.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 zonegroup default 2024-09-12T18:16:14.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:14.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:14.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:14.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:14.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.143+0000 7f85ce9c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:14.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.147+0000 7f85ce9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:14.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.147+0000 7f85ce9c39c0 20 started sync module instance, tier type = 2024-09-12T18:16:14.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.147+0000 7f85ce9c39c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:16:14.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.167+0000 7f85ce9c39c0 20 add_watcher() i=0 2024-09-12T18:16:14.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.167+0000 7f85ce9c39c0 20 add_watcher() i=1 2024-09-12T18:16:14.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.167+0000 7f85ce9c39c0 20 add_watcher() i=2 2024-09-12T18:16:14.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.167+0000 7f85ce9c39c0 20 add_watcher() i=3 2024-09-12T18:16:14.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.167+0000 7f85ce9c39c0 20 add_watcher() i=4 2024-09-12T18:16:14.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.167+0000 7f85ce9c39c0 20 add_watcher() i=5 2024-09-12T18:16:14.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.167+0000 7f85ce9c39c0 20 add_watcher() i=6 2024-09-12T18:16:14.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.171+0000 7f85ce9c39c0 20 add_watcher() i=7 2024-09-12T18:16:14.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.171+0000 7f85ce9c39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:16:14.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.175+0000 7f84837de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:14.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.175+0000 7f85ce9c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:16:14.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.175+0000 7f85ce9c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:16:14.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.263+0000 7f84827dc640 20 reqs_thread_entry: start 2024-09-12T18:16:14.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.267+0000 7f85ce9c39c0 20 init_complete bucket index max shards: 1 2024-09-12T18:16:14.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.267+0000 7f85ce9c39c0 20 Filter name: none 2024-09-12T18:16:14.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.267+0000 7f847b7fe640 20 reqs_thread_entry: start 2024-09-12T18:16:14.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.267+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:16:14.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.271+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.271+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.271+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.275+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:16:14.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.279+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.279+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.279+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.283+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:16:14.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.283+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.287+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.287+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.287+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:16:14.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.291+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.291+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.291+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.295+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:16:14.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.299+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.299+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.299+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.303+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:16:14.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.307+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.307+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.307+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.311+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:16:14.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.315+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.315+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.319+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.319+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:16:14.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.323+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.323+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.323+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.327+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:16:14.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.331+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.331+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.331+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.335+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:16:14.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.339+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.339+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.339+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.339+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:16:14.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.343+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.347+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.347+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.347+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:16:14.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.351+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.355+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.355+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.355+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:16:14.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.359+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.363+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.363+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.367+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:16:14.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.367+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.367+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.371+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.371+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:16:14.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.375+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.375+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.375+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.379+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:16:14.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.383+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.383+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.383+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.387+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:16:14.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.391+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.391+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.391+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.395+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:16:14.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.399+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.403+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.403+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.407+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:16:14.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.411+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.411+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.411+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.415+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:16:14.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.419+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.419+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.419+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.423+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.427+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.427+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.427+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.431+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.435+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.435+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.435+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.439+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.443+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.447+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.447+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.447+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.451+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.455+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.455+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.459+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.459+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.463+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.463+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.467+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.471+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.471+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.471+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.475+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.479+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.479+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.479+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.483+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.487+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.491+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.491+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.495+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.495+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.499+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.499+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.503+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.503+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.507+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.507+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.507+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.511+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.515+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.515+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.519+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.523+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.523+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:14.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.523+0000 7f85ce9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:14.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.527+0000 7f84837de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:14.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.535+0000 7f85ce9c39c0 20 remove_watcher() i=0 2024-09-12T18:16:14.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.535+0000 7f85ce9c39c0 2 removed watcher, disabling cache 2024-09-12T18:16:14.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.535+0000 7f85ce9c39c0 20 remove_watcher() i=1 2024-09-12T18:16:14.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.539+0000 7f85ce9c39c0 20 remove_watcher() i=2 2024-09-12T18:16:14.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.539+0000 7f85ce9c39c0 20 remove_watcher() i=3 2024-09-12T18:16:14.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.543+0000 7f85ce9c39c0 20 remove_watcher() i=4 2024-09-12T18:16:14.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.543+0000 7f85ce9c39c0 20 remove_watcher() i=5 2024-09-12T18:16:14.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.547+0000 7f85ce9c39c0 20 remove_watcher() i=6 2024-09-12T18:16:14.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.547+0000 7f85ce9c39c0 20 remove_watcher() i=7 2024-09-12T18:16:14.567 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:16:14.642 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:16:14.642 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:16:14.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.687+0000 7f0a43b849c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:14.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.691+0000 7f0a43b849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:14.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.691+0000 7f0a43b849c0 20 realm 2024-09-12T18:16:14.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.691+0000 7f0a43b849c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:14.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.691+0000 7f0a43b849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:14.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.691+0000 7f0a43b849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:16:14.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.691+0000 7f0a43b849c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:14.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.691+0000 7f0a43b849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:14.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.691+0000 7f0a43b849c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:14.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.695+0000 7f0a43b849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:14.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.695+0000 7f0a43b849c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:14.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.695+0000 7f0a43b849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:16:14.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.695+0000 7f0a43b849c0 20 searching for the correct realm 2024-09-12T18:16:14.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.699+0000 7f0a40e89640 0 -- 172.21.15.157:0/504007791 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f0a2c0f1070 msgr2=0x7f0a2c0ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:16:14.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:14.915+0000 7f0a4168a640 0 -- 172.21.15.157:0/504007791 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f0a2c0dd040 msgr2=0x7f0a2c0ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:16:15.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.131+0000 7f0a43b849c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:16:15.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.131+0000 7f0a43b849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:16:15.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.131+0000 7f0a43b849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:16:15.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.131+0000 7f0a43b849c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:16:15.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.131+0000 7f0a43b849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:16:15.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.131+0000 7f0a43b849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:16:15.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.131+0000 7f0a43b849c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.131+0000 7f0a43b849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:15.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.131+0000 7f0a43b849c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:15.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:16:15.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 zone default found 2024-09-12T18:16:15.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 4 Realm: () 2024-09-12T18:16:15.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:16:15.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:16:15.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:16:15.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 zonegroup default 2024-09-12T18:16:15.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:15.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:15.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:15.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 started sync module instance, tier type = 2024-09-12T18:16:15.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.135+0000 7f0a43b849c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:16:15.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.163+0000 7f0a43b849c0 20 add_watcher() i=0 2024-09-12T18:16:15.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.163+0000 7f0a43b849c0 20 add_watcher() i=1 2024-09-12T18:16:15.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.163+0000 7f0a43b849c0 20 add_watcher() i=2 2024-09-12T18:16:15.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.163+0000 7f0a43b849c0 20 add_watcher() i=3 2024-09-12T18:16:15.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.163+0000 7f0a43b849c0 20 add_watcher() i=4 2024-09-12T18:16:15.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.163+0000 7f0a43b849c0 20 add_watcher() i=5 2024-09-12T18:16:15.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.163+0000 7f0a43b849c0 20 add_watcher() i=6 2024-09-12T18:16:15.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.163+0000 7f0a43b849c0 20 add_watcher() i=7 2024-09-12T18:16:15.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.163+0000 7f0a43b849c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:16:15.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.171+0000 7f08f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:15.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.171+0000 7f0a43b849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:16:15.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.171+0000 7f0a43b849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:16:15.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.267+0000 7f08f67e4640 20 reqs_thread_entry: start 2024-09-12T18:16:15.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.267+0000 7f0a43b849c0 20 init_complete bucket index max shards: 1 2024-09-12T18:16:15.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.267+0000 7f0a43b849c0 20 Filter name: none 2024-09-12T18:16:15.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.267+0000 7f0867fff640 20 reqs_thread_entry: start 2024-09-12T18:16:15.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.267+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:16:15.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.267+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.271+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.271+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.271+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:16:15.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.275+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.275+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.275+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.279+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:16:15.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.283+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.283+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.283+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.287+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:16:15.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.291+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.291+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.291+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.295+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:16:15.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.299+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.299+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.299+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.303+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:16:15.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.303+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.307+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.307+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.307+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:16:15.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.311+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.311+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.311+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.311+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:16:15.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.315+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.319+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.319+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.319+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:16:15.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.323+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.323+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.323+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.323+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:16:15.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.327+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.327+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.327+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.331+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:16:15.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.335+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.335+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.335+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.335+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:16:15.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.339+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.343+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.343+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.347+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:16:15.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.347+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.351+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.351+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.351+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:16:15.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.355+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.355+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.355+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.359+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:16:15.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.359+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.363+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.363+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.363+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:16:15.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.367+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.367+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.367+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.371+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:16:15.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.375+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.375+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.379+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.379+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:16:15.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.383+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.387+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.387+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.391+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:16:15.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.395+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.395+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.395+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.399+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:16:15.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.399+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.403+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.403+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.407+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:16:15.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.407+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.411+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.411+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.411+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:16:15.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.415+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.415+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.415+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.419+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:16:15.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.419+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.423+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.423+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.427+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:16:15.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.431+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.431+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.431+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.435+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:16:15.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.439+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.439+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.439+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.443+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:16:15.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.447+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.451+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.451+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.455+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:16:15.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.459+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.459+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.459+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.463+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:16:15.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.467+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.471+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.471+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.471+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:16:15.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.475+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.479+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.479+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.483+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:16:15.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.487+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.487+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.487+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.491+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:16:15.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.495+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.495+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.495+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.499+0000 7f0a43b849c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:16:15.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.503+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.503+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.507+0000 7f0a43b849c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.511+0000 7f08f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:15.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.515+0000 7f0a43b849c0 20 remove_watcher() i=0 2024-09-12T18:16:15.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.515+0000 7f0a43b849c0 2 removed watcher, disabling cache 2024-09-12T18:16:15.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.519+0000 7f0a43b849c0 20 remove_watcher() i=1 2024-09-12T18:16:15.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.523+0000 7f0a43b849c0 20 remove_watcher() i=2 2024-09-12T18:16:15.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.523+0000 7f0a43b849c0 20 remove_watcher() i=3 2024-09-12T18:16:15.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.527+0000 7f0a43b849c0 20 remove_watcher() i=4 2024-09-12T18:16:15.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.527+0000 7f0a43b849c0 20 remove_watcher() i=5 2024-09-12T18:16:15.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.531+0000 7f0a43b849c0 20 remove_watcher() i=6 2024-09-12T18:16:15.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.531+0000 7f0a43b849c0 20 remove_watcher() i=7 2024-09-12T18:16:15.552 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:16:15.625 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:16:15.625 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:16:15.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.671+0000 7f6b1c9759c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.671+0000 7f6b1c9759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:15.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.671+0000 7f6b1c9759c0 20 realm 2024-09-12T18:16:15.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.671+0000 7f6b1c9759c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.671+0000 7f6b1c9759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:15.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.671+0000 7f6b1c9759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:16:15.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.671+0000 7f6b1c9759c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.671+0000 7f6b1c9759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:15.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.671+0000 7f6b1c9759c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.675+0000 7f6b1c9759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:15.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.675+0000 7f6b1c9759c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.675+0000 7f6b1c9759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:16:15.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.675+0000 7f6b1c9759c0 20 searching for the correct realm 2024-09-12T18:16:15.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.679+0000 7f6b1ac7c640 0 -- 172.21.15.157:0/3211629629 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x55f303f4fbc0 msgr2=0x55f303f52080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:16:15.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.687+0000 7f6b1a47b640 0 -- 172.21.15.157:0/3211629629 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f6b0406eb80 msgr2=0x7f6b0406d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:16:15.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:16:15.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:16:15.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:16:15.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:16:15.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:16:15.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:16:15.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:15.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:15.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:16:15.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 zone default found 2024-09-12T18:16:15.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 4 Realm: () 2024-09-12T18:16:15.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:16:15.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:16:15.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:16:15.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 zonegroup default 2024-09-12T18:16:15.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:15.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.695+0000 7f6b1c9759c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.699+0000 7f6b1c9759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:15.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.699+0000 7f6b1c9759c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:15.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.699+0000 7f6b1c9759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:15.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.699+0000 7f6b1c9759c0 20 started sync module instance, tier type = 2024-09-12T18:16:15.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.699+0000 7f6b1c9759c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:16:15.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.715+0000 7f6b1c9759c0 20 add_watcher() i=0 2024-09-12T18:16:15.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.715+0000 7f6b1c9759c0 20 add_watcher() i=1 2024-09-12T18:16:15.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.715+0000 7f6b1c9759c0 20 add_watcher() i=2 2024-09-12T18:16:15.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.715+0000 7f6b1c9759c0 20 add_watcher() i=3 2024-09-12T18:16:15.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.715+0000 7f6b1c9759c0 20 add_watcher() i=4 2024-09-12T18:16:15.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.715+0000 7f6b1c9759c0 20 add_watcher() i=5 2024-09-12T18:16:15.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.715+0000 7f6b1c9759c0 20 add_watcher() i=6 2024-09-12T18:16:15.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.715+0000 7f6b1c9759c0 20 add_watcher() i=7 2024-09-12T18:16:15.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.715+0000 7f6b1c9759c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:16:15.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.719+0000 7f69d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:15.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.719+0000 7f6b1c9759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:16:15.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.719+0000 7f6b1c9759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:16:15.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.795+0000 7f694b7fe640 20 reqs_thread_entry: start 2024-09-12T18:16:15.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.795+0000 7f6b1c9759c0 20 init_complete bucket index max shards: 1 2024-09-12T18:16:15.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.795+0000 7f6b1c9759c0 20 Filter name: none 2024-09-12T18:16:15.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.795+0000 7f69497fa640 20 reqs_thread_entry: start 2024-09-12T18:16:15.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.795+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:16:15.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.799+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.803+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.803+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.807+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:16:15.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.807+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.811+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.811+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.811+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:16:15.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.815+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.815+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.819+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.819+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:16:15.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.823+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.823+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.827+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.827+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:16:15.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.831+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.835+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.835+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.835+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:16:15.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.839+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.843+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.843+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.843+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:16:15.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.847+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.847+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.851+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.851+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:16:15.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.855+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.855+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.855+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.859+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:16:15.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.859+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.859+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.863+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.863+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:16:15.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.867+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.867+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.867+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.871+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:16:15.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.875+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.875+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.875+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.879+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:16:15.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.879+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.883+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.883+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.883+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:16:15.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.887+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.887+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.887+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.891+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:16:15.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.895+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.895+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.895+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.895+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:16:15.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.899+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.903+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.903+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.903+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:16:15.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.907+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.911+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.911+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.915+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:16:15.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.915+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.919+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.919+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.919+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:16:15.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.923+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.927+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.927+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.931+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:16:15.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.935+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.935+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.935+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.939+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:16:15.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.943+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.943+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.943+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.947+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:16:15.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.951+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.951+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.951+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.955+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:16:15.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.959+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.963+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.963+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.963+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:16:15.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.967+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.971+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.971+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.971+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:16:15.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.975+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.979+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.979+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.983+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:16:15.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.987+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.987+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.987+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.991+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:16:15.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.991+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.995+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:15.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.995+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:15.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:15.995+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:16:16.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.003+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.003+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:16.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.007+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.007+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:16:16.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.011+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.011+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:16.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.011+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.015+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:16:16.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.019+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.019+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:16.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.023+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.023+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:16:16.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.027+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.027+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:16.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.031+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.031+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:16:16.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.035+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.039+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:16.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.039+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.043+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:16:16.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.047+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.047+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:16.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.047+0000 7f6b1c9759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:16.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.051+0000 7f69d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:16.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.059+0000 7f6b1c9759c0 20 remove_watcher() i=0 2024-09-12T18:16:16.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.059+0000 7f6b1c9759c0 2 removed watcher, disabling cache 2024-09-12T18:16:16.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.059+0000 7f6b1c9759c0 20 remove_watcher() i=1 2024-09-12T18:16:16.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.063+0000 7f6b1c9759c0 20 remove_watcher() i=2 2024-09-12T18:16:16.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.063+0000 7f6b1c9759c0 20 remove_watcher() i=3 2024-09-12T18:16:16.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.067+0000 7f6b1c9759c0 20 remove_watcher() i=4 2024-09-12T18:16:16.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.071+0000 7f6b1c9759c0 20 remove_watcher() i=5 2024-09-12T18:16:16.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.071+0000 7f6b1c9759c0 20 remove_watcher() i=6 2024-09-12T18:16:16.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:16.075+0000 7f6b1c9759c0 20 remove_watcher() i=7 2024-09-12T18:16:16.094 DEBUG:teuthology.orchestra.run.smithi157:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T18:16:16.813 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :clean 2024-09-12T18:16:17.710 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :compileJava 2024-09-12T18:16:17.710 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :processResources 2024-09-12T18:16:17.711 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :classes 2024-09-12T18:16:18.210 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:18.210 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :compileTestJava 2024-09-12T18:16:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:16:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:16:18.212 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:18.212 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:16:18.212 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :testClasses 2024-09-12T18:16:20.211 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:20.211 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :test 2024-09-12T18:16:20.211 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:20.211 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T18:16:20.211 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12 18:16:19,797 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:16:20.211 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:20.212 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T18:16:20.212 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:20.212 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T18:16:20.510 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:20.510 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T18:16:20.511 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:20.511 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T18:16:21.010 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:21.010 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T18:16:21.110 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T18:16:21.610 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:21.610 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T18:16:21.910 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:21.910 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T18:16:22.010 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:22.010 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T18:16:22.310 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:22.310 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T18:16:22.810 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:22.810 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T18:16:22.910 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:22.910 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T18:16:23.111 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:23.111 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T18:16:23.410 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:23.410 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T18:16:24.310 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:24.310 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T18:16:24.510 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:24.510 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T18:16:24.910 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:24.910 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T18:16:25.010 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:25.010 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T18:16:25.187 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:25.187 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------- 2024-09-12T18:16:25.188 INFO:teuthology.orchestra.run.smithi157.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T18:16:25.188 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------- 2024-09-12T18:16:25.188 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:25.188 INFO:teuthology.orchestra.run.smithi157.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:16:25.188 INFO:teuthology.orchestra.run.smithi157.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:16:25.188 INFO:teuthology.orchestra.run.smithi157.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:16:25.188 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:25.188 INFO:teuthology.orchestra.run.smithi157.stdout:BUILD SUCCESSFUL in 8s 2024-09-12T18:16:25.188 INFO:teuthology.orchestra.run.smithi157.stdout:5 actionable tasks: 5 executed 2024-09-12T18:16:25.197 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:16:25.223 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:16:25.223 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:16:25.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.262+0000 7f8af9ca59c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:25.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:25.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 20 realm 2024-09-12T18:16:25.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:25.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:25.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:16:25.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:25.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:25.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:25.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:25.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:25.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:16:25.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.266+0000 7f8af9ca59c0 20 searching for the correct realm 2024-09-12T18:16:25.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.274+0000 7f8af7fac640 0 -- 172.21.15.157:0/1544151175 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x557ce7e0b440 msgr2=0x557ce7e0d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:16:25.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.278+0000 7f8af77ab640 0 -- 172.21.15.157:0/1544151175 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f8ae00666e0 msgr2=0x7f8ae0090710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:16:25.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:16:25.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:16:25.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:16:25.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:16:25.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:16:25.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:16:25.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:25.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:25.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:25.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:25.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:25.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:16:25.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 zone default found 2024-09-12T18:16:25.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 4 Realm: () 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 zonegroup default 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.286+0000 7f8af9ca59c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.290+0000 7f8af9ca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.290+0000 7f8af9ca59c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.290+0000 7f8af9ca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.290+0000 7f8af9ca59c0 20 started sync module instance, tier type = 2024-09-12T18:16:25.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.290+0000 7f8af9ca59c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:16:25.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.306+0000 7f8af9ca59c0 20 add_watcher() i=0 2024-09-12T18:16:25.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.306+0000 7f8af9ca59c0 20 add_watcher() i=1 2024-09-12T18:16:25.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.306+0000 7f8af9ca59c0 20 add_watcher() i=2 2024-09-12T18:16:25.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.306+0000 7f8af9ca59c0 20 add_watcher() i=3 2024-09-12T18:16:25.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.306+0000 7f8af9ca59c0 20 add_watcher() i=4 2024-09-12T18:16:25.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.306+0000 7f8af9ca59c0 20 add_watcher() i=5 2024-09-12T18:16:25.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.306+0000 7f8af9ca59c0 20 add_watcher() i=6 2024-09-12T18:16:25.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.306+0000 7f8af9ca59c0 20 add_watcher() i=7 2024-09-12T18:16:25.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.306+0000 7f8af9ca59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:16:25.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.310+0000 7f89adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:25.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.310+0000 7f8af9ca59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:16:25.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.310+0000 7f8af9ca59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:16:25.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.378+0000 7f89acfe1640 20 reqs_thread_entry: start 2024-09-12T18:16:25.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.378+0000 7f8af9ca59c0 20 init_complete bucket index max shards: 1 2024-09-12T18:16:25.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.378+0000 7f8af9ca59c0 20 Filter name: none 2024-09-12T18:16:25.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.378+0000 7f89267fc640 20 reqs_thread_entry: start 2024-09-12T18:16:25.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.378+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:16:25.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.382+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.382+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.382+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.382+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:16:25.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.386+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.386+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.390+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.390+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:16:25.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.394+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.394+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.394+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.394+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:16:25.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.398+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.398+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.398+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.398+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:16:25.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.402+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.402+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.406+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.406+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:16:25.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.410+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.410+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.410+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.410+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:16:25.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.414+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.414+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.414+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.418+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:16:25.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.418+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.422+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.422+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.422+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:16:25.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.426+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.426+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.430+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.430+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:16:25.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.434+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.434+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.434+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.438+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:16:25.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.442+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.442+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.442+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.446+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:16:25.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.446+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.446+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.450+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.450+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:16:25.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.454+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.454+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.454+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.458+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:16:25.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.462+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.462+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.462+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.466+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:16:25.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.470+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.470+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.474+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.474+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:16:25.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.478+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.478+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.478+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.482+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:16:25.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.486+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.486+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.486+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.490+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:16:25.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.494+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.494+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.494+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.498+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:16:25.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.498+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.498+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.502+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:16:25.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.502+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15985825264628206688', time=2024-09-12T20:16:22.488869+0000, chain.objs.size()=1 2024-09-12T18:16:25.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.502+0000 7f8af9ca59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.71__shadow_.F3Fo-v7hr6vZykpAbyRSuKG-QQqJDwR_0 2024-09-12T18:16:25.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.502+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16740870300515855676', time=2024-09-12T20:16:23.945703+0000, chain.objs.size()=1 2024-09-12T18:16:25.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.502+0000 7f8af9ca59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.72__shadow_.UuG-ScIx-2vJ0UwxGErIYN04Qs14lmZ_0 2024-09-12T18:16:25.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.502+0000 7f8af9ca59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:16:25.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.506+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:16:25.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.510+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.514+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.514+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.518+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:16:25.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.522+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.522+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.522+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.526+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:16:25.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.530+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.530+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.534+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.538+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:16:25.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.538+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.542+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.542+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.546+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:16:25.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.550+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.550+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.550+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.554+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:16:25.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.558+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.558+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.562+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.562+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:16:25.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.566+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.570+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.570+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.574+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:16:25.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.578+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.578+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.578+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.582+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:16:25.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.586+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.586+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.586+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.590+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:16:25.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.594+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.594+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.594+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.598+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:16:25.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.602+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.602+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.606+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.606+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:16:25.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.610+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.614+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.614+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.614+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:16:25.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.618+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.622+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:25.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.622+0000 7f8af9ca59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:25.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.626+0000 7f89adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:25.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.630+0000 7f8af9ca59c0 20 remove_watcher() i=0 2024-09-12T18:16:25.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.630+0000 7f8af9ca59c0 2 removed watcher, disabling cache 2024-09-12T18:16:25.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.634+0000 7f8af9ca59c0 20 remove_watcher() i=1 2024-09-12T18:16:25.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.638+0000 7f8af9ca59c0 20 remove_watcher() i=2 2024-09-12T18:16:25.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.638+0000 7f8af9ca59c0 20 remove_watcher() i=3 2024-09-12T18:16:25.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.642+0000 7f8af9ca59c0 20 remove_watcher() i=4 2024-09-12T18:16:25.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.646+0000 7f8af9ca59c0 20 remove_watcher() i=5 2024-09-12T18:16:25.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.646+0000 7f8af9ca59c0 20 remove_watcher() i=6 2024-09-12T18:16:25.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.650+0000 7f8af9ca59c0 20 remove_watcher() i=7 2024-09-12T18:16:25.672 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:16:25.745 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:16:25.745 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:16:25.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.974+0000 7f34e8a88640 0 --2- 172.21.15.157:0/3743254997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a3d9b76c0 0x556a3db33780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:16:25.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.998+0000 7f34eaf829c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.998+0000 7f34eaf829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.998+0000 7f34eaf829c0 20 realm 2024-09-12T18:16:26.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:25.998+0000 7f34eaf829c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.002+0000 7f34eaf829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.002+0000 7f34eaf829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:16:26.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.002+0000 7f34eaf829c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.002+0000 7f34eaf829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.002+0000 7f34eaf829c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.002+0000 7f34eaf829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:26.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.002+0000 7f34eaf829c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.002+0000 7f34eaf829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:16:26.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.002+0000 7f34eaf829c0 20 searching for the correct realm 2024-09-12T18:16:26.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.006+0000 7f34e8287640 0 -- 172.21.15.157:0/3662049736 >> [v2:172.21.15.157:6800/2182114182,v1:172.21.15.157:6801/2182114182] conn(0x556a3dc142b0 msgr2=0x556a3dc166a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:16:26.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.014+0000 7f34e8a88640 0 -- 172.21.15.157:0/3662049736 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f34d80d0040 msgr2=0x7f34d80d0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:16:26.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:16:26.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:16:26.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:16:26.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:16:26.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:16:26.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:16:26.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:26.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:16:26.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 zone default found 2024-09-12T18:16:26.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 4 Realm: () 2024-09-12T18:16:26.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:16:26.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:16:26.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:16:26.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 zonegroup default 2024-09-12T18:16:26.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.022+0000 7f34eaf829c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.026+0000 7f34eaf829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.026+0000 7f34eaf829c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.026+0000 7f34eaf829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.026+0000 7f34eaf829c0 20 started sync module instance, tier type = 2024-09-12T18:16:26.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.026+0000 7f34eaf829c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:16:26.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.042+0000 7f34eaf829c0 20 add_watcher() i=0 2024-09-12T18:16:26.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.042+0000 7f34eaf829c0 20 add_watcher() i=1 2024-09-12T18:16:26.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.042+0000 7f34eaf829c0 20 add_watcher() i=2 2024-09-12T18:16:26.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.042+0000 7f34eaf829c0 20 add_watcher() i=3 2024-09-12T18:16:26.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.042+0000 7f34eaf829c0 20 add_watcher() i=4 2024-09-12T18:16:26.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.042+0000 7f34eaf829c0 20 add_watcher() i=5 2024-09-12T18:16:26.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.042+0000 7f34eaf829c0 20 add_watcher() i=6 2024-09-12T18:16:26.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.042+0000 7f34eaf829c0 20 add_watcher() i=7 2024-09-12T18:16:26.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.042+0000 7f34eaf829c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:16:26.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.046+0000 7f339efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:26.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.046+0000 7f34eaf829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:16:26.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.046+0000 7f34eaf829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:16:26.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.126+0000 7f339dfe3640 20 reqs_thread_entry: start 2024-09-12T18:16:26.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.126+0000 7f34eaf829c0 20 init_complete bucket index max shards: 1 2024-09-12T18:16:26.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.126+0000 7f34eaf829c0 20 Filter name: none 2024-09-12T18:16:26.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.126+0000 7f330f7fe640 20 reqs_thread_entry: start 2024-09-12T18:16:26.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.126+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:16:26.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.130+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.134+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.134+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.138+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:16:26.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.138+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.138+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.142+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.142+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:16:26.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.146+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.146+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.146+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.150+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:16:26.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.150+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.154+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.154+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.154+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:16:26.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.158+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.158+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.162+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.162+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:16:26.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.166+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.170+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.170+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.174+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:16:26.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.174+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.174+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.178+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.178+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:16:26.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.182+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.182+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.186+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.190+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:16:26.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.194+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.194+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.194+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.198+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:16:26.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.202+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.202+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.202+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.206+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:16:26.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.210+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.210+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.210+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.214+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:16:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.214+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.218+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.218+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.222+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:16:26.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.226+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.226+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.226+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.230+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:16:26.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.234+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.234+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.234+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.238+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:16:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.242+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.242+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.242+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.246+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:16:26.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.246+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.250+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.250+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.250+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:16:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.254+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.254+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.258+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.258+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:16:26.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.262+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.262+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.262+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.266+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:16:26.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.270+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.270+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.270+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.274+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:16:26.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.278+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.278+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.278+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.282+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:16:26.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.286+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.286+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.290+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.290+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:16:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.294+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.294+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.298+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.298+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:16:26.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.302+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.302+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.306+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.306+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:16:26.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.310+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.314+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.314+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.314+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:16:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.318+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.322+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.322+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.326+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:16:26.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.330+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.330+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.330+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.334+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:16:26.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.338+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.338+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.342+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.342+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:16:26.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.346+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.346+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.350+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.354+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:16:26.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.358+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.358+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.358+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.362+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:16:26.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.366+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.366+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.366+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.370+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:16:26.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.374+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.374+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.374+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.378+0000 7f34eaf829c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:16:26.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.382+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.386+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.386+0000 7f34eaf829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.390+0000 7f339efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:26.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.394+0000 7f34eaf829c0 20 remove_watcher() i=0 2024-09-12T18:16:26.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.394+0000 7f34eaf829c0 2 removed watcher, disabling cache 2024-09-12T18:16:26.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.398+0000 7f34eaf829c0 20 remove_watcher() i=1 2024-09-12T18:16:26.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.402+0000 7f34eaf829c0 20 remove_watcher() i=2 2024-09-12T18:16:26.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.402+0000 7f34eaf829c0 20 remove_watcher() i=3 2024-09-12T18:16:26.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.406+0000 7f34eaf829c0 20 remove_watcher() i=4 2024-09-12T18:16:26.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.406+0000 7f34eaf829c0 20 remove_watcher() i=5 2024-09-12T18:16:26.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.410+0000 7f34eaf829c0 20 remove_watcher() i=6 2024-09-12T18:16:26.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.410+0000 7f34eaf829c0 20 remove_watcher() i=7 2024-09-12T18:16:26.433 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:16:26.504 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:16:26.505 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:16:26.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.550+0000 7f15420749c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.550+0000 7f15420749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.550+0000 7f15420749c0 20 realm 2024-09-12T18:16:26.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.550+0000 7f15420749c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.550+0000 7f15420749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.550+0000 7f15420749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:16:26.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.550+0000 7f15420749c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.550+0000 7f15420749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.550+0000 7f15420749c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.554+0000 7f15420749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:26.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.554+0000 7f15420749c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.554+0000 7f15420749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:16:26.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.554+0000 7f15420749c0 20 searching for the correct realm 2024-09-12T18:16:26.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.558+0000 7f154037b640 0 -- 172.21.15.157:0/3059777196 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x561edba1f2d0 msgr2=0x561edba21790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:16:26.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.566+0000 7f153fb7a640 0 -- 172.21.15.157:0/3059777196 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f1528049400 msgr2=0x7f1528049880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:16:26.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:16:26.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:16:26.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:16:26.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:16:26.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:16:26.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:16:26.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:26.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:16:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 zone default found 2024-09-12T18:16:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 4 Realm: () 2024-09-12T18:16:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:16:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:16:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:16:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 zonegroup default 2024-09-12T18:16:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.786+0000 7f15420749c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.790+0000 7f15420749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.790+0000 7f15420749c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:26.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.790+0000 7f15420749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:26.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.790+0000 7f15420749c0 20 started sync module instance, tier type = 2024-09-12T18:16:26.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.790+0000 7f15420749c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:16:26.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.814+0000 7f15420749c0 20 add_watcher() i=0 2024-09-12T18:16:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.814+0000 7f15420749c0 20 add_watcher() i=1 2024-09-12T18:16:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.814+0000 7f15420749c0 20 add_watcher() i=2 2024-09-12T18:16:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.814+0000 7f15420749c0 20 add_watcher() i=3 2024-09-12T18:16:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.814+0000 7f15420749c0 20 add_watcher() i=4 2024-09-12T18:16:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.814+0000 7f15420749c0 20 add_watcher() i=5 2024-09-12T18:16:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.814+0000 7f15420749c0 20 add_watcher() i=6 2024-09-12T18:16:26.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.814+0000 7f15420749c0 20 add_watcher() i=7 2024-09-12T18:16:26.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.814+0000 7f15420749c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:16:26.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.818+0000 7f13f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:26.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.822+0000 7f15420749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:16:26.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.822+0000 7f15420749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:16:26.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.914+0000 7f13f57e2640 20 reqs_thread_entry: start 2024-09-12T18:16:26.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.914+0000 7f15420749c0 20 init_complete bucket index max shards: 1 2024-09-12T18:16:26.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.914+0000 7f15420749c0 20 Filter name: none 2024-09-12T18:16:26.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.914+0000 7f13ee7fc640 20 reqs_thread_entry: start 2024-09-12T18:16:26.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.914+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:16:26.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.918+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.918+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.918+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.918+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:16:26.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.922+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.922+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.922+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.926+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:16:26.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.930+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.930+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.930+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.934+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:16:26.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.934+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.938+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.938+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.942+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:16:26.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.946+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.946+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.946+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.946+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:16:26.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.950+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.954+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.954+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.958+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:16:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.958+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.962+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.962+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.962+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:16:26.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.966+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.966+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.970+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.970+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:16:26.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.974+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.978+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.978+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.982+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:16:26.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.986+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.986+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.986+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.990+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:16:26.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.994+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.994+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:26.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.994+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:26.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.998+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:16:27.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:26.998+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.002+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.002+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.006+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:16:27.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.006+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.010+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.010+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.010+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:16:27.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.014+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.018+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.018+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.022+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:16:27.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.022+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.026+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.026+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.030+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:16:27.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.030+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.034+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.034+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.038+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:16:27.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.042+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.042+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.042+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.046+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:16:27.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.050+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.050+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.050+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.054+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:16:27.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.058+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.058+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.058+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.062+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:16:27.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.066+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.066+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.066+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.070+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:16:27.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.074+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.074+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.074+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.074+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:16:27.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.078+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.082+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.082+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.082+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:16:27.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.086+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.086+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.086+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.090+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:16:27.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.094+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.094+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.094+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.098+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:16:27.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.102+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.102+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.102+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.106+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:16:27.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.110+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.110+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.110+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.114+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:16:27.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.118+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.118+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.118+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.122+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:16:27.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.126+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.126+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.126+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.130+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:16:27.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.134+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.134+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.134+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.138+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:16:27.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.142+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.142+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.146+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.146+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:16:27.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.150+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.150+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.150+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.154+0000 7f15420749c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:16:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.158+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.158+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.158+0000 7f15420749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.166+0000 7f13f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:27.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.170+0000 7f15420749c0 20 remove_watcher() i=0 2024-09-12T18:16:27.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.170+0000 7f15420749c0 2 removed watcher, disabling cache 2024-09-12T18:16:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.174+0000 7f15420749c0 20 remove_watcher() i=1 2024-09-12T18:16:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.174+0000 7f15420749c0 20 remove_watcher() i=2 2024-09-12T18:16:27.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.178+0000 7f15420749c0 20 remove_watcher() i=3 2024-09-12T18:16:27.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.178+0000 7f15420749c0 20 remove_watcher() i=4 2024-09-12T18:16:27.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.182+0000 7f15420749c0 20 remove_watcher() i=5 2024-09-12T18:16:27.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.182+0000 7f15420749c0 20 remove_watcher() i=6 2024-09-12T18:16:27.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.186+0000 7f15420749c0 20 remove_watcher() i=7 2024-09-12T18:16:27.202 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:16:27.281 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:16:27.281 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:16:27.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.326+0000 7fa2a91f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:27.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.326+0000 7fa2a91f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:27.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.326+0000 7fa2a91f89c0 20 realm 2024-09-12T18:16:27.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.326+0000 7fa2a91f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:27.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.326+0000 7fa2a91f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:27.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.326+0000 7fa2a91f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:16:27.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.326+0000 7fa2a91f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:27.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.326+0000 7fa2a91f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:27.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.326+0000 7fa2a91f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:27.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.330+0000 7fa2a91f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:27.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.330+0000 7fa2a91f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:27.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.330+0000 7fa2a91f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:16:27.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.330+0000 7fa2a91f89c0 20 searching for the correct realm 2024-09-12T18:16:27.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.334+0000 7fa2a64fd640 0 -- 172.21.15.157:0/1319325186 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x560c6cda2c00 msgr2=0x7fa29c0631c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:16:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.550+0000 7fa2a6cfe640 0 -- 172.21.15.157:0/1319325186 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fa29c089120 msgr2=0x7fa29c090190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:16:27.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.766+0000 7fa2a91f89c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:16:27.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.766+0000 7fa2a91f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:16:27.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.766+0000 7fa2a91f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:16:27.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.766+0000 7fa2a91f89c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:16:27.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.766+0000 7fa2a91f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:16:27.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.766+0000 7fa2a91f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:16:27.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.766+0000 7fa2a91f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:27.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:27.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:27.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:16:27.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:27.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:16:27.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 zone default found 2024-09-12T18:16:27.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 4 Realm: () 2024-09-12T18:16:27.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:16:27.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:16:27.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:16:27.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 zonegroup default 2024-09-12T18:16:27.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:27.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:27.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:27.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:27.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:16:27.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:16:27.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 started sync module instance, tier type = 2024-09-12T18:16:27.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.770+0000 7fa2a91f89c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:16:27.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.794+0000 7fa2a91f89c0 20 add_watcher() i=0 2024-09-12T18:16:27.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.794+0000 7fa2a91f89c0 20 add_watcher() i=1 2024-09-12T18:16:27.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.794+0000 7fa2a91f89c0 20 add_watcher() i=2 2024-09-12T18:16:27.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.794+0000 7fa2a91f89c0 20 add_watcher() i=3 2024-09-12T18:16:27.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.794+0000 7fa2a91f89c0 20 add_watcher() i=4 2024-09-12T18:16:27.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.794+0000 7fa2a91f89c0 20 add_watcher() i=5 2024-09-12T18:16:27.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.794+0000 7fa2a91f89c0 20 add_watcher() i=6 2024-09-12T18:16:27.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.798+0000 7fa2a91f89c0 20 add_watcher() i=7 2024-09-12T18:16:27.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.798+0000 7fa2a91f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:16:27.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.802+0000 7fa15d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:27.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.802+0000 7fa2a91f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:16:27.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.802+0000 7fa2a91f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:16:27.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.894+0000 7fa0d7fff640 20 reqs_thread_entry: start 2024-09-12T18:16:27.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.894+0000 7fa2a91f89c0 20 init_complete bucket index max shards: 1 2024-09-12T18:16:27.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.894+0000 7fa2a91f89c0 20 Filter name: none 2024-09-12T18:16:27.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.894+0000 7fa0d5ffb640 20 reqs_thread_entry: start 2024-09-12T18:16:27.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.894+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:16:27.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.898+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.898+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.898+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.902+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:16:27.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.902+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.906+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.906+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.910+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:16:27.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.914+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.914+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.914+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.918+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:16:27.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.922+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.922+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.922+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.926+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:16:27.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.930+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.930+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.930+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.930+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:16:27.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.934+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.938+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.938+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.938+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:16:27.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.942+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.946+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.946+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.946+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:16:27.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.950+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.950+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.954+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.954+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:16:27.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.958+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.962+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.962+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.966+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:16:27.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.966+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.970+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.970+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.974+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:16:27.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.978+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.978+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.978+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.982+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:16:27.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.982+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.986+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.986+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.990+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:16:27.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.994+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.994+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.994+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:27.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.998+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:16:28.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:27.998+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.002+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.002+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.002+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:16:28.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.006+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.010+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.010+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.014+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:16:28.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.014+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.018+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.018+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.018+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:16:28.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.022+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.022+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.026+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.026+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:16:28.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.030+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.034+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.034+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.034+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:16:28.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.038+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.042+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.042+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.046+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:16:28.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.050+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.050+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.050+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.054+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:16:28.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.058+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.058+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.058+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.062+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:16:28.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.062+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.066+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.066+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.070+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:16:28.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.070+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.074+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.074+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.078+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:16:28.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.082+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.082+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.086+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.086+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:16:28.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.090+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.094+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.094+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.098+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:16:28.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.102+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.102+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.102+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.106+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:16:28.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.110+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.110+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.110+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.114+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:16:28.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.118+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.118+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.118+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.122+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:16:28.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.126+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.126+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.126+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.130+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:16:28.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.134+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.134+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.138+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.138+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:16:28.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.142+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.146+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.146+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.146+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:16:28.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.150+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.150+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:16:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.154+0000 7fa2a91f89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:16:28.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.158+0000 7fa15d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:16:28.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.162+0000 7fa2a91f89c0 20 remove_watcher() i=0 2024-09-12T18:16:28.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.162+0000 7fa2a91f89c0 2 removed watcher, disabling cache 2024-09-12T18:16:28.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.166+0000 7fa2a91f89c0 20 remove_watcher() i=1 2024-09-12T18:16:28.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.166+0000 7fa2a91f89c0 20 remove_watcher() i=2 2024-09-12T18:16:28.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.170+0000 7fa2a91f89c0 20 remove_watcher() i=3 2024-09-12T18:16:28.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.170+0000 7fa2a91f89c0 20 remove_watcher() i=4 2024-09-12T18:16:28.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.174+0000 7fa2a91f89c0 20 remove_watcher() i=5 2024-09-12T18:16:28.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.174+0000 7fa2a91f89c0 20 remove_watcher() i=6 2024-09-12T18:16:28.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:16:28.178+0000 7fa2a91f89c0 20 remove_watcher() i=7 2024-09-12T18:16:28.200 DEBUG:teuthology.orchestra.run.smithi157:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T18:16:28.911 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :clean 2024-09-12T18:16:29.608 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :compileJava 2024-09-12T18:16:29.608 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :processResources 2024-09-12T18:16:29.608 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :classes 2024-09-12T18:16:30.108 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:30.108 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :compileTestJava 2024-09-12T18:16:30.109 INFO:teuthology.orchestra.run.smithi157.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:16:30.109 INFO:teuthology.orchestra.run.smithi157.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:16:30.109 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:30.110 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:16:30.110 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :testClasses 2024-09-12T18:16:32.108 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:32.108 INFO:teuthology.orchestra.run.smithi157.stdout:> Task :test 2024-09-12T18:16:32.108 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:32.109 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests STANDARD_OUT 2024-09-12T18:16:32.110 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12 18:16:31,464 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:16:32.110 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:32.110 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T18:16:32.110 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:32.110 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T18:16:32.708 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:32.708 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T18:16:32.808 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:32.808 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T18:16:33.408 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:33.408 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T18:16:33.508 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:33.508 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T18:16:34.008 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:34.008 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T18:16:37.608 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:37.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T18:16:38.008 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:38.008 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T18:16:38.208 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:38.208 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T18:16:38.608 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:38.608 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T18:16:39.008 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:39.008 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T18:16:39.608 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:39.608 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T18:16:39.608 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:39.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T18:16:39.708 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:39.708 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T18:16:39.908 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:39.908 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T18:16:40.308 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:40.308 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T18:16:42.308 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:42.308 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T18:16:42.908 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:42.908 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T18:16:43.008 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:43.008 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T18:16:43.508 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:43.508 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T18:16:43.808 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:43.808 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T18:16:44.308 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:44.308 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T18:16:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:44.508 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T18:16:44.908 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:44.908 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T18:16:45.108 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:45.108 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T18:16:45.508 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:45.508 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T18:16:45.708 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:45.708 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T18:16:46.208 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:46.208 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T18:16:46.308 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T18:16:46.808 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:46.808 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T18:16:47.208 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:47.208 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T18:16:47.608 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:47.608 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T18:16:51.408 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:51.408 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T18:16:52.408 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:16:52.408 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T18:17:42.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:42.910 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T18:17:43.808 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:43.808 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T18:17:43.908 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:43.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T18:17:44.408 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:44.408 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T18:17:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:44.608 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T18:17:45.408 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:45.409 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T18:17:48.808 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:48.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T18:17:49.308 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:49.308 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T18:17:49.408 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:49.409 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T18:17:49.508 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:49.508 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T18:17:54.209 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:54.209 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T18:17:54.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:54.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests STANDARD_OUT 2024-09-12T18:17:54.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12 18:17:54,893 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T18:17:55.008 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12 18:17:54,909 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T18:17:55.208 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:17:55.208 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T18:18:10.609 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:18:10.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T18:18:11.408 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:18:11.409 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T18:18:14.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:18:14.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T18:18:15.409 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:18:15.409 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T18:18:35.209 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:18:35.209 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T18:18:35.709 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:18:35.709 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T18:18:40.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:18:40.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T18:18:41.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:18:41.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T18:18:53.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:18:53.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T18:18:54.308 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:18:54.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T18:18:56.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:18:56.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T18:19:06.709 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:06.709 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T18:19:07.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:07.910 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T18:19:08.009 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:08.009 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T18:19:08.109 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:08.109 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T18:19:08.709 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:08.709 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T18:19:08.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:08.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T18:19:09.308 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:09.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T18:19:09.509 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:09.509 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T18:19:09.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:09.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T18:19:10.109 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:10.109 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T18:19:10.609 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:10.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T18:19:10.709 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:10.709 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T18:19:11.209 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T18:19:11.409 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:11.409 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T18:19:12.009 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:12.009 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T18:19:12.509 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:12.509 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T18:19:13.209 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:13.209 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T18:19:13.709 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:13.709 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T18:19:14.509 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:14.509 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T18:19:15.009 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:15.009 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T18:19:15.709 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:15.709 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T18:19:16.209 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:16.209 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T18:19:16.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:16.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T18:19:17.409 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:17.409 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T18:19:18.208 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:18.209 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T18:19:18.609 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:18.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T18:19:19.409 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:19.409 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T18:19:19.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:19.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T18:19:20.609 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:20.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T18:19:21.109 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:21.109 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T18:19:21.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:21.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T18:19:22.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:22.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T18:19:23.109 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:23.109 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T18:19:23.609 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:23.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T18:19:24.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:24.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T18:19:24.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:24.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T18:19:25.509 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:25.509 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T18:19:25.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:25.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T18:19:26.609 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:26.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T18:19:27.009 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:27.009 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T18:19:27.609 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:27.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T18:19:28.209 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:28.209 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T18:19:28.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:28.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T18:19:29.409 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:29.409 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T18:19:30.109 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:30.109 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T18:19:30.609 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:30.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T18:19:31.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:31.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T18:19:31.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:31.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T18:19:32.612 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:32.612 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T18:19:33.109 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:33.109 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T18:19:33.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:33.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T18:19:34.209 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:34.209 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T18:19:34.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:34.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T18:19:35.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:35.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T18:19:35.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:35.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T18:19:36.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:36.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T18:19:37.009 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:37.009 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T18:19:37.409 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:37.409 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T18:19:38.109 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:38.109 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T18:19:38.209 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:38.209 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T18:19:38.709 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:38.709 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T18:19:38.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:38.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T18:19:39.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:39.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T18:19:39.609 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:39.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T18:19:40.009 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:40.009 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T18:19:40.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:40.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T18:19:40.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:40.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T18:19:41.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:41.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T18:19:41.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:41.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T18:19:41.810 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:41.810 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T18:19:42.009 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:42.009 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T18:19:42.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:42.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T18:19:42.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:42.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T18:19:43.109 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:43.109 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T18:19:43.609 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:43.609 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T18:19:43.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:43.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T18:19:44.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:44.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T18:19:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:44.509 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T18:19:44.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:44.909 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T18:19:48.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:48.309 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T18:19:48.809 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:48.809 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T18:19:52.409 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:52.409 INFO:teuthology.orchestra.run.smithi157.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T18:19:53.005 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:53.005 INFO:teuthology.orchestra.run.smithi157.stdout:---------------------------------------------------------------------- 2024-09-12T18:19:53.005 INFO:teuthology.orchestra.run.smithi157.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T18:19:53.005 INFO:teuthology.orchestra.run.smithi157.stdout:---------------------------------------------------------------------- 2024-09-12T18:19:53.005 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:53.005 INFO:teuthology.orchestra.run.smithi157.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:19:53.005 INFO:teuthology.orchestra.run.smithi157.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:19:53.005 INFO:teuthology.orchestra.run.smithi157.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:19:53.005 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:53.006 INFO:teuthology.orchestra.run.smithi157.stdout:BUILD SUCCESSFUL in 3m 24s 2024-09-12T18:19:53.006 INFO:teuthology.orchestra.run.smithi157.stdout:5 actionable tasks: 5 executed 2024-09-12T18:19:53.015 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:19:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:53.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.082+0000 7fc9796879c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:53.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.082+0000 7fc9796879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:53.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.082+0000 7fc9796879c0 20 realm 2024-09-12T18:19:53.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.082+0000 7fc9796879c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:53.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.086+0000 7fc9796879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:53.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.086+0000 7fc9796879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:53.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.086+0000 7fc9796879c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:53.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.086+0000 7fc9796879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:53.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.086+0000 7fc9796879c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:53.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.086+0000 7fc9796879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:53.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.086+0000 7fc9796879c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:53.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.086+0000 7fc9796879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:53.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.086+0000 7fc9796879c0 20 searching for the correct realm 2024-09-12T18:19:53.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.094+0000 7fc97798e640 0 -- 172.21.15.157:0/662462701 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fc96c0ab430 msgr2=0x7fc96c0ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:53.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.310+0000 7fc97718d640 0 -- 172.21.15.157:0/662462701 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x55696ffd1000 msgr2=0x55696ffd3430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.318+0000 7fc9796879c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:19:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.318+0000 7fc9796879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.318+0000 7fc9796879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.318+0000 7fc9796879c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:19:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.318+0000 7fc9796879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.318+0000 7fc9796879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:53.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.318+0000 7fc9796879c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:53.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.318+0000 7fc9796879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:53.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.318+0000 7fc9796879c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:53.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 zone default found 2024-09-12T18:19:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 4 Realm: () 2024-09-12T18:19:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:19:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:19:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 zonegroup default 2024-09-12T18:19:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 started sync module instance, tier type = 2024-09-12T18:19:53.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.322+0000 7fc9796879c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:19:53.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.354+0000 7fc9796879c0 20 add_watcher() i=0 2024-09-12T18:19:53.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.354+0000 7fc9796879c0 20 add_watcher() i=1 2024-09-12T18:19:53.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.354+0000 7fc9796879c0 20 add_watcher() i=2 2024-09-12T18:19:53.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.354+0000 7fc9796879c0 20 add_watcher() i=3 2024-09-12T18:19:53.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.354+0000 7fc9796879c0 20 add_watcher() i=4 2024-09-12T18:19:53.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.354+0000 7fc9796879c0 20 add_watcher() i=5 2024-09-12T18:19:53.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.354+0000 7fc9796879c0 20 add_watcher() i=6 2024-09-12T18:19:53.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.358+0000 7fc9796879c0 20 add_watcher() i=7 2024-09-12T18:19:53.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.358+0000 7fc9796879c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:53.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.362+0000 7fc82e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:53.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.362+0000 7fc9796879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:53.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.362+0000 7fc9796879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:53.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.462+0000 7fc82d7e2640 20 reqs_thread_entry: start 2024-09-12T18:19:53.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.462+0000 7fc9796879c0 20 init_complete bucket index max shards: 1 2024-09-12T18:19:53.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.462+0000 7fc9796879c0 20 Filter name: none 2024-09-12T18:19:53.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.462+0000 7fc8267fc640 20 reqs_thread_entry: start 2024-09-12T18:19:53.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.462+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:19:53.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.466+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.466+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:19:53.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4292290844443727925', time=2024-09-12T20:16:39.200183+0000, chain.objs.size()=1 2024-09-12T18:19:53.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.81__shadow_.TX7EQOi0AlH9I5W2hmh9TvhCNHjFyC4_0 2024-09-12T18:19:53.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14329470545467960411', time=2024-09-12T20:18:10.783796+0000, chain.objs.size()=9 2024-09-12T18:19:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__multipart_file.mpg.2~E6jbqCRYNAGVN3FrZgB_MsrcU-ZP4Qv.1 2024-09-12T18:19:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__shadow_file.mpg.2~E6jbqCRYNAGVN3FrZgB_MsrcU-ZP4Qv.1_1 2024-09-12T18:19:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__multipart_file.mpg.2~E6jbqCRYNAGVN3FrZgB_MsrcU-ZP4Qv.2 2024-09-12T18:19:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__shadow_file.mpg.2~E6jbqCRYNAGVN3FrZgB_MsrcU-ZP4Qv.2_1 2024-09-12T18:19:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__multipart_file.mpg.2~E6jbqCRYNAGVN3FrZgB_MsrcU-ZP4Qv.3 2024-09-12T18:19:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__shadow_file.mpg.2~E6jbqCRYNAGVN3FrZgB_MsrcU-ZP4Qv.3_1 2024-09-12T18:19:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__multipart_file.mpg.2~E6jbqCRYNAGVN3FrZgB_MsrcU-ZP4Qv.4 2024-09-12T18:19:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__shadow_file.mpg.2~E6jbqCRYNAGVN3FrZgB_MsrcU-ZP4Qv.4_1 2024-09-12T18:19:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__multipart_file.mpg.2~E6jbqCRYNAGVN3FrZgB_MsrcU-ZP4Qv.5 2024-09-12T18:19:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7034531862843010866', time=2024-09-12T20:19:17.742089+0000, chain.objs.size()=1 2024-09-12T18:19:53.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.116__shadow_.wmNzkpouoW5hGbNJnx2HVXYa0_rMnOY_0 2024-09-12T18:19:53.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18008490762646534711', time=2024-09-12T20:19:22.710884+0000, chain.objs.size()=1 2024-09-12T18:19:53.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.120__shadow_.xnD16VcAOIKRxKK-MVP-imSHYZGR4xK_0 2024-09-12T18:19:53.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2636934994316770021', time=2024-09-12T20:19:32.139458+0000, chain.objs.size()=1 2024-09-12T18:19:53.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.470+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.128__shadow_.arVYlOTH7SHi3ZYTOaEhihzGw9eFkQd_0 2024-09-12T18:19:53.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.478+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2547712975528038770', time=2024-09-12T20:19:36.648099+0000, chain.objs.size()=1 2024-09-12T18:19:53.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.478+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.132__shadow_.0GUwTkYASzXaUq7db2joYDMo_GAJ_4k_0 2024-09-12T18:19:53.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.478+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8246030097891692251', time=2024-09-12T20:19:37.627983+0000, chain.objs.size()=1 2024-09-12T18:19:53.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.478+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.133__shadow_.JImF0rSB5p74FfXG3lDTtqX-NheBW4N_0 2024-09-12T18:19:53.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.482+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.486+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:19:53.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:53.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18193520183378523653', time=2024-09-12T20:17:54.777981+0000, chain.objs.size()=9 2024-09-12T18:19:53.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.99__multipart_key1.2~fL0Mgp4XOxZigZrRfZJStHNhl80EUvE.1 2024-09-12T18:19:53.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.99__shadow_key1.2~fL0Mgp4XOxZigZrRfZJStHNhl80EUvE.1_1 2024-09-12T18:19:53.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.99__multipart_key1.2~fL0Mgp4XOxZigZrRfZJStHNhl80EUvE.2 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.99__shadow_key1.2~fL0Mgp4XOxZigZrRfZJStHNhl80EUvE.2_1 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.99__multipart_key1.2~fL0Mgp4XOxZigZrRfZJStHNhl80EUvE.3 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.99__shadow_key1.2~fL0Mgp4XOxZigZrRfZJStHNhl80EUvE.3_1 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.99__multipart_key1.2~fL0Mgp4XOxZigZrRfZJStHNhl80EUvE.4 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.99__shadow_key1.2~fL0Mgp4XOxZigZrRfZJStHNhl80EUvE.4_1 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.99__multipart_key1.2~fL0Mgp4XOxZigZrRfZJStHNhl80EUvE.5 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13059017180196998864', time=2024-09-12T20:19:13.884966+0000, chain.objs.size()=1 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.113__shadow_.Z1mj9NiXMU7KKZ1NIsEWGhPjClewAox_0 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.594987119794768114', time=2024-09-12T20:19:28.320019+0000, chain.objs.size()=1 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.125__shadow_.2tFbSDYeB57EuYPH1fBgHYRlyK3bv6H_0 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8083952184890072898', time=2024-09-12T20:19:33.452333+0000, chain.objs.size()=1 2024-09-12T18:19:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.490+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.129__shadow_.ZT7fPYSbQF-sDbtOjZ15GHIgmJO0sJw_0 2024-09-12T18:19:53.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.502+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.506+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:19:53.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:19:53.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9017212961876976446', time=2024-09-12T20:18:53.980135+0000, chain.objs.size()=9 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.104__multipart_key1.2~v1KmX3X1xPO56SfJEZN19XoD5IoJyr5.1 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.104__shadow_key1.2~v1KmX3X1xPO56SfJEZN19XoD5IoJyr5.1_1 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.104__multipart_key1.2~v1KmX3X1xPO56SfJEZN19XoD5IoJyr5.2 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.104__shadow_key1.2~v1KmX3X1xPO56SfJEZN19XoD5IoJyr5.2_1 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.104__multipart_key1.2~v1KmX3X1xPO56SfJEZN19XoD5IoJyr5.3 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.104__shadow_key1.2~v1KmX3X1xPO56SfJEZN19XoD5IoJyr5.3_1 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.104__multipart_key1.2~v1KmX3X1xPO56SfJEZN19XoD5IoJyr5.4 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.104__shadow_key1.2~v1KmX3X1xPO56SfJEZN19XoD5IoJyr5.4_1 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.104__multipart_key1.2~v1KmX3X1xPO56SfJEZN19XoD5IoJyr5.5 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4879126415445997223', time=2024-09-12T20:19:13.981084+0000, chain.objs.size()=1 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.113__shadow_.Bp7l-c8RQpTaZC0OruPe222Vsrfiare_0 2024-09-12T18:19:53.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10769646705280310826', time=2024-09-12T20:19:21.388405+0000, chain.objs.size()=1 2024-09-12T18:19:53.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.119__shadow_.Y6hq9zuaLmmqZFr6pKXBQqInCxRgGRI_0 2024-09-12T18:19:53.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18228977060845068625', time=2024-09-12T20:19:29.609000+0000, chain.objs.size()=1 2024-09-12T18:19:53.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.510+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.126__shadow_.28g9ZoojR1K8SAEmPWdJnsAhvSmLYv1_0 2024-09-12T18:19:53.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.518+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.272997451728599520', time=2024-09-12T20:19:48.493229+0000, chain.objs.size()=9 2024-09-12T18:19:53.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.518+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.143__multipart_key1.2~N_pbj90EGsB2CVBV5So6A9FyZixBZqC.1 2024-09-12T18:19:53.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.518+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.143__shadow_key1.2~N_pbj90EGsB2CVBV5So6A9FyZixBZqC.1_1 2024-09-12T18:19:53.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.518+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.143__multipart_key1.2~N_pbj90EGsB2CVBV5So6A9FyZixBZqC.2 2024-09-12T18:19:53.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.518+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.143__shadow_key1.2~N_pbj90EGsB2CVBV5So6A9FyZixBZqC.2_1 2024-09-12T18:19:53.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.518+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.143__multipart_key1.2~N_pbj90EGsB2CVBV5So6A9FyZixBZqC.3 2024-09-12T18:19:53.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.518+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.143__shadow_key1.2~N_pbj90EGsB2CVBV5So6A9FyZixBZqC.3_1 2024-09-12T18:19:53.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.518+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.143__multipart_key1.2~N_pbj90EGsB2CVBV5So6A9FyZixBZqC.4 2024-09-12T18:19:53.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.518+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.143__shadow_key1.2~N_pbj90EGsB2CVBV5So6A9FyZixBZqC.4_1 2024-09-12T18:19:53.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.518+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.143__multipart_key1.2~N_pbj90EGsB2CVBV5So6A9FyZixBZqC.5 2024-09-12T18:19:53.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.526+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.534+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:19:53.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.534+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.534+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:53.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1219340586725940456', time=2024-09-12T20:18:11.075904+0000, chain.objs.size()=1 2024-09-12T18:19:53.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__shadow_.BhmtPHACyMFhDq7AzYvI91JR8V008M-_0 2024-09-12T18:19:53.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~_7eap9vriqLjna6YK32u8w9tf-qDrb7', time=2024-09-12T20:19:01.801966+0000, chain.objs.size()=40 2024-09-12T18:19:53.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.1 2024-09-12T18:19:53.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.2 2024-09-12T18:19:53.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.3 2024-09-12T18:19:53.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.4 2024-09-12T18:19:53.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.5 2024-09-12T18:19:53.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.6 2024-09-12T18:19:53.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.7 2024-09-12T18:19:53.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.8 2024-09-12T18:19:53.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.9 2024-09-12T18:19:53.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.10 2024-09-12T18:19:53.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.11 2024-09-12T18:19:53.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.12 2024-09-12T18:19:53.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.538+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.13 2024-09-12T18:19:53.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.542+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.14 2024-09-12T18:19:53.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.542+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.15 2024-09-12T18:19:53.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.542+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.16 2024-09-12T18:19:53.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.542+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.17 2024-09-12T18:19:53.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.542+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.18 2024-09-12T18:19:53.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.542+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.19 2024-09-12T18:19:53.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.542+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.20 2024-09-12T18:19:53.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.542+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.21 2024-09-12T18:19:53.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.546+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.22 2024-09-12T18:19:53.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.546+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.23 2024-09-12T18:19:53.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.546+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.24 2024-09-12T18:19:53.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.546+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.25 2024-09-12T18:19:53.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.546+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.26 2024-09-12T18:19:53.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.546+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.27 2024-09-12T18:19:53.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.546+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.28 2024-09-12T18:19:53.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.546+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.29 2024-09-12T18:19:53.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.546+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.30 2024-09-12T18:19:53.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.550+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.31 2024-09-12T18:19:53.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.550+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.32 2024-09-12T18:19:53.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.550+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.33 2024-09-12T18:19:53.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.550+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.34 2024-09-12T18:19:53.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.550+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.35 2024-09-12T18:19:53.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.550+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.36 2024-09-12T18:19:53.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.550+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.37 2024-09-12T18:19:53.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.550+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.38 2024-09-12T18:19:53.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.550+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.39 2024-09-12T18:19:53.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.554+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.105__multipart_key1.2~_7eap9vriqLjna6YK32u8w9tf-qDrb7.40 2024-09-12T18:19:53.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.554+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14946941782404471770', time=2024-09-12T20:19:28.536755+0000, chain.objs.size()=1 2024-09-12T18:19:53.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.554+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.125__shadow_.ucsbK8MDKsz_H1gNFAM_SZhnKKDnHV0_0 2024-09-12T18:19:53.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.558+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.562+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:19:53.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:19:53.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15353312496427883393', time=2024-09-12T20:17:43.490489+0000, chain.objs.size()=6 2024-09-12T18:19:53.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.93__shadow_.XXMo3F8DTz--kEaebMN7tf4eBWSxrD7_0 2024-09-12T18:19:53.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.93__shadow_.XXMo3F8DTz--kEaebMN7tf4eBWSxrD7_1 2024-09-12T18:19:53.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.93__shadow_.XXMo3F8DTz--kEaebMN7tf4eBWSxrD7_2 2024-09-12T18:19:53.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.93__shadow_.XXMo3F8DTz--kEaebMN7tf4eBWSxrD7_3 2024-09-12T18:19:53.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.93__shadow_.XXMo3F8DTz--kEaebMN7tf4eBWSxrD7_4 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.93__shadow_.XXMo3F8DTz--kEaebMN7tf4eBWSxrD7_5 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13329201260301969520', time=2024-09-12T20:18:39.183906+0000, chain.objs.size()=1 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.103__shadow_.Tla8WrFfn9ZuEB5TA8ID_uREdfscXvf_0 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18231754987973720724', time=2024-09-12T20:19:12.646018+0000, chain.objs.size()=1 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.112__shadow_.ANwXwYTWvrg7fa5_qBp2hVVL4KRCw0O_0 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18103086875549212340', time=2024-09-12T20:19:14.063789+0000, chain.objs.size()=1 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.113__shadow_.jilL2uBKvptghq6Ewx4a5uhXpBiaA7k_0 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6780282253280295388', time=2024-09-12T20:19:16.424023+0000, chain.objs.size()=1 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.115__shadow_.sdmaNYN0sTrAdLxdz69bedSscUcNZkr_0 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17580735900540977744', time=2024-09-12T20:19:25.152043+0000, chain.objs.size()=1 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.122__shadow_.P3CP-GBQzm44fsyN9X7lTbinjr4sZbF_0 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13627629962156673966', time=2024-09-12T20:19:32.068732+0000, chain.objs.size()=1 2024-09-12T18:19:53.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.566+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.128__shadow_.g-mpN5Pvh2gGHxgX7TWoq6G6VW1wp3o_0 2024-09-12T18:19:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.574+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14185907324803026990', time=2024-09-12T20:19:35.510149+0000, chain.objs.size()=1 2024-09-12T18:19:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.574+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.131__shadow_.nc3VXgFX8xTiVIzQvRjIzqJbnE4jOn8_0 2024-09-12T18:19:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.574+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.578+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:19:53.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.582+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.582+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.586+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:53.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.586+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13847145899390466695', time=2024-09-12T20:19:08.336150+0000, chain.objs.size()=1 2024-09-12T18:19:53.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.586+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.106__shadow_.v48wWkBKtFDwR7QcYrwwERZdceXjgUg_0 2024-09-12T18:19:53.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.586+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16246085627026717607', time=2024-09-12T20:19:26.087423+0000, chain.objs.size()=1 2024-09-12T18:19:53.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.586+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.123__shadow_.rUHA7hBuHu8PIS7v-rTdXCCWI32PvwK_0 2024-09-12T18:19:53.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.586+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8402081987181778074', time=2024-09-12T20:19:37.699688+0000, chain.objs.size()=1 2024-09-12T18:19:53.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.586+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.133__shadow_.AxP1x8MLsiFu0OLANeqoxr9fLiTTYze_0 2024-09-12T18:19:53.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.586+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.594+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:19:53.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vHMr6VA9MgGjbklCjXIeJyEs-CgnCMD', time=2024-09-12T20:18:15.155227+0000, chain.objs.size()=9 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.101__multipart_key1.2~vHMr6VA9MgGjbklCjXIeJyEs-CgnCMD.7 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.101__shadow_key1.2~vHMr6VA9MgGjbklCjXIeJyEs-CgnCMD.7_1 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.101__multipart_key1.2~vHMr6VA9MgGjbklCjXIeJyEs-CgnCMD.8 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.101__shadow_key1.2~vHMr6VA9MgGjbklCjXIeJyEs-CgnCMD.8_1 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.101__multipart_key1.2~vHMr6VA9MgGjbklCjXIeJyEs-CgnCMD.9 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.101__shadow_key1.2~vHMr6VA9MgGjbklCjXIeJyEs-CgnCMD.9_1 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.101__multipart_key1.2~vHMr6VA9MgGjbklCjXIeJyEs-CgnCMD.10 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.101__shadow_key1.2~vHMr6VA9MgGjbklCjXIeJyEs-CgnCMD.10_1 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.101__multipart_key1.2~vHMr6VA9MgGjbklCjXIeJyEs-CgnCMD.11 2024-09-12T18:19:53.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13421212334566683510', time=2024-09-12T20:19:19.073801+0000, chain.objs.size()=1 2024-09-12T18:19:53.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.117__shadow_.t1DG5hQuq42GWFv7nBLu6EUaR8FEDXa_0 2024-09-12T18:19:53.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17883864003407273228', time=2024-09-12T20:19:26.211947+0000, chain.objs.size()=1 2024-09-12T18:19:53.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.598+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.123__shadow_.THpggTChmC7DAfebYmdUaC16_AdUKXh_0 2024-09-12T18:19:53.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.606+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.610+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:19:53.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:19:53.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14665858506134720692', time=2024-09-12T20:17:20.544294+0000, chain.objs.size()=9 2024-09-12T18:19:53.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~bQRmf3agCire-5yS8yJMDhqC3NkE7mh.1 2024-09-12T18:19:53.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~bQRmf3agCire-5yS8yJMDhqC3NkE7mh.1_1 2024-09-12T18:19:53.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~bQRmf3agCire-5yS8yJMDhqC3NkE7mh.2 2024-09-12T18:19:53.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~bQRmf3agCire-5yS8yJMDhqC3NkE7mh.2_1 2024-09-12T18:19:53.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~bQRmf3agCire-5yS8yJMDhqC3NkE7mh.3 2024-09-12T18:19:53.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~bQRmf3agCire-5yS8yJMDhqC3NkE7mh.3_1 2024-09-12T18:19:53.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~bQRmf3agCire-5yS8yJMDhqC3NkE7mh.4 2024-09-12T18:19:53.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~bQRmf3agCire-5yS8yJMDhqC3NkE7mh.4_1 2024-09-12T18:19:53.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~bQRmf3agCire-5yS8yJMDhqC3NkE7mh.5 2024-09-12T18:19:53.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18309989475314021045', time=2024-09-12T20:17:34.372722+0000, chain.objs.size()=9 2024-09-12T18:19:53.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~Fn2t8j1hE8f6blgjDJYg7PwvAEvvbwv.1 2024-09-12T18:19:53.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~Fn2t8j1hE8f6blgjDJYg7PwvAEvvbwv.1_1 2024-09-12T18:19:53.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.614+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~Fn2t8j1hE8f6blgjDJYg7PwvAEvvbwv.2 2024-09-12T18:19:53.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.622+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~Fn2t8j1hE8f6blgjDJYg7PwvAEvvbwv.2_1 2024-09-12T18:19:53.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.622+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~Fn2t8j1hE8f6blgjDJYg7PwvAEvvbwv.3 2024-09-12T18:19:53.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.622+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~Fn2t8j1hE8f6blgjDJYg7PwvAEvvbwv.3_1 2024-09-12T18:19:53.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.622+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~Fn2t8j1hE8f6blgjDJYg7PwvAEvvbwv.4 2024-09-12T18:19:53.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.622+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~Fn2t8j1hE8f6blgjDJYg7PwvAEvvbwv.4_1 2024-09-12T18:19:53.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.622+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~Fn2t8j1hE8f6blgjDJYg7PwvAEvvbwv.5 2024-09-12T18:19:53.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.630+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.634+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:19:53.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:19:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9684443199515355025', time=2024-09-12T20:18:35.038184+0000, chain.objs.size()=7 2024-09-12T18:19:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~Yw66TaxhTmL4VtEhe48SoQbNrG2fKI_.1 2024-09-12T18:19:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~Yw66TaxhTmL4VtEhe48SoQbNrG2fKI_.1_1 2024-09-12T18:19:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~Yw66TaxhTmL4VtEhe48SoQbNrG2fKI_.1_2 2024-09-12T18:19:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~Yw66TaxhTmL4VtEhe48SoQbNrG2fKI_.2 2024-09-12T18:19:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~Yw66TaxhTmL4VtEhe48SoQbNrG2fKI_.2_1 2024-09-12T18:19:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~Yw66TaxhTmL4VtEhe48SoQbNrG2fKI_.2_2 2024-09-12T18:19:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~Yw66TaxhTmL4VtEhe48SoQbNrG2fKI_.3 2024-09-12T18:19:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12937010766650648793', time=2024-09-12T20:19:22.637342+0000, chain.objs.size()=1 2024-09-12T18:19:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.638+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.120__shadow_.ISTXYInzsRC7jf1pTSn-7ms3UpkmA8J_0 2024-09-12T18:19:53.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.646+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.650+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:19:53.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.650+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:19:53.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13203125157301878407', time=2024-09-12T20:16:52.011942+0000, chain.objs.size()=9 2024-09-12T18:19:53.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__multipart_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.1 2024-09-12T18:19:53.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__shadow_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.1_1 2024-09-12T18:19:53.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__multipart_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.2 2024-09-12T18:19:53.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__shadow_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.2_1 2024-09-12T18:19:53.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__multipart_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.3 2024-09-12T18:19:53.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__shadow_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.3_1 2024-09-12T18:19:53.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__multipart_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.4 2024-09-12T18:19:53.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__shadow_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.4_1 2024-09-12T18:19:53.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__multipart_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.5 2024-09-12T18:19:53.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8252175922063480033', time=2024-09-12T20:19:23.728885+0000, chain.objs.size()=1 2024-09-12T18:19:53.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.121__shadow_.DAhMIHaa8i66qb1xdIuvAxm5bDDQBs7_0 2024-09-12T18:19:53.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7164902167879202359', time=2024-09-12T20:19:30.753125+0000, chain.objs.size()=1 2024-09-12T18:19:53.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.127__shadow_.r6y7WP7CsgykVW8U7zB0Wgimyuyr_ji_0 2024-09-12T18:19:53.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7463308001001566002', time=2024-09-12T20:19:31.996939+0000, chain.objs.size()=1 2024-09-12T18:19:53.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.654+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.128__shadow_.rk9fKxVripJkghT5WsTyRyoNPvHvagP_0 2024-09-12T18:19:53.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.658+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17081088390518273072', time=2024-09-12T20:19:33.236012+0000, chain.objs.size()=1 2024-09-12T18:19:53.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.658+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.129__shadow_.BlcxJRexhyFKWeb6PNO1Y-rxBoJk0Q4_0 2024-09-12T18:19:53.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.658+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3123550687752198660', time=2024-09-12T20:19:33.379574+0000, chain.objs.size()=1 2024-09-12T18:19:53.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.658+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.129__shadow_.Gr9PxA6CCd2Ip2aF2_EF0oPbqmDfrc9_0 2024-09-12T18:19:53.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.662+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.666+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:19:53.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:19:53.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14334951868574542791', time=2024-09-12T20:19:15.337267+0000, chain.objs.size()=1 2024-09-12T18:19:53.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.114__shadow_.Q3BidaKeydmrUbJXltM20JO1G7z_9dp_0 2024-09-12T18:19:53.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8084264472258464511', time=2024-09-12T20:19:16.494866+0000, chain.objs.size()=1 2024-09-12T18:19:53.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.115__shadow_.y2dzQGWhtZPddObuVYbF25viXizYQl7_0 2024-09-12T18:19:53.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17758239427409962148', time=2024-09-12T20:19:28.390515+0000, chain.objs.size()=1 2024-09-12T18:19:53.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.125__shadow_.agjtPsaY5kFSp21S14l-rgXiBHMVYDm_0 2024-09-12T18:19:53.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5776057300197149103', time=2024-09-12T20:19:29.681165+0000, chain.objs.size()=1 2024-09-12T18:19:53.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.126__shadow_.XRoHYwPwwnB6WZjkGb6Q5oNB64pIQkL_0 2024-09-12T18:19:53.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.547134388672632594', time=2024-09-12T20:19:52.617969+0000, chain.objs.size()=1 2024-09-12T18:19:53.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.670+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.144__shadow_.l8skkJ-ghH9QH0MUNwuKZuaJGSugy56_0 2024-09-12T18:19:53.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.674+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.682+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:19:53.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.682+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:19:53.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16627362860532808021', time=2024-09-12T20:16:42.520434+0000, chain.objs.size()=3 2024-09-12T18:19:53.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.83__shadow_.WbzshGic59SutcgNxWRsCvG2JQYe4Gx_0 2024-09-12T18:19:53.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.83__shadow_.WbzshGic59SutcgNxWRsCvG2JQYe4Gx_1 2024-09-12T18:19:53.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.83__shadow_.WbzshGic59SutcgNxWRsCvG2JQYe4Gx_2 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3295805467961177843', time=2024-09-12T20:18:32.142544+0000, chain.objs.size()=7 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~jBuKiNjMuQegBIq1KYoTNEhd9wSw_Pz.1 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~jBuKiNjMuQegBIq1KYoTNEhd9wSw_Pz.1_1 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~jBuKiNjMuQegBIq1KYoTNEhd9wSw_Pz.1_2 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~jBuKiNjMuQegBIq1KYoTNEhd9wSw_Pz.2 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~jBuKiNjMuQegBIq1KYoTNEhd9wSw_Pz.2_1 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~jBuKiNjMuQegBIq1KYoTNEhd9wSw_Pz.2_2 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~jBuKiNjMuQegBIq1KYoTNEhd9wSw_Pz.3 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1480400897338262005', time=2024-09-12T20:19:20.052797+0000, chain.objs.size()=1 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.118__shadow_.LhN2QKjcbsawgNyYUwd-5H9-jRdF2aP_0 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3506671277664732879', time=2024-09-12T20:19:34.382867+0000, chain.objs.size()=1 2024-09-12T18:19:53.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.686+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.130__shadow_.EQc9FER5Kv-2GRmRhDuNrenq3S7DkuO_0 2024-09-12T18:19:53.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.694+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12336571259170402021', time=2024-09-12T20:19:36.522081+0000, chain.objs.size()=1 2024-09-12T18:19:53.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.694+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.132__shadow_.kXNzOKQNdMME8G1T0Sqk7MG6sqf2l-G_0 2024-09-12T18:19:53.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.698+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.702+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:19:53.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16531572743820696527', time=2024-09-12T20:16:51.620735+0000, chain.objs.size()=9 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__multipart_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.1 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__shadow_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.1_1 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__multipart_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.2 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__shadow_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.2_1 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__multipart_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.3 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__shadow_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.3_1 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__multipart_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.4 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__shadow_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.4_1 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.91__multipart_key1.2~BOJ7XLtjzHkh38OkCiMdEM-1ZZ1wNkp.5 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12614387841503365494', time=2024-09-12T20:19:15.266457+0000, chain.objs.size()=1 2024-09-12T18:19:53.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.114__shadow_.TQ-yIIbqJXYJQ68Tc-5S-XKreV1GY-m_0 2024-09-12T18:19:53.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15647061247182582816', time=2024-09-12T20:19:34.532477+0000, chain.objs.size()=1 2024-09-12T18:19:53.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.706+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.130__shadow_.PeTI_r-kp_5mdI0sREfxcf57Y_S31XT_0 2024-09-12T18:19:53.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.714+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.718+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:19:53.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.722+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.722+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.726+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:19:53.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.726+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.833364553508402650', time=2024-09-12T20:19:37.565818+0000, chain.objs.size()=1 2024-09-12T18:19:53.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.726+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.133__shadow_.mCUliVFrl1u-EnXPxBqEzDMlfCUF9Db_0 2024-09-12T18:19:53.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.726+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.730+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:19:53.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.734+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.734+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13162799355137965771', time=2024-09-12T20:17:38.647390+0000, chain.objs.size()=7 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~1SaWMRL83crV2eW_9Y9rzsdZNZk_95P.1 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~1SaWMRL83crV2eW_9Y9rzsdZNZk_95P.1_1 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~1SaWMRL83crV2eW_9Y9rzsdZNZk_95P.1_2 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~1SaWMRL83crV2eW_9Y9rzsdZNZk_95P.2 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~1SaWMRL83crV2eW_9Y9rzsdZNZk_95P.2_1 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~1SaWMRL83crV2eW_9Y9rzsdZNZk_95P.2_2 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~1SaWMRL83crV2eW_9Y9rzsdZNZk_95P.3 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13612985797934183791', time=2024-09-12T20:18:35.334801+0000, chain.objs.size()=7 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~11zUl8Pf6qd3nzrAuF9ZF06wI1xlNmE.1 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~11zUl8Pf6qd3nzrAuF9ZF06wI1xlNmE.1_1 2024-09-12T18:19:53.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~11zUl8Pf6qd3nzrAuF9ZF06wI1xlNmE.1_2 2024-09-12T18:19:53.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~11zUl8Pf6qd3nzrAuF9ZF06wI1xlNmE.2 2024-09-12T18:19:53.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.738+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~11zUl8Pf6qd3nzrAuF9ZF06wI1xlNmE.2_1 2024-09-12T18:19:53.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.742+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~11zUl8Pf6qd3nzrAuF9ZF06wI1xlNmE.2_2 2024-09-12T18:19:53.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.742+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~11zUl8Pf6qd3nzrAuF9ZF06wI1xlNmE.3 2024-09-12T18:19:53.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.746+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16904302154570646522', time=2024-09-12T20:19:14.132587+0000, chain.objs.size()=1 2024-09-12T18:19:53.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.746+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.113__shadow_.mWLkQNcKI7elPHhzVih0nOUfDCs-pO3_0 2024-09-12T18:19:53.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.746+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9293200187358949222', time=2024-09-12T20:19:18.894571+0000, chain.objs.size()=1 2024-09-12T18:19:53.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.746+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.117__shadow_.DKCnOPEracMmP52l4HTVvd_DHTvPDnM_0 2024-09-12T18:19:53.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.750+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.754+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:19:53.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.758+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.758+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.762+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:53.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.762+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13459634091961333755', time=2024-09-12T20:19:17.665046+0000, chain.objs.size()=1 2024-09-12T18:19:53.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.762+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.116__shadow_.j6erfaGTWgqiX_DjAfMoki3Wmb_HB4C_0 2024-09-12T18:19:53.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.762+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3414436390902790423', time=2024-09-12T20:19:18.822309+0000, chain.objs.size()=1 2024-09-12T18:19:53.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.762+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.117__shadow_.m0GOHrKUeAwitTk8oJ-G6sEzFb0GYVC_0 2024-09-12T18:19:53.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.762+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4548264422272719932', time=2024-09-12T20:19:30.897851+0000, chain.objs.size()=1 2024-09-12T18:19:53.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.762+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.127__shadow_.4LQADzHC7mv9Vx-HFxVv1mf7szC4vIb_0 2024-09-12T18:19:53.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.762+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.770+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:19:53.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.770+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:19:53.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7433582883849448170', time=2024-09-12T20:18:25.654626+0000, chain.objs.size()=9 2024-09-12T18:19:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~FyDPgl_gaRGKslL_-6IWwLyqTlUT63M.1 2024-09-12T18:19:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~FyDPgl_gaRGKslL_-6IWwLyqTlUT63M.1_1 2024-09-12T18:19:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~FyDPgl_gaRGKslL_-6IWwLyqTlUT63M.2 2024-09-12T18:19:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~FyDPgl_gaRGKslL_-6IWwLyqTlUT63M.2_1 2024-09-12T18:19:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~FyDPgl_gaRGKslL_-6IWwLyqTlUT63M.3 2024-09-12T18:19:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~FyDPgl_gaRGKslL_-6IWwLyqTlUT63M.3_1 2024-09-12T18:19:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~FyDPgl_gaRGKslL_-6IWwLyqTlUT63M.4 2024-09-12T18:19:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~FyDPgl_gaRGKslL_-6IWwLyqTlUT63M.4_1 2024-09-12T18:19:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~FyDPgl_gaRGKslL_-6IWwLyqTlUT63M.5 2024-09-12T18:19:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6226479884290696262', time=2024-09-12T20:19:20.124837+0000, chain.objs.size()=1 2024-09-12T18:19:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.774+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.118__shadow_.CfV5Gm1tWjBLtDkx2Oq8NDuhqVewY0G_0 2024-09-12T18:19:53.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.782+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.786+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:19:53.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:53.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5856016024241265772', time=2024-09-12T20:18:28.647035+0000, chain.objs.size()=9 2024-09-12T18:19:53.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~9aING5TN7VFs68awTMx-kdEbNS2xUsK.1 2024-09-12T18:19:53.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~9aING5TN7VFs68awTMx-kdEbNS2xUsK.1_1 2024-09-12T18:19:53.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~9aING5TN7VFs68awTMx-kdEbNS2xUsK.2 2024-09-12T18:19:53.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~9aING5TN7VFs68awTMx-kdEbNS2xUsK.2_1 2024-09-12T18:19:53.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~9aING5TN7VFs68awTMx-kdEbNS2xUsK.3 2024-09-12T18:19:53.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~9aING5TN7VFs68awTMx-kdEbNS2xUsK.3_1 2024-09-12T18:19:53.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~9aING5TN7VFs68awTMx-kdEbNS2xUsK.4 2024-09-12T18:19:53.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~9aING5TN7VFs68awTMx-kdEbNS2xUsK.4_1 2024-09-12T18:19:53.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~9aING5TN7VFs68awTMx-kdEbNS2xUsK.5 2024-09-12T18:19:53.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5133393310239875704', time=2024-09-12T20:19:17.809361+0000, chain.objs.size()=1 2024-09-12T18:19:53.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.116__shadow_.dtTYilUea_FjU_UUYEcuAmnAIYI0lqz_0 2024-09-12T18:19:53.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17381154649516009427', time=2024-09-12T20:19:34.461295+0000, chain.objs.size()=1 2024-09-12T18:19:53.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.790+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.130__shadow_._eQhj7Sph9XGeSj8dSSItPyEIeOWFkh_0 2024-09-12T18:19:53.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.802+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.806+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:19:53.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.810+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.810+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.810+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:19:53.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.810+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11999608743347409790', time=2024-09-12T20:19:12.719817+0000, chain.objs.size()=1 2024-09-12T18:19:53.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.810+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.112__shadow_.VX6M_pl35PIApf85JnO81WD5xUi92vn_0 2024-09-12T18:19:53.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.810+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9442836204295265707', time=2024-09-12T20:19:43.220138+0000, chain.objs.size()=1 2024-09-12T18:19:53.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.810+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.140__shadow_.UWzzfV7W0kXVLTdzeyEQnMU5SDSWJCL_0 2024-09-12T18:19:53.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.814+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.818+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:19:53.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:19:53.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10088246641172050678', time=2024-09-12T20:17:15.056445+0000, chain.objs.size()=9 2024-09-12T18:19:53.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~S6W4okXbB6yDu80vWM8URLJD4hHtEQU.1 2024-09-12T18:19:53.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~S6W4okXbB6yDu80vWM8URLJD4hHtEQU.1_1 2024-09-12T18:19:53.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~S6W4okXbB6yDu80vWM8URLJD4hHtEQU.2 2024-09-12T18:19:53.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~S6W4okXbB6yDu80vWM8URLJD4hHtEQU.2_1 2024-09-12T18:19:53.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~S6W4okXbB6yDu80vWM8URLJD4hHtEQU.3 2024-09-12T18:19:53.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~S6W4okXbB6yDu80vWM8URLJD4hHtEQU.3_1 2024-09-12T18:19:53.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~S6W4okXbB6yDu80vWM8URLJD4hHtEQU.4 2024-09-12T18:19:53.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~S6W4okXbB6yDu80vWM8URLJD4hHtEQU.4_1 2024-09-12T18:19:53.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.822+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~S6W4okXbB6yDu80vWM8URLJD4hHtEQU.5 2024-09-12T18:19:53.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.834+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.838+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:19:53.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:19:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2172761043544129225', time=2024-09-12T20:19:12.865597+0000, chain.objs.size()=1 2024-09-12T18:19:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.112__shadow_.djd15-4VIOge-U0py9aikaKXyqw-rvg_0 2024-09-12T18:19:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17530162670747321057', time=2024-09-12T20:19:21.316560+0000, chain.objs.size()=1 2024-09-12T18:19:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.119__shadow_.gZOQcnMl6DmJjc0vMuxzIp4sQPGOYmn_0 2024-09-12T18:19:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15330008300403099902', time=2024-09-12T20:19:22.567322+0000, chain.objs.size()=1 2024-09-12T18:19:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.120__shadow_.1Xy9g18GaD1tOSkXMaWTC7cfkhNSF1O_0 2024-09-12T18:19:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15690562732214084917', time=2024-09-12T20:19:23.802556+0000, chain.objs.size()=1 2024-09-12T18:19:53.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.121__shadow_.hOkIT0yAEJ8SMHt8ACwIIQD4-QuGtE8_0 2024-09-12T18:19:53.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8557099850708693073', time=2024-09-12T20:19:24.942516+0000, chain.objs.size()=1 2024-09-12T18:19:53.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.122__shadow_.tCslVqgpC7SbLVio9EW3BxUdRfg884C_0 2024-09-12T18:19:53.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10661048958143230587', time=2024-09-12T20:19:27.216134+0000, chain.objs.size()=1 2024-09-12T18:19:53.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.124__shadow_.vLfLCG8QW9gDAHynkrzT1WfyxhDwHsY_0 2024-09-12T18:19:53.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13678626219474582117', time=2024-09-12T20:19:29.554517+0000, chain.objs.size()=1 2024-09-12T18:19:53.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.842+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.126__shadow_.RwtPR7R4FK7-OGduSgS05fpGb2uUu2w_0 2024-09-12T18:19:53.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.846+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.854+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:19:53.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.854+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17431322953066732987', time=2024-09-12T20:16:47.028990+0000, chain.objs.size()=1 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.90__shadow_.to2wKSIBWXPLrlSXOBE5ecJhNEwMshj_0 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18147696825152104410', time=2024-09-12T20:17:42.822576+0000, chain.objs.size()=7 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~QAGfFzApC4P3t5yrx7DB3M_4zzj6_q3.1 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~QAGfFzApC4P3t5yrx7DB3M_4zzj6_q3.1_1 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~QAGfFzApC4P3t5yrx7DB3M_4zzj6_q3.1_2 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~QAGfFzApC4P3t5yrx7DB3M_4zzj6_q3.2 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~QAGfFzApC4P3t5yrx7DB3M_4zzj6_q3.2_1 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~QAGfFzApC4P3t5yrx7DB3M_4zzj6_q3.2_2 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~QAGfFzApC4P3t5yrx7DB3M_4zzj6_q3.3 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17569445242961104505', time=2024-09-12T20:19:12.792460+0000, chain.objs.size()=1 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.112__shadow_.y3b5kwO9mOEGYWHvl-qMWcBdvoGmHNW_0 2024-09-12T18:19:53.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10714273339523796971', time=2024-09-12T20:19:27.288070+0000, chain.objs.size()=1 2024-09-12T18:19:53.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.858+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.124__shadow_.JOvNwnEdEPlA9MWnfp70rY7wK3sEaTT_0 2024-09-12T18:19:53.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.862+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.870+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:19:53.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.870+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:19:53.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4792347008770185745', time=2024-09-12T20:16:43.938247+0000, chain.objs.size()=1 2024-09-12T18:19:53.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.85__shadow_.ujBmiQYNOy8oQq10KNyDRPWE2c-gKKP_0 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15987967153662657447', time=2024-09-12T20:18:10.939274+0000, chain.objs.size()=4 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__multipart_file2.mpg.2~xpDnhD9VL9VvDz1-9GcxV170hxNpb5a.1 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__multipart_file2.mpg.2~xpDnhD9VL9VvDz1-9GcxV170hxNpb5a.2 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__multipart_file2.mpg.2~xpDnhD9VL9VvDz1-9GcxV170hxNpb5a.3 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__multipart_file2.mpg.2~xpDnhD9VL9VvDz1-9GcxV170hxNpb5a.4 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8797248615811095053', time=2024-09-12T20:18:11.013196+0000, chain.objs.size()=1 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__shadow_.r6Pvaf9R7zq9wZIqfL6dWs3l8SMnV0b_0 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8461975497792070151', time=2024-09-12T20:19:23.874845+0000, chain.objs.size()=1 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.121__shadow_.jalUBz1pRdI1Pbncoh5_MFgi6vNA9uv_0 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9074363549615983518', time=2024-09-12T20:19:32.214569+0000, chain.objs.size()=1 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.128__shadow_.zv7CStwtM99c5ZS7mUb25RXMWW7Y5B__0 2024-09-12T18:19:53.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3120721532000240246', time=2024-09-12T20:19:33.309246+0000, chain.objs.size()=1 2024-09-12T18:19:53.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.129__shadow_.A8yV90T5xZojzyDGIv9U3zqyWpv7tRE_0 2024-09-12T18:19:53.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10157578341111333304', time=2024-09-12T20:19:39.682521+0000, chain.objs.size()=1 2024-09-12T18:19:53.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.874+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.136__shadow_.GxEOZX0bLHvUjLegxxjp71X_q1fvGKd_0 2024-09-12T18:19:53.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.878+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.882+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:19:53.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.886+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.886+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.886+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:19:53.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.886+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16873283389588058819', time=2024-09-12T20:19:21.245544+0000, chain.objs.size()=1 2024-09-12T18:19:53.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.886+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.119__shadow_.TSLuvIvGputtyCfov1PeqFDHgz-Hhim_0 2024-09-12T18:19:53.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.886+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16849159608605339272', time=2024-09-12T20:19:29.753751+0000, chain.objs.size()=1 2024-09-12T18:19:53.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.886+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.126__shadow_.gAySkCNQmFqoYwzR0VlK9fBP2deKQFx_0 2024-09-12T18:19:53.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.890+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.894+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:19:53.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.898+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.898+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.898+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.902+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:19:53.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:19:53.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.360700532709320770', time=2024-09-12T20:18:21.854125+0000, chain.objs.size()=9 2024-09-12T18:19:53.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~zwiU1wUgyUUnnUwADqF5Rd5kuHh3f7k.1 2024-09-12T18:19:53.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~zwiU1wUgyUUnnUwADqF5Rd5kuHh3f7k.1_1 2024-09-12T18:19:53.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~zwiU1wUgyUUnnUwADqF5Rd5kuHh3f7k.2 2024-09-12T18:19:53.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~zwiU1wUgyUUnnUwADqF5Rd5kuHh3f7k.2_1 2024-09-12T18:19:53.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~zwiU1wUgyUUnnUwADqF5Rd5kuHh3f7k.3 2024-09-12T18:19:53.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~zwiU1wUgyUUnnUwADqF5Rd5kuHh3f7k.3_1 2024-09-12T18:19:53.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~zwiU1wUgyUUnnUwADqF5Rd5kuHh3f7k.4 2024-09-12T18:19:53.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__shadow_key1.2~zwiU1wUgyUUnnUwADqF5Rd5kuHh3f7k.4_1 2024-09-12T18:19:53.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.102__multipart_key1.2~zwiU1wUgyUUnnUwADqF5Rd5kuHh3f7k.5 2024-09-12T18:19:53.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1387712664640655825', time=2024-09-12T20:19:18.966904+0000, chain.objs.size()=1 2024-09-12T18:19:53.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.906+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.117__shadow_.32TCk6B4xXTmdHkmQs-RKNplA3xBlaL_0 2024-09-12T18:19:53.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.914+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.918+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:19:53.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.922+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:19:53.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18358672900413935990', time=2024-09-12T20:19:15.126465+0000, chain.objs.size()=1 2024-09-12T18:19:53.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.114__shadow_.a7GPMLE7SewrHJWZjiwunP4Uja2AeL-_0 2024-09-12T18:19:53.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7709102808937796821', time=2024-09-12T20:19:15.199827+0000, chain.objs.size()=1 2024-09-12T18:19:53.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.114__shadow_.GWCb6A6Nf3Yhb-K7OKt2hXuPHK5Btp7_0 2024-09-12T18:19:53.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2526694709983107366', time=2024-09-12T20:19:17.592716+0000, chain.objs.size()=1 2024-09-12T18:19:53.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.116__shadow_.T8IBmPpSRM9-_HIvKyuBoVjvlTcUkt-_0 2024-09-12T18:19:53.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4636244790659466608', time=2024-09-12T20:19:20.198270+0000, chain.objs.size()=1 2024-09-12T18:19:53.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.118__shadow_.hLcN-iYUo6-d4XDD5TI-6vdRHtgh0FR_0 2024-09-12T18:19:53.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8422778894316421199', time=2024-09-12T20:19:30.825426+0000, chain.objs.size()=1 2024-09-12T18:19:53.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.127__shadow_.8YMX6Uy7HZ8pIJISrPwVlD5J5hvZheR_0 2024-09-12T18:19:53.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15193781729418717688', time=2024-09-12T20:19:42.441580+0000, chain.objs.size()=1 2024-09-12T18:19:53.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.926+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.139__shadow_.WFvYG8JYs4ntxKAiOso0O9u7ZN3IIvv_0 2024-09-12T18:19:53.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.930+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.934+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:19:53.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.938+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.938+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:19:53.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10119744708928277516', time=2024-09-12T20:16:43.210835+0000, chain.objs.size()=1 2024-09-12T18:19:53.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.84__shadow_.3KxkaSN848CZ-GlZ-5UrmIg8h2yktl__0 2024-09-12T18:19:53.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13071764510956747822', time=2024-09-12T20:17:43.124788+0000, chain.objs.size()=7 2024-09-12T18:19:53.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~oTHDkSMQg8kjJnlnX7lvTTM-yRoEznG.1 2024-09-12T18:19:53.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~oTHDkSMQg8kjJnlnX7lvTTM-yRoEznG.1_1 2024-09-12T18:19:53.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~oTHDkSMQg8kjJnlnX7lvTTM-yRoEznG.1_2 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~oTHDkSMQg8kjJnlnX7lvTTM-yRoEznG.2 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~oTHDkSMQg8kjJnlnX7lvTTM-yRoEznG.2_1 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__shadow_key1.2~oTHDkSMQg8kjJnlnX7lvTTM-yRoEznG.2_2 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.94__multipart_key1.2~oTHDkSMQg8kjJnlnX7lvTTM-yRoEznG.3 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13795082093827265971', time=2024-09-12T20:19:23.930205+0000, chain.objs.size()=1 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.121__shadow_.kCX6T2dQWBWRU6zfItUymBQGU-V9KHx_0 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4365666977083907054', time=2024-09-12T20:19:25.011528+0000, chain.objs.size()=1 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.122__shadow_.FKFLsYb8iUP-VlJQMEL_y_vsLSlUDqG_0 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9404521864873291328', time=2024-09-12T20:19:26.142581+0000, chain.objs.size()=1 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.123__shadow_._6Cqr50gZGaXsqkB8i5gGfKEg029UtZ_0 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12276218988775821013', time=2024-09-12T20:19:28.463898+0000, chain.objs.size()=1 2024-09-12T18:19:53.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.942+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.125__shadow_.DD5bu5MlJ4SRJEC2AJf-GYSf532quqC_0 2024-09-12T18:19:53.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.946+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13746838713045208868', time=2024-09-12T20:19:35.453355+0000, chain.objs.size()=1 2024-09-12T18:19:53.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.946+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.131__shadow_.UdS84qGciLUnG49dAuejLAQSP6VdTi1_0 2024-09-12T18:19:53.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.950+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.954+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:19:53.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:19:53.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12761356604894375688', time=2024-09-12T20:16:33.019781+0000, chain.objs.size()=1 2024-09-12T18:19:53.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.77__shadow_.9tAhp2BJYAAFqQs7gcQoBX-nvWfeJL9_0 2024-09-12T18:19:53.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.586541021987602658', time=2024-09-12T20:18:41.001504+0000, chain.objs.size()=9 2024-09-12T18:19:53.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.103__multipart_key1.2~NEdFwh7k6mQswGztZ-bTvV0acG30m4u.1 2024-09-12T18:19:53.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.103__shadow_key1.2~NEdFwh7k6mQswGztZ-bTvV0acG30m4u.1_1 2024-09-12T18:19:53.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.103__multipart_key1.2~NEdFwh7k6mQswGztZ-bTvV0acG30m4u.2 2024-09-12T18:19:53.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.103__shadow_key1.2~NEdFwh7k6mQswGztZ-bTvV0acG30m4u.2_1 2024-09-12T18:19:53.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.103__multipart_key1.2~NEdFwh7k6mQswGztZ-bTvV0acG30m4u.3 2024-09-12T18:19:53.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.103__shadow_key1.2~NEdFwh7k6mQswGztZ-bTvV0acG30m4u.3_1 2024-09-12T18:19:53.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.103__multipart_key1.2~NEdFwh7k6mQswGztZ-bTvV0acG30m4u.4 2024-09-12T18:19:53.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.103__shadow_key1.2~NEdFwh7k6mQswGztZ-bTvV0acG30m4u.4_1 2024-09-12T18:19:53.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.103__multipart_key1.2~NEdFwh7k6mQswGztZ-bTvV0acG30m4u.5 2024-09-12T18:19:53.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17662846398564147137', time=2024-09-12T20:19:16.568051+0000, chain.objs.size()=1 2024-09-12T18:19:53.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.115__shadow_.BBf7DMWRLIQnyAj5XoRswsB_RFPL1QR_0 2024-09-12T18:19:53.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2524823384530746883', time=2024-09-12T20:19:27.144865+0000, chain.objs.size()=1 2024-09-12T18:19:53.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.958+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.124__shadow_.HX1AM4GOZ41qwv6AZ8CHLqEfnGxqT6x_0 2024-09-12T18:19:53.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5794010517802845502', time=2024-09-12T20:19:36.593050+0000, chain.objs.size()=1 2024-09-12T18:19:53.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.132__shadow_.dtTg2buPdwH-UY2XAuEI82zMuZXUWBt_0 2024-09-12T18:19:53.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14765583049837023764', time=2024-09-12T20:19:40.410791+0000, chain.objs.size()=1 2024-09-12T18:19:53.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.137__shadow_.sVcpw4JUcaVc44kv3J9Z9_EEj68ll2__0 2024-09-12T18:19:53.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15847972986408292219', time=2024-09-12T20:19:52.547900+0000, chain.objs.size()=9 2024-09-12T18:19:53.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.144__multipart_key1/data/file.mpg.2~eAHDMrr6pL9YylF35YuVyG9wGLGI1U2.1 2024-09-12T18:19:53.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.144__shadow_key1/data/file.mpg.2~eAHDMrr6pL9YylF35YuVyG9wGLGI1U2.1_1 2024-09-12T18:19:53.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.144__multipart_key1/data/file.mpg.2~eAHDMrr6pL9YylF35YuVyG9wGLGI1U2.2 2024-09-12T18:19:53.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.144__shadow_key1/data/file.mpg.2~eAHDMrr6pL9YylF35YuVyG9wGLGI1U2.2_1 2024-09-12T18:19:53.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.144__multipart_key1/data/file.mpg.2~eAHDMrr6pL9YylF35YuVyG9wGLGI1U2.3 2024-09-12T18:19:53.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.144__shadow_key1/data/file.mpg.2~eAHDMrr6pL9YylF35YuVyG9wGLGI1U2.3_1 2024-09-12T18:19:53.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.144__multipart_key1/data/file.mpg.2~eAHDMrr6pL9YylF35YuVyG9wGLGI1U2.4 2024-09-12T18:19:53.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.144__shadow_key1/data/file.mpg.2~eAHDMrr6pL9YylF35YuVyG9wGLGI1U2.4_1 2024-09-12T18:19:53.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.966+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.144__multipart_key1/data/file.mpg.2~eAHDMrr6pL9YylF35YuVyG9wGLGI1U2.5 2024-09-12T18:19:53.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.978+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:53.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.982+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:19:53.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:53.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:53.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16957099823316184094', time=2024-09-12T20:17:48.963710+0000, chain.objs.size()=9 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.98__multipart_key1.2~zEnL7lCJ_fEy10a9jxDsM-6y2KaR2_T.1 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.98__shadow_key1.2~zEnL7lCJ_fEy10a9jxDsM-6y2KaR2_T.1_1 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.98__multipart_key1.2~zEnL7lCJ_fEy10a9jxDsM-6y2KaR2_T.2 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.98__shadow_key1.2~zEnL7lCJ_fEy10a9jxDsM-6y2KaR2_T.2_1 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.98__multipart_key1.2~zEnL7lCJ_fEy10a9jxDsM-6y2KaR2_T.3 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.98__shadow_key1.2~zEnL7lCJ_fEy10a9jxDsM-6y2KaR2_T.3_1 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.98__multipart_key1.2~zEnL7lCJ_fEy10a9jxDsM-6y2KaR2_T.4 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.98__shadow_key1.2~zEnL7lCJ_fEy10a9jxDsM-6y2KaR2_T.4_1 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.98__multipart_key1.2~zEnL7lCJ_fEy10a9jxDsM-6y2KaR2_T.5 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5903975917783506445', time=2024-09-12T20:18:10.863494+0000, chain.objs.size()=1 2024-09-12T18:19:53.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.100__shadow_.yc-xW3OKt8VjF77YDAA1uzzNt21hY37_0 2024-09-12T18:19:53.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8080798919779712300', time=2024-09-12T20:19:21.460158+0000, chain.objs.size()=1 2024-09-12T18:19:53.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.119__shadow_.waWaMFRo9IV01KtQBLt7446lkEliK1i_0 2024-09-12T18:19:53.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16385102685869901517', time=2024-09-12T20:19:22.496659+0000, chain.objs.size()=1 2024-09-12T18:19:53.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.986+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.120__shadow_.IWCdjOLVVCWzZb7C9R-5nW8HKUg7LsW_0 2024-09-12T18:19:53.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:53.994+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:54.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.002+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:19:54.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.002+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.006+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.006+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:54.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.006+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9074260171091676551', time=2024-09-12T20:19:16.346634+0000, chain.objs.size()=1 2024-09-12T18:19:54.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.006+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.115__shadow_.-yp-EhXvmHUdM1njBCmsWbga1GQhnzo_0 2024-09-12T18:19:54.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.006+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10306704002417477080', time=2024-09-12T20:19:25.081947+0000, chain.objs.size()=1 2024-09-12T18:19:54.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.006+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.122__shadow_.onENlr-hQKGSU9ZkczcwrX_yv-iZjxF_0 2024-09-12T18:19:54.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.006+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4544401150562554862', time=2024-09-12T20:19:30.975898+0000, chain.objs.size()=1 2024-09-12T18:19:54.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.006+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.127__shadow_.u5aTGaFovRq2B5H9JKef4v8TnEvPpxG_0 2024-09-12T18:19:54.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.006+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16100503674330829330', time=2024-09-12T20:19:41.187874+0000, chain.objs.size()=1 2024-09-12T18:19:54.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.006+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.138__shadow_.XbqQHY5rIya6veu6_V8RSEA5fPsD7Jc_0 2024-09-12T18:19:54.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.010+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:54.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.014+0000 7fc9796879c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:19:54.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.018+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.018+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:54.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='2~uEGv92bRzZ6hqMV8QHQf1otBFKFeOkw', time=2024-09-12T20:16:37.520886+0000, chain.objs.size()=9 2024-09-12T18:19:54.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.79__multipart_key1.2~uEGv92bRzZ6hqMV8QHQf1otBFKFeOkw.1 2024-09-12T18:19:54.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.79__shadow_key1.2~uEGv92bRzZ6hqMV8QHQf1otBFKFeOkw.1_1 2024-09-12T18:19:54.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.79__multipart_key1.2~uEGv92bRzZ6hqMV8QHQf1otBFKFeOkw.2 2024-09-12T18:19:54.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.79__shadow_key1.2~uEGv92bRzZ6hqMV8QHQf1otBFKFeOkw.2_1 2024-09-12T18:19:54.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.79__multipart_key1.2~uEGv92bRzZ6hqMV8QHQf1otBFKFeOkw.3 2024-09-12T18:19:54.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.79__shadow_key1.2~uEGv92bRzZ6hqMV8QHQf1otBFKFeOkw.3_1 2024-09-12T18:19:54.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.79__multipart_key1.2~uEGv92bRzZ6hqMV8QHQf1otBFKFeOkw.4 2024-09-12T18:19:54.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.79__shadow_key1.2~uEGv92bRzZ6hqMV8QHQf1otBFKFeOkw.4_1 2024-09-12T18:19:54.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.79__multipart_key1.2~uEGv92bRzZ6hqMV8QHQf1otBFKFeOkw.5 2024-09-12T18:19:54.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5850167631029735749', time=2024-09-12T20:19:20.268342+0000, chain.objs.size()=1 2024-09-12T18:19:54.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.118__shadow_.odP13itZGejPk5YtNDTFgjN1y7Rvzcm_0 2024-09-12T18:19:54.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2820712585494593555', time=2024-09-12T20:19:35.579393+0000, chain.objs.size()=1 2024-09-12T18:19:54.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.131__shadow_.Bd9PVc6f-EhDUoAmcYgHbDuXD0QHoWX_0 2024-09-12T18:19:54.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1867537676025734871', time=2024-09-12T20:19:41.022718+0000, chain.objs.size()=1 2024-09-12T18:19:54.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.022+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.138__shadow_.hTQDD3vcZf2vvOAH2ZDrw7O-KZxDyb0_0 2024-09-12T18:19:54.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.030+0000 7fc9796879c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:54.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.038+0000 7fc82e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:54.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.042+0000 7fc9796879c0 20 remove_watcher() i=0 2024-09-12T18:19:54.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.042+0000 7fc9796879c0 2 removed watcher, disabling cache 2024-09-12T18:19:54.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.046+0000 7fc9796879c0 20 remove_watcher() i=1 2024-09-12T18:19:54.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.046+0000 7fc9796879c0 20 remove_watcher() i=2 2024-09-12T18:19:54.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.050+0000 7fc9796879c0 20 remove_watcher() i=3 2024-09-12T18:19:54.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.050+0000 7fc9796879c0 20 remove_watcher() i=4 2024-09-12T18:19:54.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.054+0000 7fc9796879c0 20 remove_watcher() i=5 2024-09-12T18:19:54.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.054+0000 7fc9796879c0 20 remove_watcher() i=6 2024-09-12T18:19:54.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.058+0000 7fc9796879c0 20 remove_watcher() i=7 2024-09-12T18:19:54.081 DEBUG:teuthology.orchestra.run.smithi157:> radosgw-admin gc process --include-all 2024-09-12T18:19:54.160 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:54.160 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:54.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.202+0000 7f7c8c0eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:54.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:54.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 20 realm 2024-09-12T18:19:54.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:54.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:54.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:54.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:54.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:54.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:54.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:54.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:54.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:54.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.206+0000 7f7c8c0eb9c0 20 searching for the correct realm 2024-09-12T18:19:54.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.210+0000 7f7c89bf1640 0 -- 172.21.15.157:0/2415869575 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f7c8401e040 msgr2=0x7f7c8401e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:54.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.218+0000 7f7c89bf1640 0 -- 172.21.15.157:0/2415869575 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f7b50080900 msgr2=0x7f7b50082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:54.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.226+0000 7f7c8c0eb9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:19:54.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.226+0000 7f7c8c0eb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:54.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.226+0000 7f7c8c0eb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:54.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.226+0000 7f7c8c0eb9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:19:54.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.226+0000 7f7c8c0eb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:54.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.226+0000 7f7c8c0eb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:54.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.226+0000 7f7c8c0eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:54.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.226+0000 7f7c8c0eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:54.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.226+0000 7f7c8c0eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:54.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:54.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:54.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:54.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 zone default found 2024-09-12T18:19:54.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 4 Realm: () 2024-09-12T18:19:54.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:19:54.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:19:54.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:54.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 zonegroup default 2024-09-12T18:19:54.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:54.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:54.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:54.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:54.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:54.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:54.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 started sync module instance, tier type = 2024-09-12T18:19:54.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.230+0000 7f7c8c0eb9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:19:54.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.246+0000 7f7c8c0eb9c0 20 add_watcher() i=0 2024-09-12T18:19:54.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.246+0000 7f7c8c0eb9c0 20 add_watcher() i=1 2024-09-12T18:19:54.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.246+0000 7f7c8c0eb9c0 20 add_watcher() i=2 2024-09-12T18:19:54.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.246+0000 7f7c8c0eb9c0 20 add_watcher() i=3 2024-09-12T18:19:54.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.246+0000 7f7c8c0eb9c0 20 add_watcher() i=4 2024-09-12T18:19:54.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.246+0000 7f7c8c0eb9c0 20 add_watcher() i=5 2024-09-12T18:19:54.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.246+0000 7f7c8c0eb9c0 20 add_watcher() i=6 2024-09-12T18:19:54.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.246+0000 7f7c8c0eb9c0 20 add_watcher() i=7 2024-09-12T18:19:54.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.246+0000 7f7c8c0eb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:54.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.250+0000 7f7b3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:54.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.250+0000 7f7c8c0eb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:54.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.250+0000 7f7c8c0eb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:54.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.318+0000 7f7b3afe5640 20 reqs_thread_entry: start 2024-09-12T18:19:54.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.318+0000 7f7c8c0eb9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:19:54.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.318+0000 7f7c8c0eb9c0 20 Filter name: none 2024-09-12T18:19:54.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.318+0000 7f7b38fe1640 20 reqs_thread_entry: start 2024-09-12T18:19:54.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.318+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:19:54.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.322+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.322+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.322+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.326+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:19:54.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.330+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.330+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.330+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.334+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:19:54.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.338+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.338+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.342+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.342+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:19:54.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.346+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.346+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.346+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.350+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:19:54.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.350+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.354+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.354+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.354+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:19:54.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.358+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.358+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.358+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.362+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:19:54.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.366+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.366+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.366+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.370+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:19:54.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.370+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.374+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.374+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.374+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:19:54.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.378+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.382+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.382+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.386+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:19:54.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.390+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.390+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.390+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.390+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:19:54.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.394+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.398+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.398+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.402+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:19:54.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.402+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.406+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.406+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.406+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:19:54.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.410+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.410+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.410+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.410+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:19:54.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.414+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.414+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.418+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.418+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:19:54.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.422+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.422+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.422+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.422+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:19:54.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.426+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.426+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.426+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.430+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:19:54.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.434+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.434+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.434+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.434+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:19:54.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.438+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.442+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.442+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.442+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:19:54.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.446+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.446+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.446+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.450+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:19:54.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.454+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.454+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.454+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.458+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:19:54.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.458+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.462+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.462+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.462+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:19:54.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.466+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.466+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.470+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.470+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:19:54.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.474+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.478+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.478+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.478+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:19:54.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.482+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.486+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.486+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.490+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:19:54.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.494+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.494+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.494+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.498+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:19:54.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.498+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.502+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.502+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.506+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:19:54.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.506+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.506+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.506+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.510+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:19:54.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.514+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.514+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.514+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.518+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:19:54.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.522+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.522+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.526+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.530+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:19:54.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.534+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.534+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.534+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.538+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:19:54.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.542+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.542+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.546+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.546+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:19:54.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.550+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.554+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:54.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.558+0000 7f7c8c0eb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:54.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.562+0000 7f7b3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:54.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.566+0000 7f7c8c0eb9c0 20 remove_watcher() i=0 2024-09-12T18:19:54.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.566+0000 7f7c8c0eb9c0 2 removed watcher, disabling cache 2024-09-12T18:19:54.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.570+0000 7f7c8c0eb9c0 20 remove_watcher() i=1 2024-09-12T18:19:54.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.574+0000 7f7c8c0eb9c0 20 remove_watcher() i=2 2024-09-12T18:19:54.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.574+0000 7f7c8c0eb9c0 20 remove_watcher() i=3 2024-09-12T18:19:54.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.578+0000 7f7c8c0eb9c0 20 remove_watcher() i=4 2024-09-12T18:19:54.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.578+0000 7f7c8c0eb9c0 20 remove_watcher() i=5 2024-09-12T18:19:54.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.582+0000 7f7c8c0eb9c0 20 remove_watcher() i=6 2024-09-12T18:19:54.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:54.582+0000 7f7c8c0eb9c0 20 remove_watcher() i=7 2024-09-12T18:19:54.607 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T18:19:54.798 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T18:19:54.798 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T18:19:54.799 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T18:19:54.799 DEBUG:teuthology.orchestra.run.smithi157:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:19:54.805 INFO:teuthology.orchestra.run.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T18:19:55.645 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T18:19:55.646 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T18:19:55.728 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:55.728 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:55.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.766+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.766+0000 7fb364b9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.766+0000 7fb364b9e9c0 20 realm 2024-09-12T18:19:55.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.766+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.766+0000 7fb364b9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.766+0000 7fb364b9e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:55.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.766+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.766+0000 7fb364b9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.766+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.770+0000 7fb364b9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:55.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.770+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.770+0000 7fb364b9e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:55.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.770+0000 7fb364b9e9c0 20 searching for the correct realm 2024-09-12T18:19:55.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.778+0000 7fb362ea5640 0 -- 172.21.15.157:0/3835013958 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x55b4d859a370 msgr2=0x55b4d859c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:55.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.782+0000 7fb3626a4640 0 -- 172.21.15.157:0/3835013958 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fb35806f810 msgr2=0x7fb35805e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:55.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:19:55.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:55.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:55.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:19:55.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:55.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:55.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:55.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:55.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 zone default found 2024-09-12T18:19:55.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 4 Realm: () 2024-09-12T18:19:55.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:19:55.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:19:55.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:55.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 zonegroup default 2024-09-12T18:19:55.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.790+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.794+0000 7fb364b9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.794+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.794+0000 7fb364b9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.794+0000 7fb364b9e9c0 20 started sync module instance, tier type = 2024-09-12T18:19:55.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.794+0000 7fb364b9e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:19:55.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.810+0000 7fb364b9e9c0 20 add_watcher() i=0 2024-09-12T18:19:55.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.810+0000 7fb364b9e9c0 20 add_watcher() i=1 2024-09-12T18:19:55.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.810+0000 7fb364b9e9c0 20 add_watcher() i=2 2024-09-12T18:19:55.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.810+0000 7fb364b9e9c0 20 add_watcher() i=3 2024-09-12T18:19:55.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.810+0000 7fb364b9e9c0 20 add_watcher() i=4 2024-09-12T18:19:55.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.810+0000 7fb364b9e9c0 20 add_watcher() i=5 2024-09-12T18:19:55.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.810+0000 7fb364b9e9c0 20 add_watcher() i=6 2024-09-12T18:19:55.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.810+0000 7fb364b9e9c0 20 add_watcher() i=7 2024-09-12T18:19:55.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.810+0000 7fb364b9e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:55.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb218fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:55.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:55.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:55.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 5 note: GC not initialized 2024-09-12T18:19:55.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb1937fe640 20 reqs_thread_entry: start 2024-09-12T18:19:55.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:19:55.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 20 Filter name: none 2024-09-12T18:19:55.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb1917fa640 20 reqs_thread_entry: start 2024-09-12T18:19:55.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T18:19:55.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T18:19:55.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:55.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T18:19:55.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T18:19:55.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T18:19:55.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:19:55.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.814+0000 7fb364b9e9c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T18:19:55.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.818+0000 7fb364b9e9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:19:55.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.818+0000 7fb364b9e9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:55.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.818+0000 7fb364b9e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T18:19:55.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.818+0000 7fb245ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464437 cookie 94235212240528 notifier 9069 bl.length()=384 2024-09-12T18:19:55.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.818+0000 7fb245ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:19:55.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.818+0000 7fb245ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:55.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.822+0000 7fb364b9e9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T18:19:55.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.822+0000 7fb364b9e9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:55.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.822+0000 7fb364b9e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T18:19:55.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.822+0000 7fb2457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464465 cookie 94235212250848 notifier 9069 bl.length()=225 2024-09-12T18:19:55.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.822+0000 7fb2457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T18:19:55.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.822+0000 7fb2457fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:55.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.826+0000 7fb364b9e9c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T18:19:55.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.826+0000 7fb364b9e9c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:19:55.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.826+0000 7fb364b9e9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T18:19:55.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.826+0000 7fb245ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464361 cookie 94235212245152 notifier 9069 bl.length()=234 2024-09-12T18:19:55.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.826+0000 7fb245ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T18:19:55.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.826+0000 7fb245ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:19:55.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.830+0000 7fb218fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:55.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.834+0000 7fb364b9e9c0 20 remove_watcher() i=0 2024-09-12T18:19:55.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.834+0000 7fb364b9e9c0 2 removed watcher, disabling cache 2024-09-12T18:19:55.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.838+0000 7fb364b9e9c0 20 remove_watcher() i=1 2024-09-12T18:19:55.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.838+0000 7fb364b9e9c0 20 remove_watcher() i=2 2024-09-12T18:19:55.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.842+0000 7fb364b9e9c0 20 remove_watcher() i=3 2024-09-12T18:19:55.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.842+0000 7fb364b9e9c0 20 remove_watcher() i=4 2024-09-12T18:19:55.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.846+0000 7fb364b9e9c0 20 remove_watcher() i=5 2024-09-12T18:19:55.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.846+0000 7fb364b9e9c0 20 remove_watcher() i=6 2024-09-12T18:19:55.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.846+0000 7fb364b9e9c0 20 remove_watcher() i=7 2024-09-12T18:19:55.861 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T18:19:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: "id": "RGW11111111111111111", 2024-09-12T18:19:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: "tenant": "", 2024-09-12T18:19:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T18:19:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T18:19:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: "quota": { 2024-09-12T18:19:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:19:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:19:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:19:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:19:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:19:55.862 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: "max_users": 1000, 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: "max_roles": 1000, 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: "max_groups": 1000, 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T18:19:55.863 INFO:teuthology.orchestra.run.smithi157.stdout: "max_access_keys": 4 2024-09-12T18:19:55.864 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T18:19:55.865 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T18:19:55.865 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key KCKWSNUUFYSKTBWGCQRX --secret dGyEHXQXsvlPhA1GtXdh2bYHijHt+w9CJQW3W/969IRcahTHQ2COxA== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T18:19:55.954 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:55.955 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:55.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.990+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.994+0000 7f21eb6599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.994+0000 7f21eb6599c0 20 realm 2024-09-12T18:19:55.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.994+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.994+0000 7f21eb6599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.994+0000 7f21eb6599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:55.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.994+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.994+0000 7f21eb6599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:55.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.994+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.994+0000 7f21eb6599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:55.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.994+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:55.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.998+0000 7f21eb6599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:55.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:55.998+0000 7f21eb6599c0 20 searching for the correct realm 2024-09-12T18:19:56.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.002+0000 7f21e895e640 0 -- 172.21.15.157:0/4081094702 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f21dc066cc0 msgr2=0x7f21dc05cc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:19:56.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.010+0000 7f21e895e640 0 -- 172.21.15.157:0/4081094702 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f20b40808f0 msgr2=0x7f20b4082d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:56.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:19:56.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:56.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:56.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:19:56.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:56.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:56.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:56.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:56.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 zone default found 2024-09-12T18:19:56.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 4 Realm: () 2024-09-12T18:19:56.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:19:56.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:19:56.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:56.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 zonegroup default 2024-09-12T18:19:56.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 started sync module instance, tier type = 2024-09-12T18:19:56.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.018+0000 7f21eb6599c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:19:56.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.034+0000 7f21eb6599c0 20 add_watcher() i=0 2024-09-12T18:19:56.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.034+0000 7f21eb6599c0 20 add_watcher() i=1 2024-09-12T18:19:56.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.034+0000 7f21eb6599c0 20 add_watcher() i=2 2024-09-12T18:19:56.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.034+0000 7f21eb6599c0 20 add_watcher() i=3 2024-09-12T18:19:56.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.034+0000 7f21eb6599c0 20 add_watcher() i=4 2024-09-12T18:19:56.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.034+0000 7f21eb6599c0 20 add_watcher() i=5 2024-09-12T18:19:56.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.034+0000 7f21eb6599c0 20 add_watcher() i=6 2024-09-12T18:19:56.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.034+0000 7f21eb6599c0 20 add_watcher() i=7 2024-09-12T18:19:56.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.034+0000 7f21eb6599c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:56.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f209ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:56.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:56.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:56.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 5 note: GC not initialized 2024-09-12T18:19:56.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f209efe5640 20 reqs_thread_entry: start 2024-09-12T18:19:56.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 20 init_complete bucket index max shards: 1 2024-09-12T18:19:56.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 20 Filter name: none 2024-09-12T18:19:56.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f209cfe1640 20 reqs_thread_entry: start 2024-09-12T18:19:56.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T18:19:56.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T18:19:56.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:56.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T18:19:56.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T18:19:56.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:19:56.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 10 cache get: name=default.rgw.meta+users.keys+KCKWSNUUFYSKTBWGCQRX : miss 2024-09-12T18:19:56.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 10 cache put: name=default.rgw.meta+users.keys+KCKWSNUUFYSKTBWGCQRX info.flags=0x0 2024-09-12T18:19:56.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 10 adding default.rgw.meta+users.keys+KCKWSNUUFYSKTBWGCQRX to cache LRU end 2024-09-12T18:19:56.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T18:19:56.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.038+0000 7f21eb6599c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f21eb6599c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:19:56.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f21eb6599c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:19:56.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f21eb6599c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:56.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f21eb6599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:56.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f21eb6599c0 10 cache get: name=default.rgw.meta+users.keys+KCKWSNUUFYSKTBWGCQRX : hit (negative entry) 2024-09-12T18:19:56.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f21eb6599c0 10 cache get: name=default.rgw.meta+users.keys+KCKWSNUUFYSKTBWGCQRX : hit (negative entry) 2024-09-12T18:19:56.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f21eb6599c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:19:56.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f21eb6599c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:56.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f21eb6599c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T18:19:56.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f20ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464466 cookie 94348023837760 notifier 8447 bl.length()=673 2024-09-12T18:19:56.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f20ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:19:56.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.042+0000 7f20ccff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:56.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.046+0000 7f21eb6599c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T18:19:56.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.046+0000 7f21eb6599c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:19:56.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.046+0000 7f21eb6599c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T18:19:56.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.046+0000 7f20ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464467 cookie 94348023853408 notifier 8447 bl.length()=185 2024-09-12T18:19:56.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.046+0000 7f20ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T18:19:56.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.046+0000 7f20ccff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:19:56.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.050+0000 7f21eb6599c0 10 cache put: name=default.rgw.meta+users.keys+KCKWSNUUFYSKTBWGCQRX info.flags=0x7 2024-09-12T18:19:56.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.050+0000 7f21eb6599c0 10 moving default.rgw.meta+users.keys+KCKWSNUUFYSKTBWGCQRX to cache LRU end 2024-09-12T18:19:56.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.050+0000 7f21eb6599c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:KCKWSNUUFYSKTBWGCQRX, ofs0, ns] 2024-09-12T18:19:56.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.050+0000 7f20bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464389 cookie 94348023846752 notifier 8447 bl.length()=186 2024-09-12T18:19:56.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.050+0000 7f20bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KCKWSNUUFYSKTBWGCQRX info.flags=0x7 2024-09-12T18:19:56.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.050+0000 7f20bbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KCKWSNUUFYSKTBWGCQRX to cache LRU end 2024-09-12T18:19:56.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.054+0000 7f21eb6599c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T18:19:56.059 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T18:19:56.059 INFO:teuthology.orchestra.run.smithi157.stdout: "user_id": "foo.client.0", 2024-09-12T18:19:56.059 INFO:teuthology.orchestra.run.smithi157.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T18:19:56.059 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "foo+test@test.test", 2024-09-12T18:19:56.059 INFO:teuthology.orchestra.run.smithi157.stdout: "suspended": 0, 2024-09-12T18:19:56.059 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T18:19:56.059 INFO:teuthology.orchestra.run.smithi157.stdout: "subusers": [], 2024-09-12T18:19:56.059 INFO:teuthology.orchestra.run.smithi157.stdout: "keys": [ 2024-09-12T18:19:56.059 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T18:19:56.059 INFO:teuthology.orchestra.run.smithi157.stdout: "user": "foo.client.0", 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: "access_key": "KCKWSNUUFYSKTBWGCQRX", 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: "secret_key": "dGyEHXQXsvlPhA1GtXdh2bYHijHt+w9CJQW3W/969IRcahTHQ2COxA==", 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: "active": true, 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:19:56.043964Z" 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: "swift_keys": [], 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": [], 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: "default_placement": "", 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: "default_storage_class": "", 2024-09-12T18:19:56.060 INFO:teuthology.orchestra.run.smithi157.stdout: "placement_tags": [], 2024-09-12T18:19:56.061 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T18:19:56.061 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:19:56.061 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:19:56.061 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:19:56.061 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:19:56.061 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:19:56.061 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:19:56.061 INFO:teuthology.orchestra.run.smithi157.stdout: "user_quota": { 2024-09-12T18:19:56.061 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:19:56.061 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:19:56.062 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:19:56.062 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:19:56.062 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:19:56.062 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:19:56.062 INFO:teuthology.orchestra.run.smithi157.stdout: "temp_url_keys": [], 2024-09-12T18:19:56.062 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "root", 2024-09-12T18:19:56.062 INFO:teuthology.orchestra.run.smithi157.stdout: "mfa_ids": [], 2024-09-12T18:19:56.062 INFO:teuthology.orchestra.run.smithi157.stdout: "account_id": "RGW11111111111111111", 2024-09-12T18:19:56.062 INFO:teuthology.orchestra.run.smithi157.stdout: "path": "/", 2024-09-12T18:19:56.062 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:19:56.043947Z", 2024-09-12T18:19:56.062 INFO:teuthology.orchestra.run.smithi157.stdout: "tags": [], 2024-09-12T18:19:56.063 INFO:teuthology.orchestra.run.smithi157.stdout: "group_ids": [] 2024-09-12T18:19:56.063 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T18:19:56.063 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:56.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.058+0000 7f209ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:56.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.062+0000 7f21eb6599c0 20 remove_watcher() i=0 2024-09-12T18:19:56.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.062+0000 7f21eb6599c0 2 removed watcher, disabling cache 2024-09-12T18:19:56.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.062+0000 7f21eb6599c0 20 remove_watcher() i=1 2024-09-12T18:19:56.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.066+0000 7f21eb6599c0 20 remove_watcher() i=2 2024-09-12T18:19:56.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.066+0000 7f21eb6599c0 20 remove_watcher() i=3 2024-09-12T18:19:56.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.070+0000 7f21eb6599c0 20 remove_watcher() i=4 2024-09-12T18:19:56.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.070+0000 7f21eb6599c0 20 remove_watcher() i=5 2024-09-12T18:19:56.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.070+0000 7f21eb6599c0 20 remove_watcher() i=6 2024-09-12T18:19:56.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.074+0000 7f21eb6599c0 20 remove_watcher() i=7 2024-09-12T18:19:56.090 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 7603734738 --totp-seed WHG6WCYRCPNTAY6RWI76DIO75I6YQXYBC5FODTOZXGFGPHKRJCOIELJVGDXQCI77 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:19:56.130 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:56.131 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:56.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.166+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.170+0000 7f72380db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.170+0000 7f72380db9c0 20 realm 2024-09-12T18:19:56.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.170+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.170+0000 7f72380db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.170+0000 7f72380db9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:56.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.170+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.170+0000 7f72380db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.170+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.170+0000 7f72380db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:56.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.170+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.174+0000 7f72380db9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:56.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.174+0000 7f72380db9c0 20 searching for the correct realm 2024-09-12T18:19:56.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.178+0000 7f72353e0640 0 -- 172.21.15.157:0/3840865378 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f722c065540 msgr2=0x7f722c0204b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:56.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.182+0000 7f72353e0640 0 -- 172.21.15.157:0/3840865378 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f7100080900 msgr2=0x7f7100082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:56.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.190+0000 7f72380db9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:19:56.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.190+0000 7f72380db9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:56.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.190+0000 7f72380db9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:56.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.190+0000 7f72380db9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:19:56.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.190+0000 7f72380db9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:56.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.190+0000 7f72380db9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:56.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.190+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.190+0000 7f72380db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.190+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 zone default found 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 4 Realm: () 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 zonegroup default 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:56.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 started sync module instance, tier type = 2024-09-12T18:19:56.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.194+0000 7f72380db9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:19:56.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.210+0000 7f72380db9c0 20 add_watcher() i=0 2024-09-12T18:19:56.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.210+0000 7f72380db9c0 20 add_watcher() i=1 2024-09-12T18:19:56.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.210+0000 7f72380db9c0 20 add_watcher() i=2 2024-09-12T18:19:56.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.210+0000 7f72380db9c0 20 add_watcher() i=3 2024-09-12T18:19:56.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.210+0000 7f72380db9c0 20 add_watcher() i=4 2024-09-12T18:19:56.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.210+0000 7f72380db9c0 20 add_watcher() i=5 2024-09-12T18:19:56.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.210+0000 7f72380db9c0 20 add_watcher() i=6 2024-09-12T18:19:56.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.210+0000 7f72380db9c0 20 add_watcher() i=7 2024-09-12T18:19:56.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.210+0000 7f72380db9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:56.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f70e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:56.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f72380db9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:56.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f72380db9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:56.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f72380db9c0 5 note: GC not initialized 2024-09-12T18:19:56.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f70e67fc640 20 reqs_thread_entry: start 2024-09-12T18:19:56.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f72380db9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:19:56.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f72380db9c0 20 Filter name: none 2024-09-12T18:19:56.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f7057fff640 20 reqs_thread_entry: start 2024-09-12T18:19:56.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f72380db9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T18:19:56.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f72380db9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:56.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f72380db9c0 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T18:19:56.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f72380db9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T18:19:56.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f72380db9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:56.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:56.214+0000 7f72380db9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:57.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.870+0000 7f72380db9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:19:57.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.870+0000 7f72380db9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:57.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.870+0000 7f72380db9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T18:19:57.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.870+0000 7f7118ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399060 cookie 94767402784224 notifier 8462 bl.length()=687 2024-09-12T18:19:57.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.870+0000 7f7118ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:19:57.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.870+0000 7f7118ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:57.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.878+0000 7f70e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:57.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.882+0000 7f72380db9c0 20 remove_watcher() i=0 2024-09-12T18:19:57.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.882+0000 7f72380db9c0 2 removed watcher, disabling cache 2024-09-12T18:19:57.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.886+0000 7f72380db9c0 20 remove_watcher() i=1 2024-09-12T18:19:57.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.886+0000 7f72380db9c0 20 remove_watcher() i=2 2024-09-12T18:19:57.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.890+0000 7f72380db9c0 20 remove_watcher() i=3 2024-09-12T18:19:57.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.894+0000 7f72380db9c0 20 remove_watcher() i=4 2024-09-12T18:19:57.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.894+0000 7f72380db9c0 20 remove_watcher() i=5 2024-09-12T18:19:57.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.898+0000 7f72380db9c0 20 remove_watcher() i=6 2024-09-12T18:19:57.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:57.898+0000 7f72380db9c0 20 remove_watcher() i=7 2024-09-12T18:19:57.925 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T18:19:57.925 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key LODWLMGSZXGILEIFNHBF --secret my5UGFcaAHk11ovaaLJmfzYLBPejAR2biwezMzPxxF63iDP1XBK8gA== --cluster ceph 2024-09-12T18:19:58.012 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:58.012 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:58.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.050+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.050+0000 7f77f2b8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.050+0000 7f77f2b8d9c0 20 realm 2024-09-12T18:19:58.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.050+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.050+0000 7f77f2b8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.050+0000 7f77f2b8d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:58.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.054+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.054+0000 7f77f2b8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.054+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.054+0000 7f77f2b8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:58.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.054+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.054+0000 7f77f2b8d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:58.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.054+0000 7f77f2b8d9c0 20 searching for the correct realm 2024-09-12T18:19:58.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.058+0000 7f77f0693640 0 -- 172.21.15.157:0/4069726140 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7f77e805c5b0 msgr2=0x7f77e8078d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:58.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.066+0000 7f77f0693640 0 -- 172.21.15.157:0/4069726140 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f77e406dfa0 msgr2=0x7f77e4038750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:58.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.282+0000 7f77f2b8d9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:19:58.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.282+0000 7f77f2b8d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:58.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.282+0000 7f77f2b8d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:58.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.282+0000 7f77f2b8d9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:19:58.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.282+0000 7f77f2b8d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:58.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.282+0000 7f77f2b8d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:58.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.282+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.282+0000 7f77f2b8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.282+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:58.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:58.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 20 zone default found 2024-09-12T18:19:58.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 4 Realm: () 2024-09-12T18:19:58.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:19:58.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:19:58.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:58.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 20 zonegroup default 2024-09-12T18:19:58.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.286+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.290+0000 7f77f2b8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.290+0000 7f77f2b8d9c0 20 started sync module instance, tier type = 2024-09-12T18:19:58.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.290+0000 7f77f2b8d9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:19:58.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.310+0000 7f77f2b8d9c0 20 add_watcher() i=0 2024-09-12T18:19:58.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.310+0000 7f77f2b8d9c0 20 add_watcher() i=1 2024-09-12T18:19:58.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.310+0000 7f77f2b8d9c0 20 add_watcher() i=2 2024-09-12T18:19:58.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.310+0000 7f77f2b8d9c0 20 add_watcher() i=3 2024-09-12T18:19:58.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.310+0000 7f77f2b8d9c0 20 add_watcher() i=4 2024-09-12T18:19:58.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.310+0000 7f77f2b8d9c0 20 add_watcher() i=5 2024-09-12T18:19:58.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.310+0000 7f77f2b8d9c0 20 add_watcher() i=6 2024-09-12T18:19:58.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.314+0000 7f77f2b8d9c0 20 add_watcher() i=7 2024-09-12T18:19:58.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.314+0000 7f77f2b8d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:58.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f76a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:58.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:58.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:58.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 5 note: GC not initialized 2024-09-12T18:19:58.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f76a5fe3640 20 reqs_thread_entry: start 2024-09-12T18:19:58.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:19:58.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 20 Filter name: none 2024-09-12T18:19:58.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f769effd640 20 reqs_thread_entry: start 2024-09-12T18:19:58.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T18:19:58.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T18:19:58.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:58.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T18:19:58.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T18:19:58.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:19:58.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 10 cache get: name=default.rgw.meta+users.keys+LODWLMGSZXGILEIFNHBF : miss 2024-09-12T18:19:58.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 10 cache put: name=default.rgw.meta+users.keys+LODWLMGSZXGILEIFNHBF info.flags=0x0 2024-09-12T18:19:58.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 10 adding default.rgw.meta+users.keys+LODWLMGSZXGILEIFNHBF to cache LRU end 2024-09-12T18:19:58.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 10 cache get: name=default.rgw.meta+users.keys+LODWLMGSZXGILEIFNHBF : hit (negative entry) 2024-09-12T18:19:58.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.318+0000 7f77f2b8d9c0 10 cache get: name=default.rgw.meta+users.keys+LODWLMGSZXGILEIFNHBF : hit (negative entry) 2024-09-12T18:19:58.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.322+0000 7f77f2b8d9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:19:58.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.322+0000 7f77f2b8d9c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:58.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.322+0000 7f77f2b8d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T18:19:58.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.322+0000 7f76c77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399030 cookie 94232022478384 notifier 9120 bl.length()=645 2024-09-12T18:19:58.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.322+0000 7f76c77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:19:58.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.322+0000 7f76c77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:58.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.326+0000 7f77f2b8d9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T18:19:58.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.326+0000 7f77f2b8d9c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:19:58.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.326+0000 7f77f2b8d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T18:19:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.326+0000 7f76c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398981 cookie 94232022493872 notifier 9120 bl.length()=185 2024-09-12T18:19:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.326+0000 7f76c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T18:19:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.326+0000 7f76c6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:19:58.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.330+0000 7f77f2b8d9c0 10 cache put: name=default.rgw.meta+users.keys+LODWLMGSZXGILEIFNHBF info.flags=0x7 2024-09-12T18:19:58.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.330+0000 7f77f2b8d9c0 10 moving default.rgw.meta+users.keys+LODWLMGSZXGILEIFNHBF to cache LRU end 2024-09-12T18:19:58.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.330+0000 7f77f2b8d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:LODWLMGSZXGILEIFNHBF, ofs0, ns] 2024-09-12T18:19:58.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.330+0000 7f76c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398938 cookie 94232022499168 notifier 9120 bl.length()=186 2024-09-12T18:19:58.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.330+0000 7f76c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LODWLMGSZXGILEIFNHBF info.flags=0x7 2024-09-12T18:19:58.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.330+0000 7f76c6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LODWLMGSZXGILEIFNHBF to cache LRU end 2024-09-12T18:19:58.336 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T18:19:58.336 INFO:teuthology.orchestra.run.smithi157.stdout: "user_id": "bar.client.0", 2024-09-12T18:19:58.336 INFO:teuthology.orchestra.run.smithi157.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T18:19:58.336 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "bar+test@test.test", 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: "suspended": 0, 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: "subusers": [], 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: "keys": [ 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: "user": "bar.client.0", 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: "access_key": "LODWLMGSZXGILEIFNHBF", 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: "secret_key": "my5UGFcaAHk11ovaaLJmfzYLBPejAR2biwezMzPxxF63iDP1XBK8gA==", 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: "active": true, 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:19:58.322460Z" 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-12T18:19:58.337 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "swift_keys": [], 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": [], 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "default_placement": "", 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "default_storage_class": "", 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "placement_tags": [], 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:19:58.338 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "user_quota": { 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "temp_url_keys": [], 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "rgw", 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "mfa_ids": [], 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "account_id": "", 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "path": "/", 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:19:58.322443Z", 2024-09-12T18:19:58.339 INFO:teuthology.orchestra.run.smithi157.stdout: "tags": [], 2024-09-12T18:19:58.340 INFO:teuthology.orchestra.run.smithi157.stdout: "group_ids": [] 2024-09-12T18:19:58.340 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T18:19:58.340 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:58.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.334+0000 7f76a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:58.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.338+0000 7f77f2b8d9c0 20 remove_watcher() i=0 2024-09-12T18:19:58.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.338+0000 7f77f2b8d9c0 2 removed watcher, disabling cache 2024-09-12T18:19:58.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.342+0000 7f77f2b8d9c0 20 remove_watcher() i=1 2024-09-12T18:19:58.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.342+0000 7f77f2b8d9c0 20 remove_watcher() i=2 2024-09-12T18:19:58.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.346+0000 7f77f2b8d9c0 20 remove_watcher() i=3 2024-09-12T18:19:58.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.346+0000 7f77f2b8d9c0 20 remove_watcher() i=4 2024-09-12T18:19:58.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.350+0000 7f77f2b8d9c0 20 remove_watcher() i=5 2024-09-12T18:19:58.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.350+0000 7f77f2b8d9c0 20 remove_watcher() i=6 2024-09-12T18:19:58.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.354+0000 7f77f2b8d9c0 20 remove_watcher() i=7 2024-09-12T18:19:58.371 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 3669062675 --totp-seed 67QG6NMWBNB6DMOJCAKFOTOIULF2SF7VTO7XK5FAFGNHZ67EAFQOV4RB6ICRWPKK --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:19:58.413 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:58.413 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:58.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.450+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.450+0000 7f79e57b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.454+0000 7f79e57b29c0 20 realm 2024-09-12T18:19:58.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.454+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.454+0000 7f79e57b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.454+0000 7f79e57b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:58.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.454+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.454+0000 7f79e57b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.454+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.454+0000 7f79e57b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:58.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.454+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.454+0000 7f79e57b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:58.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.454+0000 7f79e57b29c0 20 searching for the correct realm 2024-09-12T18:19:58.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.462+0000 7f79e2ab7640 0 -- 172.21.15.157:0/2990623743 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f79cc0ac260 msgr2=0x7f79cc0fa390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:58.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.466+0000 7f79e2ab7640 0 -- 172.21.15.157:0/2990623743 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f78ac0815e0 msgr2=0x7f78ac083a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:58.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:19:58.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:58.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:58.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:19:58.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:58.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:58.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 zone default found 2024-09-12T18:19:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 4 Realm: () 2024-09-12T18:19:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:19:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:19:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:58.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 zonegroup default 2024-09-12T18:19:58.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 started sync module instance, tier type = 2024-09-12T18:19:58.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.474+0000 7f79e57b29c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:19:58.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.490+0000 7f79e57b29c0 20 add_watcher() i=0 2024-09-12T18:19:58.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.490+0000 7f79e57b29c0 20 add_watcher() i=1 2024-09-12T18:19:58.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.490+0000 7f79e57b29c0 20 add_watcher() i=2 2024-09-12T18:19:58.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.490+0000 7f79e57b29c0 20 add_watcher() i=3 2024-09-12T18:19:58.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.490+0000 7f79e57b29c0 20 add_watcher() i=4 2024-09-12T18:19:58.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.490+0000 7f79e57b29c0 20 add_watcher() i=5 2024-09-12T18:19:58.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.490+0000 7f79e57b29c0 20 add_watcher() i=6 2024-09-12T18:19:58.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.490+0000 7f79e57b29c0 20 add_watcher() i=7 2024-09-12T18:19:58.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.490+0000 7f79e57b29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:58.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.494+0000 7f7899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:58.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.494+0000 7f79e57b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:58.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.494+0000 7f79e57b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:58.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.494+0000 7f79e57b29c0 5 note: GC not initialized 2024-09-12T18:19:58.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.494+0000 7f7898fe1640 20 reqs_thread_entry: start 2024-09-12T18:19:58.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.494+0000 7f79e57b29c0 20 init_complete bucket index max shards: 1 2024-09-12T18:19:58.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.494+0000 7f79e57b29c0 20 Filter name: none 2024-09-12T18:19:58.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.494+0000 7f78127fc640 20 reqs_thread_entry: start 2024-09-12T18:19:58.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.494+0000 7f79e57b29c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T18:19:58.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.494+0000 7f79e57b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.498+0000 7f79e57b29c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T18:19:58.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.498+0000 7f79e57b29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T18:19:58.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.498+0000 7f79e57b29c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:58.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.498+0000 7f79e57b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:58.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.502+0000 7f79e57b29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:19:58.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.502+0000 7f79e57b29c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:58.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.502+0000 7f79e57b29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T18:19:58.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.502+0000 7f78c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399031 cookie 94001712828192 notifier 9138 bl.length()=659 2024-09-12T18:19:58.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.502+0000 7f78c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:19:58.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.502+0000 7f78c6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:58.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.506+0000 7f7899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:58.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.510+0000 7f79e57b29c0 20 remove_watcher() i=0 2024-09-12T18:19:58.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.510+0000 7f79e57b29c0 2 removed watcher, disabling cache 2024-09-12T18:19:58.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.514+0000 7f79e57b29c0 20 remove_watcher() i=1 2024-09-12T18:19:58.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.514+0000 7f79e57b29c0 20 remove_watcher() i=2 2024-09-12T18:19:58.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.518+0000 7f79e57b29c0 20 remove_watcher() i=3 2024-09-12T18:19:58.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.518+0000 7f79e57b29c0 20 remove_watcher() i=4 2024-09-12T18:19:58.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.518+0000 7f79e57b29c0 20 remove_watcher() i=5 2024-09-12T18:19:58.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.522+0000 7f79e57b29c0 20 remove_watcher() i=6 2024-09-12T18:19:58.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.522+0000 7f79e57b29c0 20 remove_watcher() i=7 2024-09-12T18:19:58.539 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-12T18:19:58.539 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key VCXORBEOTPSGFAEVGLTT --secret UOQyuhapOrlVJd4R9ZuZf88gbqnMwA4wdW3rK7pdd4gQW2Mdyse+9Q== --cluster ceph 2024-09-12T18:19:58.630 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:58.630 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:58.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.666+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 20 realm 2024-09-12T18:19:58.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:58.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:58.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:58.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.670+0000 7fbeb5d5e9c0 20 searching for the correct realm 2024-09-12T18:19:58.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.678+0000 7fbeb4065640 0 -- 172.21.15.157:0/1504692314 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x55ff79c53100 msgr2=0x55ff79c555c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:19:58.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.682+0000 7fbeb3864640 0 -- 172.21.15.157:0/1504692314 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fbea8066830 msgr2=0x7fbea807d1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:58.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.942+0000 7fbeb5d5e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:19:58.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.942+0000 7fbeb5d5e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:58.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.942+0000 7fbeb5d5e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:58.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.942+0000 7fbeb5d5e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:19:58.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.942+0000 7fbeb5d5e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:58.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.942+0000 7fbeb5d5e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:58.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.942+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.942+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.942+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.942+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.942+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 20 zone default found 2024-09-12T18:19:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 4 Realm: () 2024-09-12T18:19:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:19:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:19:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 20 zonegroup default 2024-09-12T18:19:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 20 started sync module instance, tier type = 2024-09-12T18:19:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.946+0000 7fbeb5d5e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:19:58.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.970+0000 7fbeb5d5e9c0 20 add_watcher() i=0 2024-09-12T18:19:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.970+0000 7fbeb5d5e9c0 20 add_watcher() i=1 2024-09-12T18:19:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.970+0000 7fbeb5d5e9c0 20 add_watcher() i=2 2024-09-12T18:19:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.970+0000 7fbeb5d5e9c0 20 add_watcher() i=3 2024-09-12T18:19:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.970+0000 7fbeb5d5e9c0 20 add_watcher() i=4 2024-09-12T18:19:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.970+0000 7fbeb5d5e9c0 20 add_watcher() i=5 2024-09-12T18:19:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.970+0000 7fbeb5d5e9c0 20 add_watcher() i=6 2024-09-12T18:19:58.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.970+0000 7fbeb5d5e9c0 20 add_watcher() i=7 2024-09-12T18:19:58.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.970+0000 7fbeb5d5e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:58.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.974+0000 7fbd69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:58.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.974+0000 7fbeb5d5e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:58.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.974+0000 7fbeb5d5e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:58.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.974+0000 7fbeb5d5e9c0 5 note: GC not initialized 2024-09-12T18:19:58.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.974+0000 7fbd68fe1640 20 reqs_thread_entry: start 2024-09-12T18:19:58.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.974+0000 7fbeb5d5e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:19:58.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 20 Filter name: none 2024-09-12T18:19:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbce27fc640 20 reqs_thread_entry: start 2024-09-12T18:19:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T18:19:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T18:19:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T18:19:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T18:19:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:19:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 10 cache get: name=default.rgw.meta+users.keys+VCXORBEOTPSGFAEVGLTT : miss 2024-09-12T18:19:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:58.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:58.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 10 cache put: name=default.rgw.meta+users.keys+VCXORBEOTPSGFAEVGLTT info.flags=0x0 2024-09-12T18:19:58.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 10 adding default.rgw.meta+users.keys+VCXORBEOTPSGFAEVGLTT to cache LRU end 2024-09-12T18:19:58.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 10 cache get: name=default.rgw.meta+users.keys+VCXORBEOTPSGFAEVGLTT : hit (negative entry) 2024-09-12T18:19:58.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.978+0000 7fbeb5d5e9c0 10 cache get: name=default.rgw.meta+users.keys+VCXORBEOTPSGFAEVGLTT : hit (negative entry) 2024-09-12T18:19:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.982+0000 7fbeb5d5e9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:19:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.982+0000 7fbeb5d5e9c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.982+0000 7fbeb5d5e9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T18:19:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.982+0000 7fbd92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366278 cookie 94555748012592 notifier 8513 bl.length()=719 2024-09-12T18:19:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.982+0000 7fbd92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:19:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.982+0000 7fbd92ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.986+0000 7fbeb5d5e9c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T18:19:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.986+0000 7fbeb5d5e9c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:19:58.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.986+0000 7fbeb5d5e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T18:19:58.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.986+0000 7fbd927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366235 cookie 94555748009312 notifier 8513 bl.length()=215 2024-09-12T18:19:58.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.986+0000 7fbd927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T18:19:58.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.986+0000 7fbd927fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:19:58.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.990+0000 7fbeb5d5e9c0 10 cache put: name=default.rgw.meta+users.keys+VCXORBEOTPSGFAEVGLTT info.flags=0x7 2024-09-12T18:19:58.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.990+0000 7fbeb5d5e9c0 10 moving default.rgw.meta+users.keys+VCXORBEOTPSGFAEVGLTT to cache LRU end 2024-09-12T18:19:58.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.990+0000 7fbeb5d5e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:VCXORBEOTPSGFAEVGLTT, ofs0, ns] 2024-09-12T18:19:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.990+0000 7fbd927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366357 cookie 94555748008160 notifier 8513 bl.length()=201 2024-09-12T18:19:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.990+0000 7fbd927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VCXORBEOTPSGFAEVGLTT info.flags=0x7 2024-09-12T18:19:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.990+0000 7fbd927fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VCXORBEOTPSGFAEVGLTT to cache LRU end 2024-09-12T18:19:58.998 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T18:19:58.998 INFO:teuthology.orchestra.run.smithi157.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T18:19:58.998 INFO:teuthology.orchestra.run.smithi157.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-12T18:19:58.998 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T18:19:58.998 INFO:teuthology.orchestra.run.smithi157.stdout: "suspended": 0, 2024-09-12T18:19:58.998 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T18:19:58.998 INFO:teuthology.orchestra.run.smithi157.stdout: "subusers": [], 2024-09-12T18:19:58.998 INFO:teuthology.orchestra.run.smithi157.stdout: "keys": [ 2024-09-12T18:19:58.998 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T18:19:58.998 INFO:teuthology.orchestra.run.smithi157.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: "access_key": "VCXORBEOTPSGFAEVGLTT", 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: "secret_key": "UOQyuhapOrlVJd4R9ZuZf88gbqnMwA4wdW3rK7pdd4gQW2Mdyse+9Q==", 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: "active": true, 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:19:58.982151Z" 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: "swift_keys": [], 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": [], 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: "default_placement": "", 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: "default_storage_class": "", 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: "placement_tags": [], 2024-09-12T18:19:58.999 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: "user_quota": { 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:19:59.000 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:19:59.001 INFO:teuthology.orchestra.run.smithi157.stdout: "temp_url_keys": [], 2024-09-12T18:19:59.001 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "rgw", 2024-09-12T18:19:59.001 INFO:teuthology.orchestra.run.smithi157.stdout: "mfa_ids": [], 2024-09-12T18:19:59.001 INFO:teuthology.orchestra.run.smithi157.stdout: "account_id": "", 2024-09-12T18:19:59.001 INFO:teuthology.orchestra.run.smithi157.stdout: "path": "/", 2024-09-12T18:19:59.001 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:19:58.982100Z", 2024-09-12T18:19:59.001 INFO:teuthology.orchestra.run.smithi157.stdout: "tags": [], 2024-09-12T18:19:59.001 INFO:teuthology.orchestra.run.smithi157.stdout: "group_ids": [] 2024-09-12T18:19:59.001 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T18:19:59.001 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:19:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:58.998+0000 7fbd69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:59.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.002+0000 7fbeb5d5e9c0 20 remove_watcher() i=0 2024-09-12T18:19:59.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.002+0000 7fbeb5d5e9c0 2 removed watcher, disabling cache 2024-09-12T18:19:59.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.002+0000 7fbeb5d5e9c0 20 remove_watcher() i=1 2024-09-12T18:19:59.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.006+0000 7fbeb5d5e9c0 20 remove_watcher() i=2 2024-09-12T18:19:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.010+0000 7fbeb5d5e9c0 20 remove_watcher() i=3 2024-09-12T18:19:59.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.010+0000 7fbeb5d5e9c0 20 remove_watcher() i=4 2024-09-12T18:19:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.010+0000 7fbeb5d5e9c0 20 remove_watcher() i=5 2024-09-12T18:19:59.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.014+0000 7fbeb5d5e9c0 20 remove_watcher() i=6 2024-09-12T18:19:59.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.014+0000 7fbeb5d5e9c0 20 remove_watcher() i=7 2024-09-12T18:19:59.035 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 1475950248 --totp-seed C4MCQZAVQ6VI6V4RNLT57TORKEUCCH5DHWOANYJ5AJ4XYIMDL7V4TS5V7CS7HKSW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:19:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:59.118 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.154+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.158+0000 7f716368e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:59.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.158+0000 7f716368e9c0 20 realm 2024-09-12T18:19:59.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.158+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.158+0000 7f716368e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.158+0000 7f716368e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.158+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.158+0000 7f716368e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.158+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.158+0000 7f716368e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.158+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.162+0000 7f716368e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.162+0000 7f716368e9c0 20 searching for the correct realm 2024-09-12T18:19:59.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.166+0000 7f7161995640 0 -- 172.21.15.157:0/4129481547 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x5608342046b0 msgr2=0x560834206b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:59.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.174+0000 7f7160993640 0 -- 172.21.15.157:0/4129481547 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f71581065e0 msgr2=0x7f7158106a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:59.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:19:59.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:59.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:59.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:19:59.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:59.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:59.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.178+0000 7f716368e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 20 zone default found 2024-09-12T18:19:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 4 Realm: () 2024-09-12T18:19:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:19:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:19:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 20 zonegroup default 2024-09-12T18:19:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 20 started sync module instance, tier type = 2024-09-12T18:19:59.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.182+0000 7f716368e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:19:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.194+0000 7f716368e9c0 20 add_watcher() i=0 2024-09-12T18:19:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.194+0000 7f716368e9c0 20 add_watcher() i=1 2024-09-12T18:19:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.194+0000 7f716368e9c0 20 add_watcher() i=2 2024-09-12T18:19:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.194+0000 7f716368e9c0 20 add_watcher() i=3 2024-09-12T18:19:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.194+0000 7f716368e9c0 20 add_watcher() i=4 2024-09-12T18:19:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.194+0000 7f716368e9c0 20 add_watcher() i=5 2024-09-12T18:19:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.194+0000 7f716368e9c0 20 add_watcher() i=6 2024-09-12T18:19:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f716368e9c0 20 add_watcher() i=7 2024-09-12T18:19:59.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f716368e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f7017fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f716368e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f716368e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f716368e9c0 5 note: GC not initialized 2024-09-12T18:19:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f7016fe5640 20 reqs_thread_entry: start 2024-09-12T18:19:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f716368e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:19:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f716368e9c0 20 Filter name: none 2024-09-12T18:19:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f7014fe1640 20 reqs_thread_entry: start 2024-09-12T18:19:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f716368e9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T18:19:59.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.198+0000 7f716368e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.202+0000 7f716368e9c0 20 rados_obj.operate() r=0 bl.length=519 2024-09-12T18:19:59.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.202+0000 7f716368e9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T18:19:59.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.202+0000 7f716368e9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:59.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.202+0000 7f716368e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:59.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.206+0000 7f716368e9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:19:59.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.206+0000 7f716368e9c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:59.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.206+0000 7f716368e9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T18:19:59.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.206+0000 7f7044ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94593234336336 notifier 9177 bl.length()=733 2024-09-12T18:19:59.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.206+0000 7f7044ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:19:59.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.206+0000 7f7044ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:59.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.210+0000 7f7017fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.214+0000 7f716368e9c0 20 remove_watcher() i=0 2024-09-12T18:19:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.214+0000 7f716368e9c0 2 removed watcher, disabling cache 2024-09-12T18:19:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.214+0000 7f716368e9c0 20 remove_watcher() i=1 2024-09-12T18:19:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.218+0000 7f716368e9c0 20 remove_watcher() i=2 2024-09-12T18:19:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.218+0000 7f716368e9c0 20 remove_watcher() i=3 2024-09-12T18:19:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.222+0000 7f716368e9c0 20 remove_watcher() i=4 2024-09-12T18:19:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.222+0000 7f716368e9c0 20 remove_watcher() i=5 2024-09-12T18:19:59.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.222+0000 7f716368e9c0 20 remove_watcher() i=6 2024-09-12T18:19:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.226+0000 7f716368e9c0 20 remove_watcher() i=7 2024-09-12T18:19:59.241 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T18:19:59.242 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key OGAMSRSMBDKPMIJSZQDL --secret lpbcQUe0txFJFZ3x/EKz6Tnfrx61QmsbiJA8FvME7cNwHIT32kWjYA== --cluster ceph 2024-09-12T18:19:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.362+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 20 realm 2024-09-12T18:19:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:59.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.366+0000 7fd56e4939c0 20 searching for the correct realm 2024-09-12T18:19:59.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.374+0000 7fd56c79a640 0 -- 172.21.15.157:0/756992501 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fd5540c1430 msgr2=0x7fd5540c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:19:59.994+0000 7fd56c79a640 0 -- 172.21.15.157:0/756992501 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fd5540c1430 msgr2=0x7fd5540c1890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.002+0000 7fd56e4939c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:20:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.002+0000 7fd56e4939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:20:00.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.002+0000 7fd56e4939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:20:00.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.002+0000 7fd56e4939c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:20:00.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.002+0000 7fd56e4939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:20:00.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.002+0000 7fd56e4939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:20:00.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.002+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.002+0000 7fd56e4939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.002+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:00.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:20:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 zone default found 2024-09-12T18:20:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 4 Realm: () 2024-09-12T18:20:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:20:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:20:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:20:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 zonegroup default 2024-09-12T18:20:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 started sync module instance, tier type = 2024-09-12T18:20:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.006+0000 7fd56e4939c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:20:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.030+0000 7fd56e4939c0 20 add_watcher() i=0 2024-09-12T18:20:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.030+0000 7fd56e4939c0 20 add_watcher() i=1 2024-09-12T18:20:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.030+0000 7fd56e4939c0 20 add_watcher() i=2 2024-09-12T18:20:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.030+0000 7fd56e4939c0 20 add_watcher() i=3 2024-09-12T18:20:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.030+0000 7fd56e4939c0 20 add_watcher() i=4 2024-09-12T18:20:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.030+0000 7fd56e4939c0 20 add_watcher() i=5 2024-09-12T18:20:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.030+0000 7fd56e4939c0 20 add_watcher() i=6 2024-09-12T18:20:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.030+0000 7fd56e4939c0 20 add_watcher() i=7 2024-09-12T18:20:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.030+0000 7fd56e4939c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:20:00.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.034+0000 7fd421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:00.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.034+0000 7fd56e4939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:20:00.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.034+0000 7fd56e4939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:20:00.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.034+0000 7fd56e4939c0 5 note: GC not initialized 2024-09-12T18:20:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd420fe1640 20 reqs_thread_entry: start 2024-09-12T18:20:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 20 init_complete bucket index max shards: 1 2024-09-12T18:20:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 20 Filter name: none 2024-09-12T18:20:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd39a7fc640 20 reqs_thread_entry: start 2024-09-12T18:20:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:20:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T18:20:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:20:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T18:20:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T18:20:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:20:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 10 cache get: name=default.rgw.meta+users.keys+OGAMSRSMBDKPMIJSZQDL : miss 2024-09-12T18:20:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 10 cache put: name=default.rgw.meta+users.keys+OGAMSRSMBDKPMIJSZQDL info.flags=0x0 2024-09-12T18:20:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 10 adding default.rgw.meta+users.keys+OGAMSRSMBDKPMIJSZQDL to cache LRU end 2024-09-12T18:20:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 10 cache get: name=default.rgw.meta+users.keys+OGAMSRSMBDKPMIJSZQDL : hit (negative entry) 2024-09-12T18:20:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.038+0000 7fd56e4939c0 10 cache get: name=default.rgw.meta+users.keys+OGAMSRSMBDKPMIJSZQDL : hit (negative entry) 2024-09-12T18:20:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.042+0000 7fd56e4939c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:20:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.042+0000 7fd56e4939c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:20:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.042+0000 7fd56e4939c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:20:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.042+0000 7fd44affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366236 cookie 94192884958656 notifier 9198 bl.length()=660 2024-09-12T18:20:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.042+0000 7fd44affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:20:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.042+0000 7fd44affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:20:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.046+0000 7fd56e4939c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T18:20:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.046+0000 7fd56e4939c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:20:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.046+0000 7fd56e4939c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T18:20:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.050+0000 7fd44affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366328 cookie 94192884942064 notifier 9198 bl.length()=191 2024-09-12T18:20:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.050+0000 7fd44affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T18:20:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.050+0000 7fd44affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:20:00.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.054+0000 7fd56e4939c0 10 cache put: name=default.rgw.meta+users.keys+OGAMSRSMBDKPMIJSZQDL info.flags=0x7 2024-09-12T18:20:00.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.054+0000 7fd56e4939c0 10 moving default.rgw.meta+users.keys+OGAMSRSMBDKPMIJSZQDL to cache LRU end 2024-09-12T18:20:00.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.054+0000 7fd56e4939c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:OGAMSRSMBDKPMIJSZQDL, ofs0, ns] 2024-09-12T18:20:00.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.054+0000 7fd44a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366358 cookie 94192884950880 notifier 9198 bl.length()=189 2024-09-12T18:20:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.054+0000 7fd44a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OGAMSRSMBDKPMIJSZQDL info.flags=0x7 2024-09-12T18:20:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.054+0000 7fd44a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OGAMSRSMBDKPMIJSZQDL to cache LRU end 2024-09-12T18:20:00.060 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T18:20:00.060 INFO:teuthology.orchestra.run.smithi157.stdout: "user_id": "foobar.client.0", 2024-09-12T18:20:00.060 INFO:teuthology.orchestra.run.smithi157.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T18:20:00.060 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "foobar+test@test.test", 2024-09-12T18:20:00.060 INFO:teuthology.orchestra.run.smithi157.stdout: "suspended": 0, 2024-09-12T18:20:00.060 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T18:20:00.060 INFO:teuthology.orchestra.run.smithi157.stdout: "subusers": [], 2024-09-12T18:20:00.060 INFO:teuthology.orchestra.run.smithi157.stdout: "keys": [ 2024-09-12T18:20:00.060 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T18:20:00.060 INFO:teuthology.orchestra.run.smithi157.stdout: "user": "foobar.client.0", 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: "access_key": "OGAMSRSMBDKPMIJSZQDL", 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: "secret_key": "lpbcQUe0txFJFZ3x/EKz6Tnfrx61QmsbiJA8FvME7cNwHIT32kWjYA==", 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: "active": true, 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:20:00.042284Z" 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: "swift_keys": [], 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": [], 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: "default_placement": "", 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: "default_storage_class": "", 2024-09-12T18:20:00.061 INFO:teuthology.orchestra.run.smithi157.stdout: "placement_tags": [], 2024-09-12T18:20:00.062 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T18:20:00.062 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:00.062 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:00.062 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:00.062 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:00.062 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:00.062 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:00.062 INFO:teuthology.orchestra.run.smithi157.stdout: "user_quota": { 2024-09-12T18:20:00.062 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: "temp_url_keys": [], 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "rgw", 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: "mfa_ids": [], 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: "account_id": "", 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: "path": "/", 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:20:00.042266Z", 2024-09-12T18:20:00.063 INFO:teuthology.orchestra.run.smithi157.stdout: "tags": [], 2024-09-12T18:20:00.064 INFO:teuthology.orchestra.run.smithi157.stdout: "group_ids": [] 2024-09-12T18:20:00.064 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T18:20:00.064 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:20:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.058+0000 7fd421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.062+0000 7fd56e4939c0 20 remove_watcher() i=0 2024-09-12T18:20:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.062+0000 7fd56e4939c0 2 removed watcher, disabling cache 2024-09-12T18:20:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.066+0000 7fd56e4939c0 20 remove_watcher() i=1 2024-09-12T18:20:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.066+0000 7fd56e4939c0 20 remove_watcher() i=2 2024-09-12T18:20:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.070+0000 7fd56e4939c0 20 remove_watcher() i=3 2024-09-12T18:20:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.070+0000 7fd56e4939c0 20 remove_watcher() i=4 2024-09-12T18:20:00.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.074+0000 7fd56e4939c0 20 remove_watcher() i=5 2024-09-12T18:20:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.074+0000 7fd56e4939c0 20 remove_watcher() i=6 2024-09-12T18:20:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.078+0000 7fd56e4939c0 20 remove_watcher() i=7 2024-09-12T18:20:00.095 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 4829672966 --totp-seed U6XIKV3ULQIVJVJALA4NWYXMZFYQG3USYLYCB3FQVVKTHOGO2PX47XU54GI4ZP4F --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:20:00.185 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:20:00.185 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:20:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.222+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.222+0000 7f8b301fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.222+0000 7f8b301fb9c0 20 realm 2024-09-12T18:20:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.222+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.222+0000 7f8b301fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.222+0000 7f8b301fb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:20:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.222+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.222+0000 7f8b301fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.222+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.226+0000 7f8b301fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:00.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.226+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.226+0000 7f8b301fb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:20:00.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.226+0000 7f8b301fb9c0 20 searching for the correct realm 2024-09-12T18:20:00.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.230+0000 7f8b2d500640 0 -- 172.21.15.157:0/2761724287 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x5585a07ed770 msgr2=0x5585a07efc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:00.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.238+0000 7f8b2dd01640 0 -- 172.21.15.157:0/2761724287 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f8b180b83e0 msgr2=0x7f8b180b8860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:00.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:20:00.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:20:00.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:20:00.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:20:00.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:20:00.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:20:00.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:00.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:20:00.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 zone default found 2024-09-12T18:20:00.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 4 Realm: () 2024-09-12T18:20:00.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:20:00.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:20:00.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:20:00.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 zonegroup default 2024-09-12T18:20:00.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 started sync module instance, tier type = 2024-09-12T18:20:00.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.246+0000 7f8b301fb9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:20:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.262+0000 7f8b301fb9c0 20 add_watcher() i=0 2024-09-12T18:20:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.262+0000 7f8b301fb9c0 20 add_watcher() i=1 2024-09-12T18:20:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.262+0000 7f8b301fb9c0 20 add_watcher() i=2 2024-09-12T18:20:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.262+0000 7f8b301fb9c0 20 add_watcher() i=3 2024-09-12T18:20:00.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.262+0000 7f8b301fb9c0 20 add_watcher() i=4 2024-09-12T18:20:00.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.262+0000 7f8b301fb9c0 20 add_watcher() i=5 2024-09-12T18:20:00.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.262+0000 7f8b301fb9c0 20 add_watcher() i=6 2024-09-12T18:20:00.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.262+0000 7f8b301fb9c0 20 add_watcher() i=7 2024-09-12T18:20:00.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.262+0000 7f8b301fb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:20:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f89df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f8b301fb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:20:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f8b301fb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:20:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f8b301fb9c0 5 note: GC not initialized 2024-09-12T18:20:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f89de7fc640 20 reqs_thread_entry: start 2024-09-12T18:20:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f8b301fb9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:20:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f8b301fb9c0 20 Filter name: none 2024-09-12T18:20:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f894ffff640 20 reqs_thread_entry: start 2024-09-12T18:20:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f8b301fb9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:20:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f8b301fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f8b301fb9c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T18:20:00.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f8b301fb9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T18:20:00.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f8b301fb9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:20:00.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.266+0000 7f8b301fb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:20:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.274+0000 7f8b301fb9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:20:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.274+0000 7f8b301fb9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:20:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.274+0000 7f8b301fb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:20:00.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.274+0000 7f8a117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366237 cookie 94032411756976 notifier 9213 bl.length()=674 2024-09-12T18:20:00.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.274+0000 7f8a117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:20:00.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.274+0000 7f8a117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:20:00.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.274+0000 7f89df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:00.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.282+0000 7f8b301fb9c0 20 remove_watcher() i=0 2024-09-12T18:20:00.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.282+0000 7f8b301fb9c0 2 removed watcher, disabling cache 2024-09-12T18:20:00.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.282+0000 7f8b301fb9c0 20 remove_watcher() i=1 2024-09-12T18:20:00.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.282+0000 7f8b301fb9c0 20 remove_watcher() i=2 2024-09-12T18:20:00.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.286+0000 7f8b301fb9c0 20 remove_watcher() i=3 2024-09-12T18:20:00.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.286+0000 7f8b301fb9c0 20 remove_watcher() i=4 2024-09-12T18:20:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.290+0000 7f8b301fb9c0 20 remove_watcher() i=5 2024-09-12T18:20:00.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.290+0000 7f8b301fb9c0 20 remove_watcher() i=6 2024-09-12T18:20:00.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.290+0000 7f8b301fb9c0 20 remove_watcher() i=7 2024-09-12T18:20:00.309 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T18:20:00.340 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:20:00.340 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:20:00.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.378+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.378+0000 7f16e092e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.378+0000 7f16e092e9c0 20 realm 2024-09-12T18:20:00.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.378+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.378+0000 7f16e092e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.378+0000 7f16e092e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:20:00.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.378+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.378+0000 7f16e092e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.378+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.382+0000 7f16e092e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.382+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.382+0000 7f16e092e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:20:00.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.382+0000 7f16e092e9c0 20 searching for the correct realm 2024-09-12T18:20:00.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.386+0000 7f16dec35640 0 -- 172.21.15.157:0/3460111814 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x55f78c61df60 msgr2=0x55f78c6203f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:00.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.394+0000 7f16ddc33640 0 -- 172.21.15.157:0/3460111814 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f16d410ec20 msgr2=0x7f16d412cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:20:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:20:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:20:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:20:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:20:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:20:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:20:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:00.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:20:00.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 zone default found 2024-09-12T18:20:00.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 4 Realm: () 2024-09-12T18:20:00.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:20:00.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:20:00.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:20:00.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 zonegroup default 2024-09-12T18:20:00.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 started sync module instance, tier type = 2024-09-12T18:20:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.402+0000 7f16e092e9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:20:00.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.418+0000 7f16e092e9c0 20 add_watcher() i=0 2024-09-12T18:20:00.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.418+0000 7f16e092e9c0 20 add_watcher() i=1 2024-09-12T18:20:00.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.418+0000 7f16e092e9c0 20 add_watcher() i=2 2024-09-12T18:20:00.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.418+0000 7f16e092e9c0 20 add_watcher() i=3 2024-09-12T18:20:00.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.418+0000 7f16e092e9c0 20 add_watcher() i=4 2024-09-12T18:20:00.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.418+0000 7f16e092e9c0 20 add_watcher() i=5 2024-09-12T18:20:00.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.418+0000 7f16e092e9c0 20 add_watcher() i=6 2024-09-12T18:20:00.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 20 add_watcher() i=7 2024-09-12T18:20:00.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:20:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f1594fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:20:00.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:20:00.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 5 note: GC not initialized 2024-09-12T18:20:00.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f150f7fe640 20 reqs_thread_entry: start 2024-09-12T18:20:00.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:20:00.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 20 Filter name: none 2024-09-12T18:20:00.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f150d7fa640 20 reqs_thread_entry: start 2024-09-12T18:20:00.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:20:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T18:20:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T18:20:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:20:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.422+0000 7f16e092e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:20:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.426+0000 7f16e092e9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:20:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.426+0000 7f16e092e9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:20:00.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.426+0000 7f16e092e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:20:00.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.426+0000 7f15c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366238 cookie 94521700576080 notifier 8576 bl.length()=727 2024-09-12T18:20:00.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.426+0000 7f15c1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:20:00.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.426+0000 7f15c1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:20:00.430 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T18:20:00.430 INFO:teuthology.orchestra.run.smithi157.stdout: "user_id": "foobar.client.0", 2024-09-12T18:20:00.431 INFO:teuthology.orchestra.run.smithi157.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T18:20:00.431 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "foobar+test@test.test", 2024-09-12T18:20:00.431 INFO:teuthology.orchestra.run.smithi157.stdout: "suspended": 0, 2024-09-12T18:20:00.431 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T18:20:00.431 INFO:teuthology.orchestra.run.smithi157.stdout: "subusers": [], 2024-09-12T18:20:00.431 INFO:teuthology.orchestra.run.smithi157.stdout: "keys": [ 2024-09-12T18:20:00.431 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T18:20:00.431 INFO:teuthology.orchestra.run.smithi157.stdout: "user": "foobar.client.0", 2024-09-12T18:20:00.431 INFO:teuthology.orchestra.run.smithi157.stdout: "access_key": "OGAMSRSMBDKPMIJSZQDL", 2024-09-12T18:20:00.431 INFO:teuthology.orchestra.run.smithi157.stdout: "secret_key": "lpbcQUe0txFJFZ3x/EKz6Tnfrx61QmsbiJA8FvME7cNwHIT32kWjYA==", 2024-09-12T18:20:00.431 INFO:teuthology.orchestra.run.smithi157.stdout: "active": true, 2024-09-12T18:20:00.432 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:20:00.042284Z" 2024-09-12T18:20:00.432 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-12T18:20:00.432 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T18:20:00.432 INFO:teuthology.orchestra.run.smithi157.stdout: "swift_keys": [], 2024-09-12T18:20:00.432 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": [ 2024-09-12T18:20:00.432 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T18:20:00.432 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "oidc-provider", 2024-09-12T18:20:00.432 INFO:teuthology.orchestra.run.smithi157.stdout: "perm": "*" 2024-09-12T18:20:00.432 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:00.432 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "roles", 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: "perm": "*" 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "user-policy", 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: "perm": "*" 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: "default_placement": "", 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: "default_storage_class": "", 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: "placement_tags": [], 2024-09-12T18:20:00.433 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T18:20:00.434 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:00.434 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:00.434 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:00.435 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:00.435 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:00.435 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:00.435 INFO:teuthology.orchestra.run.smithi157.stdout: "user_quota": { 2024-09-12T18:20:00.435 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: "temp_url_keys": [], 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "rgw", 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: "mfa_ids": [ 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: "4829672966" 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: "account_id": "", 2024-09-12T18:20:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: "path": "/", 2024-09-12T18:20:00.437 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:20:00.042266Z", 2024-09-12T18:20:00.437 INFO:teuthology.orchestra.run.smithi157.stdout: "tags": [], 2024-09-12T18:20:00.437 INFO:teuthology.orchestra.run.smithi157.stdout: "group_ids": [] 2024-09-12T18:20:00.437 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T18:20:00.437 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:20:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.430+0000 7f1594fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.434+0000 7f16e092e9c0 20 remove_watcher() i=0 2024-09-12T18:20:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.434+0000 7f16e092e9c0 2 removed watcher, disabling cache 2024-09-12T18:20:00.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.434+0000 7f16e092e9c0 20 remove_watcher() i=1 2024-09-12T18:20:00.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.438+0000 7f16e092e9c0 20 remove_watcher() i=2 2024-09-12T18:20:00.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.442+0000 7f16e092e9c0 20 remove_watcher() i=3 2024-09-12T18:20:00.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.442+0000 7f16e092e9c0 20 remove_watcher() i=4 2024-09-12T18:20:00.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.442+0000 7f16e092e9c0 20 remove_watcher() i=5 2024-09-12T18:20:00.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.446+0000 7f16e092e9c0 20 remove_watcher() i=6 2024-09-12T18:20:00.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.446+0000 7f16e092e9c0 20 remove_watcher() i=7 2024-09-12T18:20:00.463 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T18:20:00.546 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:20:00.546 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:20:00.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.582+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 20 realm 2024-09-12T18:20:00.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:20:00.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:00.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:20:00.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.586+0000 7f78fdfe89c0 20 searching for the correct realm 2024-09-12T18:20:00.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.594+0000 7f78fc2ef640 0 -- 172.21.15.157:0/442935605 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x558c8c5202a0 msgr2=0x558c8c522760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:00.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.598+0000 7f78fbaee640 0 -- 172.21.15.157:0/442935605 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f78f00ec950 msgr2=0x7f78f00e9420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.606+0000 7f78fdfe89c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:20:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.606+0000 7f78fdfe89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:20:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.606+0000 7f78fdfe89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:20:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.606+0000 7f78fdfe89c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:20:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.606+0000 7f78fdfe89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:20:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.606+0000 7f78fdfe89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:20:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.606+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.606+0000 7f78fdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.606+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:20:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 zone default found 2024-09-12T18:20:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 4 Realm: () 2024-09-12T18:20:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:20:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:20:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:20:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 zonegroup default 2024-09-12T18:20:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 started sync module instance, tier type = 2024-09-12T18:20:00.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.610+0000 7f78fdfe89c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:20:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.626+0000 7f78fdfe89c0 20 add_watcher() i=0 2024-09-12T18:20:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.626+0000 7f78fdfe89c0 20 add_watcher() i=1 2024-09-12T18:20:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.626+0000 7f78fdfe89c0 20 add_watcher() i=2 2024-09-12T18:20:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.626+0000 7f78fdfe89c0 20 add_watcher() i=3 2024-09-12T18:20:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.626+0000 7f78fdfe89c0 20 add_watcher() i=4 2024-09-12T18:20:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.626+0000 7f78fdfe89c0 20 add_watcher() i=5 2024-09-12T18:20:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.626+0000 7f78fdfe89c0 20 add_watcher() i=6 2024-09-12T18:20:00.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.626+0000 7f78fdfe89c0 20 add_watcher() i=7 2024-09-12T18:20:00.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.626+0000 7f78fdfe89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:20:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f77b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:20:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:20:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 5 note: GC not initialized 2024-09-12T18:20:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f77b17e2640 20 reqs_thread_entry: start 2024-09-12T18:20:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 20 init_complete bucket index max shards: 1 2024-09-12T18:20:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 20 Filter name: none 2024-09-12T18:20:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f77aa7fc640 20 reqs_thread_entry: start 2024-09-12T18:20:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T18:20:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T18:20:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:20:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T18:20:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T18:20:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T18:20:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:20:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.630+0000 7f78fdfe89c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T18:20:00.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.634+0000 7f78fdfe89c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:20:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.634+0000 7f78fdfe89c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:20:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.634+0000 7f78fdfe89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T18:20:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.634+0000 7f77daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366329 cookie 94062137984976 notifier 9249 bl.length()=384 2024-09-12T18:20:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.634+0000 7f77daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:20:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.634+0000 7f77daffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:20:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.638+0000 7f78fdfe89c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T18:20:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.638+0000 7f78fdfe89c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:20:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.638+0000 7f78fdfe89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T18:20:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.638+0000 7f77da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366359 cookie 94062137992080 notifier 9249 bl.length()=225 2024-09-12T18:20:00.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.638+0000 7f77da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T18:20:00.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.638+0000 7f77da7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:20:00.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.642+0000 7f78fdfe89c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T18:20:00.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.642+0000 7f78fdfe89c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:20:00.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.642+0000 7f78fdfe89c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T18:20:00.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.646+0000 7f77daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366250 cookie 94062137988528 notifier 9249 bl.length()=234 2024-09-12T18:20:00.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.646+0000 7f77daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T18:20:00.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.646+0000 7f77daffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:20:00.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.646+0000 7f77b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:00.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.650+0000 7f78fdfe89c0 20 remove_watcher() i=0 2024-09-12T18:20:00.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.650+0000 7f78fdfe89c0 2 removed watcher, disabling cache 2024-09-12T18:20:00.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.654+0000 7f78fdfe89c0 20 remove_watcher() i=1 2024-09-12T18:20:00.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.654+0000 7f78fdfe89c0 20 remove_watcher() i=2 2024-09-12T18:20:00.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.658+0000 7f78fdfe89c0 20 remove_watcher() i=3 2024-09-12T18:20:00.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.658+0000 7f78fdfe89c0 20 remove_watcher() i=4 2024-09-12T18:20:00.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.662+0000 7f78fdfe89c0 20 remove_watcher() i=5 2024-09-12T18:20:00.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.662+0000 7f78fdfe89c0 20 remove_watcher() i=6 2024-09-12T18:20:00.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.662+0000 7f78fdfe89c0 20 remove_watcher() i=7 2024-09-12T18:20:00.678 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: "id": "RGW88888888888888888", 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: "tenant": "", 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: "quota": { 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:00.679 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout: "max_users": 1000, 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout: "max_roles": 1000, 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout: "max_groups": 1000, 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout: "max_access_keys": 4 2024-09-12T18:20:00.680 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T18:20:00.681 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T18:20:00.682 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key SPGWMWOTEMRIHJZRTCBQ --secret Z7apXqWCVYTf9etr8s1LhRq/kbQG7WpDtHO8beRxqv3o0xHwpMiCPQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T18:20:00.774 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:20:00.774 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:20:00.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.810+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.810+0000 7f1b1d63c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.810+0000 7f1b1d63c9c0 20 realm 2024-09-12T18:20:00.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.810+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.814+0000 7f1b1d63c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.814+0000 7f1b1d63c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:20:00.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.814+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.814+0000 7f1b1d63c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.814+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.814+0000 7f1b1d63c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:00.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.814+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.814+0000 7f1b1d63c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:20:00.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.814+0000 7f1b1d63c9c0 20 searching for the correct realm 2024-09-12T18:20:00.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.822+0000 7f1b1a941640 0 -- 172.21.15.157:0/2781730993 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f1b0c042430 msgr2=0x7f1b0c042850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:00.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.830+0000 7f1b1a941640 0 -- 172.21.15.157:0/2781730993 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f19e4081660 msgr2=0x7f19e4083a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:00.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.834+0000 7f1b1d63c9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:20:00.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.834+0000 7f1b1d63c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:20:00.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.834+0000 7f1b1d63c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:20:00.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.834+0000 7f1b1d63c9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:20:00.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.834+0000 7f1b1d63c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:20:00.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.834+0000 7f1b1d63c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:20:00.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.834+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.834+0000 7f1b1d63c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.834+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:00.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 zone default found 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 4 Realm: () 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 zonegroup default 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 started sync module instance, tier type = 2024-09-12T18:20:00.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.838+0000 7f1b1d63c9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:20:00.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.854+0000 7f1b1d63c9c0 20 add_watcher() i=0 2024-09-12T18:20:00.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.854+0000 7f1b1d63c9c0 20 add_watcher() i=1 2024-09-12T18:20:00.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.854+0000 7f1b1d63c9c0 20 add_watcher() i=2 2024-09-12T18:20:00.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.854+0000 7f1b1d63c9c0 20 add_watcher() i=3 2024-09-12T18:20:00.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.854+0000 7f1b1d63c9c0 20 add_watcher() i=4 2024-09-12T18:20:00.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.854+0000 7f1b1d63c9c0 20 add_watcher() i=5 2024-09-12T18:20:00.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.854+0000 7f1b1d63c9c0 20 add_watcher() i=6 2024-09-12T18:20:00.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.854+0000 7f1b1d63c9c0 20 add_watcher() i=7 2024-09-12T18:20:00.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.854+0000 7f1b1d63c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:20:00.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f19d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:00.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:20:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:20:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 5 note: GC not initialized 2024-09-12T18:20:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f19d0fe1640 20 reqs_thread_entry: start 2024-09-12T18:20:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:20:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 20 Filter name: none 2024-09-12T18:20:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f194a7fc640 20 reqs_thread_entry: start 2024-09-12T18:20:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T18:20:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T18:20:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:20:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T18:20:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T18:20:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:20:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 10 cache get: name=default.rgw.meta+users.keys+SPGWMWOTEMRIHJZRTCBQ : miss 2024-09-12T18:20:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 10 cache put: name=default.rgw.meta+users.keys+SPGWMWOTEMRIHJZRTCBQ info.flags=0x0 2024-09-12T18:20:00.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 10 adding default.rgw.meta+users.keys+SPGWMWOTEMRIHJZRTCBQ to cache LRU end 2024-09-12T18:20:00.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T18:20:00.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.858+0000 7f1b1d63c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.862+0000 7f1b1d63c9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:20:00.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.862+0000 7f1b1d63c9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:20:00.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.862+0000 7f1b1d63c9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:20:00.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.862+0000 7f1b1d63c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:20:00.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.862+0000 7f1b1d63c9c0 10 cache get: name=default.rgw.meta+users.keys+SPGWMWOTEMRIHJZRTCBQ : hit (negative entry) 2024-09-12T18:20:00.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.862+0000 7f1b1d63c9c0 10 cache get: name=default.rgw.meta+users.keys+SPGWMWOTEMRIHJZRTCBQ : hit (negative entry) 2024-09-12T18:20:00.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.862+0000 7f1b1d63c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:20:00.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.862+0000 7f1b1d63c9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:20:00.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.862+0000 7f1b1d63c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T18:20:00.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.866+0000 7f19feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366330 cookie 94174477243504 notifier 9270 bl.length()=681 2024-09-12T18:20:00.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.866+0000 7f19feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:20:00.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.866+0000 7f19feffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:20:00.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.870+0000 7f1b1d63c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T18:20:00.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.870+0000 7f1b1d63c9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:20:00.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.870+0000 7f1b1d63c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T18:20:00.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.870+0000 7f19fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94174477256928 notifier 9270 bl.length()=189 2024-09-12T18:20:00.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.870+0000 7f19fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T18:20:00.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.870+0000 7f19fe7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:20:00.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.874+0000 7f1b1d63c9c0 10 cache put: name=default.rgw.meta+users.keys+SPGWMWOTEMRIHJZRTCBQ info.flags=0x7 2024-09-12T18:20:00.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.874+0000 7f1b1d63c9c0 10 moving default.rgw.meta+users.keys+SPGWMWOTEMRIHJZRTCBQ to cache LRU end 2024-09-12T18:20:00.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.874+0000 7f1b1d63c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:SPGWMWOTEMRIHJZRTCBQ, ofs0, ns] 2024-09-12T18:20:00.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.874+0000 7f19fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366251 cookie 94174477251952 notifier 9270 bl.length()=188 2024-09-12T18:20:00.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.874+0000 7f19fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SPGWMWOTEMRIHJZRTCBQ info.flags=0x7 2024-09-12T18:20:00.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.874+0000 7f19fe7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SPGWMWOTEMRIHJZRTCBQ to cache LRU end 2024-09-12T18:20:00.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.878+0000 7f1b1d63c9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T18:20:00.883 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T18:20:00.883 INFO:teuthology.orchestra.run.smithi157.stdout: "user_id": "root1.client.0", 2024-09-12T18:20:00.883 INFO:teuthology.orchestra.run.smithi157.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T18:20:00.883 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "root1+test@test.test", 2024-09-12T18:20:00.883 INFO:teuthology.orchestra.run.smithi157.stdout: "suspended": 0, 2024-09-12T18:20:00.883 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T18:20:00.883 INFO:teuthology.orchestra.run.smithi157.stdout: "subusers": [], 2024-09-12T18:20:00.883 INFO:teuthology.orchestra.run.smithi157.stdout: "keys": [ 2024-09-12T18:20:00.883 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: "user": "root1.client.0", 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: "access_key": "SPGWMWOTEMRIHJZRTCBQ", 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: "secret_key": "Z7apXqWCVYTf9etr8s1LhRq/kbQG7WpDtHO8beRxqv3o0xHwpMiCPQ==", 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: "active": true, 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:20:00.864624Z" 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: "swift_keys": [], 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": [], 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: "default_placement": "", 2024-09-12T18:20:00.884 INFO:teuthology.orchestra.run.smithi157.stdout: "default_storage_class": "", 2024-09-12T18:20:00.885 INFO:teuthology.orchestra.run.smithi157.stdout: "placement_tags": [], 2024-09-12T18:20:00.885 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T18:20:00.885 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:00.885 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:00.885 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:00.885 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:00.885 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:00.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:00.885 INFO:teuthology.orchestra.run.smithi157.stdout: "user_quota": { 2024-09-12T18:20:00.886 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:00.886 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:00.886 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:00.886 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:00.886 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:00.886 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:00.887 INFO:teuthology.orchestra.run.smithi157.stdout: "temp_url_keys": [], 2024-09-12T18:20:00.887 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "root", 2024-09-12T18:20:00.887 INFO:teuthology.orchestra.run.smithi157.stdout: "mfa_ids": [], 2024-09-12T18:20:00.887 INFO:teuthology.orchestra.run.smithi157.stdout: "account_id": "RGW88888888888888888", 2024-09-12T18:20:00.887 INFO:teuthology.orchestra.run.smithi157.stdout: "path": "/", 2024-09-12T18:20:00.887 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:20:00.864607Z", 2024-09-12T18:20:00.887 INFO:teuthology.orchestra.run.smithi157.stdout: "tags": [], 2024-09-12T18:20:00.887 INFO:teuthology.orchestra.run.smithi157.stdout: "group_ids": [] 2024-09-12T18:20:00.887 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T18:20:00.887 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:20:00.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.878+0000 7f19d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:00.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.886+0000 7f1b1d63c9c0 20 remove_watcher() i=0 2024-09-12T18:20:00.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.886+0000 7f1b1d63c9c0 2 removed watcher, disabling cache 2024-09-12T18:20:00.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.886+0000 7f1b1d63c9c0 20 remove_watcher() i=1 2024-09-12T18:20:00.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.890+0000 7f1b1d63c9c0 20 remove_watcher() i=2 2024-09-12T18:20:00.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.890+0000 7f1b1d63c9c0 20 remove_watcher() i=3 2024-09-12T18:20:00.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.894+0000 7f1b1d63c9c0 20 remove_watcher() i=4 2024-09-12T18:20:00.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.894+0000 7f1b1d63c9c0 20 remove_watcher() i=5 2024-09-12T18:20:00.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.894+0000 7f1b1d63c9c0 20 remove_watcher() i=6 2024-09-12T18:20:00.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.898+0000 7f1b1d63c9c0 20 remove_watcher() i=7 2024-09-12T18:20:00.914 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 2151418190 --totp-seed V3SQR2NQSF6CCNQBZWMJKR5BRKRMQWHPCWWXGBX6UWSNP66YKI3G5U3ITIPKHP72 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:20:00.954 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:20:00.954 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:20:00.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.990+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.990+0000 7f0802d079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.990+0000 7f0802d079c0 20 realm 2024-09-12T18:20:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.990+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.990+0000 7f0802d079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.990+0000 7f0802d079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:20:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.990+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.990+0000 7f0802d079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.990+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.994+0000 7f0802d079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.994+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.994+0000 7f0802d079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:20:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.994+0000 7f0802d079c0 20 searching for the correct realm 2024-09-12T18:20:01.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:00.998+0000 7f080000c640 0 -- 172.21.15.157:0/2932823876 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f07f00c2040 msgr2=0x7f07f00ffcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.006+0000 7f080100e640 0 -- 172.21.15.157:0/2932823876 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f07f0100230 msgr2=0x7f07f01026a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:20:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:20:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:20:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:20:01.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:20:01.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:20:01.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:20:01.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:20:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 zone default found 2024-09-12T18:20:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 4 Realm: () 2024-09-12T18:20:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:20:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:20:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:20:01.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 zonegroup default 2024-09-12T18:20:01.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 started sync module instance, tier type = 2024-09-12T18:20:01.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.014+0000 7f0802d079c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:20:01.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.030+0000 7f0802d079c0 20 add_watcher() i=0 2024-09-12T18:20:01.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.030+0000 7f0802d079c0 20 add_watcher() i=1 2024-09-12T18:20:01.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.030+0000 7f0802d079c0 20 add_watcher() i=2 2024-09-12T18:20:01.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.030+0000 7f0802d079c0 20 add_watcher() i=3 2024-09-12T18:20:01.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.030+0000 7f0802d079c0 20 add_watcher() i=4 2024-09-12T18:20:01.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.030+0000 7f0802d079c0 20 add_watcher() i=5 2024-09-12T18:20:01.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.030+0000 7f0802d079c0 20 add_watcher() i=6 2024-09-12T18:20:01.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.034+0000 7f0802d079c0 20 add_watcher() i=7 2024-09-12T18:20:01.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.034+0000 7f0802d079c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:20:01.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.034+0000 7f06b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.034+0000 7f0802d079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:20:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.034+0000 7f0802d079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:20:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.034+0000 7f0802d079c0 5 note: GC not initialized 2024-09-12T18:20:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.038+0000 7f06b5fe3640 20 reqs_thread_entry: start 2024-09-12T18:20:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.038+0000 7f0802d079c0 20 init_complete bucket index max shards: 1 2024-09-12T18:20:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.038+0000 7f0802d079c0 20 Filter name: none 2024-09-12T18:20:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.038+0000 7f06277fe640 20 reqs_thread_entry: start 2024-09-12T18:20:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.038+0000 7f0802d079c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T18:20:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.038+0000 7f0802d079c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.038+0000 7f0802d079c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T18:20:01.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.038+0000 7f0802d079c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T18:20:01.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.038+0000 7f0802d079c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:20:01.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.038+0000 7f0802d079c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:20:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.042+0000 7f0802d079c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:20:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.042+0000 7f0802d079c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:20:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.042+0000 7f0802d079c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T18:20:01.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.042+0000 7f06d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366331 cookie 94491223652080 notifier 9288 bl.length()=695 2024-09-12T18:20:01.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.042+0000 7f06d7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:20:01.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.042+0000 7f06d7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:20:01.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.046+0000 7f06b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:01.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.050+0000 7f0802d079c0 20 remove_watcher() i=0 2024-09-12T18:20:01.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.050+0000 7f0802d079c0 2 removed watcher, disabling cache 2024-09-12T18:20:01.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.050+0000 7f0802d079c0 20 remove_watcher() i=1 2024-09-12T18:20:01.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.054+0000 7f0802d079c0 20 remove_watcher() i=2 2024-09-12T18:20:01.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.054+0000 7f0802d079c0 20 remove_watcher() i=3 2024-09-12T18:20:01.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.058+0000 7f0802d079c0 20 remove_watcher() i=4 2024-09-12T18:20:01.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.058+0000 7f0802d079c0 20 remove_watcher() i=5 2024-09-12T18:20:01.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.058+0000 7f0802d079c0 20 remove_watcher() i=6 2024-09-12T18:20:01.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.062+0000 7f0802d079c0 20 remove_watcher() i=7 2024-09-12T18:20:01.077 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T18:20:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:20:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:20:01.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.194+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.198+0000 7fa76c2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.198+0000 7fa76c2099c0 20 realm 2024-09-12T18:20:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.198+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.198+0000 7fa76c2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.198+0000 7fa76c2099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:20:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.198+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.198+0000 7fa76c2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.198+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.202+0000 7fa76c2099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:01.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.202+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.202+0000 7fa76c2099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:20:01.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.202+0000 7fa76c2099c0 20 searching for the correct realm 2024-09-12T18:20:01.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.206+0000 7fa76a510640 0 -- 172.21.15.157:0/4091613983 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x56485da686a0 msgr2=0x56485da6ab30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:01.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.214+0000 7fa769d0f640 0 -- 172.21.15.157:0/4091613983 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fa760042460 msgr2=0x7fa7600428c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:01.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.218+0000 7fa76c2099c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:20:01.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.218+0000 7fa76c2099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:20:01.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.218+0000 7fa76c2099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:20:01.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.218+0000 7fa76c2099c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:20:01.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.218+0000 7fa76c2099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:20:01.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.218+0000 7fa76c2099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:20:01.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.218+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:20:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 zone default found 2024-09-12T18:20:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 4 Realm: () 2024-09-12T18:20:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:20:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:20:01.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:20:01.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 zonegroup default 2024-09-12T18:20:01.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 started sync module instance, tier type = 2024-09-12T18:20:01.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.222+0000 7fa76c2099c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:20:01.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.238+0000 7fa76c2099c0 20 add_watcher() i=0 2024-09-12T18:20:01.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.238+0000 7fa76c2099c0 20 add_watcher() i=1 2024-09-12T18:20:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.238+0000 7fa76c2099c0 20 add_watcher() i=2 2024-09-12T18:20:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.238+0000 7fa76c2099c0 20 add_watcher() i=3 2024-09-12T18:20:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.238+0000 7fa76c2099c0 20 add_watcher() i=4 2024-09-12T18:20:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.238+0000 7fa76c2099c0 20 add_watcher() i=5 2024-09-12T18:20:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.238+0000 7fa76c2099c0 20 add_watcher() i=6 2024-09-12T18:20:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.238+0000 7fa76c2099c0 20 add_watcher() i=7 2024-09-12T18:20:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.238+0000 7fa76c2099c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:20:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa61ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:20:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:20:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 5 note: GC not initialized 2024-09-12T18:20:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa61efe5640 20 reqs_thread_entry: start 2024-09-12T18:20:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 20 init_complete bucket index max shards: 1 2024-09-12T18:20:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 20 Filter name: none 2024-09-12T18:20:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa61cfe1640 20 reqs_thread_entry: start 2024-09-12T18:20:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T18:20:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T18:20:01.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:20:01.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T18:20:01.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T18:20:01.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T18:20:01.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:20:01.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.242+0000 7fa76c2099c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T18:20:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.246+0000 7fa76c2099c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:20:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.246+0000 7fa76c2099c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:20:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.246+0000 7fa76c2099c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T18:20:01.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.246+0000 7fa64d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366332 cookie 94868808892704 notifier 9306 bl.length()=384 2024-09-12T18:20:01.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.246+0000 7fa64d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:20:01.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.246+0000 7fa64d7fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:20:01.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.250+0000 7fa76c2099c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T18:20:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.250+0000 7fa76c2099c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:20:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.250+0000 7fa76c2099c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T18:20:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.254+0000 7fa64d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366360 cookie 94868808897328 notifier 9306 bl.length()=225 2024-09-12T18:20:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.254+0000 7fa64d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T18:20:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.254+0000 7fa64d7fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:20:01.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.258+0000 7fa76c2099c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T18:20:01.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.258+0000 7fa76c2099c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:20:01.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.258+0000 7fa76c2099c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T18:20:01.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.258+0000 7fa64cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366252 cookie 94868808894832 notifier 9306 bl.length()=234 2024-09-12T18:20:01.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.258+0000 7fa64cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T18:20:01.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.258+0000 7fa64cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:20:01.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.262+0000 7fa61ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:01.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.266+0000 7fa76c2099c0 20 remove_watcher() i=0 2024-09-12T18:20:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.266+0000 7fa76c2099c0 2 removed watcher, disabling cache 2024-09-12T18:20:01.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.270+0000 7fa76c2099c0 20 remove_watcher() i=1 2024-09-12T18:20:01.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.270+0000 7fa76c2099c0 20 remove_watcher() i=2 2024-09-12T18:20:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.270+0000 7fa76c2099c0 20 remove_watcher() i=3 2024-09-12T18:20:01.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.274+0000 7fa76c2099c0 20 remove_watcher() i=4 2024-09-12T18:20:01.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.274+0000 7fa76c2099c0 20 remove_watcher() i=5 2024-09-12T18:20:01.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.278+0000 7fa76c2099c0 20 remove_watcher() i=6 2024-09-12T18:20:01.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.278+0000 7fa76c2099c0 20 remove_watcher() i=7 2024-09-12T18:20:01.293 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T18:20:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "id": "RGW99999999999999999", 2024-09-12T18:20:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "tenant": "", 2024-09-12T18:20:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T18:20:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T18:20:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "quota": { 2024-09-12T18:20:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "max_users": 1000, 2024-09-12T18:20:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "max_roles": 1000, 2024-09-12T18:20:01.295 INFO:teuthology.orchestra.run.smithi157.stdout: "max_groups": 1000, 2024-09-12T18:20:01.295 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T18:20:01.295 INFO:teuthology.orchestra.run.smithi157.stdout: "max_access_keys": 4 2024-09-12T18:20:01.295 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T18:20:01.296 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T18:20:01.296 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key WQLCIZXSUNPVIRHCZUUO --secret ZXWcZn4dFwOKc9xNbXUEvIFpdaFFKS8S3J32QmiuE6gUmKK2KH4F6A== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T18:20:01.386 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:20:01.387 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:20:01.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.426+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.426+0000 7f28a46cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.426+0000 7f28a46cc9c0 20 realm 2024-09-12T18:20:01.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.426+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.426+0000 7f28a46cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.426+0000 7f28a46cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:20:01.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.426+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.426+0000 7f28a46cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.426+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.430+0000 7f28a46cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:01.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.430+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.430+0000 7f28a46cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:20:01.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.430+0000 7f28a46cc9c0 20 searching for the correct realm 2024-09-12T18:20:01.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.434+0000 7f28a19d1640 0 -- 172.21.15.157:0/194052033 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f2898017050 msgr2=0x7f289805d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:20:01.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.650+0000 7f28a21d2640 0 -- 172.21.15.157:0/194052033 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f2898091270 msgr2=0x7f289808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:20:01.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.866+0000 7f28a46cc9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:20:01.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.866+0000 7f28a46cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:20:01.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.866+0000 7f28a46cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:20:01.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.866+0000 7f28a46cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:20:01.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.866+0000 7f28a46cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:20:01.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.866+0000 7f28a46cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:20:01.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.866+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.866+0000 7f28a46cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.866+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:01.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:20:01.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 zone default found 2024-09-12T18:20:01.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 4 Realm: () 2024-09-12T18:20:01.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:20:01.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:20:01.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:20:01.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 zonegroup default 2024-09-12T18:20:01.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 started sync module instance, tier type = 2024-09-12T18:20:01.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.870+0000 7f28a46cc9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:20:01.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.890+0000 7f28a46cc9c0 20 add_watcher() i=0 2024-09-12T18:20:01.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.890+0000 7f28a46cc9c0 20 add_watcher() i=1 2024-09-12T18:20:01.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.890+0000 7f28a46cc9c0 20 add_watcher() i=2 2024-09-12T18:20:01.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.890+0000 7f28a46cc9c0 20 add_watcher() i=3 2024-09-12T18:20:01.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.890+0000 7f28a46cc9c0 20 add_watcher() i=4 2024-09-12T18:20:01.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.890+0000 7f28a46cc9c0 20 add_watcher() i=5 2024-09-12T18:20:01.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.890+0000 7f28a46cc9c0 20 add_watcher() i=6 2024-09-12T18:20:01.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.894+0000 7f28a46cc9c0 20 add_watcher() i=7 2024-09-12T18:20:01.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.894+0000 7f28a46cc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:20:01.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f2758fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:01.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:20:01.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:20:01.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 5 note: GC not initialized 2024-09-12T18:20:01.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f26d37fe640 20 reqs_thread_entry: start 2024-09-12T18:20:01.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:20:01.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 20 Filter name: none 2024-09-12T18:20:01.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f26d17fa640 20 reqs_thread_entry: start 2024-09-12T18:20:01.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T18:20:01.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 10 cache get: name=default.rgw.meta+users.keys+WQLCIZXSUNPVIRHCZUUO : miss 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.898+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.902+0000 7f28a46cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.902+0000 7f28a46cc9c0 10 cache put: name=default.rgw.meta+users.keys+WQLCIZXSUNPVIRHCZUUO info.flags=0x0 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.902+0000 7f28a46cc9c0 10 adding default.rgw.meta+users.keys+WQLCIZXSUNPVIRHCZUUO to cache LRU end 2024-09-12T18:20:01.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.902+0000 7f28a46cc9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T18:20:01.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.902+0000 7f28a46cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:01.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.902+0000 7f28a46cc9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:20:01.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.902+0000 7f28a46cc9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:20:01.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.902+0000 7f28a46cc9c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:20:01.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.902+0000 7f28a46cc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:20:01.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.902+0000 7f28a46cc9c0 10 cache get: name=default.rgw.meta+users.keys+WQLCIZXSUNPVIRHCZUUO : hit (negative entry) 2024-09-12T18:20:01.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.902+0000 7f28a46cc9c0 10 cache get: name=default.rgw.meta+users.keys+WQLCIZXSUNPVIRHCZUUO : hit (negative entry) 2024-09-12T18:20:01.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.906+0000 7f28a46cc9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:20:01.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.906+0000 7f28a46cc9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:20:01.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.906+0000 7f28a46cc9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T18:20:01.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.906+0000 7f2785ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366333 cookie 94690781432848 notifier 9324 bl.length()=681 2024-09-12T18:20:01.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.906+0000 7f2785ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:20:01.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.906+0000 7f2785ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:20:01.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.910+0000 7f28a46cc9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T18:20:01.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.910+0000 7f28a46cc9c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:20:01.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.910+0000 7f28a46cc9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T18:20:01.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.910+0000 7f2785ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366281 cookie 94690781452304 notifier 9324 bl.length()=189 2024-09-12T18:20:01.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.910+0000 7f2785ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T18:20:01.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.910+0000 7f2785ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:20:01.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.914+0000 7f28a46cc9c0 10 cache put: name=default.rgw.meta+users.keys+WQLCIZXSUNPVIRHCZUUO info.flags=0x7 2024-09-12T18:20:01.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.914+0000 7f28a46cc9c0 10 moving default.rgw.meta+users.keys+WQLCIZXSUNPVIRHCZUUO to cache LRU end 2024-09-12T18:20:01.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.914+0000 7f28a46cc9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:WQLCIZXSUNPVIRHCZUUO, ofs0, ns] 2024-09-12T18:20:01.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.914+0000 7f27857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366282 cookie 94690781452304 notifier 9324 bl.length()=188 2024-09-12T18:20:01.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.914+0000 7f27857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WQLCIZXSUNPVIRHCZUUO info.flags=0x7 2024-09-12T18:20:01.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.914+0000 7f27857fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WQLCIZXSUNPVIRHCZUUO to cache LRU end 2024-09-12T18:20:01.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.922+0000 7f28a46cc9c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T18:20:01.923 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T18:20:01.923 INFO:teuthology.orchestra.run.smithi157.stdout: "user_id": "root2.client.0", 2024-09-12T18:20:01.923 INFO:teuthology.orchestra.run.smithi157.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T18:20:01.924 INFO:teuthology.orchestra.run.smithi157.stdout: "email": "root2+test@test.test", 2024-09-12T18:20:01.924 INFO:teuthology.orchestra.run.smithi157.stdout: "suspended": 0, 2024-09-12T18:20:01.924 INFO:teuthology.orchestra.run.smithi157.stdout: "max_buckets": 1000, 2024-09-12T18:20:01.924 INFO:teuthology.orchestra.run.smithi157.stdout: "subusers": [], 2024-09-12T18:20:01.924 INFO:teuthology.orchestra.run.smithi157.stdout: "keys": [ 2024-09-12T18:20:01.924 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-09-12T18:20:01.924 INFO:teuthology.orchestra.run.smithi157.stdout: "user": "root2.client.0", 2024-09-12T18:20:01.924 INFO:teuthology.orchestra.run.smithi157.stdout: "access_key": "WQLCIZXSUNPVIRHCZUUO", 2024-09-12T18:20:01.924 INFO:teuthology.orchestra.run.smithi157.stdout: "secret_key": "ZXWcZn4dFwOKc9xNbXUEvIFpdaFFKS8S3J32QmiuE6gUmKK2KH4F6A==", 2024-09-12T18:20:01.924 INFO:teuthology.orchestra.run.smithi157.stdout: "active": true, 2024-09-12T18:20:01.924 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:20:01.905342Z" 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "swift_keys": [], 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": [], 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "op_mask": "read, write, delete", 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "default_placement": "", 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "default_storage_class": "", 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "placement_tags": [], 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "bucket_quota": { 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:01.925 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: "user_quota": { 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: "enabled": false, 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: "check_on_raw": false, 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size": -1, 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: "max_size_kb": 0, 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: "max_objects": -1 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: "temp_url_keys": [], 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "root", 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: "mfa_ids": [], 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: "account_id": "RGW99999999999999999", 2024-09-12T18:20:01.926 INFO:teuthology.orchestra.run.smithi157.stdout: "path": "/", 2024-09-12T18:20:01.927 INFO:teuthology.orchestra.run.smithi157.stdout: "create_date": "2024-09-12T18:20:01.905321Z", 2024-09-12T18:20:01.927 INFO:teuthology.orchestra.run.smithi157.stdout: "tags": [], 2024-09-12T18:20:01.927 INFO:teuthology.orchestra.run.smithi157.stdout: "group_ids": [] 2024-09-12T18:20:01.927 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T18:20:01.927 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:20:01.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.922+0000 7f2758fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:01.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.926+0000 7f28a46cc9c0 20 remove_watcher() i=0 2024-09-12T18:20:01.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.926+0000 7f28a46cc9c0 2 removed watcher, disabling cache 2024-09-12T18:20:01.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.930+0000 7f28a46cc9c0 20 remove_watcher() i=1 2024-09-12T18:20:01.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.930+0000 7f28a46cc9c0 20 remove_watcher() i=2 2024-09-12T18:20:01.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.934+0000 7f28a46cc9c0 20 remove_watcher() i=3 2024-09-12T18:20:01.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.934+0000 7f28a46cc9c0 20 remove_watcher() i=4 2024-09-12T18:20:01.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.938+0000 7f28a46cc9c0 20 remove_watcher() i=5 2024-09-12T18:20:01.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.938+0000 7f28a46cc9c0 20 remove_watcher() i=6 2024-09-12T18:20:01.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:01.938+0000 7f28a46cc9c0 20 remove_watcher() i=7 2024-09-12T18:20:01.958 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 7240034454 --totp-seed INH4Y5ASEVPIN5EZQHWKZ2MN62ME3ATQT55GAIRG6PMDXA6KSOGFK36B3YPFTWGP --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:20:01.999 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:20:01.999 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:20:02.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.034+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.038+0000 7feefb8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:02.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.038+0000 7feefb8c79c0 20 realm 2024-09-12T18:20:02.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.038+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.038+0000 7feefb8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:02.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.038+0000 7feefb8c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:20:02.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.038+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.038+0000 7feefb8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:02.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.038+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.038+0000 7feefb8c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:02.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.038+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.042+0000 7feefb8c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:20:02.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.042+0000 7feefb8c79c0 20 searching for the correct realm 2024-09-12T18:20:02.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.046+0000 7feef8bcc640 0 -- 172.21.15.157:0/3536724549 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x556af45c9ad0 msgr2=0x556af45cbf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:02.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.050+0000 7feef93cd640 0 -- 172.21.15.157:0/3536724549 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7feef00fa400 msgr2=0x7feef00fa860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:20:02.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.058+0000 7feefb8c79c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:20:02.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.058+0000 7feefb8c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:20:02.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.058+0000 7feefb8c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:20:02.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.058+0000 7feefb8c79c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:20:02.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.058+0000 7feefb8c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:20:02.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.058+0000 7feefb8c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:20:02.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.058+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.058+0000 7feefb8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:02.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.058+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.058+0000 7feefb8c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:20:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.058+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:20:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 20 zone default found 2024-09-12T18:20:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 4 Realm: () 2024-09-12T18:20:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:20:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:20:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:20:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 20 zonegroup default 2024-09-12T18:20:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:02.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:02.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:20:02.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 20 started sync module instance, tier type = 2024-09-12T18:20:02.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.062+0000 7feefb8c79c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:20:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.078+0000 7feefb8c79c0 20 add_watcher() i=0 2024-09-12T18:20:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.078+0000 7feefb8c79c0 20 add_watcher() i=1 2024-09-12T18:20:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.078+0000 7feefb8c79c0 20 add_watcher() i=2 2024-09-12T18:20:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.078+0000 7feefb8c79c0 20 add_watcher() i=3 2024-09-12T18:20:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.078+0000 7feefb8c79c0 20 add_watcher() i=4 2024-09-12T18:20:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.078+0000 7feefb8c79c0 20 add_watcher() i=5 2024-09-12T18:20:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.078+0000 7feefb8c79c0 20 add_watcher() i=6 2024-09-12T18:20:02.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.078+0000 7feefb8c79c0 20 add_watcher() i=7 2024-09-12T18:20:02.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.078+0000 7feefb8c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:20:02.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7fedaf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:02.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7feefb8c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:20:02.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7feefb8c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:20:02.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7feefb8c79c0 5 note: GC not initialized 2024-09-12T18:20:02.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7fedae7e4640 20 reqs_thread_entry: start 2024-09-12T18:20:02.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7feefb8c79c0 20 init_complete bucket index max shards: 1 2024-09-12T18:20:02.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7feefb8c79c0 20 Filter name: none 2024-09-12T18:20:02.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7fed1ffff640 20 reqs_thread_entry: start 2024-09-12T18:20:02.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7feefb8c79c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T18:20:02.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7feefb8c79c0 20 rados->read ofs=0 len=0 2024-09-12T18:20:02.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7feefb8c79c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T18:20:02.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7feefb8c79c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T18:20:02.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7feefb8c79c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:20:02.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.082+0000 7feefb8c79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:20:02.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.086+0000 7feefb8c79c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:20:02.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.086+0000 7feefb8c79c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:20:02.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.086+0000 7feefb8c79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T18:20:02.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.086+0000 7feddcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366334 cookie 93917854670976 notifier 8675 bl.length()=695 2024-09-12T18:20:02.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.086+0000 7feddcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:20:02.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.086+0000 7feddcff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:20:02.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.090+0000 7fedaf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:20:02.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.094+0000 7feefb8c79c0 20 remove_watcher() i=0 2024-09-12T18:20:02.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.094+0000 7feefb8c79c0 2 removed watcher, disabling cache 2024-09-12T18:20:02.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.098+0000 7feefb8c79c0 20 remove_watcher() i=1 2024-09-12T18:20:02.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.098+0000 7feefb8c79c0 20 remove_watcher() i=2 2024-09-12T18:20:02.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.102+0000 7feefb8c79c0 20 remove_watcher() i=3 2024-09-12T18:20:02.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.102+0000 7feefb8c79c0 20 remove_watcher() i=4 2024-09-12T18:20:02.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.106+0000 7feefb8c79c0 20 remove_watcher() i=5 2024-09-12T18:20:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.106+0000 7feefb8c79c0 20 remove_watcher() i=6 2024-09-12T18:20:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:20:02.106+0000 7feefb8c79c0 20 remove_watcher() i=7 2024-09-12T18:20:02.124 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T18:20:02.125 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T18:20:02.125 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T18:20:02.172 INFO:tasks.s3tests:Configuring boto... 2024-09-12T18:20:02.173 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T18:20:02.173 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:20:02.220 DEBUG:teuthology.orchestra.run.smithi157:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T18:20:02.401 INFO:teuthology.orchestra.run.smithi157.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T18:20:02.596 INFO:teuthology.orchestra.run.smithi157.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T18:20:02.911 INFO:teuthology.orchestra.run.smithi157.stdout:py installdeps: -rrequirements.txt 2024-09-12T18:21:54.393 INFO:teuthology.orchestra.run.smithi157.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T18:21:56.235 INFO:teuthology.orchestra.run.smithi157.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=db35a3233030af10edb09f6221be83f1e18d6e636f1fbc9bb6d4ab6cf5823994,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T18:21:56.236 INFO:teuthology.orchestra.run.smithi157.stdout:py run-test-pre: PYTHONHASHSEED='3089797970' 2024-09-12T18:21:56.236 INFO:teuthology.orchestra.run.smithi157.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T18:21:56.424 INFO:teuthology.orchestra.run.smithi157.stdout:============================= test session starts ============================== 2024-09-12T18:21:56.424 INFO:teuthology.orchestra.run.smithi157.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T18:21:56.424 INFO:teuthology.orchestra.run.smithi157.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T18:21:56.424 INFO:teuthology.orchestra.run.smithi157.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:21:56.424 INFO:teuthology.orchestra.run.smithi157.stdout:configfile: pytest.ini 2024-09-12T18:21:58.255 INFO:teuthology.orchestra.run.smithi157.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T18:21:58.255 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:21:58.913 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T18:21:59.403 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T18:22:00.015 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T18:22:00.636 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T18:22:01.123 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T18:22:01.684 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T18:22:02.436 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T18:22:02.889 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T18:22:03.052 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T18:22:03.213 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T18:22:03.687 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T18:22:04.177 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T18:22:04.695 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T18:22:05.184 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T18:22:05.353 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T18:22:05.521 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T18:22:05.633 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T18:22:05.745 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T18:22:05.855 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T18:22:05.966 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T18:22:06.075 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T18:22:06.187 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T18:22:06.297 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T18:22:06.406 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T18:22:06.516 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T18:22:06.625 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T18:22:06.739 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T18:22:06.852 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T18:22:06.962 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T18:22:07.076 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T18:22:07.186 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T18:22:07.299 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T18:22:07.412 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T18:22:07.523 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T18:22:07.633 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T18:22:07.745 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T18:22:07.858 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T18:22:07.971 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T18:22:08.082 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:22:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T18:22:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T18:22:08.412 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:22:08.524 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:22:08.637 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T18:22:08.752 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T18:22:08.866 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T18:22:08.980 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T18:22:09.093 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T18:22:09.217 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T18:22:09.347 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T18:22:09.459 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T18:22:09.571 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T18:22:09.687 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T18:22:10.767 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T18:22:16.663 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T18:22:23.177 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T18:22:32.494 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T18:22:45.796 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T18:22:49.534 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T18:22:53.130 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T18:22:54.647 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T18:22:55.099 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T18:22:55.804 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T18:22:56.508 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T18:22:57.839 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T18:22:58.577 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T18:22:59.045 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T18:22:59.048 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T18:22:59.050 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T18:22:59.053 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T18:22:59.055 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T18:22:59.057 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T18:22:59.060 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T18:22:59.063 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T18:22:59.065 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:22:59.067 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:22:59.070 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:22:59.072 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:22:59.074 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T18:22:59.077 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:22:59.079 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:22:59.081 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:22:59.084 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:22:59.086 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:22:59.088 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:22:59.090 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:22:59.092 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T18:22:59.094 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T18:22:59.096 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T18:22:59.098 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T18:22:59.100 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T18:22:59.101 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T18:22:59.103 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T18:22:59.105 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T18:22:59.209 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T18:22:59.219 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T18:23:00.383 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T18:23:10.277 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T18:23:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T18:23:12.196 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T18:23:13.241 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T18:23:14.298 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T18:23:15.353 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T18:23:16.134 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T18:23:17.231 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T18:23:18.169 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T18:23:19.104 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T18:23:19.899 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T18:23:20.667 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T18:23:21.398 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T18:23:21.765 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T18:23:22.576 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T18:23:23.575 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T18:23:24.597 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T18:23:25.369 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T18:23:26.173 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T18:23:26.937 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T18:23:27.699 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T18:23:28.457 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T18:23:29.162 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T18:23:29.871 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T18:23:30.257 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T18:23:30.707 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T18:23:31.108 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T18:23:31.499 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T18:23:31.874 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T18:23:32.759 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T18:23:33.196 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:23:33.673 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T18:23:34.460 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T18:23:35.188 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T18:23:35.696 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:23:36.410 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T18:23:37.121 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:23:38.158 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T18:23:38.785 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T18:23:39.524 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T18:23:40.251 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T18:23:41.614 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T18:23:42.857 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T18:23:43.898 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T18:23:45.151 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:23:46.665 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:23:48.666 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:23:50.815 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:23:52.394 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:23:53.913 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:23:54.950 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T18:23:56.983 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T18:23:57.837 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T18:24:00.177 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T18:24:01.589 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T18:24:03.289 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T18:24:06.980 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T18:24:11.793 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T18:24:14.479 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T18:24:16.927 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T18:24:18.753 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T18:24:19.880 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T18:24:22.125 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T18:24:23.594 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T18:24:25.653 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T18:24:27.056 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T18:24:29.823 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T18:24:32.004 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T18:24:35.021 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T18:24:38.052 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T18:24:40.073 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T18:24:41.981 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T18:24:43.421 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T18:24:47.112 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T18:24:49.821 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T18:24:52.901 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T18:24:55.729 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T18:24:58.454 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T18:25:01.164 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T18:25:03.515 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T18:25:05.002 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T18:25:06.803 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T18:25:10.232 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T18:25:14.626 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T18:25:16.448 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T18:25:19.167 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T18:25:21.936 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T18:25:24.646 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T18:25:27.534 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T18:25:30.584 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T18:25:33.514 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T18:25:36.243 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T18:25:38.021 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T18:25:39.474 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:25:40.808 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:25:42.228 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T18:25:44.813 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:25:47.454 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:25:50.097 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:25:52.769 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:25:55.427 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:25:58.109 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:26:00.712 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T18:26:03.392 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T18:26:06.021 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T18:26:08.705 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:26:11.452 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T18:26:14.126 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T18:26:15.740 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T18:26:17.400 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T18:26:18.932 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:26:20.526 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T18:26:21.590 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T18:26:23.004 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T18:26:24.368 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T18:26:25.731 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T18:26:27.199 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T18:26:28.590 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T18:26:30.042 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T18:26:31.428 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T18:26:32.837 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T18:26:34.854 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T18:26:36.953 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T18:26:37.955 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:26:39.022 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:26:40.404 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T18:26:41.776 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T18:26:43.866 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:26:45.900 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:26:47.380 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T18:26:48.739 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T18:26:50.110 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:26:51.509 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:26:52.927 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T18:26:54.295 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T18:26:55.670 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:26:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:26:58.525 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T18:26:59.905 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T18:27:01.295 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T18:27:02.726 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T18:27:03.981 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T18:27:05.228 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T18:27:06.568 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T18:27:07.978 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:27:09.378 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:29:15.963 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T18:29:17.229 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T18:29:18.480 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T18:29:19.775 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T18:29:21.016 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T18:29:22.275 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T18:29:23.629 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T18:29:24.857 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T18:29:26.126 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T18:29:27.394 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T18:29:28.679 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T18:29:29.930 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T18:29:31.179 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T18:29:32.623 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:29:34.027 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:29:35.389 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:29:36.762 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:29:38.194 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T18:29:39.598 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T18:29:41.063 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:29:42.431 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:29:43.839 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:29:45.216 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:29:46.685 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T18:29:48.172 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T18:29:49.562 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T18:29:50.978 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T18:29:52.370 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T18:29:53.728 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T18:29:54.245 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T18:29:55.253 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T18:29:59.776 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T18:30:04.428 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T18:30:05.775 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T18:30:07.165 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T18:30:08.552 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T18:30:09.963 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T18:30:11.447 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T18:30:12.977 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T18:30:14.399 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T18:30:15.735 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T18:30:17.125 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T18:30:18.502 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T18:30:19.889 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T18:30:21.293 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T18:30:23.064 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T18:30:25.483 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T18:30:26.352 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T18:30:27.259 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T18:30:28.041 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:30:28.800 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:30:29.251 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T18:30:29.705 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T18:30:30.113 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T18:30:31.131 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T18:30:35.063 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T18:30:35.481 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T18:30:36.437 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T18:30:37.172 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T18:30:37.974 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T18:30:38.792 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T18:30:43.428 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T18:30:44.949 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T18:30:46.470 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T18:32:54.253 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T18:35:02.041 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T18:35:03.081 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T18:35:04.027 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T18:35:05.033 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T18:35:06.040 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T18:35:07.303 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T18:35:08.391 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T18:35:09.464 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T18:35:10.684 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T18:35:11.827 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T18:35:12.932 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T18:35:14.091 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T18:35:15.223 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T18:35:16.220 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T18:35:16.981 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T18:35:17.940 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T18:35:18.895 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T18:35:20.341 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T18:35:21.349 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T18:35:22.270 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T18:35:23.265 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T18:35:24.300 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T18:35:25.385 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T18:35:26.174 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T18:35:26.953 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T18:35:27.853 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T18:35:28.619 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T18:35:29.399 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T18:35:30.179 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T18:35:31.185 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T18:35:31.981 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T18:35:32.818 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T18:35:33.602 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T18:35:34.390 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T18:35:35.597 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T18:35:36.397 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T18:35:37.181 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T18:35:37.999 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T18:35:38.795 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T18:35:39.606 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T18:35:40.415 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T18:35:41.245 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T18:35:43.777 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T18:35:44.860 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T18:35:45.916 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T18:35:46.934 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T18:35:48.043 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T18:35:49.116 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T18:35:52.253 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T18:35:53.387 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T18:35:54.688 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T18:35:55.971 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T18:35:57.238 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T18:35:58.261 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T18:35:59.547 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T18:36:01.913 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T18:36:03.333 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T18:36:04.324 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T18:36:05.177 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T18:36:06.023 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T18:36:06.967 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T18:36:07.761 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T18:36:08.167 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T18:36:10.630 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T18:36:11.678 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T18:36:15.510 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T18:36:16.502 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T18:36:17.513 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T18:36:18.566 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T18:36:19.579 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T18:36:20.492 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T18:36:21.503 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T18:36:22.553 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T18:36:23.676 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T18:36:24.719 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T18:36:25.649 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T18:36:26.608 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T18:36:27.583 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T18:36:28.638 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T18:36:29.587 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T18:36:31.611 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T18:36:32.575 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T18:36:33.003 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T18:36:33.474 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T18:36:33.892 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T18:36:34.629 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T18:36:35.356 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T18:36:36.079 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T18:36:36.824 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T18:36:37.659 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T18:36:38.075 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T18:36:38.533 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T18:36:39.758 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T18:36:40.171 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T18:36:41.006 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T18:36:41.864 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T18:36:42.705 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T18:36:43.570 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T18:36:44.417 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T18:36:46.021 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T18:36:46.830 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T18:36:47.812 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T18:36:48.680 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:36:50.560 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T18:36:51.662 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T18:36:52.927 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:36:55.097 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:36:56.303 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T18:36:57.521 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T18:36:58.882 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T18:37:00.149 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T18:37:01.015 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T18:37:02.244 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T18:37:03.491 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T18:37:04.773 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T18:37:06.009 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T18:37:08.718 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T18:37:10.016 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T18:37:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T18:37:12.634 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T18:37:13.930 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T18:37:14.817 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T18:37:15.865 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T18:37:17.056 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T18:37:18.023 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T18:37:18.942 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T18:37:20.202 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T18:37:21.924 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T18:37:23.641 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T18:37:25.505 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T18:37:27.239 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T18:37:28.970 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:37:30.764 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T18:37:32.515 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T18:37:34.381 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T18:37:36.136 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:37:38.018 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T18:37:39.977 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T18:37:41.902 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T18:37:44.399 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T18:37:46.675 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T18:37:47.057 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T18:37:47.462 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T18:37:47.866 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T18:37:48.782 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T18:37:49.693 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T18:37:50.420 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T18:37:51.147 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T18:37:52.499 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T18:37:58.916 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T18:38:00.369 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T18:38:04.861 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T18:38:06.137 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T18:38:07.409 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T18:38:08.516 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T18:38:09.784 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T18:38:11.496 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T18:38:12.893 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T18:38:14.875 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T18:38:16.316 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T18:38:18.639 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T18:38:20.958 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T18:38:21.729 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T18:38:22.497 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T18:38:26.597 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T18:38:28.172 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T18:38:39.811 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T18:38:40.727 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T18:38:42.078 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T18:38:45.596 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T18:38:46.870 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T18:38:49.033 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T18:38:58.849 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T18:39:17.370 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T18:39:37.289 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T18:41:02.352 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T18:41:15.045 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T18:41:31.841 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T18:41:34.120 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T18:41:39.586 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T18:41:43.462 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T18:41:46.574 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T18:41:47.602 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T18:41:52.141 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T18:41:53.472 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T18:41:54.568 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T18:41:55.711 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T18:42:16.868 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T18:42:20.844 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T18:42:22.008 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T18:42:22.865 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T18:42:24.044 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T18:42:29.207 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T18:42:33.177 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T18:42:37.097 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T18:42:38.216 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T18:42:39.342 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T18:42:40.433 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T18:42:41.608 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T18:42:42.690 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T18:42:43.851 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T18:42:45.030 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T18:42:46.861 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T18:42:49.441 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T18:42:53.601 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T18:42:56.061 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T18:42:59.451 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T18:43:04.928 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T18:43:07.272 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T18:43:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T18:43:17.517 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T18:43:19.594 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T18:43:20.997 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T18:43:23.045 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T18:43:24.094 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T18:43:35.096 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T18:43:36.162 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T18:43:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T18:43:38.252 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T18:43:39.404 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T18:43:40.861 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T18:44:03.162 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T18:44:05.771 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T18:44:07.199 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T18:44:09.179 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T18:44:11.103 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T18:44:20.591 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T18:44:22.773 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T18:44:33.522 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T18:45:13.993 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T18:45:30.980 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T18:45:35.737 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T18:45:40.199 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T18:45:41.995 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T18:45:43.949 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T18:45:45.201 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T18:45:47.657 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T18:45:49.712 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T18:45:53.542 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T18:45:54.493 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T18:45:55.504 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T18:45:56.522 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T18:45:57.316 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T18:45:58.140 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T18:45:59.131 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T18:45:59.981 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T18:46:00.792 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T18:46:02.000 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T18:46:02.888 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T18:46:03.744 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T18:46:04.599 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T18:46:05.456 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T18:46:06.316 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T18:46:07.448 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T18:46:08.541 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T18:46:10.019 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T18:46:11.112 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T18:46:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T18:46:13.378 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T18:46:14.460 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T18:46:15.315 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T18:46:16.208 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T18:46:17.062 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T18:46:17.878 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T18:46:56.464 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T18:47:34.475 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T18:47:44.649 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T18:47:45.629 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T18:48:47.536 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T18:49:49.373 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T18:49:50.626 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T18:49:51.666 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T18:49:52.515 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T18:49:53.319 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T18:50:21.417 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T18:50:30.402 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T18:50:39.085 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T18:50:40.085 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T18:50:41.225 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T18:50:42.302 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T18:50:43.725 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T18:50:44.795 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T18:50:45.967 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T18:50:47.070 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T18:50:48.187 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T18:50:49.510 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T18:50:50.850 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T18:50:52.013 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T18:50:53.128 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T18:50:55.149 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T18:50:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T18:50:59.924 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T18:51:02.714 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T18:51:05.088 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T18:51:07.898 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T18:51:09.945 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T18:51:12.018 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T18:51:14.504 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T18:51:16.995 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T18:51:19.765 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T18:51:20.849 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T18:51:21.881 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T18:51:23.108 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T18:51:25.283 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T18:51:27.821 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T18:51:30.169 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T18:51:32.863 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T18:51:53.852 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T18:51:55.655 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T18:51:57.671 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:51:59.707 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:52:02.264 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T18:52:04.466 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T18:52:05.624 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T18:52:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T18:52:08.430 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T18:52:09.322 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T18:52:10.096 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T18:52:10.871 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T18:52:11.972 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T18:52:12.889 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T18:52:14.957 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T18:52:15.953 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T18:52:16.776 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T18:52:17.626 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T18:52:18.459 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T18:52:19.324 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T18:52:20.313 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T18:52:21.136 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T18:52:21.949 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T18:52:22.872 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T18:52:23.676 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T18:52:25.016 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T18:52:26.071 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T18:52:27.351 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T18:52:28.589 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T18:52:29.871 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T18:52:30.905 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T18:52:32.420 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T18:52:33.728 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T18:52:35.090 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T18:52:36.337 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T18:52:37.691 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T18:52:38.994 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:52:40.434 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T18:52:41.971 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T18:52:43.424 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:52:44.742 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T18:52:45.776 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T18:52:46.937 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T18:52:48.413 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T18:52:49.500 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T18:52:50.818 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:52:52.389 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:52:53.496 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T18:52:54.928 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T18:52:56.168 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T18:53:06.959 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T18:53:08.139 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T18:53:18.641 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T18:53:19.930 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T18:53:21.157 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T18:53:21.950 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T18:53:22.884 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:53:23.780 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:53:24.829 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:53:25.804 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T18:53:26.717 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T18:53:27.536 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T18:53:28.446 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T18:53:29.631 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T18:53:30.525 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T18:53:31.720 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T18:53:32.858 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T18:53:33.748 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T18:53:34.717 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T18:53:36.220 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T18:53:47.569 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T18:53:48.416 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:53:49.386 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:53:50.460 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:53:51.532 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T18:53:53.559 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T18:53:54.722 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T18:53:56.991 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T18:54:02.125 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T18:54:03.940 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T18:54:16.419 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T18:54:27.071 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T18:54:27.933 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T18:54:29.316 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T18:54:45.354 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T18:55:22.909 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T18:55:27.327 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T18:55:30.120 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T18:55:32.816 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T18:55:35.049 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T18:55:35.895 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T18:55:49.588 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T18:55:55.156 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T18:56:10.706 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T18:56:14.913 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T18:56:17.223 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T18:56:19.477 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T18:56:20.575 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T18:56:27.955 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T18:56:31.686 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T18:56:33.076 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T18:56:34.663 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T18:56:42.037 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T18:56:46.447 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T18:56:52.317 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T18:56:54.646 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T18:56:54.977 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T18:57:10.220 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T18:57:15.044 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T18:57:17.840 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T18:57:22.529 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T18:57:24.116 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T18:57:59.950 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T18:58:00.300 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T18:58:02.162 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T18:58:03.539 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T18:58:05.054 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T18:58:06.831 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T18:58:06.873 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T18:58:06.873 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.873 INFO:teuthology.orchestra.run.smithi157.stdout:=============================== warnings summary =============================== 2024-09-12T18:58:06.873 INFO:teuthology.orchestra.run.smithi157.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T18:58:06.873 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T18:58:06.873 INFO:teuthology.orchestra.run.smithi157.stdout: import imp 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py:120 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout: if boto_type is 'S3Connection': 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_headers.py:124 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3.py:359 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T18:58:06.874 INFO:teuthology.orchestra.run.smithi157.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout: if k is 'BucketName': 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout: @pytest.mark.timeout(10) 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T18:58:06.875 INFO:teuthology.orchestra.run.smithi157.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T18:58:06.876 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.877 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.878 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T18:58:06.879 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:58:06.879 INFO:teuthology.orchestra.run.smithi157.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:58:06.879 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.879 INFO:teuthology.orchestra.run.smithi157.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T18:58:06.879 INFO:teuthology.orchestra.run.smithi157.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:58:06.879 INFO:teuthology.orchestra.run.smithi157.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:58:06.879 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T18:58:06.879 INFO:teuthology.orchestra.run.smithi157.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T18:58:06.879 INFO:teuthology.orchestra.run.smithi157.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 2170.45s (0:36:10) = 2024-09-12T18:58:07.049 INFO:teuthology.orchestra.run.smithi157.stdout:___________________________________ summary ____________________________________ 2024-09-12T18:58:07.049 INFO:teuthology.orchestra.run.smithi157.stdout: py: commands succeeded 2024-09-12T18:58:07.049 INFO:teuthology.orchestra.run.smithi157.stdout: congratulations :) 2024-09-12T18:58:07.088 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T18:58:07.089 DEBUG:teuthology.orchestra.run.smithi157:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:58:07.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:58:07.185 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T18:58:07.185 DEBUG:teuthology.orchestra.run.smithi157:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:58:07.190 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T18:58:07.190 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:58:07.375 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:58:07.387 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:58:07.387 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:58:07.387 DEBUG:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:58:07.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:58:07.394 INFO:teuthology.orchestra.run.smithi157.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:58:07.394 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:58:07.440 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:58:07.440 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:58:07.488 INFO:tasks.workunit:timeout=3h 2024-09-12T18:58:07.488 INFO:tasks.workunit:cleanup=True 2024-09-12T18:58:07.489 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:58:07.538 INFO:tasks.workunit.client.0.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:59:05.794 INFO:tasks.workunit.client.0.smithi157.stderr:Updating files: 98% (12491/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T18:59:06.668 INFO:tasks.workunit.client.0.smithi157.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T18:59:06.668 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:59:06.668 INFO:tasks.workunit.client.0.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:59:06.668 INFO:tasks.workunit.client.0.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr: git switch -c 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr:Or undo this operation with: 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr: git switch - 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:59:06.669 INFO:tasks.workunit.client.0.smithi157.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:59:06.670 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:59:06.670 INFO:tasks.workunit.client.0.smithi157.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T18:59:06.676 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:59:06.727 INFO:tasks.workunit.client.0.smithi157.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:59:06.730 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:59:06.730 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:59:06.781 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:59:06.833 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:59:06.880 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:59:06.881 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:59:06.881 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:59:06.918 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:59:06.924 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-12T18:59:06.925 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:59:06.968 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T18:59:06.969 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T18:59:06.969 DEBUG:teuthology.orchestra.run.smithi157:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:59:07.024 INFO:tasks.workunit.client.0.smithi157.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:59:07.025 INFO:tasks.workunit.client.0.smithi157.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:59:07.025 INFO:tasks.workunit.client.0.smithi157.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:59:09.961 INFO:tasks.workunit.client.0.smithi157.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:59:09.961 INFO:tasks.workunit.client.0.smithi157.stderr:++ deactivate nondestructive 2024-09-12T18:59:09.962 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T18:59:09.962 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T18:59:09.962 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:59:09.962 INFO:tasks.workunit.client.0.smithi157.stderr:++ hash -r 2024-09-12T18:59:09.962 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T18:59:09.962 INFO:tasks.workunit.client.0.smithi157.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:59:09.962 INFO:tasks.workunit.client.0.smithi157.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:59:09.962 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:59:09.962 INFO:tasks.workunit.client.0.smithi157.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:59:09.962 INFO:tasks.workunit.client.0.smithi157.stderr:++ export VIRTUAL_ENV 2024-09-12T18:59:09.962 INFO:tasks.workunit.client.0.smithi157.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ export PATH 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' ']' 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -z '' ']' 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ PS1='(rgw) ' 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ export PS1 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ hash -r 2024-09-12T18:59:09.963 INFO:tasks.workunit.client.0.smithi157.stderr:+ pip install pip --upgrade 2024-09-12T18:59:10.354 INFO:tasks.workunit.client.0.smithi157.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T18:59:10.567 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting pip 2024-09-12T18:59:10.573 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:59:10.610 INFO:tasks.workunit.client.0.smithi157.stdout:Installing collected packages: pip 2024-09-12T18:59:10.610 INFO:tasks.workunit.client.0.smithi157.stdout: Attempting uninstall: pip 2024-09-12T18:59:10.611 INFO:tasks.workunit.client.0.smithi157.stdout: Found existing installation: pip 22.0.2 2024-09-12T18:59:10.895 INFO:tasks.workunit.client.0.smithi157.stdout: Uninstalling pip-22.0.2: 2024-09-12T18:59:10.901 INFO:tasks.workunit.client.0.smithi157.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T18:59:11.653 INFO:tasks.workunit.client.0.smithi157.stdout:Successfully installed pip-24.2 2024-09-12T18:59:11.714 INFO:tasks.workunit.client.0.smithi157.stderr:+ pip install boto3 2024-09-12T18:59:12.653 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting boto3 2024-09-12T18:59:12.654 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:59:13.205 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:59:13.206 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:59:13.262 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:59:13.263 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:59:13.317 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:59:13.318 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:59:13.368 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:59:13.369 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:59:13.444 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:59:13.445 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T18:59:13.631 INFO:tasks.workunit.client.0.smithi157.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:59:13.632 INFO:tasks.workunit.client.0.smithi157.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:59:13.635 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:59:13.637 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:59:13.646 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:59:13.647 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:59:13.648 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:59:13.650 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T18:59:13.651 INFO:tasks.workunit.client.0.smithi157.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:59:13.718 INFO:tasks.workunit.client.0.smithi157.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:59:14.780 INFO:tasks.workunit.client.0.smithi157.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T18:59:14.990 INFO:tasks.workunit.client.0.smithi157.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T18:59:15.131 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T18:59:15.169 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:59:15.170 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:59:15.211 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.208+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.208+0000 7ff38da559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:15.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.208+0000 7ff38da559c0 20 realm 2024-09-12T18:59:15.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.208+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.208+0000 7ff38da559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:15.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.208+0000 7ff38da559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:59:15.213 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.208+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.208+0000 7ff38da559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:15.214 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.208+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.208+0000 7ff38da559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:15.215 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.208+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.212+0000 7ff38da559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:59:15.216 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.212+0000 7ff38da559c0 20 searching for the correct realm 2024-09-12T18:59:15.223 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.216+0000 7ff38bd5c640 0 -- 172.21.15.157:0/1902301791 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7ff3800827e0 msgr2=0x7ff38009c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:15.231 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.224+0000 7ff38b55b640 0 -- 172.21.15.157:0/1902301791 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x5556b23bf290 msgr2=0x5556b23c1680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:15.235 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:59:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:59:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:59:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:59:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:59:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:59:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:59:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 zone default found 2024-09-12T18:59:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 4 Realm: () 2024-09-12T18:59:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:59:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:59:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:59:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 zonegroup default 2024-09-12T18:59:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 started sync module instance, tier type = 2024-09-12T18:59:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.232+0000 7ff38da559c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:59:15.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.248+0000 7ff38da559c0 20 add_watcher() i=0 2024-09-12T18:59:15.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.248+0000 7ff38da559c0 20 add_watcher() i=1 2024-09-12T18:59:15.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.248+0000 7ff38da559c0 20 add_watcher() i=2 2024-09-12T18:59:15.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.248+0000 7ff38da559c0 20 add_watcher() i=3 2024-09-12T18:59:15.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.248+0000 7ff38da559c0 20 add_watcher() i=4 2024-09-12T18:59:15.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.248+0000 7ff38da559c0 20 add_watcher() i=5 2024-09-12T18:59:15.252 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.248+0000 7ff38da559c0 20 add_watcher() i=6 2024-09-12T18:59:15.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.248+0000 7ff38da559c0 20 add_watcher() i=7 2024-09-12T18:59:15.253 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.248+0000 7ff38da559c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:59:15.255 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.248+0000 7ff241fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:59:15.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:59:15.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:59:15.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 5 note: GC not initialized 2024-09-12T18:59:15.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff240fe1640 20 reqs_thread_entry: start 2024-09-12T18:59:15.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 20 init_complete bucket index max shards: 1 2024-09-12T18:59:15.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 20 Filter name: none 2024-09-12T18:59:15.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff1ba7fc640 20 reqs_thread_entry: start 2024-09-12T18:59:15.256 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T18:59:15.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:15.257 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T18:59:15.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:59:15.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T18:59:15.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:15.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:15.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T18:59:15.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:59:15.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:59:15.258 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.252+0000 7ff38da559c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:59:15.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.256+0000 7ff38da559c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:59:15.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.256+0000 7ff38da559c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:59:15.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.256+0000 7ff38da559c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T18:59:15.260 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.256+0000 7ff26effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366378 cookie 93830845882176 notifier 8693 bl.length()=613 2024-09-12T18:59:15.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.256+0000 7ff26effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:59:15.261 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.256+0000 7ff26effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:59:15.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.260+0000 7ff38da559c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:59:15.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.260+0000 7ff38da559c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:59:15.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.260+0000 7ff38da559c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T18:59:15.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.260+0000 7ff26effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367795 cookie 93830845881120 notifier 8693 bl.length()=191 2024-09-12T18:59:15.264 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.260+0000 7ff26effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:59:15.265 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.260+0000 7ff26effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:59:15.266 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.260+0000 7ff241fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:59:15.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.268+0000 7ff38da559c0 20 remove_watcher() i=0 2024-09-12T18:59:15.271 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.268+0000 7ff38da559c0 2 removed watcher, disabling cache 2024-09-12T18:59:15.273 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.268+0000 7ff38da559c0 20 remove_watcher() i=1 2024-09-12T18:59:15.275 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.272+0000 7ff38da559c0 20 remove_watcher() i=2 2024-09-12T18:59:15.277 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.272+0000 7ff38da559c0 20 remove_watcher() i=3 2024-09-12T18:59:15.280 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.276+0000 7ff38da559c0 20 remove_watcher() i=4 2024-09-12T18:59:15.281 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.276+0000 7ff38da559c0 20 remove_watcher() i=5 2024-09-12T18:59:15.282 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.276+0000 7ff38da559c0 20 remove_watcher() i=6 2024-09-12T18:59:15.283 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:15.276+0000 7ff38da559c0 20 remove_watcher() i=7 2024-09-12T18:59:15.721 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T18:59:15.721 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:59:16.037 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:59:16.070 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:59:16.070 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:59:16.115 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.108+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.112+0000 7f03a1c749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:16.117 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.112+0000 7f03a1c749c0 20 realm 2024-09-12T18:59:16.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.112+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.112+0000 7f03a1c749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:16.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.112+0000 7f03a1c749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:59:16.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.112+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.112+0000 7f03a1c749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:16.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.112+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.112+0000 7f03a1c749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:16.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.116+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.116+0000 7f03a1c749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:59:16.121 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.116+0000 7f03a1c749c0 20 searching for the correct realm 2024-09-12T18:59:16.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.120+0000 7f039ef79640 0 -- 172.21.15.157:0/4247806787 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f03940b5570 msgr2=0x7f03940b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:59:16.341 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.336+0000 7f039f77a640 0 -- 172.21.15.157:0/4247806787 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7f03940f7410 msgr2=0x7f03940f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:59:16.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.556+0000 7f03a1c749c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:59:16.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.556+0000 7f03a1c749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:59:16.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.556+0000 7f03a1c749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:59:16.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.556+0000 7f03a1c749c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:59:16.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.556+0000 7f03a1c749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:59:16.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.556+0000 7f03a1c749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:59:16.563 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.556+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.565 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.556+0000 7f03a1c749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:16.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.556+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.556+0000 7f03a1c749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:16.566 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.556+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:59:16.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 20 zone default found 2024-09-12T18:59:16.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 4 Realm: () 2024-09-12T18:59:16.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:59:16.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:59:16.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:59:16.571 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 20 zonegroup default 2024-09-12T18:59:16.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:16.572 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:16.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.573 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:16.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 20 started sync module instance, tier type = 2024-09-12T18:59:16.574 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.560+0000 7f03a1c749c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:59:16.589 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.584+0000 7f03a1c749c0 20 add_watcher() i=0 2024-09-12T18:59:16.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.584+0000 7f03a1c749c0 20 add_watcher() i=1 2024-09-12T18:59:16.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.584+0000 7f03a1c749c0 20 add_watcher() i=2 2024-09-12T18:59:16.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.584+0000 7f03a1c749c0 20 add_watcher() i=3 2024-09-12T18:59:16.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.584+0000 7f03a1c749c0 20 add_watcher() i=4 2024-09-12T18:59:16.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.584+0000 7f03a1c749c0 20 add_watcher() i=5 2024-09-12T18:59:16.590 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.584+0000 7f03a1c749c0 20 add_watcher() i=6 2024-09-12T18:59:16.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.588+0000 7f03a1c749c0 20 add_watcher() i=7 2024-09-12T18:59:16.592 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.588+0000 7f03a1c749c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:59:16.596 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.592+0000 7f0255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:59:16.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.592+0000 7f03a1c749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:59:16.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.592+0000 7f03a1c749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:59:16.597 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.592+0000 7f03a1c749c0 5 note: GC not initialized 2024-09-12T18:59:16.598 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.592+0000 7f0254fe1640 20 reqs_thread_entry: start 2024-09-12T18:59:16.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.592+0000 7f03a1c749c0 20 init_complete bucket index max shards: 1 2024-09-12T18:59:16.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.592+0000 7f03a1c749c0 20 Filter name: none 2024-09-12T18:59:16.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.592+0000 7f01ce7fc640 20 reqs_thread_entry: start 2024-09-12T18:59:16.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.592+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.599 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.592+0000 7f03a1c749c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:59:16.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.592+0000 7f03a1c749c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:16.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.596+0000 7f03a1c749c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:59:16.600 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.596+0000 7f03a1c749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:59:16.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.596+0000 7f03a1c749c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T18:59:16.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.596+0000 7f03a1c749c0 20 INFO: main: starting shard=0 2024-09-12T18:59:16.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.596+0000 7f03a1c749c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.782.0 2024-09-12T18:59:16.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.596+0000 7f03a1c749c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:59:16.601 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.596+0000 7f03a1c749c0 20 INFO: main: done 2024-09-12T18:59:16.602 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.596+0000 7f0255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:59:16.607 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.604+0000 7f03a1c749c0 20 remove_watcher() i=0 2024-09-12T18:59:16.608 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.604+0000 7f03a1c749c0 2 removed watcher, disabling cache 2024-09-12T18:59:16.610 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.604+0000 7f03a1c749c0 20 remove_watcher() i=1 2024-09-12T18:59:16.612 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.608+0000 7f03a1c749c0 20 remove_watcher() i=2 2024-09-12T18:59:16.618 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.612+0000 7f03a1c749c0 20 remove_watcher() i=3 2024-09-12T18:59:16.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.616+0000 7f03a1c749c0 20 remove_watcher() i=4 2024-09-12T18:59:16.622 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.616+0000 7f03a1c749c0 20 remove_watcher() i=5 2024-09-12T18:59:16.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.620+0000 7f03a1c749c0 20 remove_watcher() i=6 2024-09-12T18:59:16.626 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.620+0000 7f03a1c749c0 20 remove_watcher() i=7 2024-09-12T18:59:16.643 INFO:tasks.workunit.client.0.smithi157.stderr:rados -p default.rgw.buckets.data ls | grep 6885a428-71fa-4bf2-b882-391d464d7842 2024-09-12T18:59:16.686 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:59:16.687 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:59:16.815 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:16.808+0000 7fde4868c640 0 -- 172.21.15.157:0/4179028260 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x7fde300195c0 msgr2=0x7fde300199e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:59:16.848 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T18:59:16.849 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:59:16.849 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:59:18.396 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:59:18.837 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:59:18.861 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:59:18.862 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:59:18.903 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.896+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.900+0000 7f5e987029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:18.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.900+0000 7f5e987029c0 20 realm 2024-09-12T18:59:18.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.900+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.905 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.900+0000 7f5e987029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:18.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.900+0000 7f5e987029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:59:18.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.900+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.900+0000 7f5e987029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:18.906 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.900+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.904+0000 7f5e987029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:18.907 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.904+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.904+0000 7f5e987029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:59:18.908 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.904+0000 7f5e987029c0 20 searching for the correct realm 2024-09-12T18:59:18.913 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.908+0000 7f5e96a09640 0 -- 172.21.15.157:0/335672693 >> [v2:172.21.15.157:6821/3908026248,v1:172.21.15.157:6823/3908026248] conn(0x5590a69f1420 msgr2=0x5590a69f3890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:18.920 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.916+0000 7f5e95a07640 0 -- 172.21.15.157:0/335672693 >> [v2:172.21.15.190:6816/2884135430,v1:172.21.15.190:6817/2884135430] conn(0x7f5e800dc070 msgr2=0x7f5e800dc960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:18.928 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.920+0000 7f5e987029c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:59:18.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.920+0000 7f5e987029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:59:18.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.920+0000 7f5e987029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:59:18.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.920+0000 7f5e987029c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:59:18.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.920+0000 7f5e987029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:59:18.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.920+0000 7f5e987029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:59:18.929 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.920+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.920+0000 7f5e987029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:18.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.920+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:18.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:59:18.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 zone default found 2024-09-12T18:59:18.930 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 4 Realm: () 2024-09-12T18:59:18.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:59:18.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:59:18.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:59:18.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 zonegroup default 2024-09-12T18:59:18.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:18.931 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:18.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:18.932 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 started sync module instance, tier type = 2024-09-12T18:59:18.933 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.924+0000 7f5e987029c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:59:18.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.940+0000 7f5e987029c0 20 add_watcher() i=0 2024-09-12T18:59:18.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.940+0000 7f5e987029c0 20 add_watcher() i=1 2024-09-12T18:59:18.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.940+0000 7f5e987029c0 20 add_watcher() i=2 2024-09-12T18:59:18.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.940+0000 7f5e987029c0 20 add_watcher() i=3 2024-09-12T18:59:18.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.940+0000 7f5e987029c0 20 add_watcher() i=4 2024-09-12T18:59:18.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.940+0000 7f5e987029c0 20 add_watcher() i=5 2024-09-12T18:59:18.944 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.940+0000 7f5e987029c0 20 add_watcher() i=6 2024-09-12T18:59:18.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.940+0000 7f5e987029c0 20 add_watcher() i=7 2024-09-12T18:59:18.945 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.940+0000 7f5e987029c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:59:18.947 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.940+0000 7f5d4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:59:18.949 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:59:18.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:59:18.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 5 note: GC not initialized 2024-09-12T18:59:18.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5cc77fe640 20 reqs_thread_entry: start 2024-09-12T18:59:18.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 init_complete bucket index max shards: 1 2024-09-12T18:59:18.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 Filter name: none 2024-09-12T18:59:18.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5cc57fa640 20 reqs_thread_entry: start 2024-09-12T18:59:18.950 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:59:18.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:18.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:59:18.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:59:18.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T18:59:18.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 INFO: main: starting shard=0 2024-09-12T18:59:18.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.782.0 2024-09-12T18:59:18.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:59:18.951 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5e987029c0 20 INFO: main: done 2024-09-12T18:59:18.952 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.944+0000 7f5d4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:59:18.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.948+0000 7f5e987029c0 20 remove_watcher() i=0 2024-09-12T18:59:18.955 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.948+0000 7f5e987029c0 2 removed watcher, disabling cache 2024-09-12T18:59:18.957 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.952+0000 7f5e987029c0 20 remove_watcher() i=1 2024-09-12T18:59:18.959 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.956+0000 7f5e987029c0 20 remove_watcher() i=2 2024-09-12T18:59:18.961 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.956+0000 7f5e987029c0 20 remove_watcher() i=3 2024-09-12T18:59:18.963 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.956+0000 7f5e987029c0 20 remove_watcher() i=4 2024-09-12T18:59:18.964 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.960+0000 7f5e987029c0 20 remove_watcher() i=5 2024-09-12T18:59:18.965 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.960+0000 7f5e987029c0 20 remove_watcher() i=6 2024-09-12T18:59:18.966 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:18.960+0000 7f5e987029c0 20 remove_watcher() i=7 2024-09-12T18:59:18.980 INFO:tasks.workunit.client.0.smithi157.stderr:rados -p default.rgw.buckets.data ls | grep 86428d35-db41-40ba-9074-49da0dc243f1 2024-09-12T18:59:19.002 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:59:19.002 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:59:19.153 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:19.148+0000 7f9d3e678640 0 -- 172.21.15.157:0/1888824502 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x7f9d28008050 msgr2=0x7f9d280122f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:19.182 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T18:59:19.182 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:59:19.422 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:59:21.036 INFO:tasks.workunit.client.0.smithi157.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:59:21.037 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:59:21.586 INFO:tasks.workunit.client.0.smithi157.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T18:59:21.586 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-09-12T18:59:21.997 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T18:59:25.661 INFO:tasks.workunit.client.0.smithi157.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T18:59:26.102 INFO:tasks.workunit.client.0.smithi157.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T18:59:26.133 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:59:26.133 INFO:tasks.workunit.client.0.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:59:26.171 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.164+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:26.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 20 realm 2024-09-12T18:59:26.172 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:26.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:59:26.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:26.173 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:26.174 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:59:26.175 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.168+0000 7fb80e46f9c0 20 searching for the correct realm 2024-09-12T18:59:26.181 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.176+0000 7fb80c776640 0 -- 172.21.15.157:0/3305612277 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7fb800066900 msgr2=0x7fb8000898a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:26.397 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.392+0000 7fb80bf75640 0 -- 172.21.15.157:0/3305612277 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x560b9df74fe0 msgr2=0x560b9df773d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:26.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:59:26.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:59:26.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:59:26.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:59:26.404 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:59:26.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:59:26.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:26.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.405 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:26.406 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:59:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 zone default found 2024-09-12T18:59:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 4 Realm: () 2024-09-12T18:59:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:59:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:59:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:59:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 zonegroup default 2024-09-12T18:59:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.400+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.404+0000 7fb80e46f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:26.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.404+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.404+0000 7fb80e46f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:26.408 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.404+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.404+0000 7fb80e46f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:26.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.404+0000 7fb80e46f9c0 20 started sync module instance, tier type = 2024-09-12T18:59:26.409 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.404+0000 7fb80e46f9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:59:26.432 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.428+0000 7fb80e46f9c0 20 add_watcher() i=0 2024-09-12T18:59:26.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.428+0000 7fb80e46f9c0 20 add_watcher() i=1 2024-09-12T18:59:26.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.428+0000 7fb80e46f9c0 20 add_watcher() i=2 2024-09-12T18:59:26.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.428+0000 7fb80e46f9c0 20 add_watcher() i=3 2024-09-12T18:59:26.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.428+0000 7fb80e46f9c0 20 add_watcher() i=4 2024-09-12T18:59:26.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.428+0000 7fb80e46f9c0 20 add_watcher() i=5 2024-09-12T18:59:26.433 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.428+0000 7fb80e46f9c0 20 add_watcher() i=6 2024-09-12T18:59:26.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.428+0000 7fb80e46f9c0 20 add_watcher() i=7 2024-09-12T18:59:26.435 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.428+0000 7fb80e46f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:59:26.439 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.432+0000 7fb6c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:59:26.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:59:26.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:59:26.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 5 note: GC not initialized 2024-09-12T18:59:26.440 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb6c17e2640 20 reqs_thread_entry: start 2024-09-12T18:59:26.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:59:26.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 20 Filter name: none 2024-09-12T18:59:26.441 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb6ba7fc640 20 reqs_thread_entry: start 2024-09-12T18:59:26.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T18:59:26.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:59:26.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T18:59:26.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T18:59:26.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.782 : miss 2024-09-12T18:59:26.442 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:59:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.782 info.flags=0x17 2024-09-12T18:59:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.782 to cache LRU end 2024-09-12T18:59:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:59:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:59:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.782 2024-09-12T18:59:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 20 bucket index object: :.dir.e807567e-1eb5-4a0c-9e30-862938396cf3.4526.782.0 2024-09-12T18:59:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:59:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.436+0000 7fb80e46f9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T18:59:26.444 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.440+0000 7fb6c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:59:26.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.444+0000 7fb80e46f9c0 20 remove_watcher() i=0 2024-09-12T18:59:26.449 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.444+0000 7fb80e46f9c0 2 removed watcher, disabling cache 2024-09-12T18:59:26.451 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.448+0000 7fb80e46f9c0 20 remove_watcher() i=1 2024-09-12T18:59:26.454 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.448+0000 7fb80e46f9c0 20 remove_watcher() i=2 2024-09-12T18:59:26.456 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.452+0000 7fb80e46f9c0 20 remove_watcher() i=3 2024-09-12T18:59:26.458 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.452+0000 7fb80e46f9c0 20 remove_watcher() i=4 2024-09-12T18:59:26.460 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.456+0000 7fb80e46f9c0 20 remove_watcher() i=5 2024-09-12T18:59:26.461 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.456+0000 7fb80e46f9c0 20 remove_watcher() i=6 2024-09-12T18:59:26.463 INFO:tasks.workunit.client.0.smithi157.stderr:2024-09-12T18:59:26.456+0000 7fb80e46f9c0 20 remove_watcher() i=7 2024-09-12T18:59:26.478 INFO:tasks.workunit.client.0.smithi157.stderr:Deleting bucket versioning-bucket 2024-09-12T18:59:26.609 INFO:tasks.workunit.client.0.smithi157.stderr:Completed bucket versioning tests 2024-09-12T18:59:26.609 INFO:tasks.workunit.client.0.smithi157.stdout:connected to http://localhost:80 2024-09-12T18:59:26.708 INFO:tasks.workunit.client.0.smithi157.stderr:+ deactivate 2024-09-12T18:59:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T18:59:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:59:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:+ export PATH 2024-09-12T18:59:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:59:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n '' ']' 2024-09-12T18:59:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:59:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:+ hash -r 2024-09-12T18:59:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' -n '' ']' 2024-09-12T18:59:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:59:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:59:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:59:26.710 INFO:tasks.workunit.client.0.smithi157.stderr:+ unset -f deactivate 2024-09-12T18:59:26.710 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo OK. 2024-09-12T18:59:26.711 INFO:tasks.workunit.client.0.smithi157.stdout:OK. 2024-09-12T18:59:26.711 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:59:26.711 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:59:26.763 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T18:59:26.764 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:59:27.153 DEBUG:teuthology.parallel:result is None 2024-09-12T18:59:27.154 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:59:27.167 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:59:27.167 DEBUG:teuthology.orchestra.run.smithi157:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:59:27.216 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:59:27.216 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T18:59:27.237 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T18:59:27.246 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T18:59:27.247 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T18:59:27.247 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:59:27.307 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T18:59:27.307 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T18:59:27.339 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:59:27.339 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:59:27.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.372+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.372+0000 7f39ff2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:27.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.372+0000 7f39ff2179c0 20 realm 2024-09-12T18:59:27.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.372+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.372+0000 7f39ff2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:27.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.372+0000 7f39ff2179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:59:27.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.372+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.372+0000 7f39ff2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:27.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.372+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.376+0000 7f39ff2179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:27.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.376+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.376+0000 7f39ff2179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:59:27.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.376+0000 7f39ff2179c0 20 searching for the correct realm 2024-09-12T18:59:27.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.384+0000 7f39fd51e640 0 -- 172.21.15.157:0/1743546531 >> [v2:172.21.15.190:6808/393781841,v1:172.21.15.190:6809/393781841] conn(0x7f39e4038be0 msgr2=0x7f39e4008440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:59:27.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.600+0000 7f39fcd1d640 0 -- 172.21.15.157:0/1743546531 >> [v2:172.21.15.190:6800/962816639,v1:172.21.15.190:6801/962816639] conn(0x557339049070 msgr2=0x55733904b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:27.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.608+0000 7f39ff2179c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:59:27.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.608+0000 7f39ff2179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:59:27.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.608+0000 7f39ff2179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:59:27.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.608+0000 7f39ff2179c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:59:27.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.608+0000 7f39ff2179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:59:27.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.608+0000 7f39ff2179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:59:27.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.608+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:27.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:27.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:59:27.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 zone default found 2024-09-12T18:59:27.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 4 Realm: () 2024-09-12T18:59:27.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:59:27.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:59:27.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:59:27.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 zonegroup default 2024-09-12T18:59:27.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:27.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:27.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.612+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.616+0000 7f39ff2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:27.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.616+0000 7f39ff2179c0 20 started sync module instance, tier type = 2024-09-12T18:59:27.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.616+0000 7f39ff2179c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:59:27.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.636+0000 7f39ff2179c0 20 add_watcher() i=0 2024-09-12T18:59:27.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.636+0000 7f39ff2179c0 20 add_watcher() i=1 2024-09-12T18:59:27.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.636+0000 7f39ff2179c0 20 add_watcher() i=2 2024-09-12T18:59:27.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.636+0000 7f39ff2179c0 20 add_watcher() i=3 2024-09-12T18:59:27.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.636+0000 7f39ff2179c0 20 add_watcher() i=4 2024-09-12T18:59:27.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.636+0000 7f39ff2179c0 20 add_watcher() i=5 2024-09-12T18:59:27.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.636+0000 7f39ff2179c0 20 add_watcher() i=6 2024-09-12T18:59:27.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.640+0000 7f39ff2179c0 20 add_watcher() i=7 2024-09-12T18:59:27.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.640+0000 7f39ff2179c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:59:27.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.644+0000 7f38b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:59:27.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.644+0000 7f39ff2179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:59:27.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.644+0000 7f39ff2179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:59:27.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.736+0000 7f38b1fe3640 20 reqs_thread_entry: start 2024-09-12T18:59:27.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.736+0000 7f39ff2179c0 20 init_complete bucket index max shards: 1 2024-09-12T18:59:27.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.736+0000 7f39ff2179c0 20 Filter name: none 2024-09-12T18:59:27.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.736+0000 7f38237fe640 20 reqs_thread_entry: start 2024-09-12T18:59:27.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.736+0000 7f39ff2179c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:59:27.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.736+0000 7f39ff2179c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:27.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.740+0000 7f39ff2179c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T18:59:27.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.740+0000 7f39ff2179c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T18:59:27.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.740+0000 7f39ff2179c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:59:27.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.740+0000 7f39ff2179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:59:27.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.740+0000 7f39ff2179c0 10 removing key index: RKBEVYWUFQMJUSFSWRFB 2024-09-12T18:59:27.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.744+0000 7f39ff2179c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:RKBEVYWUFQMJUSFSWRFB, ofs0, ns] 2024-09-12T18:59:27.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.744+0000 7f38d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367490 cookie 93953366252112 notifier 9501 bl.length()=170 2024-09-12T18:59:27.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.748+0000 7f39ff2179c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T18:59:27.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.748+0000 7f39ff2179c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:59:27.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.748+0000 7f38d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366315 cookie 93953366206064 notifier 9501 bl.length()=181 2024-09-12T18:59:27.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.752+0000 7f39ff2179c0 10 removing user buckets index 2024-09-12T18:59:27.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.756+0000 7f39ff2179c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T18:59:27.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.756+0000 7f38d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366379 cookie 93953366259216 notifier 9501 bl.length()=172 2024-09-12T18:59:27.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.756+0000 7f39ff2179c0 10 removing user index: tester.client.0 2024-09-12T18:59:27.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.760+0000 7f39ff2179c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T18:59:27.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.760+0000 7f39ff2179c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:59:27.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.760+0000 7f38d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367798 cookie 93953366260416 notifier 9501 bl.length()=164 2024-09-12T18:59:27.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.764+0000 7f38b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:59:27.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.768+0000 7f39ff2179c0 20 remove_watcher() i=0 2024-09-12T18:59:27.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.768+0000 7f39ff2179c0 2 removed watcher, disabling cache 2024-09-12T18:59:27.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.772+0000 7f39ff2179c0 20 remove_watcher() i=1 2024-09-12T18:59:27.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.772+0000 7f39ff2179c0 20 remove_watcher() i=2 2024-09-12T18:59:27.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.776+0000 7f39ff2179c0 20 remove_watcher() i=3 2024-09-12T18:59:27.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.776+0000 7f39ff2179c0 20 remove_watcher() i=4 2024-09-12T18:59:27.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.780+0000 7f39ff2179c0 20 remove_watcher() i=5 2024-09-12T18:59:27.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.780+0000 7f39ff2179c0 20 remove_watcher() i=6 2024-09-12T18:59:27.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:27.780+0000 7f39ff2179c0 20 remove_watcher() i=7 2024-09-12T18:59:27.803 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T18:59:27.812 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T18:59:27.873 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T18:59:27.916 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T18:59:27.926 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T18:59:27.927 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:59:27.970 INFO:tasks.rgw.client.0.smithi157.stdout:2024-09-12T18:59:27.960+0000 e571640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 37466) UID: 0 2024-09-12T18:59:27.976 INFO:tasks.rgw.client.0.smithi157.stdout:2024-09-12T18:59:27.968+0000 8ed9f80 -1 shutting down 2024-09-12T18:59:56.343 INFO:tasks.rgw.client.0.smithi157.stderr:==00:01:19:24.442 37470== could not unlink /tmp/vgdb-pipe-from-vgdb-to-37470-by-root-on-??? 2024-09-12T18:59:56.344 INFO:tasks.rgw.client.0.smithi157.stderr:==00:01:19:24.442 37470== could not unlink /tmp/vgdb-pipe-to-vgdb-from-37470-by-root-on-??? 2024-09-12T18:59:56.344 INFO:tasks.rgw.client.0.smithi157.stderr:==00:01:19:24.442 37470== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-37470-by-root-on-??? 2024-09-12T18:59:58.432 INFO:tasks.rgw.client.0:Stopped 2024-09-12T18:59:58.433 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T18:59:58.439 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T18:59:58.497 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T18:59:58.556 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T18:59:58.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T18:59:58.557 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T18:59:58.641 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:59:58.641 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:59:58.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.679+0000 7fe4296be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:58.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:58.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 20 realm 2024-09-12T18:59:58.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:58.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:58.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:59:58.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:58.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:58.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:58.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:58.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:58.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:59:58.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.683+0000 7fe4296be9c0 20 searching for the correct realm 2024-09-12T18:59:58.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.691+0000 7fe4279c5640 0 -- 172.21.15.157:0/1674604574 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x56001ec8caf0 msgr2=0x56001ec8efb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:58.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.695+0000 7fe4271c4640 0 -- 172.21.15.157:0/1674604574 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x7fe41c0ff460 msgr2=0x7fe41c0ff8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:58.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 RGWRados::pool_iterate: got zone_info.e807567e-1eb5-4a0c-9e30-862938396cf3 2024-09-12T18:59:58.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:59:58.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:59:58.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 RGWRados::pool_iterate: got zonegroup_info.e66f6a93-3c40-4769-b98c-6fd7b32d3b90 2024-09-12T18:59:58.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:59:58.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:59:58.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:58.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:58.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:58.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:59:58.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:58.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:59:58.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 zone default found 2024-09-12T18:59:58.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 4 Realm: () 2024-09-12T18:59:58.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 4 ZoneGroup: default (e66f6a93-3c40-4769-b98c-6fd7b32d3b90) 2024-09-12T18:59:58.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 4 Zone: default (e807567e-1eb5-4a0c-9e30-862938396cf3) 2024-09-12T18:59:58.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:59:58.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 zonegroup default 2024-09-12T18:59:58.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:58.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:58.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.703+0000 7fe4296be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:58.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.707+0000 7fe4296be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:58.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.707+0000 7fe4296be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:59:58.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.707+0000 7fe4296be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:59:58.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.707+0000 7fe4296be9c0 20 started sync module instance, tier type = 2024-09-12T18:59:58.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.707+0000 7fe4296be9c0 20 started zone id=e807567e-1eb5-4a0c-9e30-862938396cf3 (name=default) with tier type = 2024-09-12T18:59:58.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.719+0000 7fe4296be9c0 20 add_watcher() i=0 2024-09-12T18:59:58.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.719+0000 7fe4296be9c0 20 add_watcher() i=1 2024-09-12T18:59:58.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.719+0000 7fe4296be9c0 20 add_watcher() i=2 2024-09-12T18:59:58.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.719+0000 7fe4296be9c0 20 add_watcher() i=3 2024-09-12T18:59:58.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.719+0000 7fe4296be9c0 20 add_watcher() i=4 2024-09-12T18:59:58.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.719+0000 7fe4296be9c0 20 add_watcher() i=5 2024-09-12T18:59:58.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.719+0000 7fe4296be9c0 20 add_watcher() i=6 2024-09-12T18:59:58.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.723+0000 7fe4296be9c0 20 add_watcher() i=7 2024-09-12T18:59:58.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.723+0000 7fe4296be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:59:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.723+0000 7fe2de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:59:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.723+0000 7fe4296be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:59:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.723+0000 7fe4296be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:59:58.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.795+0000 7fe2dd7e2640 20 reqs_thread_entry: start 2024-09-12T18:59:58.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.795+0000 7fe4296be9c0 20 init_complete bucket index max shards: 1 2024-09-12T18:59:58.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.795+0000 7fe4296be9c0 20 Filter name: none 2024-09-12T18:59:58.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.795+0000 7fe2d67fc640 20 reqs_thread_entry: start 2024-09-12T18:59:58.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:59:58.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:58.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:58.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/61671' 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6873259889581466013', time=2024-09-12T20:22:27.975389+0000, chain.objs.size()=3 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.6YToF5lesKU2aJiWlAQ4J4NSXsvVnI-_0 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.6YToF5lesKU2aJiWlAQ4J4NSXsvVnI-_1 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.6YToF5lesKU2aJiWlAQ4J4NSXsvVnI-_2 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_ddVaQiz4nLtxJJZ4ywzJ0GMcnbSMapZ', time=2024-09-12T20:22:52.914005+0000, chain.objs.size()=1 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.165__shadow_.FIcSkWSsaZMv726JKRg9fZmpJozsCKO_0 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1421909760358891542', time=2024-09-12T20:22:58.359037+0000, chain.objs.size()=1 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.171__shadow_.BQPT6kirjfF1uRaH4Amm66TJ2KH2UaZ_0 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5709492837129263542', time=2024-09-12T20:26:39.937066+0000, chain.objs.size()=1 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.241__shadow_.AwjoGixu_WlC6JM_rOaiu3gjpXPO4Io_0 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9180045953217924641', time=2024-09-12T20:26:59.474541+0000, chain.objs.size()=1 2024-09-12T18:59:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.254__shadow_.RORloiXoS0_5MV8YHROkFKjj5Xt18Ho_0 2024-09-12T18:59:58.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13289208571965841691', time=2024-09-12T20:26:59.476690+0000, chain.objs.size()=1 2024-09-12T18:59:58.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.254__shadow_.rX18kTlWpZthnhOyU1Lis0y6JLFF3vV_0 2024-09-12T18:59:58.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13751267668587234545', time=2024-09-12T20:27:02.286301+0000, chain.objs.size()=1 2024-09-12T18:59:58.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.256__shadow_.HpkTFIGF0-wVpJJ4_hgxmNLBHUO23MV_0 2024-09-12T18:59:58.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16140094288304608810', time=2024-09-12T20:28:48.291395+0000, chain.objs.size()=1 2024-09-12T18:59:58.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HXFivdZJp2IsGtRO9bibRF20soguhFh_0 2024-09-12T18:59:58.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17786191198817904428', time=2024-09-12T20:28:48.853558+0000, chain.objs.size()=1 2024-09-12T18:59:58.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.metNG2zWIQi57x0t33sfB1d9Xp_XwgI_0 2024-09-12T18:59:58.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3701296765516532377', time=2024-09-12T20:28:50.631615+0000, chain.objs.size()=1 2024-09-12T18:59:58.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.-UGDOJWZu9QRYgDe6JuMWmD_-5ymwqL_0 2024-09-12T18:59:58.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10062334864197065213', time=2024-09-12T20:28:50.670359+0000, chain.objs.size()=1 2024-09-12T18:59:58.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8oSgTpW81bxIq-qslQI8il83nmfuY0K_0 2024-09-12T18:59:58.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11588471048620651672', time=2024-09-12T20:28:54.092354+0000, chain.objs.size()=1 2024-09-12T18:59:58.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.w0TwzR6bjFkm_fdtM3UikMLv_9-B-Rx_0 2024-09-12T18:59:58.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2847165882626359277', time=2024-09-12T20:28:54.383781+0000, chain.objs.size()=1 2024-09-12T18:59:58.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Rc7WRQtg2JDsoEU4OIyZvh7rffw19kW_0 2024-09-12T18:59:58.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17013610047895077484', time=2024-09-12T20:28:54.388741+0000, chain.objs.size()=1 2024-09-12T18:59:58.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.e4MIHziAvU9ETQ0jyAgt97Qw2VnAnxF_0 2024-09-12T18:59:58.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11025040447249456956', time=2024-09-12T20:28:56.089135+0000, chain.objs.size()=1 2024-09-12T18:59:58.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FDdUj2L6MqtKp366V0t8domWG_QURb6_0 2024-09-12T18:59:58.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15834614163484536517', time=2024-09-12T20:28:56.251711+0000, chain.objs.size()=1 2024-09-12T18:59:58.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VuW44imamTuuexXMt-aSYMS2wRd4mYA_0 2024-09-12T18:59:58.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4108236249329955568', time=2024-09-12T20:28:56.912255+0000, chain.objs.size()=1 2024-09-12T18:59:58.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.-Aiebp7vf_c6I1vp-9vcDY9PvoobjTU_0 2024-09-12T18:59:58.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3432382961994601593', time=2024-09-12T20:28:57.932244+0000, chain.objs.size()=1 2024-09-12T18:59:58.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OVX3aU6K3Ve78ACQRzwkABl_73dJxKa_0 2024-09-12T18:59:58.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.898972180569383213', time=2024-09-12T20:28:58.951390+0000, chain.objs.size()=1 2024-09-12T18:59:58.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CQ_w2c8jSjmMT2uN77jlGPOnEHtQV9Y_0 2024-09-12T18:59:58.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.391989244941368738', time=2024-09-12T20:29:00.181305+0000, chain.objs.size()=1 2024-09-12T18:59:58.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.dn-SoZNvGJXfVHG4F_aBYkRMz8TIRns_0 2024-09-12T18:59:58.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17776312928663548336', time=2024-09-12T20:29:00.510167+0000, chain.objs.size()=1 2024-09-12T18:59:58.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.sA0vk_schmpzdUTry7QP9e66Z65k1HH_0 2024-09-12T18:59:58.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7997974137335852865', time=2024-09-12T20:29:01.258028+0000, chain.objs.size()=1 2024-09-12T18:59:58.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ABlHhCR_-qLi98r9U2U9Vxc1ItysBkS_0 2024-09-12T18:59:58.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7239073932257247976', time=2024-09-12T20:29:01.684101+0000, chain.objs.size()=1 2024-09-12T18:59:58.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SD0rjLcMp66pl8vWg3UyaYBDtTIccky_0 2024-09-12T18:59:58.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6683394929194168551', time=2024-09-12T20:29:03.006893+0000, chain.objs.size()=1 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Xfeqi-VYYKOB-UupOmibx_KncrbZOVE_0 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15769560091172858017', time=2024-09-12T20:29:04.216066+0000, chain.objs.size()=1 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.B1KZCQ89B-XPvxpem5zfkI4N8pGkCeZ_0 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17693309701817030513', time=2024-09-12T20:29:06.469651+0000, chain.objs.size()=1 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VCbehOwaWIUwv68fcEuOAZk5JA_8-f__0 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15274484905969921755', time=2024-09-12T20:29:06.847909+0000, chain.objs.size()=1 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5lEnCllh0QhrejNzNs-fWzB2sXU13T4_0 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.420884677440920055', time=2024-09-12T20:29:07.459886+0000, chain.objs.size()=1 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.35kALvjAxGQvgS9GqsdLEFfXTOGfAPU_0 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13377073903048288450', time=2024-09-12T20:29:07.461432+0000, chain.objs.size()=1 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bALx5qzH7THtFjsr3GYJdVIE-0pt501_0 2024-09-12T18:59:58.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.108745158010692324', time=2024-09-12T20:29:07.463445+0000, chain.objs.size()=1 2024-09-12T18:59:58.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Wrms2cFL2mwxpX-wxk_a1p1riVqfKt3_0 2024-09-12T18:59:58.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.857870327576717737', time=2024-09-12T20:29:07.671837+0000, chain.objs.size()=1 2024-09-12T18:59:58.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.cEXZSDb8EegNY15JMXnJ-yrMu8peLBo_0 2024-09-12T18:59:58.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3690342713600180523', time=2024-09-12T20:29:08.348599+0000, chain.objs.size()=1 2024-09-12T18:59:58.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Uur4_5MTXnv-2KvX-mSLx2gdReSJqpz_0 2024-09-12T18:59:58.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.815+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16772709829434128132', time=2024-09-12T20:29:10.750996+0000, chain.objs.size()=1 2024-09-12T18:59:58.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.edflMTkjTSKsW2MoL9_drbeiIBq4cSf_0 2024-09-12T18:59:58.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16152525064612549238', time=2024-09-12T20:29:10.838863+0000, chain.objs.size()=1 2024-09-12T18:59:58.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bKeWXGlba5DkwPf2iBvqm7ChNEcXwFQ_0 2024-09-12T18:59:58.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14057174531812374699', time=2024-09-12T20:29:12.453112+0000, chain.objs.size()=1 2024-09-12T18:59:58.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.UiA5ezZgTZVReRlZ_KnXH2_0tGy74dj_0 2024-09-12T18:59:58.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12285229417489561686', time=2024-09-12T20:29:12.476969+0000, chain.objs.size()=1 2024-09-12T18:59:58.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.hHzhNpEEH8rmnp1lwXVCaG01daYpr4g_0 2024-09-12T18:59:58.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8602686331045127798', time=2024-09-12T20:29:14.016573+0000, chain.objs.size()=1 2024-09-12T18:59:58.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.dQEX3B0QRoH5tsLR83nGan92QziXFMn_0 2024-09-12T18:59:58.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10422675518780438631', time=2024-09-12T20:29:14.044009+0000, chain.objs.size()=1 2024-09-12T18:59:58.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.MtfFeyJ47tJdJ6hBaehaCOCu_mRWNL9_0 2024-09-12T18:59:58.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9090837880297135172', time=2024-09-12T20:29:19.327130+0000, chain.objs.size()=1 2024-09-12T18:59:58.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.265__shadow_.g5j7eREM38q75ao4Md85OxAvQnzfZWC_0 2024-09-12T18:59:58.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7877414808379822256', time=2024-09-12T20:29:24.450846+0000, chain.objs.size()=1 2024-09-12T18:59:58.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.269__shadow_.iUthGkI-mKexqP3hfDXCEBOeL2sOMca_0 2024-09-12T18:59:58.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6151739109602571535', time=2024-09-12T20:29:47.710032+0000, chain.objs.size()=1 2024-09-12T18:59:58.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.286__shadow_.uPWKbSRFfFQ24RmDnSVFxR4sc09sXe5_0 2024-09-12T18:59:58.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2175068137640928821', time=2024-09-12T20:29:59.055592+0000, chain.objs.size()=1 2024-09-12T18:59:58.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.4QYSSu-j06qWvZFdBk64TBM88_Xr7z2_0 2024-09-12T18:59:58.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3384940203741480556', time=2024-09-12T20:32:27.227673+0000, chain.objs.size()=1 2024-09-12T18:59:58.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dK1_t6xzElsvxbcptuGrDnSGM6xbvJy_0 2024-09-12T18:59:58.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8287013462546846646', time=2024-09-12T20:32:28.480055+0000, chain.objs.size()=1 2024-09-12T18:59:58.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8NnSS8pWePJNofUEsKPFNOCWuRbW6nA_0 2024-09-12T18:59:58.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13369237373244757462', time=2024-09-12T20:32:28.780554+0000, chain.objs.size()=1 2024-09-12T18:59:58.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7XFsa6c-iCkzOHuxNED1dt313n_B1d-_0 2024-09-12T18:59:58.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17674624306816836064', time=2024-09-12T20:32:29.601790+0000, chain.objs.size()=1 2024-09-12T18:59:58.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.fqmZyXdLq8w4Xr7cXOk3mWJ_X5B5YVs_0 2024-09-12T18:59:58.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9296579180536925556', time=2024-09-12T20:32:30.635093+0000, chain.objs.size()=1 2024-09-12T18:59:58.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kbGnRNJRq7zU7qrLpXOj42nHnHZ_8mq_0 2024-09-12T18:59:58.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.255836161422504990', time=2024-09-12T20:32:31.052239+0000, chain.objs.size()=1 2024-09-12T18:59:58.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7ghlSjOCeuTGl8Z_yfLSuoPMcb6Y1SI_0 2024-09-12T18:59:58.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17548832114114150622', time=2024-09-12T20:32:31.372330+0000, chain.objs.size()=1 2024-09-12T18:59:58.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kKh1IxF7mEKHlwL7uzlLaWMbYl63y7F_0 2024-09-12T18:59:58.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14487408897941116720', time=2024-09-12T20:32:32.685613+0000, chain.objs.size()=1 2024-09-12T18:59:58.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.9mnDjp-AQEscGQTR7prZ4H6aID1l2NT_0 2024-09-12T18:59:58.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8980251541297957932', time=2024-09-12T20:32:33.130940+0000, chain.objs.size()=1 2024-09-12T18:59:58.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eNaoX6_OFLN4TsN-HfhSO4a344GyD_Y_0 2024-09-12T18:59:58.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6255469944250208571', time=2024-09-12T20:32:34.294868+0000, chain.objs.size()=1 2024-09-12T18:59:58.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eCqse1Ej1oEd4REFJ5SbrLNvG_QjB93_0 2024-09-12T18:59:58.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14937735243949346331', time=2024-09-12T20:32:34.640482+0000, chain.objs.size()=1 2024-09-12T18:59:58.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.p7YRhxxPGRHbtmmu5JLXf4h9EDdAPr-_0 2024-09-12T18:59:58.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11916852369530480670', time=2024-09-12T20:32:35.229539+0000, chain.objs.size()=1 2024-09-12T18:59:58.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.2iaf3Y17_YPzYVjdrodKQyalRET7aiJ_0 2024-09-12T18:59:58.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14771827098532031313', time=2024-09-12T20:32:35.582191+0000, chain.objs.size()=1 2024-09-12T18:59:58.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8COWYAVlyVhUkqw3i2yRZpOKMgf-4hl_0 2024-09-12T18:59:58.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11449014435089730010', time=2024-09-12T20:32:35.682125+0000, chain.objs.size()=1 2024-09-12T18:59:58.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0-kRsy3GZ4Tu1CLopR6LSQuXq7ozKv0_0 2024-09-12T18:59:58.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7420697881130658288', time=2024-09-12T20:32:39.724039+0000, chain.objs.size()=1 2024-09-12T18:59:58.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rIhjznrw31dvCr3Gacefsx2PJIorRbq_0 2024-09-12T18:59:58.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17158354574199266181', time=2024-09-12T20:32:40.195318+0000, chain.objs.size()=1 2024-09-12T18:59:58.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7_Uy1QCNpZ_0DqjEl0Rl6qAGqzJCth8_0 2024-09-12T18:59:58.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15717594800045455022', time=2024-09-12T20:32:40.324167+0000, chain.objs.size()=1 2024-09-12T18:59:58.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.JAYADB3UPhoM7IRW1NlbXCwz7_pTsDs_0 2024-09-12T18:59:58.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4508151965688827840', time=2024-09-12T20:32:43.642845+0000, chain.objs.size()=1 2024-09-12T18:59:58.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.NE_GZKwZGV84S8zy9fnD515Qnsdaatm_0 2024-09-12T18:59:58.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5763599955013604159', time=2024-09-12T20:32:43.928123+0000, chain.objs.size()=1 2024-09-12T18:59:58.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sQz-rb2Uc7bfPF5o8gqaLipAdsZ-nxU_0 2024-09-12T18:59:58.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6963729148715844193', time=2024-09-12T20:32:44.793555+0000, chain.objs.size()=1 2024-09-12T18:59:58.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.I454OZDZBFcdyS8RU8nOTt1rjUCLySf_0 2024-09-12T18:59:58.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14889041238114716261', time=2024-09-12T20:32:45.520984+0000, chain.objs.size()=1 2024-09-12T18:59:58.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zMWZj5Qzyd1veqUCOKwffFXV4zaJhd3_0 2024-09-12T18:59:58.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3404749119438740957', time=2024-09-12T20:32:45.522587+0000, chain.objs.size()=1 2024-09-12T18:59:58.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.4dUljHOXgFUoiP8Kf39NbOoE7JR0COs_0 2024-09-12T18:59:58.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2493857089426727329', time=2024-09-12T20:32:45.808731+0000, chain.objs.size()=1 2024-09-12T18:59:58.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.a5bwCChEJTVWuFJGVJLlsqimTiSrjBT_0 2024-09-12T18:59:58.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14331172774587151221', time=2024-09-12T20:32:46.232833+0000, chain.objs.size()=1 2024-09-12T18:59:58.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.lvik5H_XLiyMXk3Jw-tyGO74vA6QmIq_0 2024-09-12T18:59:58.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16532701955393962929', time=2024-09-12T20:32:47.142183+0000, chain.objs.size()=1 2024-09-12T18:59:58.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Km3te0reU2lTfTuPmyi-MlX2eAQ-9So_0 2024-09-12T18:59:58.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15971297387555263269', time=2024-09-12T20:32:47.254501+0000, chain.objs.size()=1 2024-09-12T18:59:58.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.KNUBEIgw1Z8FoaiVIyCLm2Le6eHskXg_0 2024-09-12T18:59:58.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4858829587645781610', time=2024-09-12T20:32:48.297629+0000, chain.objs.size()=1 2024-09-12T18:59:58.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IIRspn6ZRV1NQTgmSqABCUysY7vuREZ_0 2024-09-12T18:59:58.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6924890578663253466', time=2024-09-12T20:32:49.006010+0000, chain.objs.size()=1 2024-09-12T18:59:58.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uQeiolXXXolddn4qb4et023Z59Fzxk0_0 2024-09-12T18:59:58.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15436701203900749234', time=2024-09-12T20:32:50.028610+0000, chain.objs.size()=1 2024-09-12T18:59:58.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._pYK2B9bijIuFWQvE-wflX5kVt9_Ks2_0 2024-09-12T18:59:58.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16686193358418781068', time=2024-09-12T20:32:50.530180+0000, chain.objs.size()=1 2024-09-12T18:59:58.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0CTuP56z7M1LTijGkh9K3ckp9usHatr_0 2024-09-12T18:59:58.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15102734320212332430', time=2024-09-12T20:32:50.940681+0000, chain.objs.size()=1 2024-09-12T18:59:58.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uRyPBeejay_ShdnsLX8dk_P5ciobCZh_0 2024-09-12T18:59:58.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7507649959727910490', time=2024-09-12T20:32:52.039878+0000, chain.objs.size()=1 2024-09-12T18:59:58.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.B1pCA-B54ewgAQGTxvS_tqLZc7Yrb7A_0 2024-09-12T18:59:58.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.22835723095945641', time=2024-09-12T20:32:52.253995+0000, chain.objs.size()=1 2024-09-12T18:59:58.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.FdRCSdPlvoVRwW5HQqBuY7tuXrRd_G4_0 2024-09-12T18:59:58.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7628383899798274076', time=2024-09-12T20:32:52.671897+0000, chain.objs.size()=1 2024-09-12T18:59:58.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.PI4qcV_qdT7JLPfIy7mF41xvd878r--_0 2024-09-12T18:59:58.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3393976621505703435', time=2024-09-12T20:32:53.757805+0000, chain.objs.size()=1 2024-09-12T18:59:58.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Xop3qsno0cFpRhvUEga19tL0xf8TTvI_0 2024-09-12T18:59:58.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11686911936812092682', time=2024-09-12T20:34:34.138805+0000, chain.objs.size()=1 2024-09-12T18:59:58.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kyCnQGsIJc8QOKL2EnAxl0sMvfYEk4D_0 2024-09-12T18:59:58.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15708385347432231668', time=2024-09-12T20:34:34.654153+0000, chain.objs.size()=1 2024-09-12T18:59:58.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LxJeP2E55lULAX9peFbaIK3TvJwLS3S_0 2024-09-12T18:59:58.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17135846246137415814', time=2024-09-12T20:34:35.162340+0000, chain.objs.size()=1 2024-09-12T18:59:58.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4v2jDKlAT1n1Q2MUymElaxS0bg_xmYx_0 2024-09-12T18:59:58.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7581535992728166292', time=2024-09-12T20:34:38.458288+0000, chain.objs.size()=1 2024-09-12T18:59:58.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BS0jKV_g_mFzT3xsjduW4WiPcDoxGEp_0 2024-09-12T18:59:58.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17147521097990865724', time=2024-09-12T20:34:38.813585+0000, chain.objs.size()=1 2024-09-12T18:59:58.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9opMt01kcwf2Mz0e0V2UMtgSUBGAnGk_0 2024-09-12T18:59:58.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2793856043612766211', time=2024-09-12T20:34:38.814882+0000, chain.objs.size()=1 2024-09-12T18:59:58.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.oCW4UmCcDsF9pIW79z4rJCTQcblZSpw_0 2024-09-12T18:59:58.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2290183731190805909', time=2024-09-12T20:34:39.649399+0000, chain.objs.size()=1 2024-09-12T18:59:58.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.An05VPczqUD1Xf4mrcfShzasPjOQtzM_0 2024-09-12T18:59:58.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15919859610586669259', time=2024-09-12T20:34:39.760446+0000, chain.objs.size()=1 2024-09-12T18:59:58.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9LHzGgr-LSIr204WVgoLP00bW13zhhw_0 2024-09-12T18:59:58.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2717713017701262497', time=2024-09-12T20:34:40.517185+0000, chain.objs.size()=1 2024-09-12T18:59:58.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.jEXoNAcsRMmeMWlu9e2ElecIa266Kiz_0 2024-09-12T18:59:58.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15987913833373893104', time=2024-09-12T20:34:40.603376+0000, chain.objs.size()=1 2024-09-12T18:59:58.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.E73svBgLvDFizCSlnmC7lkbTqEfWlAq_0 2024-09-12T18:59:58.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17605183812357087199', time=2024-09-12T20:34:40.604919+0000, chain.objs.size()=1 2024-09-12T18:59:58.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.sIXaMwbunp6usK5X11ZDQODwMR-u_pr_0 2024-09-12T18:59:58.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7803374531159512923', time=2024-09-12T20:34:41.550537+0000, chain.objs.size()=1 2024-09-12T18:59:58.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.jcg0hfnPEIOHyM034FDcwr0SPNIqg2N_0 2024-09-12T18:59:58.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9037311760070402311', time=2024-09-12T20:34:42.786231+0000, chain.objs.size()=1 2024-09-12T18:59:58.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.GQ0UqtouOBAp8htWBaxn9LjDWzZhozL_0 2024-09-12T18:59:58.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16115070419014471596', time=2024-09-12T20:34:45.443395+0000, chain.objs.size()=1 2024-09-12T18:59:58.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.cLjxZvJxf-zX4-dCVWPekiQhkPzhc_z_0 2024-09-12T18:59:58.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13616037986640706232', time=2024-09-12T20:34:46.528924+0000, chain.objs.size()=1 2024-09-12T18:59:58.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vQJ0Qu9Oeus78eEDiPvXxGvmnwvAjqq_0 2024-09-12T18:59:58.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6259540346674083203', time=2024-09-12T20:34:47.848934+0000, chain.objs.size()=1 2024-09-12T18:59:58.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6abWqtH9X8-wXs9_g6DPoLjXHORZAF9_0 2024-09-12T18:59:58.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13648767521351786326', time=2024-09-12T20:34:47.860573+0000, chain.objs.size()=1 2024-09-12T18:59:58.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6cvVAoFqaf5IKXWqe790DiR8CM4EBVP_0 2024-09-12T18:59:58.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1783762334718777751', time=2024-09-12T20:34:50.022082+0000, chain.objs.size()=1 2024-09-12T18:59:58.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3Yywt3IBwRtTrOEY8aQh23ZeLe6NlHd_0 2024-09-12T18:59:58.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11258984559552628060', time=2024-09-12T20:34:50.512325+0000, chain.objs.size()=1 2024-09-12T18:59:58.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.VErmPGdzHN272-rjisoLFkZhBU3JSXI_0 2024-09-12T18:59:58.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6611364912115526989', time=2024-09-12T20:34:51.214168+0000, chain.objs.size()=1 2024-09-12T18:59:58.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Bd4aypMrzJ0BqYUcNj4cQ5AV1X83Dkh_0 2024-09-12T18:59:58.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14328601675374628005', time=2024-09-12T20:34:53.110764+0000, chain.objs.size()=1 2024-09-12T18:59:58.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nQDl5R56-0eEPE3ap1CvAmL2YSA3UEp_0 2024-09-12T18:59:58.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6447848693505423232', time=2024-09-12T20:34:54.185599+0000, chain.objs.size()=1 2024-09-12T18:59:58.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.FmqToDMLDL6UV-iLWchwAToEn9jMZSj_0 2024-09-12T18:59:58.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15287737479161281635', time=2024-09-12T20:34:54.516471+0000, chain.objs.size()=1 2024-09-12T18:59:58.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YGj4nU2xG3syxxh3MbPPNGB9ykLTGe__0 2024-09-12T18:59:58.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.847+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/61671 2024-09-12T18:59:58.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T18:59:58.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8844226831061190424', time=2024-09-12T20:34:54.573696+0000, chain.objs.size()=1 2024-09-12T18:59:58.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LjUSUyIuYQEMKG3zQ1Z2FYGXUd6h5qz_0 2024-09-12T18:59:58.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16586875121802219208', time=2024-09-12T20:34:54.943869+0000, chain.objs.size()=1 2024-09-12T18:59:58.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.V3cUOIcKIKhf75FFhviHq_zTzxZ7LYy_0 2024-09-12T18:59:58.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11388915574043620714', time=2024-09-12T20:34:56.303786+0000, chain.objs.size()=1 2024-09-12T18:59:58.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.v_VvZZ5DV_ye0z4qdSXyjPg046sSuDY_0 2024-09-12T18:59:58.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6986430227828370834', time=2024-09-12T20:34:57.569593+0000, chain.objs.size()=1 2024-09-12T18:59:58.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wKFOM0qikq5tlyHyRoJ920XEmS2JeqD_0 2024-09-12T18:59:58.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14726062221037964972', time=2024-09-12T20:34:58.339026+0000, chain.objs.size()=1 2024-09-12T18:59:58.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MuQajjV70vWT79kCeyYDg4iz_i5EaEO_0 2024-09-12T18:59:58.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5871568679940446203', time=2024-09-12T20:34:58.458421+0000, chain.objs.size()=1 2024-09-12T18:59:58.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Y4agmvL29zRfhzWXjyhhpKhyM1i4sf7_0 2024-09-12T18:59:58.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1452557162383109249', time=2024-09-12T20:34:59.432024+0000, chain.objs.size()=1 2024-09-12T18:59:58.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.0miR0EP62Z2_T7hkNxKteM4FMN65mkq_0 2024-09-12T18:59:58.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3758357950664180606', time=2024-09-12T20:34:59.616651+0000, chain.objs.size()=1 2024-09-12T18:59:58.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.E1d2559mXgLgk0BnlhbzaTf52BZOeDU_0 2024-09-12T18:59:58.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10047369247074266827', time=2024-09-12T20:34:59.798025+0000, chain.objs.size()=1 2024-09-12T18:59:58.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.A5mtJnMG8tWlOHFIA90ILn9H2O7oX51_0 2024-09-12T18:59:58.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15388527296905847134', time=2024-09-12T20:34:59.845862+0000, chain.objs.size()=1 2024-09-12T18:59:58.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.B85EQusSpSBxHsFMVdo11GmOOSCIvWe_0 2024-09-12T18:59:58.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13192404847924849691', time=2024-09-12T20:35:05.614585+0000, chain.objs.size()=1 2024-09-12T18:59:58.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.328__shadow_.6c9I53M8OeB_k1cdAWjuFBY1dIf7IvH_0 2024-09-12T18:59:58.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9957548569584219154', time=2024-09-12T20:35:09.896981+0000, chain.objs.size()=1 2024-09-12T18:59:58.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.332__shadow_.h8odRwGXZGW-dtb9KM2qCM-9-VPNZ5W_0 2024-09-12T18:59:58.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8743898410231470140', time=2024-09-12T20:36:55.492088+0000, chain.objs.size()=1 2024-09-12T18:59:58.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.434__shadow_.kPXTm6T9OlCJyOwwdo5-M6y6uTWqNvK_0 2024-09-12T18:59:58.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10245961232687989393', time=2024-09-12T20:37:25.060273+0000, chain.objs.size()=1 2024-09-12T18:59:58.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.457__shadow_.iLdgvGU2KM3KfHKa9Bzzs43utxojJBt_0 2024-09-12T18:59:58.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18164560278620355564', time=2024-09-12T20:38:10.714306+0000, chain.objs.size()=1 2024-09-12T18:59:58.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.491__shadow_.H7zCbhg12MyX-5bPu0z5fv6yYhgulg0_0 2024-09-12T18:59:58.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10631167608185639746', time=2024-09-12T20:38:41.652837+0000, chain.objs.size()=1 2024-09-12T18:59:58.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.511__multipart_mymultipart.2~d-a74eZzRuX4YOpaAhkOe3Ybw2gad95.1 2024-09-12T18:59:58.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4043482146324070273', time=2024-09-12T20:41:31.444412+0000, chain.objs.size()=2 2024-09-12T18:59:58.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~6ok-VMDDkFnWa4SPL65ZzUjk2MR1BDn.1 2024-09-12T18:59:58.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~6ok-VMDDkFnWa4SPL65ZzUjk2MR1BDn.2 2024-09-12T18:59:58.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1967226620613011756', time=2024-09-12T20:43:41.997501+0000, chain.objs.size()=1 2024-09-12T18:59:58.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:rWpayLfiVy1Jcb6h3tlLHIPNuTVUOO6_.YKcikmanxdcXkrnev_stGt65XQDCcb3_0 2024-09-12T18:59:58.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3556018529514710984', time=2024-09-12T20:44:49.132473+0000, chain.objs.size()=1 2024-09-12T18:59:58.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:nvokgViPSgVLZ7qQltifvpDUFI6n4zB_.MChR__EroRme_OLamH_ysLmoQRaKNvZ_0 2024-09-12T18:59:58.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13942898769854721357', time=2024-09-12T20:44:57.947243+0000, chain.objs.size()=1 2024-09-12T18:59:58.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:5EMf8tTH.ddfWT1-nG-0rPN1xurLxKx_.IZ7VBMpIFAaj928wA3icqWY8Cpwm9PI_0 2024-09-12T18:59:58.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12463668586683480431', time=2024-09-12T20:45:01.802771+0000, chain.objs.size()=1 2024-09-12T18:59:58.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:xVY8bXR0phKrg6ZMZ41GSxyk3jJPNFJ_.UEkdOSLp5abAzZcizr82R1GIoJogKA2_0 2024-09-12T18:59:58.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1252929091553264626', time=2024-09-12T20:45:34.449767+0000, chain.objs.size()=1 2024-09-12T18:59:58.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.579__shadow:EIvEcZi.4wkbViuQOuLGPhvBijxLV-H_.mywmLUpkbFFJ6jk6x3ziGXCNuqMbUB3_0 2024-09-12T18:59:58.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6216435084066195026', time=2024-09-12T20:48:46.851235+0000, chain.objs.size()=1 2024-09-12T18:59:58.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.617__shadow_.MvXD8oKLKeyHtYfiaTpeTfiTS5OrdX1_0 2024-09-12T18:59:58.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6141127446568460995', time=2024-09-12T20:50:52.814065+0000, chain.objs.size()=1 2024-09-12T18:59:58.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.637__shadow_.rBLHUu3azrf7eUdF_48oBni2g33proq_0 2024-09-12T18:59:58.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:58.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:59:58.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:58.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:58.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51960' 2024-09-12T18:59:58.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_b1QkFT68zAH62lrJejpuRyeFWwrIUzd', time=2024-09-12T20:22:40.503901+0000, chain.objs.size()=3 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.MYf2wh9ii8U5Ck2QcQi9wKUKuGDehwY_0 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.MYf2wh9ii8U5Ck2QcQi9wKUKuGDehwY_1 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.MYf2wh9ii8U5Ck2QcQi9wKUKuGDehwY_2 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LGbeLK1c3OSwraDwP13zHzDy7x_zS2n', time=2024-09-12T20:23:48.017944+0000, chain.objs.size()=1 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.201__multipart_mymultipart.2~LGbeLK1c3OSwraDwP13zHzDy7x_zS2n.1 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12240594574061435246', time=2024-09-12T20:26:28.160143+0000, chain.objs.size()=1 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.233__shadow_.rkM5aV__zChFNOtv5ESCgEo2s-JsHNW_0 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14692802554365023686', time=2024-09-12T20:26:29.564385+0000, chain.objs.size()=1 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.234__shadow_.vOFaANNxXybU9ppo0E3WDAp-S4ptdi-_0 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4122474624014313704', time=2024-09-12T20:26:29.574695+0000, chain.objs.size()=1 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.234__shadow_.lDuHpq4jVnJYiEZH4ICPZU0vHJl_-uU_0 2024-09-12T18:59:58.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16065006761013322273', time=2024-09-12T20:26:29.603591+0000, chain.objs.size()=1 2024-09-12T18:59:58.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.234__shadow_.MwmKn7PytEy1STe_VQqv3uz0GEAwCt-_0 2024-09-12T18:59:58.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16872991393951447603', time=2024-09-12T20:26:30.954504+0000, chain.objs.size()=1 2024-09-12T18:59:58.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.235__shadow_.NkBdsll_7fEo85xG5O2HebYiEQNfReF_0 2024-09-12T18:59:58.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6786478258095168421', time=2024-09-12T20:26:41.328696+0000, chain.objs.size()=1 2024-09-12T18:59:58.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.242__shadow_.FEzgcuamtKnO7ac8uqxg1bH8vAci2mG_0 2024-09-12T18:59:58.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4904982226411677055', time=2024-09-12T20:28:47.859751+0000, chain.objs.size()=1 2024-09-12T18:59:58.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ZA32n5ZWnT0F7mvWbIrDuY5f1aWQnZw_0 2024-09-12T18:59:58.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8103806861674486276', time=2024-09-12T20:28:47.861914+0000, chain.objs.size()=1 2024-09-12T18:59:58.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.BqGz3B0W2eWi_yIYePjfpE4sqTVgZSt_0 2024-09-12T18:59:58.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17951545579030872989', time=2024-09-12T20:28:47.965846+0000, chain.objs.size()=1 2024-09-12T18:59:58.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.D1-LhA8iy-mVj8WWEkh5c30Hoa0gIwd_0 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9763595964491909923', time=2024-09-12T20:28:48.685756+0000, chain.objs.size()=1 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.TiU78kybEt8WN3JI_sbSQJqTNz8GFER_0 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10527337365742033340', time=2024-09-12T20:28:49.003011+0000, chain.objs.size()=1 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fAthhHToQ6aFgf427LE8jM5_iO1HZKM_0 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13868472737128006022', time=2024-09-12T20:28:49.591385+0000, chain.objs.size()=1 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.D9AM7NTHKTz__lwvVq2Tg3wc1CMuNfS_0 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17104908787669479144', time=2024-09-12T20:28:49.593241+0000, chain.objs.size()=1 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1XrjCFCwK6IZF0XaUSjfwlTAiNCt__w_0 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10448119404799209009', time=2024-09-12T20:28:52.001432+0000, chain.objs.size()=1 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wa2hxOp5m2a74dnbUssCFEI-HzSZIKB_0 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2580342312162965984', time=2024-09-12T20:28:52.241045+0000, chain.objs.size()=1 2024-09-12T18:59:58.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ibvKXiA_LI3iyQwsY81DuM1IOmcI0_m_0 2024-09-12T18:59:58.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12147596248740900419', time=2024-09-12T20:28:52.485261+0000, chain.objs.size()=1 2024-09-12T18:59:58.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vWvMhmamQuU0Qi_bUcQfaVoMdLa5z1o_0 2024-09-12T18:59:58.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2851055179894514254', time=2024-09-12T20:28:52.923862+0000, chain.objs.size()=1 2024-09-12T18:59:58.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Awwiat4kIiRVsePoecJ0Y6h-QOAUXpd_0 2024-09-12T18:59:58.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13444425693469805554', time=2024-09-12T20:28:53.673108+0000, chain.objs.size()=1 2024-09-12T18:59:58.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Jyw-xzIyGnGPEwA-_RpPVGEja3J_6Qx_0 2024-09-12T18:59:58.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16196074292874122435', time=2024-09-12T20:28:54.143339+0000, chain.objs.size()=1 2024-09-12T18:59:58.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Gf2mEsLLT0INw83UvpZtNMi0LWR_J2q_0 2024-09-12T18:59:58.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8119416574313202464', time=2024-09-12T20:28:56.549343+0000, chain.objs.size()=1 2024-09-12T18:59:58.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.57rWKGpOc_AK4wbPd5zUi9ujmbAk2UT_0 2024-09-12T18:59:58.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17400643398665716158', time=2024-09-12T20:28:57.623198+0000, chain.objs.size()=1 2024-09-12T18:59:58.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.n1FhiEaUCuPIRvtAqFU9-BmeFeKxAq0_0 2024-09-12T18:59:58.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13426309691034754043', time=2024-09-12T20:28:57.822323+0000, chain.objs.size()=1 2024-09-12T18:59:58.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.xQz2sBUhVp0FqJON523hkLhQrmYRg7j_0 2024-09-12T18:59:58.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11885483918459095553', time=2024-09-12T20:28:59.937924+0000, chain.objs.size()=1 2024-09-12T18:59:58.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.KhAThiZtKdAyfH8Jhj804jnBmVkamuX_0 2024-09-12T18:59:58.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6918051133320100796', time=2024-09-12T20:29:00.823433+0000, chain.objs.size()=1 2024-09-12T18:59:58.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.mfpZqO1WNSLSan2nSX8Opb6bX7a00Vu_0 2024-09-12T18:59:58.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17400772914418053394', time=2024-09-12T20:29:02.588310+0000, chain.objs.size()=1 2024-09-12T18:59:58.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.O6QCpgxLtZAoQwrqPgqGRl8UvE0lNbH_0 2024-09-12T18:59:58.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11901167466458403593', time=2024-09-12T20:29:02.710422+0000, chain.objs.size()=1 2024-09-12T18:59:58.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.LKitQs_Jx_53uVzAAQdzV6cTA_fjl1c_0 2024-09-12T18:59:58.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2054552574744147158', time=2024-09-12T20:29:04.901979+0000, chain.objs.size()=1 2024-09-12T18:59:58.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.msSC5GGZI61qvuhCs0tsUylav7Sc99d_0 2024-09-12T18:59:58.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11960481313008869227', time=2024-09-12T20:29:04.903571+0000, chain.objs.size()=1 2024-09-12T18:59:58.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.yVKUZv5O_MH1DiarBWVDPNGEe9jhqBc_0 2024-09-12T18:59:58.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.877870415911821457', time=2024-09-12T20:29:05.015382+0000, chain.objs.size()=1 2024-09-12T18:59:58.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.pQceQsF8IoiOIcY8ZMyLnLvomMv0O2M_0 2024-09-12T18:59:58.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11211853807345339293', time=2024-09-12T20:29:05.159599+0000, chain.objs.size()=1 2024-09-12T18:59:58.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.xcyqg3fPNz6DitmNP4ig9KaXZM5qQWU_0 2024-09-12T18:59:58.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10890188100460041626', time=2024-09-12T20:29:07.719218+0000, chain.objs.size()=1 2024-09-12T18:59:58.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CVhg_V4A6GTHyAezUYjKYYzq1Qt0Qwp_0 2024-09-12T18:59:58.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11574135907565881356', time=2024-09-12T20:29:08.698391+0000, chain.objs.size()=1 2024-09-12T18:59:58.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.BZP6_1cOFVRcwA1kPPXu_JaEcnWuJvE_0 2024-09-12T18:59:58.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6535606494945187375', time=2024-09-12T20:29:10.554282+0000, chain.objs.size()=1 2024-09-12T18:59:58.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bEGqiUI8pKkmZDbjRv88jAnYROPTqar_0 2024-09-12T18:59:58.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14061918435475853256', time=2024-09-12T20:29:12.497079+0000, chain.objs.size()=1 2024-09-12T18:59:58.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.v-5eRZyQSZfGIh0IsMuDJ2z6ijqiux-_0 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5857312201827269277', time=2024-09-12T20:29:15.497439+0000, chain.objs.size()=1 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WRCaohPEa1Ji7rbwuX0G9ZIINfo7-HM_0 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2486843660039373958', time=2024-09-12T20:29:49.126834+0000, chain.objs.size()=1 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.287__shadow_.4VkllrSdzZ3s1uTBdJao3O5gzAWEydB_0 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17912579537646376282', time=2024-09-12T20:29:59.210497+0000, chain.objs.size()=1 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.rO9nwtm4jvwy7qdyX4GMbmJyMo4EIm2_0 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12643971977398244329', time=2024-09-12T20:30:03.576200+0000, chain.objs.size()=1 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.AGKFsgfpgBtKpvEgIYupMiO2nu3Y2wc_0 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6647320636757333849', time=2024-09-12T20:30:05.319431+0000, chain.objs.size()=1 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.294__shadow_.aXVIA_npnTAmcGkWKmINzfHF0CaZw8j_0 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15261036263839702522', time=2024-09-12T20:30:13.921230+0000, chain.objs.size()=1 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.300__shadow_.W9m4ue06B5vAsf53xIuwl-ArqWAEdRO_0 2024-09-12T18:59:58.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6417461439686098751', time=2024-09-12T20:30:19.431697+0000, chain.objs.size()=1 2024-09-12T18:59:58.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.304__shadow_.p6rL87zB1MheAOc4aptBPKRb4Er56g0_0 2024-09-12T18:59:58.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6702223785814625212', time=2024-09-12T20:30:20.851662+0000, chain.objs.size()=1 2024-09-12T18:59:58.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.305__shadow_.DGMtf_ZHeQQJDI_v2bYIvURDWQjVK42_0 2024-09-12T18:59:58.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14017429100235920737', time=2024-09-12T20:30:30.699111+0000, chain.objs.size()=1 2024-09-12T18:59:58.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.313__shadow_.gvwJvnnsdPA5YoiwvbNPK3g8YI-82PU_0 2024-09-12T18:59:58.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9827023562910394447', time=2024-09-12T20:32:28.488094+0000, chain.objs.size()=1 2024-09-12T18:59:58.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wvtvSDPXO6h7GV_PfOI55tqswpmRhMN_0 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15530807340952536318', time=2024-09-12T20:32:32.545048+0000, chain.objs.size()=1 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.F_hwuzfoNGgYpFjVCfmk2Lc-9jfHSL-_0 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16273724868398717085', time=2024-09-12T20:32:33.064370+0000, chain.objs.size()=1 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0V1sFsqAbthpHB1QvwgdvZU58_c4gxd_0 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5153882837550756719', time=2024-09-12T20:32:33.130378+0000, chain.objs.size()=1 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.QDROxwH_AFT6aRYWPU8U-Blul9uCKES_0 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1923170891484562179', time=2024-09-12T20:32:35.850263+0000, chain.objs.size()=1 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.-0GsAu8GRcGFxg_HLUve2MKMOBDTQRz_0 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9410500828259864204', time=2024-09-12T20:32:42.186580+0000, chain.objs.size()=1 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kYfMTVfwlIixWu5c4ZgrxizPOQVNVJe_0 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12638224864603078692', time=2024-09-12T20:32:43.319425+0000, chain.objs.size()=1 2024-09-12T18:59:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jP_eIi5nrfcF_3ZLZsyKpRjn6-jL-Qz_0 2024-09-12T18:59:58.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9092144481850337539', time=2024-09-12T20:32:44.720106+0000, chain.objs.size()=1 2024-09-12T18:59:58.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.TiKS2-QSZAH-91Yg-fqfN0eA7wYrDW3_0 2024-09-12T18:59:58.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2116745276649571791', time=2024-09-12T20:32:45.079271+0000, chain.objs.size()=1 2024-09-12T18:59:58.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.y9fkSras6HEEFKpmpySv79n5iMzzR_H_0 2024-09-12T18:59:58.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17718748882662291562', time=2024-09-12T20:32:45.160149+0000, chain.objs.size()=1 2024-09-12T18:59:58.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7KTFAbrjQARSMZhKOiW916Hz1PXk0Vv_0 2024-09-12T18:59:58.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8777820926541768471', time=2024-09-12T20:32:45.398486+0000, chain.objs.size()=1 2024-09-12T18:59:58.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.UCrLOP6_2BDWz3Ingd_WkAwETlu758S_0 2024-09-12T18:59:58.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15553438572612812328', time=2024-09-12T20:32:45.522879+0000, chain.objs.size()=1 2024-09-12T18:59:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tzrl6ZhasCWJ3xspOHUTo4GsmNaxLbC_0 2024-09-12T18:59:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14029715491498404163', time=2024-09-12T20:32:46.868793+0000, chain.objs.size()=1 2024-09-12T18:59:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.NJloJdu5fit-w2e9WUv3_zkh7kOkjiV_0 2024-09-12T18:59:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17382920728118652027', time=2024-09-12T20:32:47.207943+0000, chain.objs.size()=1 2024-09-12T18:59:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wyjeLiIDgsa8gH3WHFPDrsVtbCG0aj1_0 2024-09-12T18:59:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3362703487241941529', time=2024-09-12T20:32:48.609095+0000, chain.objs.size()=1 2024-09-12T18:59:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.FQ-4GpZnB63Yp_4YJ_x9Vnxphtbuxke_0 2024-09-12T18:59:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15746013450936915832', time=2024-09-12T20:32:50.153895+0000, chain.objs.size()=1 2024-09-12T18:59:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6OefwWa_gN1sJb3-tkidA_jNSmJ8loD_0 2024-09-12T18:59:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16079654165813996025', time=2024-09-12T20:32:50.372129+0000, chain.objs.size()=1 2024-09-12T18:59:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.JRHVWrNng1eqGLttUeqz5hSgzPcK7ea_0 2024-09-12T18:59:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11858932096154063450', time=2024-09-12T20:32:51.643525+0000, chain.objs.size()=1 2024-09-12T18:59:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.cAFEgjv8Kajys1JDHQdZ3nq-SNAvT59_0 2024-09-12T18:59:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1510860517627868486', time=2024-09-12T20:32:51.645753+0000, chain.objs.size()=1 2024-09-12T18:59:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IKGw0gCiFjKD8ybKScKgVk1uWwrZDev_0 2024-09-12T18:59:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16401866531824641172', time=2024-09-12T20:32:52.708241+0000, chain.objs.size()=1 2024-09-12T18:59:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6ek5SRSezRa0FYQVZFl5AMrQ055KUQ-_0 2024-09-12T18:59:58.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15073966421322200230', time=2024-09-12T20:32:53.351315+0000, chain.objs.size()=1 2024-09-12T18:59:58.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.DDHycSbREOlsToBS1Sqtyh1Wr55sFFA_0 2024-09-12T18:59:58.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9449545953496059895', time=2024-09-12T20:32:53.353370+0000, chain.objs.size()=1 2024-09-12T18:59:58.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.EcvFRJkFpBnFB7GbrAgMdKAS54qH2yi_0 2024-09-12T18:59:58.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14329326465367567735', time=2024-09-12T20:32:53.439528+0000, chain.objs.size()=1 2024-09-12T18:59:58.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Nx6MTWoLI4Aj-RoEadGHj6zziJHanuK_0 2024-09-12T18:59:58.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16458912899219163701', time=2024-09-12T20:34:34.702456+0000, chain.objs.size()=1 2024-09-12T18:59:58.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hHB-dTzCWZTKBiYB_1LLtNdb56-3iOQ_0 2024-09-12T18:59:58.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13847241723008180008', time=2024-09-12T20:34:38.087074+0000, chain.objs.size()=1 2024-09-12T18:59:58.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MnesIcuvRYAV7Ya5bZMKsuGOWekTf_S_0 2024-09-12T18:59:58.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4369760145160083939', time=2024-09-12T20:34:39.930409+0000, chain.objs.size()=1 2024-09-12T18:59:58.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3qf0lOXu6v5I0VscvZKK3mwH4AtE4_A_0 2024-09-12T18:59:58.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1353119114568774066', time=2024-09-12T20:34:41.448944+0000, chain.objs.size()=1 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Nw9KNEKwzfTgkKrPfo0LAk3s-YQrGm5_0 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10884100168605465818', time=2024-09-12T20:34:41.830609+0000, chain.objs.size()=1 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.OVbWA3ZdY6x2T8IBEp0wEJPv-CRsd-R_0 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5281955383674584195', time=2024-09-12T20:34:44.147108+0000, chain.objs.size()=1 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.0aC1YXXtuQY1qfODJfuVHDGSofWTWr5_0 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1456129860101962989', time=2024-09-12T20:34:44.149549+0000, chain.objs.size()=1 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kyigC0RoXsCiaUP7DVEMyqGZUIos9lm_0 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15307006461704613352', time=2024-09-12T20:34:44.233915+0000, chain.objs.size()=1 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.eWgws1-oIKT4kylqhEno6kkTQy7Ifxm_0 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.730681134289260893', time=2024-09-12T20:34:45.323486+0000, chain.objs.size()=1 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5Mo9HOI4_3Pp3_pY1XQF97IHcyzLW5x_0 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15849647482706632987', time=2024-09-12T20:34:45.445612+0000, chain.objs.size()=1 2024-09-12T18:59:58.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ljHnJDUlrHxhbU93UasIOulfnvCSdk8_0 2024-09-12T18:59:58.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3539943075567733162', time=2024-09-12T20:34:46.145377+0000, chain.objs.size()=1 2024-09-12T18:59:58.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.IxM8r-Spd5aHl-lHOjQ4mCVJfYHYrzu_0 2024-09-12T18:59:58.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14129517164826977183', time=2024-09-12T20:34:47.498968+0000, chain.objs.size()=1 2024-09-12T18:59:58.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.av9hvgAGtJyK-VVLzEq9Z_jHIp5I-sq_0 2024-09-12T18:59:58.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4563820187552556307', time=2024-09-12T20:34:48.728684+0000, chain.objs.size()=1 2024-09-12T18:59:58.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ECsumuomdUv-Uh9SuOFj6ws33YNcP-0_0 2024-09-12T18:59:58.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10947741610824075982', time=2024-09-12T20:34:49.201296+0000, chain.objs.size()=1 2024-09-12T18:59:58.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.yKrMXI50fRqYnBhwO2a5Yd5ktGealjx_0 2024-09-12T18:59:58.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1005580481139169351', time=2024-09-12T20:34:50.850298+0000, chain.objs.size()=1 2024-09-12T18:59:58.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.EOX_J4a1eArUZB1viArhxFqVvsEVCoe_0 2024-09-12T18:59:58.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16226011982506097731', time=2024-09-12T20:34:54.525501+0000, chain.objs.size()=1 2024-09-12T18:59:58.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.SUoRdt1m49_daZt2y1WfJcWkCrfjTDQ_0 2024-09-12T18:59:58.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17913332305275217696', time=2024-09-12T20:34:55.766643+0000, chain.objs.size()=1 2024-09-12T18:59:58.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1j8Y7QlV4E9CHgEDHowKxVxrSGS3q4-_0 2024-09-12T18:59:58.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.146827679053766259', time=2024-09-12T20:34:55.768900+0000, chain.objs.size()=1 2024-09-12T18:59:58.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bbIh-dOChmNNWChszf21rpCc7ShsViT_0 2024-09-12T18:59:58.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15305489282699474358', time=2024-09-12T20:34:56.568445+0000, chain.objs.size()=1 2024-09-12T18:59:58.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vfILKiZD0qC--0FCmhNdL1zToMaE0nI_0 2024-09-12T18:59:58.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11457105447991959210', time=2024-09-12T20:34:56.951996+0000, chain.objs.size()=1 2024-09-12T18:59:58.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vhA7JriZhbk_j7JcLCAU0Cl5iEqnTSm_0 2024-09-12T18:59:58.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9510116188744135850', time=2024-09-12T20:34:58.521846+0000, chain.objs.size()=1 2024-09-12T18:59:58.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.iPZfn_LjrMX9UMnH4Xhc71iMWtLoiNr_0 2024-09-12T18:59:58.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10418572620379709203', time=2024-09-12T20:34:59.429689+0000, chain.objs.size()=1 2024-09-12T18:59:58.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XILg3rbWVrrS1y4Et4DXDrIGHQmWAWw_0 2024-09-12T18:59:58.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1607379921198851486', time=2024-09-12T20:34:59.936905+0000, chain.objs.size()=1 2024-09-12T18:59:58.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BBANKDi0EG0-MrWtCACVZ_9O0vhAtGs_0 2024-09-12T18:59:58.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8927892080757407693', time=2024-09-12T20:35:00.167263+0000, chain.objs.size()=1 2024-09-12T18:59:58.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YHBF5qSClLilgMWRoAhYX_HZxTFuo-t_0 2024-09-12T18:59:58.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9093000428285943791', time=2024-09-12T20:35:00.169163+0000, chain.objs.size()=1 2024-09-12T18:59:58.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.dxbl98zyyjeEFZBDYwpEqmq_j25Qosj_0 2024-09-12T18:59:58.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16499216852713467515', time=2024-09-12T20:35:00.608996+0000, chain.objs.size()=1 2024-09-12T18:59:58.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.jiZxm2FEFz0HVip-OjpItPTbIfrHVjk_0 2024-09-12T18:59:58.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11295228663440283284', time=2024-09-12T20:35:09.036440+0000, chain.objs.size()=1 2024-09-12T18:59:58.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.331__shadow_.lS0QYt_lkHOh7doboRGATGsLtB9NWY__0 2024-09-12T18:59:58.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16475494617807968073', time=2024-09-12T20:35:22.811135+0000, chain.objs.size()=1 2024-09-12T18:59:58.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.344__shadow_.dQlY1TyAQcFl1Tk4ckA9l3auxTF3cbd_0 2024-09-12T18:59:58.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11177549598599508842', time=2024-09-12T20:35:55.541679+0000, chain.objs.size()=1 2024-09-12T18:59:58.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.378__shadow_.AT5BBYfh4ocH8mSY2MDGfKCj5OJ9gOC_0 2024-09-12T18:59:58.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8878646070668785820', time=2024-09-12T20:37:08.288527+0000, chain.objs.size()=1 2024-09-12T18:59:58.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.444__shadow_.0ebX9alL5gWsR3TdQZVh1COc2Q5TZaF_0 2024-09-12T18:59:58.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6977484808248360183', time=2024-09-12T20:37:35.706969+0000, chain.objs.size()=1 2024-09-12T18:59:58.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.463__shadow_.Ujmz2AR5sCsLgTCygWr21x_2GMzWxUb_0 2024-09-12T18:59:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6883696194171069126', time=2024-09-12T20:38:07.001908+0000, chain.objs.size()=1 2024-09-12T18:59:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.488__shadow_.cXBiGa1PeDzFg1BUxSMr240Bru9A7qA_0 2024-09-12T18:59:58.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51960 2024-09-12T18:59:58.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:59:58.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~SIgrFJm8IsxFe8F0EgosodMpSzxeRH3', time=2024-09-12T20:41:45.845597+0000, chain.objs.size()=4 2024-09-12T18:59:58.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.529__multipart_mymultipart.2~SIgrFJm8IsxFe8F0EgosodMpSzxeRH3.1 2024-09-12T18:59:58.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.529__shadow_mymultipart.2~SIgrFJm8IsxFe8F0EgosodMpSzxeRH3.1_1 2024-09-12T18:59:58.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.529__multipart_mymultipart.2~SIgrFJm8IsxFe8F0EgosodMpSzxeRH3.2 2024-09-12T18:59:58.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.529__shadow_mymultipart.2~SIgrFJm8IsxFe8F0EgosodMpSzxeRH3.2_1 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6620230614331238633', time=2024-09-12T20:43:50.655502+0000, chain.objs.size()=1 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:8FlMPQDXe-46-5U.UyfJj6w5Acsz0qj_.z0OC3vcn-pyPrP76Gk-wfZRoPHuRWda_0 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10706497120122988035', time=2024-09-12T20:43:59.904677+0000, chain.objs.size()=1 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:cG1pi7UTrexVbe5-WeUTnnTT2lNMZsC_.5FNdpg15_uKDrfh17CFAw0FfUxtaN4P_0 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14085133651966867145', time=2024-09-12T20:44:05.127636+0000, chain.objs.size()=1 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.570__shadow:l.q7UENXn1oA5l42-lyfuoeaduGDblO_.ua31bwJys8zCEBPiFzqtonLz_Azdidq_0 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16212047407687012542', time=2024-09-12T20:44:55.349517+0000, chain.objs.size()=1 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:0iXvZ9Eq7ZWl4.JHqcaVDIIoMqkRoHq_.EqZgSkNoO-smJMdUMM0oX7OmpEnk_aw_0 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.563048208850514918', time=2024-09-12T20:45:12.342696+0000, chain.objs.size()=1 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:XvSmX.WA6YksvSb9s9.pQFza16X0lPN_.qJJ0tSrKjh8lKVce02T-Z_Fdk6wC5ej_0 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13361609359292711415', time=2024-09-12T20:51:21.455702+0000, chain.objs.size()=1 2024-09-12T18:59:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.652__shadow_.o24uDR-bXUSBuxpXKgPGB75PO6HLyT5_0 2024-09-12T18:59:58.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1726715262944106638', time=2024-09-12T20:52:47.962814+0000, chain.objs.size()=1 2024-09-12T18:59:58.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.708__shadow:D0aa2ZlzLNx0fFYvAZH951WG4NVODML_.rSOKMjkTMoh2bXkdpEGrgFXDmNM0UCn_0 2024-09-12T18:59:58.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:58.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:59:58.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:58.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:58.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43825' 2024-09-12T18:59:58.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14620874343840374301', time=2024-09-12T20:23:46.295221+0000, chain.objs.size()=1 2024-09-12T18:59:58.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.200__shadow_._VbeS_M6z-Q9yhYPIFwbTXbvYYUZlxG_0 2024-09-12T18:59:58.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5926349193836868548', time=2024-09-12T20:26:28.142806+0000, chain.objs.size()=1 2024-09-12T18:59:58.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.233__shadow_.6Qw2yfRlgsNPGOGBdC6UzaNklnvkziW_0 2024-09-12T18:59:58.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2584195473440998330', time=2024-09-12T20:26:56.637042+0000, chain.objs.size()=1 2024-09-12T18:59:58.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.252__shadow_.rjvzhcVh6kg1HHr6wdImt2h4zLpg-uT_0 2024-09-12T18:59:58.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9893417368412264198', time=2024-09-12T20:28:47.929472+0000, chain.objs.size()=1 2024-09-12T18:59:58.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.oilYe00SpL55nSSu-59vq-K5h1ygv3t_0 2024-09-12T18:59:58.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13227273600179800206', time=2024-09-12T20:28:48.214571+0000, chain.objs.size()=1 2024-09-12T18:59:58.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.cXCSVZ1yazgIfycBPEmNXF7BZISSPZv_0 2024-09-12T18:59:58.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14575333948863660956', time=2024-09-12T20:28:49.175970+0000, chain.objs.size()=1 2024-09-12T18:59:58.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.qxJ_MXnn5bXmG-hsKRiXvvafZwj3Uts_0 2024-09-12T18:59:58.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18072014725852863510', time=2024-09-12T20:28:49.321092+0000, chain.objs.size()=1 2024-09-12T18:59:58.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.oAnLWEam8_yEjiP0ml3gzYWwuQfmugv_0 2024-09-12T18:59:58.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1061047931038029589', time=2024-09-12T20:28:49.810307+0000, chain.objs.size()=1 2024-09-12T18:59:58.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Tp9M2VDTDKC3kw3AzGmc1NKl4VJfeYL_0 2024-09-12T18:59:58.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17809574281124328421', time=2024-09-12T20:28:49.946428+0000, chain.objs.size()=1 2024-09-12T18:59:58.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2UywuOmHViOWtDGYT3GEOYT8XgrLtJu_0 2024-09-12T18:59:58.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6426997284450689022', time=2024-09-12T20:28:50.128270+0000, chain.objs.size()=1 2024-09-12T18:59:58.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.zLFPclm-0-tU9zerQpF472f60QFidOu_0 2024-09-12T18:59:58.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9757512102150692550', time=2024-09-12T20:28:50.659792+0000, chain.objs.size()=1 2024-09-12T18:59:58.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ikDegP7H_vhJRkt03mT4fxKJtsNvB06_0 2024-09-12T18:59:58.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12547536139512372112', time=2024-09-12T20:28:51.647929+0000, chain.objs.size()=1 2024-09-12T18:59:58.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gzLQG6xMXtttdaQNFc_fBruUzqwbua0_0 2024-09-12T18:59:58.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15180650249482918378', time=2024-09-12T20:28:52.496783+0000, chain.objs.size()=1 2024-09-12T18:59:58.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.sF9AjF4eBd4AA_0znx23Q2ZgNfXy-Me_0 2024-09-12T18:59:58.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8659115536874430857', time=2024-09-12T20:28:53.406170+0000, chain.objs.size()=1 2024-09-12T18:59:58.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.XL2KzsMtmwwVcr4i1vK2Z6eiGAsMFeZ_0 2024-09-12T18:59:58.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15674551823540705657', time=2024-09-12T20:28:54.099801+0000, chain.objs.size()=1 2024-09-12T18:59:58.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FHzkfPG5rcj5cdgP5B89_a5MR_4TYGu_0 2024-09-12T18:59:58.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5101137219921198961', time=2024-09-12T20:28:56.131432+0000, chain.objs.size()=1 2024-09-12T18:59:58.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.36rwADdoOh528kKBKdlQgZ3p1szUjey_0 2024-09-12T18:59:58.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4135412176069188496', time=2024-09-12T20:28:56.215466+0000, chain.objs.size()=1 2024-09-12T18:59:58.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._k-eyDlRpkKQ83-uHEGVpSDbYA5cFG3_0 2024-09-12T18:59:58.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11119164986232625797', time=2024-09-12T20:28:56.471960+0000, chain.objs.size()=1 2024-09-12T18:59:58.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.eM1ngbvVf5GzgfKE5iMIdneaYBjjFqO_0 2024-09-12T18:59:58.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.587934588719149713', time=2024-09-12T20:28:57.074298+0000, chain.objs.size()=1 2024-09-12T18:59:58.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tVeGE4skWp1-QcH1n-1NbzQMrcZKR9w_0 2024-09-12T18:59:58.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14978236316510247821', time=2024-09-12T20:28:58.985711+0000, chain.objs.size()=1 2024-09-12T18:59:58.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VatNkljIQyTgxTChkexd2535z3vsBwl_0 2024-09-12T18:59:58.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9347151085322819548', time=2024-09-12T20:28:59.759184+0000, chain.objs.size()=1 2024-09-12T18:59:58.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wZbT1HJMdkT-GIgRXwPms-mi2LI5zvW_0 2024-09-12T18:59:58.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7267276819483178164', time=2024-09-12T20:29:00.585525+0000, chain.objs.size()=1 2024-09-12T18:59:58.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2Y3m0pQW7AB1JKHY-_o2rPedtV-S9Da_0 2024-09-12T18:59:58.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15747110894535981005', time=2024-09-12T20:29:01.680674+0000, chain.objs.size()=1 2024-09-12T18:59:58.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._L9bOXYyo0iNpKMO4naZ2sEM5hTdF0O_0 2024-09-12T18:59:58.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10443716474815173239', time=2024-09-12T20:29:01.725782+0000, chain.objs.size()=1 2024-09-12T18:59:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ForwkcGM9Izwl_XNdXkyD2RacCGhZTt_0 2024-09-12T18:59:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9450071118289373298', time=2024-09-12T20:29:04.628410+0000, chain.objs.size()=1 2024-09-12T18:59:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._-hkF9CFbnA29XtfZ2Eg7HOeOP1zZUg_0 2024-09-12T18:59:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6327586995227209317', time=2024-09-12T20:29:06.440230+0000, chain.objs.size()=1 2024-09-12T18:59:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.StfOgFh_vTCP0nwNA3UZudDy5MZgnP0_0 2024-09-12T18:59:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11847192187921890358', time=2024-09-12T20:29:06.445584+0000, chain.objs.size()=1 2024-09-12T18:59:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Ec1YzsQXgx_8YEBdeRAYQbTD5DB1CqT_0 2024-09-12T18:59:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1257475115934985145', time=2024-09-12T20:29:06.796916+0000, chain.objs.size()=1 2024-09-12T18:59:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.XrTVWSVKSYcmuFpNmLjkLfwBRqIeZ7U_0 2024-09-12T18:59:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2904504307935006159', time=2024-09-12T20:29:06.798493+0000, chain.objs.size()=1 2024-09-12T18:59:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.emjbfFqxCaPvai2JJoiqFNfEPpXVMrC_0 2024-09-12T18:59:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2673283219763888950', time=2024-09-12T20:29:07.170978+0000, chain.objs.size()=1 2024-09-12T18:59:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HYP0sN82BsgD71jLlgJ7U8f4AqWcJQZ_0 2024-09-12T18:59:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9541916553696630139', time=2024-09-12T20:29:07.217453+0000, chain.objs.size()=1 2024-09-12T18:59:58.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.qvkcftBh-JiqHVxgM7k8fK-SrgyhnCc_0 2024-09-12T18:59:58.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12629832986887350580', time=2024-09-12T20:29:07.781750+0000, chain.objs.size()=1 2024-09-12T18:59:58.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9pLxSN-QqdKfJLs0KtyK6XAIOKc63V6_0 2024-09-12T18:59:58.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13718648936309544245', time=2024-09-12T20:29:08.429693+0000, chain.objs.size()=1 2024-09-12T18:59:58.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FHcprqj5PtW7L1z3oNvr-9Yz0lwQjmf_0 2024-09-12T18:59:58.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7982722453825177190', time=2024-09-12T20:29:08.765506+0000, chain.objs.size()=1 2024-09-12T18:59:58.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.m6lsUKtyIFY1SwuqqWFPrTD5cqjFj8h_0 2024-09-12T18:59:58.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7255645658526444539', time=2024-09-12T20:29:08.794022+0000, chain.objs.size()=1 2024-09-12T18:59:58.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VBiRf49MDgb6NdVFkVMeZZIGDU92m2N_0 2024-09-12T18:59:58.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7326941041470069819', time=2024-09-12T20:29:09.668792+0000, chain.objs.size()=1 2024-09-12T18:59:58.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.f5a73syLbsIEsf2JcweWJd7R7i3UdXY_0 2024-09-12T18:59:58.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14799630046011080240', time=2024-09-12T20:29:10.111014+0000, chain.objs.size()=1 2024-09-12T18:59:58.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gQFp6mRypUv_xSUSSzyARlGydQJwXmp_0 2024-09-12T18:59:58.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6038387522317416708', time=2024-09-12T20:29:11.807303+0000, chain.objs.size()=1 2024-09-12T18:59:58.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.P3JccF67AigzkVSn7xGDBG5DfCAjK6O_0 2024-09-12T18:59:58.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2855555043753997538', time=2024-09-12T20:29:14.596540+0000, chain.objs.size()=1 2024-09-12T18:59:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.uoTWtYZPzJusi4Mn8TYbWkbIZaU6goi_0 2024-09-12T18:59:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11354666626926947312', time=2024-09-12T20:29:14.851251+0000, chain.objs.size()=1 2024-09-12T18:59:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.EXqsFCj_KdwGLHSZU4ju2CuVULcGJMF_0 2024-09-12T18:59:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12149434723878814555', time=2024-09-12T20:29:18.052573+0000, chain.objs.size()=1 2024-09-12T18:59:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.264__shadow_.0RUi3jnXO6je_KjdO8md0JyOh3F17Nu_0 2024-09-12T18:59:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11718970521514090209', time=2024-09-12T20:29:29.493978+0000, chain.objs.size()=1 2024-09-12T18:59:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.273__shadow_.pcMpCerqXskKdO1QvYgTj-S7R1tP2e-_0 2024-09-12T18:59:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1410603982228311924', time=2024-09-12T20:29:32.186998+0000, chain.objs.size()=1 2024-09-12T18:59:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.275__shadow_.X-xBdzNbl9mQs8DtahFS1VvzlPi96Wk_0 2024-09-12T18:59:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1066641310718266315', time=2024-09-12T20:29:41.988815+0000, chain.objs.size()=1 2024-09-12T18:59:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.282__shadow_.hv79AYJprOQX6gr5loUb-lILcXUxJbo_0 2024-09-12T18:59:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3705007437991990914', time=2024-09-12T20:29:47.735677+0000, chain.objs.size()=1 2024-09-12T18:59:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.286__shadow_.MfEAzqOJzNCvHDYbFeeZ-pQiOiEFW1V_0 2024-09-12T18:59:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10915639466222889803', time=2024-09-12T20:30:03.692381+0000, chain.objs.size()=1 2024-09-12T18:59:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.-_Yi-nYgEnvGeGxa8nY-AH0x38hyMDp_0 2024-09-12T18:59:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7394926200642725184', time=2024-09-12T20:30:03.823082+0000, chain.objs.size()=1 2024-09-12T18:59:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.U36tjYjRrCkEiN2TPu8gjo3HTRcIL0x_0 2024-09-12T18:59:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7331624690565838102', time=2024-09-12T20:30:13.903738+0000, chain.objs.size()=1 2024-09-12T18:59:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.300__shadow_.-cTVfoUdD5Hgz_WubnxF4qWHlap9zxP_0 2024-09-12T18:59:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11633710439196353466', time=2024-09-12T20:30:41.346745+0000, chain.objs.size()=1 2024-09-12T18:59:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.319__shadow:XDxENr7cb-w6MaMxHh6IpPUZFqlmwQe_.DuGMQRgYO4Y0DfDC3tqxPto2utD3itS_0 2024-09-12T18:59:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6939924159880405202', time=2024-09-12T20:32:28.051407+0000, chain.objs.size()=1 2024-09-12T18:59:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.TXX_P77M4E9nk_XttGj1BmzE8doWjpS_0 2024-09-12T18:59:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5600373893779723850', time=2024-09-12T20:32:28.191573+0000, chain.objs.size()=1 2024-09-12T18:59:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.mZDEqLM2XzbugE8rTfNmUaP_INo7pgR_0 2024-09-12T18:59:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14879760911544025742', time=2024-09-12T20:32:28.456532+0000, chain.objs.size()=1 2024-09-12T18:59:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BjHDyXBEy4UOvo_eW4Ad7GXKhQtRr32_0 2024-09-12T18:59:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1186423985397899985', time=2024-09-12T20:32:28.458191+0000, chain.objs.size()=1 2024-09-12T18:59:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8qVbaMU46ud81suU0YkbzSo_KtnA9CK_0 2024-09-12T18:59:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.919225396930399302', time=2024-09-12T20:32:29.482977+0000, chain.objs.size()=1 2024-09-12T18:59:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.MV5AZDBBTGAIULUejpmpXgxYGYAnISW_0 2024-09-12T18:59:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4496567349656929343', time=2024-09-12T20:32:29.485304+0000, chain.objs.size()=1 2024-09-12T18:59:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.AELIVHIYlh782OewmJaO3h6es65Skt6_0 2024-09-12T18:59:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2477144272377751860', time=2024-09-12T20:32:30.711384+0000, chain.objs.size()=1 2024-09-12T18:59:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.RMJIDgnSJjGYgSqWXnYvkzcCdhP2GWt_0 2024-09-12T18:59:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7243490546114170262', time=2024-09-12T20:32:31.452684+0000, chain.objs.size()=1 2024-09-12T18:59:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.KNG26rqN1uRy7pWOHqh-WWEBNHOqVZ5_0 2024-09-12T18:59:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7472054510499617981', time=2024-09-12T20:32:34.296938+0000, chain.objs.size()=1 2024-09-12T18:59:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.TojPS2p5uQA2PZQB5uKqv2C0Yc7gC-U_0 2024-09-12T18:59:58.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11003244530987918421', time=2024-09-12T20:32:34.522838+0000, chain.objs.size()=1 2024-09-12T18:59:58.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1PTqsBPvormTdn-UsfAYjqXM40V7oQr_0 2024-09-12T18:59:58.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15487213285766507199', time=2024-09-12T20:32:35.838445+0000, chain.objs.size()=1 2024-09-12T18:59:58.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eJbXbv9rR4l4PedSLBV7fTWLQPBRG4e_0 2024-09-12T18:59:58.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5128329871393959853', time=2024-09-12T20:32:35.974478+0000, chain.objs.size()=1 2024-09-12T18:59:58.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dqy2ZSdxAmb4FSm4TKDs0k8uwC5k_rp_0 2024-09-12T18:59:58.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3242291689419548373', time=2024-09-12T20:32:35.975951+0000, chain.objs.size()=1 2024-09-12T18:59:58.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Q7pTzfXB-vu4rOgECT_3xYueItIHLoK_0 2024-09-12T18:59:58.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8689684823569687495', time=2024-09-12T20:32:36.396185+0000, chain.objs.size()=1 2024-09-12T18:59:58.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.mwQo3zFZdNL9RKe4TcKt23GuK74g-z5_0 2024-09-12T18:59:58.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12426982151389984920', time=2024-09-12T20:32:40.143863+0000, chain.objs.size()=1 2024-09-12T18:59:58.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kVOWoQJNhJ6x-RddWkUSjZqElwa4z1B_0 2024-09-12T18:59:58.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3348502358805440225', time=2024-09-12T20:32:40.161395+0000, chain.objs.size()=1 2024-09-12T18:59:58.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.qoLyg7Wv-YrMhXi5Ki3A_GsYclcTagC_0 2024-09-12T18:59:58.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2751089516988848795', time=2024-09-12T20:32:41.379018+0000, chain.objs.size()=1 2024-09-12T18:59:58.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6sLS_T36AEG79KAJZ8cHKDtGBDsyG1S_0 2024-09-12T18:59:58.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11190299841369872068', time=2024-09-12T20:32:42.030190+0000, chain.objs.size()=1 2024-09-12T18:59:58.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.N-6qjbECEOU1d-0f9LTdouNYet0XMAJ_0 2024-09-12T18:59:58.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9636162933265517194', time=2024-09-12T20:32:45.133523+0000, chain.objs.size()=1 2024-09-12T18:59:58.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.SLAHXpoj_WVmWvP9QLj-GRVXRslba1f_0 2024-09-12T18:59:58.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11871822334478957746', time=2024-09-12T20:32:45.617212+0000, chain.objs.size()=1 2024-09-12T18:59:58.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0PP74zw1Gy0POE7PVI-HykDXN1vdJ84_0 2024-09-12T18:59:58.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5772729503429972289', time=2024-09-12T20:32:45.824935+0000, chain.objs.size()=1 2024-09-12T18:59:58.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6ueY4gR44md317J2U7UK7lNTiO7NgLv_0 2024-09-12T18:59:58.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18345999276164734898', time=2024-09-12T20:32:46.511013+0000, chain.objs.size()=1 2024-09-12T18:59:58.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.WmlNHyBusWV6iPmH5RseU3SfIcMzKmI_0 2024-09-12T18:59:58.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8999690650974693568', time=2024-09-12T20:32:48.801359+0000, chain.objs.size()=1 2024-09-12T18:59:58.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7nI-6yRSckFMS1Ecf2yifjbeOOpQLuT_0 2024-09-12T18:59:58.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17397897076301230860', time=2024-09-12T20:32:49.407057+0000, chain.objs.size()=1 2024-09-12T18:59:58.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HN7L72vp6C_hl84397AJWjTKK0a8uxX_0 2024-09-12T18:59:58.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5498592566485939215', time=2024-09-12T20:32:51.639725+0000, chain.objs.size()=1 2024-09-12T18:59:58.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.LtT9n1xh9ATyMPdJLKjv3AGj1G2sgSh_0 2024-09-12T18:59:58.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11150967140052997435', time=2024-09-12T20:32:52.070699+0000, chain.objs.size()=1 2024-09-12T18:59:58.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jDU1s-siIlH4p6bplAtVMOrks2wlJnQ_0 2024-09-12T18:59:58.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15594164924413734877', time=2024-09-12T20:32:52.423735+0000, chain.objs.size()=1 2024-09-12T18:59:58.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IAhFhRMKO4A_iVVPPDb_gehgBWBYHqz_0 2024-09-12T18:59:58.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8829985190028643275', time=2024-09-12T20:32:53.189874+0000, chain.objs.size()=1 2024-09-12T18:59:58.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tnRrfHi7UGryuiA9mCweFdpsND5bxAB_0 2024-09-12T18:59:58.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16997946435142474643', time=2024-09-12T20:32:53.331385+0000, chain.objs.size()=1 2024-09-12T18:59:58.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.WN9Y6HprBVcGrdLPi3s6GG_qgPMK4c7_0 2024-09-12T18:59:58.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1179266293372598627', time=2024-09-12T20:34:34.077982+0000, chain.objs.size()=1 2024-09-12T18:59:58.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BwGt8fLe6a_Mzbd0jdQId-fXOPmmec9_0 2024-09-12T18:59:58.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12306310641305290497', time=2024-09-12T20:34:34.080304+0000, chain.objs.size()=1 2024-09-12T18:59:58.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XVGj59jSQhcTr1eW7U8zpzD27z_d2t0_0 2024-09-12T18:59:58.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.873968345310972036', time=2024-09-12T20:34:34.978867+0000, chain.objs.size()=1 2024-09-12T18:59:58.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5xs_SoKpoS3WejpeIiW5e1zzdBrm8CA_0 2024-09-12T18:59:58.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10801804324113198901', time=2024-09-12T20:34:35.419174+0000, chain.objs.size()=1 2024-09-12T18:59:58.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bzd_wxOiq-0JZU2Z8UTBzn3CdHphztl_0 2024-09-12T18:59:58.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11582372450131325813', time=2024-09-12T20:34:36.063556+0000, chain.objs.size()=1 2024-09-12T18:59:58.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.jQA6H7cRscNBIVMDZIKnxn8eDjq587L_0 2024-09-12T18:59:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12281558671342525325', time=2024-09-12T20:34:36.783411+0000, chain.objs.size()=1 2024-09-12T18:59:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Rhx-foT60MSSo2V3YHOSTS_X7kmxpD0_0 2024-09-12T18:59:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10108952675183619053', time=2024-09-12T20:34:38.430628+0000, chain.objs.size()=1 2024-09-12T18:59:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.OYvA-VSKQRYieMLEsMiIN6l-TrzvnUw_0 2024-09-12T18:59:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9053050107986270005', time=2024-09-12T20:34:39.078511+0000, chain.objs.size()=1 2024-09-12T18:59:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.WB92l2sPzk1PB7c9qpmF3F2h4GGaxMB_0 2024-09-12T18:59:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14733834282877896900', time=2024-09-12T20:34:39.295479+0000, chain.objs.size()=1 2024-09-12T18:59:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wCTNeaeq8rfvEIEmzUr8dL4gyts4n4__0 2024-09-12T18:59:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12746236737109022412', time=2024-09-12T20:34:39.944067+0000, chain.objs.size()=1 2024-09-12T18:59:58.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.y7zAWBzg01dgJ6VTHDa1wXkHMn6VBQE_0 2024-09-12T18:59:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8420902245210437729', time=2024-09-12T20:34:40.280709+0000, chain.objs.size()=1 2024-09-12T18:59:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tqLYhh9GrFaPGF2hhwWJiIP2VyOvgVs_0 2024-09-12T18:59:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3765761827846429784', time=2024-09-12T20:34:40.388923+0000, chain.objs.size()=1 2024-09-12T18:59:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vsz9xoBnDqfxPdRqYDkakILroSzgdXT_0 2024-09-12T18:59:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6236327125210990151', time=2024-09-12T20:34:41.495264+0000, chain.objs.size()=1 2024-09-12T18:59:58.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.pc7lTB6OWx9kYfEMUyNZqZrUIXK2CR4_0 2024-09-12T18:59:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2253721374684595036', time=2024-09-12T20:34:41.891845+0000, chain.objs.size()=1 2024-09-12T18:59:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Sg3xzQ_xMk-4nwd08hc9-al28MaDPTv_0 2024-09-12T18:59:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8939557380528825853', time=2024-09-12T20:34:42.021803+0000, chain.objs.size()=1 2024-09-12T18:59:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._dssyr-giblXYKcZ867X2PqlaPpeXUh_0 2024-09-12T18:59:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17865992023596213366', time=2024-09-12T20:34:42.464071+0000, chain.objs.size()=1 2024-09-12T18:59:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.eQ4JJ43MFSKbFOkirkhrF-BIAUoAspf_0 2024-09-12T18:59:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5363454376648710514', time=2024-09-12T20:34:42.703299+0000, chain.objs.size()=1 2024-09-12T18:59:58.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5QCqi1RZV3rK3Ti5dEM3aTq8KQuZl5B_0 2024-09-12T18:59:58.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8889212788665915523', time=2024-09-12T20:34:43.091244+0000, chain.objs.size()=1 2024-09-12T18:59:58.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Yn9HnACRBEs1PKLi4nKQJOaICVxgkCE_0 2024-09-12T18:59:58.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5795806060111720068', time=2024-09-12T20:34:43.190830+0000, chain.objs.size()=1 2024-09-12T18:59:58.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.7_GtC5iqsjPx-MjEeQR3j6JMQboRb5W_0 2024-09-12T18:59:58.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17795501652672450084', time=2024-09-12T20:34:45.802580+0000, chain.objs.size()=1 2024-09-12T18:59:58.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.a49hfCr7YTLp1aD94H2a9YRzobrPGdF_0 2024-09-12T18:59:58.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8318450122527619949', time=2024-09-12T20:34:46.081763+0000, chain.objs.size()=1 2024-09-12T18:59:58.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6L4ouH6a1RbiaaAPnR0T4FZhGh8SU_S_0 2024-09-12T18:59:58.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1733101710246685776', time=2024-09-12T20:34:47.470847+0000, chain.objs.size()=1 2024-09-12T18:59:58.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LABrvDKzsW3ZJFhklHuomxBcNyYsKMh_0 2024-09-12T18:59:58.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43825 2024-09-12T18:59:58.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T18:59:58.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4087339439968144485', time=2024-09-12T20:34:49.841835+0000, chain.objs.size()=1 2024-09-12T18:59:58.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RzpLazSANZkFSo_u8M3ZlDyyMVKa8BX_0 2024-09-12T18:59:58.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8035067012860100868', time=2024-09-12T20:34:50.430254+0000, chain.objs.size()=1 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.KGF5BVb_-YzUu_5aKY_6UuIFiID_DC7_0 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15913281765158716043', time=2024-09-12T20:34:50.431920+0000, chain.objs.size()=1 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.CHbdNUlRyC4lSZgD_sbcjf63QOm4ZQs_0 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3260340380600401052', time=2024-09-12T20:34:50.433622+0000, chain.objs.size()=1 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1AG00Ynyg8Seqrb-dd8RdDt-Le4rk3a_0 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10781994897310830686', time=2024-09-12T20:34:53.189882+0000, chain.objs.size()=1 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Gzk2-YS_N9yYxtjauBKj4eOzY580_zY_0 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14118687012949261164', time=2024-09-12T20:34:54.032325+0000, chain.objs.size()=1 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ujZvJVXdQAYfkbFf8vYKMgOsFb4SxbI_0 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7222643805725420874', time=2024-09-12T20:34:55.002928+0000, chain.objs.size()=1 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.OS2-iU25o8hd_JT0zyjhn4cMxPmLW_L_0 2024-09-12T18:59:58.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11566712108021929697', time=2024-09-12T20:34:55.730825+0000, chain.objs.size()=1 2024-09-12T18:59:58.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ONmVNzvx8XByrezXn4iaAiXOShlKHS8_0 2024-09-12T18:59:58.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11219812222832098008', time=2024-09-12T20:34:56.174556+0000, chain.objs.size()=1 2024-09-12T18:59:58.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RKW8I8f0u6kuRAl5NAT1dORLcJk1XA0_0 2024-09-12T18:59:58.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2053480999935538823', time=2024-09-12T20:34:57.851477+0000, chain.objs.size()=1 2024-09-12T18:59:58.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.sS8LJmHSQuZhqarh4IYRoom7WgkkjDQ_0 2024-09-12T18:59:58.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4037872323232864926', time=2024-09-12T20:34:58.407665+0000, chain.objs.size()=1 2024-09-12T18:59:58.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.VmR3fdVdrBLKLkB_NJ4OF9zQ54XRJaM_0 2024-09-12T18:59:58.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10170531615017024509', time=2024-09-12T20:34:58.636999+0000, chain.objs.size()=1 2024-09-12T18:59:58.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tNPSdW_0ccDibaJLvDaguDDkNh2DD_5_0 2024-09-12T18:59:58.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8510790010614637122', time=2024-09-12T20:34:59.602531+0000, chain.objs.size()=1 2024-09-12T18:59:58.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.WirOWVQdYYzMfVclDb4BnaIsJhoxlSB_0 2024-09-12T18:59:58.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2425139888152119259', time=2024-09-12T20:36:31.291324+0000, chain.objs.size()=1 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.410__shadow_.qLSn3xl-PtGA_ypLcrfKF1RRDuuWocn_0 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16785047180882361248', time=2024-09-12T20:37:32.073368+0000, chain.objs.size()=1 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.461__shadow_.6QaNxmeeg52bqdgz1IwGaCg94ARALEw_0 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5345801925071475383', time=2024-09-12T20:37:33.890951+0000, chain.objs.size()=1 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.462__shadow_.uXPtIgNTnQu9gqOLRNxPT5gCETOLELs_0 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14285792834401784677', time=2024-09-12T20:37:39.533768+0000, chain.objs.size()=1 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.465__shadow_.WRHLZjov20LuVczZ3LgE5z_Hl8Qf2M4_0 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16771942375049688651', time=2024-09-12T20:37:40.679620+0000, chain.objs.size()=1 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.466__shadow_.T-eA_VPXZhL_QQI5gP7eCF0qwz_YfeN_0 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1612703501807159204', time=2024-09-12T20:37:56.857760+0000, chain.objs.size()=1 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.oqihZWfFggphElv5JL2VppuebUDZ7xY_0 2024-09-12T18:59:58.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15753762242461939052', time=2024-09-12T20:39:58.030501+0000, chain.objs.size()=6 2024-09-12T18:59:58.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.rIJOTml8HD5MW6JP4DeQRZcVhkN9M2Yz.1 2024-09-12T18:59:58.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~tYdUocEy9HpoLahAvOW2g6tmwS8JLtK.2 2024-09-12T18:59:58.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~tYdUocEy9HpoLahAvOW2g6tmwS8JLtK.3 2024-09-12T18:59:58.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~tYdUocEy9HpoLahAvOW2g6tmwS8JLtK.4 2024-09-12T18:59:58.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~tYdUocEy9HpoLahAvOW2g6tmwS8JLtK.5 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~tYdUocEy9HpoLahAvOW2g6tmwS8JLtK.6 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4098707188519279518', time=2024-09-12T20:42:16.447150+0000, chain.objs.size()=4 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.535__multipart_mymultipart.2~L6OGYHRKgBcnANfuESfIxp95KMrkSxV.1 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.535__multipart_mymultipart.2~L6OGYHRKgBcnANfuESfIxp95KMrkSxV.2 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.535__multipart_mymultipart.8pH-3qiW6pf6ykDHf8aY1rQY_tG8j3ra.3 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.535__multipart_mymultipart.2~L6OGYHRKgBcnANfuESfIxp95KMrkSxV.4 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17537524895010783847', time=2024-09-12T20:42:45.943625+0000, chain.objs.size()=1 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.550__shadow_.awUJYqFrCLAqkiMnjAKH9vnFWIAJ1Le_0 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10047817228553782151', time=2024-09-12T20:44:18.748398+0000, chain.objs.size()=1 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574__shadow:iHYyZdWqvjb1-SEIKgjrIJvZybLCplF_.w-m3y4fy_MfzIG6i6xGtRb8fdu2Zr6G_0 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13766169676746615071', time=2024-09-12T20:44:31.860271+0000, chain.objs.size()=1 2024-09-12T18:59:58.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.576__shadow:45xpqzmGtmlgp9JxgdYuV-OZB-D6dHV_.oCmZaxKMpyvW1SQXWji3pwRgiGqOs6S_0 2024-09-12T18:59:58.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1046336092633780831', time=2024-09-12T20:44:36.859908+0000, chain.objs.size()=1 2024-09-12T18:59:58.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:p683qnnLxtJ40VX3ymCBqnSataN6LQE_.taMiAlQIDE1TN7pHeu9MTxSNErSR_Pt_0 2024-09-12T18:59:58.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12818216223502004884', time=2024-09-12T20:44:38.102032+0000, chain.objs.size()=1 2024-09-12T18:59:58.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:0JXaaCcY552DzRKdq4uhohcOEPQrAZc_.BtDXvHODD_Y-Vc_n04POvaEizq6FzYN_0 2024-09-12T18:59:58.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13676453747886180185', time=2024-09-12T20:45:52.260038+0000, chain.objs.size()=1 2024-09-12T18:59:58.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.587__shadow:P3XsCfjD6rBp8-Lzfmh0.-jUQwxmgpr_.Rm4158W6_5OJJKEzJl_IEIV1r9-Au1K_0 2024-09-12T18:59:58.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14880224668561885610', time=2024-09-12T20:51:19.349912+0000, chain.objs.size()=1 2024-09-12T18:59:58.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.650__shadow_.HCO_7LvenPk3XZlYppbsLksbkt0vXGC_0 2024-09-12T18:59:58.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9506163422100075652', time=2024-09-12T20:52:01.823327+0000, chain.objs.size()=1 2024-09-12T18:59:58.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.666__shadow_.MeADMv2ZiJczPVMw8jD1GhLHwYxRoRx_0 2024-09-12T18:59:58.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:58.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:59:58.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:58.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:58.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47125' 2024-09-12T18:59:58.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8413883339696912402', time=2024-09-12T20:26:36.450361+0000, chain.objs.size()=1 2024-09-12T18:59:58.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.238__shadow_.vqOnjm5Q_UyFmVWSR7t6wkgNhArLaOS_0 2024-09-12T18:59:58.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16851429407061771617', time=2024-09-12T20:26:53.859097+0000, chain.objs.size()=1 2024-09-12T18:59:58.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.250__shadow_.atlODWL_SLcizgSAx7zfucgj9y5mlSm_0 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2842821487062170928', time=2024-09-12T20:26:55.233817+0000, chain.objs.size()=1 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.251__shadow_.yuXrHRakDHzr84brgUYaFLwFHRJXbL9_0 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17371852281000669316', time=2024-09-12T20:28:47.768572+0000, chain.objs.size()=1 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.w2YYMfCwIM5652L8gqyfIZ8IyDIiK2S_0 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8400066607399030351', time=2024-09-12T20:28:47.861354+0000, chain.objs.size()=1 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3Iknrrbu4n0z7FZk-FJB3-YpnTAf2j5_0 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12356012052487492809', time=2024-09-12T20:28:48.407028+0000, chain.objs.size()=1 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.hWUvLTco1rAF_g0v8MeLV9q005Gglvq_0 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7291865676049018915', time=2024-09-12T20:28:48.542890+0000, chain.objs.size()=1 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.GoS0Jq98VNKBj_DpEQuonOP-UmDtdfY_0 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1532026900574061012', time=2024-09-12T20:28:51.618208+0000, chain.objs.size()=1 2024-09-12T18:59:58.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fW5RJR49qyQA2dy3bFPTtIfkvnoV2-f_0 2024-09-12T18:59:58.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4329455568890648755', time=2024-09-12T20:28:53.653245+0000, chain.objs.size()=1 2024-09-12T18:59:58.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.nvGFWr0uYhRXUWxgZaUoco0dWe9eRDP_0 2024-09-12T18:59:58.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18353724984207388821', time=2024-09-12T20:28:55.769770+0000, chain.objs.size()=1 2024-09-12T18:59:58.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AARH3-uDl1ATQ_9mstocinUlIlUfWgp_0 2024-09-12T18:59:58.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10920971825813032579', time=2024-09-12T20:28:56.254734+0000, chain.objs.size()=1 2024-09-12T18:59:58.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.K7_Wgd9b39nWEjyobSzLFKIH_ojBLAB_0 2024-09-12T18:59:58.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9663511050886089374', time=2024-09-12T20:28:56.707687+0000, chain.objs.size()=1 2024-09-12T18:59:58.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OFDhasVjGHk29mA_Q3-I2hvwMFnnYCf_0 2024-09-12T18:59:58.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8909379321171129461', time=2024-09-12T20:28:57.333470+0000, chain.objs.size()=1 2024-09-12T18:59:58.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vkeApEFuFaXBOXwZemuECzpco4JW2nb_0 2024-09-12T18:59:58.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3128694011467465658', time=2024-09-12T20:28:57.494583+0000, chain.objs.size()=1 2024-09-12T18:59:58.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.r056wJB8RAOuq5ehTAlwqy38APiRv3y_0 2024-09-12T18:59:58.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13428985772954422617', time=2024-09-12T20:28:57.733308+0000, chain.objs.size()=1 2024-09-12T18:59:58.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.F5Em52R6szVEUPvBMnrWjFH8aljXH5E_0 2024-09-12T18:59:58.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17924203364889046106', time=2024-09-12T20:28:58.074906+0000, chain.objs.size()=1 2024-09-12T18:59:58.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.le8rWKxJ1R7_9TTLvbNYop-R_F2PtWo_0 2024-09-12T18:59:58.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4198871130141787273', time=2024-09-12T20:28:58.964036+0000, chain.objs.size()=1 2024-09-12T18:59:58.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fnW6PR_UoKnQsIC5AtdE0oDXsFye1Zn_0 2024-09-12T18:59:58.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6320421460530253603', time=2024-09-12T20:28:59.482945+0000, chain.objs.size()=1 2024-09-12T18:59:58.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.0pRWUhsN7SaoOnVkDqJY8VygC1orHjb_0 2024-09-12T18:59:58.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10092760311311963105', time=2024-09-12T20:29:00.053623+0000, chain.objs.size()=1 2024-09-12T18:59:58.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7AAiiSz_bs1CG6CPKWyxFxnUixqnjhu_0 2024-09-12T18:59:58.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4059258840008009929', time=2024-09-12T20:29:00.106145+0000, chain.objs.size()=1 2024-09-12T18:59:58.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.eBdHiAejLGPKulOQCv3wR1ZzBkhMcfd_0 2024-09-12T18:59:58.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4554929207109029206', time=2024-09-12T20:29:01.682146+0000, chain.objs.size()=1 2024-09-12T18:59:58.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9hBffT84W2so4IKzPc4NIT_IaEERb3F_0 2024-09-12T18:59:58.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18071882785572514837', time=2024-09-12T20:29:02.991415+0000, chain.objs.size()=1 2024-09-12T18:59:58.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.hOiV7JNzwZ06ppx9jYMeDMa9dzE1KII_0 2024-09-12T18:59:58.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15743482443410366479', time=2024-09-12T20:29:04.082185+0000, chain.objs.size()=1 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NF1xcxBGr4EjAAJdyY33g4twIlDSpR6_0 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2089501501781026781', time=2024-09-12T20:29:06.065280+0000, chain.objs.size()=1 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Yq7HC4kN0ZFjMw6pu5mBQfFFl_dILxn_0 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13272834115088274514', time=2024-09-12T20:29:06.067022+0000, chain.objs.size()=1 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HYit6vAdd9nGGON8PNu-oErxQ_S03Oc_0 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16374151582471671632', time=2024-09-12T20:29:06.439578+0000, chain.objs.size()=1 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ugzFdWoqNsEYrN-audLDGB0v4o5uTcH_0 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4154400183948233793', time=2024-09-12T20:29:07.323386+0000, chain.objs.size()=1 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.elSTid7PmF_zLEiSS5i5JN6SLzxB0od_0 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3195307121863113028', time=2024-09-12T20:29:07.669610+0000, chain.objs.size()=1 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.lTEPPy-yETNbenHyQCxtv51SON9kK1i_0 2024-09-12T18:59:58.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8672042005679467716', time=2024-09-12T20:29:08.681995+0000, chain.objs.size()=1 2024-09-12T18:59:58.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kFT_0vzpQI9R9_Nxppb1hI8xqV8jg78_0 2024-09-12T18:59:58.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2152890202523806116', time=2024-09-12T20:29:08.757171+0000, chain.objs.size()=1 2024-09-12T18:59:58.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.KJiQgviohNsBxZLSwZlL37g7YHyl3i9_0 2024-09-12T18:59:58.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15034679356537452300', time=2024-09-12T20:29:09.499667+0000, chain.objs.size()=1 2024-09-12T18:59:58.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.cpRTt8cSyODHYcjUyzAyVLWFfyaqTNW_0 2024-09-12T18:59:58.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3651832309534314085', time=2024-09-12T20:29:10.273753+0000, chain.objs.size()=1 2024-09-12T18:59:58.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.GgbVzp6yXnQ6iyfrKEqeaHtzz0hGz3T_0 2024-09-12T18:59:58.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14414017661930251642', time=2024-09-12T20:29:10.382246+0000, chain.objs.size()=1 2024-09-12T18:59:58.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.odNM6UQPMkLOxUBVkGWtCAl3GBVuLpR_0 2024-09-12T18:59:58.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.21409653945042431', time=2024-09-12T20:29:14.409105+0000, chain.objs.size()=1 2024-09-12T18:59:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5PJ5NkHuQqK1pONoxWETSrn475pMUIV_0 2024-09-12T18:59:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.791411467843625257', time=2024-09-12T20:29:36.323648+0000, chain.objs.size()=1 2024-09-12T18:59:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.278__shadow_.QGeCitWD_UKIj5BTlQAbUc5snGhqC4m_0 2024-09-12T18:59:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2587450416255307119', time=2024-09-12T20:29:40.603510+0000, chain.objs.size()=1 2024-09-12T18:59:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.281__shadow_.NAfCdcEV1ovqNaDjJr1z7UrGxnWU1Rr_0 2024-09-12T18:59:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1706146424146495427', time=2024-09-12T20:30:03.698069+0000, chain.objs.size()=1 2024-09-12T18:59:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.9UhgFCKk0iPmhzJMpwDAZ6fLKumLMY6_0 2024-09-12T18:59:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8434170742117639798', time=2024-09-12T20:30:03.976881+0000, chain.objs.size()=1 2024-09-12T18:59:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.fz_eBX4-5tUK0QahoyKSltk7-fPQUPp_0 2024-09-12T18:59:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5040508866868363467', time=2024-09-12T20:30:13.887812+0000, chain.objs.size()=1 2024-09-12T18:59:58.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.300__shadow_.lWc5St5ijRRDlVXcf4mnFIw7WiNUYEh_0 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4344193774305476253', time=2024-09-12T20:30:18.063252+0000, chain.objs.size()=1 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.303__shadow_.uErPpjBBUVYvFkfaCn-5z0_lcab6mdW_0 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5305766142843757203', time=2024-09-12T20:30:45.569951+0000, chain.objs.size()=1 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.322__shadow_.aQnjwmODO-bJY2YtEt_EcYCmObow8Ie_0 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3992492810400105335', time=2024-09-12T20:32:26.798332+0000, chain.objs.size()=1 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pSE_eZErbisdvZoNSFXwD89kf59rxMe_0 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6860298732201595039', time=2024-09-12T20:32:27.887848+0000, chain.objs.size()=1 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.P8MYARxV1T9raLS6z76AhviJbF2e3m8_0 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15274705495068970268', time=2024-09-12T20:32:28.777612+0000, chain.objs.size()=1 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.G9vrnDFYVS_4IDDCZvFEFCS24GxP4dN_0 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15640342545052416877', time=2024-09-12T20:32:29.465977+0000, chain.objs.size()=1 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.LVdeZDolz6uaw0vPieLZFz6b65UbYC7_0 2024-09-12T18:59:58.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10179956167718155314', time=2024-09-12T20:32:30.608528+0000, chain.objs.size()=1 2024-09-12T18:59:58.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.VRx49HiA1hkE_BqKx4KEijCEbOEa6Qf_0 2024-09-12T18:59:58.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1357494000344394109', time=2024-09-12T20:32:32.463945+0000, chain.objs.size()=1 2024-09-12T18:59:58.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.M_MNbovEb23yu-M_wSt76DuTlSOl-vH_0 2024-09-12T18:59:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8736821075525619589', time=2024-09-12T20:32:32.726322+0000, chain.objs.size()=1 2024-09-12T18:59:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dClboR7zI3dFXAta2bIX9n634qFFs4d_0 2024-09-12T18:59:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17918739445126134838', time=2024-09-12T20:32:34.707244+0000, chain.objs.size()=1 2024-09-12T18:59:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6H4UvFcDxlGnJzt7awdeP1m1lwFtApk_0 2024-09-12T18:59:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16751175470137779991', time=2024-09-12T20:32:34.998972+0000, chain.objs.size()=1 2024-09-12T18:59:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.FV-UMEEuD1GW_n7SDpAyYW-893jWZZR_0 2024-09-12T18:59:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10721200725010499991', time=2024-09-12T20:32:36.656729+0000, chain.objs.size()=1 2024-09-12T18:59:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.34B44UKvuLajBLVxYiEAQaYL342guuT_0 2024-09-12T18:59:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16008089346726018294', time=2024-09-12T20:32:38.882796+0000, chain.objs.size()=1 2024-09-12T18:59:58.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IItBSLPANqNjUsn46rXyXFLZteOx1C9_0 2024-09-12T18:59:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.259985482340526919', time=2024-09-12T20:32:41.849423+0000, chain.objs.size()=1 2024-09-12T18:59:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.qHpGX6YtRXkGqJcfyCQK89ELhPCZpdU_0 2024-09-12T18:59:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9149301849248291538', time=2024-09-12T20:32:42.181605+0000, chain.objs.size()=1 2024-09-12T18:59:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._ky5oVyyeUZNw8My7BekSo13KIVbWcw_0 2024-09-12T18:59:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16676213934550587317', time=2024-09-12T20:32:42.531424+0000, chain.objs.size()=1 2024-09-12T18:59:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7nF3PMm_xcgzVK3kABwAnYjHJdfSTIr_0 2024-09-12T18:59:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1121749745786378113', time=2024-09-12T20:32:43.883208+0000, chain.objs.size()=1 2024-09-12T18:59:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sKeiN8Q8NXsag3FAxuExRG6Zm_pu_eH_0 2024-09-12T18:59:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11163644286202941447', time=2024-09-12T20:32:44.721437+0000, chain.objs.size()=1 2024-09-12T18:59:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gZXEsrvOnybQrk-V9VsFxV5s8nByioo_0 2024-09-12T18:59:58.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1923851286200637040', time=2024-09-12T20:32:45.573630+0000, chain.objs.size()=1 2024-09-12T18:59:58.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ePMqVNb0uPeDebQx6iRjibDQ7cSd7F4_0 2024-09-12T18:59:58.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9752179804838062911', time=2024-09-12T20:32:48.621440+0000, chain.objs.size()=1 2024-09-12T18:59:58.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.2faI3RpGjhR2QviKQw1LMV4fBGc44sQ_0 2024-09-12T18:59:58.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9748967736870298267', time=2024-09-12T20:32:49.681044+0000, chain.objs.size()=1 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Im1Lhs3t0GyqhGlYpz6nMQSA9TlG79w_0 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15255271414838295558', time=2024-09-12T20:32:50.137636+0000, chain.objs.size()=1 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.DbuB0y1nI_nmNB4nC3y3avM7Ja7Z1yA_0 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8716976777610895560', time=2024-09-12T20:32:50.947648+0000, chain.objs.size()=1 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.CEHUAVTLa78kNFLul46PnKaq2oUYb1Z_0 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9943052851330559410', time=2024-09-12T20:32:52.180548+0000, chain.objs.size()=1 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eyyuWW_3M499-47KoOZXOA7R8ofn74g_0 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16030286267894662778', time=2024-09-12T20:32:52.597197+0000, chain.objs.size()=1 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pTjcT7n8OBnXZbV4agZc4-HPEcZt_b5_0 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5373942365131715978', time=2024-09-12T20:32:52.769655+0000, chain.objs.size()=1 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jHdO0I_a-zHrKw6uhEIss-GW2Hs4z57_0 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4483240664077435980', time=2024-09-12T20:32:53.067594+0000, chain.objs.size()=1 2024-09-12T18:59:58.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.D7cqEw_TGljsQbhBNgVIdO4kDOZ5TFE_0 2024-09-12T18:59:58.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15569900735556397284', time=2024-09-12T20:32:53.555095+0000, chain.objs.size()=1 2024-09-12T18:59:58.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Lvi3BqC8SttPYKOeBdevvy7QmEENAEb_0 2024-09-12T18:59:58.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13472294109647647833', time=2024-09-12T20:34:34.161659+0000, chain.objs.size()=1 2024-09-12T18:59:58.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.AbGVruJw_9bQis_VPvuY9_48GdeGzmf_0 2024-09-12T18:59:58.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1393023611503781738', time=2024-09-12T20:34:36.051674+0000, chain.objs.size()=1 2024-09-12T18:59:58.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qEx6fd1U0CtDp3KHYUWfR1lADG-l3G3_0 2024-09-12T18:59:58.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4718679771706083395', time=2024-09-12T20:34:36.727055+0000, chain.objs.size()=1 2024-09-12T18:59:58.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Gn4MUW7kBmoYI30xwGn496ymAr1dQuY_0 2024-09-12T18:59:58.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11722414145865700031', time=2024-09-12T20:34:37.959482+0000, chain.objs.size()=1 2024-09-12T18:59:58.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.l0VDB7ylFE5vBHvb1qIEkU_6pUIQgdA_0 2024-09-12T18:59:58.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6275477568164401868', time=2024-09-12T20:34:40.548467+0000, chain.objs.size()=1 2024-09-12T18:59:58.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6hRGnHncDVq3CHMGhhaPo7DwW_lZzcD_0 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15642705175658431506', time=2024-09-12T20:34:41.491962+0000, chain.objs.size()=1 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Fo9roLCU5vfYiHzNflMDnnntuJeodj4_0 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14830049776479772246', time=2024-09-12T20:34:41.968861+0000, chain.objs.size()=1 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ygloM9Yh9UAkNs-5KhKw2zFhYUN05Qe_0 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16774166936409078551', time=2024-09-12T20:34:42.928371+0000, chain.objs.size()=1 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.rH_Zg6OMozKHkufTgNbe-QXn13SOdue_0 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18016794214883610095', time=2024-09-12T20:34:42.930513+0000, chain.objs.size()=1 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.I8M_j9N_LMFS2LjdR8WhHGHFTR5YNQj_0 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5750993216813529011', time=2024-09-12T20:34:44.036822+0000, chain.objs.size()=1 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.zliwa8VzAx_8M2Xc5dxehbo40udoHdI_0 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11551087066524979995', time=2024-09-12T20:34:44.241912+0000, chain.objs.size()=1 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vBm1T7_XgyDVQZ47ShmE7sv4G4xZdje_0 2024-09-12T18:59:58.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14311098402063860972', time=2024-09-12T20:34:44.264681+0000, chain.objs.size()=1 2024-09-12T18:59:58.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.o9QU_6fvZTxZW4Sjso9014IoHkyolwS_0 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18170929640409313828', time=2024-09-12T20:34:46.242873+0000, chain.objs.size()=1 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bFUP_cXa6CDQEqTpIJQZh8Ay3sxft7B_0 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3645058165384953045', time=2024-09-12T20:34:47.557861+0000, chain.objs.size()=1 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.sFVNbXHoaNYEkcBQYrAsXfCqssqqkax_0 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7712523985467171434', time=2024-09-12T20:34:47.807754+0000, chain.objs.size()=1 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1Rkvn_ZrL_W9ixjw2-M_0iayEcl6yqo_0 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13694115596925414450', time=2024-09-12T20:34:47.872297+0000, chain.objs.size()=1 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hSx6XbUmYxbNhPPT-CErnxprNhKJGxM_0 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2431722477408573152', time=2024-09-12T20:34:48.809616+0000, chain.objs.size()=1 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3-T9Dq9_uaVNWLocaBf7skDy0OPpJnw_0 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6125966898682026540', time=2024-09-12T20:34:48.907935+0000, chain.objs.size()=1 2024-09-12T18:59:58.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JNoHnR5sSMoQJG7NTHSIdVxT3f_e7rZ_0 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5192413870505957869', time=2024-09-12T20:34:49.261089+0000, chain.objs.size()=1 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hoqUdAXQUfxN-MPQRIljoWEntQMPuQ9_0 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8526839582886155388', time=2024-09-12T20:34:49.827956+0000, chain.objs.size()=1 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Kz866D3RfbU8o9_A5eWm4yeuCBggbbv_0 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.36767610810618911', time=2024-09-12T20:34:49.834873+0000, chain.objs.size()=1 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.o-fWa-xiIFx-aU7Xlwo4YV7veYTJL9d_0 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9372350957307583283', time=2024-09-12T20:34:50.693595+0000, chain.objs.size()=1 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qeSXtgLI7cgSENjkTwxZuFIsK2w3sw7_0 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12286308865034830719', time=2024-09-12T20:34:51.173872+0000, chain.objs.size()=1 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.G2u48zbsAKT37pWDsLoaU4BKTrb_y8n_0 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.305596729799686093', time=2024-09-12T20:34:52.706068+0000, chain.objs.size()=1 2024-09-12T18:59:58.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.SNNRCzE2N_58eXyJhtr2q0i-V_OxOdW_0 2024-09-12T18:59:58.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14986379560918494887', time=2024-09-12T20:34:53.113824+0000, chain.objs.size()=1 2024-09-12T18:59:58.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XbHxCUsJ-kUSAAbXvrrrmeBQHGC76Us_0 2024-09-12T18:59:58.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10294197674896082853', time=2024-09-12T20:34:53.115975+0000, chain.objs.size()=1 2024-09-12T18:59:58.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.R3Ai1WEueKjLE4pOgyuZrCVSSB2f5Gv_0 2024-09-12T18:59:58.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13628508824569614181', time=2024-09-12T20:34:56.408157+0000, chain.objs.size()=1 2024-09-12T18:59:58.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9hEmXOaCaG4upQivBNfv_-piDDFIEem_0 2024-09-12T18:59:58.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4983481376002822808', time=2024-09-12T20:34:56.973891+0000, chain.objs.size()=1 2024-09-12T18:59:58.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3eHRRSN4K2r5kVyoomgHMLjFERqdkRQ_0 2024-09-12T18:59:58.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18196351016328335860', time=2024-09-12T20:34:56.977487+0000, chain.objs.size()=1 2024-09-12T18:59:58.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.CmDilRB286Be2-QQttSeu9zbh7ZVVxs_0 2024-09-12T18:59:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16772294071198893267', time=2024-09-12T20:34:58.789537+0000, chain.objs.size()=1 2024-09-12T18:59:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.2SpUIfta0UOSN7CrfUJRTV3pQ4WvAib_0 2024-09-12T18:59:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9918623689340905098', time=2024-09-12T20:35:00.375201+0000, chain.objs.size()=1 2024-09-12T18:59:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.f6wAPFh7B-RTB9LkveXpiDMeJW3iGD9_0 2024-09-12T18:59:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1294569045881955571', time=2024-09-12T20:35:20.923451+0000, chain.objs.size()=1 2024-09-12T18:59:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.342__shadow_.iq6eZuQL3A5jcdwZPHyIiE5CqKQwU11_0 2024-09-12T18:59:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4223727176566523443', time=2024-09-12T20:35:56.814198+0000, chain.objs.size()=1 2024-09-12T18:59:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.379__shadow_.vL5jLncjle0g3p58IygiDdX4HDLIhfI_0 2024-09-12T18:59:58.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47125 2024-09-12T18:59:58.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:59:58.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12668671554792457660', time=2024-09-12T20:35:59.114976+0000, chain.objs.size()=1 2024-09-12T18:59:58.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.381__shadow_.ydRZ0iv7kWObiMx_HdTEadIUmHWto_l_0 2024-09-12T18:59:58.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9813773654767113546', time=2024-09-12T20:37:06.825126+0000, chain.objs.size()=1 2024-09-12T18:59:58.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.443__shadow_.CwUrQJqlZg-I4VF3fCrD3Ko8vVJvnWo_0 2024-09-12T18:59:58.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11274478586341941138', time=2024-09-12T20:37:37.578821+0000, chain.objs.size()=1 2024-09-12T18:59:58.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.464__shadow_.dYihB1qSFMP5SvBtY4CF5V42piCBO9l_0 2024-09-12T18:59:58.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17564504282508541409', time=2024-09-12T20:38:39.344688+0000, chain.objs.size()=6 2024-09-12T18:59:58.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.1 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.2 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.3 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.4 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.5 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.6 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1836054849080222974', time=2024-09-12T20:38:48.613437+0000, chain.objs.size()=1 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.516__multipart_mymultipartcopy.2~PNv3FXo-kammxIJ44QKmbFVbsd3SYWS.1 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17962517203943431742', time=2024-09-12T20:43:36.786064+0000, chain.objs.size()=1 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.565__shadow_.rdQPp-Di0tL7M1dRNwrSEvCgCsDu2ti_0 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7773860833279509294', time=2024-09-12T20:43:37.831456+0000, chain.objs.size()=1 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.566__shadow_.5kaHeBnCWdjpxyyfDt0udsxtQAYLHKX_0 2024-09-12T18:59:59.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4187065912125837545', time=2024-09-12T20:44:06.361283+0000, chain.objs.size()=1 2024-09-12T18:59:59.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.571__shadow_.pXZV6gIvwjjcH8413Oj77hkm12ezzY9_0 2024-09-12T18:59:59.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4264871517855651524', time=2024-09-12T20:44:22.134614+0000, chain.objs.size()=1 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.575__shadow:l6WCTLxE7Rrt-D4EipyPvBdkDwlQ8CQ_.LzBR9G4VUiaCNzP6r3CvsCI0TNO61p__0 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12032283274129370389', time=2024-09-12T20:45:10.863678+0000, chain.objs.size()=1 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:mpEbjo6OhwDRQwo.GNvNk2A-zvvYaxV_.ihg7T8cWbcwRyHrPp5gFhwbuVy67Rat_0 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17790439994104426576', time=2024-09-12T20:51:52.962298+0000, chain.objs.size()=6 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.661__multipart_baz.2~qTs2rV7YQNw9-ruaKYl8gnMBvuRGkB4.1 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.661__multipart_baz.2~qTs2rV7YQNw9-ruaKYl8gnMBvuRGkB4.2 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.661__multipart_baz.2~qTs2rV7YQNw9-ruaKYl8gnMBvuRGkB4.3 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.661__multipart_baz.2~qTs2rV7YQNw9-ruaKYl8gnMBvuRGkB4.4 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.661__multipart_baz.2~qTs2rV7YQNw9-ruaKYl8gnMBvuRGkB4.5 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.661__multipart_baz.2~qTs2rV7YQNw9-ruaKYl8gnMBvuRGkB4.6 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18154282624921735538', time=2024-09-12T20:51:55.225886+0000, chain.objs.size()=1 2024-09-12T18:59:59.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.663__shadow_.xxuUPi9X8r9x_tR4hC9dlDoReWEqYOo_0 2024-09-12T18:59:59.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.795777250364825033', time=2024-09-12T20:51:55.237903+0000, chain.objs.size()=1 2024-09-12T18:59:59.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.663__shadow_.dWvV8zn9uGgxOItLbUFEszMhWCCoggG_0 2024-09-12T18:59:59.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14657161608192150725', time=2024-09-12T20:51:57.244634+0000, chain.objs.size()=1 2024-09-12T18:59:59.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.664__shadow_.YjNxYMJFosh2OJ3AxvIm2T3c8SY6IJS_0 2024-09-12T18:59:59.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10043778181784021772', time=2024-09-12T20:52:30.486850+0000, chain.objs.size()=1 2024-09-12T18:59:59.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:58.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.695__shadow_.71Om2J-Pb2uQ9-WvqVK3iNBsGvF-Eqy_0 2024-09-12T18:59:59.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.003+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.003+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:59:59.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48537' 2024-09-12T18:59:59.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_CNDShhaotlb8rdkjeRf2C0EpgORYhRj', time=2024-09-12T20:22:45.574665+0000, chain.objs.size()=3 2024-09-12T18:59:59.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.YVQwYkD4AdvjNCUjfaWrhQMrKvXb8-X_0 2024-09-12T18:59:59.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.YVQwYkD4AdvjNCUjfaWrhQMrKvXb8-X_1 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.YVQwYkD4AdvjNCUjfaWrhQMrKvXb8-X_2 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7823686406495402707', time=2024-09-12T20:22:48.971965+0000, chain.objs.size()=1 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.162__shadow_.pyWTRTtqSIFnBTBqGpf7e8LlIqP7w8q_0 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.195384176139389833', time=2024-09-12T20:23:13.860881+0000, chain.objs.size()=1 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.178__shadow_.PBTH5cr3TNxBOO_a9B_ugbA9y4-UkH5_0 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10824735778484338376', time=2024-09-12T20:26:48.286765+0000, chain.objs.size()=1 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.246__shadow_.2Rafam-VuzarSGOcHGTV99is8wa-4VK_0 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14322546095614376642', time=2024-09-12T20:26:52.473726+0000, chain.objs.size()=1 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.249__shadow_.mCgUmIUuNuMwSbcW-TqOloKTlZ6sxdR_0 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7112232586798200778', time=2024-09-12T20:27:00.825891+0000, chain.objs.size()=1 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.255__shadow_.DWEXW13x8sTN-OZitTXO0Y104S0RpQW_0 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16013893673228252757', time=2024-09-12T20:28:48.773018+0000, chain.objs.size()=1 2024-09-12T18:59:59.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.abR_XMt92SomF8fi6MpDXSspwsGxa9a_0 2024-09-12T18:59:59.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.106314451640300789', time=2024-09-12T20:28:49.206765+0000, chain.objs.size()=1 2024-09-12T18:59:59.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5uuc4Nz67hPLxWKV6UkMdSJ43WgfiUq_0 2024-09-12T18:59:59.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9530146054320520868', time=2024-09-12T20:28:49.998364+0000, chain.objs.size()=1 2024-09-12T18:59:59.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7cRxtVjmijIw1ZnOJNSsdPJpkfaY0Qp_0 2024-09-12T18:59:59.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7017405686316823339', time=2024-09-12T20:28:50.517301+0000, chain.objs.size()=1 2024-09-12T18:59:59.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.IfHZRSgEROSoOeoLlXkGdSxEs2iJDKW_0 2024-09-12T18:59:59.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17720959579758756894', time=2024-09-12T20:28:52.485899+0000, chain.objs.size()=1 2024-09-12T18:59:59.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.I1Gu2k-tngXL6_sQ5xyQEQKTvb3RD8M_0 2024-09-12T18:59:59.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4876176772033605985', time=2024-09-12T20:28:53.672925+0000, chain.objs.size()=1 2024-09-12T18:59:59.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.EYA66tIKGvRXVn7zjLYdVeCA20r6S4s_0 2024-09-12T18:59:59.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5792065017684838399', time=2024-09-12T20:28:55.398441+0000, chain.objs.size()=1 2024-09-12T18:59:59.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ScRV-WOPjW97DWjSmhQOMWNhSDeL9wh_0 2024-09-12T18:59:59.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11184867182771055121', time=2024-09-12T20:28:55.400448+0000, chain.objs.size()=1 2024-09-12T18:59:59.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3Xgo15IWEmcsuA8oqe2Cf1e8HoksPdh_0 2024-09-12T18:59:59.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16824383861517558484', time=2024-09-12T20:28:56.575865+0000, chain.objs.size()=1 2024-09-12T18:59:59.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.lU9kLnUkHBpMIe6FKQQkOKNhXq_O7Qy_0 2024-09-12T18:59:59.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16349973355909967176', time=2024-09-12T20:28:56.972095+0000, chain.objs.size()=1 2024-09-12T18:59:59.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.37EKbyXrL7xbjJGNpiUZvl717GhLQY3_0 2024-09-12T18:59:59.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17165587999975543037', time=2024-09-12T20:28:58.070836+0000, chain.objs.size()=1 2024-09-12T18:59:59.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.g8gO-t5UIgHeFYhqyb9zACC-0V6kwUH_0 2024-09-12T18:59:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6559338479502743437', time=2024-09-12T20:29:01.283481+0000, chain.objs.size()=1 2024-09-12T18:59:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.yhZRps17voouZEez7RiOGX-Phm1e2om_0 2024-09-12T18:59:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17646481251101026909', time=2024-09-12T20:29:03.138203+0000, chain.objs.size()=1 2024-09-12T18:59:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JQTi4vdiArXKwCRriFmvs2n6m1qE7G3_0 2024-09-12T18:59:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5082751588066754229', time=2024-09-12T20:29:03.641235+0000, chain.objs.size()=1 2024-09-12T18:59:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.YaYThJTk_ReVJkVM3pAtP9MyhKFv2Bi_0 2024-09-12T18:59:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1504756417242365235', time=2024-09-12T20:29:03.934392+0000, chain.objs.size()=1 2024-09-12T18:59:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.87nCGgOqyHhBoJ71qUMkOoSEdlnngZp_0 2024-09-12T18:59:59.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.505715092163004658', time=2024-09-12T20:29:05.019509+0000, chain.objs.size()=1 2024-09-12T18:59:59.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Iu4dVb1vMjcBVpEuIj9n1UQWwDLr1xi_0 2024-09-12T18:59:59.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4025493497108383021', time=2024-09-12T20:29:06.075633+0000, chain.objs.size()=1 2024-09-12T18:59:59.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.YrogBwdveS4isAhZBBlpSrJ8KVjdm0s_0 2024-09-12T18:59:59.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8656124388720784488', time=2024-09-12T20:29:06.077671+0000, chain.objs.size()=1 2024-09-12T18:59:59.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.4j_ziLd62HR91tEdKqkJ8COfSGGprhK_0 2024-09-12T18:59:59.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10157108500224690087', time=2024-09-12T20:29:07.358007+0000, chain.objs.size()=1 2024-09-12T18:59:59.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.v5Ws9zSVlhb9CIqVo0jOuSWUKU4IzkH_0 2024-09-12T18:59:59.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13892962095702875183', time=2024-09-12T20:29:09.522543+0000, chain.objs.size()=1 2024-09-12T18:59:59.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.F2Ko3akSTszNIqh2GBPROBU3duFKHDL_0 2024-09-12T18:59:59.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17143020980726312180', time=2024-09-12T20:29:10.301888+0000, chain.objs.size()=1 2024-09-12T18:59:59.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.R7T0PGnZWPEUPHZZ4qkKR_aMRg8wWRK_0 2024-09-12T18:59:59.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12577915829835117933', time=2024-09-12T20:29:10.668400+0000, chain.objs.size()=1 2024-09-12T18:59:59.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.YXxWuHDJr6QxVgrFL5yRslUQMNZiyKX_0 2024-09-12T18:59:59.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5984442334557250909', time=2024-09-12T20:29:10.784184+0000, chain.objs.size()=1 2024-09-12T18:59:59.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SFHu_jcqluAbAFy-CvA2yVrGgm5zIzG_0 2024-09-12T18:59:59.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13636742212456893181', time=2024-09-12T20:29:12.054514+0000, chain.objs.size()=1 2024-09-12T18:59:59.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.cisH0V3_NH6bjmckhzsHoOECvmKk9gv_0 2024-09-12T18:59:59.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10487502404871693808', time=2024-09-12T20:29:12.058135+0000, chain.objs.size()=1 2024-09-12T18:59:59.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3WDf_owfzmGjAtcrQw3Gn6-APWlCder_0 2024-09-12T18:59:59.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5547701039908031897', time=2024-09-12T20:29:12.496059+0000, chain.objs.size()=1 2024-09-12T18:59:59.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rMrvt8-KQjqdmI_xGaKZ8XjEBRUmtmR_0 2024-09-12T18:59:59.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12029318417823786905', time=2024-09-12T20:29:12.579828+0000, chain.objs.size()=1 2024-09-12T18:59:59.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.lo4IZfcs-h1-iroagvXQH5SamnEHOu5_0 2024-09-12T18:59:59.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11511553122940654732', time=2024-09-12T20:29:13.850914+0000, chain.objs.size()=1 2024-09-12T18:59:59.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.aicJJZYbD3crL8fgEFkWQvv3Ig_el3Q_0 2024-09-12T18:59:59.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7430914569438918097', time=2024-09-12T20:29:14.811473+0000, chain.objs.size()=1 2024-09-12T18:59:59.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.UZQ55AjCc50eImVaqHzfS_DLhbcpzf0_0 2024-09-12T18:59:59.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12658164724140460768', time=2024-09-12T20:29:15.404068+0000, chain.objs.size()=1 2024-09-12T18:59:59.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.b-G1BSNdcRUhjPUzdfRvMIuPTCQeYdK_0 2024-09-12T18:59:59.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17389849045620568455', time=2024-09-12T20:29:19.317440+0000, chain.objs.size()=1 2024-09-12T18:59:59.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.265__shadow_.MAN7l32ToGOJSwFIAD9cMJXNtxZWy21_0 2024-09-12T18:59:59.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13247869871148214845', time=2024-09-12T20:29:23.163530+0000, chain.objs.size()=1 2024-09-12T18:59:59.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.268__shadow_.1BJyNE_2Z3ZZKRRth61P4_0UCrmW4RX_0 2024-09-12T18:59:59.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16937240024743173505', time=2024-09-12T20:29:36.331295+0000, chain.objs.size()=1 2024-09-12T18:59:59.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.278__shadow_.IOCmEiQ_guZlnk035il5c2bR6lv3she_0 2024-09-12T18:59:59.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2920378538942037428', time=2024-09-12T20:29:59.038842+0000, chain.objs.size()=1 2024-09-12T18:59:59.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.Vd1ppRmJPv5NhrRACkxmaUV8G0q7U79_0 2024-09-12T18:59:59.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.96369679839416646', time=2024-09-12T20:30:03.634662+0000, chain.objs.size()=1 2024-09-12T18:59:59.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.n_LczovNXUaRAcwxol4Ol933YbXDn5u_0 2024-09-12T18:59:59.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5780462779264222584', time=2024-09-12T20:30:03.871318+0000, chain.objs.size()=1 2024-09-12T18:59:59.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.TZwbFmoMiAdJN8wZ1eLnzNXsFO-f8XT_0 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16316928883814953273', time=2024-09-12T20:30:25.000123+0000, chain.objs.size()=1 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.307__shadow:KKCtxtKs7PRCGPGEyqxVO77cB2A3h-B_.UQaCVBEhgANXoc2-7ZNySzKmREHaN67_0 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18105453786123646604', time=2024-09-12T20:32:27.306437+0000, chain.objs.size()=1 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.m0LKJwRuJewfUdw41-BlH5dl3B3A59d_0 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14062395539209028519', time=2024-09-12T20:32:29.458125+0000, chain.objs.size()=1 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HCJMVYo9ytn9wQvisXZ_8zVMjqYE62J_0 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12382321497153897067', time=2024-09-12T20:32:29.460134+0000, chain.objs.size()=1 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.oZIbbB1FOny3JKCF9F6l0srsJO4J181_0 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12998272026742025153', time=2024-09-12T20:32:30.718643+0000, chain.objs.size()=1 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.NcGrGC6BbAg-c17uW9767DALu7yfGAC_0 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4272678188812884000', time=2024-09-12T20:32:31.046669+0000, chain.objs.size()=1 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Ko0b-yIOd6Xe_Ho3ux-Hp6WYzIAvImZ_0 2024-09-12T18:59:59.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1942244305456640092', time=2024-09-12T20:32:32.311705+0000, chain.objs.size()=1 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BivSHhctkeFc8bo8swETQ_1rM15Qyu9_0 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3687307324789701901', time=2024-09-12T20:32:34.687790+0000, chain.objs.size()=1 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Bd4QOogM3Rdzle6Je8SVFYwqZicQ7BM_0 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4889939331485077464', time=2024-09-12T20:32:34.951805+0000, chain.objs.size()=1 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nRYAYGCbvSfpGp6V7zYGAX-lVghpBEd_0 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2825501464260076097', time=2024-09-12T20:32:35.895906+0000, chain.objs.size()=1 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.84aUEtV3mVOs8JeWQ38wL1y3aaInysI_0 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11209903919883906711', time=2024-09-12T20:32:36.037348+0000, chain.objs.size()=1 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Nlvi5CQVo9klSabKk-vUEqE7G1MIqvy_0 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1655675604370676', time=2024-09-12T20:32:36.212275+0000, chain.objs.size()=1 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.YG3TGgqMzfhP67jvHbckifHpbp77zjI_0 2024-09-12T18:59:59.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14051408186003151994', time=2024-09-12T20:32:37.900797+0000, chain.objs.size()=1 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HhiLV-lJA3U4yaqM9ORcM4n3VkU7JPz_0 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6712471952184541901', time=2024-09-12T20:32:37.953725+0000, chain.objs.size()=1 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.EY1-qfLGeLaepDUYQs32WD15mZHar2j_0 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9600007110973984347', time=2024-09-12T20:32:38.233339+0000, chain.objs.size()=1 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.fuxU0Mv-S91GTLaF8CcJNM9IIBRVcIr_0 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.587653358502309386', time=2024-09-12T20:32:38.793088+0000, chain.objs.size()=1 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jzM2Uw1UOv8JobdqkkFhml6QDiFinJ__0 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11849477452676585209', time=2024-09-12T20:32:39.195071+0000, chain.objs.size()=1 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HlREir4ugmU5VWTtAAzukjOHkDlAGwV_0 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5718957528761361370', time=2024-09-12T20:32:39.527772+0000, chain.objs.size()=1 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Pf9x2fk1OGCcd2gsG88Ravhr9c7_n3o_0 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6060714534768503026', time=2024-09-12T20:32:40.277928+0000, chain.objs.size()=1 2024-09-12T18:59:59.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Uj1cqvRkT76O6LthS4BEQaceMBfBpSN_0 2024-09-12T18:59:59.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8502366311237196456', time=2024-09-12T20:32:41.176653+0000, chain.objs.size()=1 2024-09-12T18:59:59.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.YieO3XdwEd8YtDebugqc3gRG5YYhpBu_0 2024-09-12T18:59:59.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17716361772698613186', time=2024-09-12T20:32:42.316134+0000, chain.objs.size()=1 2024-09-12T18:59:59.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.4bLOIQa-O5EHcvsvRNXbF1lcvoP5w7b_0 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12018990903459632319', time=2024-09-12T20:32:43.534754+0000, chain.objs.size()=1 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Fdpu_xsVkrzfKSs75rW-LePDBMDS5O3_0 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2345401860582056947', time=2024-09-12T20:32:43.968035+0000, chain.objs.size()=1 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.mIXWeB2kCBby1bKVXBltvHZ3RwzqNfS_0 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2438029022661780713', time=2024-09-12T20:32:45.741353+0000, chain.objs.size()=1 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8ibv1-h-dHF1FBHGLJ5yVsqeJhZrSoR_0 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8243739848788429181', time=2024-09-12T20:32:45.898734+0000, chain.objs.size()=1 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jKePhW1O-jSD1sNgSuvst2tjWqbTc-E_0 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5430160918346566555', time=2024-09-12T20:32:45.935894+0000, chain.objs.size()=1 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ehSI68xCthRhLhLAL1Cq-foJB629uZb_0 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13708663153692509161', time=2024-09-12T20:32:47.140543+0000, chain.objs.size()=1 2024-09-12T18:59:59.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Za0OyOjYm_kFByVgFkp0bfQLqYie1TS_0 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5979817365911377657', time=2024-09-12T20:32:47.142722+0000, chain.objs.size()=1 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.lwJRUAov1WZqKC3MmGIdtCKev_6X49Y_0 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1638783380822621409', time=2024-09-12T20:32:48.298783+0000, chain.objs.size()=1 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.DEZxH_OwwlBl75Eb0vn2zT4e-hJ6cjn_0 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7432378103882724345', time=2024-09-12T20:32:48.324950+0000, chain.objs.size()=1 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.vhgNG9Id7EaLTRkWbZwzMgM5v8_eQkp_0 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9413383828290697493', time=2024-09-12T20:32:48.720056+0000, chain.objs.size()=1 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.SI2P-bkJAV6aK6BJeoe7dOmHlGRRNZH_0 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3447186614633234719', time=2024-09-12T20:32:49.097515+0000, chain.objs.size()=1 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.97Fd5_92Q7_w1r5iByztRUGGvtLh2BX_0 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9950580458898925442', time=2024-09-12T20:32:49.445290+0000, chain.objs.size()=1 2024-09-12T18:59:59.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0ZDO5tj8zjFSVKVTK5Qd_YO9pdm4kjz_0 2024-09-12T18:59:59.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11460433916926777813', time=2024-09-12T20:32:49.739669+0000, chain.objs.size()=1 2024-09-12T18:59:59.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.27Y4Msx4K1lyQZKFY3KwPwepUah0kPp_0 2024-09-12T18:59:59.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10515255498127709534', time=2024-09-12T20:32:50.057337+0000, chain.objs.size()=1 2024-09-12T18:59:59.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.z9Bs4rdulEtIStb7updlHzBLdAnM8ZZ_0 2024-09-12T18:59:59.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10765581076749943213', time=2024-09-12T20:32:50.549097+0000, chain.objs.size()=1 2024-09-12T18:59:59.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.PV3lNrKp2lpVJ_mFbPoP2m3fZCiTVJL_0 2024-09-12T18:59:59.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4840864943190174798', time=2024-09-12T20:32:50.931017+0000, chain.objs.size()=1 2024-09-12T18:59:59.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.-axcMRvhQo3ntmDJcgMkS8RxF63nE8q_0 2024-09-12T18:59:59.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16003318388851832843', time=2024-09-12T20:32:51.625150+0000, chain.objs.size()=1 2024-09-12T18:59:59.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8N81C0re6dh3omXsJf6jcK8DQtUT6xL_0 2024-09-12T18:59:59.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6263913866639415138', time=2024-09-12T20:32:52.116554+0000, chain.objs.size()=1 2024-09-12T18:59:59.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.cf_ltdsz2yYBK-VCMEvFaFpBsn4wavC_0 2024-09-12T18:59:59.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3382088441252236605', time=2024-09-12T20:32:52.430748+0000, chain.objs.size()=1 2024-09-12T18:59:59.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.QhOIoYqOtqeFDNsXzpqYc47b4zBESlh_0 2024-09-12T18:59:59.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6306536570862977432', time=2024-09-12T20:32:52.645961+0000, chain.objs.size()=1 2024-09-12T18:59:59.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ix5Oj2B02AWqxuiYpG35LLMpJjuB4mZ_0 2024-09-12T18:59:59.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11262609282617456178', time=2024-09-12T20:32:52.708670+0000, chain.objs.size()=1 2024-09-12T18:59:59.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yq1eo-qLH2BR4gCvJQ9H-gjhvi8Xbvy_0 2024-09-12T18:59:59.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3857975115048815966', time=2024-09-12T20:34:34.358920+0000, chain.objs.size()=1 2024-09-12T18:59:59.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MScSTe5UAMv8VA2JfKZTLwUkpTcUBWV_0 2024-09-12T18:59:59.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6758938162524099853', time=2024-09-12T20:34:34.576696+0000, chain.objs.size()=1 2024-09-12T18:59:59.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PfR8aSuIbE6qMntqzRVVku0OJNsJcJi_0 2024-09-12T18:59:59.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4508023918826817262', time=2024-09-12T20:34:34.863638+0000, chain.objs.size()=1 2024-09-12T18:59:59.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.NBOuQ30cWrq0WDbVhTQe80s0kpOoOjz_0 2024-09-12T18:59:59.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6785432919299611193', time=2024-09-12T20:34:35.209216+0000, chain.objs.size()=1 2024-09-12T18:59:59.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.TmHMvNtYbNqkT4EvMgZmtu6ysMunEZt_0 2024-09-12T18:59:59.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16105832649460258178', time=2024-09-12T20:34:36.396742+0000, chain.objs.size()=1 2024-09-12T18:59:59.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Fd3uWTWXz07YPWvzDqt0N5RrIXFYNZE_0 2024-09-12T18:59:59.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1209717422445413946', time=2024-09-12T20:34:36.758774+0000, chain.objs.size()=1 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ZYSLlpVI86MHpkFnzGc27nld2PThyZr_0 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18368051314067817284', time=2024-09-12T20:34:37.902246+0000, chain.objs.size()=1 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.TYAAO1JBPZkMihmWo8M8mXLFMMx-2Xr_0 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17693207135047877974', time=2024-09-12T20:34:38.371028+0000, chain.objs.size()=1 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BT7viA7H2uNQs04fDjvDMwS44bAx0-7_0 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9140198927690023349', time=2024-09-12T20:34:38.439592+0000, chain.objs.size()=1 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Zbvla7iBJUIpX-_uJ-tIMszdSyRXDH-_0 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11442354836467014731', time=2024-09-12T20:34:39.285234+0000, chain.objs.size()=1 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.mgHwBJe-C-g25OWExPkNs_w0LQt6Inz_0 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12084758059739281246', time=2024-09-12T20:34:39.565204+0000, chain.objs.size()=1 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.b_sW3zw_R0Tc5v98Iq_oIZyM1mMsHdc_0 2024-09-12T18:59:59.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7035820229969866810', time=2024-09-12T20:34:39.592738+0000, chain.objs.size()=1 2024-09-12T18:59:59.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6vvJKeN85K3Tj_L0P5zSNTX8eL-yckQ_0 2024-09-12T18:59:59.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2251775900336593369', time=2024-09-12T20:34:39.747974+0000, chain.objs.size()=1 2024-09-12T18:59:59.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.igQ-WJx0A7864gOi1kLqs3-fNdFnk9h_0 2024-09-12T18:59:59.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2352859341523113458', time=2024-09-12T20:34:39.921523+0000, chain.objs.size()=1 2024-09-12T18:59:59.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ZrIRrSjwUrm-IB0ZWWLyydQ_AWJe0BU_0 2024-09-12T18:59:59.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6952245572580276152', time=2024-09-12T20:34:40.657092+0000, chain.objs.size()=1 2024-09-12T18:59:59.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XVaSlS8sstgQoVztrgbNwPgCb68i1KR_0 2024-09-12T18:59:59.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3948957253126415936', time=2024-09-12T20:34:45.058673+0000, chain.objs.size()=1 2024-09-12T18:59:59.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.DTTE_XKzrENmzkbABadpKvVpQyP8ao8_0 2024-09-12T18:59:59.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.031+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48537 2024-09-12T18:59:59.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T18:59:59.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3355011926603990759', time=2024-09-12T20:34:45.336661+0000, chain.objs.size()=1 2024-09-12T18:59:59.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.irEIqy_b72Oxj1mMd3xzSI2c4FJfSGU_0 2024-09-12T18:59:59.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11951856940451581170', time=2024-09-12T20:34:46.152612+0000, chain.objs.size()=1 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.GO5myyiWUrsjV_LjvPVVe7Qb0KoR_1q_0 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6020625846719624738', time=2024-09-12T20:34:47.823769+0000, chain.objs.size()=1 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.yLmKJgkkQzHgedp19S8QO8uFAYEOoTM_0 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14966967726645029610', time=2024-09-12T20:34:48.685774+0000, chain.objs.size()=1 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._jT1RESRrbgS39cOAYAkRlby5xu6Obh_0 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13672737152604472274', time=2024-09-12T20:34:48.811529+0000, chain.objs.size()=1 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XZvB6ACYFcWZye5qRwKuwdwW0piqd_6_0 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6740895361936989753', time=2024-09-12T20:34:49.172494+0000, chain.objs.size()=1 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.oPJvdg749-u3rYfEGPgzNsKdw-yh7vL_0 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13286342756233650114', time=2024-09-12T20:34:49.174484+0000, chain.objs.size()=1 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.NbAdRvXmrTI-qHIMO8MnoYDzA68FR-B_0 2024-09-12T18:59:59.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18310454379097122815', time=2024-09-12T20:34:51.456464+0000, chain.objs.size()=1 2024-09-12T18:59:59.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.48-2rIyhpd9U1Ill4d-EU-xvd3-8FHd_0 2024-09-12T18:59:59.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13408353763283469152', time=2024-09-12T20:34:52.706810+0000, chain.objs.size()=1 2024-09-12T18:59:59.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.2zfpKNb6vxTNQzOss6V45xi4e2N52jy_0 2024-09-12T18:59:59.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5287373548792843845', time=2024-09-12T20:34:54.810969+0000, chain.objs.size()=1 2024-09-12T18:59:59.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.SnbLzXicgVlyIPAAZ0GD6Lkvbk9c6P3_0 2024-09-12T18:59:59.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16613573843875772388', time=2024-09-12T20:34:54.950111+0000, chain.objs.size()=1 2024-09-12T18:59:59.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6ONw1zmhqQQid-oDDUqs8fH6jZ36hPy_0 2024-09-12T18:59:59.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11459733342148962917', time=2024-09-12T20:34:59.746234+0000, chain.objs.size()=1 2024-09-12T18:59:59.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MGVWjgJudjDUWny2vN82vJ-d8OTjHhD_0 2024-09-12T18:59:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13822121542617693037', time=2024-09-12T20:35:00.281911+0000, chain.objs.size()=1 2024-09-12T18:59:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.y7-LoNuQPcxPwWvy5DbyHobNp0L2co__0 2024-09-12T18:59:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2150611616495503289', time=2024-09-12T20:35:01.044145+0000, chain.objs.size()=1 2024-09-12T18:59:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.s-mHL0F_voU3upYp1Dm8n9izRJvV_FP_0 2024-09-12T18:59:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12969666826781213139', time=2024-09-12T20:35:01.525470+0000, chain.objs.size()=1 2024-09-12T18:59:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.a-CxMYad4nGfzboamoTnc7TTuzK5cHg_0 2024-09-12T18:59:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11040540474155018910', time=2024-09-12T20:37:15.440181+0000, chain.objs.size()=1 2024-09-12T18:59:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.450__shadow_.On5j1GOF2RQTP5ORnwCIqgfeZhFaO1b_0 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17085819931021660514', time=2024-09-12T20:37:39.526046+0000, chain.objs.size()=1 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.465__shadow_.01ogrqZIbKIkRK2KqzZdc518t3HF5_i_0 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17463804765010524107', time=2024-09-12T20:37:40.903503+0000, chain.objs.size()=1 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.466__shadow_.UWHYR-0CqY_YZGB4PNbZI7bsMIOL0Ie_0 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4057574604795131612', time=2024-09-12T20:37:56.862206+0000, chain.objs.size()=1 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.gO5dsQyDA7mSMlELBAV69lZevRLvrKF_0 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3395799325400290739', time=2024-09-12T20:38:05.711685+0000, chain.objs.size()=1 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.487__shadow_.F5bHyIfeDAswdrpXuiAfPmi5eWS2D0m_0 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8695169640659490100', time=2024-09-12T20:38:11.063096+0000, chain.objs.size()=1 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.491__shadow_.H7zCbhg12MyX-5bPu0z5fv6yYhgulg0_0 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3281892053045384473', time=2024-09-12T20:38:38.505018+0000, chain.objs.size()=6 2024-09-12T18:59:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.1 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.2 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.3 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.4 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.5 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.6 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15030020904064499066', time=2024-09-12T20:39:16.980727+0000, chain.objs.size()=6 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.519__multipart_mymultipart.2~Ar5dBl6ikhMElMDTDvUlAYp08ucgFqS.1 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.519__multipart_mymultipart.2~Ar5dBl6ikhMElMDTDvUlAYp08ucgFqS.2 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.519__multipart_mymultipart.2~Ar5dBl6ikhMElMDTDvUlAYp08ucgFqS.3 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.519__multipart_mymultipart.2~Ar5dBl6ikhMElMDTDvUlAYp08ucgFqS.4 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.519__multipart_mymultipart.2~Ar5dBl6ikhMElMDTDvUlAYp08ucgFqS.5 2024-09-12T18:59:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.519__multipart_mymultipart.2~Ar5dBl6ikhMElMDTDvUlAYp08ucgFqS.6 2024-09-12T18:59:59.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6381352057091862029', time=2024-09-12T20:39:34.399255+0000, chain.objs.size()=6 2024-09-12T18:59:59.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__multipart_mymultipart.2~EM43GSVamzXK6a1pmrBN0SjtW-hRylw.1 2024-09-12T18:59:59.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__shadow_mymultipart.2~EM43GSVamzXK6a1pmrBN0SjtW-hRylw.1_1 2024-09-12T18:59:59.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__multipart_mymultipart.2~EM43GSVamzXK6a1pmrBN0SjtW-hRylw.2 2024-09-12T18:59:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__shadow_mymultipart.2~EM43GSVamzXK6a1pmrBN0SjtW-hRylw.2_1 2024-09-12T18:59:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__multipart_mymultipart.2~EM43GSVamzXK6a1pmrBN0SjtW-hRylw.3 2024-09-12T18:59:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__shadow_mymultipart.2~EM43GSVamzXK6a1pmrBN0SjtW-hRylw.3_1 2024-09-12T18:59:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11104656340026238993', time=2024-09-12T20:44:04.718222+0000, chain.objs.size()=1 2024-09-12T18:59:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.570__shadow:faZgIw-4OnIFgPcgyY.0HvfeonqH0QJ_.CFnw8TkUEdU9p4OFBfnbi7WjzQSYF9z_0 2024-09-12T18:59:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16509793840057746658', time=2024-09-12T20:45:34.653208+0000, chain.objs.size()=1 2024-09-12T18:59:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.579__shadow:xwglQgcDShUKEXrdVcaRgzQO4WjFAl7_.-i98BGc3BVfCzL0ZNaj3S-nZe6isIiA_0 2024-09-12T18:59:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18145774795066548144', time=2024-09-12T20:45:34.945094+0000, chain.objs.size()=1 2024-09-12T18:59:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.579__shadow:yVKD0ITYDlTJYihHeW33Jl2JyBadPBH_.2DIVmyj1veqlXiRkTd1EhW2TowyTEb-_0 2024-09-12T18:59:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12055462522135296981', time=2024-09-12T20:45:52.496254+0000, chain.objs.size()=1 2024-09-12T18:59:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.587__shadow:ATTknC09rda1oMAMKBml8KVp9mGS61s_.qUwFd7fcyCVfR4pdGobuJW1AxPz7FNA_0 2024-09-12T18:59:59.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13708918669738925266', time=2024-09-12T20:50:43.310169+0000, chain.objs.size()=1 2024-09-12T18:59:59.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.629__shadow_.D52sxxL9-D6-Ou1wq5Pl9urlk3mgJUW_0 2024-09-12T18:59:59.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14982227396709873186', time=2024-09-12T20:50:45.462824+0000, chain.objs.size()=1 2024-09-12T18:59:59.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.631__shadow_.Y947Iwcyy3xmsvcxfoctkGV26uz4_S-_0 2024-09-12T18:59:59.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11507048966227749095', time=2024-09-12T20:50:56.395938+0000, chain.objs.size()=1 2024-09-12T18:59:59.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.640__shadow_.SKSZbT4XkhYYPpWlHgFAwENNtNktx1G_0 2024-09-12T18:59:59.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2878807369052839267', time=2024-09-12T20:52:14.524407+0000, chain.objs.size()=1 2024-09-12T18:59:59.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.679__shadow_.xpNDV-UE9dRrSWYptQmS79PKWmIKfU__0 2024-09-12T18:59:59.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13737067132860858269', time=2024-09-12T20:52:31.622408+0000, chain.objs.size()=1 2024-09-12T18:59:59.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.696__shadow:r6Ehzz-WTNVJxxKVXUEg4Gk29GhRtD4_.8r-yFOTwnunWPo7s8CVX08mLDZPTH26_0 2024-09-12T18:59:59.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.047+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.047+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:59:59.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47969' 2024-09-12T18:59:59.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7664259060960569835', time=2024-09-12T20:21:59.795177+0000, chain.objs.size()=1 2024-09-12T18:59:59.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.147__shadow_.t6_1CHIKVIb2DSVrYWC269Bb-NMB7ip_0 2024-09-12T18:59:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_d-AhDdDQUiqWmVrNMUCGed_vQY1lWrQ', time=2024-09-12T20:22:36.372360+0000, chain.objs.size()=3 2024-09-12T18:59:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.4ZGa_2iZZrx7N4pzdbgunDAJe5zTdEn_0 2024-09-12T18:59:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.4ZGa_2iZZrx7N4pzdbgunDAJe5zTdEn_1 2024-09-12T18:59:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.4ZGa_2iZZrx7N4pzdbgunDAJe5zTdEn_2 2024-09-12T18:59:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13554483938485051499', time=2024-09-12T20:23:42.157704+0000, chain.objs.size()=1 2024-09-12T18:59:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.197__shadow_.m66-A2HSagQ0ex2GMW1CbwhZK2FbtF2_0 2024-09-12T18:59:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14356915397246437976', time=2024-09-12T20:26:32.407519+0000, chain.objs.size()=1 2024-09-12T18:59:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.236__shadow_._Ctx1p3BROeJ72a7WtbXIlf19Yc7wH8_0 2024-09-12T18:59:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2179485947655603428', time=2024-09-12T20:26:36.444908+0000, chain.objs.size()=1 2024-09-12T18:59:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.238__shadow_.DmMLtvGQDscruAnEZ_RtHhku04vOsUf_0 2024-09-12T18:59:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10531119156990010684', time=2024-09-12T20:26:41.328783+0000, chain.objs.size()=1 2024-09-12T18:59:59.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.242__shadow_.0_WiCG4ClUQQCb57BYfqQdUgTJUV8wD_0 2024-09-12T18:59:59.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6611118254508479509', time=2024-09-12T20:26:45.443949+0000, chain.objs.size()=1 2024-09-12T18:59:59.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.244__shadow_.AsBr3qxUYVbyzU3kRnCwNb1Xwc12mEb_0 2024-09-12T18:59:59.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6706352099883215895', time=2024-09-12T20:26:53.857909+0000, chain.objs.size()=1 2024-09-12T18:59:59.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.250__shadow_.nVgI4hLOFnV3qXVxc18NTf52wD1seYd_0 2024-09-12T18:59:59.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10794308175278985672', time=2024-09-12T20:26:58.085366+0000, chain.objs.size()=1 2024-09-12T18:59:59.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.253__shadow_.KjIPXWBGjAtm_T8XB_2_RTNirTUvC9l_0 2024-09-12T18:59:59.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7217393854317661520', time=2024-09-12T20:27:02.286854+0000, chain.objs.size()=1 2024-09-12T18:59:59.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.256__shadow_.myLcxVU2QVB4stSkO2AhheoEF_BB7y5_0 2024-09-12T18:59:59.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10354733307469359619', time=2024-09-12T20:28:48.387465+0000, chain.objs.size()=1 2024-09-12T18:59:59.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.pJPdFEP16Bb7rV-PwH1meb9cDFSC4ZA_0 2024-09-12T18:59:59.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15995948360571723851', time=2024-09-12T20:28:49.003308+0000, chain.objs.size()=1 2024-09-12T18:59:59.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Muh14aof9e9sJ0fPrWuqvsUCoh-dibO_0 2024-09-12T18:59:59.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18427231263965021562', time=2024-09-12T20:28:51.788031+0000, chain.objs.size()=1 2024-09-12T18:59:59.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fnU17t6As89JtfqP9uA1DENbS8f67Lj_0 2024-09-12T18:59:59.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2231188217222507083', time=2024-09-12T20:28:52.001605+0000, chain.objs.size()=1 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vS9PytPy6LSgPcVBz0wjyzffB2B6ZKo_0 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5345092077386687627', time=2024-09-12T20:28:53.163882+0000, chain.objs.size()=1 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AM13wn9Qp_zTkbyHYirB0MtwJ2CWwgf_0 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13240480317793987177', time=2024-09-12T20:28:53.331345+0000, chain.objs.size()=1 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.40zgyYgxYxLp4ZdjtlxIi-HFvqjUaM8_0 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1046839569820019387', time=2024-09-12T20:28:54.329472+0000, chain.objs.size()=1 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.GLK9_B38u4c-FXPY1fErcMPmH7JxKzh_0 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5177100480717265692', time=2024-09-12T20:28:57.429170+0000, chain.objs.size()=1 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.z3BNc_W8B1Jw99uiYTuTRm9MBQLyE8p_0 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17447782934149857695', time=2024-09-12T20:28:59.093616+0000, chain.objs.size()=1 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.c1Py2uneRgVpBbgh0qoPyS2pCOdJ0Aj_0 2024-09-12T18:59:59.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11002790205792048129', time=2024-09-12T20:28:59.395618+0000, chain.objs.size()=1 2024-09-12T18:59:59.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.4UZG48zXd8sid2g5RltHPTaQ13RdgA-_0 2024-09-12T18:59:59.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9963904037045246508', time=2024-09-12T20:28:59.716206+0000, chain.objs.size()=1 2024-09-12T18:59:59.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.0gwea_Uhq4Ns-fef_MvDjViQHLa_4Hx_0 2024-09-12T18:59:59.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11406040099141959884', time=2024-09-12T20:29:00.161472+0000, chain.objs.size()=1 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2wYL5nJc9oR1w6YCg8LSSzz65OQP-TA_0 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14066746673629638382', time=2024-09-12T20:29:01.391570+0000, chain.objs.size()=1 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2NaYqhLEHmWzG-857voWVpPsFt7jj49_0 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7320563650176917788', time=2024-09-12T20:29:03.208298+0000, chain.objs.size()=1 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.cBHvigi1_EwCikM3kASkvO0wYMso-JG_0 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1225387488436861246', time=2024-09-12T20:29:03.826539+0000, chain.objs.size()=1 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.RwT-gS5z4EdfMq0bBlgLCTHmDhXP2yN_0 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7003876362594584896', time=2024-09-12T20:29:03.827977+0000, chain.objs.size()=1 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.UdYPFP8H7hQ5NmTrwv2jj2NQfGc853y_0 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1127093774893982491', time=2024-09-12T20:29:06.600439+0000, chain.objs.size()=1 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ex-L9Ch-Jg0tkV9_TxfQKTyexxjiLYV_0 2024-09-12T18:59:59.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12482943672423099574', time=2024-09-12T20:29:07.254228+0000, chain.objs.size()=1 2024-09-12T18:59:59.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OjHBHkBvVuM_QaDHDfxC75DhVpa_T39_0 2024-09-12T18:59:59.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13816982561148358811', time=2024-09-12T20:29:07.917133+0000, chain.objs.size()=1 2024-09-12T18:59:59.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.x7-XJePmMy8-yI5d2TyWyyepwItccTA_0 2024-09-12T18:59:59.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12263529784410850212', time=2024-09-12T20:29:08.041274+0000, chain.objs.size()=1 2024-09-12T18:59:59.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HTuPRJugQ1F5wXmNLDVlzuxxis5uMB9_0 2024-09-12T18:59:59.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10254926903197288640', time=2024-09-12T20:29:08.420170+0000, chain.objs.size()=1 2024-09-12T18:59:59.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.d3teOkm3_-SbcpW4GcXw1Gm2YoDRaop_0 2024-09-12T18:59:59.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9937570486686257325', time=2024-09-12T20:29:12.562355+0000, chain.objs.size()=1 2024-09-12T18:59:59.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.yt2QtWn8KUK8ahkUXVVouxLq0Q0IJYA_0 2024-09-12T18:59:59.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14641234398348943946', time=2024-09-12T20:29:13.681115+0000, chain.objs.size()=1 2024-09-12T18:59:59.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.mR9Q5KawbfW0ZW-uUcJaC5BWbV3K38L_0 2024-09-12T18:59:59.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8903196388191513839', time=2024-09-12T20:29:14.739433+0000, chain.objs.size()=1 2024-09-12T18:59:59.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.86sYdYKmz16k9pFiikb5Idl9COAmh3__0 2024-09-12T18:59:59.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10686270122595002623', time=2024-09-12T20:29:14.899638+0000, chain.objs.size()=1 2024-09-12T18:59:59.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ihy6H5r5Bhs86nCCHdz-BDcnkldDq0Q_0 2024-09-12T18:59:59.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14831604888932896226', time=2024-09-12T20:29:18.041912+0000, chain.objs.size()=1 2024-09-12T18:59:59.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.264__shadow_.eZ2-99QMjCAcgEn2hTLH7QgYoej-llW_0 2024-09-12T18:59:59.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4880433328386765275', time=2024-09-12T20:29:24.434012+0000, chain.objs.size()=1 2024-09-12T18:59:59.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.269__shadow_.RfMKBR54moVvaODlW4IlPmYZZSGh_lO_0 2024-09-12T18:59:59.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10991997759727302690', time=2024-09-12T20:29:44.788269+0000, chain.objs.size()=1 2024-09-12T18:59:59.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.284__shadow_.SnsK_dhOVdklx7J9n60H0okOoJqeHTL_0 2024-09-12T18:59:59.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17914233402907848273', time=2024-09-12T20:29:58.862919+0000, chain.objs.size()=1 2024-09-12T18:59:59.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.D2PIXbhRSvuy8FmpBZltgNnxREkZ-se_0 2024-09-12T18:59:59.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12726260797416529483', time=2024-09-12T20:30:06.700378+0000, chain.objs.size()=1 2024-09-12T18:59:59.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.295__shadow_.BY1Xwqo7qgwAGfg3Wo50yf20rDJ-oBs_0 2024-09-12T18:59:59.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8780804281416270903', time=2024-09-12T20:30:15.305333+0000, chain.objs.size()=1 2024-09-12T18:59:59.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.301__shadow_.lI3CHtTAaFqNqyy7UaA2rlMV6vgpoiK_0 2024-09-12T18:59:59.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4192206225045469437', time=2024-09-12T20:30:19.463641+0000, chain.objs.size()=1 2024-09-12T18:59:59.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.304__shadow_.9fkXt6_mTWTJnozbHNtZHK0OqMG-gvC_0 2024-09-12T18:59:59.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12268477060662245581', time=2024-09-12T20:30:36.009491+0000, chain.objs.size()=1 2024-09-12T18:59:59.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.315__shadow_.QJCbpkeTGs9xG_IGGYr-HbIoZlG0Nyj_0 2024-09-12T18:59:59.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3595286765015470204', time=2024-09-12T20:32:26.853679+0000, chain.objs.size()=1 2024-09-12T18:59:59.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IMADaYZZoVVtGoYMsjb1niQXg1jWfnQ_0 2024-09-12T18:59:59.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4407980986707335604', time=2024-09-12T20:32:27.229582+0000, chain.objs.size()=1 2024-09-12T18:59:59.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6urcTtTpLTgTYd-a6xJE54Xj8vv9wC4_0 2024-09-12T18:59:59.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5483311099291480883', time=2024-09-12T20:32:27.795094+0000, chain.objs.size()=1 2024-09-12T18:59:59.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.fIy3-yTNdxd3fDqQL6VhF8j3Zn_fzrH_0 2024-09-12T18:59:59.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8087509360475652354', time=2024-09-12T20:32:27.796778+0000, chain.objs.size()=1 2024-09-12T18:59:59.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._mkbLJNq0xFIrK2C3jLb4TaPWRd4qqq_0 2024-09-12T18:59:59.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8103577371186060078', time=2024-09-12T20:32:28.488298+0000, chain.objs.size()=1 2024-09-12T18:59:59.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.CpgTUpNJmZDHR5s_WCb7iaBHBY_ZebG_0 2024-09-12T18:59:59.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15080511019148123294', time=2024-09-12T20:32:28.826631+0000, chain.objs.size()=1 2024-09-12T18:59:59.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ix0-PYXGysCVEKkFEeefnLyiaVwO9TE_0 2024-09-12T18:59:59.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7093783790512915151', time=2024-09-12T20:32:28.828647+0000, chain.objs.size()=1 2024-09-12T18:59:59.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.-3JJyaQ8Jgu8wtE1oBZ6Zk1awGRY0PC_0 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3558294381774920336', time=2024-09-12T20:32:28.978172+0000, chain.objs.size()=1 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3q4eTVBC9J2vzp4j9GNQZrWsR03XIEH_0 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10750551298756093740', time=2024-09-12T20:32:29.161687+0000, chain.objs.size()=1 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.9KBN19znw-YjY0DSRQ2bV2xbNMRfdr5_0 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17344323655229520221', time=2024-09-12T20:32:30.745814+0000, chain.objs.size()=1 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.P_mAj7J4XgT6MrR3hdOKUo4nDfknM0D_0 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9995500048002133770', time=2024-09-12T20:32:31.095268+0000, chain.objs.size()=1 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.4rKMKX39E9QwAoy_63IM0CJ8BSoSHgg_0 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14263879295245434426', time=2024-09-12T20:32:31.656495+0000, chain.objs.size()=1 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kOWeqNIW4a-cRzWIkVOWCAKFNntBjJu_0 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13587252802519411029', time=2024-09-12T20:32:34.312147+0000, chain.objs.size()=1 2024-09-12T18:59:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sAaA3t4fHnC5veMeuZfaR5kH8Y3ehdo_0 2024-09-12T18:59:59.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574706374625445018', time=2024-09-12T20:32:34.316360+0000, chain.objs.size()=1 2024-09-12T18:59:59.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.xuxP0JiguOGznS3d5MM20qW7_y4b1PG_0 2024-09-12T18:59:59.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17358823256163998989', time=2024-09-12T20:32:34.947304+0000, chain.objs.size()=1 2024-09-12T18:59:59.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.CWt_YG3Vxs05VpZMFHXnOs9TuRgKDye_0 2024-09-12T18:59:59.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15106470749808241055', time=2024-09-12T20:32:36.189214+0000, chain.objs.size()=1 2024-09-12T18:59:59.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6VavRYUxnTZibIxPsgDcfHkoW0wJofG_0 2024-09-12T18:59:59.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13103939365628271675', time=2024-09-12T20:32:37.802174+0000, chain.objs.size()=1 2024-09-12T18:59:59.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.a9lgBHVo0k5oiTDPJILh-7i0RUsZiXN_0 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12351895047156287624', time=2024-09-12T20:32:39.212687+0000, chain.objs.size()=1 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.MiSiXtqaFSMO2AYTVv4WbGH5gp3jLjm_0 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2963709196754987932', time=2024-09-12T20:32:41.391682+0000, chain.objs.size()=1 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6gJicGvuXIRavxVyOuQBgoVLa7ngXz6_0 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.110461564927857034', time=2024-09-12T20:32:42.234767+0000, chain.objs.size()=1 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sC5W9atrlpZ5F_2eddXE0yXbEVRFZgg_0 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17319318037545733054', time=2024-09-12T20:32:42.696953+0000, chain.objs.size()=1 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.r-XazhBslqf-C7BSgZ7-vM4Do0F7eE2_0 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15352953552464633096', time=2024-09-12T20:32:42.910466+0000, chain.objs.size()=1 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.lQrm_CS8Yi0JHWH9GZzdTNuB11c2A1I_0 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5910620975680637655', time=2024-09-12T20:32:43.208392+0000, chain.objs.size()=1 2024-09-12T18:59:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.UK-tu4flrnlCitFMykLYeDY4KWbMCMu_0 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10127092501988696146', time=2024-09-12T20:32:43.210660+0000, chain.objs.size()=1 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.t_SNL58R_36e1hgVI8Mwk1kRacJKPzh_0 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18219077597008741876', time=2024-09-12T20:32:45.123972+0000, chain.objs.size()=1 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dXKdAyTMUHxUK2NxoVwklryRljlBYs4_0 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14651175321829016313', time=2024-09-12T20:32:45.732260+0000, chain.objs.size()=1 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.MWAKAzuX59PCet33rHGSSXbMNOMybrA_0 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11178871552633449706', time=2024-09-12T20:32:46.189110+0000, chain.objs.size()=1 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.vc6KNzCYCZvFFGYRVUIBv6OaYtv9Iqs_0 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5088642136712193448', time=2024-09-12T20:32:46.628355+0000, chain.objs.size()=1 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7xEFYY6emZNFGtU-jcpHJT6H8DjG6M4_0 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14316698095395429518', time=2024-09-12T20:32:47.208061+0000, chain.objs.size()=1 2024-09-12T18:59:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.2dZn_HubVtR0tOKRp_JmYy6tjrkHju6_0 2024-09-12T18:59:59.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3128896965292794135', time=2024-09-12T20:32:47.341541+0000, chain.objs.size()=1 2024-09-12T18:59:59.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.u2ijiZM4ymBddln-4gfm0czpK13t8Qk_0 2024-09-12T18:59:59.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6807711058935388137', time=2024-09-12T20:32:47.388074+0000, chain.objs.size()=1 2024-09-12T18:59:59.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hV_UVHFO8eo0GTSSfEQfTAIcsTTzl4W_0 2024-09-12T18:59:59.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15690636189614580235', time=2024-09-12T20:32:48.645271+0000, chain.objs.size()=1 2024-09-12T18:59:59.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Ilo0k2wP6djcYRjYfdcvYsQWcev22O0_0 2024-09-12T18:59:59.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13710655424222882151', time=2024-09-12T20:32:48.737988+0000, chain.objs.size()=1 2024-09-12T18:59:59.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jwpTLZcEeb5sfOZAEn1AnyUcT_47XWN_0 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11886972864275778956', time=2024-09-12T20:32:49.648010+0000, chain.objs.size()=1 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nMVE3V17P5P7zuV1urY_cp4dPCDWWrl_0 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6091526950727562865', time=2024-09-12T20:32:50.587452+0000, chain.objs.size()=1 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.OEgWzty8TYG-cS5GaVuSbg-zAz-ZR_T_0 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12996677780388129348', time=2024-09-12T20:32:51.645386+0000, chain.objs.size()=1 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.RLdIER9TqskzmYL952l-KTrCLKdeXwG_0 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8833893718163354867', time=2024-09-12T20:32:52.110722+0000, chain.objs.size()=1 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.beMGwgHEJNt9xRLdCc1lTUAg_dEYLAP_0 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.358444536238299856', time=2024-09-12T20:32:52.650981+0000, chain.objs.size()=1 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eYqwEuKxVfGrFJSi6FRC6eIeV2Vypjc_0 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3873021121703571954', time=2024-09-12T20:32:53.351380+0000, chain.objs.size()=1 2024-09-12T18:59:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.seLpgwf_REgLSDMKVxYsIR7T1ogLZRt_0 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6972905703769644846', time=2024-09-12T20:34:34.580152+0000, chain.objs.size()=1 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.48uO_j11SjsTuVMv2PKLDyBofsW5gt9_0 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12960692527615093738', time=2024-09-12T20:34:35.157200+0000, chain.objs.size()=1 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XxXI5L5h4l3dsqaok3mp0-UgNVztokS_0 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7372007687109315487', time=2024-09-12T20:34:37.920879+0000, chain.objs.size()=1 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LppJGd3k7oop2PW7LU2CfNCCMFhfOu6_0 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6245049473181445427', time=2024-09-12T20:34:39.235165+0000, chain.objs.size()=1 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4IcqTO8hE2nxztrYpBvlCO4tyhHQTue_0 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10814150740160844130', time=2024-09-12T20:34:42.432264+0000, chain.objs.size()=1 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bDbP0MWkTzGNUDH64SyVLEPSFZmO_zb_0 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17982354936949270950', time=2024-09-12T20:34:42.781046+0000, chain.objs.size()=1 2024-09-12T18:59:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.e5qeok8lcy4QWA3TpQDM-X4HAFJWJlv_0 2024-09-12T18:59:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9953215568657434423', time=2024-09-12T20:34:42.783121+0000, chain.objs.size()=1 2024-09-12T18:59:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4UFTEOnzLq1gBTTfBxRyATfFuVep0vE_0 2024-09-12T18:59:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14170618532484523475', time=2024-09-12T20:34:43.445515+0000, chain.objs.size()=1 2024-09-12T18:59:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.uoWS9xt-vZCLcX90pnDr-8XH-Onl0Ud_0 2024-09-12T18:59:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3605041364913738932', time=2024-09-12T20:34:43.801640+0000, chain.objs.size()=1 2024-09-12T18:59:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.FCVEBlfIvIpJ5mX106a_WUBrFsm5ysw_0 2024-09-12T18:59:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14582891995103447810', time=2024-09-12T20:34:45.080108+0000, chain.objs.size()=1 2024-09-12T18:59:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vY2PiQQuUtnO4HRU0ESan9t7BOkikn4_0 2024-09-12T18:59:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7806471063602906167', time=2024-09-12T20:34:45.182373+0000, chain.objs.size()=1 2024-09-12T18:59:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RvZGXDfXRFEf1xluvcII5cH7B0LTbOm_0 2024-09-12T18:59:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17787533169703567705', time=2024-09-12T20:34:45.564178+0000, chain.objs.size()=1 2024-09-12T18:59:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.31lX4wou0eThYnbbOnzbj9rDJA5YkMN_0 2024-09-12T18:59:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13061251963658545044', time=2024-09-12T20:34:45.904144+0000, chain.objs.size()=1 2024-09-12T18:59:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ITD-0MEUIJyQoACgkcB9_tgE5xyUHnr_0 2024-09-12T18:59:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.768670629907711774', time=2024-09-12T20:34:46.861759+0000, chain.objs.size()=1 2024-09-12T18:59:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Cxr8h_R0FqWc1gaH6TAgDhvxkEVHZDr_0 2024-09-12T18:59:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6935144195389303063', time=2024-09-12T20:34:47.208471+0000, chain.objs.size()=1 2024-09-12T18:59:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MNMW-59KFZexUFTgk5sD4zDjREc8yQS_0 2024-09-12T18:59:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10116132422038572721', time=2024-09-12T20:34:47.603673+0000, chain.objs.size()=1 2024-09-12T18:59:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.fGYCn3-BNxRRPWArWKYauFq2-XCOg8I_0 2024-09-12T18:59:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.53401221600386381', time=2024-09-12T20:34:47.804058+0000, chain.objs.size()=1 2024-09-12T18:59:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1ud_U_MM4g01II42GRdrYHOpRFNv7bS_0 2024-09-12T18:59:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10155448301984382199', time=2024-09-12T20:34:49.495615+0000, chain.objs.size()=1 2024-09-12T18:59:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RaprX-ZSPR2ml43Ukvdvmk6_9oGVF-M_0 2024-09-12T18:59:59.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47969 2024-09-12T18:59:59.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T18:59:59.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16819761751194771369', time=2024-09-12T20:34:50.168746+0000, chain.objs.size()=1 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MCFdjJ3f5Pf9ZeNpOIlyOk0pU48nGDb_0 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3915207009302474071', time=2024-09-12T20:34:50.301459+0000, chain.objs.size()=1 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.c5tVzTu08bY7uOXjhWHVRRay5i-WdgQ_0 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4920697890280259710', time=2024-09-12T20:34:50.748249+0000, chain.objs.size()=1 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nmTFvm6O9QUdC-9fySx_ldFQ78QEkgK_0 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7620348848610332797', time=2024-09-12T20:34:52.203642+0000, chain.objs.size()=1 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vO68WLoeFORKOMvp6VCukBQg4pnlVHG_0 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.708629854453855222', time=2024-09-12T20:34:53.893084+0000, chain.objs.size()=1 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.C9wFhjx_xcOhZ2UzfhfFiymsuxAIPy0_0 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2490692444711483090', time=2024-09-12T20:34:54.362577+0000, chain.objs.size()=1 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.cpJNLtjE9BnCuJo4d-W3lp3HrA_8-OK_0 2024-09-12T18:59:59.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14857364240620728657', time=2024-09-12T20:34:54.938005+0000, chain.objs.size()=1 2024-09-12T18:59:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3p7x2Pdm6kvJs-YdBEjiJH12CCrhfrz_0 2024-09-12T18:59:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10318893773339562324', time=2024-09-12T20:34:55.807055+0000, chain.objs.size()=1 2024-09-12T18:59:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.TOTJWCYYi3jR6GFeozmU570131QVw8a_0 2024-09-12T18:59:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.617545598434697390', time=2024-09-12T20:35:00.786062+0000, chain.objs.size()=1 2024-09-12T18:59:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nmceiAQhhfIJSKo65DFm3OiREaaoMaM_0 2024-09-12T18:59:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8934594532751645781', time=2024-09-12T20:35:01.048570+0000, chain.objs.size()=1 2024-09-12T18:59:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5u_jG6loPd6aOh9W2eMdPa2ci19_LXQ_0 2024-09-12T18:59:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15318031147058364829', time=2024-09-12T20:35:56.418268+0000, chain.objs.size()=1 2024-09-12T18:59:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.379__shadow_.F9QleIfrXyDUD2dkXxCPPkktpEaNuST_0 2024-09-12T18:59:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7378482819738102166', time=2024-09-12T20:36:30.163119+0000, chain.objs.size()=1 2024-09-12T18:59:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.409__shadow_.5UAtvaaJMBes4t2exf9107kZr3nDNVl_0 2024-09-12T18:59:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18172612286471856925', time=2024-09-12T20:37:19.799991+0000, chain.objs.size()=1 2024-09-12T18:59:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.454__shadow_.y8vZt7AfMc-Lh90eyQRi2ZniT0BSJye_0 2024-09-12T18:59:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14398722010495318051', time=2024-09-12T20:37:37.574756+0000, chain.objs.size()=1 2024-09-12T18:59:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.464__shadow_.aHE_-qsEn1V9s0VrMlhDTbjxCvPLrG__0 2024-09-12T18:59:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4473794041514166500', time=2024-09-12T20:43:06.776814+0000, chain.objs.size()=1 2024-09-12T18:59:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.556__shadow_.lbhHgZObcwvAsiRiMI5xZV3708K0edR_0 2024-09-12T18:59:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.178023623561228727', time=2024-09-12T20:43:21.582738+0000, chain.objs.size()=1 2024-09-12T18:59:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.561__multipart_mymultipart.2~jYP9lX0Xuc3j1K5R6GBqGXtZeCWS5If.1 2024-09-12T18:59:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15114433591293433403', time=2024-09-12T20:43:35.722408+0000, chain.objs.size()=1 2024-09-12T18:59:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.564__shadow_.wuV8XsENcl-4m1hZlRYiR7OMl6_qrx7_0 2024-09-12T18:59:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13022752722300050106', time=2024-09-12T20:43:57.094106+0000, chain.objs.size()=1 2024-09-12T18:59:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:PwI5XXZhCE2g9plwubHxTt4hzijMxTH_.5_8CS9bm1SYanMAnJ7ho8tymIHh0pL3_0 2024-09-12T18:59:59.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7081123435669029952', time=2024-09-12T20:44:48.003240+0000, chain.objs.size()=1 2024-09-12T18:59:59.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:NlJY4HXksoa7gsPfMUUFvtTGCBiYzs0_.dw6ONy7n8gFH3YHC86JiPzUD7nXNC69_0 2024-09-12T18:59:59.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4321821720179871907', time=2024-09-12T20:45:01.022191+0000, chain.objs.size()=1 2024-09-12T18:59:59.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:Rqf1qZ8Wtv8vMF.WW6rGVhUU-Bcnwhe_.8WVTId4RbLiPYB3Q-QKQCTtQqRmzFi5_0 2024-09-12T18:59:59.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2300017567413288978', time=2024-09-12T20:45:34.823021+0000, chain.objs.size()=1 2024-09-12T18:59:59.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.579__shadow:.YQS-L-aLSssE70br0cM85KEeLFAMC9_.MXrj8veRBNTJ7-L-OGKvMxkw-iNVfUJ_0 2024-09-12T18:59:59.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6279977657511432717', time=2024-09-12T20:45:35.137317+0000, chain.objs.size()=1 2024-09-12T18:59:59.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.579__shadow:qzDcnmWi9YBBawVINoxVz9DPN.Prhwx_._DBtN158lMtriBJ43PoHhKB1Ur_lnun_0 2024-09-12T18:59:59.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4328069101795599318', time=2024-09-12T20:53:20.713528+0000, chain.objs.size()=1 2024-09-12T18:59:59.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.719__shadow_.5Ao_C61p-MC2HISD4SQbT98aZBlM4jX_0 2024-09-12T18:59:59.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.083+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.083+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:59:59.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50887' 2024-09-12T18:59:59.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1572547951331676761', time=2024-09-12T20:22:57.621086+0000, chain.objs.size()=1 2024-09-12T18:59:59.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.170__shadow_.7c4tYJMl_Lg41aODCZpq-MrzgCl0_Y2_0 2024-09-12T18:59:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15823210723475855818', time=2024-09-12T20:23:12.807851+0000, chain.objs.size()=1 2024-09-12T18:59:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.177__shadow_.k2c0I7n_1rg3CKgMUuglGfiZnSPJRzJ_0 2024-09-12T18:59:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.352628789328656339', time=2024-09-12T20:26:36.461130+0000, chain.objs.size()=1 2024-09-12T18:59:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.238__shadow_.pJKzBl7q1CALG75dyk7BUwORCU9cdVA_0 2024-09-12T18:59:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13761344099345908018', time=2024-09-12T20:26:48.300046+0000, chain.objs.size()=1 2024-09-12T18:59:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.246__shadow_.vFvHR9RTT41NfrFv7_7fk5bapn3oejv_0 2024-09-12T18:59:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5670954348052489576', time=2024-09-12T20:26:48.305690+0000, chain.objs.size()=1 2024-09-12T18:59:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.246__shadow_.qjCXfXqQM2ZuJ94V4Ze3Nt-oxDnEzsK_0 2024-09-12T18:59:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4909730766528650445', time=2024-09-12T20:27:03.526828+0000, chain.objs.size()=1 2024-09-12T18:59:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.257__shadow_.JyXJnV9WRpsYPP9HlRCZ_b8NV-DEMAt_0 2024-09-12T18:59:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15712062596210639713', time=2024-09-12T20:27:07.538288+0000, chain.objs.size()=1 2024-09-12T18:59:59.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.260__shadow_.3gWkDlhHwsy9E-j55NhV7jhPzugKBm-_0 2024-09-12T18:59:59.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8285629426422310005', time=2024-09-12T20:28:48.615687+0000, chain.objs.size()=1 2024-09-12T18:59:59.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1j3w5qUKlyT4GObawLuhF8C8-b7GM2h_0 2024-09-12T18:59:59.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9642840847919579304', time=2024-09-12T20:28:48.970412+0000, chain.objs.size()=1 2024-09-12T18:59:59.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.jYqzg6GYCrJw-a8xz0C5Vgmy40mjywB_0 2024-09-12T18:59:59.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16985520091275469207', time=2024-09-12T20:28:50.437421+0000, chain.objs.size()=1 2024-09-12T18:59:59.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.lyGhmRhnlZgImkmFDLjFzp9wFIr0iFa_0 2024-09-12T18:59:59.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4235738492348448034', time=2024-09-12T20:28:51.648908+0000, chain.objs.size()=1 2024-09-12T18:59:59.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JlGfgYpMOBl26elq-9_I6_XCumw1Tpf_0 2024-09-12T18:59:59.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12631687712161209373', time=2024-09-12T20:28:52.556184+0000, chain.objs.size()=1 2024-09-12T18:59:59.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.087+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Zlft2GqazjJCoQOHxmCgQI9bW1Sztce_0 2024-09-12T18:59:59.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15549610172015003072', time=2024-09-12T20:28:52.698559+0000, chain.objs.size()=1 2024-09-12T18:59:59.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1V-FteVMDucOzBJHpZtd3HVljMn_V3L_0 2024-09-12T18:59:59.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3205383954204354406', time=2024-09-12T20:28:53.227246+0000, chain.objs.size()=1 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.0fWLxJKrSUMdzwTtz3Nl9cDNqBkdzza_0 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2781597509726159101', time=2024-09-12T20:28:54.383965+0000, chain.objs.size()=1 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.jG4LsRjzqplr4s2SqhdaewDPbtctC5g_0 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1808649556407590122', time=2024-09-12T20:28:54.414638+0000, chain.objs.size()=1 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DH6UQ1I73vNRF6rkV_owWG3xBPcCTOi_0 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14930493103616231201', time=2024-09-12T20:28:55.372521+0000, chain.objs.size()=1 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gCL8FlVWuY_b_JiKc7SLhQPOsY9BnVO_0 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15507713275699578424', time=2024-09-12T20:28:59.384722+0000, chain.objs.size()=1 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.oGzYL3Ao_IZYSWIl54dOzh93CQg7K1V_0 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1201944898892884623', time=2024-09-12T20:28:59.581775+0000, chain.objs.size()=1 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.x0yC2145LohfiR85aLyPdSslLuCP2fN_0 2024-09-12T18:59:59.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18126686614881355403', time=2024-09-12T20:29:00.296954+0000, chain.objs.size()=1 2024-09-12T18:59:59.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.0ktJAFd8Vi77ouncNfUCNBunHOORVe8_0 2024-09-12T18:59:59.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8638779860791020474', time=2024-09-12T20:29:02.520723+0000, chain.objs.size()=1 2024-09-12T18:59:59.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.eNp5mbhuAUpcAsw_sb6uV3v4ygmR2_-_0 2024-09-12T18:59:59.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14065088719527303879', time=2024-09-12T20:29:04.074036+0000, chain.objs.size()=1 2024-09-12T18:59:59.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Ag6ARaIiAGUaHBasFQRisnMjudT_WOP_0 2024-09-12T18:59:59.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17605072597603627235', time=2024-09-12T20:29:04.217169+0000, chain.objs.size()=1 2024-09-12T18:59:59.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.b2LP-A1C6FRt7eYt8x6REDtI6l9gw6Z_0 2024-09-12T18:59:59.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11344688044878931137', time=2024-09-12T20:29:04.310742+0000, chain.objs.size()=1 2024-09-12T18:59:59.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.17t41RiN7U55xy7_t_bD5_oo4SECM4n_0 2024-09-12T18:59:59.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10939135204255577723', time=2024-09-12T20:29:04.808798+0000, chain.objs.size()=1 2024-09-12T18:59:59.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ssSLsuh3pURQ_KLQgHzTbcSP7k8MKKB_0 2024-09-12T18:59:59.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7875109103715815751', time=2024-09-12T20:29:04.869532+0000, chain.objs.size()=1 2024-09-12T18:59:59.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.091+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NV-K6E5qUtDudOo8kjSfgRJ--7IwGUO_0 2024-09-12T18:59:59.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14010375085237489313', time=2024-09-12T20:29:05.265428+0000, chain.objs.size()=1 2024-09-12T18:59:59.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SqVHnxrQR_uqMSygScnyYfQ_sdw-hrh_0 2024-09-12T18:59:59.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16137409592760623253', time=2024-09-12T20:29:07.205757+0000, chain.objs.size()=1 2024-09-12T18:59:59.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5R_rD0Pt80-YC_ZLDXlwhHvaRgGU0i5_0 2024-09-12T18:59:59.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13702767586338511281', time=2024-09-12T20:29:13.637532+0000, chain.objs.size()=1 2024-09-12T18:59:59.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.pzvMEPZJPxgAhIPnCV2FU8B6Rfmk2w5_0 2024-09-12T18:59:59.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.145813872007343624', time=2024-09-12T20:29:15.040298+0000, chain.objs.size()=1 2024-09-12T18:59:59.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.reSBpLzU-S-bmDoh73GVJUc0Z_taRdx_0 2024-09-12T18:59:59.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10399411478866642593', time=2024-09-12T20:29:15.101097+0000, chain.objs.size()=1 2024-09-12T18:59:59.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HSQ1sIUd3BaVFNvso86bDBfVj6Dyjsf_0 2024-09-12T18:59:59.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13766039804509219443', time=2024-09-12T20:29:15.412320+0000, chain.objs.size()=1 2024-09-12T18:59:59.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FszXbscTUuzUiMPGdmG_b5lsUb71zM8_0 2024-09-12T18:59:59.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15241036647954715268', time=2024-09-12T20:29:28.207788+0000, chain.objs.size()=1 2024-09-12T18:59:59.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.272__shadow_.5AkzkgR9Fpt5bsMfHVlRuozt3CSIg_i_0 2024-09-12T18:59:59.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11900385351088371481', time=2024-09-12T20:29:53.278544+0000, chain.objs.size()=1 2024-09-12T18:59:59.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.290__shadow_.c69kRGnxHzBXka6w4UlNVFclaMe9Its_0 2024-09-12T18:59:59.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6299746150807683105', time=2024-09-12T20:29:59.036374+0000, chain.objs.size()=1 2024-09-12T18:59:59.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.Hy7eMMWeo8IIsNeXsXIEGuOaWF6pFjV_0 2024-09-12T18:59:59.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12391969553112174300', time=2024-09-12T20:30:09.506152+0000, chain.objs.size()=1 2024-09-12T18:59:59.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.297__shadow_.8rIgarRqQcrTi27uDv3_ZW1aKsVX7Jx_0 2024-09-12T18:59:59.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5877120170476829905', time=2024-09-12T20:30:16.658015+0000, chain.objs.size()=1 2024-09-12T18:59:59.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.302__shadow_.39S_J9SkujjCH5DIwGxh2ebFSDmr4HC_0 2024-09-12T18:59:59.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14839765704189866544', time=2024-09-12T20:30:44.048883+0000, chain.objs.size()=1 2024-09-12T18:59:59.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.321__shadow_.2HluUUbND2BUmLCp9tlvKVNMzQbZJay_0 2024-09-12T18:59:59.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4877378315717147139', time=2024-09-12T20:32:27.185331+0000, chain.objs.size()=1 2024-09-12T18:59:59.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.LJbVe7ZS0a2kr70Rxqjv9rCtEqgvDlP_0 2024-09-12T18:59:59.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5306749330828720964', time=2024-09-12T20:32:27.562292+0000, chain.objs.size()=1 2024-09-12T18:59:59.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8PjEyeU8majcovkV4uhNf8DEAfuHZ7n_0 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17650543761460736766', time=2024-09-12T20:32:28.459078+0000, chain.objs.size()=1 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IIaGRyCIfRQ_dIJxT2qpBsN_jddvIJ0_0 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4631456901891709705', time=2024-09-12T20:32:29.280238+0000, chain.objs.size()=1 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0eaCGY5CC6BgwZei95UxFkSbnzsEO_k_0 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9647950846722816648', time=2024-09-12T20:32:29.573608+0000, chain.objs.size()=1 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ibqkKVxscx-3y41nMaln8yw_bbfDaPu_0 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13619724171168516016', time=2024-09-12T20:32:30.682410+0000, chain.objs.size()=1 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ZMhRN2DP7lJoqYDwmdjBi2WKDD5brFC_0 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10099521031436009248', time=2024-09-12T20:32:31.007995+0000, chain.objs.size()=1 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tIrCVc-9QnoWhPKQ9Old6b5DWniwyTu_0 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9150343741305621701', time=2024-09-12T20:32:31.844289+0000, chain.objs.size()=1 2024-09-12T18:59:59.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.T3z6HnK7zb6I4Wxbq_rZp2PMb5hQuIv_0 2024-09-12T18:59:59.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8366381505853829788', time=2024-09-12T20:32:33.017336+0000, chain.objs.size()=1 2024-09-12T18:59:59.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.095+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.-do0CUQdLkqMAiQIMpOp6W4MCjs_3Gd_0 2024-09-12T18:59:59.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17457807234335017787', time=2024-09-12T20:32:34.776723+0000, chain.objs.size()=1 2024-09-12T18:59:59.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.msoIa4bkOHtmORuaBNoj3xQeEJ2lOr2_0 2024-09-12T18:59:59.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1583845777268062114', time=2024-09-12T20:32:36.055204+0000, chain.objs.size()=1 2024-09-12T18:59:59.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uBss2aPniKIgg2GODdAHBL0oL1gBqfB_0 2024-09-12T18:59:59.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6639053649077967211', time=2024-09-12T20:32:36.667323+0000, chain.objs.size()=1 2024-09-12T18:59:59.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gjNr3K5gPaLKgSluP8410scOxrOo5jI_0 2024-09-12T18:59:59.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5513490036976862552', time=2024-09-12T20:32:36.924045+0000, chain.objs.size()=1 2024-09-12T18:59:59.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.a3i_wL5fTJPHT-rxxRMi2_E_ksq7Xyd_0 2024-09-12T18:59:59.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14984895255850307223', time=2024-09-12T20:32:37.956769+0000, chain.objs.size()=1 2024-09-12T18:59:59.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.r8cBaVuoNMBeeD2A_UUkMir7Wlqdpzw_0 2024-09-12T18:59:59.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13351683090355730320', time=2024-09-12T20:32:38.204645+0000, chain.objs.size()=1 2024-09-12T18:59:59.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.xBJOIqP1QF5qqA0AjZfCW9jQ2v7hndN_0 2024-09-12T18:59:59.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3516165012092957079', time=2024-09-12T20:32:38.235599+0000, chain.objs.size()=1 2024-09-12T18:59:59.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yw_xj20tVOjT7m3TzOyb6W800Uvpdiz_0 2024-09-12T18:59:59.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15817431587153935045', time=2024-09-12T20:32:38.640728+0000, chain.objs.size()=1 2024-09-12T18:59:59.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.AOgJBSxKjw4JV98sYpghCtjI3Vs7NeR_0 2024-09-12T18:59:59.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6421182441638736218', time=2024-09-12T20:32:38.778528+0000, chain.objs.size()=1 2024-09-12T18:59:59.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.TOAg5ddCfYbJ2PZHfuJdRXwSXfpK0Jq_0 2024-09-12T18:59:59.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5630735029698538945', time=2024-09-12T20:32:39.144929+0000, chain.objs.size()=1 2024-09-12T18:59:59.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gzFZ0RJguOvVf3RaINWNakxlxOolH50_0 2024-09-12T18:59:59.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12010991133556650183', time=2024-09-12T20:32:41.372173+0000, chain.objs.size()=1 2024-09-12T18:59:59.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.31EbTaogL04HIZ9F04GqrlprrDcsWTE_0 2024-09-12T18:59:59.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15484244828102647228', time=2024-09-12T20:32:41.384340+0000, chain.objs.size()=1 2024-09-12T18:59:59.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Nwv4bWAxXvs_SaJJCf4ighAn0F_aUxo_0 2024-09-12T18:59:59.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1709612412567839597', time=2024-09-12T20:32:41.780327+0000, chain.objs.size()=1 2024-09-12T18:59:59.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1lc0vBbbvYsd-q4WCvwcDW27SGaQ_KA_0 2024-09-12T18:59:59.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14641865984674706217', time=2024-09-12T20:32:42.725546+0000, chain.objs.size()=1 2024-09-12T18:59:59.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zyeofRA-eCWtFlp0BTNj7gkhxx0dUP4_0 2024-09-12T18:59:59.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7386604357211787114', time=2024-09-12T20:32:42.993545+0000, chain.objs.size()=1 2024-09-12T18:59:59.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.099+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BnR75XPMcLgtSZizlKOC_H3_UKzv5Gi_0 2024-09-12T18:59:59.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1932857800021051894', time=2024-09-12T20:32:43.755910+0000, chain.objs.size()=1 2024-09-12T18:59:59.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.H6YVz-eSfcAnyYZbL1t7l-5VZ7jDxdd_0 2024-09-12T18:59:59.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3437664872504102493', time=2024-09-12T20:32:45.164331+0000, chain.objs.size()=1 2024-09-12T18:59:59.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0k-B6NOsZAsRbNgL34E5uMOsdm9a2i3_0 2024-09-12T18:59:59.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7534087812036401430', time=2024-09-12T20:32:50.547556+0000, chain.objs.size()=1 2024-09-12T18:59:59.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._4KgD5gJet-wb631Ls8M2gzb3O5-XnI_0 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16144080841573296057', time=2024-09-12T20:32:53.046081+0000, chain.objs.size()=1 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.CIOPzkPxZvX-XPNsHSiNAKb7ndTJXin_0 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3258385047077802856', time=2024-09-12T20:32:53.128234+0000, chain.objs.size()=1 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.NIrc8d1b-87VONYhuBOrYT3HsaLATfi_0 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15692924888222499433', time=2024-09-12T20:32:53.432713+0000, chain.objs.size()=1 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.JjUrlGRs3KSbBUvUfKpniFnvW12OujH_0 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.420282078076272378', time=2024-09-12T20:34:34.378532+0000, chain.objs.size()=1 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.j03DuyVeLaiw9gEGYf3NWO29CiRBD3c_0 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10581102152726628068', time=2024-09-12T20:34:35.601275+0000, chain.objs.size()=1 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PBqzR19rgGAiwOS_gkqMD1X7wVAM4ts_0 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14363305546839798086', time=2024-09-12T20:34:36.396047+0000, chain.objs.size()=1 2024-09-12T18:59:59.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wnG3bVOz7_iOIhB-zdG9RT8QeKduzKm_0 2024-09-12T18:59:59.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7246870305949808317', time=2024-09-12T20:34:38.193002+0000, chain.objs.size()=1 2024-09-12T18:59:59.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.FvezVQ0EBOyRLZGGL6RcVonJadjtvoP_0 2024-09-12T18:59:59.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17472841051777219353', time=2024-09-12T20:34:38.665053+0000, chain.objs.size()=1 2024-09-12T18:59:59.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.e0PipBhcWR3x4v-irpkJ9tx6B4YpGxS_0 2024-09-12T18:59:59.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17180306626628740534', time=2024-09-12T20:34:39.554843+0000, chain.objs.size()=1 2024-09-12T18:59:59.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.inFf1Ki_Gx-7Nxr2962lxJAKbicFJ38_0 2024-09-12T18:59:59.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6642605108017340781', time=2024-09-12T20:34:40.415189+0000, chain.objs.size()=1 2024-09-12T18:59:59.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qh2kSBRRNCeA48B5vZbEiVeKiOMAict_0 2024-09-12T18:59:59.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17020966508267307616', time=2024-09-12T20:34:41.504518+0000, chain.objs.size()=1 2024-09-12T18:59:59.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bfkZL9YDpmVhzWmZuFxbyyJc_y1H5Xh_0 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14488299990369136770', time=2024-09-12T20:34:43.443842+0000, chain.objs.size()=1 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.IDJ_HpAnwL0GUdbnGLFYUm0zsWWnU21_0 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3171101905515698462', time=2024-09-12T20:34:43.550009+0000, chain.objs.size()=1 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ZvUgwtMg1uNFjLkwBaz7vdo_VM9jbHS_0 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4456425083619249158', time=2024-09-12T20:34:43.807350+0000, chain.objs.size()=1 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.I4F5XyMSmyg_pa107UfoqTzv2qdowT4_0 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8416958004143192747', time=2024-09-12T20:34:45.517137+0000, chain.objs.size()=1 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.R4rnc4B6RpLnL8NrsxYNDZQkJ16pvDW_0 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10205200402767293929', time=2024-09-12T20:34:45.792458+0000, chain.objs.size()=1 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.KDJhJcph4PYY8qLqxaTNIJPBjFxS0am_0 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2937615887271675859', time=2024-09-12T20:34:45.892552+0000, chain.objs.size()=1 2024-09-12T18:59:59.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.103+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.SceWu_BDa0n5IDbhXw_INOaiEDKMywH_0 2024-09-12T18:59:59.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9968235210449145736', time=2024-09-12T20:34:46.432830+0000, chain.objs.size()=1 2024-09-12T18:59:59.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QwD8A6TJsZ_hFqevH_mf-zg8zf0RbQC_0 2024-09-12T18:59:59.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6110498682700674875', time=2024-09-12T20:34:50.299196+0000, chain.objs.size()=1 2024-09-12T18:59:59.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.NM9w1s6a1_U2M9kPQZkw4oNBEBzBxaq_0 2024-09-12T18:59:59.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13409961225355152719', time=2024-09-12T20:34:50.670685+0000, chain.objs.size()=1 2024-09-12T18:59:59.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kQV7uoSk7y783WunlgMzeuJ2i5fox5y_0 2024-09-12T18:59:59.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1933452208818971829', time=2024-09-12T20:34:51.303422+0000, chain.objs.size()=1 2024-09-12T18:59:59.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kzknAka_6W_iOUX14OGqPC0mOgyjcIy_0 2024-09-12T18:59:59.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15712315320506466918', time=2024-09-12T20:34:52.202032+0000, chain.objs.size()=1 2024-09-12T18:59:59.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vxcXvdygh7nXMMUeKOoj2fN9o5bamYu_0 2024-09-12T18:59:59.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4367358848808396239', time=2024-09-12T20:34:53.724534+0000, chain.objs.size()=1 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.A41swAWSN3TG9LzysZIOisqmh9iXcmz_0 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1032412404075820309', time=2024-09-12T20:34:54.132697+0000, chain.objs.size()=1 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.CaSeTSFksulBpKpwPMbmZyps6JR5EG1_0 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8410921438351952246', time=2024-09-12T20:34:54.946405+0000, chain.objs.size()=1 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5VPmkX5V_2X8Ob9y_aWL6ZsFpnl4b9E_0 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18147073195315503698', time=2024-09-12T20:34:55.712492+0000, chain.objs.size()=1 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tkDrV3NeFjwu0Hf-3PfejPN3sPxnJxO_0 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3386582131047934320', time=2024-09-12T20:34:56.176343+0000, chain.objs.size()=1 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.OsGCh-yiYVQrIjkwaB9kBO3MdMgAbLp_0 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8167199153038023027', time=2024-09-12T20:34:56.201035+0000, chain.objs.size()=1 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hW4EiO2i2UEdMpoa25Eq67dsUNS4g2p_0 2024-09-12T18:59:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16611343898732730011', time=2024-09-12T20:34:57.783117+0000, chain.objs.size()=1 2024-09-12T18:59:59.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.cgLExODbzc9JXH9w0IH8iNeJDjIKatn_0 2024-09-12T18:59:59.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8975691285430735382', time=2024-09-12T20:34:58.283115+0000, chain.objs.size()=1 2024-09-12T18:59:59.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.iOT4YFPG3wGs7JoDEhU85X3BNx-UUMV_0 2024-09-12T18:59:59.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.690350437971815870', time=2024-09-12T20:35:00.032351+0000, chain.objs.size()=1 2024-09-12T18:59:59.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.WB74a6aKoLPvHFZXwef0chhAvl8RnA6_0 2024-09-12T18:59:59.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1832215234235048152', time=2024-09-12T20:35:01.135362+0000, chain.objs.size()=1 2024-09-12T18:59:59.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HMpogIRDiL4BgqDsEb4pcLxkAMsxZ1h_0 2024-09-12T18:59:59.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5338824814211783148', time=2024-09-12T20:35:01.532918+0000, chain.objs.size()=1 2024-09-12T18:59:59.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.taobiH7MwCkXITiPfIWlQ6AOefs26Ot_0 2024-09-12T18:59:59.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7617277922962357931', time=2024-09-12T20:35:23.855227+0000, chain.objs.size()=1 2024-09-12T18:59:59.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.107+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.345__shadow_.rLLNLzLp5T_h3klLwd83VaJj40mHXGe_0 2024-09-12T18:59:59.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.111+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12012403164497092132', time=2024-09-12T20:36:54.662490+0000, chain.objs.size()=1 2024-09-12T18:59:59.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.111+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.433__shadow_.ZKFHAAC1x4ul3gpESg33F3gedDlB4oI_0 2024-09-12T18:59:59.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.111+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50887 2024-09-12T18:59:59.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:59:59.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3729030408860945282', time=2024-09-12T20:37:58.458139+0000, chain.objs.size()=1 2024-09-12T18:59:59.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.484__shadow_.ywQ1ZgwPzD6fNRpJmliXRlaB1nZKYRP_0 2024-09-12T18:59:59.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16092422956545755006', time=2024-09-12T20:38:57.092648+0000, chain.objs.size()=1 2024-09-12T18:59:59.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.518__multipart_mymultipart.2~11CbxhlK_3IK8zXh9UnilxtOEcjE9OM.1 2024-09-12T18:59:59.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7044314657274727031', time=2024-09-12T20:40:16.433187+0000, chain.objs.size()=6 2024-09-12T18:59:59.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~c8dcvzc2iSySBCBurijubxw9FnnvMKT.1 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.b4gVFQzpEB433FDPSCqswID7c_WoSYsG.2 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~c8dcvzc2iSySBCBurijubxw9FnnvMKT.3 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~c8dcvzc2iSySBCBurijubxw9FnnvMKT.4 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~c8dcvzc2iSySBCBurijubxw9FnnvMKT.5 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~c8dcvzc2iSySBCBurijubxw9FnnvMKT.6 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.730874475902561742', time=2024-09-12T20:41:05.029720+0000, chain.objs.size()=1 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~cwQxzXOegfe5LBoxdWhrxNuShMZHztQ.1 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~_wuzBkVYwtzenO6xqgeEDZLayhBZpsE', time=2024-09-12T20:41:51.544643+0000, chain.objs.size()=1 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.531__multipart_mymultipart2.2~_wuzBkVYwtzenO6xqgeEDZLayhBZpsE.1 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2160895800743017694', time=2024-09-12T20:44:26.086970+0000, chain.objs.size()=1 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.576__shadow:9bAlN-X.zzZmvvZN11Y8akc7xSP46K0_.fFW-eO0FBsmb2qX42YH30LxN0MorB-c_0 2024-09-12T18:59:59.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18071256722617917682', time=2024-09-12T20:44:39.293730+0000, chain.objs.size()=1 2024-09-12T18:59:59.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:Ucn9qPGk4K.0feQP4jM57WyPAwlTfMS_.nw8vQg4-ti7Xggj0N7gaXNzYkyMlyaE_0 2024-09-12T18:59:59.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13425683441247617477', time=2024-09-12T20:44:50.202908+0000, chain.objs.size()=1 2024-09-12T18:59:59.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:mwxGFF0THaAP0rsYIxvYKBrm3Y10HcV_.fLsRt0lSokGMH8n2VRA1j5y-yZO_c4F_0 2024-09-12T18:59:59.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16371195200202858880', time=2024-09-12T20:45:27.846905+0000, chain.objs.size()=4 2024-09-12T18:59:59.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~2FNx0mFfMvC2yKxMkwUZl02LKhMCL2e.1 2024-09-12T18:59:59.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~2FNx0mFfMvC2yKxMkwUZl02LKhMCL2e.2 2024-09-12T18:59:59.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~2FNx0mFfMvC2yKxMkwUZl02LKhMCL2e.3 2024-09-12T18:59:59.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~2FNx0mFfMvC2yKxMkwUZl02LKhMCL2e.4 2024-09-12T18:59:59.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14297235273018691856', time=2024-09-12T20:45:51.408744+0000, chain.objs.size()=1 2024-09-12T18:59:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.587__shadow:nJy9wKh99zUzR5T6SN4NMn2WtItPbFb_.HcOHx2OFmY1_HGQjnrS51NLvotfyD70_0 2024-09-12T18:59:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3026001089558836182', time=2024-09-12T20:45:52.138724+0000, chain.objs.size()=1 2024-09-12T18:59:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.587__shadow:LsiKlWm8Sxg0jijvwfzU2.zBfFCOjRC_.USOfSQrSKEaMfiH4Fy8s0MBcK4A6mIC_0 2024-09-12T18:59:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8269157552481676583', time=2024-09-12T20:45:52.730886+0000, chain.objs.size()=1 2024-09-12T18:59:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.587__shadow:inJ3CE8kmP5VJGX3SsiiJAybYit0Siz_.zXzKKA0N8M04G1Ij678wEMAE0MLkrX-_0 2024-09-12T18:59:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2727404485381197125', time=2024-09-12T20:50:39.665139+0000, chain.objs.size()=1 2024-09-12T18:59:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.626__shadow_.NM5YbHiWQkaRYk_qwqoEAbEXwyNx501_0 2024-09-12T18:59:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8685552933912825761', time=2024-09-12T20:51:04.558288+0000, chain.objs.size()=1 2024-09-12T18:59:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.644__shadow_.7y7FOGO8hNTr4SEtg6nCyNawC_mUwdu_0 2024-09-12T18:59:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18220374043032302006', time=2024-09-12T20:51:59.281596+0000, chain.objs.size()=1 2024-09-12T18:59:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.115+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.665__shadow_.WaG6yVhBuiWtpMTqL0z6rZqM4bhYEHn_0 2024-09-12T18:59:59.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.119+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3093730653227541875', time=2024-09-12T20:52:24.387154+0000, chain.objs.size()=1 2024-09-12T18:59:59.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.119+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.690__shadow:fTuuN023-tQWSMwFo4u4tSrIf2pVmRd_.I-Av8zTg4jLayd3kt7CaDrUuHCMGmlp_0 2024-09-12T18:59:59.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.119+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:59:59.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54098' 2024-09-12T18:59:59.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_KBxERhrnyWNoiVTiwXeq7ptm3rZayPg', time=2024-09-12T20:22:25.851191+0000, chain.objs.size()=1 2024-09-12T18:59:59.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.YzQJDVAwDjzNKx5dnMxyYdVrNNrdvbp_0 2024-09-12T18:59:59.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_fZEDTfE1bEdU7YIsSY3ZB64EYg0XaID', time=2024-09-12T20:22:45.431480+0000, chain.objs.size()=3 2024-09-12T18:59:59.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.Cg0OuIV7VVz7iyizXXGM2UkPWb9DDnD_0 2024-09-12T18:59:59.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.Cg0OuIV7VVz7iyizXXGM2UkPWb9DDnD_1 2024-09-12T18:59:59.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.Cg0OuIV7VVz7iyizXXGM2UkPWb9DDnD_2 2024-09-12T18:59:59.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14765699457246579082', time=2024-09-12T20:22:52.567640+0000, chain.objs.size()=2 2024-09-12T18:59:59.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.164__multipart_foo.2~qUQQ_L87U68_XiJRt4oLyjR4Zq-eRwF.1 2024-09-12T18:59:59.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.164__multipart_foo.2~qUQQ_L87U68_XiJRt4oLyjR4Zq-eRwF.2 2024-09-12T18:59:59.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8119558713073202434', time=2024-09-12T20:26:22.329006+0000, chain.objs.size()=1 2024-09-12T18:59:59.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.228__shadow_.hgHJNtARX-1szZa5luzzQJdEUWgbSEG_0 2024-09-12T18:59:59.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9623158701321559946', time=2024-09-12T20:26:30.952297+0000, chain.objs.size()=1 2024-09-12T18:59:59.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.235__shadow_.yxQ4C9lKvcwXuEBsGvfh26WANm_TTtW_0 2024-09-12T18:59:59.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6031611752510195941', time=2024-09-12T20:26:45.458453+0000, chain.objs.size()=1 2024-09-12T18:59:59.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.244__shadow_.tJHf-owaqD7Aja6FeL7CDwTiDkGUbZn_0 2024-09-12T18:59:59.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4322222847494520483', time=2024-09-12T20:28:47.861424+0000, chain.objs.size()=1 2024-09-12T18:59:59.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.UMvW7YeZD57gYu1w7IAwqoFbwm7DVgB_0 2024-09-12T18:59:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.833405852089614293', time=2024-09-12T20:28:48.542760+0000, chain.objs.size()=1 2024-09-12T18:59:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.KRq2IpYqveuPWI9NWMjopId4ar1gKfv_0 2024-09-12T18:59:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7826805668083590503', time=2024-09-12T20:28:49.340442+0000, chain.objs.size()=1 2024-09-12T18:59:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.123+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.H77qNnWxr92qSnuxrZ78OTYhWNbF58i_0 2024-09-12T18:59:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15183006145527529205', time=2024-09-12T20:28:49.578504+0000, chain.objs.size()=1 2024-09-12T18:59:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.N2njziFiI0uSGLwQydGLzzfYBGzN9Eg_0 2024-09-12T18:59:59.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4492641441801051622', time=2024-09-12T20:28:49.803846+0000, chain.objs.size()=1 2024-09-12T18:59:59.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SbWDz3PhmvBv6Y8kOuK_qgH4N6Y2Q3C_0 2024-09-12T18:59:59.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2764325505034193350', time=2024-09-12T20:28:50.290420+0000, chain.objs.size()=1 2024-09-12T18:59:59.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CbH3gHe8I-voH6PPeT_mKcgXx-GlFa1_0 2024-09-12T18:59:59.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5478077462444662970', time=2024-09-12T20:28:50.377592+0000, chain.objs.size()=1 2024-09-12T18:59:59.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.siYrXyW4Sy63qXvdEnyGnnQxy4Z_q2a_0 2024-09-12T18:59:59.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17047274393848382996', time=2024-09-12T20:28:51.618208+0000, chain.objs.size()=1 2024-09-12T18:59:59.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tI1sywxFHuy1KmOTxlGo3j24E3uH_v4_0 2024-09-12T18:59:59.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13773708567282361165', time=2024-09-12T20:28:51.643479+0000, chain.objs.size()=1 2024-09-12T18:59:59.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.nkBlAgOgYZFF3pvKlc-49rDk0BE2mQ__0 2024-09-12T18:59:59.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12389719614739931299', time=2024-09-12T20:28:52.777535+0000, chain.objs.size()=1 2024-09-12T18:59:59.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JRBiLbVHoRYZSipITN1ZzrJCxidS1PH_0 2024-09-12T18:59:59.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13350848281767082947', time=2024-09-12T20:28:53.268407+0000, chain.objs.size()=1 2024-09-12T18:59:59.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FVRHlfgOK6DnxYfka5xvg5V8BJayLPc_0 2024-09-12T18:59:59.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.44115017320956001', time=2024-09-12T20:28:53.849940+0000, chain.objs.size()=1 2024-09-12T18:59:59.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ARoe2csKGYf7S5T3319-lSNRgqOuxsE_0 2024-09-12T18:59:59.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14858771072462573893', time=2024-09-12T20:28:54.026341+0000, chain.objs.size()=1 2024-09-12T18:59:59.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CMJZeBDVgCBC7pIh6d0xvEpmEDLFhHD_0 2024-09-12T18:59:59.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5650092802795617206', time=2024-09-12T20:28:54.100515+0000, chain.objs.size()=1 2024-09-12T18:59:59.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.e9KiFor081WL75IHqDtXsmti2-qak0H_0 2024-09-12T18:59:59.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13225488048043049802', time=2024-09-12T20:28:59.376564+0000, chain.objs.size()=1 2024-09-12T18:59:59.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.127+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NhTdyNlmXpKgiCJHaWp9ok5UGoGUlug_0 2024-09-12T18:59:59.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9147214068635254567', time=2024-09-12T20:29:04.728166+0000, chain.objs.size()=1 2024-09-12T18:59:59.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CRoQeek9JrwsVeu783lmqyKinF4G-Qn_0 2024-09-12T18:59:59.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1314056959653986085', time=2024-09-12T20:29:05.008858+0000, chain.objs.size()=1 2024-09-12T18:59:59.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WjmI2kFrwrvUGwtRO2ESEonhE-oAeb5_0 2024-09-12T18:59:59.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1377073124903164892', time=2024-09-12T20:29:06.185967+0000, chain.objs.size()=1 2024-09-12T18:59:59.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.hDuHevIzXCRTqhWTSOAlG7ZoQZNQuGi_0 2024-09-12T18:59:59.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.994134842746604008', time=2024-09-12T20:29:06.439737+0000, chain.objs.size()=1 2024-09-12T18:59:59.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AVOScQ62c-5zj2aAzAx2X23IvZZ9O_H_0 2024-09-12T18:59:59.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16766374460429823599', time=2024-09-12T20:29:06.981158+0000, chain.objs.size()=1 2024-09-12T18:59:59.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.n2DDRWPM2HJaP0DVczzsh1dTxyw_BKZ_0 2024-09-12T18:59:59.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17743643764485219784', time=2024-09-12T20:29:07.850770+0000, chain.objs.size()=1 2024-09-12T18:59:59.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ooSeBX_P5hSh65aQTBdcAmkhBRO0ZOz_0 2024-09-12T18:59:59.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15163984009571284832', time=2024-09-12T20:29:10.305979+0000, chain.objs.size()=1 2024-09-12T18:59:59.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.-2Qn1Nvxbb0zEly9RadMScfpUP14vWW_0 2024-09-12T18:59:59.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10037646445215205670', time=2024-09-12T20:29:10.911146+0000, chain.objs.size()=1 2024-09-12T18:59:59.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WAhzF8wLmIdSQrhg7wJ1o959Pps_Bx1_0 2024-09-12T18:59:59.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12282397555887032492', time=2024-09-12T20:29:11.679954+0000, chain.objs.size()=1 2024-09-12T18:59:59.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JONH2TftSQb8NvXlrT6Sz85yKRptqff_0 2024-09-12T18:59:59.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4735429435567831438', time=2024-09-12T20:29:12.287972+0000, chain.objs.size()=1 2024-09-12T18:59:59.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.o_Yt90qxhGvi2BVG97kEVF52NluzbrW_0 2024-09-12T18:59:59.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14194036316250784301', time=2024-09-12T20:29:13.246060+0000, chain.objs.size()=1 2024-09-12T18:59:59.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.caUJksD8hM2Z2_H8X6cHW7_8RkANSuh_0 2024-09-12T18:59:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7452311254628708055', time=2024-09-12T20:29:15.040819+0000, chain.objs.size()=1 2024-09-12T18:59:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DFAeO-3bq8B8W1a6ePBloA-gnFrg21A_0 2024-09-12T18:59:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18443439542962534693', time=2024-09-12T20:29:23.142131+0000, chain.objs.size()=1 2024-09-12T18:59:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.268__shadow_.AZ8aLhV0oas32TF-lfAhpDR--5N8TeE_0 2024-09-12T18:59:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8229603143218034230', time=2024-09-12T20:29:29.479750+0000, chain.objs.size()=1 2024-09-12T18:59:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.273__shadow_.TMxmRJ6feKvgGAmOMjdGkBbJpWLjUvI_0 2024-09-12T18:59:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.149376289641528853', time=2024-09-12T20:29:41.986991+0000, chain.objs.size()=1 2024-09-12T18:59:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.131+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.282__shadow_.I-OflayAQ2KiUfv8ykWo94ldHDgeH0i_0 2024-09-12T18:59:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9502077559820439873', time=2024-09-12T20:29:43.371404+0000, chain.objs.size()=1 2024-09-12T18:59:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.283__shadow_.paNPSEx8kH90WICL8ehTNoAmngUiguA_0 2024-09-12T18:59:59.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12494418718686885105', time=2024-09-12T20:30:03.700123+0000, chain.objs.size()=1 2024-09-12T18:59:59.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.rdV5WudpvoBv-gigHrNHawBKp-9H1ZN_0 2024-09-12T18:59:59.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7559349394594199379', time=2024-09-12T20:30:03.702187+0000, chain.objs.size()=1 2024-09-12T18:59:59.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.Kfsc6HNs4h12HsziGkJYdPhKITKjqVG_0 2024-09-12T18:59:59.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11050896969037786731', time=2024-09-12T20:30:18.040431+0000, chain.objs.size()=1 2024-09-12T18:59:59.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.303__shadow_.wMzljCSXy-YkqKelNdH8UnORYYfMzMC_0 2024-09-12T18:59:59.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3787914504063224303', time=2024-09-12T20:30:22.630959+0000, chain.objs.size()=1 2024-09-12T18:59:59.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.306__shadow_.HP6Vh24ddcmvirlsLuFs1eGJ8TIer8Z_0 2024-09-12T18:59:59.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1697277928032711236', time=2024-09-12T20:30:24.985368+0000, chain.objs.size()=1 2024-09-12T18:59:59.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.307__shadow:sqGFues7LS.Z24o6nWiMiLsxpFUpFGd_.reDSptO9nO6lAUiOHgeN1d6hSkPO6U9_0 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15086977106505001937', time=2024-09-12T20:30:45.554348+0000, chain.objs.size()=1 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.322__shadow_.Z932y5v79wShy0eKQDF4y4fHtSOCy-I_0 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1714975902324565867', time=2024-09-12T20:32:27.304793+0000, chain.objs.size()=1 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.aBsV1oM-sL3UFErssj2bEj0_6jXpJqt_0 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14761635843071636383', time=2024-09-12T20:32:28.777600+0000, chain.objs.size()=1 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.CnFf_wiPGUnsOsobXYOxcW1YAD-EDYM_0 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5662427991710894151', time=2024-09-12T20:32:28.811462+0000, chain.objs.size()=1 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.McRKULWdLU3q9XHK-7rlsRf5Flsa6tG_0 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7874705695755686089', time=2024-09-12T20:32:29.181232+0000, chain.objs.size()=1 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.v7XeI4ZQdqxq9KL3CKwFQlfp8-rVf3w_0 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9965418709917356851', time=2024-09-12T20:32:30.972645+0000, chain.objs.size()=1 2024-09-12T18:59:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.WrVleW0n7IKdY12OHsUCKIXs5_Byyy-_0 2024-09-12T18:59:59.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5994070040801252320', time=2024-09-12T20:32:32.322021+0000, chain.objs.size()=1 2024-09-12T18:59:59.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.GjEDZHqP6h5BJVOhWHbefS2PMXYhRLc_0 2024-09-12T18:59:59.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11092549183446580659', time=2024-09-12T20:32:33.153279+0000, chain.objs.size()=1 2024-09-12T18:59:59.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.P6pvcZEe_ExPMcGCi8ZPtlVgeGmbnhR_0 2024-09-12T18:59:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2594307834029750946', time=2024-09-12T20:32:36.030789+0000, chain.objs.size()=1 2024-09-12T18:59:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1V5WzmQRG1BS1DuNObWv37ETIKzhw2U_0 2024-09-12T18:59:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5469772874179864755', time=2024-09-12T20:32:36.287380+0000, chain.objs.size()=1 2024-09-12T18:59:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ao7FhvJ1ONwC14LsHxymqMpX3ewFUFv_0 2024-09-12T18:59:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2828604263109774389', time=2024-09-12T20:32:36.656904+0000, chain.objs.size()=1 2024-09-12T18:59:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.FAZqn_b8gsA2cnGhXo07IgZW8CEvSpr_0 2024-09-12T18:59:59.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17823012282389803039', time=2024-09-12T20:32:37.810732+0000, chain.objs.size()=1 2024-09-12T18:59:59.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.RZnhrYuE03D0nksAV7XRaKRKD7wpDXV_0 2024-09-12T18:59:59.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15145501750933940559', time=2024-09-12T20:32:38.255974+0000, chain.objs.size()=1 2024-09-12T18:59:59.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.GOxfqTjLRd-bFzRkZ5eCh--RBCaNUIp_0 2024-09-12T18:59:59.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9981760514050536163', time=2024-09-12T20:32:39.186795+0000, chain.objs.size()=1 2024-09-12T18:59:59.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.D0alX6Od0doCEmfo5qbe0MuW_VDdLFQ_0 2024-09-12T18:59:59.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6154409661708573634', time=2024-09-12T20:32:39.353941+0000, chain.objs.size()=1 2024-09-12T18:59:59.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Sr-Ms0kDHPhflPr-T_WJPGN_hUxGxO5_0 2024-09-12T18:59:59.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8301353439772637118', time=2024-09-12T20:32:39.893916+0000, chain.objs.size()=1 2024-09-12T18:59:59.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.135+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ujyJsHkjdqALRxtZHfQ_ACqm4ZDl86H_0 2024-09-12T18:59:59.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9644261763069395314', time=2024-09-12T20:32:40.257769+0000, chain.objs.size()=1 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.EyxSkdyOdgA5UbspeOYSwhfW-EQIWfU_0 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14492773583855595311', time=2024-09-12T20:32:41.849470+0000, chain.objs.size()=1 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pAqSJQpDBSIKn2ulFOfh3uFx-HeapF5_0 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4876264838879699868', time=2024-09-12T20:32:42.181540+0000, chain.objs.size()=1 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3yMQbGkjJlTAvzflK2e8icjz6hTe4f9_0 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16299126102910990430', time=2024-09-12T20:32:42.322497+0000, chain.objs.size()=1 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.B5wcMInMwm8c-TtRlgMPSuSsYwHH5pz_0 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16054869246751763668', time=2024-09-12T20:32:42.402397+0000, chain.objs.size()=1 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6wPwRa9H1i5_8ofZbCw93NNPTcIG6Z2_0 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7253087117896587273', time=2024-09-12T20:32:42.697533+0000, chain.objs.size()=1 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.CUHog4YuQk6hxwgfj-QMRu7yi8ZaARr_0 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17122689543808796019', time=2024-09-12T20:32:43.503044+0000, chain.objs.size()=1 2024-09-12T18:59:59.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.D09_4ElsRrXy4RleQKEJSNi5DfBMwc2_0 2024-09-12T18:59:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13958139533325576721', time=2024-09-12T20:32:43.895282+0000, chain.objs.size()=1 2024-09-12T18:59:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.WRGe24riQg3j09cMW6r7-JwvMD8KSNS_0 2024-09-12T18:59:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12896192944215414356', time=2024-09-12T20:32:46.160533+0000, chain.objs.size()=1 2024-09-12T18:59:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.e6ZI6uvaC6lVSnzOdB_PU1hUMHAwoAk_0 2024-09-12T18:59:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12854430386938344382', time=2024-09-12T20:32:46.838547+0000, chain.objs.size()=1 2024-09-12T18:59:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.cCbwjfm2kTDj9Ec6f9tQToBGa_Zwase_0 2024-09-12T18:59:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17169199642615128738', time=2024-09-12T20:32:48.316373+0000, chain.objs.size()=1 2024-09-12T18:59:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.5r0af7qMm74Xjtn1U9boO1BKXVdHcud_0 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5224440463893707055', time=2024-09-12T20:32:49.078783+0000, chain.objs.size()=1 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uUGL1daKcBH9m9gLPZvn22QWxlP4CqU_0 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12874890749045556398', time=2024-09-12T20:32:49.867643+0000, chain.objs.size()=1 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.abCkUrWQ-YH9OV6O6sK_5-t3jAaPi2u_0 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14891595434351157108', time=2024-09-12T20:32:50.027182+0000, chain.objs.size()=1 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.139+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wJuNBdjPrdsqGgczTFml6nVrbHbf8mu_0 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3244666657415665487', time=2024-09-12T20:32:50.525998+0000, chain.objs.size()=1 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7nRK1lrrO7HD1QgucQBpCBESGNDG5uh_0 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5354719530225618778', time=2024-09-12T20:32:51.640278+0000, chain.objs.size()=1 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Ev8_bsiLzqnSfCDK4pz15-1fuDMu86M_0 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4650148891865795317', time=2024-09-12T20:32:52.907340+0000, chain.objs.size()=1 2024-09-12T18:59:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yLeRrljtQ6qmtbVIeEk3QcjdS_9bBAX_0 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9856513176572834487', time=2024-09-12T20:32:53.614846+0000, chain.objs.size()=1 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.A7-aSYrRdvlhKBdBK69Ucmr5bQ0lA0J_0 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4545008057813111257', time=2024-09-12T20:34:34.161783+0000, chain.objs.size()=1 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hbEYKvHoY4wOjks_f4ILLBOeGcwF6kd_0 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.713707655782800737', time=2024-09-12T20:34:34.938219+0000, chain.objs.size()=1 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.v9Rj6jJcwX5oWZrbofAJlu61qh9W7Vc_0 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10500140580330900423', time=2024-09-12T20:34:34.940389+0000, chain.objs.size()=1 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Qi5eIeAw9Va9YvsFOVJ-S1NVPW6w1at_0 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8709698172720071684', time=2024-09-12T20:34:36.052063+0000, chain.objs.size()=1 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Su-psCyxOdqJGxsgNYGQSfAwYqwWOXS_0 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5823589604924159334', time=2024-09-12T20:34:36.301909+0000, chain.objs.size()=1 2024-09-12T18:59:59.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.7ZnZORpVSl4G5X6iIZJCpMaSc2FOHt0_0 2024-09-12T18:59:59.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5880422476413629609', time=2024-09-12T20:34:36.458505+0000, chain.objs.size()=1 2024-09-12T18:59:59.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1NLNJL0Huc_tzidZ27sD-hpzlqKwHrS_0 2024-09-12T18:59:59.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14510081844797709061', time=2024-09-12T20:34:36.794764+0000, chain.objs.size()=1 2024-09-12T18:59:59.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.06u5_ruqaQnMtER0CbqVnWv-w-fwtqY_0 2024-09-12T18:59:59.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.396557259727744783', time=2024-09-12T20:34:38.275850+0000, chain.objs.size()=1 2024-09-12T18:59:59.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-chbTwoI3htb4hBf0siOO8xqsRKRlWF_0 2024-09-12T18:59:59.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11427902347397490683', time=2024-09-12T20:34:39.086128+0000, chain.objs.size()=1 2024-09-12T18:59:59.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.cM8mgI62paUsO-m1e5izudJlN6Mx6t-_0 2024-09-12T18:59:59.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3033117253220377426', time=2024-09-12T20:34:40.386013+0000, chain.objs.size()=1 2024-09-12T18:59:59.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5-BZ_whkvzgIHEcM65H1F_IzkS5YgS2_0 2024-09-12T18:59:59.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18086367993958957599', time=2024-09-12T20:34:42.195902+0000, chain.objs.size()=1 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Y7WOeMIueCKwcDstUM4jpYxpWOOXHrI_0 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5895335535610358079', time=2024-09-12T20:34:43.729603+0000, chain.objs.size()=1 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XK9N7fyykjMa7i2KSMbs3RvpkMsVwAf_0 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12396616074072610666', time=2024-09-12T20:34:45.096177+0000, chain.objs.size()=1 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9qYHvOCQaqk4ax_bRB65Z9ZA83V5uzB_0 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4769050816479590585', time=2024-09-12T20:34:45.791063+0000, chain.objs.size()=1 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.gUCuz7_KnCBoA8US5iEZiFK60VI80R2_0 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.511161896347288710', time=2024-09-12T20:34:46.240947+0000, chain.objs.size()=1 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.J32eBdiqwSDsiCxRfQ8SAbui0GAqpoF_0 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4311649665521027250', time=2024-09-12T20:34:46.561549+0000, chain.objs.size()=1 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BGn3hNLOqxXWir0ejVQXJw82NCgpaJa_0 2024-09-12T18:59:59.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6419116451712812644', time=2024-09-12T20:34:46.563815+0000, chain.objs.size()=1 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3LDg4F9NntaJIIMpAEGv6mwpvQbkRRe_0 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6103770862283568692', time=2024-09-12T20:34:48.809687+0000, chain.objs.size()=1 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.143+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wu7U4bZnPeey3eA1a-SRchhDOBGBxnJ_0 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4385627057485571384', time=2024-09-12T20:34:49.258842+0000, chain.objs.size()=1 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.oPs5XV7EBEs5yfv_Aa6HZIdQB26xWsZ_0 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9176762373485075097', time=2024-09-12T20:34:49.739155+0000, chain.objs.size()=1 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UYrYAfhmVigi3Z7fzMAgCeRFurm9mJx_0 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7779292731663165879', time=2024-09-12T20:34:50.089760+0000, chain.objs.size()=1 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.sOQwCM-B5LgrQhLUgj_xuFy0h0nhNXF_0 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10926428557891927656', time=2024-09-12T20:34:51.196659+0000, chain.objs.size()=1 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.AIZXa8PTOdscRV7GugGTrd5A9HBJIPN_0 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9068185553739909343', time=2024-09-12T20:34:51.308017+0000, chain.objs.size()=1 2024-09-12T18:59:59.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._bXnlL54dB9piS6reAKzQZfOh6N_PGL_0 2024-09-12T18:59:59.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12026131054701233573', time=2024-09-12T20:34:51.492429+0000, chain.objs.size()=1 2024-09-12T18:59:59.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nV-hCu-1tSqrpkeLEqwXj5vjtMbaddW_0 2024-09-12T18:59:59.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.147+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54098 2024-09-12T18:59:59.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T18:59:59.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10535588088252968956', time=2024-09-12T20:34:52.462545+0000, chain.objs.size()=1 2024-09-12T18:59:59.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1eQRL1jwFsr3wPbonOeDhgPiTlH4Qan_0 2024-09-12T18:59:59.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4304628352659494110', time=2024-09-12T20:34:56.408764+0000, chain.objs.size()=1 2024-09-12T18:59:59.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.O7ppLCWI55ouAqeSOHgJmkXwbIbT4AE_0 2024-09-12T18:59:59.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10769306141773454562', time=2024-09-12T20:34:57.589301+0000, chain.objs.size()=1 2024-09-12T18:59:59.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ep86WoVTt8ety3U-8pPc93bB6f35owU_0 2024-09-12T18:59:59.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3188824945432840509', time=2024-09-12T20:34:57.700149+0000, chain.objs.size()=1 2024-09-12T18:59:59.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JmYUEJtSh0no6xxceyr5N4Wbj_oT3g7_0 2024-09-12T18:59:59.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15392184354884996073', time=2024-09-12T20:34:57.702438+0000, chain.objs.size()=1 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.lw6HuztuWJjOZQuoyinUxsZMKBgRxvM_0 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5375771668295212157', time=2024-09-12T20:34:57.847406+0000, chain.objs.size()=1 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.73hNgm8erfKJxZdUaHWY094D3woGsgg_0 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4240713288818165404', time=2024-09-12T20:35:00.889586+0000, chain.objs.size()=1 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1MKpsLxLeAV5bLJyxjzaxosgaO-yfo3_0 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2250620122035222904', time=2024-09-12T20:35:01.574772+0000, chain.objs.size()=1 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LJzqIjTzHei2qdF8q7PE01AkTjYw_kD_0 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11135513260784669998', time=2024-09-12T20:36:51.242711+0000, chain.objs.size()=1 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.430__shadow_.Hrlr7jQyLRVs3pd1NMPulVBxdtNo8f1_0 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1814024110086650248', time=2024-09-12T20:37:21.501548+0000, chain.objs.size()=1 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.455__shadow_.-U48m43_P8V-r9W5bKeUnDPO7semRwk_0 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10746863061217867694', time=2024-09-12T20:37:38.941371+0000, chain.objs.size()=1 2024-09-12T18:59:59.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.465__shadow_.Hku3fzOswSgSdkkv5IzGhL2PmyzCZs5_0 2024-09-12T18:59:59.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8893799836748789701', time=2024-09-12T20:37:56.817358+0000, chain.objs.size()=1 2024-09-12T18:59:59.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.gZY4nX9t8Zyd98krbGPnTJN_BHyIMaA_0 2024-09-12T18:59:59.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2511578301820983873', time=2024-09-12T20:38:18.207464+0000, chain.objs.size()=1 2024-09-12T18:59:59.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.151+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.498__shadow_.YXL4X6QexEahTzLA3SQzFFIhTpUywxe_0 2024-09-12T18:59:59.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15052889473179873342', time=2024-09-12T20:38:39.366686+0000, chain.objs.size()=6 2024-09-12T18:59:59.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.1 2024-09-12T18:59:59.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.2 2024-09-12T18:59:59.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.3 2024-09-12T18:59:59.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.4 2024-09-12T18:59:59.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.5 2024-09-12T18:59:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.6 2024-09-12T18:59:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12483374031513897580', time=2024-09-12T20:38:55.060461+0000, chain.objs.size()=1 2024-09-12T18:59:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.518__multipart_mymultipart.2~W4lMc9pM1JOHfrTV3uTIP59wmXG2KRN.1 2024-09-12T18:59:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT', time=2024-09-12T20:40:52.168976+0000, chain.objs.size()=1 2024-09-12T18:59:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT.1 2024-09-12T18:59:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT', time=2024-09-12T20:40:52.178371+0000, chain.objs.size()=1 2024-09-12T18:59:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT.2 2024-09-12T18:59:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT', time=2024-09-12T20:40:52.187598+0000, chain.objs.size()=1 2024-09-12T18:59:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT.3 2024-09-12T18:59:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT', time=2024-09-12T20:40:52.199518+0000, chain.objs.size()=1 2024-09-12T18:59:59.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT.4 2024-09-12T18:59:59.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT', time=2024-09-12T20:40:52.208979+0000, chain.objs.size()=1 2024-09-12T18:59:59.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT.5 2024-09-12T18:59:59.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT', time=2024-09-12T20:40:52.218504+0000, chain.objs.size()=1 2024-09-12T18:59:59.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~KzoxBzyHCSW63r1qEsXJma7CWqlOiNT.6 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3826282644814064497', time=2024-09-12T20:43:05.719511+0000, chain.objs.size()=1 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.556__shadow_.Gg45vCoqITFAj6SaqPDBR4TWNQMHFyY_0 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14351297175280977752', time=2024-09-12T20:43:49.977136+0000, chain.objs.size()=1 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:AeV3jOnKaC9SjW9gBGM1a3O0tQ2meG0_.QtVTeUyU4WBW8ZMayNaWDgHIvi8rhmJ_0 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11171383714625989587', time=2024-09-12T20:44:18.062929+0000, chain.objs.size()=1 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574__shadow:E0Us4lhpmqPtS2q1CoJQimv43kb6Y7p_.4ZOC23lU_ifeaFrP-L2zgKirTTA56uZ_0 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8388456588584273317', time=2024-09-12T20:44:24.745332+0000, chain.objs.size()=1 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.576__shadow:pqPyA1PQxYSzsgCt0ltl.MsAXJzE5Fk_.KavYwr8ai_ea699YfwjYv3vyX8UckVh_0 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2041400828846572887', time=2024-09-12T20:44:29.490709+0000, chain.objs.size()=1 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.576__shadow:mK1PlmWayKvN87y0w4eCANSaLy0RgL1_.ifgXohGakw_3aBM_p2Nwfib2hI5l8U7_0 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13859835234752965129', time=2024-09-12T20:44:42.009512+0000, chain.objs.size()=1 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.155+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:XHZgWl6GZujDUDae2KOTlf07Xh2wqEw_.2BZhrTSpHhVKU_pDvOXnPk9rUrua1_k_0 2024-09-12T18:59:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5571453073529800361', time=2024-09-12T20:44:56.721230+0000, chain.objs.size()=1 2024-09-12T18:59:59.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:q3Ym32xDYCF4-5Hi.ucGyEC1QPNC0CM_.5Nosdf7qkXvYSPsoGd_sq00FCMPqLfL_0 2024-09-12T18:59:59.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17682971602423143090', time=2024-09-12T20:45:13.361592+0000, chain.objs.size()=1 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:TBXvhmlCTguzE4sqrgkc6v.-P95mD0Q_.w-Yz-89QPjHvU19gbI9Y33KHGsjNTp3_0 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17492870986073618867', time=2024-09-12T20:45:30.352075+0000, chain.objs.size()=4 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~DsMGcsOTMOcQw0akJw0Thwcgm6nCT05.1 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~DsMGcsOTMOcQw0akJw0Thwcgm6nCT05.2 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~DsMGcsOTMOcQw0akJw0Thwcgm6nCT05.3 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~DsMGcsOTMOcQw0akJw0Thwcgm6nCT05.4 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6986065371796390234', time=2024-09-12T20:45:42.903871+0000, chain.objs.size()=1 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.583__shadow:EvPtbSSBse.Qg2Er1Jp33OSeVAX5wfu_.M3_3EM25axZGowJQQpYDSxk7Edqy_U3_0 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15043315349219691540', time=2024-09-12T20:45:52.788218+0000, chain.objs.size()=1 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.587__shadow:oUOVci5MTIY8Uioeahw2GKNFLGBuySg_.44BZEOoN-ojOI1gGK411LSf811oqoYQ_0 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15906591575392064585', time=2024-09-12T20:51:14.086365+0000, chain.objs.size()=1 2024-09-12T18:59:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.648__shadow_.0KFYA01q7CblKtL5lJrWarYCrkfSurA_0 2024-09-12T18:59:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9288257480988517837', time=2024-09-12T20:52:06.848593+0000, chain.objs.size()=1 2024-09-12T18:59:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.671__shadow_.xOwFnFQBXCxgV1LBLk7mT-Abm786O_S_0 2024-09-12T18:59:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1710348498413162107', time=2024-09-12T20:52:38.294941+0000, chain.objs.size()=1 2024-09-12T18:59:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.701__shadow:hYy9ul3SmPlMRXuSTYVN9AN8n1tKoca_.z83NxFvNmClNDu4HnhfFJFG1wzmPDLd_0 2024-09-12T18:59:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15272927965993912272', time=2024-09-12T20:52:42.795674+0000, chain.objs.size()=1 2024-09-12T18:59:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.704__shadow:lEQ7rj4N.x2oFbf36sSLzCrUPna44JS_.lw-3Xk8jgSnj0z8aLCHBUeoM-630cXp_0 2024-09-12T18:59:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17902310233429500714', time=2024-09-12T20:53:51.124140+0000, chain.objs.size()=1 2024-09-12T18:59:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.159+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.739__shadow_.aLzD5C-T-hAm6FCLnzd7tPYWVl3wU_E_0 2024-09-12T18:59:59.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.163+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.163+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:59:59.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51001' 2024-09-12T18:59:59.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14574757617724554375', time=2024-09-12T20:23:18.680422+0000, chain.objs.size()=1 2024-09-12T18:59:59.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.183__shadow_.bi0YYBO4pEwgZwGOb-mT2aOH2w58KCp_0 2024-09-12T18:59:59.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10729132859386714892', time=2024-09-12T20:26:23.937829+0000, chain.objs.size()=1 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.230__shadow_.o5PfeMMW-FQl4XpNW9CfLsRRNvWwUFN_0 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3700333532105777892', time=2024-09-12T20:26:41.348130+0000, chain.objs.size()=1 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.242__shadow_.kREXvMu5hwoxqTb7goJEg3WYt27IG7Z_0 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1523125560588331833', time=2024-09-12T20:26:45.478657+0000, chain.objs.size()=1 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.244__shadow_.fdlYuePtU739waZ76I8zmCRxBDPuRMN_0 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1177542928553966197', time=2024-09-12T20:26:46.835718+0000, chain.objs.size()=1 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.245__shadow_.6V5tVtqWRgsBc8Y3f3r7lgxoM0dSFSh_0 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13596152360079764218', time=2024-09-12T20:26:49.658541+0000, chain.objs.size()=1 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.247__shadow_.EfhE2UbKPiFZjCU5mfO38lTrlBoi8z0_0 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11173054291735986824', time=2024-09-12T20:26:55.226654+0000, chain.objs.size()=1 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.251__shadow_.r-mYOawJ-LFp_LoimYcickspEcMuPwU_0 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9973185005718572474', time=2024-09-12T20:26:56.664379+0000, chain.objs.size()=1 2024-09-12T18:59:59.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.252__shadow_.2yupJxv9VGcV_ioeCxRm1Xc_bhlej92_0 2024-09-12T18:59:59.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8616311154112527957', time=2024-09-12T20:27:07.539112+0000, chain.objs.size()=1 2024-09-12T18:59:59.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.260__shadow_.oLmo0PamH51wUpCiu9cRw0M-nZiV5vY_0 2024-09-12T18:59:59.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10247685198806765469', time=2024-09-12T20:27:08.944883+0000, chain.objs.size()=1 2024-09-12T18:59:59.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.261__shadow_.ynwx3m8iBK9CamxBm4vBJ2-WzuMKcyK_0 2024-09-12T18:59:59.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16214195107857689119', time=2024-09-12T20:28:48.871820+0000, chain.objs.size()=1 2024-09-12T18:59:59.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.6RwFA_zYaDdX1ui3Nea7NhSOgCmeW2t_0 2024-09-12T18:59:59.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.888224928651671159', time=2024-09-12T20:28:49.103254+0000, chain.objs.size()=1 2024-09-12T18:59:59.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.MNCZOWgPPuF2TtfciabFHY7E3RolNnn_0 2024-09-12T18:59:59.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2060525445671951679', time=2024-09-12T20:28:49.314135+0000, chain.objs.size()=1 2024-09-12T18:59:59.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ANCDn3F9sbC0OrRCjqcQzhekFLQTweZ_0 2024-09-12T18:59:59.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10322688999350373636', time=2024-09-12T20:28:49.577200+0000, chain.objs.size()=1 2024-09-12T18:59:59.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DncUFzJBGIaXMpLKfYHsu6h930FNyye_0 2024-09-12T18:59:59.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.835895629754966499', time=2024-09-12T20:28:49.903230+0000, chain.objs.size()=1 2024-09-12T18:59:59.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.zj8aTYuT2GhNp2VnhNBauAuyhD8ByoI_0 2024-09-12T18:59:59.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10625813468645902644', time=2024-09-12T20:28:50.211446+0000, chain.objs.size()=1 2024-09-12T18:59:59.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.23ZcBaIDvflCSUc9k3i1G9npo87BeB__0 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7505427425608948222', time=2024-09-12T20:28:50.442624+0000, chain.objs.size()=1 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3zmNxetleeWZDp-DPYcBuILJsKQ1qj7_0 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7044609683034477430', time=2024-09-12T20:28:52.003769+0000, chain.objs.size()=1 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.PBVulZedDV4UneOmNNg1BYoSx0jELMt_0 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14687260676040667612', time=2024-09-12T20:28:52.136333+0000, chain.objs.size()=1 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.167+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7bQYc7q2JC3tbkSLrpyNHKAIxVFAzjS_0 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5858007450803977539', time=2024-09-12T20:28:52.707189+0000, chain.objs.size()=1 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.j_Yl3M1NhVXyhb7rCCM-9lCXNSWsu8O_0 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4063263893993099771', time=2024-09-12T20:28:52.876720+0000, chain.objs.size()=1 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.aD9jv7le40bPprjlVMH7RBkWwTqChM4_0 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12799436147354321312', time=2024-09-12T20:28:53.583570+0000, chain.objs.size()=1 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.YdS-OvyRu6k17eFvAElIs0oanOJcRgn_0 2024-09-12T18:59:59.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9881847301695934776', time=2024-09-12T20:28:54.376618+0000, chain.objs.size()=1 2024-09-12T18:59:59.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rbrpRhCkiob1H8hx2RjL1ECj8qB6QSN_0 2024-09-12T18:59:59.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5896476957871200239', time=2024-09-12T20:28:56.257764+0000, chain.objs.size()=1 2024-09-12T18:59:59.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.74WoHoVnr0bUPWV11W9uJ0wSTDZNNUz_0 2024-09-12T18:59:59.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12864908975811867065', time=2024-09-12T20:28:56.260998+0000, chain.objs.size()=1 2024-09-12T18:59:59.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tkYMLALvRskcK0MXQOIZZ6TPerp4WkP_0 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.353343251991900786', time=2024-09-12T20:28:56.749062+0000, chain.objs.size()=1 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.b1fR_KBqtKbr_Fi_YcZEJiHXNXzGw9X_0 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4035530643641269765', time=2024-09-12T20:28:56.954963+0000, chain.objs.size()=1 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.S2P1J0sHtRGlEYDGHGlIhMcPzvP0P_h_0 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11990745465659726389', time=2024-09-12T20:28:57.167846+0000, chain.objs.size()=1 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.zNoHWbuLrtTpbKHCPInlDDwib9Z-phy_0 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4733214187917906199', time=2024-09-12T20:28:57.169576+0000, chain.objs.size()=1 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.MQhvIlR74G1LdaX0rO-6JipDMNgi-qi_0 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14715669452725045528', time=2024-09-12T20:28:58.034708+0000, chain.objs.size()=1 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SVm45NIZlxsh2l-Ai6FeLkktk1S2wNp_0 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15902595532318892337', time=2024-09-12T20:29:00.698017+0000, chain.objs.size()=1 2024-09-12T18:59:59.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.6n8ytdud8YaELHpxweQ2CCHzFYeqj5F_0 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1968286263909103223', time=2024-09-12T20:29:01.119813+0000, chain.objs.size()=1 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.TWwVzlB_ktcoBXhpHehGvNVccf9MnkB_0 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15417056677215665530', time=2024-09-12T20:29:02.631717+0000, chain.objs.size()=1 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5jigjJSKo9t0Op7iu-KhbaYkPkOLcgo_0 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10436096932752414277', time=2024-09-12T20:29:02.772716+0000, chain.objs.size()=1 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SKdPRh4wP3xeaJi-wsotw5Y2oTryeA7_0 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10918931779840081698', time=2024-09-12T20:29:02.990880+0000, chain.objs.size()=1 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DdS1NCh9Fe6_BKE6slJXs20UhfzQeka_0 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17859042907552426439', time=2024-09-12T20:29:03.102947+0000, chain.objs.size()=1 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.xaQzA3r9pSe23-ZJtQvG-eXXPRPcNMm_0 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2876476978871125527', time=2024-09-12T20:29:03.696536+0000, chain.objs.size()=1 2024-09-12T18:59:59.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.f3gmeClNtf1eqBitu1R-_rhj_I2l1bA_0 2024-09-12T18:59:59.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6886681314290943924', time=2024-09-12T20:29:03.828497+0000, chain.objs.size()=1 2024-09-12T18:59:59.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.83i7rEq93qdNFXqLhEycsRx7PKbZ19M_0 2024-09-12T18:59:59.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.171+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18332696245302748136', time=2024-09-12T20:29:05.200456+0000, chain.objs.size()=1 2024-09-12T18:59:59.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HzNrIXTzg4oLki4vZJ3hdMyzVoMs6lF_0 2024-09-12T18:59:59.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8159779822442514061', time=2024-09-12T20:29:07.517454+0000, chain.objs.size()=1 2024-09-12T18:59:59.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Cv7-BWhA-pEL7zTTgHpucB6Eg0Fv32R_0 2024-09-12T18:59:59.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3120899753062834716', time=2024-09-12T20:29:07.973440+0000, chain.objs.size()=1 2024-09-12T18:59:59.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bHx6Wh-xMEfvKMbSUVsXa8UmeO74qiA_0 2024-09-12T18:59:59.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8124308114337840671', time=2024-09-12T20:29:08.273947+0000, chain.objs.size()=1 2024-09-12T18:59:59.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SIToDiv7asxP5dPUPl73bZapvdK8kTo_0 2024-09-12T18:59:59.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12005885573636849190', time=2024-09-12T20:29:08.402136+0000, chain.objs.size()=1 2024-09-12T18:59:59.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.MmLBy3KOrWpkE2rVH3IPsh08cSrh_W9_0 2024-09-12T18:59:59.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8915941945115871813', time=2024-09-12T20:29:08.531253+0000, chain.objs.size()=1 2024-09-12T18:59:59.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.qMTgmHOXKi9tq-n2JDNWBSbvofKNh2m_0 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13196077324957267976', time=2024-09-12T20:29:10.302276+0000, chain.objs.size()=1 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FR2LyLMccDASGZqGjTMCJe3tR6Ijhxi_0 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1543158275897817982', time=2024-09-12T20:29:11.373407+0000, chain.objs.size()=1 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9WeDrMzYpmm5llr6cApg0XeoSAd3dMN_0 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13585530803511066707', time=2024-09-12T20:29:13.287478+0000, chain.objs.size()=1 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.puMTf8X0DDT5diMS_t5X60oT3s371Jz_0 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6394944678389952647', time=2024-09-12T20:29:13.290492+0000, chain.objs.size()=1 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.F3E588k1d7n8mmPWt2x7KwbZv2JuD5D_0 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7299256848618588145', time=2024-09-12T20:29:14.066454+0000, chain.objs.size()=1 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.hxjXMTzw7svHiqgcE4O4ZfxrONw3cdx_0 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.769889600557412217', time=2024-09-12T20:29:14.929739+0000, chain.objs.size()=1 2024-09-12T18:59:59.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kYJ3WUVfbA0UEjKrC5rvi-rnked9Xui_0 2024-09-12T18:59:59.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14309593689298868449', time=2024-09-12T20:29:15.210269+0000, chain.objs.size()=1 2024-09-12T18:59:59.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wXojBbhOxMXLVpJHs32kcuZhA04BnyS_0 2024-09-12T18:59:59.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9129936134694538083', time=2024-09-12T20:29:15.470167+0000, chain.objs.size()=1 2024-09-12T18:59:59.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kQzStovfs9vn84f2fQ2r2Qm73GvIFsl_0 2024-09-12T18:59:59.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1159262614416737491', time=2024-09-12T20:29:15.471722+0000, chain.objs.size()=1 2024-09-12T18:59:59.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.175+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.TZEY_c2ZTU7XNzL7Z3LJKY5FYaMLfhF_0 2024-09-12T18:59:59.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17141602591037028898', time=2024-09-12T20:29:51.927781+0000, chain.objs.size()=1 2024-09-12T18:59:59.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.289__shadow_.54I5cAagl0VMDWsj0gbdlaIIfbduUnO_0 2024-09-12T18:59:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11568170305927110240', time=2024-09-12T20:30:03.820733+0000, chain.objs.size()=1 2024-09-12T18:59:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.Wbfam-cvBP6dyQ9Z28otOkMR-ofaWCJ_0 2024-09-12T18:59:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17194239901628723248', time=2024-09-12T20:30:03.839840+0000, chain.objs.size()=1 2024-09-12T18:59:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.zWrmbwZzkZqWixyMVLOvGE9CNsqeJTA_0 2024-09-12T18:59:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13285629229880586369', time=2024-09-12T20:30:08.090770+0000, chain.objs.size()=1 2024-09-12T18:59:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.296__shadow_.ryAw_QU_Gj_-olSX_iGsF5e7o7YUtKo_0 2024-09-12T18:59:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13113437165274853404', time=2024-09-12T20:30:11.001432+0000, chain.objs.size()=1 2024-09-12T18:59:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.298__shadow_.gHRr7jilGexS165CalMnsZlZyEFrf3z_0 2024-09-12T18:59:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8314885404920449557', time=2024-09-12T20:32:26.847739+0000, chain.objs.size()=1 2024-09-12T18:59:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.KvknvbQC50m8X5dU56FnjsCJaCmUCZs_0 2024-09-12T18:59:59.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6486718859732195754', time=2024-09-12T20:32:26.912294+0000, chain.objs.size()=1 2024-09-12T18:59:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.TeDsAUKnHZraIhA2WHu0S1lTcRg6NnM_0 2024-09-12T18:59:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10746271981045649909', time=2024-09-12T20:32:26.914421+0000, chain.objs.size()=1 2024-09-12T18:59:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.t67Y9s98eQgqjWW0q1CjoGWfr1zRxff_0 2024-09-12T18:59:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10701831342525989618', time=2024-09-12T20:32:27.308307+0000, chain.objs.size()=1 2024-09-12T18:59:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Zz2F17T8OVNo1z9GFN6ce6FhGQmRrxk_0 2024-09-12T18:59:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17507466354790799170', time=2024-09-12T20:32:27.635331+0000, chain.objs.size()=1 2024-09-12T18:59:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.5LyjE0EkxCJeMZGWV_5BM5JwY9lDgLO_0 2024-09-12T18:59:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3486751520879091336', time=2024-09-12T20:32:27.721395+0000, chain.objs.size()=1 2024-09-12T18:59:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ESrySwXOqZ4oXqb8EwMf82ACVN9Hs7n_0 2024-09-12T18:59:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7426400051036343541', time=2024-09-12T20:32:28.512741+0000, chain.objs.size()=1 2024-09-12T18:59:59.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.aOnooydL2Qw1VK8zcg1kRoR0EV9hsLc_0 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10644953702094558846', time=2024-09-12T20:32:29.559385+0000, chain.objs.size()=1 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.woyYeEgu40Y4cPX7LHSHY9PlrkjR4gP_0 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10136466908406732142', time=2024-09-12T20:32:30.620199+0000, chain.objs.size()=1 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Q8Z_X0MHxpxlJ3XxS8TUb_ptysnzTrq_0 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10215990716364089539', time=2024-09-12T20:32:30.721208+0000, chain.objs.size()=1 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dZwLuyIwwMeUMZ7EvIKcsem6tsJ1j7n_0 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14800372658110279417', time=2024-09-12T20:32:31.046637+0000, chain.objs.size()=1 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.lFFjSTh1EQkUGxRbNsoJ_Du0o2dqThy_0 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16291301530389964940', time=2024-09-12T20:32:31.860299+0000, chain.objs.size()=1 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.WyQivZm20-qtJHw7b2nWf8mAc9iEZ6x_0 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11262947161748762998', time=2024-09-12T20:32:32.688367+0000, chain.objs.size()=1 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.baCHp9hakmuhfOPt-JAONkRBAz9tn4p_0 2024-09-12T18:59:59.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5699622377434055011', time=2024-09-12T20:32:34.296608+0000, chain.objs.size()=1 2024-09-12T18:59:59.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3Cm3696xO1bKzjzfMQrdNQBSSoNjGa5_0 2024-09-12T18:59:59.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5644963186575741707', time=2024-09-12T20:32:34.687952+0000, chain.objs.size()=1 2024-09-12T18:59:59.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.k5MfokN_wt6tup7QwD_YODw044Aki4Y_0 2024-09-12T18:59:59.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14968175221052309221', time=2024-09-12T20:32:35.425481+0000, chain.objs.size()=1 2024-09-12T18:59:59.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.XMAzb5dO4N0yHuoTaJTZ3PQBwUy9ONf_0 2024-09-12T18:59:59.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14893422699536723390', time=2024-09-12T20:32:36.953245+0000, chain.objs.size()=1 2024-09-12T18:59:59.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.179+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Wj7dZgIo4RtwlM1Vr2pJ4lXXcCb2IwK_0 2024-09-12T18:59:59.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17231270789552395406', time=2024-09-12T20:32:38.793162+0000, chain.objs.size()=1 2024-09-12T18:59:59.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6olOwZpR9en3KpcTdpCN6FUZXtb2_ZP_0 2024-09-12T18:59:59.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.259859829941521436', time=2024-09-12T20:32:40.377115+0000, chain.objs.size()=1 2024-09-12T18:59:59.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.AEQQ4j9kTxwW13BxnwZjFZY9FhRi4iO_0 2024-09-12T18:59:59.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.162100502558884460', time=2024-09-12T20:32:41.672878+0000, chain.objs.size()=1 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gsWOiOEVie3uVgXMojQ71AEl3gjak4X_0 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3931553686114198046', time=2024-09-12T20:32:42.315599+0000, chain.objs.size()=1 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.s8bPzzQLUF8pZxqsxUQKlyyCoOWzgOw_0 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11514315665376061539', time=2024-09-12T20:32:42.721180+0000, chain.objs.size()=1 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7tkX-BiQJn1hKtOCMMAuGsxdick5uMF_0 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5819409613404667659', time=2024-09-12T20:32:43.639983+0000, chain.objs.size()=1 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.b4MjJQ1XlXjnBtS8ZNdgAqlPPgDNxHK_0 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17825297925104594424', time=2024-09-12T20:32:45.124536+0000, chain.objs.size()=1 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._RsGDbapFxzGI8RlhX_ojNyGYRwYQlY_0 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18047862567799158021', time=2024-09-12T20:32:46.194779+0000, chain.objs.size()=1 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.K4NsFkZ0ld1sM2ZehY-LIydXhVl0yvN_0 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7626808330255818012', time=2024-09-12T20:32:46.519533+0000, chain.objs.size()=1 2024-09-12T18:59:59.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yqMYNs3dd6w2Y33Id7RK-6KjnumPsbl_0 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7581644415731037356', time=2024-09-12T20:32:48.356906+0000, chain.objs.size()=1 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.CyqyBFjvb5Omx9ATBduJwJ3K7jikkZM_0 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7808723140885600356', time=2024-09-12T20:32:49.036104+0000, chain.objs.size()=1 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eon2siw-cRZItYNtbY3cm1Yoexm6EDE_0 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1199837183033142453', time=2024-09-12T20:32:49.689945+0000, chain.objs.size()=1 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.oF0mLgwPEnsMeAWy6wkSB_egtmX83Gg_0 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.840460234310623180', time=2024-09-12T20:32:50.057500+0000, chain.objs.size()=1 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.O6aJjLFGx7Jot4m24sw_2LhHDez2_CS_0 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12562986623582500162', time=2024-09-12T20:32:50.549144+0000, chain.objs.size()=1 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.akA23Oci_gijdI727eEpyVhd9u7apIk_0 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4282949372092639137', time=2024-09-12T20:32:51.625922+0000, chain.objs.size()=1 2024-09-12T18:59:59.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.GU4a68FoUfguNctxb6_9tQt4zuVOCLq_0 2024-09-12T18:59:59.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10545164301731091527', time=2024-09-12T20:32:53.438408+0000, chain.objs.size()=1 2024-09-12T18:59:59.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hl-_r4KT5fvrOVcHC_18gkxhICcG5Sx_0 2024-09-12T18:59:59.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1412124116194074246', time=2024-09-12T20:34:34.134807+0000, chain.objs.size()=1 2024-09-12T18:59:59.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.183+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.F2Q35EFdIOIRWZAu1QO7VT9IfnohUki_0 2024-09-12T18:59:59.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6003045974215199648', time=2024-09-12T20:34:34.424271+0000, chain.objs.size()=1 2024-09-12T18:59:59.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ggAjF6TEIXWgumBgqI5l7Kw_L6w31c9_0 2024-09-12T18:59:59.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17912823105000271895', time=2024-09-12T20:34:35.354205+0000, chain.objs.size()=1 2024-09-12T18:59:59.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.V1-kv4lyTceDWjxWuohKhmdRFQ3OVpl_0 2024-09-12T18:59:59.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9969031488584665383', time=2024-09-12T20:34:35.581707+0000, chain.objs.size()=1 2024-09-12T18:59:59.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.my8cv0B09pL4ZmY_0zGcrKzo_A9mFYg_0 2024-09-12T18:59:59.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8867800793945396128', time=2024-09-12T20:34:36.581401+0000, chain.objs.size()=1 2024-09-12T18:59:59.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.992EYEWY483uA1wR-jLxdqoAedEt86X_0 2024-09-12T18:59:59.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3819010321362082452', time=2024-09-12T20:34:39.565140+0000, chain.objs.size()=1 2024-09-12T18:59:59.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.jQsYHDCOEhRlC-NQJgEsoCHR-8V_VTY_0 2024-09-12T18:59:59.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4104891940431795637', time=2024-09-12T20:34:40.271666+0000, chain.objs.size()=1 2024-09-12T18:59:59.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tuyTMHQJZ0ZikPqx17vgV_l8zmPIDzx_0 2024-09-12T18:59:59.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7155606164555204940', time=2024-09-12T20:34:40.657191+0000, chain.objs.size()=1 2024-09-12T18:59:59.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.13jeBLNJnETgf7cDWcoohcR5D5D3CCK_0 2024-09-12T18:59:59.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8852803000823293637', time=2024-09-12T20:34:40.693689+0000, chain.objs.size()=1 2024-09-12T18:59:59.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LvYtXE_6JrwCqjd3B9cMTNlt3C-_53-_0 2024-09-12T18:59:59.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.187+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51001 2024-09-12T18:59:59.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T18:59:59.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1357449124027427768', time=2024-09-12T20:34:43.563639+0000, chain.objs.size()=1 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RBzqX3Y1XLd2njob6wbYKCSDj0VPcOS_0 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13628323299857962252', time=2024-09-12T20:34:43.735565+0000, chain.objs.size()=1 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.xu2oliGawJdd5uHUQ8WoCdTCoxueXt0_0 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9238810458414993805', time=2024-09-12T20:34:44.267750+0000, chain.objs.size()=1 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.EJkIX5G-Y95-c21KeWTdjY8s8_dxwJL_0 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14702847816302122317', time=2024-09-12T20:34:45.898389+0000, chain.objs.size()=1 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QagIksWSZ0JM9axb1mlgnMNFu3mgGA6_0 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1140007440301318564', time=2024-09-12T20:34:46.154185+0000, chain.objs.size()=1 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.zTmzhzbRNnm0TKXHiTAKWNeM7pAjoPJ_0 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5390061389715401523', time=2024-09-12T20:34:47.720467+0000, chain.objs.size()=1 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.O2CHB103rkqZcCmvhM4DTCJ1h_eo7cY_0 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1813388611015045805', time=2024-09-12T20:34:47.830905+0000, chain.objs.size()=1 2024-09-12T18:59:59.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.C47OASxgPeAmbNWDge3vUEDY2KwM_z6_0 2024-09-12T18:59:59.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9029346455402190372', time=2024-09-12T20:34:49.173685+0000, chain.objs.size()=1 2024-09-12T18:59:59.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.fXtL7GMGXTu29zzJWujgCQYJA-_nimh_0 2024-09-12T18:59:59.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17746137450601396450', time=2024-09-12T20:34:50.671926+0000, chain.objs.size()=1 2024-09-12T18:59:59.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._uH5mwzMAgkisAh6_kTcWL5rf2gTt-h_0 2024-09-12T18:59:59.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17599926649642806671', time=2024-09-12T20:34:54.718900+0000, chain.objs.size()=1 2024-09-12T18:59:59.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.zZX7QJzj7B5gbIpvznsEMBPgsqGuh6l_0 2024-09-12T18:59:59.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2368413530537617331', time=2024-09-12T20:34:54.887582+0000, chain.objs.size()=1 2024-09-12T18:59:59.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.0_nw7G4CRV0naKVeJ4xEfah2knjM00T_0 2024-09-12T18:59:59.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7560079982838362209', time=2024-09-12T20:34:54.984666+0000, chain.objs.size()=1 2024-09-12T18:59:59.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.llnqDzuHGftnp8eIY7y23wlcAO75Tm6_0 2024-09-12T18:59:59.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14454469674843304347', time=2024-09-12T20:34:55.990660+0000, chain.objs.size()=1 2024-09-12T18:59:59.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.191+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.y9mXkKJx6WDY8jT28AIuVSx41bk9_2W_0 2024-09-12T18:59:59.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4477896484644799892', time=2024-09-12T20:34:56.342706+0000, chain.objs.size()=1 2024-09-12T18:59:59.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.sPeqh1EvOWbqj0geTr4B8ezEXT_Ctpw_0 2024-09-12T18:59:59.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4071641024823200326', time=2024-09-12T20:34:57.195360+0000, chain.objs.size()=1 2024-09-12T18:59:59.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.WjCgWFTGf7BFmdGkFi_xts6xHVKdTof_0 2024-09-12T18:59:59.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10284594720742319526', time=2024-09-12T20:34:58.635949+0000, chain.objs.size()=1 2024-09-12T18:59:59.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hnRvAAbN4MYLxz94FeqdQW3j7OK0Wz3_0 2024-09-12T18:59:59.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17089493851174366409', time=2024-09-12T20:34:58.735522+0000, chain.objs.size()=1 2024-09-12T18:59:59.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bE9AbAVLsWZesd6oJd02zEW5wtUdp3y_0 2024-09-12T18:59:59.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.608532283480347885', time=2024-09-12T20:35:01.044251+0000, chain.objs.size()=1 2024-09-12T18:59:59.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Hyrb9Z3YfPdZkjqdYJ5ssd2FZ5gBTto_0 2024-09-12T18:59:59.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12087931144131305775', time=2024-09-12T20:35:01.278911+0000, chain.objs.size()=1 2024-09-12T18:59:59.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3sxJhpJKFu1RZpYuuszEZLlKp5jYVvP_0 2024-09-12T18:59:59.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7309093951189260227', time=2024-09-12T20:35:01.365511+0000, chain.objs.size()=1 2024-09-12T18:59:59.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.eRhqivYj_gb8ykGRYWX5qdxJ-N7Wn1Y_0 2024-09-12T18:59:59.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12282323892326493686', time=2024-09-12T20:35:18.451606+0000, chain.objs.size()=1 2024-09-12T18:59:59.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.340__shadow_.p5-LxWMaWM1IAXKfPwDXFqx4u1BdzXy_0 2024-09-12T18:59:59.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2825988210270285330', time=2024-09-12T20:37:16.623125+0000, chain.objs.size()=1 2024-09-12T18:59:59.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.451__shadow_.mfLWvqwoOe6WVMJPKNZBq5NmfLqEI6Y_0 2024-09-12T18:59:59.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11818331826252236984', time=2024-09-12T20:39:36.301953+0000, chain.objs.size()=4 2024-09-12T18:59:59.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.520__shadow:xJfCVCyHZWusM1Gg5ZolbpqF4C9nxTM_.uUJ1gDARkDK8dgE_JYtC9kqWr6xUzTp_0 2024-09-12T18:59:59.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.520__shadow:xJfCVCyHZWusM1Gg5ZolbpqF4C9nxTM_.uUJ1gDARkDK8dgE_JYtC9kqWr6xUzTp_1 2024-09-12T18:59:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.520__shadow:xJfCVCyHZWusM1Gg5ZolbpqF4C9nxTM_.uUJ1gDARkDK8dgE_JYtC9kqWr6xUzTp_2 2024-09-12T18:59:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.520__shadow:xJfCVCyHZWusM1Gg5ZolbpqF4C9nxTM_.uUJ1gDARkDK8dgE_JYtC9kqWr6xUzTp_3 2024-09-12T18:59:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5142595605234089209', time=2024-09-12T20:41:06.546340+0000, chain.objs.size()=2 2024-09-12T18:59:59.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.195+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~AOYJVlRIgoEtSzpf5Q-YbD1L3X2iumr.1 2024-09-12T18:59:59.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~AOYJVlRIgoEtSzpf5Q-YbD1L3X2iumr.2 2024-09-12T18:59:59.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2210150366473427513', time=2024-09-12T20:41:27.622569+0000, chain.objs.size()=3 2024-09-12T18:59:59.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~Bjlqz4kkbqETmGZQOLpwMM69BaqIwPX.1 2024-09-12T18:59:59.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~Bjlqz4kkbqETmGZQOLpwMM69BaqIwPX.2 2024-09-12T18:59:59.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~Bjlqz4kkbqETmGZQOLpwMM69BaqIwPX.3 2024-09-12T18:59:59.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13794755519138360549', time=2024-09-12T20:41:42.404730+0000, chain.objs.size()=1 2024-09-12T18:59:59.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.528__shadow_.Nvhi-c_3bmBbQADm2oS6j0bA-zJ6bse_0 2024-09-12T18:59:59.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11957103874621204059', time=2024-09-12T20:43:14.108432+0000, chain.objs.size()=2 2024-09-12T18:59:59.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.558__shadow_.Ez4ohOofCDyYPnB8bCiLVDdS6rC0bUG_0 2024-09-12T18:59:59.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.558__shadow_.Ez4ohOofCDyYPnB8bCiLVDdS6rC0bUG_1 2024-09-12T18:59:59.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10334248405874454366', time=2024-09-12T20:43:51.220460+0000, chain.objs.size()=1 2024-09-12T18:59:59.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:Ec8KHW8X8Pq5th09YaK5DSyfuPP9.Wy_.4JB15SA8KE6ooIsgON-6GZaQI1l3SED_0 2024-09-12T18:59:59.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16352191814073069650', time=2024-09-12T20:44:14.107600+0000, chain.objs.size()=1 2024-09-12T18:59:59.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574__shadow:Q5wS6sIM0qGYU4EbXCzL19PJgsenmZj_.Wy5QiPAqvyTOhx2GzZs8ej_NWrUWq6J_0 2024-09-12T18:59:59.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4952755023271951009', time=2024-09-12T20:44:28.424365+0000, chain.objs.size()=1 2024-09-12T18:59:59.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.576__shadow:r9xROZR77hCOs2Xy-xtkDKUk-r0KkUS_.SXNsyw3cXy6LydbcKcv5oUTJ1Amb56v_0 2024-09-12T18:59:59.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3698859363239728388', time=2024-09-12T20:44:51.905322+0000, chain.objs.size()=1 2024-09-12T18:59:59.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:I6Htopsu8NSv9G8qrR5JbgmTOPUPNOK_.1d2dYOunSmYO93JoVZv6GBUAXSCpAe5_0 2024-09-12T18:59:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12717276948315895591', time=2024-09-12T20:45:41.014291+0000, chain.objs.size()=1 2024-09-12T18:59:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.582__shadow:ScqwfVnfrcRTONgVchzB3wTN3I.FGG9_.J2fXZ3v17OIOaOzMJ3bnglFx4cRD4Mt_0 2024-09-12T18:59:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.606876741021022101', time=2024-09-12T20:50:54.354493+0000, chain.objs.size()=1 2024-09-12T18:59:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.199+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.638__shadow_.Kk3A_PRgU1AHHK1CA1dg9mPB13AWUt2_0 2024-09-12T18:59:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.203+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.989136614899443955', time=2024-09-12T20:51:52.579673+0000, chain.objs.size()=6 2024-09-12T18:59:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.203+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.660__multipart_bar.2~W08VR1iAX6m48GAuKoGxLOxuquy1hTO.1 2024-09-12T18:59:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.203+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.660__multipart_bar.2~W08VR1iAX6m48GAuKoGxLOxuquy1hTO.2 2024-09-12T18:59:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.203+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.660__multipart_bar.2~W08VR1iAX6m48GAuKoGxLOxuquy1hTO.3 2024-09-12T18:59:59.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.203+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.660__multipart_bar.2~W08VR1iAX6m48GAuKoGxLOxuquy1hTO.4 2024-09-12T18:59:59.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.203+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.660__multipart_bar.2~W08VR1iAX6m48GAuKoGxLOxuquy1hTO.5 2024-09-12T18:59:59.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.203+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.660__multipart_bar.2~W08VR1iAX6m48GAuKoGxLOxuquy1hTO.6 2024-09-12T18:59:59.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.203+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1132027081654931095', time=2024-09-12T20:53:19.494310+0000, chain.objs.size()=1 2024-09-12T18:59:59.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.203+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.718__shadow_.6Vd3n6n2fW5WsHcmpZ9Vp_mRHbWyxYH_0 2024-09-12T18:59:59.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.203+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:59:59.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50431' 2024-09-12T18:59:59.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_dfb8Tvh8BsANNX23ykCITi2qPxo3uNA', time=2024-09-12T20:22:45.504069+0000, chain.objs.size()=3 2024-09-12T18:59:59.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.z7pxGdmRCL6CNToV_HkLa6rojT5FMLY_0 2024-09-12T18:59:59.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.z7pxGdmRCL6CNToV_HkLa6rojT5FMLY_1 2024-09-12T18:59:59.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.z7pxGdmRCL6CNToV_HkLa6rojT5FMLY_2 2024-09-12T18:59:59.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.488276014083279154', time=2024-09-12T20:23:44.481155+0000, chain.objs.size()=1 2024-09-12T18:59:59.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.199__shadow_.T6NwcBaNmDPw3QV-P_PV1Aomr3X3txm_0 2024-09-12T18:59:59.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5261388290794841273', time=2024-09-12T20:26:23.939087+0000, chain.objs.size()=1 2024-09-12T18:59:59.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.230__shadow_.K8pVEtqDwCA3IuZGzW8wjPARJ_K9Qxg_0 2024-09-12T18:59:59.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9413944742524051987', time=2024-09-12T20:26:23.940972+0000, chain.objs.size()=1 2024-09-12T18:59:59.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.230__shadow_.wnZjOgG89R8DgPpSPvez9-atceeSoSi_0 2024-09-12T18:59:59.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14883900918752583010', time=2024-09-12T20:26:25.302069+0000, chain.objs.size()=1 2024-09-12T18:59:59.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.231__shadow_.-ULW9Z14qwxswlXMUvElmeemnPj9paS_0 2024-09-12T18:59:59.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9607688054369695485', time=2024-09-12T20:26:43.417882+0000, chain.objs.size()=1 2024-09-12T18:59:59.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.243__shadow_.PA-p-GAEaZiS-7dsEqardqyC4tMZERL_0 2024-09-12T18:59:59.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15464159464672055331', time=2024-09-12T20:27:02.283289+0000, chain.objs.size()=1 2024-09-12T18:59:59.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.256__shadow_.HVjp1KTNyQj3tXrcXpdRvLeGp3oUIrW_0 2024-09-12T18:59:59.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13726340602175017212', time=2024-09-12T20:28:48.303736+0000, chain.objs.size()=1 2024-09-12T18:59:59.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.uXfwnpxfCNCKRTqLR6_-UZsWPRGWXsN_0 2024-09-12T18:59:59.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17164257080127227704', time=2024-09-12T20:28:48.482395+0000, chain.objs.size()=1 2024-09-12T18:59:59.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.N0yA3tSzTtiYMmCt7_qHFqU0XzxLZ9B_0 2024-09-12T18:59:59.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10571555282694695289', time=2024-09-12T20:28:49.004976+0000, chain.objs.size()=1 2024-09-12T18:59:59.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.207+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.uim91a0voV2Wi4Ewo98scbdeNe4Di8Y_0 2024-09-12T18:59:59.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12881685313776741821', time=2024-09-12T20:28:49.196838+0000, chain.objs.size()=1 2024-09-12T18:59:59.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Wwwrpq-yzrwdWOr84X-hrv2c8i8ZJMG_0 2024-09-12T18:59:59.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17108232974488394465', time=2024-09-12T20:28:51.775651+0000, chain.objs.size()=1 2024-09-12T18:59:59.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JZ6-PyF2ADGRSY6jodDe_XhwB9YUsk4_0 2024-09-12T18:59:59.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14322942161270457497', time=2024-09-12T20:28:52.707154+0000, chain.objs.size()=1 2024-09-12T18:59:59.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.E6Zulw0twpDmeOti6gOUo2YYy6MXtCN_0 2024-09-12T18:59:59.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16142384863827923930', time=2024-09-12T20:28:53.402491+0000, chain.objs.size()=1 2024-09-12T18:59:59.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.reJJDKzvkBy6Vha5fy7AcILAW_wgVNS_0 2024-09-12T18:59:59.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7315676995715810156', time=2024-09-12T20:28:53.672835+0000, chain.objs.size()=1 2024-09-12T18:59:59.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1-00UiLCAE3qjK8HsgHVDMtI55iBJnp_0 2024-09-12T18:59:59.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13996300150370124454', time=2024-09-12T20:28:55.451826+0000, chain.objs.size()=1 2024-09-12T18:59:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DHwj5w9PbF5YbGKkhKwSQGtokoNuTfI_0 2024-09-12T18:59:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16519022171347469141', time=2024-09-12T20:28:56.164106+0000, chain.objs.size()=1 2024-09-12T18:59:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.lw1dPEy9vUX_6yWGyAqgdIPZMDMw5IK_0 2024-09-12T18:59:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9749735807587367759', time=2024-09-12T20:28:57.811820+0000, chain.objs.size()=1 2024-09-12T18:59:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3TpnDLIH_30AXJ-E6Y9C9VnVKetXa0N_0 2024-09-12T18:59:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3458660728881806842', time=2024-09-12T20:28:59.626018+0000, chain.objs.size()=1 2024-09-12T18:59:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.L7KZCa48-oI_x5JdZnKDstfnT-Y16CI_0 2024-09-12T18:59:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2272427877466742022', time=2024-09-12T20:29:00.513098+0000, chain.objs.size()=1 2024-09-12T18:59:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ycyAaN8E31MrK9LU0aviweTVKMMGLi1_0 2024-09-12T18:59:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4521589155199131224', time=2024-09-12T20:29:01.700261+0000, chain.objs.size()=1 2024-09-12T18:59:59.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.211+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7Kao2Y6pJprUp8gVSKkQ1OTuTJxGIaq_0 2024-09-12T18:59:59.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18370185407675606847', time=2024-09-12T20:29:04.631465+0000, chain.objs.size()=1 2024-09-12T18:59:59.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Ef0q3y2QYy8XQu0Kj-L1_IHraY-WYpg_0 2024-09-12T18:59:59.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.787744531362375712', time=2024-09-12T20:29:07.706741+0000, chain.objs.size()=1 2024-09-12T18:59:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VVLEVnfHEYu-McXU_kMUUnzVF-1cXDP_0 2024-09-12T18:59:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1664936019300931707', time=2024-09-12T20:29:08.699938+0000, chain.objs.size()=1 2024-09-12T18:59:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.R9LuHqaY-syi2M89lkuDq6faltCTPVx_0 2024-09-12T18:59:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4096263154761076665', time=2024-09-12T20:29:08.823520+0000, chain.objs.size()=1 2024-09-12T18:59:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5cu03gyU1wJYq3_0iMl3FYLLxcIyAjR_0 2024-09-12T18:59:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18352572783641773054', time=2024-09-12T20:29:09.586496+0000, chain.objs.size()=1 2024-09-12T18:59:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VWgNWccLIaHGnzVW4U4NwSjAKIfa1tH_0 2024-09-12T18:59:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12867460584310262047', time=2024-09-12T20:29:09.968799+0000, chain.objs.size()=1 2024-09-12T18:59:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.RlBn1eykrtAKPqTXFMoUBe1YpO0hONi_0 2024-09-12T18:59:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6645199788932338390', time=2024-09-12T20:29:10.817086+0000, chain.objs.size()=1 2024-09-12T18:59:59.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DcPfg8WExPqAC_1msgvL-j3VOTOIM2h_0 2024-09-12T18:59:59.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4601550333836282478', time=2024-09-12T20:29:11.374299+0000, chain.objs.size()=1 2024-09-12T18:59:59.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5ScxJ5Hsma-lWigAkZ8ZYTerrway7fC_0 2024-09-12T18:59:59.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13021969211054723544', time=2024-09-12T20:29:12.164589+0000, chain.objs.size()=1 2024-09-12T18:59:59.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NMXg-IsS-zor_QefUgptdN03vnAke3t_0 2024-09-12T18:59:59.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8382871244850731717', time=2024-09-12T20:29:12.550386+0000, chain.objs.size()=1 2024-09-12T18:59:59.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.PiRveP1DCvKaKkoKfYp6I7YXHc_BgNL_0 2024-09-12T18:59:59.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.341658946841473576', time=2024-09-12T20:29:13.955534+0000, chain.objs.size()=1 2024-09-12T18:59:59.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9a3OvNfogrFFrXct0Eejidzvbypfp1q_0 2024-09-12T18:59:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9363050699785205277', time=2024-09-12T20:29:14.068027+0000, chain.objs.size()=1 2024-09-12T18:59:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Mz4RaImvE8dSoKVJeGQrcP4gaEb4nCh_0 2024-09-12T18:59:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3628010239480271932', time=2024-09-12T20:29:14.675730+0000, chain.objs.size()=1 2024-09-12T18:59:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.V-C53XiqoE4bQPKuBIz3cDty9rzIr_I_0 2024-09-12T18:59:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17773748327787412704', time=2024-09-12T20:29:14.978829+0000, chain.objs.size()=1 2024-09-12T18:59:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.owdXMCPBqmnmdBxqy5F0u-OZ5lVpVyx_0 2024-09-12T18:59:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12553918586021590505', time=2024-09-12T20:29:28.188403+0000, chain.objs.size()=1 2024-09-12T18:59:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.272__shadow_.QDwat-6QA4o6t7EYLIK9AFz-zsH-DOG_0 2024-09-12T18:59:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.902801085829798924', time=2024-09-12T20:29:33.545534+0000, chain.objs.size()=1 2024-09-12T18:59:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.276__shadow_.ohYOA0R7GU9gjztRjcHKcBLcVQJ4vnl_0 2024-09-12T18:59:59.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1520742277470460703', time=2024-09-12T20:29:40.637572+0000, chain.objs.size()=1 2024-09-12T18:59:59.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.281__shadow_.VCW_qLBz2PILmncCytHAxd4_ceqKM7D_0 2024-09-12T18:59:59.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14722876004680653542', time=2024-09-12T20:29:41.952792+0000, chain.objs.size()=1 2024-09-12T18:59:59.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.215+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.282__shadow_.NLYheNT-YFWvNEGuITeYFAqcxCq1B-T_0 2024-09-12T18:59:59.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7277170062010692572', time=2024-09-12T20:29:46.234543+0000, chain.objs.size()=1 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.285__shadow_.52DXGuGCBgFfSmKsAfhHk5yO3ygceNF_0 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14868854658692756762', time=2024-09-12T20:29:51.927905+0000, chain.objs.size()=1 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.289__shadow_.AdjIQb3FzObgRxTC8FihGKP8xeND21X_0 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.106112769135240488', time=2024-09-12T20:32:26.847739+0000, chain.objs.size()=1 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7q4lHrlWF8PCYRV16kmsYXujUjhIzyg_0 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9505112519130827895', time=2024-09-12T20:32:28.836354+0000, chain.objs.size()=1 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.77nA6Vs9lv3Kkr-9UnS4z6Q_iV7RJC7_0 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1911222523235915924', time=2024-09-12T20:32:28.990323+0000, chain.objs.size()=1 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hNo17NDRB9Zok5bi1ZaY1pd0NPQPADm_0 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14089142380325215264', time=2024-09-12T20:32:30.721153+0000, chain.objs.size()=1 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.52KOeGOLQbvSk_JHU4FPo8gdPZUo6DH_0 2024-09-12T18:59:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6881168936180293905', time=2024-09-12T20:32:31.046670+0000, chain.objs.size()=1 2024-09-12T18:59:59.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zE5IMUiFNt1IUEVepPrf1APE5nwSrXD_0 2024-09-12T18:59:59.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15772627009584987585', time=2024-09-12T20:32:31.892769+0000, chain.objs.size()=1 2024-09-12T18:59:59.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.um43vXNO6zWzeAU0VqCNKcV3RbIC6U1_0 2024-09-12T18:59:59.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10328293812323005328', time=2024-09-12T20:32:34.687714+0000, chain.objs.size()=1 2024-09-12T18:59:59.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.-D_im7sQ2DQSitU7fkbdFS1UfIJRHUT_0 2024-09-12T18:59:59.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9157516994119205497', time=2024-09-12T20:32:35.079671+0000, chain.objs.size()=1 2024-09-12T18:59:59.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.L8Nz2KDyeeH9ZEQD3nqTZL8GEJFlyr__0 2024-09-12T18:59:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16434141679062337837', time=2024-09-12T20:32:35.359625+0000, chain.objs.size()=1 2024-09-12T18:59:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hVAU_pG4JLwQJJTfvj0AMwoMKs34qEC_0 2024-09-12T18:59:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5834140607512973983', time=2024-09-12T20:32:35.969167+0000, chain.objs.size()=1 2024-09-12T18:59:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.OQdVllYV-D354cXHQG5kHu5F7k4tGP7_0 2024-09-12T18:59:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10237243186160941476', time=2024-09-12T20:32:36.953303+0000, chain.objs.size()=1 2024-09-12T18:59:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.b7NTXuI_3OeQew8EL63zoF8x8u05Eje_0 2024-09-12T18:59:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4653094854462393307', time=2024-09-12T20:32:38.175792+0000, chain.objs.size()=1 2024-09-12T18:59:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._hUWhZE2i9AWH5rpPwiZlAUi9QfnZiy_0 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13203285442440706227', time=2024-09-12T20:32:39.286211+0000, chain.objs.size()=1 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.fW28qpEepbHrBcOvX5FWwxxK-RhjOSb_0 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14309543289610736992', time=2024-09-12T20:32:40.254101+0000, chain.objs.size()=1 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pewt7L5Y2V5LalxImtFpMCbMWR6hnca_0 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2966678298668966997', time=2024-09-12T20:32:40.416212+0000, chain.objs.size()=1 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.219+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Vy9RU7MMyKq40gwqs1HQkOyoNyLnXYs_0 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18289975692368528544', time=2024-09-12T20:32:42.525241+0000, chain.objs.size()=1 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kafZbswE7vRcOccbFBonbu4ACIicoe6_0 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13230072781120452452', time=2024-09-12T20:32:43.244822+0000, chain.objs.size()=1 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.SZRiCU7k4TnSm_ecPD2yN0rXjDQzF_U_0 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2109617574468096578', time=2024-09-12T20:32:43.246093+0000, chain.objs.size()=1 2024-09-12T18:59:59.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jlD4Mr0xFomAXt0zeXebXTpnoZKOEE3_0 2024-09-12T18:59:59.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6762812435879085642', time=2024-09-12T20:32:43.556728+0000, chain.objs.size()=1 2024-09-12T18:59:59.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.5yOfSJM_pdobjExbpmsjMVjfVBVTnEL_0 2024-09-12T18:59:59.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12322142053300789399', time=2024-09-12T20:32:46.948175+0000, chain.objs.size()=1 2024-09-12T18:59:59.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.4ukX4dfpColHTsDmh2ZRRK93kNnD_Im_0 2024-09-12T18:59:59.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11839507952407984771', time=2024-09-12T20:32:49.446458+0000, chain.objs.size()=1 2024-09-12T18:59:59.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.PEV4sB7X_0QMBuZ0c1LlOBbtd-yFf_Y_0 2024-09-12T18:59:59.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15255630378129049932', time=2024-09-12T20:34:35.491731+0000, chain.objs.size()=1 2024-09-12T18:59:59.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kN1Zi9oHDVIZEETcQR4w7-R_q0PuJB2_0 2024-09-12T18:59:59.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16288692229291900113', time=2024-09-12T20:34:36.302118+0000, chain.objs.size()=1 2024-09-12T18:59:59.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._GYZkxAWZJgGXo3EUUeOnumgonsIqQt_0 2024-09-12T18:59:59.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1796020220060248055', time=2024-09-12T20:34:36.758783+0000, chain.objs.size()=1 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.x47_9Lbwc1FmPFowHQ4iDn10ESjARJi_0 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6296280100108825798', time=2024-09-12T20:34:38.678698+0000, chain.objs.size()=1 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wxsUhOX-PwgvKRUnZ6voSVVgbdWRY3V_0 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6986252857175938946', time=2024-09-12T20:34:39.418510+0000, chain.objs.size()=1 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._nhc4wUWuY-Bd1ehxN3aG8DIZdhhdQC_0 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.938074601117648138', time=2024-09-12T20:34:43.931172+0000, chain.objs.size()=1 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.2J0q0sSSCoCyx7xDLGqUWKeBUzuA-Pa_0 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1421418693577770873', time=2024-09-12T20:34:46.691767+0000, chain.objs.size()=1 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.t67bAzMkYNrOBO_ZkA_6W06RdBKjrzr_0 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11211827968619888797', time=2024-09-12T20:34:47.199788+0000, chain.objs.size()=1 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qb9CN-MFj-1v1o0xAuPlnox15Gn7JW7_0 2024-09-12T18:59:59.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13342126139956671159', time=2024-09-12T20:34:47.201513+0000, chain.objs.size()=1 2024-09-12T18:59:59.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.AGzYOKOzCQO9frl4yARqwgpLkUB7P_A_0 2024-09-12T18:59:59.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.478391922055194979', time=2024-09-12T20:34:47.499484+0000, chain.objs.size()=1 2024-09-12T18:59:59.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.223+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.mMq8XjcVAKLD14QbGEbAZ-qGLBrHEqy_0 2024-09-12T18:59:59.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14162031597302649373', time=2024-09-12T20:34:47.826851+0000, chain.objs.size()=1 2024-09-12T18:59:59.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BZTjVrKHAqqMnNCA1AcoAIqFK_oI2mB_0 2024-09-12T18:59:59.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8889518105247836698', time=2024-09-12T20:34:49.171735+0000, chain.objs.size()=1 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hTzJNWlUVVbftmbrUj0v_JZQM1z_Qfb_0 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9392707234362856101', time=2024-09-12T20:34:49.552567+0000, chain.objs.size()=1 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tikdcP_jOl3X31AMW8SbP0fbqitNKEd_0 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6191454974392788593', time=2024-09-12T20:34:52.165527+0000, chain.objs.size()=1 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UeZvu-e1OuQ_ceiSaK2dXI4YJvsAB3M_0 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2805800110418005107', time=2024-09-12T20:34:53.904895+0000, chain.objs.size()=1 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Cln3KiH0py6dVaT84P-1asZhI8NHK3Z_0 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3647265527413214868', time=2024-09-12T20:34:55.737688+0000, chain.objs.size()=1 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.DEBySbXzFQDuXJg7PIPDpE_vFMw32L6_0 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5079516934836725384', time=2024-09-12T20:34:55.844799+0000, chain.objs.size()=1 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.R3TkEQdZhA8CFnE6-9zeXaQshPDpl8n_0 2024-09-12T18:59:59.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.77330271537011988', time=2024-09-12T20:34:55.848171+0000, chain.objs.size()=1 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JZ-U95uWamd-sYiinPjYMvd70DUmMZa_0 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11676762297762976439', time=2024-09-12T20:34:57.077194+0000, chain.objs.size()=1 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.izXvkedAZ1oHbMbSZsNRj99ZhX9lxdv_0 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15179943522116305637', time=2024-09-12T20:34:57.241465+0000, chain.objs.size()=1 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.weorfQenqYVxRVr6b0hqQ7qteNwHVg7_0 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.639204375317290539', time=2024-09-12T20:34:59.503104+0000, chain.objs.size()=1 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.j2qyiDpxLVGUPQSXGrO3IqWRSb5HLhS_0 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16510465612559502724', time=2024-09-12T20:35:00.564234+0000, chain.objs.size()=1 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.pErEM1_97boy1kdG1gm2o3pzmlSgUPa_0 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17433956379184886816', time=2024-09-12T20:35:00.847392+0000, chain.objs.size()=1 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.A0oMe5s1w7KKkTJdWuxna82Iv0vDZ21_0 2024-09-12T18:59:59.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10799446632758209366', time=2024-09-12T20:35:15.786621+0000, chain.objs.size()=1 2024-09-12T18:59:59.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.337__shadow_.rSwnqGz9PfWEZQTpiWNdBSjEy0g1IBz_0 2024-09-12T18:59:59.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10485857037269514338', time=2024-09-12T20:35:45.472287+0000, chain.objs.size()=1 2024-09-12T18:59:59.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.370__shadow_.w8--38GBjekcuM4ER6YY2QOWZSSnYKq_0 2024-09-12T18:59:59.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5369888230023789627', time=2024-09-12T20:35:58.707868+0000, chain.objs.size()=1 2024-09-12T18:59:59.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.381__shadow_.ENHj-arkN-nGQVTo3tGyBuDoaANIUb5_0 2024-09-12T18:59:59.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16583512971470295753', time=2024-09-12T20:37:12.203621+0000, chain.objs.size()=1 2024-09-12T18:59:59.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.447__shadow_.2Zj-icMuY3jJPReBJQ2751doHxG7jvD_0 2024-09-12T18:59:59.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10773141972722831198', time=2024-09-12T20:37:52.063499+0000, chain.objs.size()=1 2024-09-12T18:59:59.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.481__shadow_.vVUWvkUpeIuO793DYc_EhANGCnaT1Uk_0 2024-09-12T18:59:59.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15484355744353544225', time=2024-09-12T20:38:20.530457+0000, chain.objs.size()=1 2024-09-12T18:59:59.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.500__shadow_.3JrmMczq5jDVFb2yP_UJ4I-4_KcvzFh_0 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11379059116051365743', time=2024-09-12T20:38:48.267099+0000, chain.objs.size()=1 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.515__shadow_.vy5j3Xh2ushhvZQvP8KrAmgpbLxujgC_0 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1510989573815091974', time=2024-09-12T20:41:14.492374+0000, chain.objs.size()=2 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.227+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~mnDrIQlKdEN029jetv-Gx6muGRTKfAM.1 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~mnDrIQlKdEN029jetv-Gx6muGRTKfAM.2 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2363666727748527224', time=2024-09-12T20:41:22.390923+0000, chain.objs.size()=2 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~ncsxyhi9sQ0A86hDXpsKw94TNN33WnM.1 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~ncsxyhi9sQ0A86hDXpsKw94TNN33WnM.2 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3880277540767215887', time=2024-09-12T20:43:45.570611+0000, chain.objs.size()=1 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:OMZ4iYB--Dz9P4alcuWB-Q7N6cEIqE3_.MYf5bM17hTZLlHzoJxaSYUTD8RGMGVQ_0 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16400041959604642952', time=2024-09-12T20:43:48.078646+0000, chain.objs.size()=1 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:3rp33UJcd-03M1z1ZeN6Am1cOwl2ZsP_.XZnYJ0wH9nRB2f_wFetUTuP5fQC_TKS_0 2024-09-12T18:59:59.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4117921220821019871', time=2024-09-12T20:44:15.267495+0000, chain.objs.size()=1 2024-09-12T18:59:59.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574__shadow:k51Oe72tn7Ua5TcOB7UDASyqSJVPHyF_.pe9DQaBC92dXw8sLNcx2yf1UvIOizp0_0 2024-09-12T18:59:59.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8909490415664580863', time=2024-09-12T20:44:31.182812+0000, chain.objs.size()=1 2024-09-12T18:59:59.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.576__shadow:e3hFWv9UjIouG1nKPRKNZURZS-Bz3Bz_.HoA5zhwpdiaU1GirMWQE7t2ecqpICdl_0 2024-09-12T18:59:59.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16179600679458122083', time=2024-09-12T20:44:52.589552+0000, chain.objs.size()=1 2024-09-12T18:59:59.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:3aLHY9ScuXZr-r88ZGo1rM7QXJ5VIt._.xDWObQeFAv4UO2mIoQfgpndFcWeBeJF_0 2024-09-12T18:59:59.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7075368480202209959', time=2024-09-12T20:45:08.897146+0000, chain.objs.size()=1 2024-09-12T18:59:59.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:NVhEANN3AfReyYUV4JK1lBI6jQawpoG_.N4CzSHu8sJii3dQZ8HVnAGPARyLvW-x_0 2024-09-12T18:59:59.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.231+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50431 2024-09-12T18:59:59.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:59:59.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6565688374200095256', time=2024-09-12T20:45:47.005413+0000, chain.objs.size()=1 2024-09-12T18:59:59.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.585__shadow:LIGRiPqeohxKH5uRHYhVyuVPQqS1Bgy_.V7Yd60AVQddaXsyg4xRm1DqJPWm_XDc_0 2024-09-12T18:59:59.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7840508273617398322', time=2024-09-12T20:50:46.652854+0000, chain.objs.size()=1 2024-09-12T18:59:59.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.632__shadow_.f9QOr4OG6b56af7wYGxsBk9HLvXTUJi_0 2024-09-12T18:59:59.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5125248764446337314', time=2024-09-12T20:51:02.169718+0000, chain.objs.size()=1 2024-09-12T18:59:59.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.643__shadow_.d32E_Y_wha9vO04BXmeSasWO3TyW-Jm_0 2024-09-12T18:59:59.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.193530574008267959', time=2024-09-12T20:51:55.221671+0000, chain.objs.size()=1 2024-09-12T18:59:59.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.663__shadow_.vagN9_dcXffDrHA8tL-xHILbOZl-q5c_0 2024-09-12T18:59:59.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8128387843356182682', time=2024-09-12T20:51:57.231747+0000, chain.objs.size()=1 2024-09-12T18:59:59.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.664__shadow_.jiyMONgh56DZ9YMW_LKKMRq4_7OqtTz_0 2024-09-12T18:59:59.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~3uwvjptc04X8AAJIkTEi5Vfd43OyrB6', time=2024-09-12T20:53:56.613796+0000, chain.objs.size()=1 2024-09-12T18:59:59.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.235+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.742__multipart_mymultipart2.2~3uwvjptc04X8AAJIkTEi5Vfd43OyrB6.1 2024-09-12T18:59:59.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.239+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.239+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:59:59.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54265' 2024-09-12T18:59:59.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6158336441449635273', time=2024-09-12T20:26:25.302032+0000, chain.objs.size()=1 2024-09-12T18:59:59.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.231__shadow_.CKzkSg0wQ1JJpiZ2HbRSRM0hHJGL4GD_0 2024-09-12T18:59:59.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10722242428087807096', time=2024-09-12T20:26:30.964749+0000, chain.objs.size()=1 2024-09-12T18:59:59.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.235__shadow_.WgmdYuTiQ0hoZr4WaAXfWmDAKFoWwlx_0 2024-09-12T18:59:59.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14997089360428306621', time=2024-09-12T20:26:38.596531+0000, chain.objs.size()=1 2024-09-12T18:59:59.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.240__shadow_.iAj8qii6RoRt0qATolA6XgaTuckdXrc_0 2024-09-12T18:59:59.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7755385923388731993', time=2024-09-12T20:28:49.197260+0000, chain.objs.size()=1 2024-09-12T18:59:59.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CD0zIDUMhSg6ffVv_xcJ6sdQJ-K-Fp__0 2024-09-12T18:59:59.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4701060526928353003', time=2024-09-12T20:28:49.480778+0000, chain.objs.size()=1 2024-09-12T18:59:59.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.G9u6svGS3spJiOPCUl4SWMXthXYi0vS_0 2024-09-12T18:59:59.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17982208632038408966', time=2024-09-12T20:28:49.995348+0000, chain.objs.size()=1 2024-09-12T18:59:59.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.6EnFAJP7XOIxwgx1awaKFf9_5ejnz3l_0 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6086977750192655553', time=2024-09-12T20:28:52.305114+0000, chain.objs.size()=1 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3As2_gdTBPzys0cZGRY6mM6rnwQvxUx_0 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7108715376196051652', time=2024-09-12T20:28:54.009337+0000, chain.objs.size()=1 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.YDSoWLQ7VGmdExQxm0qApfM6sP5zfGO_0 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5282680847982666167', time=2024-09-12T20:28:55.404267+0000, chain.objs.size()=1 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.g-xsKd5I2zwh9EfCUB9LkanXK3vSHpB_0 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11708713771584862879', time=2024-09-12T20:28:56.261072+0000, chain.objs.size()=1 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.mlovHim35rdIKIoV2jGbqkLXENp8GIJ_0 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1253197649369931800', time=2024-09-12T20:28:56.837793+0000, chain.objs.size()=1 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.i2z_ufJ5i2t8iPAvoLNK437HghqkiCW_0 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10821822775724676224', time=2024-09-12T20:29:00.155942+0000, chain.objs.size()=1 2024-09-12T18:59:59.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.243+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.jILs8Sh4TiYzFAHV2ErVhhpXN06MzC6_0 2024-09-12T18:59:59.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11526730732718188272', time=2024-09-12T20:29:00.876245+0000, chain.objs.size()=1 2024-09-12T18:59:59.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DMBFHy81YtasQjmM0MOfa0bkTMAUZIa_0 2024-09-12T18:59:59.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.329805594750353500', time=2024-09-12T20:29:01.201581+0000, chain.objs.size()=1 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ir6fRuQlJh4Gxe3dY2C1SPejwEMaht2_0 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12432814616590655042', time=2024-09-12T20:29:03.195679+0000, chain.objs.size()=1 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.-AZHMUh387a5FS4f_0hH_v9DVIdgSrp_0 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7729961729949115625', time=2024-09-12T20:29:04.538532+0000, chain.objs.size()=1 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.UW4_VZbQcl3IqmQRsc5aKKbns9EZYf3_0 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6818795981676846264', time=2024-09-12T20:29:04.893088+0000, chain.objs.size()=1 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Hu-HCuknL_p9cl5Q9m5eNI723xIWjgZ_0 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15013528993944639154', time=2024-09-12T20:29:05.017687+0000, chain.objs.size()=1 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VTc61AOfgmZk2qb4b5PJ61Ja3W4BC3t_0 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1708990114181536551', time=2024-09-12T20:29:06.500213+0000, chain.objs.size()=1 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ymbSMbxVGpYfwPDc9tQWXXSyNCOGhem_0 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10050727551232878959', time=2024-09-12T20:29:06.869043+0000, chain.objs.size()=1 2024-09-12T18:59:59.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NVyfY0A0TKIrPVHs02vIJvZw45LNCWh_0 2024-09-12T18:59:59.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2914550987222386964', time=2024-09-12T20:29:06.873005+0000, chain.objs.size()=1 2024-09-12T18:59:59.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bwSKsFY2scj6g_C-Rs5_0jKGXAsuFPu_0 2024-09-12T18:59:59.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16077791187695896353', time=2024-09-12T20:29:06.874715+0000, chain.objs.size()=1 2024-09-12T18:59:59.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.pXlFX3e0RZP5_4pcQ-vwn2tIyDc-nI6_0 2024-09-12T18:59:59.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2834078718509908075', time=2024-09-12T20:29:06.876652+0000, chain.objs.size()=1 2024-09-12T18:59:59.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SykrAz_ooi31LqvwkbkjHjlwFZrZgvN_0 2024-09-12T18:59:59.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9258098472107340008', time=2024-09-12T20:29:07.360078+0000, chain.objs.size()=1 2024-09-12T18:59:59.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ECPueuWHJbeDH1awh1fsgLuEg0SDO9d_0 2024-09-12T18:59:59.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1780991382671596996', time=2024-09-12T20:29:08.123003+0000, chain.objs.size()=1 2024-09-12T18:59:59.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Bug-W341Bycc1ubrHTx8DuX8O1F0gdd_0 2024-09-12T18:59:59.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2498434435102571659', time=2024-09-12T20:29:08.402032+0000, chain.objs.size()=1 2024-09-12T18:59:59.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kb1Wj7hwXe8pfp5hNBB5aKR2zn33Buj_0 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12886802717161541109', time=2024-09-12T20:29:09.927716+0000, chain.objs.size()=1 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7Ju1UTKpnEZiVimMTRYsxFIgIgkdi_o_0 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14084691052123470233', time=2024-09-12T20:29:11.115187+0000, chain.objs.size()=1 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.g1lm6GU8M2xCVifQhyYgkHZeD9Af3z4_0 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9315988381974852261', time=2024-09-12T20:29:11.588902+0000, chain.objs.size()=1 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CNoPeldd1Wy1QyBLRZIKFCp69XoobHt_0 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16587741597432546519', time=2024-09-12T20:29:11.877018+0000, chain.objs.size()=1 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.j-IPykBEcWiIV3u9LvkHzE_SCRSAqcS_0 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2678751814635286399', time=2024-09-12T20:29:12.497963+0000, chain.objs.size()=1 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.-0lO39TyMef5nz7Vao-9kbu-FF3VcLW_0 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17415487452230371573', time=2024-09-12T20:29:14.308939+0000, chain.objs.size()=1 2024-09-12T18:59:59.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7eHs2Fy8d-QwqUy0oU3If0FJVIJIr_m_0 2024-09-12T18:59:59.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5430517343291785483', time=2024-09-12T20:29:14.505631+0000, chain.objs.size()=1 2024-09-12T18:59:59.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VvRRcZChLKG0eCham48tr8SsdCz_E_E_0 2024-09-12T18:59:59.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2750674246236216761', time=2024-09-12T20:29:14.675528+0000, chain.objs.size()=1 2024-09-12T18:59:59.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.247+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.MGdcPmdI0dbtYIc7KE_2xYPQab7-eYH_0 2024-09-12T18:59:59.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17494278485788104986', time=2024-09-12T20:29:20.582353+0000, chain.objs.size()=1 2024-09-12T18:59:59.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.266__shadow_.ZcplXmRtl6cKaOSe3-RIHOsCc46GfLz_0 2024-09-12T18:59:59.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.328262400924743670', time=2024-09-12T20:30:03.589266+0000, chain.objs.size()=1 2024-09-12T18:59:59.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.u2dDu-Wa5zTdWTYGPH6BKORaL-n9uDn_0 2024-09-12T18:59:59.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4612324474607183352', time=2024-09-12T20:30:06.715762+0000, chain.objs.size()=1 2024-09-12T18:59:59.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.295__shadow_.otVmaA1MxJF_c7LkfkSkUX5VJaNnYUf_0 2024-09-12T18:59:59.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10603943115723662223', time=2024-09-12T20:30:12.523100+0000, chain.objs.size()=1 2024-09-12T18:59:59.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.299__shadow_.eAESeE3af9cE9SiwZlQ75XA2SrPEgda_0 2024-09-12T18:59:59.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11352045390021347905', time=2024-09-12T20:30:45.571740+0000, chain.objs.size()=1 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.322__shadow_.lOLNGSieaXAmv2jRtXzYS8PD8i1tCLt_0 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5127738915776768342', time=2024-09-12T20:32:26.846845+0000, chain.objs.size()=1 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rqPY1-ycCXH8bBZCPMIw4eGTZwP_9mx_0 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7650769981396820612', time=2024-09-12T20:32:27.637637+0000, chain.objs.size()=1 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ySzcDL84z7pun9dxP4m7W6AnY28xSae_0 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4210853924970212377', time=2024-09-12T20:32:28.202571+0000, chain.objs.size()=1 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.d_2P9iOZLLPGrtgEOVvd6zN4Gwe9N_q_0 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18163752711074954496', time=2024-09-12T20:32:29.602505+0000, chain.objs.size()=1 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.W-RMshptMp5ETJy4BDwxQgpcErwseIG_0 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5957702462080034149', time=2024-09-12T20:32:30.619532+0000, chain.objs.size()=1 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.K9T0v9H-bw4IjGEcQ9d45kCpcgRxciC_0 2024-09-12T18:59:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3949900918513042685', time=2024-09-12T20:32:31.298336+0000, chain.objs.size()=1 2024-09-12T18:59:59.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.bcgicXhtArRNe23HEDKZ33G5N0cjEap_0 2024-09-12T18:59:59.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2724053418299111603', time=2024-09-12T20:32:32.086174+0000, chain.objs.size()=1 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.SJfuO8bfN3NnzRG4lgb0kuTDJSJLzvK_0 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14224300531179154600', time=2024-09-12T20:32:32.204161+0000, chain.objs.size()=1 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.OaprOhtOBmF3ARi-RnAOwWu6AHsbULs_0 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10699824505500027123', time=2024-09-12T20:32:32.854647+0000, chain.objs.size()=1 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.251+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.V9YrRmKe7GyqzzsBqFrS-Rn3uqFh8HU_0 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.350898183138479587', time=2024-09-12T20:32:33.125072+0000, chain.objs.size()=1 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rxnLxmE-EqGNmjkynXH73gwBJt8A3k1_0 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14940447642249175588', time=2024-09-12T20:32:33.306381+0000, chain.objs.size()=1 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.klDHSkfGrnAItjsIYK0wH77ZFYBFp3r_0 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12175144262146139198', time=2024-09-12T20:32:34.360800+0000, chain.objs.size()=1 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.TspEHR2-JgUmRHHcjXWZsMcixUqh_88_0 2024-09-12T18:59:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5737679914456858744', time=2024-09-12T20:32:34.953648+0000, chain.objs.size()=1 2024-09-12T18:59:59.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zK4N5mg9wQsz08Z_-6AOgfVUF_u_fqa_0 2024-09-12T18:59:59.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3396907560189132237', time=2024-09-12T20:32:36.660470+0000, chain.objs.size()=1 2024-09-12T18:59:59.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.5xDtE8C3c1jwZ-hiG7UyTMEVHxd5cFI_0 2024-09-12T18:59:59.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10422696102572280636', time=2024-09-12T20:32:41.392722+0000, chain.objs.size()=1 2024-09-12T18:59:59.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.NOofhYqNb8PSiBqMCL1lzMMnsT8tTs__0 2024-09-12T18:59:59.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.172047340255221195', time=2024-09-12T20:32:41.975828+0000, chain.objs.size()=1 2024-09-12T18:59:59.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1mmfR3UwOT781Yr3urSWzKdO7S_sV-d_0 2024-09-12T18:59:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18043252588706429903', time=2024-09-12T20:32:43.235970+0000, chain.objs.size()=1 2024-09-12T18:59:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.cN7lRyu2U2hUZ-2q2biU4EM5KQhDRhq_0 2024-09-12T18:59:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9658463943781118588', time=2024-09-12T20:32:43.313525+0000, chain.objs.size()=1 2024-09-12T18:59:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jFcNKbru0RoPnPL_6w8PqRlvYyYd4W8_0 2024-09-12T18:59:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1301132810149438466', time=2024-09-12T20:32:45.810164+0000, chain.objs.size()=1 2024-09-12T18:59:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.g_q02NTpNHipofPakdtQdzUSSX0m_yc_0 2024-09-12T18:59:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18283729706628095583', time=2024-09-12T20:32:46.519211+0000, chain.objs.size()=1 2024-09-12T18:59:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.G28Htn8I6avV1VRA-5BjGES6Fn6y1MD_0 2024-09-12T18:59:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12602169066440145226', time=2024-09-12T20:32:47.319298+0000, chain.objs.size()=1 2024-09-12T18:59:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.255+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.O1Lhfk1n9MA4KEvtmCkSMfbsVUcBLIV_0 2024-09-12T18:59:59.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15140071409488129205', time=2024-09-12T20:32:48.966475+0000, chain.objs.size()=1 2024-09-12T18:59:59.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ywhcaNM4YcXcgpwIV6lkZLZmR_lesal_0 2024-09-12T18:59:59.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1081831723893500641', time=2024-09-12T20:32:49.448792+0000, chain.objs.size()=1 2024-09-12T18:59:59.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eyCmWPmQSdqjn0l7JONi6LjujPcWiGf_0 2024-09-12T18:59:59.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.532488607382318116', time=2024-09-12T20:32:49.594708+0000, chain.objs.size()=1 2024-09-12T18:59:59.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nOW5plmEM2pJTT9WknDzQe02W89E1Rc_0 2024-09-12T18:59:59.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13742454552230493', time=2024-09-12T20:32:50.095619+0000, chain.objs.size()=1 2024-09-12T18:59:59.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8AZdIeYF_4tVP5yKw51iHsEibdh49R3_0 2024-09-12T18:59:59.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13300636005997083759', time=2024-09-12T20:32:52.049820+0000, chain.objs.size()=1 2024-09-12T18:59:59.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.aXowMI2gtrpgf7RVI2O_CuHqxVUmTko_0 2024-09-12T18:59:59.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10009364422597582432', time=2024-09-12T20:32:52.432655+0000, chain.objs.size()=1 2024-09-12T18:59:59.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.r12_lDrQdngVJPt3c0gqfkP8n5emuDV_0 2024-09-12T18:59:59.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8103914696262250024', time=2024-09-12T20:32:52.642380+0000, chain.objs.size()=1 2024-09-12T18:59:59.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ARrFlH-VY98pT4qz1YunDlI5t0fArDd_0 2024-09-12T18:59:59.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5680906979705031699', time=2024-09-12T20:32:52.750646+0000, chain.objs.size()=1 2024-09-12T18:59:59.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Cl7Q056V6dWqCPKjVnUKUJhQneAkBdS_0 2024-09-12T18:59:59.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5542262316767935678', time=2024-09-12T20:32:53.685825+0000, chain.objs.size()=1 2024-09-12T18:59:59.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ueHmHkPSsg_twKFr2lwjtrjsgDvEBQ7_0 2024-09-12T18:59:59.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3208993230298424095', time=2024-09-12T20:34:34.865333+0000, chain.objs.size()=1 2024-09-12T18:59:59.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.D4nXg6-zqDHimJRAsHgH0huuqfMPCeS_0 2024-09-12T18:59:59.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3019326804180522836', time=2024-09-12T20:34:35.103995+0000, chain.objs.size()=1 2024-09-12T18:59:59.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.KeGfzDPjhNQRRQzvDRPtheF8VpCb3pP_0 2024-09-12T18:59:59.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7051685110759925717', time=2024-09-12T20:34:35.581909+0000, chain.objs.size()=1 2024-09-12T18:59:59.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3H-cZ0gALmMheUYRYrvuc9V3fox4-2W_0 2024-09-12T18:59:59.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12850455404402097899', time=2024-09-12T20:34:35.765624+0000, chain.objs.size()=1 2024-09-12T18:59:59.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.b9D01cH1sfSTbvcMfUqHDRd1Uzc_TVw_0 2024-09-12T18:59:59.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10318819087568807890', time=2024-09-12T20:34:36.615775+0000, chain.objs.size()=1 2024-09-12T18:59:59.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.axPTjzITJnXld90lQY-gTdLCuATufSj_0 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5236983764930383777', time=2024-09-12T20:34:39.925447+0000, chain.objs.size()=1 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.O4CCVrcXTYiCw55KuAo6NtesSYOymhR_0 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14972732588531439292', time=2024-09-12T20:34:40.693033+0000, chain.objs.size()=1 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.haGKfDu-CWTO8nGRQVrXbYj1QODZcmb_0 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4007351406837828466', time=2024-09-12T20:34:42.442023+0000, chain.objs.size()=1 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UGDZV1_7yR6I2hNbVhQ8kaDjowkIc5y_0 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14256243906776832777', time=2024-09-12T20:34:42.587598+0000, chain.objs.size()=1 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.o8HxrK6WnmOOUbW9U2eNjvArq-Rlv3E_0 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3489182695404581625', time=2024-09-12T20:34:43.625804+0000, chain.objs.size()=1 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QvsoKtU0DcDtgiJ20mcHQ0uwzHa3uSp_0 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15087125784403881292', time=2024-09-12T20:34:45.060374+0000, chain.objs.size()=1 2024-09-12T18:59:59.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.skEtueugkbpiNd1OGsSNlkXxBIOjG5K_0 2024-09-12T18:59:59.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16434849615471705617', time=2024-09-12T20:34:46.430399+0000, chain.objs.size()=1 2024-09-12T18:59:59.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.rhkNdxBkGcq6rHRR-T9onuxTSpvEFAK_0 2024-09-12T18:59:59.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17025454837901874643', time=2024-09-12T20:34:46.921602+0000, chain.objs.size()=1 2024-09-12T18:59:59.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.259+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.w7rXKqlFHlAXWR743BOG2FburzRDV2E_0 2024-09-12T18:59:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.344181164648668800', time=2024-09-12T20:34:47.559040+0000, chain.objs.size()=1 2024-09-12T18:59:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Tz66IddLHpGxXSSSb6GvsXoUJOKCoSN_0 2024-09-12T18:59:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15988865191107142499', time=2024-09-12T20:34:49.631923+0000, chain.objs.size()=1 2024-09-12T18:59:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vfqGQGViIwm2rYCgCIhKMn9hnjc5GTT_0 2024-09-12T18:59:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11460259237092430340', time=2024-09-12T20:34:50.028721+0000, chain.objs.size()=1 2024-09-12T18:59:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.twTee_xn9gBjcc-e5imfQJccRPa-h3w_0 2024-09-12T18:59:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2887687921234166600', time=2024-09-12T20:34:50.399689+0000, chain.objs.size()=1 2024-09-12T18:59:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5QelgDWtPOtDO9Oo3TKkI1mI6sT-8ug_0 2024-09-12T18:59:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3229801053683964217', time=2024-09-12T20:34:52.533363+0000, chain.objs.size()=1 2024-09-12T18:59:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LYJNFEC4LX9Gu0FT7gDfQ9YX5TRVmoY_0 2024-09-12T18:59:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8927931577585739269', time=2024-09-12T20:34:52.841891+0000, chain.objs.size()=1 2024-09-12T18:59:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.38YXHk3rUDqEedNZ3ZmEzCCVgXTcZtj_0 2024-09-12T18:59:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8262606941654468313', time=2024-09-12T20:34:53.032603+0000, chain.objs.size()=1 2024-09-12T18:59:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JbcOVwQ7AFmVxBmpCcCQX8vUvdpUakm_0 2024-09-12T18:59:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11196571715228265944', time=2024-09-12T20:34:53.319259+0000, chain.objs.size()=1 2024-09-12T18:59:59.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.W8qnoMaRStUaUSebVB8N-3whBV8GglT_0 2024-09-12T18:59:59.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13080669791605791450', time=2024-09-12T20:34:54.448357+0000, chain.objs.size()=1 2024-09-12T18:59:59.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.KGYRF1-WdARF5EIHM6DAVBAefUE_nkZ_0 2024-09-12T18:59:59.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7596685208254710266', time=2024-09-12T20:34:54.528678+0000, chain.objs.size()=1 2024-09-12T18:59:59.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XQijCzBtTh2YDKfdt0XPO_poWUnxZZH_0 2024-09-12T18:59:59.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.273529411213346215', time=2024-09-12T20:34:54.905333+0000, chain.objs.size()=1 2024-09-12T18:59:59.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.FuoBf2osz1hlLdpn65lvavhK-pMakxk_0 2024-09-12T18:59:59.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16732015402374923075', time=2024-09-12T20:34:56.036716+0000, chain.objs.size()=1 2024-09-12T18:59:59.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.GS-yODgBL9sYsReAkuH9oazRK9_HWCT_0 2024-09-12T18:59:59.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18317282455572877303', time=2024-09-12T20:34:57.106528+0000, chain.objs.size()=1 2024-09-12T18:59:59.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.solRnNg-5AfCPc3m9urwYf2-QiMKx4u_0 2024-09-12T18:59:59.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3224159398193560857', time=2024-09-12T20:34:58.455956+0000, chain.objs.size()=1 2024-09-12T18:59:59.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.M01nf9YDpBoyNBrBYKSMmGjeItNfvOh_0 2024-09-12T18:59:59.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10214962864664704284', time=2024-09-12T20:34:59.932656+0000, chain.objs.size()=1 2024-09-12T18:59:59.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.263+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.axLaEgJHIkwuAr6dbtJ9C5GeKSxVTP5_0 2024-09-12T18:59:59.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.267+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17264025535918776914', time=2024-09-12T20:35:00.502565+0000, chain.objs.size()=1 2024-09-12T18:59:59.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.267+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RJh5H1UJBc3aItU0xKyooV_AO2rURxp_0 2024-09-12T18:59:59.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.267+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11401689868819040734', time=2024-09-12T20:35:00.563570+0000, chain.objs.size()=1 2024-09-12T18:59:59.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.267+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.guCPTFnohk8LYoCqCO5H1sDw1bIOHeG_0 2024-09-12T18:59:59.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.267+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6659805437734187204', time=2024-09-12T20:35:01.577979+0000, chain.objs.size()=1 2024-09-12T18:59:59.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.267+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.OXEMHF50-BKJjZJA_xe8nSd0GDVEt-s_0 2024-09-12T18:59:59.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.267+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54265 2024-09-12T18:59:59.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:59:59.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11645879808864135210', time=2024-09-12T20:35:06.694036+0000, chain.objs.size()=1 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.329__shadow_.WncuErAUy8pDn613ZfeQFb4-bN1EpYy_0 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6406306452594844240', time=2024-09-12T20:36:56.705247+0000, chain.objs.size()=1 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.435__shadow_.mxbVA1O-QxVwUgo9Q6w0GVt2advtUMp_0 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1602572215296914299', time=2024-09-12T20:37:52.063314+0000, chain.objs.size()=1 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.481__shadow_.hR2LbSuTqdG2IXSK-t8ClmDiLxaSOAc_0 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2995988434981030756', time=2024-09-12T20:37:58.474037+0000, chain.objs.size()=1 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.484__shadow_.xNf7NcWt7Vf25t7yRMQaLsrHR-OsV4x_0 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12102576523839052348', time=2024-09-12T20:38:58.038090+0000, chain.objs.size()=2 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.517__shadow_.tNaNrZOxxw4yq4Mj-lCGqSzpU2o-9km_0 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.517__shadow_.tNaNrZOxxw4yq4Mj-lCGqSzpU2o-9km_1 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tYdUocEy9HpoLahAvOW2g6tmwS8JLtK', time=2024-09-12T20:39:43.273524+0000, chain.objs.size()=1 2024-09-12T18:59:59.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~tYdUocEy9HpoLahAvOW2g6tmwS8JLtK.1 2024-09-12T18:59:59.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2453975744694103450', time=2024-09-12T20:41:31.096494+0000, chain.objs.size()=1 2024-09-12T18:59:59.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.524__shadow_.IG_6yJnRYppwz3_Z--J8Uv0JG-dI2lZ_0 2024-09-12T18:59:59.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4401809048930039342', time=2024-09-12T20:43:06.087463+0000, chain.objs.size()=1 2024-09-12T18:59:59.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.556__shadow_.kBu0sCRNx8I_ORErC38wePBBx0gQB_t_0 2024-09-12T18:59:59.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16880862045389693114', time=2024-09-12T20:43:17.031043+0000, chain.objs.size()=1 2024-09-12T18:59:59.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.558__shadow_.CARXfgxfiPZBwX9oQHVA44aU4y4eJdR_0 2024-09-12T18:59:59.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4816951110441759149', time=2024-09-12T20:44:16.372403+0000, chain.objs.size()=1 2024-09-12T18:59:59.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574__shadow:hfdb6jnrZXMRWB6hhhuChVX.ftguCih_.roPZ8gRUa67etdp-HPvkJD4vp3IUAlb_0 2024-09-12T18:59:59.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14436573114742059447', time=2024-09-12T20:45:03.044431+0000, chain.objs.size()=1 2024-09-12T18:59:59.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:phv.HyGnxMEYHbAll0D7FB-2BAnQSud_.EflinuX9fyYFmAoPbsXNtkQlUJzBz6t_0 2024-09-12T18:59:59.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2036869428942937298', time=2024-09-12T20:45:39.760671+0000, chain.objs.size()=1 2024-09-12T18:59:59.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.580__shadow:gSyCbv7JlZ4b7cjM3iKnyLb1.eZeLDX_.glXCm9i6SyKWFOrIBwQdyquP5XrF40I_0 2024-09-12T18:59:59.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13788558294543213406', time=2024-09-12T20:46:12.951950+0000, chain.objs.size()=1 2024-09-12T18:59:59.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.607__shadow_.4qIcy4XsvGj3kN8RVehdyf0G5dtmA2f_0 2024-09-12T18:59:59.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5484855263787312275', time=2024-09-12T20:52:51.926521+0000, chain.objs.size()=1 2024-09-12T18:59:59.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.711__multipart_file1.2~kjKpbQ5Ud6BOBE92pYMh9t2cgUpv-ie.1 2024-09-12T18:59:59.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17994495506488477511', time=2024-09-12T20:52:54.305404+0000, chain.objs.size()=1 2024-09-12T18:59:59.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.271+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.713__shadow:GGVo5A2Hxw-WudaJ-WmN2Zg.BPHsv.g_.6EsSmA6raFoQj10-HiktTANUofLkPwV_0 2024-09-12T18:59:59.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.275+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.275+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:59:59.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48896' 2024-09-12T18:59:59.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_2usGFaGDSLB20guc8cGV7r2d1zY0dzW', time=2024-09-12T20:22:52.843602+0000, chain.objs.size()=1 2024-09-12T18:59:59.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.165__shadow_.xAXHFWvRzwEAJj23k-Ahbaw2MG3boDW_0 2024-09-12T18:59:59.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8749259823355258359', time=2024-09-12T20:23:17.740385+0000, chain.objs.size()=1 2024-09-12T18:59:59.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.182__shadow_.c8PBpoN9ZmFHriyUon_OTOwlONlSBW__0 2024-09-12T18:59:59.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.960932348978239747', time=2024-09-12T20:26:32.387226+0000, chain.objs.size()=1 2024-09-12T18:59:59.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.236__shadow_.31eEVSh0yQgM5FOYGLMxEXJd2z6OWNK_0 2024-09-12T18:59:59.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8453620492659120049', time=2024-09-12T20:26:46.847794+0000, chain.objs.size()=1 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.245__shadow_._YnG_ipHmNsxa3FAshMS4L3HCPQljuE_0 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11284706177510000828', time=2024-09-12T20:27:03.542449+0000, chain.objs.size()=1 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.257__shadow_.BIu5u5jSbR2qkVXpISeFv-qyXQ4Kg0J_0 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13464857330610958242', time=2024-09-12T20:27:04.780849+0000, chain.objs.size()=1 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.258__shadow_.E3l8s8UcivgeB77T3Ap_hpcDhE8E_03_0 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13118114406229269935', time=2024-09-12T20:27:06.107800+0000, chain.objs.size()=1 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.259__shadow_.Lngckg8MEI-MKdqZnwYUgZOnsZe3m2K_0 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8180743865748524474', time=2024-09-12T20:28:47.752059+0000, chain.objs.size()=1 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Y5_v-oTlk6GueZehhdVEIRiS5rlY1ky_0 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3202219397536628740', time=2024-09-12T20:28:47.858617+0000, chain.objs.size()=1 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.80fI_8ANxZg6oHYBCdEedOZIZEznASY_0 2024-09-12T18:59:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18268384980512793230', time=2024-09-12T20:28:48.874907+0000, chain.objs.size()=1 2024-09-12T18:59:59.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CybgGWdsWdIY16JCxO7KAxEdByRA2TM_0 2024-09-12T18:59:59.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15795190113940892623', time=2024-09-12T20:28:49.810060+0000, chain.objs.size()=1 2024-09-12T18:59:59.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.RnSjOt3mje6iceCHISxtOwXob3Af1-O_0 2024-09-12T18:59:59.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13651294306892445081', time=2024-09-12T20:28:52.038688+0000, chain.objs.size()=1 2024-09-12T18:59:59.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.279+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AALG0Ev1ACe2uOkmfpLQ5wE69ucR7wf_0 2024-09-12T18:59:59.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7728847666844044685', time=2024-09-12T20:28:52.223141+0000, chain.objs.size()=1 2024-09-12T18:59:59.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Yiv9TnsUB6ZBJZpKupOtH_3zGTvmnjO_0 2024-09-12T18:59:59.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6926122296875642917', time=2024-09-12T20:28:52.325957+0000, chain.objs.size()=1 2024-09-12T18:59:59.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fAglS9sadWXhNPLymR0KUZTCZfIpK0M_0 2024-09-12T18:59:59.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2240574853655622914', time=2024-09-12T20:28:52.412137+0000, chain.objs.size()=1 2024-09-12T18:59:59.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.coTYWrSA8omVt0Tq8kOjcxMP_WDCrt6_0 2024-09-12T18:59:59.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11462914256327639084', time=2024-09-12T20:28:52.496739+0000, chain.objs.size()=1 2024-09-12T18:59:59.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.n0Vt4dYuuxTV1g1VpYs4EQUi25n5FFw_0 2024-09-12T18:59:59.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12093370709091579570', time=2024-09-12T20:28:52.925967+0000, chain.objs.size()=1 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1UskNcq2Hx8z6vaUqZ55P65lUmxC-Ze_0 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16098079195711751495', time=2024-09-12T20:28:53.922471+0000, chain.objs.size()=1 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.F4Sg--T_8oEayDRDy6_gzDdM8O5RYN0_0 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3811183386590558662', time=2024-09-12T20:28:54.365967+0000, chain.objs.size()=1 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.64eUWff2XI4ZJulmL1V4oHpdNfbmL0N_0 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1962857146538533273', time=2024-09-12T20:28:55.671777+0000, chain.objs.size()=1 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gatEBrgvD50GPXetNFEM2XhZYkgR7ba_0 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1850653447638084589', time=2024-09-12T20:28:56.583098+0000, chain.objs.size()=1 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Qhs0znand-KJdUu2kXWG1uMdWUXPOnn_0 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11429246755696168115', time=2024-09-12T20:28:56.710385+0000, chain.objs.size()=1 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2oAOkLWggzkDxIQypJ1bxVOoV6lpA2J_0 2024-09-12T18:59:59.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6889396207986282761', time=2024-09-12T20:28:57.908935+0000, chain.objs.size()=1 2024-09-12T18:59:59.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ACkSzp3ZxNEQXHARFSIdmzt0ng0Gi1U_0 2024-09-12T18:59:59.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4039480762417254608', time=2024-09-12T20:28:59.372614+0000, chain.objs.size()=1 2024-09-12T18:59:59.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HlYUrGoq9B6vmK4fpTE7uWAw3oj7WTH_0 2024-09-12T18:59:59.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7137669136955406902', time=2024-09-12T20:29:00.977960+0000, chain.objs.size()=1 2024-09-12T18:59:59.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fI-wD8dmyE5tflT1OjGVR9SpZmeXRQO_0 2024-09-12T18:59:59.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13898311940241706285', time=2024-09-12T20:29:01.483697+0000, chain.objs.size()=1 2024-09-12T18:59:59.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.IJpJIedsQUNI3aI5aynJGgCTE0Lg9r9_0 2024-09-12T18:59:59.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6428249365262390625', time=2024-09-12T20:29:03.238232+0000, chain.objs.size()=1 2024-09-12T18:59:59.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.n5Tj6sp6bX92TGiu4EnK6_h6aKNIxuv_0 2024-09-12T18:59:59.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6573720427477387341', time=2024-09-12T20:29:03.964563+0000, chain.objs.size()=1 2024-09-12T18:59:59.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.283+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.lMQWLVvXASyFtZw-g8v9ZLq-ceLbh6z_0 2024-09-12T18:59:59.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17884738688931832358', time=2024-09-12T20:29:04.137494+0000, chain.objs.size()=1 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Rx16B8a7Fp_p-2skADHiIb1zH8HaLF9_0 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1794101295260346827', time=2024-09-12T20:29:06.068736+0000, chain.objs.size()=1 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.plomSWIGlEWkzX_n6y0C0Ulr1HeGXpT_0 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3331333614525256526', time=2024-09-12T20:29:06.108031+0000, chain.objs.size()=1 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3wNmtScfOhuNfYlGFry7R0gunZprrai_0 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10988045109048283760', time=2024-09-12T20:29:06.183105+0000, chain.objs.size()=1 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Sx7oI__-Bbo3RewGjlkIrFy6HkPK2Lv_0 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13248136290054430831', time=2024-09-12T20:29:07.217217+0000, chain.objs.size()=1 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2wmcEdzw_-tP3BllufbFZgmP1EW3Bv4_0 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10955337066521754096', time=2024-09-12T20:29:07.691887+0000, chain.objs.size()=1 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.xIHxB6hzmRaw3AafnqRBTHsI957B6i3_0 2024-09-12T18:59:59.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14257288214772189371', time=2024-09-12T20:29:07.905970+0000, chain.objs.size()=1 2024-09-12T18:59:59.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.M-TstFE3KTtm6_XA20FppmIlYETt-NO_0 2024-09-12T18:59:59.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14712895938709824344', time=2024-09-12T20:29:10.509488+0000, chain.objs.size()=1 2024-09-12T18:59:59.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tXtLiFBrUpi-fl3azdNALJJubJN8Vo3_0 2024-09-12T18:59:59.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2193004392140563779', time=2024-09-12T20:29:11.365598+0000, chain.objs.size()=1 2024-09-12T18:59:59.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.pz_p4cGQTkEjFitNh2iyCCl8SIPivNj_0 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4264588086450846872', time=2024-09-12T20:29:11.728565+0000, chain.objs.size()=1 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kcSdXhembkV9jkZmDuXiAuA5koB4laa_0 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3386361030843777993', time=2024-09-12T20:29:11.991759+0000, chain.objs.size()=1 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Gc8Rv93Dm-ULsySlTgaXeHz1CAsblup_0 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1780231672173791033', time=2024-09-12T20:29:12.369705+0000, chain.objs.size()=1 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.b225TA09poKHv4ghjfM8XToNgh3r7vh_0 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14894964478159534693', time=2024-09-12T20:29:13.260874+0000, chain.objs.size()=1 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.G2inMTXWHDzQ21f_z6FZiP_T-N_BiJd_0 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.896071302597278699', time=2024-09-12T20:29:13.658558+0000, chain.objs.size()=1 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.XSDnSmNzUW5qOE3BPNyWTR8wZcEWs0H_0 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7072575099660298072', time=2024-09-12T20:29:14.297911+0000, chain.objs.size()=1 2024-09-12T18:59:59.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.c2rGIsCfSlrRR4LqHwLMMe4lPNReRVU_0 2024-09-12T18:59:59.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14689811771286471133', time=2024-09-12T20:29:20.586801+0000, chain.objs.size()=1 2024-09-12T18:59:59.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.266__shadow_.b-3NUM1M3ZBcN6Qoxn-0tdsi9nXGv4x_0 2024-09-12T18:59:59.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10419568349767318484', time=2024-09-12T20:29:23.154613+0000, chain.objs.size()=1 2024-09-12T18:59:59.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.268__shadow_.aztKT0-zZLf_AOiYr1lAzeFqRse9_vY_0 2024-09-12T18:59:59.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17529629433499804827', time=2024-09-12T20:29:30.742189+0000, chain.objs.size()=1 2024-09-12T18:59:59.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.274__shadow_.WtrEQmspPJcR3rOynh756EXSA97gwM6_0 2024-09-12T18:59:59.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13122972692209376631', time=2024-09-12T20:29:43.350115+0000, chain.objs.size()=1 2024-09-12T18:59:59.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.287+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.283__shadow_.vwplIwO7ZNaU76z3AZTrfqQvVK0Pj9w_0 2024-09-12T18:59:59.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16561486029257523931', time=2024-09-12T20:29:59.071298+0000, chain.objs.size()=1 2024-09-12T18:59:59.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.seUG65n9MrBHIo3FRZIAphP_tIJUw7w_0 2024-09-12T18:59:59.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.429449100375562164', time=2024-09-12T20:30:03.892783+0000, chain.objs.size()=1 2024-09-12T18:59:59.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.lHlCI9T-RI1p2A_sa-PEHN_oIWdnUrC_0 2024-09-12T18:59:59.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1718529654794423241', time=2024-09-12T20:30:03.894561+0000, chain.objs.size()=1 2024-09-12T18:59:59.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.keBBZWiJchPUj-hJLmwWwqsoJOVzHje_0 2024-09-12T18:59:59.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14087533470838243181', time=2024-09-12T20:30:08.105764+0000, chain.objs.size()=1 2024-09-12T18:59:59.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.296__shadow_.apyDnBdleK00JaGDdGEQ0-UX3Rj7ka2_0 2024-09-12T18:59:59.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10935730316517139115', time=2024-09-12T20:30:19.445054+0000, chain.objs.size()=1 2024-09-12T18:59:59.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.304__shadow_.qrkkouIMVZkUsdccpvDjgYbcj7RrCPQ_0 2024-09-12T18:59:59.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2097494869985158524', time=2024-09-12T20:30:19.446903+0000, chain.objs.size()=1 2024-09-12T18:59:59.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.304__shadow_.K4Q2CEkt2lOJP8H2mYN3atKexRxHewF_0 2024-09-12T18:59:59.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1466381136052535622', time=2024-09-12T20:30:20.838554+0000, chain.objs.size()=1 2024-09-12T18:59:59.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.305__shadow_.IUC96JjpsRy5fa6ouGNk9vg-hjL0ss7_0 2024-09-12T18:59:59.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10575423092073317548', time=2024-09-12T20:32:27.338028+0000, chain.objs.size()=1 2024-09-12T18:59:59.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HZb0E_qA-QDQTb8jUvkuCXYcxqbdL0p_0 2024-09-12T18:59:59.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.35266974001486182', time=2024-09-12T20:32:28.458138+0000, chain.objs.size()=1 2024-09-12T18:59:59.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.4yowPdi3lr8pHlxaH04Fm1_zX7-tsh9_0 2024-09-12T18:59:59.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8259644542089386255', time=2024-09-12T20:32:28.769187+0000, chain.objs.size()=1 2024-09-12T18:59:59.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1vKA2O-tzkQJzziVn2sYREPYssmmsX1_0 2024-09-12T18:59:59.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6064424906593914949', time=2024-09-12T20:32:31.800408+0000, chain.objs.size()=1 2024-09-12T18:59:59.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.UVaFjZuKenm4knP6dTiLQk7wi5nOp5-_0 2024-09-12T18:59:59.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2073659942845887454', time=2024-09-12T20:32:32.852125+0000, chain.objs.size()=1 2024-09-12T18:59:59.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jJzgaPHxWbEv7ZBjAimZWkTccs2Abb6_0 2024-09-12T18:59:59.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.722762387430886800', time=2024-09-12T20:32:33.043220+0000, chain.objs.size()=1 2024-09-12T18:59:59.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hvaplYqKt-Bv7wLdY5GLtYfBGehMCme_0 2024-09-12T18:59:59.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4480872808602819202', time=2024-09-12T20:32:33.152425+0000, chain.objs.size()=1 2024-09-12T18:59:59.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.061678FMfxMe7KmO0Wn0X86L8cDCmJ6_0 2024-09-12T18:59:59.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14382331685736886851', time=2024-09-12T20:32:33.199781+0000, chain.objs.size()=1 2024-09-12T18:59:59.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ExpGL3ZU0MuaQ4DIuE9yyNDyhmPGj0O_0 2024-09-12T18:59:59.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10584927355696262807', time=2024-09-12T20:32:35.009406+0000, chain.objs.size()=1 2024-09-12T18:59:59.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.291+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.or7BS6ygzcA7UNbRLmJLq45ced-vPwg_0 2024-09-12T18:59:59.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13561926925945550713', time=2024-09-12T20:32:36.208820+0000, chain.objs.size()=1 2024-09-12T18:59:59.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pKO65DTj_25O_TOrqbAEbti_7R78MHp_0 2024-09-12T18:59:59.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7230387460429360518', time=2024-09-12T20:32:38.791188+0000, chain.objs.size()=1 2024-09-12T18:59:59.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.VSG_RJNYFd3uvTbmmDErarBC1AxL7tG_0 2024-09-12T18:59:59.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1033168968485462627', time=2024-09-12T20:32:39.160886+0000, chain.objs.size()=1 2024-09-12T18:59:59.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.r_6nXe9V8nsr3Ud3yMZr-9umz1AjnuQ_0 2024-09-12T18:59:59.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7196359501846819887', time=2024-09-12T20:32:39.162846+0000, chain.objs.size()=1 2024-09-12T18:59:59.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nCl8kdC6AwKAN_5IiQrErXQr7ykvqD4_0 2024-09-12T18:59:59.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16877345532725191213', time=2024-09-12T20:32:39.471599+0000, chain.objs.size()=1 2024-09-12T18:59:59.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.K6PqbOuX5bJz5kv-saqEYGEfB7etxHz_0 2024-09-12T18:59:59.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8434056815071107695', time=2024-09-12T20:32:39.586015+0000, chain.objs.size()=1 2024-09-12T18:59:59.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.V0deAbtuZKVMo1Z9aIgzCRZHv5n-XTU_0 2024-09-12T18:59:59.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10937657470538776239', time=2024-09-12T20:32:40.143912+0000, chain.objs.size()=1 2024-09-12T18:59:59.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.KOpthmgGQHCXlemM0yoku3ozYmPRM9Z_0 2024-09-12T18:59:59.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5753195104863136137', time=2024-09-12T20:32:42.030027+0000, chain.objs.size()=1 2024-09-12T18:59:59.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.9Zkxp2-7fe8cKqnTC9dxXRdASVQ1OMw_0 2024-09-12T18:59:59.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2245154325356915714', time=2024-09-12T20:32:42.586659+0000, chain.objs.size()=1 2024-09-12T18:59:59.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ovt1gKwGiOUZCFnvev-pwQ8W3uPbfUc_0 2024-09-12T18:59:59.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1379257010456474519', time=2024-09-12T20:32:42.688350+0000, chain.objs.size()=1 2024-09-12T18:59:59.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Yg58Q4qYY3mBMjkbWDRNXP9utQAxmNS_0 2024-09-12T18:59:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13205104615844565605', time=2024-09-12T20:32:43.586114+0000, chain.objs.size()=1 2024-09-12T18:59:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3OKxsUI9TaT1-osUUNCZvzcPfhyKlYO_0 2024-09-12T18:59:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8340918021745925332', time=2024-09-12T20:32:44.742468+0000, chain.objs.size()=1 2024-09-12T18:59:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IjuA13BzFe03izz_-fF1kdfNocgGuAi_0 2024-09-12T18:59:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9731021157188502091', time=2024-09-12T20:32:46.236668+0000, chain.objs.size()=1 2024-09-12T18:59:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pA7R2rkyQd4UbqGKG53-igz3myU6mcm_0 2024-09-12T18:59:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4616013858910651300', time=2024-09-12T20:32:46.980070+0000, chain.objs.size()=1 2024-09-12T18:59:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.PELmLi0IUAEnKD9QfqOSjwJ5hh_NRu3_0 2024-09-12T18:59:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7031713167565759015', time=2024-09-12T20:32:49.216068+0000, chain.objs.size()=1 2024-09-12T18:59:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.SrG5C7Y-qSeI8X4Bjt_vWgPfLxpqd7l_0 2024-09-12T18:59:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5442507508341748477', time=2024-09-12T20:32:49.274962+0000, chain.objs.size()=1 2024-09-12T18:59:59.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rplnTC3rjur8JUfSTCSpm5Bdv8zTjxP_0 2024-09-12T18:59:59.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5555020621254982660', time=2024-09-12T20:32:49.605290+0000, chain.objs.size()=1 2024-09-12T18:59:59.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tu67ZOugfqkliG4rilYbNkdXktxU2yq_0 2024-09-12T18:59:59.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6515627638947062466', time=2024-09-12T20:32:50.872581+0000, chain.objs.size()=1 2024-09-12T18:59:59.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.XmoXUagpmBxNwBUjSguAtI3UPA1SOND_0 2024-09-12T18:59:59.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18299354230577436112', time=2024-09-12T20:32:52.670048+0000, chain.objs.size()=1 2024-09-12T18:59:59.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3-CsX3WYYqtkm7UUBoR5o0VkDD34mSk_0 2024-09-12T18:59:59.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8178661264906580139', time=2024-09-12T20:32:53.719848+0000, chain.objs.size()=1 2024-09-12T18:59:59.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HAXZup6UqKv2lNhFWjm2asDEmiyb0Fc_0 2024-09-12T18:59:59.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15530536021450286586', time=2024-09-12T20:34:35.315178+0000, chain.objs.size()=1 2024-09-12T18:59:59.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.iH2vASqpOcNw2ZGdOF-WQSbqueMmozO_0 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16087451581044276071', time=2024-09-12T20:34:35.603145+0000, chain.objs.size()=1 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.295+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.K98R3O7PRBX3Xn8qWeJq51PeNcQEIzm_0 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16938361163862237080', time=2024-09-12T20:34:35.824927+0000, chain.objs.size()=1 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.eTt-6O2aeUZau7ydYWA7oDMd17TIOQh_0 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2667918557471932148', time=2024-09-12T20:34:36.123134+0000, chain.objs.size()=1 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kKifg7uOt27EXdNeu_oh9TSXcdygeDR_0 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8188481449468683487', time=2024-09-12T20:34:39.495663+0000, chain.objs.size()=1 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.adBM5zTX0WNj7cRC7n83zhZfFsOIJ8h_0 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10500428169296582083', time=2024-09-12T20:34:40.279783+0000, chain.objs.size()=1 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LdwzFKk4W7bm4pgeO_knNeZ5qrIjX7a_0 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9306173190351302138', time=2024-09-12T20:34:41.497276+0000, chain.objs.size()=1 2024-09-12T18:59:59.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BWwGkYnFyLkcx9j8R1nngORQQ-FQgAL_0 2024-09-12T18:59:59.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9197710018477609596', time=2024-09-12T20:34:41.790089+0000, chain.objs.size()=1 2024-09-12T18:59:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JfCZGX17UYXS5jcW_0CBZTerP-BLH2m_0 2024-09-12T18:59:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15667998586320460174', time=2024-09-12T20:34:42.833995+0000, chain.objs.size()=1 2024-09-12T18:59:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.VphDaJHVndhxgkDVAFO6PR_C4mC-XH6_0 2024-09-12T18:59:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6587627067029251496', time=2024-09-12T20:34:43.321555+0000, chain.objs.size()=1 2024-09-12T18:59:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LX6YKgQ5_Abuh71G3u9g7THDZ3cBYL8_0 2024-09-12T18:59:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9726814227423311178', time=2024-09-12T20:34:43.896029+0000, chain.objs.size()=1 2024-09-12T18:59:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6FQtQJ-jlkil7zwjgykt9idVU-oWSei_0 2024-09-12T18:59:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5235313335997917797', time=2024-09-12T20:34:45.103000+0000, chain.objs.size()=1 2024-09-12T18:59:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Ho_xbdZ8iz7sd3elTfT3JnqVxa_lZG5_0 2024-09-12T18:59:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13991680022190255458', time=2024-09-12T20:34:47.225539+0000, chain.objs.size()=1 2024-09-12T18:59:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1VcqQzTRu55VxVXE70M-jPDVOgQya4A_0 2024-09-12T18:59:59.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18446262891873285001', time=2024-09-12T20:34:47.602634+0000, chain.objs.size()=1 2024-09-12T18:59:59.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.X_MgABbt6d9RatdOzSdaoLZXJtYknEc_0 2024-09-12T18:59:59.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2562473323820037151', time=2024-09-12T20:34:49.443022+0000, chain.objs.size()=1 2024-09-12T18:59:59.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ylg1-hqylS8birATvs3sg5jHr9WM6tn_0 2024-09-12T18:59:59.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.139498631524801866', time=2024-09-12T20:34:49.599732+0000, chain.objs.size()=1 2024-09-12T18:59:59.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.xXsdLtk6U-rok4lZG-DcOv9HFlkd8-y_0 2024-09-12T18:59:59.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8153694033793390347', time=2024-09-12T20:34:51.242880+0000, chain.objs.size()=1 2024-09-12T18:59:59.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.299+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4V7mFmLBa-H7Gf9UppbiGHly4ggNei4_0 2024-09-12T18:59:59.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48896 2024-09-12T18:59:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T18:59:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13855445425996697189', time=2024-09-12T20:34:51.353731+0000, chain.objs.size()=1 2024-09-12T18:59:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.F6ojMVqFvBaZ5V5jMpKmq87S9EkmbV6_0 2024-09-12T18:59:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1636914991003380177', time=2024-09-12T20:34:52.277118+0000, chain.objs.size()=1 2024-09-12T18:59:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YQZQz2q0vJiTVACjuxJqEbaZyxTCO-N_0 2024-09-12T18:59:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6103776834482328485', time=2024-09-12T20:34:52.435841+0000, chain.objs.size()=1 2024-09-12T18:59:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ygp5BbeOp2o6eRN4Y1zuHdaKM0NkBVo_0 2024-09-12T18:59:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15037947845784618613', time=2024-09-12T20:34:52.682159+0000, chain.objs.size()=1 2024-09-12T18:59:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Ttm1gL9DcZJ1YY29JIEIxPCSrkD2N3B_0 2024-09-12T18:59:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13390471136165163316', time=2024-09-12T20:34:53.055123+0000, chain.objs.size()=1 2024-09-12T18:59:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.q3ExgMUOeTv835UPMCxXfwrUNqmfjuq_0 2024-09-12T18:59:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5297603993989005572', time=2024-09-12T20:34:53.402777+0000, chain.objs.size()=1 2024-09-12T18:59:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MfCM4iZ2mYdkRT60rBUQ7lTp7g6Xkp-_0 2024-09-12T18:59:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1097355573021604530', time=2024-09-12T20:34:54.641748+0000, chain.objs.size()=1 2024-09-12T18:59:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.IvBtwUY8NNHnbjsdK3_AapFTEQ8T0CM_0 2024-09-12T18:59:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10956004821050145793', time=2024-09-12T20:34:58.765406+0000, chain.objs.size()=1 2024-09-12T18:59:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.D9-RUcrRx5OPnge0zKOidL9tnfoElSM_0 2024-09-12T18:59:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11270908158531066219', time=2024-09-12T20:35:42.468569+0000, chain.objs.size()=1 2024-09-12T18:59:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.367__shadow_.UzEPhRtT0jsuERhF7jDyB7wlu2227dP_0 2024-09-12T18:59:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12197419777536362576', time=2024-09-12T20:36:09.213182+0000, chain.objs.size()=1 2024-09-12T18:59:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.390__shadow_.jZCCqgM6gZq9llWcWiq7HQOo4BZpAeZ_0 2024-09-12T18:59:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.311230458865934236', time=2024-09-12T20:36:09.228971+0000, chain.objs.size()=1 2024-09-12T18:59:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.390__shadow_.btPBxVSrQdMA4584VlOrO-MmafhiVNC_0 2024-09-12T18:59:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9230372458832036612', time=2024-09-12T20:38:18.197885+0000, chain.objs.size()=1 2024-09-12T18:59:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.303+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.498__shadow_.YXL4X6QexEahTzLA3SQzFFIhTpUywxe_0 2024-09-12T18:59:59.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12418228224425368279', time=2024-09-12T20:38:20.519190+0000, chain.objs.size()=1 2024-09-12T18:59:59.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.500__shadow_.3JrmMczq5jDVFb2yP_UJ4I-4_KcvzFh_0 2024-09-12T18:59:59.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10551906398731192448', time=2024-09-12T20:38:58.051195+0000, chain.objs.size()=1 2024-09-12T18:59:59.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.517__shadow_.qfyYP_rxq0F9L4bkUs-KZ3AS4znjmdl_0 2024-09-12T18:59:59.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11710998892457027379', time=2024-09-12T20:39:30.274730+0000, chain.objs.size()=3 2024-09-12T18:59:59.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__multipart_mymultipart.2~G2FFE3ma4Nwi5gDOSzQZj63pbTenN4i.1 2024-09-12T18:59:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__multipart_mymultipart.2~G2FFE3ma4Nwi5gDOSzQZj63pbTenN4i.2 2024-09-12T18:59:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__multipart_mymultipart.2~G2FFE3ma4Nwi5gDOSzQZj63pbTenN4i.3 2024-09-12T18:59:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11677358278531227970', time=2024-09-12T20:41:01.835497+0000, chain.objs.size()=6 2024-09-12T18:59:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.a7hDwxBo28i3IrTMlURVOrK24mMmfYM8.1 2024-09-12T18:59:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.rnbRyz8DB9t1yDrIKbFq59HrW2CsYQrX.2 2024-09-12T18:59:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.zurFCNuH4cJZfdTfcNQUdYEjDTsSoob4.3 2024-09-12T18:59:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.6Q0wx7gDCjeBeRohiSg1TXWD94EZWlRc.4 2024-09-12T18:59:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.SS-JFMUV0tXXF5eqD5mr91aE_QYaGek4.5 2024-09-12T18:59:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.AckCFbudMi3vhiEgNZfrD7iNEqtYTQXS.6 2024-09-12T18:59:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12012319820004511202', time=2024-09-12T20:42:55.634954+0000, chain.objs.size()=1 2024-09-12T18:59:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.553__shadow_.2jYVFYYUcI1cSmchR2RP3JS25DYTC5h_0 2024-09-12T18:59:59.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4070129154439197954', time=2024-09-12T20:42:58.471202+0000, chain.objs.size()=1 2024-09-12T18:59:59.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.554__shadow_.jev4JT5UMb6hnHIutWikEnvW04uTEBD_0 2024-09-12T18:59:59.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.339187465879980930', time=2024-09-12T20:43:06.314591+0000, chain.objs.size()=1 2024-09-12T18:59:59.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.556__shadow_.Xjv3nOvAHsG1zmGmZFuPhTPAgd6U2LC_0 2024-09-12T18:59:59.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16295191151930688320', time=2024-09-12T20:43:42.783809+0000, chain.objs.size()=1 2024-09-12T18:59:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:8Jj.Pj59byrSO4vQzRxES1w.dJ7vnZU_.y-W5mOrIChdxcwB-J4-IotLRHEBFITB_0 2024-09-12T18:59:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6707745155509655136', time=2024-09-12T20:44:17.275458+0000, chain.objs.size()=1 2024-09-12T18:59:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574__shadow:0H0wLaYAXo5Tzdo9YV93Cvnp7JgUzMV_.zAoib3HKUBPosXC_ETUyQQSGpvjJAhp_0 2024-09-12T18:59:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6416867967198359518', time=2024-09-12T20:46:56.058645+0000, chain.objs.size()=12 2024-09-12T18:59:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__multipart_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.1 2024-09-12T18:59:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__shadow_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.1_1 2024-09-12T18:59:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__multipart_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.2 2024-09-12T18:59:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__shadow_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.2_1 2024-09-12T18:59:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__multipart_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.3 2024-09-12T18:59:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.307+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__shadow_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.3_1 2024-09-12T18:59:59.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.311+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__multipart_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.4 2024-09-12T18:59:59.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.311+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__shadow_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.4_1 2024-09-12T18:59:59.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.311+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__multipart_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.5 2024-09-12T18:59:59.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.311+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__shadow_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.5_1 2024-09-12T18:59:59.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.311+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__multipart_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.6 2024-09-12T18:59:59.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.311+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.613__shadow_multipart_enc.2~REB5_y-wg8lVoT6895jtNE77h3Vurix.6_1 2024-09-12T18:59:59.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.315+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10446070307111848733', time=2024-09-12T20:49:51.246552+0000, chain.objs.size()=1 2024-09-12T18:59:59.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.315+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.620__shadow_.DHqGJ08tuHInD3Jv19b_lD7dGkXcfdu_0 2024-09-12T18:59:59.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.315+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18370388947768558993', time=2024-09-12T20:51:07.395765+0000, chain.objs.size()=1 2024-09-12T18:59:59.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.315+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.645__shadow_.X1PVb0swFs2j7GeVCifxUvTyxUna2wu_0 2024-09-12T18:59:59.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.315+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2149606846131003684', time=2024-09-12T20:52:07.220390+0000, chain.objs.size()=1 2024-09-12T18:59:59.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.315+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.672__shadow_.8m23ZRzoiN2quXzm_ovCNEfyFPiVv0A_0 2024-09-12T18:59:59.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.315+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11954114139522872570', time=2024-09-12T20:52:26.878933+0000, chain.objs.size()=1 2024-09-12T18:59:59.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.315+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.692__shadow:NDIMh-ddpvIjhq3HISKX7hyEPejUbBY_.SfJh9LTLgrsTAfw-NUJZPnhik1ke6IE_0 2024-09-12T18:59:59.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.315+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4799049795774494501', time=2024-09-12T20:52:49.015017+0000, chain.objs.size()=1 2024-09-12T18:59:59.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.315+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.709__shadow_.CArlAmx46JOjuE0GlW6X7LgnBn12QMN_0 2024-09-12T18:59:59.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.315+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.319+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:59:59.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.319+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.319+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50618' 2024-09-12T18:59:59.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1904542796091454676', time=2024-09-12T20:28:47.801656+0000, chain.objs.size()=1 2024-09-12T18:59:59.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.LEssj_CjkyrHBpErgAztHWLOmEWyjD4_0 2024-09-12T18:59:59.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.415490753307790675', time=2024-09-12T20:28:47.869436+0000, chain.objs.size()=1 2024-09-12T18:59:59.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.k4G_Cq70uL4ykCKFGYbcLHlkHZTmGQ5_0 2024-09-12T18:59:59.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1164342803766186742', time=2024-09-12T20:28:48.303136+0000, chain.objs.size()=1 2024-09-12T18:59:59.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.eqJMNOhq5ilru0yFSNo1q2wC4DiLNz8_0 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4076242632959162650', time=2024-09-12T20:28:51.774674+0000, chain.objs.size()=1 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.dWerZgU3XTnaBLMRsoEnfRmwVdwzKU2_0 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11552645677256341912', time=2024-09-12T20:28:53.917607+0000, chain.objs.size()=1 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.frdiGhcqtGw7pPXqcQ01OnGgRWaTmh0_0 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5306379559168186641', time=2024-09-12T20:28:54.277170+0000, chain.objs.size()=1 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ZI_Zull02_1Te3vmuu9DnYjYa74QSWD_0 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6234098812168308860', time=2024-09-12T20:28:54.376498+0000, chain.objs.size()=1 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SdSFkttXAC-zKmn4RiIbTSohFV7867Y_0 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5873587536526427333', time=2024-09-12T20:28:55.396242+0000, chain.objs.size()=1 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wm0QqNPVScQ3Z1CZZIwwmfjdMtKhtg6_0 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17852480171937660531', time=2024-09-12T20:28:55.397952+0000, chain.objs.size()=1 2024-09-12T18:59:59.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ZOYfIeFzfqzY77x8FWwDZM_shul_frt_0 2024-09-12T18:59:59.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3563738029133555284', time=2024-09-12T20:28:55.399913+0000, chain.objs.size()=1 2024-09-12T18:59:59.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3y5_AGfSsSyTrx1WfGv4E7-UgbfdnGr_0 2024-09-12T18:59:59.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9032990407186091458', time=2024-09-12T20:28:56.264654+0000, chain.objs.size()=1 2024-09-12T18:59:59.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.UnZ7yVNCIZPqxQ6KseaxKWgIr7214Z9_0 2024-09-12T18:59:59.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5313761430913293928', time=2024-09-12T20:28:56.958470+0000, chain.objs.size()=1 2024-09-12T18:59:59.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.323+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JxdrenJB3Q-YditkBokxncakI7uSqSK_0 2024-09-12T18:59:59.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1440538935944710098', time=2024-09-12T20:28:57.804670+0000, chain.objs.size()=1 2024-09-12T18:59:59.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.PCkDynCv-ib0c7ikSxSeE9TKv-h27dU_0 2024-09-12T18:59:59.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11335848799868800453', time=2024-09-12T20:28:59.080769+0000, chain.objs.size()=1 2024-09-12T18:59:59.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.LomoD_do5Ggy5pc51bacXSp_1xVXRV5_0 2024-09-12T18:59:59.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17382094346321782226', time=2024-09-12T20:29:01.119623+0000, chain.objs.size()=1 2024-09-12T18:59:59.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.EixyCcQAp831PWUlC5BCT0vosakGJ8p_0 2024-09-12T18:59:59.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7036081481989992878', time=2024-09-12T20:29:01.201798+0000, chain.objs.size()=1 2024-09-12T18:59:59.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Synkb9dx2bRVdf7UKIgyt-Sa5FNTHla_0 2024-09-12T18:59:59.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11847627720341279641', time=2024-09-12T20:29:02.642446+0000, chain.objs.size()=1 2024-09-12T18:59:59.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.EA-0v0iH3ZPLjKq3MIg4yAXJY06seqy_0 2024-09-12T18:59:59.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5399314363572822181', time=2024-09-12T20:29:02.703093+0000, chain.objs.size()=1 2024-09-12T18:59:59.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1qyXT8qzFyoyo0K--8ZMGg7ob6Rsiel_0 2024-09-12T18:59:59.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5229035197880702520', time=2024-09-12T20:29:03.642054+0000, chain.objs.size()=1 2024-09-12T18:59:59.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ZEvH4qwTgiDHB1acraDTDdS_HVqtom0_0 2024-09-12T18:59:59.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9924964283213794974', time=2024-09-12T20:29:03.980986+0000, chain.objs.size()=1 2024-09-12T18:59:59.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VAb6TVtK2mbNcf0x8gAGRnF5TzEu2yl_0 2024-09-12T18:59:59.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12277781561645535521', time=2024-09-12T20:29:04.736778+0000, chain.objs.size()=1 2024-09-12T18:59:59.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ED0eJ9IfDD3r_Vy_odcwEqI3MqdsIis_0 2024-09-12T18:59:59.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6390534373889361275', time=2024-09-12T20:29:05.018501+0000, chain.objs.size()=1 2024-09-12T18:59:59.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.J-NeslPAzDO4Oxv8EF4fgwmUpHqTbmu_0 2024-09-12T18:59:59.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.76831274036735196', time=2024-09-12T20:29:07.963305+0000, chain.objs.size()=1 2024-09-12T18:59:59.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kLLoz9dfWd-uD-4fYuCgjGkUVO2ENhI_0 2024-09-12T18:59:59.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3854906558093823953', time=2024-09-12T20:29:09.586719+0000, chain.objs.size()=1 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NNkU7RIM9BYFKFWOI57QoXoxiRvMmZA_0 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15663847390634525970', time=2024-09-12T20:29:09.967432+0000, chain.objs.size()=1 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JpS5Pob18K89sLb93OMseXKH3vLp0A3_0 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17891153206212832659', time=2024-09-12T20:29:11.729517+0000, chain.objs.size()=1 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.K4dAPz5qaX0F3XXIBS_DsuMA65Vbh_k_0 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5854569607523570387', time=2024-09-12T20:29:11.980580+0000, chain.objs.size()=1 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kf6Qmd7VADS_ms0Wj_jzAOcM4KQCZX6_0 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15851356957492335413', time=2024-09-12T20:29:12.579363+0000, chain.objs.size()=1 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1XqRXzDs-SxkjDIcuo-ROUOOTVre_5l_0 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12581010513280604338', time=2024-09-12T20:29:13.692544+0000, chain.objs.size()=1 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VG3qrDgmvxbgRBTMak821IVb5y1pt2e_0 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1621735710470494203', time=2024-09-12T20:29:14.068265+0000, chain.objs.size()=1 2024-09-12T18:59:59.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9hFAB_jzuRcVjc6Wz65p-xQ85jDsv5E_0 2024-09-12T18:59:59.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15176771039024391142', time=2024-09-12T20:29:14.507179+0000, chain.objs.size()=1 2024-09-12T18:59:59.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.T6LRClD70csFg89zAcsy5ArLASCy1jT_0 2024-09-12T18:59:59.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10711766482787342056', time=2024-09-12T20:29:14.811621+0000, chain.objs.size()=1 2024-09-12T18:59:59.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Zf6FjWBYU-tsKEso4HJtFOt5Fb2iq4B_0 2024-09-12T18:59:59.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16591925750807932914', time=2024-09-12T20:29:14.978854+0000, chain.objs.size()=1 2024-09-12T18:59:59.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.327+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.aovveCbgTlso801NNH6iMANcd2-q1dp_0 2024-09-12T18:59:59.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13816797442314292499', time=2024-09-12T20:29:20.567020+0000, chain.objs.size()=1 2024-09-12T18:59:59.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.266__shadow_.BnpYRqBAcyeuAdFxnQFEZggUEKXkH6A_0 2024-09-12T18:59:59.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3162841557907732500', time=2024-09-12T20:29:21.843324+0000, chain.objs.size()=1 2024-09-12T18:59:59.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.267__shadow_.0rKfKv3uvU9-cxVe0Mv7ZQR7Rh5V6RO_0 2024-09-12T18:59:59.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2705206516232331577', time=2024-09-12T20:29:32.161371+0000, chain.objs.size()=1 2024-09-12T18:59:59.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.275__shadow_.fmU-Bbj2ksPMMgRwtf0GIE8hM3SuoE4_0 2024-09-12T18:59:59.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14991629458638759722', time=2024-09-12T20:29:51.926217+0000, chain.objs.size()=1 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.289__shadow_.3IS0KjixCQjx4IKZqQQ6sB-HmlyW_yu_0 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5468790010467469397', time=2024-09-12T20:29:59.289043+0000, chain.objs.size()=1 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.6rYiv4TdfKL1Kzhou5Q4pNfkHjdDsFC_0 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11677085275388623086', time=2024-09-12T20:30:03.560754+0000, chain.objs.size()=1 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.oo0D3-A1a9tDwks8EcWTYKDVbEuMyyC_0 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8066619532637813974', time=2024-09-12T20:30:03.562600+0000, chain.objs.size()=1 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.AqzrrzeCp78akWU9QhDl0ipZ2eQz6Aj_0 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18384411058419780958', time=2024-09-12T20:30:10.989669+0000, chain.objs.size()=1 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.298__shadow_.qV13195eMBp-nNGUIdZCFClX_cuvlCh_0 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10767265855280436139', time=2024-09-12T20:30:20.869500+0000, chain.objs.size()=1 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.305__shadow_.C7WcoJirSvMhvMR94I8bbAMS_ZPL-v9_0 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8389647538648063016', time=2024-09-12T20:32:28.511311+0000, chain.objs.size()=1 2024-09-12T18:59:59.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.cz6rCmvJGG6EgJ7y6dJkB5ENrRDpQbX_0 2024-09-12T18:59:59.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10729758568003737302', time=2024-09-12T20:32:28.513190+0000, chain.objs.size()=1 2024-09-12T18:59:59.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tUaWgXHaBft9UlBZpSS5cXu7O3JOA5r_0 2024-09-12T18:59:59.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15924931527764373554', time=2024-09-12T20:32:28.514867+0000, chain.objs.size()=1 2024-09-12T18:59:59.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.KsxZbreiDYhTex0RbEUClGO-P5yNyAr_0 2024-09-12T18:59:59.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3590022614334715614', time=2024-09-12T20:32:29.111760+0000, chain.objs.size()=1 2024-09-12T18:59:59.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0-hUICwvVwFW2dIq0XhipQtL-y5my-K_0 2024-09-12T18:59:59.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8917020563725965988', time=2024-09-12T20:32:31.106392+0000, chain.objs.size()=1 2024-09-12T18:59:59.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Ls97coJzx0RXVWmjaSQ0pVxPdQEhcHE_0 2024-09-12T18:59:59.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17948480485994128471', time=2024-09-12T20:32:32.688239+0000, chain.objs.size()=1 2024-09-12T18:59:59.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.GyjYQ2AevLgd0HyM8EI6CSCIc3lvs0s_0 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10562534387063746694', time=2024-09-12T20:32:32.854665+0000, chain.objs.size()=1 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.glbiTALfo9_4rL8-TsmoIIv37R4wTFL_0 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5764769473022872918', time=2024-09-12T20:32:35.583211+0000, chain.objs.size()=1 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.bRV9A4oCMQYzxDp8qk9H5vyXQbBhouA_0 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12977333227303856561', time=2024-09-12T20:32:35.584849+0000, chain.objs.size()=1 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zFjxIGyUzE0txcx7Nd4SZcrDIn4qf85_0 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12025280917254352686', time=2024-09-12T20:32:36.294971+0000, chain.objs.size()=1 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.5FiRC4mNbhu0a8lszDOsg8OSosinShT_0 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12478153198064780453', time=2024-09-12T20:32:36.473667+0000, chain.objs.size()=1 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._MjooLYhi6SvK5itxgTOdPLS62Rmpw6_0 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15815204663544046845', time=2024-09-12T20:32:36.579150+0000, chain.objs.size()=1 2024-09-12T18:59:59.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.331+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.d-uGVJsGrv2litVF1QBfO2xIRvNzitA_0 2024-09-12T18:59:59.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8171213383292548538', time=2024-09-12T20:32:36.763497+0000, chain.objs.size()=1 2024-09-12T18:59:59.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.JvVXxw8rUTMkP88qrYXeCW_417duywl_0 2024-09-12T18:59:59.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14183937227214831225', time=2024-09-12T20:32:37.760251+0000, chain.objs.size()=1 2024-09-12T18:59:59.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.JaOOpRZn0AoavS_U2uSeHreTb6I4EUM_0 2024-09-12T18:59:59.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8668220363265584051', time=2024-09-12T20:32:38.513678+0000, chain.objs.size()=1 2024-09-12T18:59:59.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.AM51yUFfmepfFe0JieNrOxMSGAsyvBw_0 2024-09-12T18:59:59.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9059477643414999586', time=2024-09-12T20:32:38.516167+0000, chain.objs.size()=1 2024-09-12T18:59:59.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.XfUlG_M2-D59PXZJOKsdGbp5nY2mFGo_0 2024-09-12T18:59:59.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14663797214939788282', time=2024-09-12T20:32:39.579641+0000, chain.objs.size()=1 2024-09-12T18:59:59.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.o6_0XqvmdvHuOJ-5R_HrPDzU7Jm6sNE_0 2024-09-12T18:59:59.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15426171420763910678', time=2024-09-12T20:32:39.724500+0000, chain.objs.size()=1 2024-09-12T18:59:59.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.vN4Gv88RKcR-42fbvuUGSE4yPbeiFWM_0 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5522728317636183784', time=2024-09-12T20:32:40.460707+0000, chain.objs.size()=1 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3L2si0_nL5Lb6btEOZNH9zd0qOm3EZZ_0 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12461275656993557619', time=2024-09-12T20:32:41.741627+0000, chain.objs.size()=1 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Q7lm5Fj4dmnTyuFABFVx8yEPx2lLMzf_0 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1588811884950929840', time=2024-09-12T20:32:43.239549+0000, chain.objs.size()=1 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.MA-aImi1X-LijxY_k3BpsxOoNkVV7pG_0 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6439402683745776349', time=2024-09-12T20:32:43.816926+0000, chain.objs.size()=1 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.deI2eBcU20OrniINHnEz_TtQBUa82JY_0 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5596580557569311178', time=2024-09-12T20:32:44.757279+0000, chain.objs.size()=1 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kCNWoLiYufnZmtMliw_bprU2X1Iq5zm_0 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10642338759512803988', time=2024-09-12T20:32:44.761321+0000, chain.objs.size()=1 2024-09-12T18:59:59.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.GXLu1Qx6xYtunH4ftVD4naaq-wmupGf_0 2024-09-12T18:59:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4309971825564497967', time=2024-09-12T20:32:45.429501+0000, chain.objs.size()=1 2024-09-12T18:59:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.F3Kzf3qZ2Hzwn5Vn5MUa4vZiecVIpDI_0 2024-09-12T18:59:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10795842660990258587', time=2024-09-12T20:32:46.194604+0000, chain.objs.size()=1 2024-09-12T18:59:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.XaYM1ejpqD-X9-_VH6EO203rjnYyDBt_0 2024-09-12T18:59:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15292126171217314015', time=2024-09-12T20:32:46.606276+0000, chain.objs.size()=1 2024-09-12T18:59:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.JSTNVuQZhN-uIffzgzQq9vU6nUq-MnI_0 2024-09-12T18:59:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14191414493077561225', time=2024-09-12T20:32:46.948270+0000, chain.objs.size()=1 2024-09-12T18:59:59.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.335+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.PDnQBOWGib_PsAa7jRH73sLxAsDDtRH_0 2024-09-12T18:59:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6088986958059101354', time=2024-09-12T20:32:48.721415+0000, chain.objs.size()=1 2024-09-12T18:59:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.g7VNfE1nZhMTzh6LXXxVSVXq8LakHtx_0 2024-09-12T18:59:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1730527525076011599', time=2024-09-12T20:32:49.817530+0000, chain.objs.size()=1 2024-09-12T18:59:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.G04ieKtLGH14X44IWeyLyJyUfpCnINn_0 2024-09-12T18:59:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16251648467103012220', time=2024-09-12T20:32:50.547560+0000, chain.objs.size()=1 2024-09-12T18:59:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.52lyaNTB7RlpDZbJVdQsT0biSMO-3iX_0 2024-09-12T18:59:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9963643757842825649', time=2024-09-12T20:32:53.336697+0000, chain.objs.size()=1 2024-09-12T18:59:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eMwAlZix6uA3QhUQ_LcB2IghPZHvShn_0 2024-09-12T18:59:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2215420046967848578', time=2024-09-12T20:34:36.232292+0000, chain.objs.size()=1 2024-09-12T18:59:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.KLN0Jy31cb3ZhEee367BhD9MRllVwYa_0 2024-09-12T18:59:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11262271418518669335', time=2024-09-12T20:34:36.302162+0000, chain.objs.size()=1 2024-09-12T18:59:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.8xpPcTH7nTcxlA6JeEuJjWEQUtR2lxT_0 2024-09-12T18:59:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8936880027288889103', time=2024-09-12T20:34:36.669566+0000, chain.objs.size()=1 2024-09-12T18:59:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.o0c2Xdt-Q9SNHLr99-8wzCokaPQcoCQ_0 2024-09-12T18:59:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8244611523517353205', time=2024-09-12T20:34:37.962224+0000, chain.objs.size()=1 2024-09-12T18:59:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JWXio9Q91UFRpU9sZwmtQFGd9Mqzi4d_0 2024-09-12T18:59:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15171305841498710339', time=2024-09-12T20:34:40.655340+0000, chain.objs.size()=1 2024-09-12T18:59:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.FU9EdaVSTdvxCb9rGsKI0jytFHevaKe_0 2024-09-12T18:59:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3122502782693583291', time=2024-09-12T20:34:40.693931+0000, chain.objs.size()=1 2024-09-12T18:59:59.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Fj2naOTNDGwfzGyU7ZSvtpkKHUiI2-y_0 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9989495583047681519', time=2024-09-12T20:34:41.611012+0000, chain.objs.size()=1 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.13SvSFxgWsG8r2zl6r6gPkc2BjAISF7_0 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1209697412036192892', time=2024-09-12T20:34:42.336434+0000, chain.objs.size()=1 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.D9DoS6jg1p5ZBjawD6uSgUb8YRXzxja_0 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13462555740557819685', time=2024-09-12T20:34:42.441893+0000, chain.objs.size()=1 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.uVvCojZO0UpGTcJSGHZHW_OaESYTDgP_0 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2230278405033038232', time=2024-09-12T20:34:45.711418+0000, chain.objs.size()=1 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.U24EEECWwzsDA7XCcdZhGK4OvaCmHNf_0 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11378387468104635951', time=2024-09-12T20:34:46.154081+0000, chain.objs.size()=1 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.b6Lpc-rET7lcaaEEZDZYUpQ7NnZ4M7w_0 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10665413819386736026', time=2024-09-12T20:34:48.811560+0000, chain.objs.size()=1 2024-09-12T18:59:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.NRiN1yPGvfSD1b4tbii0lgFVo7QHfmb_0 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12560705026758562229', time=2024-09-12T20:34:49.552648+0000, chain.objs.size()=1 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PkH0RAH960Ns0nb4XMYePMjwcFqSRWk_0 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12532929966720412766', time=2024-09-12T20:34:50.107359+0000, chain.objs.size()=1 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.v4YXu0sDg_Mh_iCYy0pTt60PYWuKQhn_0 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13133090483826774884', time=2024-09-12T20:34:50.257321+0000, chain.objs.size()=1 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.7QR2xn-EaeJIYsBN28f13qLTHFXEl_e_0 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1018950571997818750', time=2024-09-12T20:34:52.213511+0000, chain.objs.size()=1 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.t_EKq98iwelndoMnp8gal3SdzIGHAuo_0 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16365252267578886438', time=2024-09-12T20:34:52.215672+0000, chain.objs.size()=1 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.jU5t2u3cD68akvNuxYFwc2WG2GiuWEY_0 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16648111672753383350', time=2024-09-12T20:34:53.500485+0000, chain.objs.size()=1 2024-09-12T18:59:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wY3EQ0SDxscctk-TmjxKr9yeBQEH6bE_0 2024-09-12T18:59:59.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17937996109606868147', time=2024-09-12T20:34:53.502112+0000, chain.objs.size()=1 2024-09-12T18:59:59.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.339+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.SX56m4c_dSRFGNZOrr6t2oIZbJe5eVd_0 2024-09-12T18:59:59.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2280621257420581632', time=2024-09-12T20:34:53.968479+0000, chain.objs.size()=1 2024-09-12T18:59:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.iT-6DPG41oIR6oCWEO30Ivo5XtS3hdf_0 2024-09-12T18:59:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5236256702881981579', time=2024-09-12T20:34:56.568213+0000, chain.objs.size()=1 2024-09-12T18:59:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.N4bFDDzXB9lZjYP3iIXe7RGLF9S7s7p_0 2024-09-12T18:59:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7206647057670045502', time=2024-09-12T20:34:57.241592+0000, chain.objs.size()=1 2024-09-12T18:59:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.i3-qGxPekkT0hQe9aPHAjUkUABNGNkg_0 2024-09-12T18:59:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10556856030790584758', time=2024-09-12T20:35:00.256445+0000, chain.objs.size()=1 2024-09-12T18:59:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3KKVVImncgJUBgw0JM86o5w8yhX4Hlo_0 2024-09-12T18:59:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13289695412466070856', time=2024-09-12T20:35:00.564101+0000, chain.objs.size()=1 2024-09-12T18:59:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PI4YzB5EQwDc99qPBPqi7NP3-SEjbn5_0 2024-09-12T18:59:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10429555004269537486', time=2024-09-12T20:35:01.043611+0000, chain.objs.size()=1 2024-09-12T18:59:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.N6W3A_7PoLrw0itqlcKSB7fj2-3Y8e3_0 2024-09-12T18:59:59.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14541678429137217274', time=2024-09-12T20:36:00.408362+0000, chain.objs.size()=1 2024-09-12T18:59:59.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.382__shadow_.YTjmUuZyQAVA833dimX0ja5K-Gzh556_0 2024-09-12T18:59:59.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.343+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50618 2024-09-12T18:59:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:59:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13051494632139716906', time=2024-09-12T20:36:01.473390+0000, chain.objs.size()=1 2024-09-12T18:59:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.383__shadow_.TzQ8cvJyEGr_topQZ7ZF2BJhlc_Zl6n_0 2024-09-12T18:59:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16309961629982323502', time=2024-09-12T20:37:25.050542+0000, chain.objs.size()=1 2024-09-12T18:59:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.457__shadow_.hugNC4GT4t1PwYzSlnGZMn0LwFWnxKP_0 2024-09-12T18:59:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15430903592632414496', time=2024-09-12T20:37:56.795881+0000, chain.objs.size()=1 2024-09-12T18:59:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.B4-fegX5SHDePf6rL3U87RdGAX9KK1v_0 2024-09-12T18:59:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7093794401312653424', time=2024-09-12T20:38:05.707766+0000, chain.objs.size()=1 2024-09-12T18:59:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.487__shadow_.F5bHyIfeDAswdrpXuiAfPmi5eWS2D0m_0 2024-09-12T18:59:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17369850722530837101', time=2024-09-12T20:38:08.088241+0000, chain.objs.size()=1 2024-09-12T18:59:59.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.489__shadow_.fcpowxLvSVZu-p-XzcEtEYKgYGIkpfl_0 2024-09-12T18:59:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13426641907207349496', time=2024-09-12T20:38:14.074711+0000, chain.objs.size()=1 2024-09-12T18:59:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.495__shadow_.C5z6OsTJYn9L-ihAmJuKXCfZ5ejh_9a_0 2024-09-12T18:59:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13004178499103306561', time=2024-09-12T20:40:52.268717+0000, chain.objs.size()=6 2024-09-12T18:59:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~0XFDFRKzX3NSo9l6zV-HigKxtv0dHRS.1 2024-09-12T18:59:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.L6Kdrl4arZmf9vJdn4fdIZpPWLOhNjGw.2 2024-09-12T18:59:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.VsT_6jbSthnxYaaApcZTpOjP9MjuWlEq.3 2024-09-12T18:59:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~0XFDFRKzX3NSo9l6zV-HigKxtv0dHRS.4 2024-09-12T18:59:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~0XFDFRKzX3NSo9l6zV-HigKxtv0dHRS.5 2024-09-12T18:59:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~0XFDFRKzX3NSo9l6zV-HigKxtv0dHRS.6 2024-09-12T18:59:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2993697728460188003', time=2024-09-12T20:44:01.958255+0000, chain.objs.size()=1 2024-09-12T18:59:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:x1d9tv33uL0hRtBl60gFM.trh1Tz113_.O_7UEbmJcZxRLMn-6lGGtXvEU6vu2sk_0 2024-09-12T18:59:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15101464913366992829', time=2024-09-12T20:44:35.492237+0000, chain.objs.size()=1 2024-09-12T18:59:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:uAsPV6NI7nE72vxNvGAvJlGbkWu.cjA_.YRZGsr9Wt1AKCNLIuA2_IChvVpwIaxd_0 2024-09-12T18:59:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15309224258437576302', time=2024-09-12T20:45:39.755036+0000, chain.objs.size()=1 2024-09-12T18:59:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.580__shadow:yMU8APiZiUwFvOs15EjFdoiuGrl9xCA_._JdH5UOni97x9mgS6kgqPXl7qhEaGz4_0 2024-09-12T18:59:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5193692681255797963', time=2024-09-12T20:45:39.760755+0000, chain.objs.size()=1 2024-09-12T18:59:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.347+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.580__shadow:yMU8APiZiUwFvOs15EjFdoiuGrl9xCA_._JdH5UOni97x9mgS6kgqPXl7qhEaGz4_0 2024-09-12T18:59:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.351+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1065386019393387477', time=2024-09-12T20:45:41.058631+0000, chain.objs.size()=1 2024-09-12T18:59:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.351+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.582__shadow:BCKCpDf9HQ.8ZLgsoE9s0eO3vUXScps_.CV4czzBEyVxN-At61Zey-8WxSp2pmUp_0 2024-09-12T18:59:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.351+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10029092480607786477', time=2024-09-12T20:48:47.116948+0000, chain.objs.size()=1 2024-09-12T18:59:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.351+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.617__shadow_.cQ5rCG4_hMU59R4uc0lpAfxeuNK17KY_0 2024-09-12T18:59:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.351+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:59:59.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54888' 2024-09-12T18:59:59.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.951124207598676823', time=2024-09-12T20:23:11.768412+0000, chain.objs.size()=1 2024-09-12T18:59:59.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.176__shadow_.iCj1rg88bbg5_T7bbDOc0ekhe24O32y_0 2024-09-12T18:59:59.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13870856254323443335', time=2024-09-12T20:26:51.019117+0000, chain.objs.size()=1 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.248__shadow_.8aZD0fzO046YC-Re7GtcRNSqZWW8d8v_0 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5473131545561054350', time=2024-09-12T20:26:53.824141+0000, chain.objs.size()=1 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.250__shadow_.JCbXMK4JcCggqUgxFJFxQ0UFlFrwF4L_0 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10168191668458294919', time=2024-09-12T20:27:00.826995+0000, chain.objs.size()=1 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.255__shadow_.v2ukODathPpr0Z4Yciye-g5IcsOozSV_0 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4713854984585543046', time=2024-09-12T20:28:48.300717+0000, chain.objs.size()=1 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.0SgGGErhMRGLhs95QDVtW1k3Hm1z325_0 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6736082731816513837', time=2024-09-12T20:28:48.387619+0000, chain.objs.size()=1 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.0ytnS7Frkjwo5s3j6rVB6FCiURdX83c_0 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11822912266476217281', time=2024-09-12T20:28:48.858230+0000, chain.objs.size()=1 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.trRkOiMrJr9IpLych7gTAg5nu0Hzq6h_0 2024-09-12T18:59:59.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14700261441918893718', time=2024-09-12T20:28:50.395505+0000, chain.objs.size()=1 2024-09-12T18:59:59.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.P-Oc-uwus5IYSm1N0aY2GLPTMIoVNgU_0 2024-09-12T18:59:59.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16293827512765454273', time=2024-09-12T20:28:51.787921+0000, chain.objs.size()=1 2024-09-12T18:59:59.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ReMwjcBc88i_kJSe5Y889wO4sIp5EjF_0 2024-09-12T18:59:59.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9500085027295011617', time=2024-09-12T20:28:55.368707+0000, chain.objs.size()=1 2024-09-12T18:59:59.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.hCFxQONNGhyrxGJ-6GUQJT3YuZvz7Ct_0 2024-09-12T18:59:59.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12359774151156316143', time=2024-09-12T20:28:56.484221+0000, chain.objs.size()=1 2024-09-12T18:59:59.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FslpGbDQBaK9LwRhYiAo6MEKsIpFDPN_0 2024-09-12T18:59:59.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7458074357712246730', time=2024-09-12T20:28:56.549105+0000, chain.objs.size()=1 2024-09-12T18:59:59.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.355+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.r4Ftm51tyJsXcUC-gocwSsrirZ7Y1k5_0 2024-09-12T18:59:59.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2251142007595344576', time=2024-09-12T20:28:56.685393+0000, chain.objs.size()=1 2024-09-12T18:59:59.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.cD6TgFzbk5DM_plOh-M_cEY-n_hHXKj_0 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5160886802903613719', time=2024-09-12T20:28:57.822064+0000, chain.objs.size()=1 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AqBrHhGM_tZSGMyPzZtI8SfK6jUVCGy_0 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2428373461189420245', time=2024-09-12T20:28:58.028339+0000, chain.objs.size()=1 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ofd_0utnvVwL6cbmdWuF7vBDcjr1Thm_0 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17892648214423278075', time=2024-09-12T20:28:59.093780+0000, chain.objs.size()=1 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.IME-gXh7HbC3mMf4a9pgsdpftYH_eqL_0 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9526735988958473271', time=2024-09-12T20:28:59.438023+0000, chain.objs.size()=1 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9KvaLQzDzjUkTl_YDjGm6krANTcARl3_0 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18182651389377656352', time=2024-09-12T20:28:59.715875+0000, chain.objs.size()=1 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.QRyzzee7PyMiN_tYRZkDi2jH9EbYcF1_0 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16003797650822946565', time=2024-09-12T20:28:59.717804+0000, chain.objs.size()=1 2024-09-12T18:59:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bAQdFoFxK-N7L0Tu96DN986mWru-qkP_0 2024-09-12T18:59:59.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14362099607222829641', time=2024-09-12T20:29:00.735764+0000, chain.objs.size()=1 2024-09-12T18:59:59.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.GOUZpfw5UCtzkkRBeBLipdX_qwaJlgr_0 2024-09-12T18:59:59.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17425371314475907277', time=2024-09-12T20:29:02.497966+0000, chain.objs.size()=1 2024-09-12T18:59:59.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.zLbxhyHTXaDctTzuDZVn-Pp_JG1ZSK6_0 2024-09-12T18:59:59.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6403095612997338712', time=2024-09-12T20:29:03.475942+0000, chain.objs.size()=1 2024-09-12T18:59:59.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.yKSh3vLMUQcLBdXh1KGVX8PbpMMdVPb_0 2024-09-12T18:59:59.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7090102135063577550', time=2024-09-12T20:29:04.118548+0000, chain.objs.size()=1 2024-09-12T18:59:59.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.oUVpAkHqXFHPy9cPSc4KH2DIlF3LlGT_0 2024-09-12T18:59:59.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4254637913686306628', time=2024-09-12T20:29:04.355935+0000, chain.objs.size()=1 2024-09-12T18:59:59.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.z3hLc6sP634uAT0zZLO_gthN2s_aCwE_0 2024-09-12T18:59:59.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16599441746841332769', time=2024-09-12T20:29:06.823955+0000, chain.objs.size()=1 2024-09-12T18:59:59.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.359+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2EWmMyo_VT4WbToqNVi4BkII0WoU9kZ_0 2024-09-12T18:59:59.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15714994325174252025', time=2024-09-12T20:29:07.254107+0000, chain.objs.size()=1 2024-09-12T18:59:59.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.99oMYkELcdXKNPn5AHfa2aJKd3X50gT_0 2024-09-12T18:59:59.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12246496820141825150', time=2024-09-12T20:29:07.256230+0000, chain.objs.size()=1 2024-09-12T18:59:59.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fPHaF12xTdYT52numv5BXXi551dTlr3_0 2024-09-12T18:59:59.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.789416487167663775', time=2024-09-12T20:29:09.876853+0000, chain.objs.size()=1 2024-09-12T18:59:59.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._J2Q35cN1kg_KGYzKDuNQi5Lwlmtqx2_0 2024-09-12T18:59:59.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6843053429530278696', time=2024-09-12T20:29:09.980434+0000, chain.objs.size()=1 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.46onlMJ1ybeg6ESK_W2SZUfOSsGoUwB_0 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15494025322561378230', time=2024-09-12T20:29:10.313117+0000, chain.objs.size()=1 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fdj-x-p4ZwqYjBPUnrAodfE3zf9wc4i_0 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12993319066056930693', time=2024-09-12T20:29:10.758431+0000, chain.objs.size()=1 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.w_pD0t2vuwWbwComU3Ah5rERDJvb8Md_0 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11223669335510963874', time=2024-09-12T20:29:10.760439+0000, chain.objs.size()=1 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.MKMgzEm71ImhDgMncH4YRcaBJrbK4OQ_0 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11977361323705613011', time=2024-09-12T20:29:11.125525+0000, chain.objs.size()=1 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.94l-gQz-Kb2vM2IO27RJduP5Ibch9Lx_0 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12633895385577036881', time=2024-09-12T20:29:14.064519+0000, chain.objs.size()=1 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wB2gHopxfhhf-dK3q82_d9upi7fHpOn_0 2024-09-12T18:59:59.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16339918619200869909', time=2024-09-12T20:29:15.061350+0000, chain.objs.size()=1 2024-09-12T18:59:59.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.65u7761GbBFp3vZD9IcwgDDt2gG89de_0 2024-09-12T18:59:59.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11280851558079160895', time=2024-09-12T20:29:30.741603+0000, chain.objs.size()=1 2024-09-12T18:59:59.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.274__shadow_._EtxFX-ZxK60dIQS2P6Za0-S5QqRgC1_0 2024-09-12T18:59:59.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6042262607427573731', time=2024-09-12T20:29:37.705833+0000, chain.objs.size()=1 2024-09-12T18:59:59.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.279__shadow_._T0AVKkP3NRBpf2teXXvLMjHUdxbdKx_0 2024-09-12T18:59:59.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12928342009553998132', time=2024-09-12T20:29:43.365922+0000, chain.objs.size()=1 2024-09-12T18:59:59.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.283__shadow_.zu046v43Nqt93iRHN2UN64ReMLcZKx2_0 2024-09-12T18:59:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13613917027145687217', time=2024-09-12T20:29:44.744495+0000, chain.objs.size()=1 2024-09-12T18:59:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.284__shadow_.lNqFTMHK4QDwFwVmlfUs_JWRoOaL6kZ_0 2024-09-12T18:59:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13199521965076592067', time=2024-09-12T20:29:44.764849+0000, chain.objs.size()=1 2024-09-12T18:59:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.284__shadow_.RikNJUVD6fRXqamgucrxABWVArQjjL6_0 2024-09-12T18:59:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17634585769346036685', time=2024-09-12T20:29:46.236485+0000, chain.objs.size()=1 2024-09-12T18:59:59.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.285__shadow_.55xyIclW93K_fCP7_-htLOSKlEnVnwQ_0 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17516916883657409463', time=2024-09-12T20:29:49.126607+0000, chain.objs.size()=1 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.287__shadow_.IBX8PvJJNHt75VUhhvmjhJi5cOoCydZ_0 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3750773054226229893', time=2024-09-12T20:29:59.048668+0000, chain.objs.size()=1 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.xotS9nFsDIVUDa9gEjQ22wxAtyjBIkV_0 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4645330154254014263', time=2024-09-12T20:29:59.291098+0000, chain.objs.size()=1 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.U0x5vcAfaGntRamoXOTsElIoH1o2DYx_0 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13864233968521115737', time=2024-09-12T20:32:29.451915+0000, chain.objs.size()=1 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.qCT7xiFVICvkz3GaeCSAT3NJh3Jj4Qj_0 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17710934188643366678', time=2024-09-12T20:32:31.463938+0000, chain.objs.size()=1 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.WHuxhmsB7-ffwXSroajndtCiKFI5zRo_0 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.394533006473108458', time=2024-09-12T20:32:32.326215+0000, chain.objs.size()=1 2024-09-12T18:59:59.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.363+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.23XOZj1kElCdZpuh0Y5p8TyFjpfmUDu_0 2024-09-12T18:59:59.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15654354577484012913', time=2024-09-12T20:32:33.064444+0000, chain.objs.size()=1 2024-09-12T18:59:59.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Z4MF-M-YFsGISqQ9GWiQDN4rc3Svr3Q_0 2024-09-12T18:59:59.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13890297303193088030', time=2024-09-12T20:32:35.281007+0000, chain.objs.size()=1 2024-09-12T18:59:59.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Wt6UuDm4gRPaww7BTZs7ufJhFkAFrrz_0 2024-09-12T18:59:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9702059220894905464', time=2024-09-12T20:32:35.607922+0000, chain.objs.size()=1 2024-09-12T18:59:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IXkWPbHJK8jXFCakS5Q56DcbjYfxqhC_0 2024-09-12T18:59:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12625198060281859961', time=2024-09-12T20:32:36.285527+0000, chain.objs.size()=1 2024-09-12T18:59:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Cyz5Ot6nUQ_GgtqN81fDEAmPlCVVAgk_0 2024-09-12T18:59:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5135518362870774943', time=2024-09-12T20:32:36.401053+0000, chain.objs.size()=1 2024-09-12T18:59:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.t62p0KLCkI9kJZ2nGJoODyYPQMjYG6Q_0 2024-09-12T18:59:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11729741335806772579', time=2024-09-12T20:32:36.579720+0000, chain.objs.size()=1 2024-09-12T18:59:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HbTcKxewB9ME2L6CVGZ97ubjkRbtLQH_0 2024-09-12T18:59:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11203716191535779540', time=2024-09-12T20:32:36.759587+0000, chain.objs.size()=1 2024-09-12T18:59:59.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8NPagDjYGhOhSaVf5bJSnbhKV3v-v9E_0 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4051786217041259315', time=2024-09-12T20:32:36.761309+0000, chain.objs.size()=1 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.MD34bPMrtT8xRJ8VeOBWwmwb_DKjtA3_0 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8942398744820876378', time=2024-09-12T20:32:36.949836+0000, chain.objs.size()=1 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.xVTPvkmSrhHoeDWmgroLGfDMMbQZYAO_0 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5530125075854431267', time=2024-09-12T20:32:37.890937+0000, chain.objs.size()=1 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.EAJaEYcfwyiuWYe_ldR-KM_c58ocetu_0 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3036194569829700420', time=2024-09-12T20:32:39.061675+0000, chain.objs.size()=1 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.p8sFSl7hHZlJ1hHcJi5OCRynUcgyEM9_0 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17732106842290881964', time=2024-09-12T20:32:39.212601+0000, chain.objs.size()=1 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.QwZ7z6FdfIfyfLChwu8yM6c0v8FhwNz_0 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16469619756653354825', time=2024-09-12T20:32:39.903237+0000, chain.objs.size()=1 2024-09-12T18:59:59.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.367+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yN8b_dNeCOEJCTzewXIFmQOzIPXikQn_0 2024-09-12T18:59:59.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13671100192466566299', time=2024-09-12T20:32:39.966357+0000, chain.objs.size()=1 2024-09-12T18:59:59.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Woz3q_snLgJxPShfJvcXvIUda_A-Sw0_0 2024-09-12T18:59:59.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9876722938262184121', time=2024-09-12T20:32:40.315377+0000, chain.objs.size()=1 2024-09-12T18:59:59.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.PsaDWznSy-qSdSzS_lxOzYFlw2U7YGG_0 2024-09-12T18:59:59.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2579895483891193921', time=2024-09-12T20:32:41.426066+0000, chain.objs.size()=1 2024-09-12T18:59:59.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Hjl7X-i6uQV-yII_nzKCV6obCFzVQfj_0 2024-09-12T18:59:59.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7954511382475020619', time=2024-09-12T20:32:41.635055+0000, chain.objs.size()=1 2024-09-12T18:59:59.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3YuCzl5PD7i-6OnZbFYQDh0zmGLPesl_0 2024-09-12T18:59:59.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16240107181187753904', time=2024-09-12T20:32:41.833961+0000, chain.objs.size()=1 2024-09-12T18:59:59.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tC7ZOtjTVRoXjgW530NCF-tIJjs4DLH_0 2024-09-12T18:59:59.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5049315332431562753', time=2024-09-12T20:32:43.208183+0000, chain.objs.size()=1 2024-09-12T18:59:59.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.RW5Ogzsh9UMyy6fH835csbFU2iC5omJ_0 2024-09-12T18:59:59.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6036627697236093244', time=2024-09-12T20:32:43.209776+0000, chain.objs.size()=1 2024-09-12T18:59:59.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kOmlkunHKq1BcYMSfLwgWo9ouVFd4Uk_0 2024-09-12T18:59:59.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13049808251573886042', time=2024-09-12T20:32:44.984345+0000, chain.objs.size()=1 2024-09-12T18:59:59.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.LU6zXalM8oLel-O_ykWapY-OewrkKcP_0 2024-09-12T18:59:59.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14793882658335856619', time=2024-09-12T20:32:47.052799+0000, chain.objs.size()=1 2024-09-12T18:59:59.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.th3k4tkhGnnckEMv2yFOI_P4khYbg3o_0 2024-09-12T18:59:59.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11174957202625010031', time=2024-09-12T20:32:48.324144+0000, chain.objs.size()=1 2024-09-12T18:59:59.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.C0ox4vkvKlax4tfFQjPy19fweyRPuew_0 2024-09-12T18:59:59.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9667906980018648364', time=2024-09-12T20:32:50.153992+0000, chain.objs.size()=1 2024-09-12T18:59:59.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6NScFDW2irPtwv-lNmlnytmwrd8c3WR_0 2024-09-12T18:59:59.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8483368877978662942', time=2024-09-12T20:32:50.563936+0000, chain.objs.size()=1 2024-09-12T18:59:59.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sKy7R5EM_fANGIEB0Fcx4D1ddru1gbq_0 2024-09-12T18:59:59.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15492461946526494300', time=2024-09-12T20:32:51.524371+0000, chain.objs.size()=1 2024-09-12T18:59:59.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hjYL-1EzbGK_ldrf30IZB443jPbJLIU_0 2024-09-12T18:59:59.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2482902850677836064', time=2024-09-12T20:32:51.535447+0000, chain.objs.size()=1 2024-09-12T18:59:59.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.07VozwQ6FRwepAI-M6OY8EFaQykFSj-_0 2024-09-12T18:59:59.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5720028366977314326', time=2024-09-12T20:32:51.861859+0000, chain.objs.size()=1 2024-09-12T18:59:59.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.RlB9UcDVjMjwZqHxABCWWOPklhkXsOx_0 2024-09-12T18:59:59.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7352050097808193443', time=2024-09-12T20:32:51.881644+0000, chain.objs.size()=1 2024-09-12T18:59:59.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.371+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.QsXh2J09Ft5YAXpiyRw-Ku0n9D16EMh_0 2024-09-12T18:59:59.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12807817581775346485', time=2024-09-12T20:34:34.013385+0000, chain.objs.size()=1 2024-09-12T18:59:59.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.U-4MGYMZ_192TFn0NhbWzI2OU3LYdrN_0 2024-09-12T18:59:59.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5960478312575748197', time=2024-09-12T20:34:37.892757+0000, chain.objs.size()=1 2024-09-12T18:59:59.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._UbPXzeFpFKqC5azihfFvd9hxn6J0dL_0 2024-09-12T18:59:59.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9426442080608549956', time=2024-09-12T20:34:37.894742+0000, chain.objs.size()=1 2024-09-12T18:59:59.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.s3-BbW-Bi2_j6H1c-oBU8YXlJEfBFch_0 2024-09-12T18:59:59.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9588489662313754331', time=2024-09-12T20:34:39.235194+0000, chain.objs.size()=1 2024-09-12T18:59:59.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._U0KDD5-GJWCPczTi1MjhyTsv0GBRN4_0 2024-09-12T18:59:59.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3432732806998415723', time=2024-09-12T20:34:39.419305+0000, chain.objs.size()=1 2024-09-12T18:59:59.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.z_K0hxWmQZDkgegl400EYL6BiIHs9di_0 2024-09-12T18:59:59.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1125658709863681664', time=2024-09-12T20:34:43.133138+0000, chain.objs.size()=1 2024-09-12T18:59:59.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3T8fwB2nEb52A_QK_yGKUt548uVuomK_0 2024-09-12T18:59:59.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14812072448886473210', time=2024-09-12T20:34:49.054240+0000, chain.objs.size()=1 2024-09-12T18:59:59.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.oWfLRyLR1FubpKkdMJq3nCn0qTLRZQW_0 2024-09-12T18:59:59.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12233571586149548766', time=2024-09-12T20:34:49.450063+0000, chain.objs.size()=1 2024-09-12T18:59:59.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.F1ckTvy3WlS8KZFKJTLxc0LjStpT3tP_0 2024-09-12T18:59:59.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17366433224669721671', time=2024-09-12T20:34:50.032231+0000, chain.objs.size()=1 2024-09-12T18:59:59.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.J3t6XkgjP_TcKFsxdxs3UUHuVwbFdtb_0 2024-09-12T18:59:59.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7442176800555294975', time=2024-09-12T20:34:50.168746+0000, chain.objs.size()=1 2024-09-12T18:59:59.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.uFwjZ5GPh5pXOkYUyMkMgf0iemRIfbW_0 2024-09-12T18:59:59.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10412003371396069346', time=2024-09-12T20:34:50.301727+0000, chain.objs.size()=1 2024-09-12T18:59:59.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.r7cdyiQJ9lJbPnZ9uzOqQJTkWZISqLN_0 2024-09-12T18:59:59.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16003266451553360232', time=2024-09-12T20:34:51.031865+0000, chain.objs.size()=1 2024-09-12T18:59:59.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.IUCSoYFG0-j5Ws3T_e6aS529qA0VkbN_0 2024-09-12T18:59:59.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3175642498868790150', time=2024-09-12T20:34:51.313111+0000, chain.objs.size()=1 2024-09-12T18:59:59.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.eB6c1Jp7y7ZLii_oTDVKFyfvf1grBqL_0 2024-09-12T18:59:59.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8781603795834973221', time=2024-09-12T20:34:51.401497+0000, chain.objs.size()=1 2024-09-12T18:59:59.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.375+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ermgJ1jly1yUGt9d_YW372TLccyV-l1_0 2024-09-12T18:59:59.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10980875947223062929', time=2024-09-12T20:34:52.203305+0000, chain.objs.size()=1 2024-09-12T18:59:59.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bnr2QUt-g6P20ieD2TLgCzGS1M8j-3j_0 2024-09-12T18:59:59.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10177082898011874568', time=2024-09-12T20:34:53.318890+0000, chain.objs.size()=1 2024-09-12T18:59:59.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YhMZyCt1mCF2Pdx2lgMzvxMOf9gVRps_0 2024-09-12T18:59:59.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9527553611100995285', time=2024-09-12T20:34:53.320844+0000, chain.objs.size()=1 2024-09-12T18:59:59.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qIW_AGJDyZVs5ulCoFS7bzlmArK3xxu_0 2024-09-12T18:59:59.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11680868675114439727', time=2024-09-12T20:34:54.035590+0000, chain.objs.size()=1 2024-09-12T18:59:59.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.I0a-T1OcOzLgauUlXBl2It4JNIjkKPz_0 2024-09-12T18:59:59.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5140293154033268999', time=2024-09-12T20:34:54.325035+0000, chain.objs.size()=1 2024-09-12T18:59:59.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6d47i9SITCgP4tHJDWNtd4rEzAgHSrA_0 2024-09-12T18:59:59.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16721039033633863645', time=2024-09-12T20:34:54.571965+0000, chain.objs.size()=1 2024-09-12T18:59:59.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.OPxtkPDwftssW_MANV3DfSgx7Rs4RGb_0 2024-09-12T18:59:59.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16745449544582083652', time=2024-09-12T20:34:54.574271+0000, chain.objs.size()=1 2024-09-12T18:59:59.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.p4d0RCinwuDkzZd2N_FNbEIO9ltVuE0_0 2024-09-12T18:59:59.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3758624294407880737', time=2024-09-12T20:34:54.938004+0000, chain.objs.size()=1 2024-09-12T18:59:59.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.dcOwqTy3D9kAMxAhmW9P33fnPF-YYYN_0 2024-09-12T18:59:59.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15926549211938213401', time=2024-09-12T20:34:56.212928+0000, chain.objs.size()=1 2024-09-12T18:59:59.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.eFin3jtu3acnY90h8FULMiX1RVsow_v_0 2024-09-12T18:59:59.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15695879071450848313', time=2024-09-12T20:34:56.398485+0000, chain.objs.size()=1 2024-09-12T18:59:59.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.379+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QpyQV1kR_ZvW7OzvkgTopZGlzN7HtvG_0 2024-09-12T18:59:59.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54888 2024-09-12T18:59:59.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:59:59.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15637730628298783490', time=2024-09-12T20:34:56.951864+0000, chain.objs.size()=1 2024-09-12T18:59:59.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.X24TA_17yI_4s7Gp_sL9N8UUm8YMsBF_0 2024-09-12T18:59:59.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3710993357132547863', time=2024-09-12T20:34:57.654309+0000, chain.objs.size()=1 2024-09-12T18:59:59.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4zIwjdSaKbLHpLZCwDxQzd3MTYHR9qP_0 2024-09-12T18:59:59.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2885190732544751091', time=2024-09-12T20:34:58.594476+0000, chain.objs.size()=1 2024-09-12T18:59:59.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.WknELrVX9GH8rlak59y0OvSRRRJcD-Q_0 2024-09-12T18:59:59.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5118205733912722985', time=2024-09-12T20:34:59.474440+0000, chain.objs.size()=1 2024-09-12T18:59:59.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kyFZsFHZTUaaAXL8sD0cVcjzhHXCzIa_0 2024-09-12T18:59:59.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1343731108030369221', time=2024-09-12T20:34:59.936891+0000, chain.objs.size()=1 2024-09-12T18:59:59.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.yxyBvNotqHNElH131Gh0aEqsYpiiruM_0 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1149344667044011771', time=2024-09-12T20:35:01.572809+0000, chain.objs.size()=1 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MLVgWrcFDd7w48XkNqvrD9jFRWliabY_0 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8700095317351329195', time=2024-09-12T20:36:50.120219+0000, chain.objs.size()=1 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.429__shadow_.G4X2Y1Z37sL8_a76bFycfHncvXGTEuZ_0 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1666136029669149419', time=2024-09-12T20:36:58.386952+0000, chain.objs.size()=1 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.436__shadow_.oqirpvXDtIpLXl-lJoh1hOgbFgiOpfM_0 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9357123484717031536', time=2024-09-12T20:37:30.323719+0000, chain.objs.size()=1 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.460__shadow_.4QZYAwF9uNpfRXLsWUrsTQILqHY7Jy1_0 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2019443946688579737', time=2024-09-12T20:37:56.791214+0000, chain.objs.size()=1 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.-A9t98iee7o1RoeIZJW7kVQvCKLW5Fy_0 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17103943831963378159', time=2024-09-12T20:37:56.794837+0000, chain.objs.size()=1 2024-09-12T18:59:59.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.EIsUtWZhlHMnT6zWJqywlo6sZGcnnnN_0 2024-09-12T18:59:59.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6232493669397114533', time=2024-09-12T20:38:12.204059+0000, chain.objs.size()=1 2024-09-12T18:59:59.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.383+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.493__shadow_.Z10WrZ7lp80v2vZcG6HeOKHCOM0HRx4_0 2024-09-12T18:59:59.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12050062735325914105', time=2024-09-12T20:42:55.179309+0000, chain.objs.size()=1 2024-09-12T18:59:59.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.553__shadow_.stPaeQUsrNfJeTcBzKeW0vLmN2im83E_0 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16327060552580262006', time=2024-09-12T20:43:10.765168+0000, chain.objs.size()=1 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.557__shadow_.ZLEHp_EDLXoHTcLn1B8A09dEMT8jDXZ_0 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13825394762808357309', time=2024-09-12T20:43:49.191897+0000, chain.objs.size()=1 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:HPUYBicG-T0WcEz6g8-iR1YgGXxUkj7_.HHnnbnzzUFfN4_7T62dZq9rtxLAqRsW_0 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12019965213677723378', time=2024-09-12T20:44:10.263076+0000, chain.objs.size()=1 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.573__shadow_.GWwaKwLxM8azabcGbSrjog0zqxRG4F7_0 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7507121079758813397', time=2024-09-12T20:44:19.823239+0000, chain.objs.size()=1 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574__shadow:zKR42ykJoCtYEE6BkLYAKcXV18QJ.Hv_.ppXbyYkRwaDJ7Q2wZ-1mgYXYDnOmKk4_0 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4373842466211472721', time=2024-09-12T20:44:43.720143+0000, chain.objs.size()=1 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:47cThB1ie7AGNSXc2GhLu1c1RctAL7b_.RLMKmuwtwUvX89p_giLPJ_KBNd9tcvG_0 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11189424500857674773', time=2024-09-12T20:45:39.100092+0000, chain.objs.size()=1 2024-09-12T18:59:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.580__shadow:zZIydmVUTKFCziSS7nc1o8T.oM7Xq-p_.bBttjkFMfqpcaQ5SmJV9V9Ojsj3adnp_0 2024-09-12T18:59:59.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17550258520422624953', time=2024-09-12T20:50:56.760015+0000, chain.objs.size()=1 2024-09-12T18:59:59.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.641__shadow_.PDfsTkn_dNs63bHo7gZh2mFDdAyknVw_0 2024-09-12T18:59:59.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8383569461673066025', time=2024-09-12T20:54:03.516843+0000, chain.objs.size()=1 2024-09-12T18:59:59.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.744__shadow_.19aetkxbbqjBxElMeJn_yacRhKD0C5l_0 2024-09-12T18:59:59.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.387+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.391+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:59:59.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.391+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52325' 2024-09-12T18:59:59.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1229625438846095744', time=2024-09-12T20:22:02.210595+0000, chain.objs.size()=1 2024-09-12T18:59:59.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.151__shadow_.ZDMiLle9syhSNXnkL4YInFpvfoNU0LT_0 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_gthsiHczcRjf-BOxF-spFbivf2XhcLY', time=2024-09-12T20:22:32.148492+0000, chain.objs.size()=3 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.vA241n8oxcFgDGiY-QcSrXMD0YOdIjf_0 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.vA241n8oxcFgDGiY-QcSrXMD0YOdIjf_1 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.vA241n8oxcFgDGiY-QcSrXMD0YOdIjf_2 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2737044050122683196', time=2024-09-12T20:22:54.416173+0000, chain.objs.size()=1 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.166__shadow_.OlulxVkHallqNtEDO_UJ-KCOPOvTIhS_0 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16343549810537079269', time=2024-09-12T20:26:28.164601+0000, chain.objs.size()=1 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.233__shadow_.cfgisD8SOCmoQkUnRv1ua7a68HcZQI3_0 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8393053923194317365', time=2024-09-12T20:28:49.340172+0000, chain.objs.size()=1 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VxQkMke_jIuMjlHp1UaPP8XzYIAiMO6_0 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7086238833288406138', time=2024-09-12T20:28:50.606245+0000, chain.objs.size()=1 2024-09-12T18:59:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.XgtG4N_ugJ0UCvU4gh0ew-OtKpqu6bv_0 2024-09-12T18:59:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5145234084420825753', time=2024-09-12T20:28:50.635785+0000, chain.objs.size()=1 2024-09-12T18:59:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.eY3Bkh9fmPLprjiM-c3Qyc0cGgjYJC1_0 2024-09-12T18:59:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8511237936259140668', time=2024-09-12T20:28:52.006047+0000, chain.objs.size()=1 2024-09-12T18:59:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.cQ9jGDInPtHrcXqiqrTfCg2_tVYmrIY_0 2024-09-12T18:59:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11814272077578109685', time=2024-09-12T20:28:54.306950+0000, chain.objs.size()=1 2024-09-12T18:59:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.pnu12Ec_y3ouWpPBQirqr1oPOyghA-F_0 2024-09-12T18:59:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9107526323215969091', time=2024-09-12T20:28:55.685318+0000, chain.objs.size()=1 2024-09-12T18:59:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SXjQQqIK2tPt_Jx3gytoGno8Tz5QQPk_0 2024-09-12T18:59:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6280705245697462706', time=2024-09-12T20:28:55.886782+0000, chain.objs.size()=1 2024-09-12T18:59:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DbwOy_-0teBDXlVk0eBpkfZLhjbfQy2_0 2024-09-12T18:59:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8167608988467008518', time=2024-09-12T20:28:57.127816+0000, chain.objs.size()=1 2024-09-12T18:59:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.BuXGS6IjG8ltIWjhJ0u5qDSw1ZN8-kf_0 2024-09-12T18:59:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9215435676197803850', time=2024-09-12T20:28:57.955341+0000, chain.objs.size()=1 2024-09-12T18:59:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Mmv3xI5NXhi_24ljTVxK2XxYx6UGDuA_0 2024-09-12T18:59:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10588916984185581944', time=2024-09-12T20:28:58.076571+0000, chain.objs.size()=1 2024-09-12T18:59:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.395+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.QgFKAGnt11oTIOSNyBwcxGUatFoeqc6_0 2024-09-12T18:59:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3527956715888556078', time=2024-09-12T20:28:59.931217+0000, chain.objs.size()=1 2024-09-12T18:59:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.eQH9SwbqlrwL_KN1a3yS4Tw_3db_d1p_0 2024-09-12T18:59:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8694477724603501700', time=2024-09-12T20:29:00.258648+0000, chain.objs.size()=1 2024-09-12T18:59:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NKkek2fXjeeKV1FZKWR7O8NaXaHP4Z1_0 2024-09-12T18:59:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3284831012643022036', time=2024-09-12T20:29:00.483949+0000, chain.objs.size()=1 2024-09-12T18:59:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.qovg-7FVhUzRl6tMDtHaGIBG11RiqP6_0 2024-09-12T18:59:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5590787713751998906', time=2024-09-12T20:29:00.960267+0000, chain.objs.size()=1 2024-09-12T18:59:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AHJJTw8ca-dDPVUVn_VFgjKnqJLSh0-_0 2024-09-12T18:59:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7096300102693881431', time=2024-09-12T20:29:02.839658+0000, chain.objs.size()=1 2024-09-12T18:59:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fIlsNRpTMIV6285cUela5dDVk9gNTe3_0 2024-09-12T18:59:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14893091962991923248', time=2024-09-12T20:29:03.372108+0000, chain.objs.size()=1 2024-09-12T18:59:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.41PXxOABYDa-tenXwq8NwpnyJ47NHoS_0 2024-09-12T18:59:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.837896372174626574', time=2024-09-12T20:29:03.373619+0000, chain.objs.size()=1 2024-09-12T18:59:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.IZs3Lvbo6eUTyGwSGnSN8RyUe_uZ6NL_0 2024-09-12T18:59:59.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17638258821908559568', time=2024-09-12T20:29:03.417228+0000, chain.objs.size()=1 2024-09-12T18:59:59.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WuzP-gnTjpnPviR_yccsJPnFN5wWLNg_0 2024-09-12T18:59:59.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10916897328105794076', time=2024-09-12T20:29:06.441786+0000, chain.objs.size()=1 2024-09-12T18:59:59.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NzYcQFvxSSg2LAShp7heCUw1qjzBhV3_0 2024-09-12T18:59:59.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12158150070997793051', time=2024-09-12T20:29:07.321688+0000, chain.objs.size()=1 2024-09-12T18:59:59.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Kt8RecvSgoe_EX1Gez-Y64ecCbrmyR0_0 2024-09-12T18:59:59.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15938332830394606855', time=2024-09-12T20:29:08.046699+0000, chain.objs.size()=1 2024-09-12T18:59:59.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.80HQXEp0-cbA4RYpnrs59jcgUqYbHlj_0 2024-09-12T18:59:59.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7362928319336032608', time=2024-09-12T20:29:08.048664+0000, chain.objs.size()=1 2024-09-12T18:59:59.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.N2EZAVE6SL6z36cZlyj8e0FLXTdR84s_0 2024-09-12T18:59:59.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.915104139548297177', time=2024-09-12T20:29:11.504463+0000, chain.objs.size()=1 2024-09-12T18:59:59.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WbjHmiDuCHqufQYVolXh5VPPhk-7uYP_0 2024-09-12T18:59:59.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6933649979606524804', time=2024-09-12T20:29:11.734190+0000, chain.objs.size()=1 2024-09-12T18:59:59.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.33KKwPxkM-Gcfe8A6LKZd348cgOEHTR_0 2024-09-12T18:59:59.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15710692018471442023', time=2024-09-12T20:29:12.041646+0000, chain.objs.size()=1 2024-09-12T18:59:59.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.XFgRAWg_3lCo3166qeZvvEDUahJeqbW_0 2024-09-12T18:59:59.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12273731317808413200', time=2024-09-12T20:29:12.210666+0000, chain.objs.size()=1 2024-09-12T18:59:59.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.f_DPQf9dsTvIn4Vr9l74P3BWo42WKMp_0 2024-09-12T18:59:59.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3598206605416574708', time=2024-09-12T20:29:13.246201+0000, chain.objs.size()=1 2024-09-12T18:59:59.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.P4agMS_rL0ukOJL7GxZC6Bopp8eY-sM_0 2024-09-12T18:59:59.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10131487228521001456', time=2024-09-12T20:29:14.300638+0000, chain.objs.size()=1 2024-09-12T18:59:59.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SesszsjvpF4BnrGGP78yNK2k5FElgwb_0 2024-09-12T18:59:59.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18192948864505474374', time=2024-09-12T20:29:14.808298+0000, chain.objs.size()=1 2024-09-12T18:59:59.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.-01jp1fr-zYzmhu_jkFfe7oSOiX-DVB_0 2024-09-12T18:59:59.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15341462292572427415', time=2024-09-12T20:29:15.407565+0000, chain.objs.size()=1 2024-09-12T18:59:59.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.399+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1iPm7bM4yPuBfhNGxNDyraERi2jC8Pb_0 2024-09-12T18:59:59.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6969523115675893384', time=2024-09-12T20:29:15.409705+0000, chain.objs.size()=1 2024-09-12T18:59:59.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.4_9S5BZ1mvkhoDCboi_ODXbqfMhrLaU_0 2024-09-12T18:59:59.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14203673931061859048', time=2024-09-12T20:29:18.040383+0000, chain.objs.size()=1 2024-09-12T18:59:59.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.264__shadow_.Fo0GWwZ7xVqX1Dp8QwOvHzb8gHj1TcN_0 2024-09-12T18:59:59.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1378018890545234675', time=2024-09-12T20:29:33.537494+0000, chain.objs.size()=1 2024-09-12T18:59:59.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.276__shadow_.2YzAcyYIWGxOFyd_KAXJUZKy2Crr73W_0 2024-09-12T18:59:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18357231891102364453', time=2024-09-12T20:29:59.084423+0000, chain.objs.size()=1 2024-09-12T18:59:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.F30SXLUExAO7gZlvFpnIVce2hF8zi-e_0 2024-09-12T18:59:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7080095498069626577', time=2024-09-12T20:30:08.119684+0000, chain.objs.size()=1 2024-09-12T18:59:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.296__shadow_.fM_0xXDZOYMHCUISPb7EzWRHF0piSsL_0 2024-09-12T18:59:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7967693249213948668', time=2024-09-12T20:30:16.681316+0000, chain.objs.size()=1 2024-09-12T18:59:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.302__shadow_.Ti2xD9i96BezEcx-GNdAjNB0vFr2QLs_0 2024-09-12T18:59:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4645703325407748879', time=2024-09-12T20:32:26.800343+0000, chain.objs.size()=1 2024-09-12T18:59:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.UW2q0YnlOS5dV_HEI4CbsgmpottJgvl_0 2024-09-12T18:59:59.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3365144018426905539', time=2024-09-12T20:32:28.811462+0000, chain.objs.size()=1 2024-09-12T18:59:59.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.euDRA82bZPf2tvvRTotI95fqlyAqZe2_0 2024-09-12T18:59:59.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17503941374532027896', time=2024-09-12T20:32:29.181236+0000, chain.objs.size()=1 2024-09-12T18:59:59.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.KpkOalulKgDBkKe0ci_OEGS3O7hB0v9_0 2024-09-12T18:59:59.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10188820057443467820', time=2024-09-12T20:32:29.464159+0000, chain.objs.size()=1 2024-09-12T18:59:59.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.v1tnmxiCW7QkqOArzYuYXkk4glbxH6u_0 2024-09-12T18:59:59.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1746003461321508605', time=2024-09-12T20:32:31.295230+0000, chain.objs.size()=1 2024-09-12T18:59:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.737lCKY43e8NCuImd5KiEDTsSxwyT0L_0 2024-09-12T18:59:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15767332001470223838', time=2024-09-12T20:32:32.211211+0000, chain.objs.size()=1 2024-09-12T18:59:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sarzahaTyK-6JMBFLpMLfmvsxaSKMbA_0 2024-09-12T18:59:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6394909820162599551', time=2024-09-12T20:32:32.324646+0000, chain.objs.size()=1 2024-09-12T18:59:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.UTkn8EhmXylCIdlQ9tuUs-ZyrpBovKM_0 2024-09-12T18:59:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18401463846265487663', time=2024-09-12T20:32:34.709070+0000, chain.objs.size()=1 2024-09-12T18:59:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.403+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dh0qdTaA0U4pM0SBqI0i6113ohdTHu5_0 2024-09-12T18:59:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17824646953292226116', time=2024-09-12T20:32:38.150488+0000, chain.objs.size()=1 2024-09-12T18:59:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tW-V9pEzoxwLmkmZ53DHYo0MEiWXYKx_0 2024-09-12T18:59:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7072614871368687632', time=2024-09-12T20:32:38.152164+0000, chain.objs.size()=1 2024-09-12T18:59:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.vElXoDLx4kVtSZkrCJhzqjVrAF21eAV_0 2024-09-12T18:59:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14212579853813538123', time=2024-09-12T20:32:38.791766+0000, chain.objs.size()=1 2024-09-12T18:59:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.AjMCzthsekRQ9eoiqSyY9C3iNFwyHM0_0 2024-09-12T18:59:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17657479294564158468', time=2024-09-12T20:32:39.085684+0000, chain.objs.size()=1 2024-09-12T18:59:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tVg4OeElh2vLn1FSOrXho0X9YYjZU5G_0 2024-09-12T18:59:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13870654908975954155', time=2024-09-12T20:32:39.520825+0000, chain.objs.size()=1 2024-09-12T18:59:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.beq-Jd6h3Bbs8XEVvlWq-TzwRd7auwz_0 2024-09-12T18:59:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14166162935051877880', time=2024-09-12T20:32:39.605683+0000, chain.objs.size()=1 2024-09-12T18:59:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uiv97YNgUN3_aztNigIjX3jhAIxEwPN_0 2024-09-12T18:59:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3593948165705518137', time=2024-09-12T20:32:39.892453+0000, chain.objs.size()=1 2024-09-12T18:59:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dC9rICz6TRkE-TtwcSMhyCFSU-OEWFo_0 2024-09-12T18:59:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17589621617460911348', time=2024-09-12T20:32:40.420678+0000, chain.objs.size()=1 2024-09-12T18:59:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1NuhRhILzJNANtDcQNaajW5PqyhNGne_0 2024-09-12T18:59:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5399265434922501029', time=2024-09-12T20:32:41.850935+0000, chain.objs.size()=1 2024-09-12T18:59:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zvikl24t-o2wLIE15tBcQqXi_qM1h9G_0 2024-09-12T18:59:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15949947193602780308', time=2024-09-12T20:32:42.417951+0000, chain.objs.size()=1 2024-09-12T18:59:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Szsb4HI99L2-msxLB0oWyYiEUskr-By_0 2024-09-12T18:59:59.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2880369306262419687', time=2024-09-12T20:32:42.818702+0000, chain.objs.size()=1 2024-09-12T18:59:59.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.G-xnnAOyMkdEHLPTRiO2BGWx2ECrYuU_0 2024-09-12T18:59:59.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13303107343076046054', time=2024-09-12T20:32:42.904440+0000, chain.objs.size()=1 2024-09-12T18:59:59.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.u468Bfe1_VK3XYjtu_JNK9F6WMyarSl_0 2024-09-12T18:59:59.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8383526835936574428', time=2024-09-12T20:32:43.801472+0000, chain.objs.size()=1 2024-09-12T18:59:59.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1q51Fm10RJYEhm4jpAntz2anY-5ErC3_0 2024-09-12T18:59:59.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16713124184488794941', time=2024-09-12T20:32:44.753376+0000, chain.objs.size()=1 2024-09-12T18:59:59.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.PGti1LLFefShqbgYQPe8PKZ1zXSVG-s_0 2024-09-12T18:59:59.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8089985847260700943', time=2024-09-12T20:32:45.202007+0000, chain.objs.size()=1 2024-09-12T18:59:59.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.CH9rldSAaZ938tozT0U98VrlM5hFeno_0 2024-09-12T18:59:59.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9363526950960683893', time=2024-09-12T20:32:47.118853+0000, chain.objs.size()=1 2024-09-12T18:59:59.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.407+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.iwtNwKnO02I5bx4MTRU1ytWEYG6x8rH_0 2024-09-12T18:59:59.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7407043499867023037', time=2024-09-12T20:32:47.321661+0000, chain.objs.size()=1 2024-09-12T18:59:59.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.DN15OSJJpM8LJd5s2hWPj5tAlP0RkuU_0 2024-09-12T18:59:59.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13513520365194071952', time=2024-09-12T20:32:48.291605+0000, chain.objs.size()=1 2024-09-12T18:59:59.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tGjM8-SZ-hJx782SydqM5x9ktwLp6zJ_0 2024-09-12T18:59:59.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18190380065265936321', time=2024-09-12T20:32:48.717555+0000, chain.objs.size()=1 2024-09-12T18:59:59.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.b0HXf0KNC-mIL1cHnuS-dMT0_FEhFBh_0 2024-09-12T18:59:59.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2459219056030462128', time=2024-09-12T20:32:48.949651+0000, chain.objs.size()=1 2024-09-12T18:59:59.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.v_f4evb13Nrq-Js9I_xcvXYiS4TwQzw_0 2024-09-12T18:59:59.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7490026254591722411', time=2024-09-12T20:32:49.408169+0000, chain.objs.size()=1 2024-09-12T18:59:59.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rAnzLSLCpNNj2aU4K_BssdHRKU3UiNQ_0 2024-09-12T18:59:59.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.164515270180913829', time=2024-09-12T20:32:50.027079+0000, chain.objs.size()=1 2024-09-12T18:59:59.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6q46puDCDck9rtUh457gWZW-sm4MJER_0 2024-09-12T18:59:59.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4013520593667061241', time=2024-09-12T20:32:50.989630+0000, chain.objs.size()=1 2024-09-12T18:59:59.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BcxdQRwQmm0MjACBMuncYefX5lc5f8S_0 2024-09-12T18:59:59.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18315591880938661730', time=2024-09-12T20:32:53.069877+0000, chain.objs.size()=1 2024-09-12T18:59:59.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.QdEukZyHECS8wj_68gsCGAu8VnP0fWQ_0 2024-09-12T18:59:59.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5109561436846248800', time=2024-09-12T20:32:53.695996+0000, chain.objs.size()=1 2024-09-12T18:59:59.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.L9DwwHPxnqLFnBVqiC1AO16Nu1w2qKP_0 2024-09-12T18:59:59.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2945745956764660576', time=2024-09-12T20:34:34.351990+0000, chain.objs.size()=1 2024-09-12T18:59:59.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Jr8bO4nnZ72e8QMp4STXqD_gGPJlWRE_0 2024-09-12T18:59:59.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9922745913098211073', time=2024-09-12T20:34:34.938171+0000, chain.objs.size()=1 2024-09-12T18:59:59.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-F-N1WyhVfaY87Ow6lB39lpkU0PLzwo_0 2024-09-12T18:59:59.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.509369356244064244', time=2024-09-12T20:34:35.821932+0000, chain.objs.size()=1 2024-09-12T18:59:59.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LyPjgQN2c6kXgvq9i5_kB8WxLVbgOVj_0 2024-09-12T18:59:59.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4726498739250926555', time=2024-09-12T20:34:36.458125+0000, chain.objs.size()=1 2024-09-12T18:59:59.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.c3fHORLB-RqPPjZDScl8UiAVCejIoTv_0 2024-09-12T18:59:59.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16746996064885911985', time=2024-09-12T20:34:37.955316+0000, chain.objs.size()=1 2024-09-12T18:59:59.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qnkTX7mstJKbtJqfGw4yNThds_cBt8p_0 2024-09-12T18:59:59.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2929060082256368445', time=2024-09-12T20:34:37.957281+0000, chain.objs.size()=1 2024-09-12T18:59:59.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.E3gmjI39XXJTaB43_g9Gh66kFsmgWXo_0 2024-09-12T18:59:59.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10241009841825726076', time=2024-09-12T20:34:38.275602+0000, chain.objs.size()=1 2024-09-12T18:59:59.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PKyopOt7wSr64fcXjnU7jyuTuz5u-FF_0 2024-09-12T18:59:59.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11047053134354221764', time=2024-09-12T20:34:38.428294+0000, chain.objs.size()=1 2024-09-12T18:59:59.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.erjS7_atOog9Bz2kfY43A9_0Smu12JC_0 2024-09-12T18:59:59.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.411+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3870100903342404528', time=2024-09-12T20:34:39.034147+0000, chain.objs.size()=1 2024-09-12T18:59:59.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nmh0srWs76b-Ao9XpcTzYbdHsxaKvU8_0 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15073645958419567240', time=2024-09-12T20:34:39.036266+0000, chain.objs.size()=1 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RrN_PLQkLjkkDMEtWZvgnGITBE3beas_0 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2095575096922578361', time=2024-09-12T20:34:39.433548+0000, chain.objs.size()=1 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1xWgmnMLId7rwH4TG-N4pQLvDfCTB-H_0 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18121707291480699915', time=2024-09-12T20:34:40.261105+0000, chain.objs.size()=1 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.2b_bVCshf27TfVBYBdtnb8CE8Z8b12b_0 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17005197612157512803', time=2024-09-12T20:34:42.461896+0000, chain.objs.size()=1 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bQ_xWVaL2Iawuw9mvu8S7MFLQHJzHvA_0 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14670529444175307668', time=2024-09-12T20:34:42.818869+0000, chain.objs.size()=1 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.e7k34J8o07Xt731lHl4Rgs9ua13X2_U_0 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16187436915054107816', time=2024-09-12T20:34:42.925841+0000, chain.objs.size()=1 2024-09-12T18:59:59.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.51W4147JXafpOhA1d_Yygwuimzt5bMF_0 2024-09-12T18:59:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7481147117613193605', time=2024-09-12T20:34:42.933440+0000, chain.objs.size()=1 2024-09-12T18:59:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.fpyvHiYKessq8v-hIJT12WNR1pmQ9kC_0 2024-09-12T18:59:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2980913731277704523', time=2024-09-12T20:34:43.151094+0000, chain.objs.size()=1 2024-09-12T18:59:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XQ1wItojK16BYDNSOPDxMoxhPaBwfm5_0 2024-09-12T18:59:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9311687939302435463', time=2024-09-12T20:34:43.837296+0000, chain.objs.size()=1 2024-09-12T18:59:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qQSBL-IyMbyshf587Ie4j41v5ZLuVW4_0 2024-09-12T18:59:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7752033262861293539', time=2024-09-12T20:34:46.240820+0000, chain.objs.size()=1 2024-09-12T18:59:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hoz1A4IfzD-BUpjuIeHAwesrLj1Us4l_0 2024-09-12T18:59:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5849474525258496387', time=2024-09-12T20:34:46.728015+0000, chain.objs.size()=1 2024-09-12T18:59:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tx6Q8jZYk2_y4HaoHeeODo_Um4LTsoR_0 2024-09-12T18:59:59.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12535728527033417289', time=2024-09-12T20:34:47.019998+0000, chain.objs.size()=1 2024-09-12T18:59:59.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.iHYKAB7AyFtnEEgsPXhg2aH25bgYUc2_0 2024-09-12T18:59:59.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13772495384146364751', time=2024-09-12T20:34:47.224528+0000, chain.objs.size()=1 2024-09-12T18:59:59.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.xmF1tzGiWSpHnZVyQXNCpSJGdFco3Vi_0 2024-09-12T18:59:59.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15532563687083125922', time=2024-09-12T20:34:47.874532+0000, chain.objs.size()=1 2024-09-12T18:59:59.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wZK-bwXGrdhEodiFNPKPtUN0SM-zwlh_0 2024-09-12T18:59:59.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5972130843309489625', time=2024-09-12T20:34:49.414358+0000, chain.objs.size()=1 2024-09-12T18:59:59.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.uU7jF7xFjkSuSqR0LxRsfnmYGU0uwxX_0 2024-09-12T18:59:59.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7835328545474452068', time=2024-09-12T20:34:49.623029+0000, chain.objs.size()=1 2024-09-12T18:59:59.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QSk3--TwItWpboAlyntp2joWy1KA_2c_0 2024-09-12T18:59:59.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17459848343320709709', time=2024-09-12T20:34:50.875859+0000, chain.objs.size()=1 2024-09-12T18:59:59.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.KVTbL5bfT4zNQMwRTSfdOXoPtakjcuD_0 2024-09-12T18:59:59.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3893115279148535692', time=2024-09-12T20:34:52.704207+0000, chain.objs.size()=1 2024-09-12T18:59:59.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.415+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.uH5nqciYNBgEqg5j-xHGhR3hRWXJzR3_0 2024-09-12T18:59:59.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52325 2024-09-12T18:59:59.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:59:59.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16251317631773191240', time=2024-09-12T20:34:52.938865+0000, chain.objs.size()=1 2024-09-12T18:59:59.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4S3LUJNf8VGhP41OCIud3tXVMaJoHYc_0 2024-09-12T18:59:59.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14322020655941005255', time=2024-09-12T20:34:54.178122+0000, chain.objs.size()=1 2024-09-12T18:59:59.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.TZ1IvDzZUyxmY_yB-NnvqN9DFlZcLID_0 2024-09-12T18:59:59.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10013407757925747452', time=2024-09-12T20:34:56.217631+0000, chain.objs.size()=1 2024-09-12T18:59:59.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.zosftrdPnYhtc_r8ndsnPeTaCSYafoL_0 2024-09-12T18:59:59.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2821894301306452160', time=2024-09-12T20:34:56.976011+0000, chain.objs.size()=1 2024-09-12T18:59:59.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.sbF6itZTVxLsI3F-05jYxBOZlvmGHBD_0 2024-09-12T18:59:59.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13864332274649352718', time=2024-09-12T20:34:57.589138+0000, chain.objs.size()=1 2024-09-12T18:59:59.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.O7UZl59QIm8UdYXhULRSnmd3iAdOsgA_0 2024-09-12T18:59:59.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12439894450987032885', time=2024-09-12T20:35:01.060683+0000, chain.objs.size()=1 2024-09-12T18:59:59.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tpWlgqJa7hK1HVkUXJNls09JAwR5NCo_0 2024-09-12T18:59:59.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7749397156662574366', time=2024-09-12T20:37:41.420706+0000, chain.objs.size()=1 2024-09-12T18:59:59.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.466__shadow_.45D3fVo0sVnvWmb1o_POoemBVmB0JYs_0 2024-09-12T18:59:59.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4923317222352940500', time=2024-09-12T20:37:41.433931+0000, chain.objs.size()=1 2024-09-12T18:59:59.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.466__shadow_.iyUrn0Qr-xcZGioMq6F_M0jjB40eMWa_0 2024-09-12T18:59:59.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1726088489166859540', time=2024-09-12T20:38:45.129699+0000, chain.objs.size()=1 2024-09-12T18:59:59.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.513__multipart_mymultipart.2~1I-meKPGJINdutChOgm66yEYmW1RwdB.1 2024-09-12T18:59:59.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12790710870193248144', time=2024-09-12T20:38:46.363175+0000, chain.objs.size()=1 2024-09-12T18:59:59.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.514__shadow_.8fhoA2jcBUICD9VrpM_QyJDst7fvjd9_0 2024-09-12T18:59:59.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14822358366166853186', time=2024-09-12T20:41:43.050769+0000, chain.objs.size()=2 2024-09-12T18:59:59.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.528__multipart_mymultipart.2~WgB1h57gmHCYfFKM5fkxoBJWpgHKtaO.1 2024-09-12T18:59:59.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.419+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.528__multipart_mymultipart.2~WgB1h57gmHCYfFKM5fkxoBJWpgHKtaO.2 2024-09-12T18:59:59.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2940450282924756399', time=2024-09-12T20:42:52.398328+0000, chain.objs.size()=1 2024-09-12T18:59:59.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.552__shadow_.k5Z79fnLPoO-VRWbWaxhAXeXAOilst5_0 2024-09-12T18:59:59.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6034752557822928233', time=2024-09-12T20:43:04.501697+0000, chain.objs.size()=1 2024-09-12T18:59:59.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.555__shadow_.ivXY2XqaKjTvXOwH2q7K4YqMYZb-S-q_0 2024-09-12T18:59:59.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16674529224740108887', time=2024-09-12T20:43:23.670599+0000, chain.objs.size()=1 2024-09-12T18:59:59.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.562__shadow_.fR7__F8UXtpCGOL5ABPZGVsUUHlyH5J_0 2024-09-12T18:59:59.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4865253667746299120', time=2024-09-12T20:43:47.627002+0000, chain.objs.size()=1 2024-09-12T18:59:59.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:F6qTHo0DN2TkwcfxHo5bB5SEaQJ-cjz_.iEK3FCrR_ChLAt71_ES-__eOko1sMAg_0 2024-09-12T18:59:59.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10145606827102804615', time=2024-09-12T20:50:20.997154+0000, chain.objs.size()=12 2024-09-12T18:59:59.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__multipart_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.1 2024-09-12T18:59:59.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__shadow_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.1_1 2024-09-12T18:59:59.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__multipart_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.2 2024-09-12T18:59:59.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__shadow_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.2_1 2024-09-12T18:59:59.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__multipart_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.3 2024-09-12T18:59:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__shadow_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.3_1 2024-09-12T18:59:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__multipart_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.4 2024-09-12T18:59:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.423+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__shadow_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.4_1 2024-09-12T18:59:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.427+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__multipart_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.5 2024-09-12T18:59:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.427+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__shadow_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.5_1 2024-09-12T18:59:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.427+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__multipart_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.6 2024-09-12T18:59:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.427+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.623__shadow_multipart_enc.2~VdDSbpZXoKJrCQPf6vPAnQEE3vAB21J.6_1 2024-09-12T18:59:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.427+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7898659429062535284', time=2024-09-12T20:52:01.404662+0000, chain.objs.size()=1 2024-09-12T18:59:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.427+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.666__shadow_.MeADMv2ZiJczPVMw8jD1GhLHwYxRoRx_0 2024-09-12T18:59:59.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.427+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5686146500703090832', time=2024-09-12T20:52:31.956322+0000, chain.objs.size()=1 2024-09-12T18:59:59.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.427+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.696__shadow:w3LiXHCLS4N3UrAZuvIn4j4hqWclegO_.p1xpXZ3oyX-JT7ETgv4Zs2WBFVSJjta_0 2024-09-12T18:59:59.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.431+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.431+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:59:59.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44798' 2024-09-12T18:59:59.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.510975534110476917', time=2024-09-12T20:22:22.887902+0000, chain.objs.size()=5 2024-09-12T18:59:59.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__multipart_mymultipart-LUKEWARM.2~g7Bv-LOexm1IXPjkZa-IRBUW3wLsTgg.1 2024-09-12T18:59:59.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__shadow_mymultipart-LUKEWARM.2~g7Bv-LOexm1IXPjkZa-IRBUW3wLsTgg.1_1 2024-09-12T18:59:59.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__multipart_mymultipart-LUKEWARM.2~g7Bv-LOexm1IXPjkZa-IRBUW3wLsTgg.2 2024-09-12T18:59:59.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__shadow_mymultipart-LUKEWARM.2~g7Bv-LOexm1IXPjkZa-IRBUW3wLsTgg.2_1 2024-09-12T18:59:59.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__multipart_mymultipart-LUKEWARM.2~g7Bv-LOexm1IXPjkZa-IRBUW3wLsTgg.3 2024-09-12T18:59:59.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16240953947058923581', time=2024-09-12T20:22:30.856930+0000, chain.objs.size()=3 2024-09-12T18:59:59.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.Wj4c8qzo_Qu_PISLYPqXNOXMsxDBN3Z_0 2024-09-12T18:59:59.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.Wj4c8qzo_Qu_PISLYPqXNOXMsxDBN3Z_1 2024-09-12T18:59:59.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.Wj4c8qzo_Qu_PISLYPqXNOXMsxDBN3Z_2 2024-09-12T18:59:59.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9602097571667586662', time=2024-09-12T20:26:45.443917+0000, chain.objs.size()=1 2024-09-12T18:59:59.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.244__shadow_.Md2ArTZbQMaD8NRoMQIimsUKPsjjOac_0 2024-09-12T18:59:59.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3004641981331972818', time=2024-09-12T20:26:46.820260+0000, chain.objs.size()=1 2024-09-12T18:59:59.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.245__shadow_.uhtUCHmovF1cTGvKk_X7gSxxsau3kAR_0 2024-09-12T18:59:59.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2073082969604145426', time=2024-09-12T20:27:06.115709+0000, chain.objs.size()=1 2024-09-12T18:59:59.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.259__shadow_.uHgFtS-688JXmTKcybWwQ8A9LXp64tl_0 2024-09-12T18:59:59.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16247939697312938235', time=2024-09-12T20:28:47.888596+0000, chain.objs.size()=1 2024-09-12T18:59:59.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.435+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.blmFXVJid-u8ZJmvzqh6gwjFzUKgRQW_0 2024-09-12T18:59:59.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5179445218349522731', time=2024-09-12T20:28:51.657013+0000, chain.objs.size()=1 2024-09-12T18:59:59.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.TjWtKoJvlKcTd3mUoJ8vBpUUJYjx8G0_0 2024-09-12T18:59:59.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3151527449622912501', time=2024-09-12T20:28:52.041167+0000, chain.objs.size()=1 2024-09-12T18:59:59.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OHc4pqZRgGSEhLhtpR-YFmNoQSA1PM1_0 2024-09-12T18:59:59.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16076366969690383629', time=2024-09-12T20:28:53.734099+0000, chain.objs.size()=1 2024-09-12T18:59:59.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Ppnq7yf2QzRDuWXu-WCFtUgXrIATJol_0 2024-09-12T18:59:59.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1647615128908653864', time=2024-09-12T20:28:54.027186+0000, chain.objs.size()=1 2024-09-12T18:59:59.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vyYWf55Ye4D6Ewa_SEOTnavjnHuREVb_0 2024-09-12T18:59:59.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5676035853819699710', time=2024-09-12T20:28:54.305381+0000, chain.objs.size()=1 2024-09-12T18:59:59.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AuTSMoO2RxaqlJQiJpbtHs3MI4SXFdP_0 2024-09-12T18:59:59.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1544675972450566149', time=2024-09-12T20:28:55.683775+0000, chain.objs.size()=1 2024-09-12T18:59:59.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.haeIvyk6z59W4eUP8HWRORxBgPhFvt9_0 2024-09-12T18:59:59.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11316826431982507156', time=2024-09-12T20:28:55.896985+0000, chain.objs.size()=1 2024-09-12T18:59:59.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.hKEgv6J5yfIi_AyDYq1omRNrZaLP7my_0 2024-09-12T18:59:59.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17834869418376721301', time=2024-09-12T20:28:56.335340+0000, chain.objs.size()=1 2024-09-12T18:59:59.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.h5WOWmUyeY2Zl_aD_dUyeYMYxCdmPk4_0 2024-09-12T18:59:59.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1897613503624349392', time=2024-09-12T20:28:56.358111+0000, chain.objs.size()=1 2024-09-12T18:59:59.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.a2TS2wkHXwWTGagwRCu0_kqEXle-2eZ_0 2024-09-12T18:59:59.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.847201096497963626', time=2024-09-12T20:28:57.361101+0000, chain.objs.size()=1 2024-09-12T18:59:59.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.MYIcvqhIrhdGijvbs7Y6t4mDFDBo0Rl_0 2024-09-12T18:59:59.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9041082068633457464', time=2024-09-12T20:28:57.839541+0000, chain.objs.size()=1 2024-09-12T18:59:59.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.pxwz7xw5iXUPxYJ_Cf6WrCH8O7sCQsh_0 2024-09-12T18:59:59.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6665328134584497082', time=2024-09-12T20:29:00.510103+0000, chain.objs.size()=1 2024-09-12T18:59:59.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vM52HACiyTVJXBZNy-J3yPkSpG9iTKB_0 2024-09-12T18:59:59.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3092761015970453350', time=2024-09-12T20:29:00.591036+0000, chain.objs.size()=1 2024-09-12T18:59:59.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.X_2EJr7Um_R9Mklycy4tUvMFndLUazK_0 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17912108032446881990', time=2024-09-12T20:29:01.175676+0000, chain.objs.size()=1 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.IpP0EuqOkJbEI2zYtSSBFUDhW4TaSXo_0 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9379430293483856030', time=2024-09-12T20:29:02.956472+0000, chain.objs.size()=1 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.byNkEkQr1nwNqgsFm9xu7cXZ7CTYw36_0 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1766572774716719929', time=2024-09-12T20:29:03.461381+0000, chain.objs.size()=1 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ZkeLkyVVk5T3pmTiKbqYAmkGFiiYiKr_0 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14305342362109312214', time=2024-09-12T20:29:03.626379+0000, chain.objs.size()=1 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OQH3hxEuqyUMAVDJ81XcwiR0sFqXSbF_0 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14956833734284213925', time=2024-09-12T20:29:03.781097+0000, chain.objs.size()=1 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.GWO7gvlShpIXPymMACsonPjEXZC1Ai5_0 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10740516357706189033', time=2024-09-12T20:29:04.560106+0000, chain.objs.size()=1 2024-09-12T18:59:59.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.EmlhSQ8714-3ISeqTukF7CR_x0YGs8h_0 2024-09-12T18:59:59.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12833066429655458144', time=2024-09-12T20:29:04.649974+0000, chain.objs.size()=1 2024-09-12T18:59:59.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ZgWpTgAfqQboP-y_prnYC9raIbHKHWA_0 2024-09-12T18:59:59.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17630164755260686202', time=2024-09-12T20:29:06.468578+0000, chain.objs.size()=1 2024-09-12T18:59:59.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5kbstuJ7nYWAEUtxBw4td03xiOPoqXl_0 2024-09-12T18:59:59.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11715592595643822210', time=2024-09-12T20:29:08.259522+0000, chain.objs.size()=1 2024-09-12T18:59:59.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.439+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vLzGGbYyGxrNwWKk_IVwpcZ_wCsXDFc_0 2024-09-12T18:59:59.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13879081314203965601', time=2024-09-12T20:29:09.534669+0000, chain.objs.size()=1 2024-09-12T18:59:59.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.08neQppXb-h9KPZ1OGCVIZIID19nQ5a_0 2024-09-12T18:59:59.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6527094861866697718', time=2024-09-12T20:29:09.880916+0000, chain.objs.size()=1 2024-09-12T18:59:59.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.mi_GBeQCNU3bVus47IYrA-taJaAInQa_0 2024-09-12T18:59:59.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.599699405809077152', time=2024-09-12T20:29:09.883084+0000, chain.objs.size()=1 2024-09-12T18:59:59.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NwbXjlBZ2-o08PeL3SwOD2zdVG0_nSL_0 2024-09-12T18:59:59.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13479317391767096374', time=2024-09-12T20:29:09.885103+0000, chain.objs.size()=1 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.hZgaSc-ddPb8G6l0BqU6pvGZeQP4k1d_0 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7240888776300177300', time=2024-09-12T20:29:09.976758+0000, chain.objs.size()=1 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.RYa-wvxss2QJFX05DHUXDpIqU-1P4Fu_0 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9922768472590469838', time=2024-09-12T20:29:10.143622+0000, chain.objs.size()=1 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.l_YpWRody_V4cHa8FRq2m2YRfQHbI5m_0 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17467812593566199225', time=2024-09-12T20:29:11.453837+0000, chain.objs.size()=1 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.RVwO15Vwrj7Q3esYsaNsaURqDpfHfnd_0 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17530651257165418511', time=2024-09-12T20:29:11.488177+0000, chain.objs.size()=1 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.TNhNmx_tWIdBd8pp-303HNomZoQmvG0_0 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4567709035993116607', time=2024-09-12T20:29:12.095511+0000, chain.objs.size()=1 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.UG1hXQRF_9hpcxkli7QGayVtPfE2eEH_0 2024-09-12T18:59:59.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5555705353921972581', time=2024-09-12T20:29:12.139198+0000, chain.objs.size()=1 2024-09-12T18:59:59.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JyeHDuneYtgQY0dXfXwYUjQk0lCwFR0_0 2024-09-12T18:59:59.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4745123705735874037', time=2024-09-12T20:29:13.656696+0000, chain.objs.size()=1 2024-09-12T18:59:59.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.W6xlq-PXNUjn6eg9G_eGEOr_9xtbDA6_0 2024-09-12T18:59:59.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6407972492036384288', time=2024-09-12T20:29:14.269665+0000, chain.objs.size()=1 2024-09-12T18:59:59.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.443+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.qIJrIcf7Emmlc-CuQHiEVwSxHDBrUpG_0 2024-09-12T18:59:59.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12894271300679939630', time=2024-09-12T20:29:34.927275+0000, chain.objs.size()=1 2024-09-12T18:59:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.277__shadow_.0zRkId-8CcTetKHz0KFW1y7o8pCgMoE_0 2024-09-12T18:59:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13183066193094355239', time=2024-09-12T20:29:53.284349+0000, chain.objs.size()=1 2024-09-12T18:59:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.290__shadow_.oF84lBAQ0w5TxTEPpS8A-x8V7KL68fy_0 2024-09-12T18:59:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3231325476208131180', time=2024-09-12T20:29:59.298157+0000, chain.objs.size()=1 2024-09-12T18:59:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.XOeWpjL7O2lEiHwCdISPiz4J1u8MfTw_0 2024-09-12T18:59:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12172795278905486578', time=2024-09-12T20:29:59.301107+0000, chain.objs.size()=1 2024-09-12T18:59:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.Q5buj1_xHppjlA6Hjet1w0Qpnp-6c-I_0 2024-09-12T18:59:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.390251805404767346', time=2024-09-12T20:30:05.320493+0000, chain.objs.size()=1 2024-09-12T18:59:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.294__shadow_.XJHfN4WP1sP3qvedGn_RUc1fdFwaz9a_0 2024-09-12T18:59:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6087531577674515147', time=2024-09-12T20:30:06.689276+0000, chain.objs.size()=1 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.295__shadow_.QflmIVWjXtHSBveqqPKopUJj47JmW_u_0 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10224453712852319652', time=2024-09-12T20:32:27.889239+0000, chain.objs.size()=1 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.aXZlf-S1Nm9uqrPvUXmChVU7M5Sshxa_0 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3266391590197230560', time=2024-09-12T20:32:28.133512+0000, chain.objs.size()=1 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.er-cta_t0KMqguKvvCGAyOZlNXIRpPH_0 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16246841742608765248', time=2024-09-12T20:32:29.038362+0000, chain.objs.size()=1 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.q8nT9dgiUHQELDVKwcyMioUl5ZJigeo_0 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11472675919354897729', time=2024-09-12T20:32:31.463330+0000, chain.objs.size()=1 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.WT-yKoGNfXMhN-kdfzBaBuBMWOTV0eu_0 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9446662435917617433', time=2024-09-12T20:32:32.279972+0000, chain.objs.size()=1 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ApzoU8Gj9SFUXHujnFyYlbyGkij7YFe_0 2024-09-12T18:59:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8822771381669004574', time=2024-09-12T20:32:32.283668+0000, chain.objs.size()=1 2024-09-12T18:59:59.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.5r1SWEjVg1YbJZ5Opv5dxzWco3jMCjx_0 2024-09-12T18:59:59.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8657661777852686665', time=2024-09-12T20:32:33.234409+0000, chain.objs.size()=1 2024-09-12T18:59:59.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.WJrcQl8fX1TCFp6JGSEhvr3KvDKKuUL_0 2024-09-12T18:59:59.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6141777009620532135', time=2024-09-12T20:32:34.295275+0000, chain.objs.size()=1 2024-09-12T18:59:59.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.CN8Qwkrxu0ZJMZJmzZ54K0zrwTFdon7_0 2024-09-12T18:59:59.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15920389980921080734', time=2024-09-12T20:32:34.568137+0000, chain.objs.size()=1 2024-09-12T18:59:59.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.9GpkWxhgy7ZXBMPKZPTvt9v_YVMTn-7_0 2024-09-12T18:59:59.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.873569730571853470', time=2024-09-12T20:32:35.055644+0000, chain.objs.size()=1 2024-09-12T18:59:59.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.VZAQxIkuZCyqmFlb6lvVZBARgQyhP4M_0 2024-09-12T18:59:59.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11058731473748390540', time=2024-09-12T20:32:35.414624+0000, chain.objs.size()=1 2024-09-12T18:59:59.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.qFuNVhpJJ5SF_e_wc1MOVxMl2DqdQ3K_0 2024-09-12T18:59:59.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3806071736359472961', time=2024-09-12T20:32:35.971223+0000, chain.objs.size()=1 2024-09-12T18:59:59.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7jJwPx74Y_ss5GMWgdkhAKUOlyxoFsG_0 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4051652120670455830', time=2024-09-12T20:32:36.269882+0000, chain.objs.size()=1 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.447+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.62rHpQV9EoDi12Nn31-bsukcOX0UhYo_0 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7110278593315885254', time=2024-09-12T20:32:36.298468+0000, chain.objs.size()=1 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.KCa0qCKBS4aeHOKkcknmlNzn90VQ5rO_0 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16205869149815883101', time=2024-09-12T20:32:36.388077+0000, chain.objs.size()=1 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ycyKGLNBDWng9ffXaSc5XpeRPqbKMl8_0 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7233104422167652400', time=2024-09-12T20:32:36.664552+0000, chain.objs.size()=1 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.UVaxfkp6L18Mt_hCZWxRvdKDCFk0kF2_0 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10519271276730044852', time=2024-09-12T20:32:38.798004+0000, chain.objs.size()=1 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sBDeBtAWfZT0g9mbAPHIxn4xJgKAA2l_0 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11385021174314372603', time=2024-09-12T20:32:39.159803+0000, chain.objs.size()=1 2024-09-12T18:59:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.lDlBPY9e58bie7iOO32efMWPjX-tiY7_0 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6978178556122234992', time=2024-09-12T20:32:41.290469+0000, chain.objs.size()=1 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Gdt1fjfPqfcDUo2zMZrzBL2QfUpvXSJ_0 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17959461660841201715', time=2024-09-12T20:32:42.446971+0000, chain.objs.size()=1 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.GfBd9XgfsMqofuSvkYKiB9sMH0eBwU-_0 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8733462142149374728', time=2024-09-12T20:32:42.627104+0000, chain.objs.size()=1 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3hUHekV3bwk4OdKAkW1W7yjG1kV1bcb_0 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15030728520496316155', time=2024-09-12T20:32:43.642667+0000, chain.objs.size()=1 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0fMiPCWQ66j3OdYndOGkUtYEufZD_-X_0 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14579849450821459792', time=2024-09-12T20:32:43.928132+0000, chain.objs.size()=1 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zno4YZwszvbHb2fhJqq_XOUq9Q3Mz5y_0 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11199489526241425557', time=2024-09-12T20:32:45.440973+0000, chain.objs.size()=1 2024-09-12T18:59:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zVQp42LA7R3Hnj80MAYaW9QP3b5xROQ_0 2024-09-12T18:59:59.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7796028855534557757', time=2024-09-12T20:32:45.871242+0000, chain.objs.size()=1 2024-09-12T18:59:59.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7uyWvMf1X9w-UHn1sKHGMWP2A1cO0rd_0 2024-09-12T18:59:59.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7701170219291485884', time=2024-09-12T20:32:45.873470+0000, chain.objs.size()=1 2024-09-12T18:59:59.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rCJGXqF8s2cflinfpTNY2o7arv6anQY_0 2024-09-12T18:59:59.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14366652467098508865', time=2024-09-12T20:32:47.317974+0000, chain.objs.size()=1 2024-09-12T18:59:59.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.NiCx5ox_BSQtQGPTGo5rY3t02PhN0Vd_0 2024-09-12T18:59:59.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14025341797585535535', time=2024-09-12T20:32:49.126489+0000, chain.objs.size()=1 2024-09-12T18:59:59.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IleTVWSvZwyentHx6SaK6F-41iC90cp_0 2024-09-12T18:59:59.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14764104643952563685', time=2024-09-12T20:32:49.787674+0000, chain.objs.size()=1 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wXZxNh0CMddaxFBYxlcCvpnZVjcCq6L_0 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3803113019757684604', time=2024-09-12T20:32:50.368337+0000, chain.objs.size()=1 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8DvdpPKqb0EZIKxZQRqDjB2nEPI9zru_0 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7181058092963154997', time=2024-09-12T20:32:52.968529+0000, chain.objs.size()=1 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.toWSiDu1oBWl3CUCtqTEUpWx68OQ-N6_0 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15281638564989372379', time=2024-09-12T20:32:53.036364+0000, chain.objs.size()=1 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.451+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3Hnzj-HYBfBCW5NSbUso4keRAhaXIgh_0 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4065279329610859272', time=2024-09-12T20:32:53.038126+0000, chain.objs.size()=1 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.GcX2Dug3gQco4AoCigfbT7nT_0bS00z_0 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15925924338698867208', time=2024-09-12T20:32:53.230162+0000, chain.objs.size()=1 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Y8y7hsYQ3R0J_4BeECdM-mmeMVBXbgK_0 2024-09-12T18:59:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12784863361751904757', time=2024-09-12T20:32:53.572255+0000, chain.objs.size()=1 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.JCc_QNZXj64KttqoDVH8XD2KwWQzVl3_0 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10793206623511553910', time=2024-09-12T20:34:35.162074+0000, chain.objs.size()=1 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RqQj0db3uEJ5MK7_9QWp26bmDnltYU-_0 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11689405479045738997', time=2024-09-12T20:34:35.275504+0000, chain.objs.size()=1 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.deyQe7xHJQrDv5khJyHVhZ_4Q8_vFys_0 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9614226684291876468', time=2024-09-12T20:34:35.817701+0000, chain.objs.size()=1 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.gEOMherB8R1_J1bB2tKsk7tt5LUedM7_0 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12992815786440733813', time=2024-09-12T20:34:38.169231+0000, chain.objs.size()=1 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.a7Mz8-1Aqu8SN4jKHxzH0dIgKxM7utn_0 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.550369995392862571', time=2024-09-12T20:34:38.370350+0000, chain.objs.size()=1 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.cSrz-PdBO5stX2_4DmzU82kgBsnjOzZ_0 2024-09-12T18:59:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8663557272191652337', time=2024-09-12T20:34:38.429421+0000, chain.objs.size()=1 2024-09-12T18:59:59.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.DdHYQB0DLmw53NYtANNyr-JVlhJS3af_0 2024-09-12T18:59:59.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14178386995113712981', time=2024-09-12T20:34:39.496239+0000, chain.objs.size()=1 2024-09-12T18:59:59.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Y5m-bXZK7uqkzpSzUdoCer4f5_CsRMa_0 2024-09-12T18:59:59.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14738087605095373972', time=2024-09-12T20:34:39.499330+0000, chain.objs.size()=1 2024-09-12T18:59:59.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.0TbEoEBLreApZ8PaY3YU6I7aVar_0w-_0 2024-09-12T18:59:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9230463089793654571', time=2024-09-12T20:34:40.604768+0000, chain.objs.size()=1 2024-09-12T18:59:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HsCN6S5KXu-cJwuwvzeHZddwp3cIpzo_0 2024-09-12T18:59:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1862740793526063998', time=2024-09-12T20:34:41.923250+0000, chain.objs.size()=1 2024-09-12T18:59:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.455+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.jy8VQxUBB69Q0vz1uRE90oQAX3nd7Du_0 2024-09-12T18:59:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11993880412591206091', time=2024-09-12T20:34:42.786516+0000, chain.objs.size()=1 2024-09-12T18:59:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YgrnImvhNd4A6K0qlY3ETFOvhBz5U_d_0 2024-09-12T18:59:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15662544590157142219', time=2024-09-12T20:34:43.144042+0000, chain.objs.size()=1 2024-09-12T18:59:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BY9cdJ0med7eI7icgAB4ioKRBF7AXhx_0 2024-09-12T18:59:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7735773257020368997', time=2024-09-12T20:34:43.146913+0000, chain.objs.size()=1 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.GwViwOgMBelBdETM4K2ujLTZudjP8bv_0 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2157899348263252415', time=2024-09-12T20:34:43.402405+0000, chain.objs.size()=1 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XSfvifesfMZL3EAjrjOX9mU3UmH7lA4_0 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17867676183646575828', time=2024-09-12T20:34:45.067613+0000, chain.objs.size()=1 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.FT1rHWem6s4uBdbbqyFq84igaLa5-Ua_0 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2792074290404300358', time=2024-09-12T20:34:45.070856+0000, chain.objs.size()=1 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.AhMGvaejY0qckjcehtO7_piYU9js5o5_0 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2142629694468786036', time=2024-09-12T20:34:46.423723+0000, chain.objs.size()=1 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wcfpPPZcKr5940iVhayZkW1ckDzUil6_0 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7347439152340261475', time=2024-09-12T20:34:46.481077+0000, chain.objs.size()=1 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.rqwJMWlxaP6gQ35LkzzcgcUvKj6p5Kr_0 2024-09-12T18:59:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15409055023954786113', time=2024-09-12T20:34:47.193780+0000, chain.objs.size()=1 2024-09-12T18:59:59.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3q_PohOAh46ieayFgb7xy1NLip2DlMd_0 2024-09-12T18:59:59.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.459+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44798 2024-09-12T18:59:59.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=46, truncated=0, next_marker='' 2024-09-12T18:59:59.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7657367021183822742', time=2024-09-12T20:34:47.257874+0000, chain.objs.size()=1 2024-09-12T18:59:59.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YkbHwR-M6cl7VpVXDjl9t4bpqFtj8zL_0 2024-09-12T18:59:59.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13541892602158225267', time=2024-09-12T20:34:47.848938+0000, chain.objs.size()=1 2024-09-12T18:59:59.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5TLdjB-xfPH2j-FkfDdXDRie01zz2iF_0 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9469736797853902246', time=2024-09-12T20:34:48.788968+0000, chain.objs.size()=1 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QG_nvhP-fAesFa71HCNAJ5yIYc33IVC_0 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14896681432689331724', time=2024-09-12T20:34:49.598554+0000, chain.objs.size()=1 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PDo1DiGPiEKUg1dON4d0B9_Lh9dd0j7_0 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5165972814126791053', time=2024-09-12T20:34:49.981992+0000, chain.objs.size()=1 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-F2z2nqSPHNpv2FlsoC47-gC9mKVx-I_0 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.550865593399939070', time=2024-09-12T20:34:50.660721+0000, chain.objs.size()=1 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.l_gS_zcfP13TJa2KtMxD7C_By-h85Lx_0 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10916505381355598881', time=2024-09-12T20:34:51.464567+0000, chain.objs.size()=1 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wTDsOEFSWgrYwpIEBaMedO02dKUzU6L_0 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5354334109729300250', time=2024-09-12T20:34:52.657039+0000, chain.objs.size()=1 2024-09-12T18:59:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.OfRZfAKBe4_YpZ57IZRDLMD_PulzrTQ_0 2024-09-12T18:59:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3890415136633791706', time=2024-09-12T20:34:52.676071+0000, chain.objs.size()=1 2024-09-12T18:59:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.AkkVVhW1uPxXV7-r_miqZbrdCyEAB5y_0 2024-09-12T18:59:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8661622419380891208', time=2024-09-12T20:34:53.317470+0000, chain.objs.size()=1 2024-09-12T18:59:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.lqCLO4Mg3v82eujK6Cddy3pZ6U6x02Z_0 2024-09-12T18:59:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8113983149056723796', time=2024-09-12T20:34:53.494770+0000, chain.objs.size()=1 2024-09-12T18:59:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qyHS475ozoRJKWdY0SJT9qDPRqIQJNM_0 2024-09-12T18:59:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12367569315806121445', time=2024-09-12T20:34:53.617707+0000, chain.objs.size()=1 2024-09-12T18:59:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RMs9VGs9TrbSurJ2HQboCm3mjPx3z4Z_0 2024-09-12T18:59:59.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15303517913791010417', time=2024-09-12T20:34:53.755965+0000, chain.objs.size()=1 2024-09-12T18:59:59.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1MJ21yOjEQDn6zWT8YlY-TJ_5Hle1Op_0 2024-09-12T18:59:59.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3199593384590021861', time=2024-09-12T20:34:53.892437+0000, chain.objs.size()=1 2024-09-12T18:59:59.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9VIsmXsfVJtY-QprGGvYbb6hp96oGP-_0 2024-09-12T18:59:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7449701848303104225', time=2024-09-12T20:34:55.866518+0000, chain.objs.size()=1 2024-09-12T18:59:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qRgJsTdggiOhmm4B-4mmXyUvvDl87df_0 2024-09-12T18:59:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17770774267294870856', time=2024-09-12T20:34:56.304278+0000, chain.objs.size()=1 2024-09-12T18:59:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.cAIairr08d6rwUu9V734O-4cgUaB-bh_0 2024-09-12T18:59:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2347429549837418072', time=2024-09-12T20:34:57.569639+0000, chain.objs.size()=1 2024-09-12T18:59:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ADqCet-K3pi-OF5KGfBTdl-CZzM098b_0 2024-09-12T18:59:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13665051295727724672', time=2024-09-12T20:34:58.154619+0000, chain.objs.size()=1 2024-09-12T18:59:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.cC4GdH1wsOnjKPRXVj6U5hfzs5yIo_U_0 2024-09-12T18:59:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5710191008854088337', time=2024-09-12T20:34:59.796900+0000, chain.objs.size()=1 2024-09-12T18:59:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.pCrUhFlUzazRdMVVLWTp7GMEgcCVg7H_0 2024-09-12T18:59:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13199186963595909073', time=2024-09-12T20:34:59.798632+0000, chain.objs.size()=1 2024-09-12T18:59:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.pS2MYiGZ9mcPadH3rYYhuqvHSTFbY7m_0 2024-09-12T18:59:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17540762982094037039', time=2024-09-12T20:35:00.499151+0000, chain.objs.size()=1 2024-09-12T18:59:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.463+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-9EWPaT4r4PAF3Ou32Tvg3asDeM3mUU_0 2024-09-12T18:59:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10674575352674851138', time=2024-09-12T20:35:00.607183+0000, chain.objs.size()=1 2024-09-12T18:59:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.b-UfYN7INgs9K5Ohd0sj_wDOj0qprZZ_0 2024-09-12T18:59:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2458417467126322212', time=2024-09-12T20:35:00.608639+0000, chain.objs.size()=1 2024-09-12T18:59:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6GtfHjVrdmzwqY9MiJr4dDuvqqa0oeB_0 2024-09-12T18:59:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14314069421695761372', time=2024-09-12T20:35:00.828836+0000, chain.objs.size()=1 2024-09-12T18:59:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tBRQCpHuP7XlJ5q-k5XBFtgeTOUoO4g_0 2024-09-12T18:59:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17853222225686725122', time=2024-09-12T20:35:01.082390+0000, chain.objs.size()=1 2024-09-12T18:59:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ZP4LbZp_Pyu5o6Rj0AkHhJNNlCIcBP6_0 2024-09-12T18:59:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1646688834653208238', time=2024-09-12T20:35:01.287535+0000, chain.objs.size()=1 2024-09-12T18:59:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.uD3MmiuM59GQz0ynvPvCLBi8S2PCAwi_0 2024-09-12T18:59:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12023348488971602994', time=2024-09-12T20:35:13.648849+0000, chain.objs.size()=1 2024-09-12T18:59:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.335__shadow_._VKbRqn-TKYHQijpqoCenm0jnfGye8__0 2024-09-12T18:59:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4239833412784994567', time=2024-09-12T20:35:14.787486+0000, chain.objs.size()=1 2024-09-12T18:59:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.336__shadow_.1iT6xb2s2j6w-6ckCbb-QmozI7qiyQ9_0 2024-09-12T18:59:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10246558839114083845', time=2024-09-12T20:37:28.531476+0000, chain.objs.size()=1 2024-09-12T18:59:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.459__shadow_.-ekXYPyqnm4uMHXQDKviTqvfVwAgLvD_0 2024-09-12T18:59:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17791455673771227421', time=2024-09-12T20:37:41.437705+0000, chain.objs.size()=1 2024-09-12T18:59:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.466__shadow_.x0XL9MoNekL9fV3f4HXz0Y-P4YPevrR_0 2024-09-12T18:59:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14309503026124743695', time=2024-09-12T20:37:58.470427+0000, chain.objs.size()=1 2024-09-12T18:59:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.484__shadow_.3wG9LyjfQa-c0lEkN_7Tg1bSUl29Ac6_0 2024-09-12T18:59:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17311627144780423167', time=2024-09-12T20:39:36.859496+0000, chain.objs.size()=3 2024-09-12T18:59:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__multipart_mymultipart.2~CCoJUTbc9smNBTbYrx54szSQY-7sLOw.1 2024-09-12T18:59:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__multipart_mymultipart.2~CCoJUTbc9smNBTbYrx54szSQY-7sLOw.2 2024-09-12T18:59:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.521__multipart_mymultipart.2~CCoJUTbc9smNBTbYrx54szSQY-7sLOw.3 2024-09-12T18:59:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UQHAw4gip0StPuDXjFsHhAabobMRqm4', time=2024-09-12T20:41:51.452805+0000, chain.objs.size()=3 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.467+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.531__multipart_mymultipart.2~UQHAw4gip0StPuDXjFsHhAabobMRqm4.1 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.531__shadow_mymultipart.2~UQHAw4gip0StPuDXjFsHhAabobMRqm4.1_1 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.531__multipart_mymultipart.2~UQHAw4gip0StPuDXjFsHhAabobMRqm4.2 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16560954112722786296', time=2024-09-12T20:42:20.417774+0000, chain.objs.size()=1 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.536__multipart_mymultipart.2~KUVS-r1nyMXFfoDEvO5pPKYsuLPUu74.1 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4360672986255157576', time=2024-09-12T20:43:16.567095+0000, chain.objs.size()=1 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.558__shadow_.GKcTNYtsMwNL5fJm4nWEmBArAjD2rUQ_0 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3935258032053322045', time=2024-09-12T20:43:20.562225+0000, chain.objs.size()=1 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.560__shadow_.3VWwH44uUrafAl4RRUAcHKJYXjOIR8F_0 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9221979039210966439', time=2024-09-12T20:45:51.344989+0000, chain.objs.size()=1 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.587__shadow:sqP5KmbX6FhhW4xqx.26ZsBSyycC-Vb_.JhB_KS-IOqaYZeVuivtOBDfruw6wHhO_0 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11729142314177879600', time=2024-09-12T20:47:44.198806+0000, chain.objs.size()=12 2024-09-12T18:59:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__multipart_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.1 2024-09-12T18:59:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__shadow_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.1_1 2024-09-12T18:59:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__multipart_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.2 2024-09-12T18:59:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__shadow_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.2_1 2024-09-12T18:59:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__multipart_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.3 2024-09-12T18:59:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__shadow_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.3_1 2024-09-12T18:59:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__multipart_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.4 2024-09-12T18:59:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__shadow_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.4_1 2024-09-12T18:59:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__multipart_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.5 2024-09-12T18:59:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__shadow_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.5_1 2024-09-12T18:59:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__multipart_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.6 2024-09-12T18:59:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.615__shadow_multipart_enc.2~a1C58w37caR3RdD43sdnF2Kyu16PU1h.6_1 2024-09-12T18:59:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7303195527659676663', time=2024-09-12T20:50:51.581891+0000, chain.objs.size()=1 2024-09-12T18:59:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.471+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.636__shadow_.dbPor6BqvPcPNJE3Qwv002QL7Ywr0nq_0 2024-09-12T18:59:59.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16363471867295705975', time=2024-09-12T20:50:59.446586+0000, chain.objs.size()=1 2024-09-12T18:59:59.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.642__shadow_.m1XE-Juxu-SNutja9oTG7nvO0DHl8im_0 2024-09-12T18:59:59.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8599211769801992058', time=2024-09-12T20:52:03.658562+0000, chain.objs.size()=1 2024-09-12T18:59:59.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.668__shadow_.pD5Uko6AmsvMIvTulaIPw1uWQYGiKm6_0 2024-09-12T18:59:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.241191035119828677', time=2024-09-12T20:52:04.024744+0000, chain.objs.size()=1 2024-09-12T18:59:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.668__shadow_.rbP5OINoNx35oRLpU4AtKoKxOd9YJv__0 2024-09-12T18:59:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13330941349854129914', time=2024-09-12T20:52:27.942705+0000, chain.objs.size()=1 2024-09-12T18:59:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.693__shadow:CGkjDnHS92QZt4Ui42Xnyo9fzwZsXSn_.rrgeKu1utuTN1wQnToEbrsHvCR5HvD2_0 2024-09-12T18:59:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7324260441209448133', time=2024-09-12T20:52:35.701282+0000, chain.objs.size()=1 2024-09-12T18:59:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.699__shadow:u4HdqY6h62IAAgQO0-G-yg7FzM4gN6A_.DJPYXYtJeowwuiekU_cKLKufaqU2C1V_0 2024-09-12T18:59:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4179668230482395272', time=2024-09-12T20:52:55.498053+0000, chain.objs.size()=1 2024-09-12T18:59:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.714__shadow:.Hj-rRPHFjl.LWMq8Cns-YPcjY..NIM_.OedsusWNU--frpNkfHYaAj8cBRZlwXa_0 2024-09-12T18:59:59.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9034437715116474838', time=2024-09-12T20:53:18.180691+0000, chain.objs.size()=1 2024-09-12T18:59:59.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.475+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.717__shadow:7ThVYv.e1fXT2FRgHGmM3i7p497IFa3_.3J6EbzOnFBfXso9Ll9_rnohyh79xauF_0 2024-09-12T18:59:59.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.479+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.479+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:59:59.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45607' 2024-09-12T18:59:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12811500933750041956', time=2024-09-12T20:22:16.444892+0000, chain.objs.size()=1 2024-09-12T18:59:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.158__shadow_.AhVRIo_qJNKK1icA_MSWrpGE9uOieAq_0 2024-09-12T18:59:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_CWM5ZXTTZSIFirdqoHLvo8E99Zk8pv8', time=2024-09-12T20:22:32.268448+0000, chain.objs.size()=1 2024-09-12T18:59:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.pdslWRMKkQ2y7dtzxytsdRbwAsxazWp_0 2024-09-12T18:59:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_9gJ0Mr_amU42FHp36p6oRU0Ne-7q0hO', time=2024-09-12T20:22:49.254340+0000, chain.objs.size()=1 2024-09-12T18:59:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.163__shadow_.eVHOhnkKgBMSPusEoXlFQYtCl64Qs2m_0 2024-09-12T18:59:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2482490382413312001', time=2024-09-12T20:26:34.420631+0000, chain.objs.size()=1 2024-09-12T18:59:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.237__shadow_.wg0n8xRc-EzoEptTAbur9W817ZSFwwg_0 2024-09-12T18:59:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16031600162359403533', time=2024-09-12T20:27:08.944886+0000, chain.objs.size()=1 2024-09-12T18:59:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.261__shadow_.exYOoKEPa_9V63PR6BuAjUcLLmTW2Ev_0 2024-09-12T18:59:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8881645858216754608', time=2024-09-12T20:28:48.138599+0000, chain.objs.size()=1 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.zCrbJb9XA8V_2lMgm96p5g7UOYDQNeS_0 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3043350279712083659', time=2024-09-12T20:28:48.653668+0000, chain.objs.size()=1 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.EuL_r2U6Hg-dxaoifeJtKqG6_Ly2Bse_0 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8258486120214958147', time=2024-09-12T20:28:49.004928+0000, chain.objs.size()=1 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.G3envsYA8yaE4CGSBJSIeyvhKl3c61O_0 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7137192374674820472', time=2024-09-12T20:28:50.400491+0000, chain.objs.size()=1 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.LOOwzxtirIt9T-CjEIhkf5ckHjE3RVN_0 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9727391318777578121', time=2024-09-12T20:28:51.611314+0000, chain.objs.size()=1 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.mV1cA2Vaahh9nf_BNeYcU-_JShqOxEE_0 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17547959885330109724', time=2024-09-12T20:28:51.612767+0000, chain.objs.size()=1 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8EvZbEGy8aDur5ww6TnAbWhxYynh4zY_0 2024-09-12T18:59:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.312533955133481565', time=2024-09-12T20:28:52.004281+0000, chain.objs.size()=1 2024-09-12T18:59:59.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.KbDfdCCT_AXfTBbMG8jQz_L_udSmjaY_0 2024-09-12T18:59:59.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15472590222883468202', time=2024-09-12T20:28:52.417605+0000, chain.objs.size()=1 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.GP_Ga0FILzGbhQEdSq-Wg2rKIzTsPWI_0 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14761256444166588067', time=2024-09-12T20:28:52.877038+0000, chain.objs.size()=1 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.mlonzXVw6nGCAAhrAehODqgbKcrVm63_0 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11056603352339360770', time=2024-09-12T20:28:53.548207+0000, chain.objs.size()=1 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rau-9st1efuJNXv6B5gOr_UiRstFGO-_0 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12479172135489785305', time=2024-09-12T20:28:55.402589+0000, chain.objs.size()=1 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Nxbp5Ju3aWcXwvYeQZc5BDdWPePE61C_0 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5964455191354894679', time=2024-09-12T20:28:55.764667+0000, chain.objs.size()=1 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.M6fRegzK8fEnDZxQdl1e7xjsp-ihUfb_0 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10718065316366422894', time=2024-09-12T20:28:56.748153+0000, chain.objs.size()=1 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.lkIDe2bECJzqTIe0y_zzc86m4Slauin_0 2024-09-12T18:59:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13821672195327889605', time=2024-09-12T20:28:57.407987+0000, chain.objs.size()=1 2024-09-12T18:59:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.sMOcLLjHd_EoRYo9XXhNWuZaxtlZzP5_0 2024-09-12T18:59:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3242573443626499232', time=2024-09-12T20:28:59.080662+0000, chain.objs.size()=1 2024-09-12T18:59:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.483+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Ck_9KeJCvkesqMYtHnzQgl1BUQKCB9C_0 2024-09-12T18:59:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16586097756703189132', time=2024-09-12T20:29:00.157717+0000, chain.objs.size()=1 2024-09-12T18:59:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.X5M9G7RbsKxDMTsJn8rtDSbnJgpJ5r7_0 2024-09-12T18:59:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16617930587567565487', time=2024-09-12T20:29:00.402523+0000, chain.objs.size()=1 2024-09-12T18:59:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.4EgyeV-przBSiY8u0DETmikyZU_uIac_0 2024-09-12T18:59:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14994542427038397820', time=2024-09-12T20:29:00.551924+0000, chain.objs.size()=1 2024-09-12T18:59:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HMfAjyvfuzn9gB20QM3RNFSvPHwlbg4_0 2024-09-12T18:59:59.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11420998077605663755', time=2024-09-12T20:29:01.285837+0000, chain.objs.size()=1 2024-09-12T18:59:59.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3C3NeyJ00tw0xGbifS3MGsjveRhW1Gy_0 2024-09-12T18:59:59.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4950920357799823689', time=2024-09-12T20:29:02.631677+0000, chain.objs.size()=1 2024-09-12T18:59:59.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vmEcB__n7ZkiswSxz13CSOcQFaeLTg7_0 2024-09-12T18:59:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2838991939699119770', time=2024-09-12T20:29:02.642568+0000, chain.objs.size()=1 2024-09-12T18:59:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vMV1pYvKg7FMFbKVaohShwu0WirT8z8_0 2024-09-12T18:59:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5504882511560645086', time=2024-09-12T20:29:02.703028+0000, chain.objs.size()=1 2024-09-12T18:59:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.QkOysIlYSYU3gniW8f5C3BUpy96-OhL_0 2024-09-12T18:59:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11447040242218170374', time=2024-09-12T20:29:03.194188+0000, chain.objs.size()=1 2024-09-12T18:59:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.qNl-MSKusaz-BYDB4fske3kCuMCKi-P_0 2024-09-12T18:59:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15560574297855979949', time=2024-09-12T20:29:03.988870+0000, chain.objs.size()=1 2024-09-12T18:59:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.hSKIXZQzYKhQyCPfMcu1nzeTYx-jeuI_0 2024-09-12T18:59:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11194462695835748803', time=2024-09-12T20:29:04.354793+0000, chain.objs.size()=1 2024-09-12T18:59:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vPqKlyTVBeQ_rlIYF7ne-j23DKV7jAu_0 2024-09-12T18:59:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17107382057498849139', time=2024-09-12T20:29:04.541914+0000, chain.objs.size()=1 2024-09-12T18:59:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JOrackWzwXEbJgVJ4q5IqW_pKBtfp6o_0 2024-09-12T18:59:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8000797439001576401', time=2024-09-12T20:29:04.552288+0000, chain.objs.size()=1 2024-09-12T18:59:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.PhCCDAkhy4EJKsKUHr8b7iK0QmGGmix_0 2024-09-12T18:59:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4045291578665858037', time=2024-09-12T20:29:04.736138+0000, chain.objs.size()=1 2024-09-12T18:59:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.s2g_O5rNFt9zupaYfcxuap6voUgkflK_0 2024-09-12T18:59:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2186681701978950564', time=2024-09-12T20:29:06.871151+0000, chain.objs.size()=1 2024-09-12T18:59:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.487+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.n5MF6tHsSGaeJcSyhmMmQXdsbPxUD06_0 2024-09-12T18:59:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17387850293933811505', time=2024-09-12T20:29:08.699924+0000, chain.objs.size()=1 2024-09-12T18:59:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.i2E9a5__QDBtdwKoaNleilgHY_bVeUS_0 2024-09-12T18:59:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12330477436722083634', time=2024-09-12T20:29:11.374342+0000, chain.objs.size()=1 2024-09-12T18:59:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FSp-RH7_gM_D5hJfrelmoXo3wENDHPf_0 2024-09-12T18:59:59.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2010751979407049858', time=2024-09-12T20:29:11.376425+0000, chain.objs.size()=1 2024-09-12T18:59:59.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ncaA1lkwHlh9jqANH7xNoQFzf7pfFKD_0 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10447944770062354243', time=2024-09-12T20:29:14.067974+0000, chain.objs.size()=1 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.iBJbAxYtEQaZWzUowpbBNJdHPkpbGXU_0 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12838023848551493032', time=2024-09-12T20:29:25.677532+0000, chain.objs.size()=1 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.270__shadow_.A-gB80wQ7GD3hh4DJKCOhZpwQbjq54e_0 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9646711169873731573', time=2024-09-12T20:29:26.954534+0000, chain.objs.size()=1 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.271__shadow_.PGMuPdCbgWouwxiipuHPZFtmEZLWc7z_0 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13963551457807519953', time=2024-09-12T20:29:37.699144+0000, chain.objs.size()=1 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.279__shadow_.hPiJRct937qdZDlDxHXFVelRzSFMGKZ_0 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11674086516493371285', time=2024-09-12T20:29:39.153958+0000, chain.objs.size()=1 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.280__shadow_.DMiP0uav0EIpbbRBbFz8NRPm0qzGU_1_0 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10629992461577683674', time=2024-09-12T20:29:59.288871+0000, chain.objs.size()=1 2024-09-12T18:59:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.0wF-3Z_3H4UCZyJbsDunck_bJRI9Xhf_0 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14393461817657898340', time=2024-09-12T20:30:03.561283+0000, chain.objs.size()=1 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.rCXoLnblbF0S8_KTabGkhC8J0TqStHe_0 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2739496811322727041', time=2024-09-12T20:30:03.905698+0000, chain.objs.size()=1 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.RZJn3P2xsP7mopmVTXZWzBSxbw5doz2_0 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3457615115206191630', time=2024-09-12T20:30:16.650296+0000, chain.objs.size()=1 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.302__shadow_.Pf8cRjRiwhvAVqu9mPCSgoZKhmBJ8v9_0 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7671151429304903043', time=2024-09-12T20:30:22.628572+0000, chain.objs.size()=1 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.306__shadow_.rU0MkHCf8dgAR8Rmr9FjG87Xxgfk97l_0 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7595616171791637377', time=2024-09-12T20:30:41.284578+0000, chain.objs.size()=1 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.319__shadow:KBVPeB6lduHgdpPJg71qggKcjZcz2tV_.M847LLDBgQd_TbIkRbk-h7aHQ1E9gXf_0 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4389160986378747115', time=2024-09-12T20:32:26.914318+0000, chain.objs.size()=1 2024-09-12T18:59:59.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ehKxWleQVVHlEqfIyrvDH8mRE2z2s8C_0 2024-09-12T18:59:59.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4856961996696708894', time=2024-09-12T20:32:28.193110+0000, chain.objs.size()=1 2024-09-12T18:59:59.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.MpmXjvpBujUrtf3VSsff86DDcS3UbZb_0 2024-09-12T18:59:59.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9965542485400966412', time=2024-09-12T20:32:28.195393+0000, chain.objs.size()=1 2024-09-12T18:59:59.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.491+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rqI20EDCdZRZQlIEaPbYBLHploc5lbO_0 2024-09-12T18:59:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6217459587812374054', time=2024-09-12T20:32:30.621062+0000, chain.objs.size()=1 2024-09-12T18:59:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3PPtj_T1pE8Mme4QODuDir3VcFm5xfH_0 2024-09-12T18:59:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6045472923034968727', time=2024-09-12T20:32:31.403277+0000, chain.objs.size()=1 2024-09-12T18:59:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.osiENRyJMKfzbxDXG0WIjgEU-cb_5gb_0 2024-09-12T18:59:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7173016431768836190', time=2024-09-12T20:32:33.330538+0000, chain.objs.size()=1 2024-09-12T18:59:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Sk77TVDZoaY8Do-qom8PMWJlMqxb8Zm_0 2024-09-12T18:59:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10313457644380013329', time=2024-09-12T20:32:34.296646+0000, chain.objs.size()=1 2024-09-12T18:59:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.YuwbGdBT3QOrNUm-SIiGvqM8zVVlBL1_0 2024-09-12T18:59:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16165920040706448001', time=2024-09-12T20:32:34.641856+0000, chain.objs.size()=1 2024-09-12T18:59:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.KIi6RCZ1wO9-6jdIEouFnDfSt_w9cS5_0 2024-09-12T18:59:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1669088675287157145', time=2024-09-12T20:32:36.295065+0000, chain.objs.size()=1 2024-09-12T18:59:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Hj9TI0rTDQI6TD-5wzQXSuMKDSIEeYo_0 2024-09-12T18:59:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5631613028816313860', time=2024-09-12T20:32:36.655662+0000, chain.objs.size()=1 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ajWsm_MX7mk969KYYAjm5wNc7wQ077O_0 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17000519741985463543', time=2024-09-12T20:32:36.662907+0000, chain.objs.size()=1 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gIUxPkm-JCYhUtXfjpp6Mfbm45vzOZ2_0 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4890131322320576570', time=2024-09-12T20:32:38.227072+0000, chain.objs.size()=1 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zYj2j-QlRORof2D6qfeMTXcSxHl9ivq_0 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.802688926885714358', time=2024-09-12T20:32:38.230538+0000, chain.objs.size()=1 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8CE06UJZ5ql1GXh-nwU-Mg3N5VE7_RW_0 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3081647900843031433', time=2024-09-12T20:32:38.926431+0000, chain.objs.size()=1 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3BoOjQ-7D8kkLKg0svJpUInFCYRryTN_0 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2151334587555559328', time=2024-09-12T20:32:39.196950+0000, chain.objs.size()=1 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eQfrU49tENNVy2eTvUsW6cYu1voRw16_0 2024-09-12T18:59:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15867130797148173032', time=2024-09-12T20:32:39.828458+0000, chain.objs.size()=1 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nQTmMkayD42Gnl6PLuk90O-4eEXvmr7_0 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9606823361164744164', time=2024-09-12T20:32:41.390524+0000, chain.objs.size()=1 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.oWBxt0yA4-S2Ugnx45xI_hGoLwtItUC_0 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17224957636440293964', time=2024-09-12T20:32:41.737754+0000, chain.objs.size()=1 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.opqcX_W32V5-h3JY4JP1MQLSo3BXPUJ_0 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10934271351954296851', time=2024-09-12T20:32:43.640032+0000, chain.objs.size()=1 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7WCuRyzebAL2qKgCj6Vc3OYR3wcvCkE_0 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18360808078509454318', time=2024-09-12T20:32:43.937004+0000, chain.objs.size()=1 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6rPU7oKSZZOmEUOLfRE1PL1grzV-yzd_0 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18310308711993878566', time=2024-09-12T20:32:45.145263+0000, chain.objs.size()=1 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.xylBVv1xN6YDIPpzvIpGi0DafnuXM8R_0 2024-09-12T18:59:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13237947749034591687', time=2024-09-12T20:32:46.014811+0000, chain.objs.size()=1 2024-09-12T18:59:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Orqpjj6GJLdqxFNqjZMBGjYPq4kwUQc_0 2024-09-12T18:59:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13279773238812453632', time=2024-09-12T20:32:46.190802+0000, chain.objs.size()=1 2024-09-12T18:59:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hmKAiNQXljW8WBAZkXt6gYnRjG0eDv__0 2024-09-12T18:59:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17882296980916620104', time=2024-09-12T20:32:46.608011+0000, chain.objs.size()=1 2024-09-12T18:59:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.495+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jwGzwtfjj7sLvsv05-VcRDmBMLOXOsc_0 2024-09-12T18:59:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10158474258972871245', time=2024-09-12T20:32:46.610043+0000, chain.objs.size()=1 2024-09-12T18:59:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uA2ME3w-jzIhI47Uv_UKALr42b5w0gc_0 2024-09-12T18:59:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4643317450256830978', time=2024-09-12T20:32:47.317521+0000, chain.objs.size()=1 2024-09-12T18:59:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pwhhtTIfMM9XE8QseL3KpsLvpEFj7D8_0 2024-09-12T18:59:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1393916303819656079', time=2024-09-12T20:32:49.101491+0000, chain.objs.size()=1 2024-09-12T18:59:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jYGmyn7N-GooeX_JUKqjCd1kcT5D7Wj_0 2024-09-12T18:59:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3418884970303955614', time=2024-09-12T20:32:49.648638+0000, chain.objs.size()=1 2024-09-12T18:59:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wbqGY7tkshvGnEuvVN6YL7C0Rcb7CRa_0 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10440599648492515951', time=2024-09-12T20:32:49.741876+0000, chain.objs.size()=1 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.q3zw3rl541MdmYoYmk0thLfiqkceGBA_0 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8059478752178579991', time=2024-09-12T20:32:50.366837+0000, chain.objs.size()=1 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.k7pmYJZQZAGchCQBTjBE5FUt0YrmMqV_0 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15998338998878646506', time=2024-09-12T20:32:50.632416+0000, chain.objs.size()=1 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Mwc1WX6oe_IS2YU35qvPywZE_ZHqDdh_0 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9749484075436749840', time=2024-09-12T20:32:50.733371+0000, chain.objs.size()=1 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._6snmGNdWJ6C0Hd8F4gsoUBIGx48_R5_0 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14194040244029112838', time=2024-09-12T20:32:51.627431+0000, chain.objs.size()=1 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.AFJWCr9rcZRDkoEncvWfL7bJOsmDzqo_0 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9439305541750278989', time=2024-09-12T20:34:34.792892+0000, chain.objs.size()=1 2024-09-12T18:59:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-YMANQD_fQRiPaJX8h6k5axC-AyW8lz_0 2024-09-12T18:59:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4129037926569199204', time=2024-09-12T20:34:34.928202+0000, chain.objs.size()=1 2024-09-12T18:59:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.xspUzcdqjN7THBEZ9f4A6WV27gDhj05_0 2024-09-12T18:59:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.112108448665356322', time=2024-09-12T20:34:35.413995+0000, chain.objs.size()=1 2024-09-12T18:59:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.df5axoaTBJaivAs8b5stdiBh7M6r2Cn_0 2024-09-12T18:59:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8315983235069596270', time=2024-09-12T20:34:35.710967+0000, chain.objs.size()=1 2024-09-12T18:59:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.7qJCds9_aqVItvUhm56IczgiNu6nqi2_0 2024-09-12T18:59:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17731530910586859641', time=2024-09-12T20:34:35.763814+0000, chain.objs.size()=1 2024-09-12T18:59:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YEchdlCMBI4WwmTpp5n4PFleL180uRN_0 2024-09-12T18:59:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1180746269079889849', time=2024-09-12T20:34:40.659092+0000, chain.objs.size()=1 2024-09-12T18:59:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.499+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qH_cL9lZlu_tZMm0k9PHDMsgOgEjCaV_0 2024-09-12T18:59:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3373964876538140831', time=2024-09-12T20:34:42.440079+0000, chain.objs.size()=1 2024-09-12T18:59:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.u0eGkeQG4Pu08Ns7m2RD2Hp8iPrWOcQ_0 2024-09-12T18:59:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10262672808481703028', time=2024-09-12T20:34:43.564884+0000, chain.objs.size()=1 2024-09-12T18:59:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.juO7Bq1UrYhTfMaaE4cfx9AfFZFvEXQ_0 2024-09-12T18:59:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6458723141874983282', time=2024-09-12T20:34:45.688463+0000, chain.objs.size()=1 2024-09-12T18:59:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.i-ZSTVeobr2m_yTy-CTizvQACvc9HzN_0 2024-09-12T18:59:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12179168890597858135', time=2024-09-12T20:34:45.715147+0000, chain.objs.size()=1 2024-09-12T18:59:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Qa89I3AzTSdeIcNjxitkVtQnNqv2pOi_0 2024-09-12T18:59:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.403225493449764769', time=2024-09-12T20:34:45.898419+0000, chain.objs.size()=1 2024-09-12T18:59:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9zROepAtUUZQ9DDDfnNEUGbu9-Uo6U5_0 2024-09-12T18:59:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1427552137409447110', time=2024-09-12T20:34:49.176295+0000, chain.objs.size()=1 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.oKyYdquw5ZTXoVfjSYpPoyzWo9Go_WP_0 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11570522342913407026', time=2024-09-12T20:34:50.232809+0000, chain.objs.size()=1 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Dm_OXFAZkpW7oa9_NkQea66fJ7dZZds_0 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16377641964350661429', time=2024-09-12T20:34:51.493655+0000, chain.objs.size()=1 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.yrB9EZ4NCw36B2VwHcRn9V4eCgcTO3a_0 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10362797266160881925', time=2024-09-12T20:34:53.618761+0000, chain.objs.size()=1 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qjr8l5gTmN2bOkrO7ALy_9e4XpkEM4V_0 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12437112802240095737', time=2024-09-12T20:34:54.300514+0000, chain.objs.size()=1 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Cd6XT2CUUi38t5QNHoGEBJ8L9QhcxFj_0 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8647656629076549621', time=2024-09-12T20:34:54.754922+0000, chain.objs.size()=1 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.0U2GGuogoVoyN-OqWA_1QolZ_HXb52f_0 2024-09-12T18:59:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17028557892304126842', time=2024-09-12T20:34:54.948022+0000, chain.objs.size()=1 2024-09-12T18:59:59.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.lBy2nvtYgBQAMrjrWSFKrsV-jszkXst_0 2024-09-12T18:59:59.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18236654301949998791', time=2024-09-12T20:34:55.737850+0000, chain.objs.size()=1 2024-09-12T18:59:59.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.503+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.B8RpKTZhZyDvj5JctQ4gl6IJIRWwNIY_0 2024-09-12T18:59:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45607 2024-09-12T18:59:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T18:59:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11798712695907510458', time=2024-09-12T20:34:56.197853+0000, chain.objs.size()=1 2024-09-12T18:59:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ZCAUgeOrZk60WBA7z5uZ1Fw0tc8547L_0 2024-09-12T18:59:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4547762643759356505', time=2024-09-12T20:34:56.306256+0000, chain.objs.size()=1 2024-09-12T18:59:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.lutnooL251dpvA9sAG7wWPO6NBuGXIK_0 2024-09-12T18:59:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.83170272316788493', time=2024-09-12T20:34:58.237022+0000, chain.objs.size()=1 2024-09-12T18:59:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.AMBxAn3oCP96CJamiFc-tg_5ngGZNiU_0 2024-09-12T18:59:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2703307131539069002', time=2024-09-12T20:34:59.848091+0000, chain.objs.size()=1 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.M5of9EFWoqTIo-ZFMYwaXwYzbNUa_fx_0 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2401038752561676597', time=2024-09-12T20:34:59.927284+0000, chain.objs.size()=1 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nvC_m377ls_m5W7XIooVkqi24kxFAr__0 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3853573056949964114', time=2024-09-12T20:34:59.929155+0000, chain.objs.size()=1 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RzZQxCe1zvX4CIbqrVrCGh9O8Oiva9q_0 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14310049603645073961', time=2024-09-12T20:35:00.122001+0000, chain.objs.size()=1 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.rhwIZqyAsPC1yiKXIWjvcQ9jalXqv3k_0 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10993984408101489726', time=2024-09-12T20:35:00.878984+0000, chain.objs.size()=1 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tfqRbZlPpwjDigivD-W2vnytZAkzNcw_0 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17210754869460947021', time=2024-09-12T20:35:00.949363+0000, chain.objs.size()=1 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Ot1SaqPIw9IJpoBL3NoVni5Nzs6i5gu_0 2024-09-12T18:59:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15231360442560483305', time=2024-09-12T20:35:48.676449+0000, chain.objs.size()=1 2024-09-12T18:59:59.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.373__shadow_.kbFqpt7h2yvZ-KJ2dYjA83EugE_AaES_0 2024-09-12T18:59:59.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4225423716956997450', time=2024-09-12T20:35:52.922137+0000, chain.objs.size()=1 2024-09-12T18:59:59.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.376__shadow_.u9HeDIKFalGxVr3g8-KtDW-driGkX3M_0 2024-09-12T18:59:59.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8644433943866562151', time=2024-09-12T20:37:28.537768+0000, chain.objs.size()=1 2024-09-12T18:59:59.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.459__shadow_.aW2w0izmDiHDScTVLmZjjxB1SUzDe7L_0 2024-09-12T18:59:59.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14017674860187778863', time=2024-09-12T20:43:19.165749+0000, chain.objs.size()=1 2024-09-12T18:59:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.559__shadow_.DNuw7nkxAQvqMSedpG2xVvcvIdHc-MC_0 2024-09-12T18:59:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4379521803892324872', time=2024-09-12T20:44:08.038751+0000, chain.objs.size()=1 2024-09-12T18:59:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.507+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.572__shadow:qn.M45VEiPtjxJLWIz983ZF0PgGjP6Y_.OQZSj4Cebah5TfV6U-_3to-_RUQvDz2_0 2024-09-12T18:59:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16063593213937560506', time=2024-09-12T20:44:27.311520+0000, chain.objs.size()=1 2024-09-12T18:59:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.576__shadow:kVqllrSKVxoqrc1mZapa6NIbiY8E9sV_._F2uvisNoBAmHez5yOc8saxad_nX8I6_0 2024-09-12T18:59:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1897035433009875881', time=2024-09-12T20:44:40.311821+0000, chain.objs.size()=1 2024-09-12T18:59:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:Mk-8DdZ-J8pBxpk45rUqXmIe7jxiLry_.SyDpxt_6Qgb4r87zCksOtu_6C9jWdHm_0 2024-09-12T18:59:59.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2771563805636498516', time=2024-09-12T20:45:34.449264+0000, chain.objs.size()=1 2024-09-12T18:59:59.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.579__shadow:srbcefDLeffDFIXRme9b.Mp9Rputk.v_.uC-MeXbIOHsophlFwMirA5p-rlmpqep_0 2024-09-12T18:59:59.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6214084206730142860', time=2024-09-12T20:45:39.174049+0000, chain.objs.size()=1 2024-09-12T18:59:59.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.580__shadow:gSyCbv7JlZ4b7cjM3iKnyLb1.eZeLDX_.glXCm9i6SyKWFOrIBwQdyquP5XrF40I_0 2024-09-12T18:59:59.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17374916761999784729', time=2024-09-12T20:45:42.966070+0000, chain.objs.size()=1 2024-09-12T18:59:59.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.583__shadow:j4VVutX9gZ2CORW6Mhc-X2ONTYj5Sko_.ss49DwMovbr9vq5iNtkSpBK42SSpGTD_0 2024-09-12T18:59:59.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16120095572222294557', time=2024-09-12T20:45:47.172852+0000, chain.objs.size()=1 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.585__shadow:e8dJnBROQyoZyLRlbXt4qkGeyHWMnaE_.YKxhsEFZx1vrKvVGB3h4eg-F925Lv-j_0 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9990642279569636247', time=2024-09-12T20:46:01.523848+0000, chain.objs.size()=1 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.596__shadow_.CCe_QPM4RMQohd-kpF28_HwWFj38r_H_0 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9392871516000010148', time=2024-09-12T20:49:50.198463+0000, chain.objs.size()=1 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.619__shadow_.9SnzPZ93woU94AivdnOQXJ1IULs84q7_0 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3273977534615385531', time=2024-09-12T20:52:01.389946+0000, chain.objs.size()=1 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.666__shadow_.wYS4ruffWtdkxcKNd5r670J7j-Yc6p9_0 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9579865025613927361', time=2024-09-12T20:52:01.809290+0000, chain.objs.size()=1 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.666__shadow_.JuCIDPB2lIKv31an1QwoFNIE6DL3RYD_0 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8698951232189925315', time=2024-09-12T20:52:34.462253+0000, chain.objs.size()=1 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.698__shadow:f3VUNNUlMkNZAxYBX.Jk8mxAog2if-Y_.7fsOPtmxmTdxN2dH16CxV0DLX9Cy3JN_0 2024-09-12T18:59:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4519088064501392614', time=2024-09-12T20:53:56.468571+0000, chain.objs.size()=1 2024-09-12T18:59:59.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.511+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.742__multipart_mymultipart3.2~hs0E9hIZ3A7AAvbgSgFU0rR3a8wzdDV.1 2024-09-12T18:59:59.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.515+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.515+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:59:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50345' 2024-09-12T18:59:59.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_0GpNioIloXRo4nO_h0hc9XfSod595gx', time=2024-09-12T20:22:31.549597+0000, chain.objs.size()=3 2024-09-12T18:59:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.L8zvF_SxuPjwdHpCNI0ZStWbA9WQqYs_0 2024-09-12T18:59:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.L8zvF_SxuPjwdHpCNI0ZStWbA9WQqYs_1 2024-09-12T18:59:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.L8zvF_SxuPjwdHpCNI0ZStWbA9WQqYs_2 2024-09-12T18:59:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11440458076019305722', time=2024-09-12T20:26:52.474943+0000, chain.objs.size()=1 2024-09-12T18:59:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.249__shadow_.CMHMR8cDWfYlGg-XGGbyKNCXAfnwUuH_0 2024-09-12T18:59:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4035974398839893585', time=2024-09-12T20:26:56.651234+0000, chain.objs.size()=1 2024-09-12T18:59:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.252__shadow_.V7ehi2N4JgUNGn0UeP7KY74ri8k07cv_0 2024-09-12T18:59:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7999233693596614555', time=2024-09-12T20:27:07.540095+0000, chain.objs.size()=1 2024-09-12T18:59:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.260__shadow_.bM0wi-b_OUbiE0HU4iBTcYalmUp_iLk_0 2024-09-12T18:59:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7001995643975242991', time=2024-09-12T20:27:08.923860+0000, chain.objs.size()=1 2024-09-12T18:59:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.261__shadow_.xkWpXjAkWjsiM4HEclvRQJ13rLL_27O_0 2024-09-12T18:59:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11780664584551780089', time=2024-09-12T20:28:49.337337+0000, chain.objs.size()=1 2024-09-12T18:59:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7cSwphvpUcNzl5uMR1apKB3hT3TfGns_0 2024-09-12T18:59:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11908142588732676350', time=2024-09-12T20:28:49.894082+0000, chain.objs.size()=1 2024-09-12T18:59:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.TnEdtk4Y89vpIVWoCxCFzIqUL02EUPa_0 2024-09-12T18:59:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11796398731956761715', time=2024-09-12T20:28:52.411467+0000, chain.objs.size()=1 2024-09-12T18:59:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.60TrL7TF1KxlYsUZOZv32fs6fxFdyAe_0 2024-09-12T18:59:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13918821752841866338', time=2024-09-12T20:28:52.485077+0000, chain.objs.size()=1 2024-09-12T18:59:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.zlTPvkK8KuhsfkLCsxH8OhbGiwdhgdJ_0 2024-09-12T18:59:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15002122983377933020', time=2024-09-12T20:28:53.163737+0000, chain.objs.size()=1 2024-09-12T18:59:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.519+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ubS539Q0m2Z5ZtyjY50LGVPHuZU0zFU_0 2024-09-12T18:59:59.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1324849708516312203', time=2024-09-12T20:28:53.165594+0000, chain.objs.size()=1 2024-09-12T18:59:59.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.qKRROLSp3h0UUY_9aEIzVFy032KMSBn_0 2024-09-12T18:59:59.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16208470840172342496', time=2024-09-12T20:28:53.438473+0000, chain.objs.size()=1 2024-09-12T18:59:59.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.11IqqJvgOCtrHvj_Uo5W2p_btE-pdeN_0 2024-09-12T18:59:59.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14009030307568750771', time=2024-09-12T20:28:53.766027+0000, chain.objs.size()=1 2024-09-12T18:59:59.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.m3AwbAuOSvuBzwqks6IX1V6w_LvmKK__0 2024-09-12T18:59:59.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11228550092935827568', time=2024-09-12T20:28:53.918489+0000, chain.objs.size()=1 2024-09-12T18:59:59.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.yXGzu3hXfZ_-efDWTosqO_PQR1TrcZy_0 2024-09-12T18:59:59.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2443014872316312868', time=2024-09-12T20:28:54.367425+0000, chain.objs.size()=1 2024-09-12T18:59:59.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.89yAIvhTYkMgSewGV1yMSUWS4-3mtJ8_0 2024-09-12T18:59:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5728374191545811047', time=2024-09-12T20:28:55.368623+0000, chain.objs.size()=1 2024-09-12T18:59:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DCtML25u9BDeKHjUcuBAqAApYBjmpPa_0 2024-09-12T18:59:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11754046574135269267', time=2024-09-12T20:28:55.706578+0000, chain.objs.size()=1 2024-09-12T18:59:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.EgOpvf1JuS46ITdM1knEd5-bTxxujRc_0 2024-09-12T18:59:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.176497616181744256', time=2024-09-12T20:28:57.429128+0000, chain.objs.size()=1 2024-09-12T18:59:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Kgs5L1DsrBE9hpHXm0eFOzNl2rO2DRr_0 2024-09-12T18:59:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16059722786755886040', time=2024-09-12T20:28:59.843883+0000, chain.objs.size()=1 2024-09-12T18:59:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.4Q7dO-XVDzAXNISVhaSEBlzC0txsBDm_0 2024-09-12T18:59:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11098545513669316946', time=2024-09-12T20:29:00.050957+0000, chain.objs.size()=1 2024-09-12T18:59:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rSV7BDsv1TN7Jf3E9i2Po57T7IZG8Dm_0 2024-09-12T18:59:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4400140840513041764', time=2024-09-12T20:29:00.823423+0000, chain.objs.size()=1 2024-09-12T18:59:59.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.miJS-LtDv2YKxtv1UmOK98NaVWGnIPw_0 2024-09-12T18:59:59.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15939548564761124627', time=2024-09-12T20:29:01.453676+0000, chain.objs.size()=1 2024-09-12T18:59:59.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.goK_K3BI1L1d4KTuW_mz0oS8qzrT_7e_0 2024-09-12T18:59:59.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7539086435023628029', time=2024-09-12T20:29:03.687132+0000, chain.objs.size()=1 2024-09-12T18:59:59.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2Ki2G3NiqYwTqeJDoiOfetkRB7apQ7d_0 2024-09-12T18:59:59.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12007567951261835662', time=2024-09-12T20:29:06.174652+0000, chain.objs.size()=1 2024-09-12T18:59:59.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vmBRil_ud6p2sxxzrYqdeYfyAoaYoHZ_0 2024-09-12T18:59:59.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14142637862162985174', time=2024-09-12T20:29:06.496690+0000, chain.objs.size()=1 2024-09-12T18:59:59.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.523+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.qYNxOCSpiOH3RzqJRRpr6zumZnWlIzo_0 2024-09-12T18:59:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11596455781725461902', time=2024-09-12T20:29:06.600467+0000, chain.objs.size()=1 2024-09-12T18:59:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._PkI8oWMl6EkZak3DYd4gsrVGWXGcHw_0 2024-09-12T18:59:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12092371618865761344', time=2024-09-12T20:29:06.823926+0000, chain.objs.size()=1 2024-09-12T18:59:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.qvWVNVrj0yexzYE6E6E4muTseUqGRwg_0 2024-09-12T18:59:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8631825558533639552', time=2024-09-12T20:29:07.936724+0000, chain.objs.size()=1 2024-09-12T18:59:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wfGPc_FwMSQ1tymN4-ucn2x_ORN5rnv_0 2024-09-12T18:59:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16456887870716880649', time=2024-09-12T20:29:08.124333+0000, chain.objs.size()=1 2024-09-12T18:59:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.4eKxxxzz9_iAd6cMC_9vUp0AB6uL5Cf_0 2024-09-12T18:59:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4078351658794181150', time=2024-09-12T20:29:11.063311+0000, chain.objs.size()=1 2024-09-12T18:59:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gGqmEjTU0-68EDPPIfywfRD4Zre13RO_0 2024-09-12T18:59:59.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3087358828255564020', time=2024-09-12T20:29:13.681173+0000, chain.objs.size()=1 2024-09-12T18:59:59.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.__cQYzPFStqpqZ2NF1ZKGj990Xln0hR_0 2024-09-12T18:59:59.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6937571448578966174', time=2024-09-12T20:29:15.061136+0000, chain.objs.size()=1 2024-09-12T18:59:59.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DVhxNAqQMeN6SBv8EZNiLCIIVqa5EEe_0 2024-09-12T18:59:59.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7507963649414097912', time=2024-09-12T20:29:15.239136+0000, chain.objs.size()=1 2024-09-12T18:59:59.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wUczzq1Dkyv_7K61FB-kfQqdvqbXfNH_0 2024-09-12T18:59:59.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15674557484351899765', time=2024-09-12T20:29:32.184970+0000, chain.objs.size()=1 2024-09-12T18:59:59.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.275__shadow_.InjK7Pvlw8qF8ivcm0YYfGJ7EZwwZP4_0 2024-09-12T18:59:59.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10119576823785363335', time=2024-09-12T20:29:51.938185+0000, chain.objs.size()=1 2024-09-12T18:59:59.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.289__shadow_.9YmO_qJXJ2hISYW9n33WmMPEIQocdSf_0 2024-09-12T18:59:59.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9244545684795152087', time=2024-09-12T20:29:58.978974+0000, chain.objs.size()=1 2024-09-12T18:59:59.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.OkFY0b04pREOZZbyeKA2JPgBRcOMftA_0 2024-09-12T18:59:59.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4060606826042442059', time=2024-09-12T20:30:06.704743+0000, chain.objs.size()=1 2024-09-12T18:59:59.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.295__shadow_.5xhDA9JEsm4whEDPkqFVwrrMNMLOMd__0 2024-09-12T18:59:59.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3689173371685932104', time=2024-09-12T20:30:12.513886+0000, chain.objs.size()=1 2024-09-12T18:59:59.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.299__shadow_.t8bmypFBmLOawTwgdKm0IxvAaVMddv__0 2024-09-12T18:59:59.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2868599912849026905', time=2024-09-12T20:32:26.810902+0000, chain.objs.size()=1 2024-09-12T18:59:59.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yYV8GsWb_YnLOKgTIQvh7M73msHPmcd_0 2024-09-12T18:59:59.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17629918239388668620', time=2024-09-12T20:32:27.229425+0000, chain.objs.size()=1 2024-09-12T18:59:59.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kjj7BMNxbj8kX6wfXSYAKCPrQRZUYaU_0 2024-09-12T18:59:59.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4115808155537649278', time=2024-09-12T20:32:28.826690+0000, chain.objs.size()=1 2024-09-12T18:59:59.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.TItoeL1BdXiUVAxngb9TPCgVWFXxuHf_0 2024-09-12T18:59:59.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10605679582442558406', time=2024-09-12T20:32:29.161604+0000, chain.objs.size()=1 2024-09-12T18:59:59.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dy4HyD9bFaNYm3CpIf_dp3Kjf3w5IES_0 2024-09-12T18:59:59.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10322821489390821471', time=2024-09-12T20:32:33.064323+0000, chain.objs.size()=1 2024-09-12T18:59:59.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.527+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nkCdy_sxsZI-B44LaUnYxeY9fvtOhhV_0 2024-09-12T18:59:59.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17498646918324863764', time=2024-09-12T20:32:35.115008+0000, chain.objs.size()=1 2024-09-12T18:59:59.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dWZ3uSTrAtwxFyNZN9TiSjVX5X_N6KM_0 2024-09-12T18:59:59.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18234057095574468454', time=2024-09-12T20:32:36.629691+0000, chain.objs.size()=1 2024-09-12T18:59:59.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BY01apg1uWmF5bz1OzMipiVVvxcBnWx_0 2024-09-12T18:59:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14692454478901582828', time=2024-09-12T20:32:36.631228+0000, chain.objs.size()=1 2024-09-12T18:59:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._Os8x_vzdg2efwxZ2ipJdCoN5B7Dr58_0 2024-09-12T18:59:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9820556461933318794', time=2024-09-12T20:32:37.891053+0000, chain.objs.size()=1 2024-09-12T18:59:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.bk2kJmrkfEJ_Vx6l60YUgzOl8eHE4mU_0 2024-09-12T18:59:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12455088454783024627', time=2024-09-12T20:32:38.527710+0000, chain.objs.size()=1 2024-09-12T18:59:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Z3kuZ2lj4-wdgvAfF4NR8VePZFHi2B2_0 2024-09-12T18:59:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11297385881332967557', time=2024-09-12T20:32:39.361897+0000, chain.objs.size()=1 2024-09-12T18:59:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.KLRARTpDoxMeauff8PTB57896xBGt2Q_0 2024-09-12T18:59:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.687163534414376286', time=2024-09-12T20:32:40.462159+0000, chain.objs.size()=1 2024-09-12T18:59:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.avkb-rRNm5VRsfl05bUrc01QpTs0s8m_0 2024-09-12T18:59:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16381172551733132292', time=2024-09-12T20:32:41.391680+0000, chain.objs.size()=1 2024-09-12T18:59:59.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.oFiGt6evIKY2fzEjAcefZQcPbz9qYbQ_0 2024-09-12T18:59:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12511536822758869805', time=2024-09-12T20:32:41.993276+0000, chain.objs.size()=1 2024-09-12T18:59:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.iPCpEcKvhMjLtamj3rcqxvpcFqLbhOz_0 2024-09-12T18:59:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8988793771962918739', time=2024-09-12T20:32:42.324458+0000, chain.objs.size()=1 2024-09-12T18:59:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.xWRlAarfW05BiW4_xuVmV7eUKeJ0Tca_0 2024-09-12T18:59:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11825208157063170382', time=2024-09-12T20:32:43.009118+0000, chain.objs.size()=1 2024-09-12T18:59:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.olzpK8Tlz60Z1kl-a5a42XzaUUZN7dQ_0 2024-09-12T18:59:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6688639312133253276', time=2024-09-12T20:32:43.208277+0000, chain.objs.size()=1 2024-09-12T18:59:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Hxrt7f3Z_zAgsTxWH9PVNznrWjyNIbl_0 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12566358729726523725', time=2024-09-12T20:32:44.709167+0000, chain.objs.size()=1 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.MPFdMbUOtu3NiyspPr3KtNn3uSJZJrM_0 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2690597040584675517', time=2024-09-12T20:32:45.347944+0000, chain.objs.size()=1 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jXmv9E6-MDoh9naBAX4WCRHgK70Jt8a_0 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12057761513712887408', time=2024-09-12T20:32:46.188686+0000, chain.objs.size()=1 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wHsH7IyAAbC2Qt6yQzPDsilDoOpEWSg_0 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.761091986991080197', time=2024-09-12T20:32:46.524585+0000, chain.objs.size()=1 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.qyL5IH0UIVvlU_IJFNjuLWHq_3YF6dM_0 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8138122228832670515', time=2024-09-12T20:32:46.628263+0000, chain.objs.size()=1 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.66BTO5kyu5cGBTnoYuSpmAx4JGX_l1Z_0 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11205001831337043368', time=2024-09-12T20:32:47.341563+0000, chain.objs.size()=1 2024-09-12T18:59:59.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.YH76vVSy3wLfZkGC3r4U3xYUFMwv-gI_0 2024-09-12T18:59:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10120080839994198788', time=2024-09-12T20:32:48.365671+0000, chain.objs.size()=1 2024-09-12T18:59:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.WVjgRMc7hp-Wjel-Aiqo8ngDKyf2MbP_0 2024-09-12T18:59:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16973136802645045968', time=2024-09-12T20:32:48.737725+0000, chain.objs.size()=1 2024-09-12T18:59:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.loydzISCvgdrCVwnunalX9BdDi-Va0I_0 2024-09-12T18:59:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6864572730553433595', time=2024-09-12T20:32:50.564148+0000, chain.objs.size()=1 2024-09-12T18:59:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._f-PGGcf0fKzRnyletW2WU0taU2Vmuw_0 2024-09-12T18:59:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11328217326293524623', time=2024-09-12T20:32:51.921720+0000, chain.objs.size()=1 2024-09-12T18:59:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.531+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jEIJMElOq4czsSqh4YWrNVziRWYACSX_0 2024-09-12T18:59:59.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15131933828038559894', time=2024-09-12T20:32:51.923619+0000, chain.objs.size()=1 2024-09-12T18:59:59.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Ay0ldBCIjGGGPIvYBXsYwDJLV6FC-7j_0 2024-09-12T18:59:59.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9933900051926786649', time=2024-09-12T20:32:52.200762+0000, chain.objs.size()=1 2024-09-12T18:59:59.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.r7jss3OALt95gcOJkdemX11RNGXdhWB_0 2024-09-12T18:59:59.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1492092652167760672', time=2024-09-12T20:32:52.293647+0000, chain.objs.size()=1 2024-09-12T18:59:59.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Y3iRHcyh0XL0eeABVTiyn57Qr-nIdrU_0 2024-09-12T18:59:59.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16461231121663310743', time=2024-09-12T20:32:53.439528+0000, chain.objs.size()=1 2024-09-12T18:59:59.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uxxZZgI8CiZQOi2IIOtqTGZI8OWDrRE_0 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10294654126117401615', time=2024-09-12T20:32:53.613372+0000, chain.objs.size()=1 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hrnBsfNcxR9NJjTsGS_0_vLjZZ90mLM_0 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18330698906671306066', time=2024-09-12T20:32:53.728364+0000, chain.objs.size()=1 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.bfpWhSff5oznvhgBdnpypMmpWNZD0_6_0 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13284854856249687322', time=2024-09-12T20:34:34.013272+0000, chain.objs.size()=1 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9PvjpvgH5SMn_xllH2f_24LWWNP1siM_0 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9671079048642958624', time=2024-09-12T20:34:35.219326+0000, chain.objs.size()=1 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.__X3ZbOsI2hGylQLi8Ujj36kTQCoGzq_0 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14664808324725625143', time=2024-09-12T20:34:36.397308+0000, chain.objs.size()=1 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.90xvWFP746N4md1RYRQMU1iMuJ-YdJT_0 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9772452464668180462', time=2024-09-12T20:34:38.218670+0000, chain.objs.size()=1 2024-09-12T18:59:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.niSUm498ljh85x4m6V_Q3GY61mzIiEY_0 2024-09-12T18:59:59.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7056398949417062274', time=2024-09-12T20:34:38.255777+0000, chain.objs.size()=1 2024-09-12T18:59:59.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4C2ViFGn3-ku7EyTnGE62tyzRq0eivy_0 2024-09-12T18:59:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13722822343592647022', time=2024-09-12T20:34:39.828257+0000, chain.objs.size()=1 2024-09-12T18:59:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.535+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6ATLz5hQgNgNhrtxNRQFf9jMGRRfaTp_0 2024-09-12T18:59:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3632774870818122845', time=2024-09-12T20:34:39.930431+0000, chain.objs.size()=1 2024-09-12T18:59:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.NFeWHxLGwmc-RMlYxUMV573L2k47K4V_0 2024-09-12T18:59:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17767132475896442294', time=2024-09-12T20:34:40.241814+0000, chain.objs.size()=1 2024-09-12T18:59:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QAGEP4_9QWYuhe1IHuXx2lJFR4t-zE2_0 2024-09-12T18:59:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4420767109915267554', time=2024-09-12T20:34:40.381136+0000, chain.objs.size()=1 2024-09-12T18:59:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Sx-mZpmA7aIC4pBrdxcSF-ExYt5flr-_0 2024-09-12T18:59:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13116650830982938274', time=2024-09-12T20:34:42.137238+0000, chain.objs.size()=1 2024-09-12T18:59:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.mc5yiehtH0OF45BE_uBjE7SSwE3wypl_0 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11498970041605569832', time=2024-09-12T20:34:43.132834+0000, chain.objs.size()=1 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JpEnAhWPUdpcj6vw3m55MkNtuYJiNdH_0 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5026022653451725507', time=2024-09-12T20:34:43.454586+0000, chain.objs.size()=1 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.x10sfHBK5ZNNUAAaO57AcwTaf-Ya5ur_0 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13937980660954478634', time=2024-09-12T20:34:47.208690+0000, chain.objs.size()=1 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3KIIDbxdI6oBhbyKOGbw6F62tCd_tpN_0 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.652556644069680491', time=2024-09-12T20:34:48.810116+0000, chain.objs.size()=1 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.EIxHx0TgpvqFhyDbQKFNEdKce5o_vZ7_0 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9616042417400010140', time=2024-09-12T20:34:48.812612+0000, chain.objs.size()=1 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.rBSoIGR3YKSjR2VuaNDYPmRkQ6C-pk-_0 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14667672368769959801', time=2024-09-12T20:34:49.745510+0000, chain.objs.size()=1 2024-09-12T18:59:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.zRw7JfnDJbNf0RLjrFsZW83UyFH0Vga_0 2024-09-12T18:59:59.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12431145641515995743', time=2024-09-12T20:34:50.032540+0000, chain.objs.size()=1 2024-09-12T18:59:59.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.mnrpATCKMXzM1pnQ3sussVSYmwmaZg6_0 2024-09-12T18:59:59.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16965391558790771104', time=2024-09-12T20:34:52.677002+0000, chain.objs.size()=1 2024-09-12T18:59:59.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.GUgLEJjQko6Q7yuazYrA1q6oLgKu9FG_0 2024-09-12T18:59:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17165601297298348013', time=2024-09-12T20:34:53.163834+0000, chain.objs.size()=1 2024-09-12T18:59:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-tH4P2zlECsitWeY1kr7kj-WYuiKOs3_0 2024-09-12T18:59:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9649147736772859345', time=2024-09-12T20:34:53.490440+0000, chain.objs.size()=1 2024-09-12T18:59:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.21hlqulOJ4GWrVPicTo0ynHkxPdFm1R_0 2024-09-12T18:59:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13699104289870546377', time=2024-09-12T20:34:54.133854+0000, chain.objs.size()=1 2024-09-12T18:59:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.eZHUouJSMoczc3h5DN7Q_Cmk-y5ooPj_0 2024-09-12T18:59:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3083107174645955735', time=2024-09-12T20:34:57.243369+0000, chain.objs.size()=1 2024-09-12T18:59:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.gRNaTq_VNBuOGtUFyHCcyRvdyKACjnq_0 2024-09-12T18:59:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.461552741784564084', time=2024-09-12T20:34:57.371159+0000, chain.objs.size()=1 2024-09-12T18:59:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Up274pRYK_N_aV3_JkOuc6SrHhpYJsY_0 2024-09-12T18:59:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6976329766539628291', time=2024-09-12T20:34:57.576339+0000, chain.objs.size()=1 2024-09-12T18:59:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6nzuNtrHH0BO1vpqQ73VDWVH3iSS2YF_0 2024-09-12T18:59:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9045022910207502153', time=2024-09-12T20:34:57.878285+0000, chain.objs.size()=1 2024-09-12T18:59:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nvAQRfFCgBAOKXWliRrrv33FbKxkJh9_0 2024-09-12T18:59:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8890984351984715085', time=2024-09-12T20:34:58.732966+0000, chain.objs.size()=1 2024-09-12T18:59:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QDSkoXg5XZwsnRjyzjq_iWZFpKoSMXU_0 2024-09-12T18:59:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7576102475129168145', time=2024-09-12T20:34:59.501762+0000, chain.objs.size()=1 2024-09-12T18:59:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.mAzSb7SApCB3sTGKb8CQWl_SQFDmqhy_0 2024-09-12T18:59:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18178067547512941697', time=2024-09-12T20:34:59.548748+0000, chain.objs.size()=1 2024-09-12T18:59:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qSQFLVQF15OqNeG-GtaT6xx0DKz3paR_0 2024-09-12T18:59:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11203623206913648287', time=2024-09-12T20:34:59.936899+0000, chain.objs.size()=1 2024-09-12T18:59:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.539+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YthC9m-_KLc6hS9moboG-jTLnNwmiSr_0 2024-09-12T18:59:59.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50345 2024-09-12T18:59:59.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:59:59.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13260880494053503415', time=2024-09-12T20:35:00.553668+0000, chain.objs.size()=1 2024-09-12T18:59:59.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.gfrDX_ftTnPRMYWV6Xe2lzMyj-CzBs0_0 2024-09-12T18:59:59.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12036085337781624053', time=2024-09-12T20:35:01.048492+0000, chain.objs.size()=1 2024-09-12T18:59:59.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.uuXvvJPGcyJzr2snT9sgf2LxExRUjUJ_0 2024-09-12T18:59:59.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8224669531512021300', time=2024-09-12T20:35:47.562213+0000, chain.objs.size()=1 2024-09-12T18:59:59.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.372__shadow_.mD8Z6hSZoRAhnxIYTjtlA2aGPWDpQ2E_0 2024-09-12T18:59:59.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4036291208844256022', time=2024-09-12T20:36:09.235527+0000, chain.objs.size()=1 2024-09-12T18:59:59.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.390__shadow_.Wsh4WKI8ZfC_VG65_DlqdaUJ5ksGS9F_0 2024-09-12T18:59:59.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.433165951209823982', time=2024-09-12T20:37:30.334489+0000, chain.objs.size()=1 2024-09-12T18:59:59.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.460__shadow_.R0NkWXK6dlkHNIlfOYeVjEY7Ye3YjOg_0 2024-09-12T18:59:59.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11913003945638447642', time=2024-09-12T20:38:20.150068+0000, chain.objs.size()=1 2024-09-12T18:59:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.499__shadow_.LwwfRLe7SjXheh9wCfMmX_mpUO17t3P_0 2024-09-12T18:59:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8853848337471367218', time=2024-09-12T20:38:25.792679+0000, chain.objs.size()=1 2024-09-12T18:59:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.503__shadow:RrE07h9QVCnd4UDOAeK8Om93tXQxxPE_.hyGvE7kfORPSZwwerfxAYNUofTKRYRK_0 2024-09-12T18:59:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~901PsBCcJUXXZkNS8iXucYc7-HWZ9RE', time=2024-09-12T20:40:16.382797+0000, chain.objs.size()=1 2024-09-12T18:59:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~901PsBCcJUXXZkNS8iXucYc7-HWZ9RE.3 2024-09-12T18:59:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15945661076905885473', time=2024-09-12T20:41:30.068024+0000, chain.objs.size()=3 2024-09-12T18:59:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~VgwiNKovhiDxTTzSvShPq7hkEzu4E_6.1 2024-09-12T18:59:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~VgwiNKovhiDxTTzSvShPq7hkEzu4E_6.2 2024-09-12T18:59:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~VgwiNKovhiDxTTzSvShPq7hkEzu4E_6.3 2024-09-12T18:59:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FuBalHqeIA5Z-tJafbKHnEAfOW5KuGf', time=2024-09-12T20:41:33.773855+0000, chain.objs.size()=10 2024-09-12T18:59:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.543+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.526__multipart_mymultipart.2~FuBalHqeIA5Z-tJafbKHnEAfOW5KuGf.1 2024-09-12T18:59:59.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.526__multipart_mymultipart.2~FuBalHqeIA5Z-tJafbKHnEAfOW5KuGf.2 2024-09-12T18:59:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.526__multipart_mymultipart.2~FuBalHqeIA5Z-tJafbKHnEAfOW5KuGf.3 2024-09-12T18:59:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.526__multipart_mymultipart.2~FuBalHqeIA5Z-tJafbKHnEAfOW5KuGf.4 2024-09-12T18:59:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.526__multipart_mymultipart.2~FuBalHqeIA5Z-tJafbKHnEAfOW5KuGf.5 2024-09-12T18:59:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.526__multipart_mymultipart.2~FuBalHqeIA5Z-tJafbKHnEAfOW5KuGf.6 2024-09-12T18:59:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.526__multipart_mymultipart.2~FuBalHqeIA5Z-tJafbKHnEAfOW5KuGf.7 2024-09-12T18:59:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.526__multipart_mymultipart.2~FuBalHqeIA5Z-tJafbKHnEAfOW5KuGf.8 2024-09-12T18:59:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.526__multipart_mymultipart.2~FuBalHqeIA5Z-tJafbKHnEAfOW5KuGf.9 2024-09-12T18:59:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.526__multipart_mymultipart.2~FuBalHqeIA5Z-tJafbKHnEAfOW5KuGf.10 2024-09-12T18:59:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~j6jxzU9FsC46jliFAeuJDBpWNhoKpXv', time=2024-09-12T20:41:54.198742+0000, chain.objs.size()=1 2024-09-12T18:59:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.533__multipart_mymultipart.2~j6jxzU9FsC46jliFAeuJDBpWNhoKpXv.1 2024-09-12T18:59:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~L6OGYHRKgBcnANfuESfIxp95KMrkSxV', time=2024-09-12T20:42:00.056222+0000, chain.objs.size()=1 2024-09-12T18:59:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.535__multipart_mymultipart.2~L6OGYHRKgBcnANfuESfIxp95KMrkSxV.3 2024-09-12T18:59:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5288592431395025715', time=2024-09-12T20:43:51.670810+0000, chain.objs.size()=1 2024-09-12T18:59:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.547+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:Pi.Qug3Z05BCgeu-poiOricc-nZIB6m_.WVGa13dkiybs5pxq3BfOwo2xUS4oSKf_0 2024-09-12T18:59:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1326032959790977897', time=2024-09-12T20:43:55.236901+0000, chain.objs.size()=1 2024-09-12T18:59:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:cfkIfEjKn45d2Egh-9MorH-G962RH1d_.Kfpfp7X80dXzSBBjy9BTPkWmfb-7lCw_0 2024-09-12T18:59:59.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.110568261340363886', time=2024-09-12T20:44:04.250033+0000, chain.objs.size()=1 2024-09-12T18:59:59.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.570__shadow:6Xmn6UassA9U-jmQIC3c623IBdjkmwR_.guu1-syV7qpuuYvLQgnuk_7HR4qxFs4_0 2024-09-12T18:59:59.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10987319414957653317', time=2024-09-12T20:44:09.931110+0000, chain.objs.size()=1 2024-09-12T18:59:59.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.573__shadow_.vFEJsEavGWpsJwDEcfpyHZkt7y03kjX_0 2024-09-12T18:59:59.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1436449369226809700', time=2024-09-12T20:45:03.499409+0000, chain.objs.size()=1 2024-09-12T18:59:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:Fx5ekXjt.Q67HadPMV.qo28tPjUnBgw_.woXfYD4irF6og0b8opqrzMmsS_HWPaP_0 2024-09-12T18:59:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15739315364811081887', time=2024-09-12T20:45:39.763184+0000, chain.objs.size()=1 2024-09-12T18:59:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.580__shadow:zZIydmVUTKFCziSS7nc1o8T.oM7Xq-p_.bBttjkFMfqpcaQ5SmJV9V9Ojsj3adnp_0 2024-09-12T18:59:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13956263277212176150', time=2024-09-12T20:50:54.714375+0000, chain.objs.size()=1 2024-09-12T18:59:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.639__shadow_.svn86H5RJkcnG_FV7-fMmUw-Zf2jbld_0 2024-09-12T18:59:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9907242819562002235', time=2024-09-12T20:53:35.793143+0000, chain.objs.size()=1 2024-09-12T18:59:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.734__shadow_.Uf7Xg3CT3AdupzFsiH4csX2JOLcWlzG_0 2024-09-12T18:59:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.551+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.555+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:59:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.555+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.555+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47427' 2024-09-12T18:59:59.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10703270434119639820', time=2024-09-12T20:23:24.171644+0000, chain.objs.size()=1 2024-09-12T18:59:59.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.189__shadow_.RJGBt8pH0crTFHONWFmumzulHZRDLEb_0 2024-09-12T18:59:59.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12089081804939096741', time=2024-09-12T20:26:29.565265+0000, chain.objs.size()=1 2024-09-12T18:59:59.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.234__shadow_.W2c725v3gIY2OjWMyXoLpqtg04jW2-7_0 2024-09-12T18:59:59.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9650157628925956161', time=2024-09-12T20:26:55.237840+0000, chain.objs.size()=1 2024-09-12T18:59:59.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.251__shadow_.GmBtn5eb6pp7zFsbU0Ji0v5Is4hiTS__0 2024-09-12T18:59:59.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14337343421716675230', time=2024-09-12T20:27:00.839174+0000, chain.objs.size()=1 2024-09-12T18:59:59.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.255__shadow_.z--bpvx8c6QMOUlFfY8nvbeaBYXgZ25_0 2024-09-12T18:59:59.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2682526175531696363', time=2024-09-12T20:28:47.904760+0000, chain.objs.size()=1 2024-09-12T18:59:59.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.KLcELanBZw8VfnOIW71HmahcbLKO7mZ_0 2024-09-12T18:59:59.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9688369916978903527', time=2024-09-12T20:28:49.301715+0000, chain.objs.size()=1 2024-09-12T18:59:59.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VLjf8w9FW5d8QnJLemsTFkrI8hfRDQh_0 2024-09-12T18:59:59.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.803936023348847742', time=2024-09-12T20:28:50.061209+0000, chain.objs.size()=1 2024-09-12T18:59:59.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AHbMgu5P5_CE3zh_yQ6MI3nT47zTl4P_0 2024-09-12T18:59:59.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5443281600650088181', time=2024-09-12T20:28:50.076232+0000, chain.objs.size()=1 2024-09-12T18:59:59.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.nmyA8a9tu_7g8tCZ123u7gageb4xGVT_0 2024-09-12T18:59:59.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17674716290703739413', time=2024-09-12T20:28:50.483992+0000, chain.objs.size()=1 2024-09-12T18:59:59.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.TnEfOliCI5_WTz8KwWk46U6mvfN--pj_0 2024-09-12T18:59:59.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11962661889263980781', time=2024-09-12T20:28:51.942978+0000, chain.objs.size()=1 2024-09-12T18:59:59.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wH6M24MX4DgRdYT0OUbH7ODKFklDvdp_0 2024-09-12T18:59:59.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14924872427057736392', time=2024-09-12T20:28:52.134415+0000, chain.objs.size()=1 2024-09-12T18:59:59.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.A2YwztDAgMHQp1xZWFhpRoYTICPnQhb_0 2024-09-12T18:59:59.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14587934566687445054', time=2024-09-12T20:28:53.127506+0000, chain.objs.size()=1 2024-09-12T18:59:59.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SqMYc-ZeknfVJhEwGVUJcD_yYBEvZtD_0 2024-09-12T18:59:59.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4564919963337113438', time=2024-09-12T20:28:53.449202+0000, chain.objs.size()=1 2024-09-12T18:59:59.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NQBqrIFhU5OhB1Lq7svtCT2KuR1CLXc_0 2024-09-12T18:59:59.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7968671212330310280', time=2024-09-12T20:28:53.542938+0000, chain.objs.size()=1 2024-09-12T18:59:59.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gQMPTocdx8r5AbTp2WIc4Xsxe0Qyeij_0 2024-09-12T18:59:59.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17284260537180950657', time=2024-09-12T20:28:54.383565+0000, chain.objs.size()=1 2024-09-12T18:59:59.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3xmoS4QDePgYZaupaGc5EyCZvU6wQNM_0 2024-09-12T18:59:59.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11841186702904706126', time=2024-09-12T20:28:57.257546+0000, chain.objs.size()=1 2024-09-12T18:59:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.cg0dKG0Y1L8UBb5MNsRNG9bqln_mLIF_0 2024-09-12T18:59:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15054507674901322362', time=2024-09-12T20:28:57.671508+0000, chain.objs.size()=1 2024-09-12T18:59:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._9NpANikpvneT7vXWXY6jcVsDQvw3Be_0 2024-09-12T18:59:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17105158911342257766', time=2024-09-12T20:28:59.028973+0000, chain.objs.size()=1 2024-09-12T18:59:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3VJFn_yEq2TyrEZhFMrtQxeh-DqbOKI_0 2024-09-12T18:59:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14688110682490020866', time=2024-09-12T20:29:00.060483+0000, chain.objs.size()=1 2024-09-12T18:59:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.O5IC95tRd-ZjeBqCTi5Bp5pthNm0ncF_0 2024-09-12T18:59:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10039234407982775997', time=2024-09-12T20:29:04.484883+0000, chain.objs.size()=1 2024-09-12T18:59:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.QK1CMU7TeaMmT1Ouc46CtuDo6meN5Ev_0 2024-09-12T18:59:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.892366724728105776', time=2024-09-12T20:29:04.873603+0000, chain.objs.size()=1 2024-09-12T18:59:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.s6qaP9JlBKq0SP989P2tLadG_kI7Wmk_0 2024-09-12T18:59:59.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8046381743920052237', time=2024-09-12T20:29:04.887922+0000, chain.objs.size()=1 2024-09-12T18:59:59.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SCLQt-qpVY9DQ13CKiKci8OLWVqgGyt_0 2024-09-12T18:59:59.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8471989599497578946', time=2024-09-12T20:29:05.289540+0000, chain.objs.size()=1 2024-09-12T18:59:59.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.559+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gFU82GzfsushghLeApLETwxxduyAxXL_0 2024-09-12T18:59:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9562897384013681653', time=2024-09-12T20:29:05.291553+0000, chain.objs.size()=1 2024-09-12T18:59:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.XcRoTWQNr1VOFl1YguKFl01YEDP4jNd_0 2024-09-12T18:59:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10494525777186144569', time=2024-09-12T20:29:07.075848+0000, chain.objs.size()=1 2024-09-12T18:59:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.jmAG2H-fbRFJztTZ10BtiwXuDkSHE5C_0 2024-09-12T18:59:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5231148318999084891', time=2024-09-12T20:29:07.864548+0000, chain.objs.size()=1 2024-09-12T18:59:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.xtXfDcXfM4hDj026-jI7AkiKdA75MNk_0 2024-09-12T18:59:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18390878150806871605', time=2024-09-12T20:29:08.768503+0000, chain.objs.size()=1 2024-09-12T18:59:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.jrHMOQ-I-Q25vuzgK_8_9eHBijotBBO_0 2024-09-12T18:59:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7727654549952281103', time=2024-09-12T20:29:11.112402+0000, chain.objs.size()=1 2024-09-12T18:59:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.6leioyYbJx4Z-2xnV9x2hUGthi6bMxY_0 2024-09-12T18:59:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13548911084614161353', time=2024-09-12T20:29:12.374804+0000, chain.objs.size()=1 2024-09-12T18:59:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.E_-UQ1mNkbpNmXkGNdHPZYUJs1zBQWs_0 2024-09-12T18:59:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13735950308070204771', time=2024-09-12T20:29:12.595345+0000, chain.objs.size()=1 2024-09-12T18:59:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HYtJJOrnVtDsGcafVI3B2wP0yVI12SP_0 2024-09-12T18:59:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2389072227196683421', time=2024-09-12T20:29:13.259254+0000, chain.objs.size()=1 2024-09-12T18:59:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.f0PfWeTkZILy72biyyk2K0kO-bTOO8t_0 2024-09-12T18:59:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2311897713867544329', time=2024-09-12T20:29:13.654952+0000, chain.objs.size()=1 2024-09-12T18:59:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.UItl_siYxS34bQgViVqyEdW1b7nVEAm_0 2024-09-12T18:59:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2887415197266637412', time=2024-09-12T20:29:14.478815+0000, chain.objs.size()=1 2024-09-12T18:59:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wIYCjDF1WuYmSF6C1ObEUxa2yaVJMG__0 2024-09-12T18:59:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15499095322021161190', time=2024-09-12T20:29:21.841413+0000, chain.objs.size()=1 2024-09-12T18:59:59.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.267__shadow_.epxaWccQbg7wxYI6v4a3uLwxxwP06TL_0 2024-09-12T18:59:59.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17806064299008720899', time=2024-09-12T20:29:36.307850+0000, chain.objs.size()=1 2024-09-12T18:59:59.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.278__shadow_.kDqlVCMUVSpCL-NWDTcbLhrh8HeItBH_0 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10841274285069027482', time=2024-09-12T20:29:40.618829+0000, chain.objs.size()=1 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.281__shadow_.qJ4qKrB4SvsiIKh1-cgcHlTKohubxIv_0 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9236875045106614443', time=2024-09-12T20:29:49.130001+0000, chain.objs.size()=1 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.287__shadow_.RsmxMAhEhpQaNeBwAmO3-O9N1Vf5O_K_0 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11060827938853259443', time=2024-09-12T20:29:50.544077+0000, chain.objs.size()=1 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.288__shadow_.FqiE6y7wRDgsAgEBbHWJjf-WJGh03SB_0 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3380549666982559049', time=2024-09-12T20:29:59.055172+0000, chain.objs.size()=1 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.TZLgqtOUkUGIxsb2QdSTWLTxcv9qlBG_0 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7925570830990951772', time=2024-09-12T20:30:18.061541+0000, chain.objs.size()=1 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.303__shadow_.dC0X6PxQLrxmkBsUDGknQOGEoP23Jty_0 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13690939366445209470', time=2024-09-12T20:30:41.285137+0000, chain.objs.size()=1 2024-09-12T18:59:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.319__shadow:AYDp5l4-oa53eO.Hw6Zlc..WFc3sOPn_.ZkCAe4Gge1_P3ZOmYc6zvYVCI3UBx1m_0 2024-09-12T18:59:59.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11579469521296288684', time=2024-09-12T20:30:44.030901+0000, chain.objs.size()=1 2024-09-12T18:59:59.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.321__shadow_.KDrK7ODSJgOZSqBK-b9xZOsGM-ijliN_0 2024-09-12T18:59:59.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6308089930955748570', time=2024-09-12T20:32:26.848464+0000, chain.objs.size()=1 2024-09-12T18:59:59.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.563+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.4hZKU6wlXjAp8xsBVNPy314GH-FnetJ_0 2024-09-12T18:59:59.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13564599316311940580', time=2024-09-12T20:32:27.320543+0000, chain.objs.size()=1 2024-09-12T18:59:59.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._kGIC2JKjEhyMKVjCamURhEE3QAW-Db_0 2024-09-12T18:59:59.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3023376092379943572', time=2024-09-12T20:32:27.322973+0000, chain.objs.size()=1 2024-09-12T18:59:59.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.GgfgKZzL_vJp9FBtz6Eel9thw7QRoAx_0 2024-09-12T18:59:59.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13238510228795776418', time=2024-09-12T20:32:28.073784+0000, chain.objs.size()=1 2024-09-12T18:59:59.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rzhgEWP4xhb2ssjIP6Uld-j5gWkdXUf_0 2024-09-12T18:59:59.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2033875338713670319', time=2024-09-12T20:32:28.606609+0000, chain.objs.size()=1 2024-09-12T18:59:59.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.MYOz0Fbbx-U1_2nCKEjN3WWBYI4u9TD_0 2024-09-12T18:59:59.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17574603259874470929', time=2024-09-12T20:32:28.848375+0000, chain.objs.size()=1 2024-09-12T18:59:59.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pDaqiEy-_rjAWrnudTYHYBvi1x5a07J_0 2024-09-12T18:59:59.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2313732379339671649', time=2024-09-12T20:32:30.721772+0000, chain.objs.size()=1 2024-09-12T18:59:59.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IdVv9U-KYdx_7Vx3ZJWMnhZP-a4T1gr_0 2024-09-12T18:59:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18013991436879699074', time=2024-09-12T20:32:31.052273+0000, chain.objs.size()=1 2024-09-12T18:59:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0jQ_IUfynJQnnWDiR502jg7XIif7bZX_0 2024-09-12T18:59:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3359193756383870202', time=2024-09-12T20:32:31.244416+0000, chain.objs.size()=1 2024-09-12T18:59:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.if-cAW7C_xi3GSN-pQ6Hi2ewro8tIpc_0 2024-09-12T18:59:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5742744905945602114', time=2024-09-12T20:32:31.462326+0000, chain.objs.size()=1 2024-09-12T18:59:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wprl0gVVZCHFwY2o6CcAKhzKLwJBWHY_0 2024-09-12T18:59:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17291380422460776950', time=2024-09-12T20:32:31.569970+0000, chain.objs.size()=1 2024-09-12T18:59:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.YiXnmsOj_sDHPjqs-Pss8LhTNUnD815_0 2024-09-12T18:59:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4716594207313530726', time=2024-09-12T20:32:31.860767+0000, chain.objs.size()=1 2024-09-12T18:59:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.iar6crevA-XESndBaBqd7BvxszDA4ba_0 2024-09-12T18:59:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3804004623290812468', time=2024-09-12T20:32:32.287745+0000, chain.objs.size()=1 2024-09-12T18:59:59.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.567+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Rshcr0c5GjSlltnDFbfEM3Aux4wUW6b_0 2024-09-12T18:59:59.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10526724177052635114', time=2024-09-12T20:32:32.857737+0000, chain.objs.size()=1 2024-09-12T18:59:59.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ZxqmEHZgXXEs2iosnv_PIRRIVtx9G6M_0 2024-09-12T18:59:59.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17382078768353496164', time=2024-09-12T20:32:32.860078+0000, chain.objs.size()=1 2024-09-12T18:59:59.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jvgcIeGLXKmPjA_q4V6g7N0uZY_UF7R_0 2024-09-12T18:59:59.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5806643887156038303', time=2024-09-12T20:32:33.307074+0000, chain.objs.size()=1 2024-09-12T18:59:59.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tCERRQBNSTpbDsUrUvw1AUmoGl0wKpw_0 2024-09-12T18:59:59.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5208683625998939031', time=2024-09-12T20:32:33.325413+0000, chain.objs.size()=1 2024-09-12T18:59:59.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.exb3uCGh393y57E0pEQ1T9OgqVXOVK4_0 2024-09-12T18:59:59.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14202364269320511156', time=2024-09-12T20:32:34.205635+0000, chain.objs.size()=1 2024-09-12T18:59:59.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Vg4ONr5dsVNMJYf46dUbDeTjk3gtlg4_0 2024-09-12T18:59:59.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14309489511904392966', time=2024-09-12T20:32:34.294737+0000, chain.objs.size()=1 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.M3aVx-Nr0mtna2r9r8ByJ83A5jBMBp__0 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12979084992815979916', time=2024-09-12T20:32:35.062915+0000, chain.objs.size()=1 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.LWZXpZ5XRu2onL_Smajb_EAi6QHSacY_0 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12998453980160423743', time=2024-09-12T20:32:35.287517+0000, chain.objs.size()=1 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.FN_JRju_YKGuY8mZDETdFab5nBwRSwr_0 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8494975031292604576', time=2024-09-12T20:32:35.676012+0000, chain.objs.size()=1 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Dhi8sPvMEv-cH2HygOVnodfYaMKSCd4_0 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18140391277720597196', time=2024-09-12T20:32:36.954424+0000, chain.objs.size()=1 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.5RtmKT4l440UtP9s9AHYLvzSp85G1WJ_0 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2602239227518309562', time=2024-09-12T20:32:37.817351+0000, chain.objs.size()=1 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Z61nje3Cqfg9pajmy1vBFIvADEwPkSC_0 2024-09-12T18:59:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11373154647307990178', time=2024-09-12T20:32:38.518207+0000, chain.objs.size()=1 2024-09-12T18:59:59.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8IaLznx8Ijrrmuyl5tM_lMQrH2ucLik_0 2024-09-12T18:59:59.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9461447587839847964', time=2024-09-12T20:32:38.801328+0000, chain.objs.size()=1 2024-09-12T18:59:59.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yOAbLiRTH5mirWysqcLN2UyFpDmWlYj_0 2024-09-12T18:59:59.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7788654381928511055', time=2024-09-12T20:32:38.811711+0000, chain.objs.size()=1 2024-09-12T18:59:59.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.77jDi5-nwIzgUG1Y4t4HVhdeWEwf78T_0 2024-09-12T18:59:59.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13874195196617971219', time=2024-09-12T20:32:39.895034+0000, chain.objs.size()=1 2024-09-12T18:59:59.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.buNXP2N2XK_YBIQoliQyvXveJbKhfvj_0 2024-09-12T18:59:59.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3491861901937392508', time=2024-09-12T20:32:39.965656+0000, chain.objs.size()=1 2024-09-12T18:59:59.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yhpIjj5UaLHj3LgEcw6pglpksu7NS0O_0 2024-09-12T18:59:59.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15448675784539924807', time=2024-09-12T20:32:40.197941+0000, chain.objs.size()=1 2024-09-12T18:59:59.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.h1AzONB0DXJ_x6KrPZLgXeBbWey47Ul_0 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5691383610058141246', time=2024-09-12T20:32:40.200001+0000, chain.objs.size()=1 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.e7Aeku8upGs8VC39N8JjKEuqomm18TK_0 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3972059635648611493', time=2024-09-12T20:32:41.593418+0000, chain.objs.size()=1 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.OCEtFpfEQiyNZ1KgqTgQJl3-1mBpFXK_0 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12582299790947652354', time=2024-09-12T20:32:41.996484+0000, chain.objs.size()=1 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.571+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Ddylmeps4MpdrNlTTC_9jmLWob-kOO6_0 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14004150847234160689', time=2024-09-12T20:32:43.007508+0000, chain.objs.size()=1 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.2lNayyH332zmLmEB0sA51b_xOvJfRUc_0 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14531064161185057245', time=2024-09-12T20:32:43.234263+0000, chain.objs.size()=1 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kPeR4OorMEtTHfjBtemEZ6rbtP3rcEN_0 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16603034809306982308', time=2024-09-12T20:32:45.943766+0000, chain.objs.size()=1 2024-09-12T18:59:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.l6mx_t8x3UaQNukQA0g6yNLm7fh9uYR_0 2024-09-12T18:59:59.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17190078318483114689', time=2024-09-12T20:32:46.078583+0000, chain.objs.size()=1 2024-09-12T18:59:59.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.J0ZP74YZu2gunrtV6XXqFPEbNQd0ocy_0 2024-09-12T18:59:59.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15376345211887883177', time=2024-09-12T20:32:46.972384+0000, chain.objs.size()=1 2024-09-12T18:59:59.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.vZdrEHFEPfbB_ewHRAteAYZKpjt9mZG_0 2024-09-12T18:59:59.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18161258284071121545', time=2024-09-12T20:32:48.742455+0000, chain.objs.size()=1 2024-09-12T18:59:59.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uqds2LxPRM1T0pu00gE04JWELLW0EFT_0 2024-09-12T18:59:59.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7924500939822698589', time=2024-09-12T20:32:49.654984+0000, chain.objs.size()=1 2024-09-12T18:59:59.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nEsX4rFL33Si89JGdkvUL1DSHftYENI_0 2024-09-12T18:59:59.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.859521437595108529', time=2024-09-12T20:32:51.861096+0000, chain.objs.size()=1 2024-09-12T18:59:59.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.XW0hgeakFNAOlRUA-4pgHbg8RJl7xkt_0 2024-09-12T18:59:59.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15715073149178379390', time=2024-09-12T20:32:52.668840+0000, chain.objs.size()=1 2024-09-12T18:59:59.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eNDcxczxAKBJAeHXJBAUaOO60zIdNxb_0 2024-09-12T18:59:59.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13104838755998042117', time=2024-09-12T20:32:53.040805+0000, chain.objs.size()=1 2024-09-12T18:59:59.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ZI3cVkvhlXgK5mgkL35VQhc0tG9D94W_0 2024-09-12T18:59:59.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9895602220340777675', time=2024-09-12T20:32:53.338070+0000, chain.objs.size()=1 2024-09-12T18:59:59.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.5Z2xy8Fygu_1ohKhFowGzAW5T7fGmuV_0 2024-09-12T18:59:59.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16291618181479277049', time=2024-09-12T20:34:34.424971+0000, chain.objs.size()=1 2024-09-12T18:59:59.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.yUwd2jWEkkyt33nP-LSM6aScRKMFjSn_0 2024-09-12T18:59:59.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16694762482231914794', time=2024-09-12T20:34:35.759331+0000, chain.objs.size()=1 2024-09-12T18:59:59.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Me8zNYRaJnITSCPUGFdR26eDJTeN7Ee_0 2024-09-12T18:59:59.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1643680706213479998', time=2024-09-12T20:34:35.816644+0000, chain.objs.size()=1 2024-09-12T18:59:59.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.575+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.muqkt8Zkk8Oyg_Vad5vJ5nQ9JIT0jg5_0 2024-09-12T18:59:59.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.511239141938599926', time=2024-09-12T20:34:36.020401+0000, chain.objs.size()=1 2024-09-12T18:59:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.dzdBVbGYaRjAJyYvHexyUk0r5qpHnth_0 2024-09-12T18:59:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6250012651673695261', time=2024-09-12T20:34:37.891370+0000, chain.objs.size()=1 2024-09-12T18:59:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hY-qDY_irsR4YVTqQpGFFAfP3Nbqssj_0 2024-09-12T18:59:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10053093117472012839', time=2024-09-12T20:34:38.225966+0000, chain.objs.size()=1 2024-09-12T18:59:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.O1PsXCkgMvMl4qMZlhm52W84RtVRYtj_0 2024-09-12T18:59:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15099319564709312287', time=2024-09-12T20:34:38.814207+0000, chain.objs.size()=1 2024-09-12T18:59:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hfjH35Ov-EAodfrLay1h7Qq9qFORL9P_0 2024-09-12T18:59:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2045062989286814960', time=2024-09-12T20:34:41.492494+0000, chain.objs.size()=1 2024-09-12T18:59:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.8RaNucQ0SSmjzpnWk_91Qh4N2wtzdUn_0 2024-09-12T18:59:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9602744499736585165', time=2024-09-12T20:34:41.496883+0000, chain.objs.size()=1 2024-09-12T18:59:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.dk9OhhW-oUdvx9WNzdtyBAAEyOj-WJD_0 2024-09-12T18:59:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10942351000284128775', time=2024-09-12T20:34:41.501503+0000, chain.objs.size()=1 2024-09-12T18:59:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.GLxlBnBOZjbr1Xrf4NH9DTowIKFlIpI_0 2024-09-12T18:59:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11716769642789695993', time=2024-09-12T20:34:42.443199+0000, chain.objs.size()=1 2024-09-12T18:59:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ex9OERnAVHowBV0PCmm7rKw-5XbDXnc_0 2024-09-12T18:59:59.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7706102297682175372', time=2024-09-12T20:34:43.284620+0000, chain.objs.size()=1 2024-09-12T18:59:59.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.CdLK9g7vK5m9DcXTg5_lRTrsOv7avrE_0 2024-09-12T18:59:59.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13208147765721681369', time=2024-09-12T20:34:43.459375+0000, chain.objs.size()=1 2024-09-12T18:59:59.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9enWq8KG_TMMeDYPDztKLjtLH5Sg2An_0 2024-09-12T18:59:59.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13312779186896841168', time=2024-09-12T20:34:43.719879+0000, chain.objs.size()=1 2024-09-12T18:59:59.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qHvGgDefw6wYLLHln_lyDR0Zm_2FJSH_0 2024-09-12T18:59:59.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.579+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47427 2024-09-12T18:59:59.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-09-12T18:59:59.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16661689972370969717', time=2024-09-12T20:34:43.951637+0000, chain.objs.size()=1 2024-09-12T18:59:59.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.B42V7B-vqsf0aqFRospFZ_6GC2_E021_0 2024-09-12T18:59:59.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6517868738207440919', time=2024-09-12T20:34:45.753320+0000, chain.objs.size()=1 2024-09-12T18:59:59.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.EX15pVRhziviYkWPv8ty9wlA4fqku9y_0 2024-09-12T18:59:59.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4304662225184156085', time=2024-09-12T20:34:45.755047+0000, chain.objs.size()=1 2024-09-12T18:59:59.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9tBSXr1TTyxN28pOAZZwdlq1ZmYPQUn_0 2024-09-12T18:59:59.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12667659624661430947', time=2024-09-12T20:34:46.149579+0000, chain.objs.size()=1 2024-09-12T18:59:59.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.WJslEpFnuYq-HgttN7YdvmjBt_4YLPK_0 2024-09-12T18:59:59.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8407912249047000224', time=2024-09-12T20:34:46.528869+0000, chain.objs.size()=1 2024-09-12T18:59:59.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.CGrRnUCHnDoyPOI9KxuUJH36UG8b4bt_0 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17443527236796879605', time=2024-09-12T20:34:46.863692+0000, chain.objs.size()=1 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qC0ToKDHSbY9BVQWjz2RVdTr3QSeTls_0 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17089368559555437030', time=2024-09-12T20:34:47.010526+0000, chain.objs.size()=1 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LKCUOktlPKy_z-GCpXkxIUkk26Rvka__0 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3671285358636490144', time=2024-09-12T20:34:47.615224+0000, chain.objs.size()=1 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.mY5rdCTMwAPiKvZotqRhyIsiI4gnsZ5_0 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18180790812165063134', time=2024-09-12T20:34:50.020972+0000, chain.objs.size()=1 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.roaNyeb2kdTnAl_5aqG85iOfqUET1-e_0 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12146951504679845811', time=2024-09-12T20:34:50.367920+0000, chain.objs.size()=1 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.OkUbnYBmFfenoHGfIA91luV9_1wfyox_0 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6088069683305558328', time=2024-09-12T20:34:50.511143+0000, chain.objs.size()=1 2024-09-12T18:59:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.uYd68smjr9envC6H-WeHSx2gotAAbXH_0 2024-09-12T18:59:59.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13669002655758971349', time=2024-09-12T20:34:50.671310+0000, chain.objs.size()=1 2024-09-12T18:59:59.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Ei-GSR5MK9aSV3TTSEMOSgRO9KY_p5v_0 2024-09-12T18:59:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8545867360326089792', time=2024-09-12T20:34:51.331988+0000, chain.objs.size()=1 2024-09-12T18:59:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.583+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.oU68dQe0fGFw-RQGnsJbwTYEwCWlBQQ_0 2024-09-12T18:59:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15909173487269351850', time=2024-09-12T20:34:52.216087+0000, chain.objs.size()=1 2024-09-12T18:59:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.U6BUZqAODLgav8r2H5zsltu0qVfEECS_0 2024-09-12T18:59:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3088326549942265275', time=2024-09-12T20:34:52.285408+0000, chain.objs.size()=1 2024-09-12T18:59:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.CpCD83GOxmjos1b2ue3bj3BztxKAO-l_0 2024-09-12T18:59:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10745650638297031642', time=2024-09-12T20:34:53.964044+0000, chain.objs.size()=1 2024-09-12T18:59:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.0-UQofUpXXq9yjjmC6RsoBu3SwqiqK5_0 2024-09-12T18:59:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15559240088036953814', time=2024-09-12T20:34:54.573427+0000, chain.objs.size()=1 2024-09-12T18:59:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.jyEJkGhZQv2nzrOM3NCU-1Pd_f5VPlT_0 2024-09-12T18:59:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.668069749253001215', time=2024-09-12T20:34:55.765447+0000, chain.objs.size()=1 2024-09-12T18:59:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XvhsXjcHnEK1EpsuyOlcx6ysSL6KJ2d_0 2024-09-12T18:59:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5722942525092203386', time=2024-09-12T20:34:56.952042+0000, chain.objs.size()=1 2024-09-12T18:59:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.B0Wx7WVlfhlM7KPkZPtbCQfCq3uRNtz_0 2024-09-12T18:59:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13075362261415886260', time=2024-09-12T20:34:58.200166+0000, chain.objs.size()=1 2024-09-12T18:59:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PjqfCjUjeljF56FEFfRhaFhLBsN_jyg_0 2024-09-12T18:59:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8175089988833026285', time=2024-09-12T20:34:58.590965+0000, chain.objs.size()=1 2024-09-12T18:59:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tKT313tVZqXXA3o3LpSgCcr3yhXYObZ_0 2024-09-12T18:59:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12079171874185562070', time=2024-09-12T20:35:00.195458+0000, chain.objs.size()=1 2024-09-12T18:59:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-3KIaks3mU5ytA_wXqNMLQBEyaFOWu6_0 2024-09-12T18:59:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10682745125156210919', time=2024-09-12T20:35:00.554446+0000, chain.objs.size()=1 2024-09-12T18:59:59.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.iFDH_16CJxP0pSABuL42qlNY7AkTDOR_0 2024-09-12T18:59:59.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8692365196195244357', time=2024-09-12T20:35:01.287501+0000, chain.objs.size()=1 2024-09-12T18:59:59.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Zzlqv4WUYuQ4qetl10q-HgU9fx_8May_0 2024-09-12T18:59:59.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11828418575750570316', time=2024-09-12T20:35:21.847722+0000, chain.objs.size()=1 2024-09-12T18:59:59.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.343__shadow_.F67cMeMEkm26TycSxS79v1b_jkEHgKa_0 2024-09-12T18:59:59.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9771931182555686083', time=2024-09-12T20:35:44.424759+0000, chain.objs.size()=1 2024-09-12T18:59:59.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.369__shadow_.53YbCEinWpbTOAWG0ztTy62f1Ha8Q8x_0 2024-09-12T18:59:59.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11074955399434204229', time=2024-09-12T20:37:23.218534+0000, chain.objs.size()=1 2024-09-12T18:59:59.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.456__shadow_.BPpIFSKtK1Jn-BqkM-7Q92yt9mkBKQl_0 2024-09-12T18:59:59.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10823702180073740893', time=2024-09-12T20:38:26.169971+0000, chain.objs.size()=1 2024-09-12T18:59:59.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.503__shadow:RrE07h9QVCnd4UDOAeK8Om93tXQxxPE_.hyGvE7kfORPSZwwerfxAYNUofTKRYRK_0 2024-09-12T18:59:59.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5599883724653792535', time=2024-09-12T20:38:38.520314+0000, chain.objs.size()=6 2024-09-12T18:59:59.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.1 2024-09-12T18:59:59.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.2 2024-09-12T18:59:59.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.3 2024-09-12T18:59:59.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.4 2024-09-12T18:59:59.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.5 2024-09-12T18:59:59.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.6 2024-09-12T18:59:59.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5042130815978102972', time=2024-09-12T20:41:11.525732+0000, chain.objs.size()=3 2024-09-12T18:59:59.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.587+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~vr8b8KwxlLkskcr-Pw6xp9TfLMaXh__.1 2024-09-12T18:59:59.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~vr8b8KwxlLkskcr-Pw6xp9TfLMaXh__.2 2024-09-12T18:59:59.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~vr8b8KwxlLkskcr-Pw6xp9TfLMaXh__.3 2024-09-12T18:59:59.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8937793296954104090', time=2024-09-12T20:41:14.184145+0000, chain.objs.size()=3 2024-09-12T18:59:59.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~fTeNm3C42njzkikhnWr7hZ_cwGN0yvZ.1 2024-09-12T18:59:59.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~fTeNm3C42njzkikhnWr7hZ_cwGN0yvZ.2 2024-09-12T18:59:59.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~fTeNm3C42njzkikhnWr7hZ_cwGN0yvZ.3 2024-09-12T18:59:59.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9738145101244184554', time=2024-09-12T20:42:46.381950+0000, chain.objs.size()=1 2024-09-12T18:59:59.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.550__shadow_.8CAe2ZIAy1qmOsJbfq-5LAuI83DoIO2_0 2024-09-12T18:59:59.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3340220765975492734', time=2024-09-12T20:42:59.027119+0000, chain.objs.size()=1 2024-09-12T18:59:59.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.554__shadow_.b76CVM1Am40BEKVmFNsNxVwmXoKKVZx_0 2024-09-12T18:59:59.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14081825049558739245', time=2024-09-12T20:43:15.977214+0000, chain.objs.size()=1 2024-09-12T18:59:59.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.558__shadow_.ffFPcQbuaRj9TV87PefNDYLHX70C8yx_0 2024-09-12T18:59:59.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11068891180279630447', time=2024-09-12T20:44:01.396418+0000, chain.objs.size()=1 2024-09-12T18:59:59.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:xdEG157cxKvNVg.rpdFKii1Di0IK-xL_.1MzieAsAWmmLUNaKeJdjoGllqCbPeuk_0 2024-09-12T18:59:59.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11498604751778480920', time=2024-09-12T20:46:09.592236+0000, chain.objs.size()=1 2024-09-12T18:59:59.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.604__shadow_.AqhFmw2rXa-YkVTWf_WkxShjqTm6i8U_0 2024-09-12T18:59:59.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9866824614748597915', time=2024-09-12T20:49:48.991779+0000, chain.objs.size()=1 2024-09-12T18:59:59.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.618__shadow_.CXp888Ku3jrqNIsnsD42_pSRJOTKwQb_0 2024-09-12T18:59:59.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.570011865619885914', time=2024-09-12T20:51:11.528145+0000, chain.objs.size()=1 2024-09-12T18:59:59.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.647__shadow_.0spkFwZCvpIf9x7Jb-KNA8aTXl6w1jw_0 2024-09-12T18:59:59.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6295891932959411077', time=2024-09-12T20:53:19.503264+0000, chain.objs.size()=1 2024-09-12T18:59:59.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.718__shadow_.6Vd3n6n2fW5WsHcmpZ9Vp_mRHbWyxYH_0 2024-09-12T18:59:59.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KBuRQ8joaNa34ahonu_GxAVsg7RZdMb', time=2024-09-12T20:53:56.575265+0000, chain.objs.size()=1 2024-09-12T18:59:59.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.591+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.742__multipart_mymultipart.2~KBuRQ8joaNa34ahonu_GxAVsg7RZdMb.1 2024-09-12T18:59:59.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.595+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.595+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:59:59.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48166' 2024-09-12T18:59:59.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7982674835150132368', time=2024-09-12T20:22:22.957674+0000, chain.objs.size()=3 2024-09-12T18:59:59.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__multipart_mymultipart-STANDARD.2~yeKLtZ8JvZHNVheT4mPQQzXC0a2A-TP.1 2024-09-12T18:59:59.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__multipart_mymultipart-STANDARD.2~yeKLtZ8JvZHNVheT4mPQQzXC0a2A-TP.2 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__multipart_mymultipart-STANDARD.2~yeKLtZ8JvZHNVheT4mPQQzXC0a2A-TP.3 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_n4OX90-tMUfyHTOss1VIKE0fbuR2aVy', time=2024-09-12T20:22:28.708253+0000, chain.objs.size()=3 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.5a7FYgpg4JwHDZ1WPg5cahiROLlT_jh_0 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.5a7FYgpg4JwHDZ1WPg5cahiROLlT_jh_1 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.5a7FYgpg4JwHDZ1WPg5cahiROLlT_jh_2 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Yf-spdUFNhrWjV3Vlsvp8C1sniDNwgR', time=2024-09-12T20:22:32.219874+0000, chain.objs.size()=3 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.BmvTXpg89cn3AFyGranr_hmjDyojFQC_0 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.BmvTXpg89cn3AFyGranr_hmjDyojFQC_1 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.BmvTXpg89cn3AFyGranr_hmjDyojFQC_2 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5715265352707287716', time=2024-09-12T20:26:39.972297+0000, chain.objs.size()=1 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.241__shadow_.1Cwx07R_G5ih9W9eW758dcErVSis9OP_0 2024-09-12T18:59:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3004663593776531810', time=2024-09-12T20:26:55.215384+0000, chain.objs.size()=1 2024-09-12T18:59:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.251__shadow_._EMf2jeBjEmGzqkiP8XEn8rHJ9Xq0oH_0 2024-09-12T18:59:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1904641903237377432', time=2024-09-12T20:28:49.648540+0000, chain.objs.size()=1 2024-09-12T18:59:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.599+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.mCObkJaEWuiPd5SL4t4VtnypKt5q3M-_0 2024-09-12T18:59:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7177805366369330510', time=2024-09-12T20:28:50.078208+0000, chain.objs.size()=1 2024-09-12T18:59:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1xibhomUeYBcOdsP6Bs5CS4eq4roGUk_0 2024-09-12T18:59:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3961948213517573644', time=2024-09-12T20:28:50.604178+0000, chain.objs.size()=1 2024-09-12T18:59:59.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rHKPHhW2NYuzleSHnkP9R0UWykd0dzv_0 2024-09-12T18:59:59.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2128622350030678899', time=2024-09-12T20:28:52.300362+0000, chain.objs.size()=1 2024-09-12T18:59:59.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NGHA8mTUR96G3G7CyZ1TzGCWg_hUnXV_0 2024-09-12T18:59:59.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6100911199140174960', time=2024-09-12T20:28:52.301939+0000, chain.objs.size()=1 2024-09-12T18:59:59.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.zc7VfS153soFpaNkxPg077dYkdTAfEb_0 2024-09-12T18:59:59.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15622061146427459406', time=2024-09-12T20:28:52.852802+0000, chain.objs.size()=1 2024-09-12T18:59:59.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.hJa1XxEHKdYaxE7yandWQnY7QIAqvOn_0 2024-09-12T18:59:59.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8581816097001422590', time=2024-09-12T20:28:53.651498+0000, chain.objs.size()=1 2024-09-12T18:59:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OO560mnO0zLQlJvRRmvb2v9lCjVC0SY_0 2024-09-12T18:59:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11556866671001999522', time=2024-09-12T20:28:54.046986+0000, chain.objs.size()=1 2024-09-12T18:59:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tuTX1ksDqQQ3iOmCzp0Z46H20v9XGHl_0 2024-09-12T18:59:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12541121239976307983', time=2024-09-12T20:28:55.369646+0000, chain.objs.size()=1 2024-09-12T18:59:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._bbFgoZadHJkBjQZBwiyYvCx8MzxeWe_0 2024-09-12T18:59:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1085056752026499140', time=2024-09-12T20:28:55.884675+0000, chain.objs.size()=1 2024-09-12T18:59:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.EyhFAu5-tCJS0dgLJPmsG9vwyHr1HZI_0 2024-09-12T18:59:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3639040841197771424', time=2024-09-12T20:28:56.361752+0000, chain.objs.size()=1 2024-09-12T18:59:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FprKcCsapEnLey6oER0jJ5Ia1tm2jok_0 2024-09-12T18:59:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1375843801153780536', time=2024-09-12T20:28:56.588265+0000, chain.objs.size()=1 2024-09-12T18:59:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.PsLOFqgkzlMsOPx8FMe3zex4GTy2vIN_0 2024-09-12T18:59:59.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11371640103285923821', time=2024-09-12T20:28:57.073799+0000, chain.objs.size()=1 2024-09-12T18:59:59.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.nAFNx1AYZsmvZTTSF0O5l1JcGsQsuYM_0 2024-09-12T18:59:59.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17850658498843273861', time=2024-09-12T20:28:57.076352+0000, chain.objs.size()=1 2024-09-12T18:59:59.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rFF-o7STtRl99sIMeatWSiH9YeQk0cC_0 2024-09-12T18:59:59.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18295489494271962096', time=2024-09-12T20:28:57.666990+0000, chain.objs.size()=1 2024-09-12T18:59:59.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.EXIEXVwbKUYK7sKT6D3JhnhpMKY0cQ-_0 2024-09-12T18:59:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13704158210994437726', time=2024-09-12T20:28:58.976897+0000, chain.objs.size()=1 2024-09-12T18:59:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wzjbbvz1y-CcgkMN8EAD0PPICT8K6nU_0 2024-09-12T18:59:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5930813462876343357', time=2024-09-12T20:28:59.072787+0000, chain.objs.size()=1 2024-09-12T18:59:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ypou_y6wlAFNVYSu3iUwGE1Oai5UeAd_0 2024-09-12T18:59:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.828749431152089597', time=2024-09-12T20:28:59.074370+0000, chain.objs.size()=1 2024-09-12T18:59:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FueCSNEvZlF43naj9V442bnVpc0HkCL_0 2024-09-12T18:59:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16150576628861422884', time=2024-09-12T20:28:59.704115+0000, chain.objs.size()=1 2024-09-12T18:59:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.603+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.S74Ykq_HlK5m88EltfR1vbaqyX1_GBP_0 2024-09-12T18:59:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.919931986856983051', time=2024-09-12T20:29:00.331720+0000, chain.objs.size()=1 2024-09-12T18:59:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.X0mHmTwDD-LsayBHY9IdPZLLfCW50GP_0 2024-09-12T18:59:59.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8926837069619793347', time=2024-09-12T20:29:00.333312+0000, chain.objs.size()=1 2024-09-12T18:59:59.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WDD6Wc628YDxUf_i8F7vezTy0q3pymu_0 2024-09-12T18:59:59.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1966188153818887322', time=2024-09-12T20:29:01.282254+0000, chain.objs.size()=1 2024-09-12T18:59:59.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.d9fqQggFupErl9K-Ormnmcz6sDoGIyX_0 2024-09-12T18:59:59.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4342085534455623551', time=2024-09-12T20:29:01.531758+0000, chain.objs.size()=1 2024-09-12T18:59:59.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CY6ULvoZS4qtAzkuyT_H7M_bMf9WPXw_0 2024-09-12T18:59:59.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11575865293975783998', time=2024-09-12T20:29:02.841350+0000, chain.objs.size()=1 2024-09-12T18:59:59.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HriMOvwjE8_sukf4rfRMewnCRyQ5ecx_0 2024-09-12T18:59:59.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15309429911670974200', time=2024-09-12T20:29:03.375669+0000, chain.objs.size()=1 2024-09-12T18:59:59.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tdWQdZXoIoC3VdpSKssRYt9KMOt5xGX_0 2024-09-12T18:59:59.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4403533603463922734', time=2024-09-12T20:29:03.493840+0000, chain.objs.size()=1 2024-09-12T18:59:59.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8R4WC_ZOsXrSA5xtPbqorfNJCEZvX5A_0 2024-09-12T18:59:59.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17248523327152754712', time=2024-09-12T20:29:03.587883+0000, chain.objs.size()=1 2024-09-12T18:59:59.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.mTlyVhUAOBLU7SYWhPyk0-oNiFhsq8l_0 2024-09-12T18:59:59.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16689480374152355412', time=2024-09-12T20:29:04.304671+0000, chain.objs.size()=1 2024-09-12T18:59:59.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.p-R6dsgeOZiTCbB0q0t-kacMHP6ct39_0 2024-09-12T18:59:59.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5650799143612148407', time=2024-09-12T20:29:05.285800+0000, chain.objs.size()=1 2024-09-12T18:59:59.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JbxrQV33ZE58QRBklPfHbLDDLjd4uOU_0 2024-09-12T18:59:59.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13240090748326776647', time=2024-09-12T20:29:06.069103+0000, chain.objs.size()=1 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.zvIY4l6hsuICTETfyU_ww4lo6MKTMOH_0 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8658625704906070663', time=2024-09-12T20:29:07.436277+0000, chain.objs.size()=1 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1_M5MeS0ns-yz1KaS9WQjlmxd5mGb4m_0 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6168749202991772147', time=2024-09-12T20:29:08.667145+0000, chain.objs.size()=1 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.lM6ZYHfJ7qW6NPPEk6fy9hmtreKUW9D_0 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12203485280896207252', time=2024-09-12T20:29:08.755514+0000, chain.objs.size()=1 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8_8lLG54VibHmJqZ-OAE9zUZx-WeRXO_0 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16011584023605914091', time=2024-09-12T20:29:08.835326+0000, chain.objs.size()=1 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.607+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Vzq_n9vjmoitV_dFIaHi1qsF7BJqVmO_0 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12768903275824263001', time=2024-09-12T20:29:09.669951+0000, chain.objs.size()=1 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.TEPvlqz4IOxOBAMOcodBuXoFfyZMXPC_0 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12565020192694084795', time=2024-09-12T20:29:10.384577+0000, chain.objs.size()=1 2024-09-12T18:59:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9H-L-A7cvDd_buiKXrs8rpXdALRU2P4_0 2024-09-12T18:59:59.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10112693118457874335', time=2024-09-12T20:29:10.759251+0000, chain.objs.size()=1 2024-09-12T18:59:59.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7Km0vxMl0aQcG1hWA5yAizrjiH7M9Xb_0 2024-09-12T18:59:59.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1514721077044961417', time=2024-09-12T20:29:13.656170+0000, chain.objs.size()=1 2024-09-12T18:59:59.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.76qnm0Yn5EjfNarbiUxKK-l047TBvAX_0 2024-09-12T18:59:59.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1981452939229826750', time=2024-09-12T20:29:13.658204+0000, chain.objs.size()=1 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.X8HLmf3tOJ8o1azQpHv2c5yersWv5Z2_0 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7064672014522710902', time=2024-09-12T20:29:13.972525+0000, chain.objs.size()=1 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.RLZ0xkfDgBGJ310ELmTuT1Km-bFUSmu_0 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12893599652733209838', time=2024-09-12T20:29:14.044831+0000, chain.objs.size()=1 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.F9B4lPT09mvjcUYBmcPEzvhbHVgoj7x_0 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3741587050170436040', time=2024-09-12T20:29:16.766288+0000, chain.objs.size()=1 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.263__shadow_.a1yXja_2uMdK8Hj2O6hXoq84IGeIRBC_0 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4115524756345351421', time=2024-09-12T20:29:33.535996+0000, chain.objs.size()=1 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.276__shadow_.Bj6P49pLDOs2Rue7-GhVms2441EPkyz_0 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8178179604177443610', time=2024-09-12T20:32:27.304953+0000, chain.objs.size()=1 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nBYkCbtU75Hz7UmG_5uTu_BfvXUz6zZ_0 2024-09-12T18:59:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15012734317844457445', time=2024-09-12T20:32:27.632550+0000, chain.objs.size()=1 2024-09-12T18:59:59.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Raxk02syrSRcdDWVXunJDMgCp-dyFZQ_0 2024-09-12T18:59:59.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7030742651980985213', time=2024-09-12T20:32:29.381138+0000, chain.objs.size()=1 2024-09-12T18:59:59.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.J71UuWaI_Ilmz8u1XI6_x-Srzf3mRhw_0 2024-09-12T18:59:59.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3865893565552144351', time=2024-09-12T20:32:29.462644+0000, chain.objs.size()=1 2024-09-12T18:59:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sCFlhOY5WWQgxqkkJex5_EfUw1Ky3-Y_0 2024-09-12T18:59:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15937877656936057628', time=2024-09-12T20:32:32.113965+0000, chain.objs.size()=1 2024-09-12T18:59:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8aBs4u7B63LrH0MPWgXsaoCOh3QWHv8_0 2024-09-12T18:59:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7371648528396036696', time=2024-09-12T20:32:32.321894+0000, chain.objs.size()=1 2024-09-12T18:59:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yq_MmLEDx-j1nfbUJgrlbr10NFCZNwr_0 2024-09-12T18:59:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18380257081720776925', time=2024-09-12T20:32:32.397633+0000, chain.objs.size()=1 2024-09-12T18:59:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pgTVVDoDgUa-b4FmJDI_ujCkMPHKFpX_0 2024-09-12T18:59:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18431185950474486742', time=2024-09-12T20:32:33.075932+0000, chain.objs.size()=1 2024-09-12T18:59:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zkE89QD-L4-jK0LudtyJow9BozlJQgJ_0 2024-09-12T18:59:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12868844732104822244', time=2024-09-12T20:32:35.560283+0000, chain.objs.size()=1 2024-09-12T18:59:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.611+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.4rdYfW5iRhcEaioSV3M5MKLLpbnRqb2_0 2024-09-12T18:59:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10753472013189882615', time=2024-09-12T20:32:38.198979+0000, chain.objs.size()=1 2024-09-12T18:59:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6fuGSIdt5xAsr28ApdK6AGYU9cdN3ft_0 2024-09-12T18:59:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2825888598461756119', time=2024-09-12T20:32:41.196741+0000, chain.objs.size()=1 2024-09-12T18:59:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Y1_FRGh78zseDQ3NicMLOcnsmqWSoaC_0 2024-09-12T18:59:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.598328523124815136', time=2024-09-12T20:32:41.557091+0000, chain.objs.size()=1 2024-09-12T18:59:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1UQ0o_FSFZEewL8n86mQIsgHypyMvCT_0 2024-09-12T18:59:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17995790550194241832', time=2024-09-12T20:32:41.733340+0000, chain.objs.size()=1 2024-09-12T18:59:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.85nt9V-5lSz2G_9mxA-jBMAApN8usjs_0 2024-09-12T18:59:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13653230437465975745', time=2024-09-12T20:32:42.017757+0000, chain.objs.size()=1 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.b0toPvHJVjSe4P-BrDXt6oWomexFoDn_0 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6669556537206700736', time=2024-09-12T20:32:43.130783+0000, chain.objs.size()=1 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Aw44SgSFQxqdtR8so-KjudyhTOGWU9i_0 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17858344080839963479', time=2024-09-12T20:32:43.924388+0000, chain.objs.size()=1 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.XqlcP41AITaBXPxIyLnHQiK9XmCmio8_0 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5231747727178059410', time=2024-09-12T20:32:44.723841+0000, chain.objs.size()=1 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.AMtSjhQX5EV_8mkSAcOT8S1Ji1s4v9Y_0 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11373245314777132644', time=2024-09-12T20:32:45.366682+0000, chain.objs.size()=1 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Z7quHV2dBYEKu698S5HiJxTCFzwBrk2_0 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8204901010298281829', time=2024-09-12T20:32:46.158893+0000, chain.objs.size()=1 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.C4Rysqr_6ewjqpaaUn7MMbzdsZKvo5u_0 2024-09-12T18:59:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1525085021606800695', time=2024-09-12T20:32:46.728000+0000, chain.objs.size()=1 2024-09-12T18:59:59.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ku2i2fcS3RRkn2ZM71UOKmEJEIFrEh4_0 2024-09-12T18:59:59.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4564100228054145672', time=2024-09-12T20:32:47.059017+0000, chain.objs.size()=1 2024-09-12T18:59:59.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1X5gwycI8v7SN1oFI5NT-WRjcyAJm0w_0 2024-09-12T18:59:59.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3057185096111280423', time=2024-09-12T20:32:48.287722+0000, chain.objs.size()=1 2024-09-12T18:59:59.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.UZk88sVwxRI_TioyVhGtnBIHeBeXvK9_0 2024-09-12T18:59:59.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2224284202983234062', time=2024-09-12T20:32:48.289807+0000, chain.objs.size()=1 2024-09-12T18:59:59.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6Km74G-UAMemzOhQXKhMnBIL_NRiWJU_0 2024-09-12T18:59:59.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16298386806552490685', time=2024-09-12T20:32:48.359356+0000, chain.objs.size()=1 2024-09-12T18:59:59.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.615+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.C4p713sEXgXrB2xNp_2lR1rKiH6Uzh1_0 2024-09-12T18:59:59.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5789664275388284379', time=2024-09-12T20:32:49.217435+0000, chain.objs.size()=1 2024-09-12T18:59:59.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.-SZXn5T4M0ZwmuKzP26hcyDm5XJN_xb_0 2024-09-12T18:59:59.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3405526609092797307', time=2024-09-12T20:32:49.678708+0000, chain.objs.size()=1 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.YnVCz8qxOfVd7nfHQgYjnHJngTI4Aq4_0 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2411844257576676729', time=2024-09-12T20:32:50.357861+0000, chain.objs.size()=1 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.lRAVPjfDAQBkpe2si6msAjyzlGkZ5WC_0 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5519286821457506079', time=2024-09-12T20:32:50.946168+0000, chain.objs.size()=1 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.OzcPC9u4Tinvw_QQzwEL5W3rEqQQUxl_0 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16313672139247764417', time=2024-09-12T20:32:51.561254+0000, chain.objs.size()=1 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ZE9acVOnzay-k56AQdHCNJkdFt4csXU_0 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3419193321304033684', time=2024-09-12T20:32:52.096594+0000, chain.objs.size()=1 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7ohynWB-wJ-w9_jZLkQ8Xmz1kIIcA-__0 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4698000147655102820', time=2024-09-12T20:32:52.371401+0000, chain.objs.size()=1 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.QEkNYdzbmsurIhup5crA74blk0q6yBe_0 2024-09-12T18:59:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8065915120276672761', time=2024-09-12T20:34:34.005185+0000, chain.objs.size()=1 2024-09-12T18:59:59.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kATPK2aCQmqI9sjuEJn5lygYEmxkmVK_0 2024-09-12T18:59:59.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12371667126778277716', time=2024-09-12T20:34:34.164023+0000, chain.objs.size()=1 2024-09-12T18:59:59.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.2X1rRYsfCcpuobuy8aS6mrhAE2OKn6W_0 2024-09-12T18:59:59.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9776580615526736717', time=2024-09-12T20:34:34.454878+0000, chain.objs.size()=1 2024-09-12T18:59:59.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.sRvUukBqY5TE7oGVuPPDR3oxLmf-jhr_0 2024-09-12T18:59:59.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14067943095524582325', time=2024-09-12T20:34:34.575372+0000, chain.objs.size()=1 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wa9XvcFsduFch6qWO1HYHt_CzS0cpGM_0 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4752254405827981638', time=2024-09-12T20:34:34.936187+0000, chain.objs.size()=1 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nADG1jFmVkI8xJ2xmg231fih-_OgI76_0 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.834874360144469689', time=2024-09-12T20:34:35.418435+0000, chain.objs.size()=1 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.usMm_LEhbYV6QtzslZME2ZDrhEo91Uw_0 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14827214126686427154', time=2024-09-12T20:34:35.601144+0000, chain.objs.size()=1 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.R1fGyj9J8kW8FwvuuewlJvh-Y0ii688_0 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14783654755780231244', time=2024-09-12T20:34:35.824140+0000, chain.objs.size()=1 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HiVciHfmRNMDaDZfO6eHguEg1Iscpdc_0 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7900718961454596687', time=2024-09-12T20:34:36.053845+0000, chain.objs.size()=1 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.FTbgtQXTokrwDkG9fmDnvf3-7J88zDO_0 2024-09-12T18:59:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3087172191138694243', time=2024-09-12T20:34:38.490387+0000, chain.objs.size()=1 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.lDlK5PgM-icRBCrjgpiklJtC8t8Q20F_0 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18098295913708307194', time=2024-09-12T20:34:38.749688+0000, chain.objs.size()=1 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Z13EMtA2nOIdmzhNfOASC49v4kMqXxE_0 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13767615075549112540', time=2024-09-12T20:34:39.563389+0000, chain.objs.size()=1 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.8bvVv0GUjhk13QqEYcAHCYYDW5E_tP8_0 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5456183590097461293', time=2024-09-12T20:34:40.259094+0000, chain.objs.size()=1 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.619+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BMzaHBtI4I505Ps316fTf7ABOYLHLYF_0 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8877843289901894489', time=2024-09-12T20:34:41.970581+0000, chain.objs.size()=1 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.S2Rx8oLg-ShXofvl6Jz6G1ri5luLmm5_0 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5217724748936654433', time=2024-09-12T20:34:42.385166+0000, chain.objs.size()=1 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.NfQNsXAFh5Tyj_iwHqdHMtGeFB0CGeZ_0 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5185692458230203438', time=2024-09-12T20:34:43.089760+0000, chain.objs.size()=1 2024-09-12T18:59:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ZxAkJORDIyJzG0aPVeNmp6IbXhyi7Af_0 2024-09-12T18:59:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7601786597728631533', time=2024-09-12T20:34:45.514713+0000, chain.objs.size()=1 2024-09-12T18:59:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.uQLgdwYOv3lpulR9t2uavE809f7Raie_0 2024-09-12T18:59:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12098532009533138631', time=2024-09-12T20:34:46.360525+0000, chain.objs.size()=1 2024-09-12T18:59:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.uuLli03XMo7uEM8AGfXnQgq_kuzBv0R_0 2024-09-12T18:59:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18119175156516412737', time=2024-09-12T20:34:46.726419+0000, chain.objs.size()=1 2024-09-12T18:59:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.84udfSgTpb_IpkdjCsf45pcvteNxF_E_0 2024-09-12T18:59:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11147672569412829437', time=2024-09-12T20:34:47.327620+0000, chain.objs.size()=1 2024-09-12T18:59:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ldW5JzMzmXXKgmatf3o8t8izFMsrGuz_0 2024-09-12T18:59:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11465417286218286753', time=2024-09-12T20:34:47.555744+0000, chain.objs.size()=1 2024-09-12T18:59:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.iwxDrHcxRw6yzjFlgDtYQt2By18yCGy_0 2024-09-12T18:59:59.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.623+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48166 2024-09-12T18:59:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T18:59:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3103220528597452034', time=2024-09-12T20:34:47.678793+0000, chain.objs.size()=1 2024-09-12T18:59:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.q4l2Wm7zin7PJZGyKqtwDVjJOyf8NNU_0 2024-09-12T18:59:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16746379987808421280', time=2024-09-12T20:34:49.256875+0000, chain.objs.size()=1 2024-09-12T18:59:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vNC46PBmcgOBXSj_0gOp69-P7XessxY_0 2024-09-12T18:59:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7885175323109835209', time=2024-09-12T20:34:49.258997+0000, chain.objs.size()=1 2024-09-12T18:59:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PsM2waCCxTEFx-Fl2V8NQp33rfZKHyq_0 2024-09-12T18:59:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7673804024012100350', time=2024-09-12T20:34:49.486850+0000, chain.objs.size()=1 2024-09-12T18:59:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.rgi2MJeV89WXdja-Nm0gV92VqEYViGS_0 2024-09-12T18:59:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8452065878426101165', time=2024-09-12T20:34:50.402617+0000, chain.objs.size()=1 2024-09-12T18:59:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.NAG23XefdQvIAbFTv21wjj3Y3jVgeD-_0 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11578926658951742108', time=2024-09-12T20:34:51.213833+0000, chain.objs.size()=1 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.aqzD9wL9WVnB4S9G6DF7FNKTjPzpsGR_0 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16683890746155426883', time=2024-09-12T20:34:51.349331+0000, chain.objs.size()=1 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.TWwNqIXMbzF1saiydDMK6pWWLQBIlHj_0 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4975144128551135369', time=2024-09-12T20:34:52.235378+0000, chain.objs.size()=1 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RIjeH8gclWxgUr3OQiQOPF7nyz-sIMJ_0 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4032090985722979828', time=2024-09-12T20:34:52.237222+0000, chain.objs.size()=1 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9OupQmW4XPYzPTJD8TbYobKz-jyYO2o_0 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5359691509174741812', time=2024-09-12T20:34:52.304882+0000, chain.objs.size()=1 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.s4xBHI8woRXJ-c77fuKAvP8ZVUZ4AJr_0 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7771377246857963087', time=2024-09-12T20:34:52.854403+0000, chain.objs.size()=1 2024-09-12T18:59:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._p34saduFE6TH5Tw-RB4ZbV3F9iaqc5_0 2024-09-12T18:59:59.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17283329230659447729', time=2024-09-12T20:34:53.357812+0000, chain.objs.size()=1 2024-09-12T18:59:59.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.cRVDYw-kDJ8isl3N2DU8FYwUQaUBSM3_0 2024-09-12T18:59:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8801750068820913557', time=2024-09-12T20:34:53.929316+0000, chain.objs.size()=1 2024-09-12T18:59:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kqUz1RtGtykBYYxFjKcCZSdl_--4vQf_0 2024-09-12T18:59:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14951374191127225871', time=2024-09-12T20:34:56.975340+0000, chain.objs.size()=1 2024-09-12T18:59:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.n8QzwRg8PoQuv6gzlgHn1BNXgY3FiVd_0 2024-09-12T18:59:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18087005084328380909', time=2024-09-12T20:34:57.788514+0000, chain.objs.size()=1 2024-09-12T18:59:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._lx8czvxv7MStDFltMmD6YJFoho3AYc_0 2024-09-12T18:59:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13061777534329444064', time=2024-09-12T20:34:58.278386+0000, chain.objs.size()=1 2024-09-12T18:59:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.fsP0H-uZNLz5Z5ES-Zok2Ex16HLtZFR_0 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4848080740135232977', time=2024-09-12T20:34:59.504372+0000, chain.objs.size()=1 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JWSs3GoQIM53iNz-3q0yYs-wkiVtf0s_0 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15881148101693381183', time=2024-09-12T20:34:59.506310+0000, chain.objs.size()=1 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.yAZ9uCugVcrz9aVPl1hKyZup-o202rI_0 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2622285126333076678', time=2024-09-12T20:35:00.954692+0000, chain.objs.size()=1 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.VXCRJ-O-h2R1KPSliFq4CTMMwN549u6_0 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2099660815319683789', time=2024-09-12T20:35:01.280170+0000, chain.objs.size()=1 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.K1QE0FedVdOD_sxngiMMEnR6elVkM2z_0 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11951911972298189748', time=2024-09-12T20:35:01.378401+0000, chain.objs.size()=1 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.t-SkUgYoMyE3blUODUh6R1ycUM6XKAt_0 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13785985191712784347', time=2024-09-12T20:35:01.380365+0000, chain.objs.size()=1 2024-09-12T18:59:59.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Q9seXXASDnKmZMxhpT7UaG_1qdF_CmE_0 2024-09-12T18:59:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8108656381557760632', time=2024-09-12T20:35:03.596217+0000, chain.objs.size()=1 2024-09-12T18:59:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.627+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.326__shadow_.xPPboobiRhpEQjcBpX7kVKt8czQaCiN_0 2024-09-12T18:59:59.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8308059772300210583', time=2024-09-12T20:37:26.800823+0000, chain.objs.size()=1 2024-09-12T18:59:59.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.458__shadow_.KBYP-k4gVx6K2S3I9ow8EGBeM_3DZAP_0 2024-09-12T18:59:59.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3470267784145955542', time=2024-09-12T20:38:04.360018+0000, chain.objs.size()=4 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.486__shadow_.u61vayJ5cjcohMwa4A1c3JAUonelwoJ_0 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.486__shadow_.u61vayJ5cjcohMwa4A1c3JAUonelwoJ_1 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.486__shadow_.u61vayJ5cjcohMwa4A1c3JAUonelwoJ_2 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.486__shadow_.u61vayJ5cjcohMwa4A1c3JAUonelwoJ_3 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14868033115214407570', time=2024-09-12T20:38:20.149415+0000, chain.objs.size()=1 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.499__shadow_.LwwfRLe7SjXheh9wCfMmX_mpUO17t3P_0 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~c8dcvzc2iSySBCBurijubxw9FnnvMKT', time=2024-09-12T20:39:57.977663+0000, chain.objs.size()=1 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~c8dcvzc2iSySBCBurijubxw9FnnvMKT.2 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2633264430707255359', time=2024-09-12T20:43:09.783504+0000, chain.objs.size()=1 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.557__shadow_.kUyibsrtqXzMxyfNpyPSvx8Cru5JrQR_0 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~N9BX3J0vx_HSw6ff3Hf3mNS-KJJwGcp', time=2024-09-12T20:43:22.035626+0000, chain.objs.size()=1 2024-09-12T18:59:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.561__multipart_mymultipart.2~N9BX3J0vx_HSw6ff3Hf3mNS-KJJwGcp.1 2024-09-12T18:59:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16467344359663241509', time=2024-09-12T20:43:56.303217+0000, chain.objs.size()=1 2024-09-12T18:59:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:c33JOR2LnoGiLvjVfIk7wN.48XsAV0I_.aJJqUXxb3-OekvNxpPkEhWdDYiqgTJ__0 2024-09-12T18:59:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7491097747795313532', time=2024-09-12T20:44:19.367722+0000, chain.objs.size()=1 2024-09-12T18:59:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574__shadow:cTBLS5yeOjD24Gc7yOOPXLvALRIaloB_.FyHtGh9uzy3uebUUrhb3wwMrOZTPdaq_0 2024-09-12T18:59:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10638058215579584688', time=2024-09-12T20:50:47.752685+0000, chain.objs.size()=1 2024-09-12T18:59:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.633__shadow_.3oIpEur_hErtzvKMXCkeEjXrFrdJTyo_0 2024-09-12T18:59:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5793654700600271579', time=2024-09-12T20:51:16.505393+0000, chain.objs.size()=2 2024-09-12T18:59:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.649__shadow_.RhDPRY3d9qzFlSCvH_NoKs0Wmcvs8-l_0 2024-09-12T18:59:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.649__shadow_.RhDPRY3d9qzFlSCvH_NoKs0Wmcvs8-l_1 2024-09-12T18:59:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8798517885216405662', time=2024-09-12T20:51:24.849823+0000, chain.objs.size()=1 2024-09-12T18:59:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.654__shadow_.Jl1oImw9e0usCsI0dnyyQwkCzjtVTP2_0 2024-09-12T18:59:59.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5479114876963565434', time=2024-09-12T20:53:07.692743+0000, chain.objs.size()=1 2024-09-12T18:59:59.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.631+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.716__shadow:iywFoybqgxElhlXvee3ni0b66e84sao_.nkDPYt37cFeuImO0cEbkqWVUQYuvgc5_0 2024-09-12T18:59:59.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.635+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:59:59.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=93, truncated=0, next_marker='' 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1424722165607316556', time=2024-09-12T20:22:35.717547+0000, chain.objs.size()=5 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__multipart_foo-STANDARD.2~NByAMT6i38Huv8JeGySE87cvx2aqMqz.1 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_foo-STANDARD.2~NByAMT6i38Huv8JeGySE87cvx2aqMqz.1_1 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__multipart_foo-STANDARD.2~NByAMT6i38Huv8JeGySE87cvx2aqMqz.2 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_foo-STANDARD.2~NByAMT6i38Huv8JeGySE87cvx2aqMqz.2_1 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__multipart_foo-STANDARD.2~NByAMT6i38Huv8JeGySE87cvx2aqMqz.3 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11018504080792753435', time=2024-09-12T20:26:34.419994+0000, chain.objs.size()=1 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.237__shadow_.Cj_9tmh0zmWlaOPj5GXRFUaW1N2nrSf_0 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10303509956273514012', time=2024-09-12T20:26:45.475984+0000, chain.objs.size()=1 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.244__shadow_.xefVkEkMe_Hh02Zy0XAx_2jpg50ztKQ_0 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2668567746858907660', time=2024-09-12T20:28:48.254263+0000, chain.objs.size()=1 2024-09-12T18:59:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rK_v1WGT_NAGlN5PogKpvh0JtsTx8Hs_0 2024-09-12T18:59:59.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11346135906864431391', time=2024-09-12T20:28:49.366954+0000, chain.objs.size()=1 2024-09-12T18:59:59.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.r4-hqCW7d4d8PMbDzPMuplDcC1WpymT_0 2024-09-12T18:59:59.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16700972475864738669', time=2024-09-12T20:28:52.478688+0000, chain.objs.size()=1 2024-09-12T18:59:59.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.PVEY2CTJQEySy8OzvGe-wOuNtjHI7TK_0 2024-09-12T18:59:59.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15094576103430927048', time=2024-09-12T20:28:52.691068+0000, chain.objs.size()=1 2024-09-12T18:59:59.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.4ptotD3rIsNcktAqilsa21L-wCmjjpj_0 2024-09-12T18:59:59.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6197791741419871223', time=2024-09-12T20:28:52.703151+0000, chain.objs.size()=1 2024-09-12T18:59:59.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.639+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1fkB-n-oC-Ac3b_GRbuVH4u1LzSR1w5_0 2024-09-12T18:59:59.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1001623030796637966', time=2024-09-12T20:28:53.118807+0000, chain.objs.size()=1 2024-09-12T18:59:59.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.t4GOW3D2YdnDFegZilsADkuJNBtIn_M_0 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3892489018623880055', time=2024-09-12T20:28:55.384563+0000, chain.objs.size()=1 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.BlV1AkAfLxzVz-Iz_-_59EinoI6MPAb_0 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16552798503006914050', time=2024-09-12T20:28:55.875214+0000, chain.objs.size()=1 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bx4h-gYQ2DtjksUgp3_CDfD0baE0xk7_0 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16628855693325294548', time=2024-09-12T20:28:56.909407+0000, chain.objs.size()=1 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.msAyEjWASEW_aw7EAPelj9FnKfYhrp__0 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3440300025212620534', time=2024-09-12T20:28:57.320998+0000, chain.objs.size()=1 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.4jOjnRiiwslFl8liFDAtLerTf5f7Nke_0 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14617979154596986590', time=2024-09-12T20:28:59.559590+0000, chain.objs.size()=1 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.eBrTn1SyJfwDdejJzEaWx36tWALvdB5_0 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16193644265113874048', time=2024-09-12T20:28:59.816356+0000, chain.objs.size()=1 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.mdl_NkESYuvfyRKS5ENVCnQu2pz7HdJ_0 2024-09-12T18:59:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5917481803685800846', time=2024-09-12T20:28:59.869944+0000, chain.objs.size()=1 2024-09-12T18:59:59.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.UcEaYs26br5IDhZIMoN3JgAZwbiRt3B_0 2024-09-12T18:59:59.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13111361719904418465', time=2024-09-12T20:29:00.177087+0000, chain.objs.size()=1 2024-09-12T18:59:59.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.F7lbG7KBI0Zg1pYMrpc9lN2dz8itgW7_0 2024-09-12T18:59:59.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14690231470185020447', time=2024-09-12T20:29:01.691948+0000, chain.objs.size()=1 2024-09-12T18:59:59.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.V14Y3twCZ2Vx5VDEo1tfMZ2uyp32BfN_0 2024-09-12T18:59:59.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17597581192597914683', time=2024-09-12T20:29:02.854005+0000, chain.objs.size()=1 2024-09-12T18:59:59.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.643+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.EN6LFgiJzQRz53WvJ7wokuMnJSYKuov_0 2024-09-12T18:59:59.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12114121675255126064', time=2024-09-12T20:29:03.003386+0000, chain.objs.size()=1 2024-09-12T18:59:59.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.jfVUg49xhNzYwZI5UVGF63F_PucqeSh_0 2024-09-12T18:59:59.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14014596272258187693', time=2024-09-12T20:29:03.205756+0000, chain.objs.size()=1 2024-09-12T18:59:59.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.YYIqR7JrSAqt8tqLnVZcZpSC26g7qcs_0 2024-09-12T18:59:59.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15329000678157981907', time=2024-09-12T20:29:03.999786+0000, chain.objs.size()=1 2024-09-12T18:59:59.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.xG0YBIi3H0can7Qd_mgeJ7uOtxK8Krm_0 2024-09-12T18:59:59.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9238892780697359107', time=2024-09-12T20:29:04.882317+0000, chain.objs.size()=1 2024-09-12T18:59:59.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bkPuJStG-VYgqV_X6mTTcutf1TOKkBp_0 2024-09-12T18:59:59.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1339938925027699810', time=2024-09-12T20:29:06.066621+0000, chain.objs.size()=1 2024-09-12T18:59:59.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kqVcdE8Nd5LHUQlygpUHDiS38Al3u6Q_0 2024-09-12T18:59:59.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5981434180347517233', time=2024-09-12T20:29:07.224520+0000, chain.objs.size()=1 2024-09-12T18:59:59.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.436hQPc6doqNi-PtxCIObxKfNx9SUtP_0 2024-09-12T18:59:59.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14006383923432846734', time=2024-09-12T20:29:08.757549+0000, chain.objs.size()=1 2024-09-12T18:59:59.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.t1jvdOHzszpUDIZ2PMj_Zla5s8Amd8-_0 2024-09-12T18:59:59.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4318076670517144940', time=2024-09-12T20:29:10.717484+0000, chain.objs.size()=1 2024-09-12T18:59:59.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8dQ2_2YYOGDvloUfuLXizWOZvvAY1nD_0 2024-09-12T18:59:59.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12861814410478905575', time=2024-09-12T20:29:10.749973+0000, chain.objs.size()=1 2024-09-12T18:59:59.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.q0eWlOEL3Voc9CsmRTmm3rAmxB2A0pg_0 2024-09-12T18:59:59.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5141110670948268816', time=2024-09-12T20:29:11.828989+0000, chain.objs.size()=1 2024-09-12T18:59:59.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wS-eL9J95uZm03LXyLy5oSUSa7GHvrb_0 2024-09-12T18:59:59.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14665914987544151851', time=2024-09-12T20:29:14.380320+0000, chain.objs.size()=1 2024-09-12T18:59:59.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wsh3hQU8GA_G2KeouuxWKe0--5zL1Pr_0 2024-09-12T18:59:59.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15877812264684508337', time=2024-09-12T20:29:15.100620+0000, chain.objs.size()=1 2024-09-12T18:59:59.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OOqmZc-9s86I7r2rhGRwk4zpd9vhImm_0 2024-09-12T18:59:59.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17686765262906124165', time=2024-09-12T20:29:32.187897+0000, chain.objs.size()=1 2024-09-12T18:59:59.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.275__shadow_.9ZUM44YAbiAd3oNtLulIq5v_xIrYzCG_0 2024-09-12T18:59:59.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11887475183959273345', time=2024-09-12T20:29:37.739064+0000, chain.objs.size()=1 2024-09-12T18:59:59.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.279__shadow_.ByV94Hsstm_NXbrKQ1Bweob6SjpjYv1_0 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16617656158484659811', time=2024-09-12T20:29:59.055888+0000, chain.objs.size()=1 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.0-iiYGbb5hRHytu_Rs28r3Q1mmpoOFA_0 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14675550849994856950', time=2024-09-12T20:30:03.635112+0000, chain.objs.size()=1 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.oeB06O1c3RHdqPzkDRJQ8XaZSEZwb3I_0 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17808361121610853796', time=2024-09-12T20:30:09.528167+0000, chain.objs.size()=1 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.297__shadow_.FMD7Ol8Aemw40PgHNrTTU09c_eV5rYO_0 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9240735168581115415', time=2024-09-12T20:32:27.227651+0000, chain.objs.size()=1 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._K-u5G7Sk-fGpl1zHgSYj5fxxrGMoX8_0 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15001438617933520562', time=2024-09-12T20:32:27.914185+0000, chain.objs.size()=1 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pkED-v0qWDbN2OiP59CjshY_M5U01JS_0 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14107918429909549461', time=2024-09-12T20:32:28.940179+0000, chain.objs.size()=1 2024-09-12T18:59:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.SlpbqEzPqEL21C9IF3ymMVC5Qn_ldD5_0 2024-09-12T18:59:59.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10405138864722630166', time=2024-09-12T20:32:29.449187+0000, chain.objs.size()=1 2024-09-12T18:59:59.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.647+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Fej4_hcDiVSzEabZzm4FlpGZZ4Rp3Er_0 2024-09-12T18:59:59.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7290268101069420960', time=2024-09-12T20:32:30.949363+0000, chain.objs.size()=1 2024-09-12T18:59:59.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.bKwg6MHsXiyyGEndAhK02wJL2P7KUjN_0 2024-09-12T18:59:59.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2952122931442724725', time=2024-09-12T20:32:32.500580+0000, chain.objs.size()=1 2024-09-12T18:59:59.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.qUFsf0sHYy1FZnGH1yujUTaKJSwQUfH_0 2024-09-12T18:59:59.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.911596858988242723', time=2024-09-12T20:32:32.683917+0000, chain.objs.size()=1 2024-09-12T18:59:59.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.M-cIfIwDrvIvPYX5ChiL_dMpDMg0fig_0 2024-09-12T18:59:59.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8796657986613955592', time=2024-09-12T20:32:32.857944+0000, chain.objs.size()=1 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.OHApn6sY_k_fnUXabdLIwzCdcPgm-5Z_0 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2041762291827854553', time=2024-09-12T20:32:34.719283+0000, chain.objs.size()=1 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.J1U7VdW_HcIyPR7-2_n51IuvTP_rzk8_0 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4932949251515336994', time=2024-09-12T20:32:35.062810+0000, chain.objs.size()=1 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dB_xORVEEf8jGFREeMDaP--I6Fzom-n_0 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.120412070554950687', time=2024-09-12T20:32:35.927454+0000, chain.objs.size()=1 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.v4CP0M5AhRT911z9GZT_KzLLZzG1dZi_0 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8024346697040570793', time=2024-09-12T20:32:36.273347+0000, chain.objs.size()=1 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ovPUUxa2lNYUyEBn3rOP7SPpYIItDe6_0 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10970152096617787216', time=2024-09-12T20:32:36.880132+0000, chain.objs.size()=1 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wPQtBKhcbYrHfSWBWeVsPjc9DhPm5Yz_0 2024-09-12T18:59:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17028335383339673347', time=2024-09-12T20:32:38.521497+0000, chain.objs.size()=1 2024-09-12T18:59:59.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eDGX8Gde8SJkKYyVNZ7tu5RaMrW1oOd_0 2024-09-12T18:59:59.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2441425408445925894', time=2024-09-12T20:32:39.100266+0000, chain.objs.size()=1 2024-09-12T18:59:59.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.iFdgmDbEIhXb1G79p08Kua26_kkXctC_0 2024-09-12T18:59:59.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16692612737640806961', time=2024-09-12T20:32:39.892960+0000, chain.objs.size()=1 2024-09-12T18:59:59.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.X39mkoJ1BjTG5TrREc9GDrcI2SXMwLo_0 2024-09-12T18:59:59.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14417664948782356237', time=2024-09-12T20:32:39.895219+0000, chain.objs.size()=1 2024-09-12T18:59:59.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.t_Te1BNjB-g0NGRq4tIdsaSScRL23Kn_0 2024-09-12T18:59:59.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4744010160178412270', time=2024-09-12T20:32:39.965795+0000, chain.objs.size()=1 2024-09-12T18:59:59.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.XPXISLoBI8wNylDWYlm3qJCMD41HaZa_0 2024-09-12T18:59:59.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4243439396760869807', time=2024-09-12T20:32:48.297635+0000, chain.objs.size()=1 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0Fe52iRhEvC74hhlaCUCcLTXMpEB4A__0 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16033144191562689580', time=2024-09-12T20:32:48.607606+0000, chain.objs.size()=1 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Vo9SlDOcFOWhKboHj3LZkdfUxyscT1c_0 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8160972202741622264', time=2024-09-12T20:32:49.216060+0000, chain.objs.size()=1 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.xACRJVM9K8y5fLsMvGm4WF6072zSWVq_0 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14593708503910769114', time=2024-09-12T20:32:52.671989+0000, chain.objs.size()=1 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.P9w3LG0e7sgeYrV_7hOKnlKoa7oh7jc_0 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15147855334120563505', time=2024-09-12T20:34:33.998470+0000, chain.objs.size()=1 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1LsIlWkGWxCZMs6MF86R3U91rNVxQUg_0 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17738725861745020549', time=2024-09-12T20:34:34.041570+0000, chain.objs.size()=1 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.651+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PjDDAkwrMcmdaE4f-CBOx3lFf5ENChg_0 2024-09-12T18:59:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11875535850245016055', time=2024-09-12T20:34:34.363016+0000, chain.objs.size()=1 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Y7gntCj811YVU5uAtnW1za7en02t-Xr_0 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2041537712672964366', time=2024-09-12T20:34:35.582270+0000, chain.objs.size()=1 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.pq6SybV7WrugtB3dA5DHgo_RzEFfh7G_0 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4415781427765770733', time=2024-09-12T20:34:37.891521+0000, chain.objs.size()=1 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.s5KZ8j3wDgjj3RLqtRG8NilxP38COHl_0 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6580440542662868160', time=2024-09-12T20:34:38.578650+0000, chain.objs.size()=1 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1Vd6vMZWWzDZwEl2hw2UE1NfeDeVt06_0 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14784935868650540148', time=2024-09-12T20:34:39.080704+0000, chain.objs.size()=1 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wwaRfHCyL0Vs2g1AmBlRX3Y1vwr7PrB_0 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6638473546928065162', time=2024-09-12T20:34:39.082238+0000, chain.objs.size()=1 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.GZSqq99OLW_-xxEvTe1E1hAm-v7qowV_0 2024-09-12T18:59:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10362687017782625811', time=2024-09-12T20:34:39.280456+0000, chain.objs.size()=1 2024-09-12T18:59:59.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MsC8fjRm90Wnrn2fPMArE6QkjjpA9M2_0 2024-09-12T18:59:59.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1168631931258716683', time=2024-09-12T20:34:40.575353+0000, chain.objs.size()=1 2024-09-12T18:59:59.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.H0-vHowUnGt3oi1vIddyx88DoUU6BZg_0 2024-09-12T18:59:59.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13451503290170711371', time=2024-09-12T20:34:41.831105+0000, chain.objs.size()=1 2024-09-12T18:59:59.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-Ggxj7U1Fjfr_d0ZiXj10Y-gcjm_z0E_0 2024-09-12T18:59:59.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4532371664779280632', time=2024-09-12T20:34:42.784387+0000, chain.objs.size()=1 2024-09-12T18:59:59.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.7u-VAxTYdk2l3yNzv9ZSUD1jClb2nx-_0 2024-09-12T18:59:59.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15481610850076860172', time=2024-09-12T20:34:43.145493+0000, chain.objs.size()=1 2024-09-12T18:59:59.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.rj4jZ3qMLP86Pwx1iKZVXSbq_TX0PcH_0 2024-09-12T18:59:59.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17165768082921047064', time=2024-09-12T20:34:44.188941+0000, chain.objs.size()=1 2024-09-12T18:59:59.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bAeEOMsSu986dZzXUU8oT0HBbhPBNfn_0 2024-09-12T18:59:59.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4196428361261351237', time=2024-09-12T20:34:45.081142+0000, chain.objs.size()=1 2024-09-12T18:59:59.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YCZSK1DWM0ieA5Mgmd_5cUJ5hfjohSO_0 2024-09-12T18:59:59.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4674123584777048986', time=2024-09-12T20:34:46.885888+0000, chain.objs.size()=1 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.uR0gHVx4NjYC6Dp57a6Fy8SIJlUAjmO_0 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10912303927716579924', time=2024-09-12T20:34:46.914941+0000, chain.objs.size()=1 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.KzAGvbkdHgJm_Kouj6JjFxW-TVA2Lep_0 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9197405243065802577', time=2024-09-12T20:34:49.600068+0000, chain.objs.size()=1 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6aMGkIk1tp0twYZck1O5K0ZUvZnnzfv_0 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17830572373050021149', time=2024-09-12T20:34:50.021823+0000, chain.objs.size()=1 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.dJhE5dPeoIsXpzMx9qpmRT89Q7dlEa9_0 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7406463434224628689', time=2024-09-12T20:34:51.268948+0000, chain.objs.size()=1 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QR8cOmlhHS6khVGIcrMnayqorGB6-M6_0 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14719109653960933268', time=2024-09-12T20:34:54.298041+0000, chain.objs.size()=1 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.y-Oc2H07iglvuf79d377BO7lRWzasGc_0 2024-09-12T18:59:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3156310407729629316', time=2024-09-12T20:34:55.765747+0000, chain.objs.size()=1 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1uZBryhbK0RUZyCgQ9rUnoS_kwb21hU_0 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16578983304599525735', time=2024-09-12T20:34:58.096166+0000, chain.objs.size()=1 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ul2SlwKtDQqfubnJQHirYEQDQ0q0QpA_0 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10724326768405118361', time=2024-09-12T20:34:59.616720+0000, chain.objs.size()=1 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.655+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.8-X91VW2k8skmxiQtEJr0BTlKqtcA8e_0 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7504743944934722400', time=2024-09-12T20:35:17.464728+0000, chain.objs.size()=1 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.339__shadow_._94FGWL8j-KwMWEsHQLqDB4zZrPw9nS_0 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.461935364087792353', time=2024-09-12T20:35:46.505702+0000, chain.objs.size()=1 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.371__shadow_.6E9PDpTXtkfH8pHgvhXG7p7R-b_5UId_0 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.405036115506820301', time=2024-09-12T20:38:58.026179+0000, chain.objs.size()=1 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.517__shadow_.npFU4hMVyLRqsX8Ld5P_zTrMmMQOgWH_0 2024-09-12T18:59:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8560184290577035474', time=2024-09-12T20:38:58.054890+0000, chain.objs.size()=2 2024-09-12T18:59:59.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.517__shadow_.59eToN5mrZZMi6RkgqZ17peCe1GveSk_0 2024-09-12T18:59:59.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.517__shadow_.59eToN5mrZZMi6RkgqZ17peCe1GveSk_1 2024-09-12T18:59:59.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5783297875002433996', time=2024-09-12T20:41:39.162302+0000, chain.objs.size()=7 2024-09-12T18:59:59.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.527__multipart_mymultipart.2~IIVsrq5RB-tlOa4vMuiWOd-oaXUH2PY.1 2024-09-12T18:59:59.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.527__shadow_mymultipart.2~IIVsrq5RB-tlOa4vMuiWOd-oaXUH2PY.1_1 2024-09-12T18:59:59.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.527__multipart_mymultipart.2~IIVsrq5RB-tlOa4vMuiWOd-oaXUH2PY.2 2024-09-12T18:59:59.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.527__shadow_mymultipart.2~IIVsrq5RB-tlOa4vMuiWOd-oaXUH2PY.2_1 2024-09-12T18:59:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.527__multipart_mymultipart.2~IIVsrq5RB-tlOa4vMuiWOd-oaXUH2PY.3 2024-09-12T18:59:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.527__shadow_mymultipart.2~IIVsrq5RB-tlOa4vMuiWOd-oaXUH2PY.3_1 2024-09-12T18:59:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.527__multipart_mymultipart.2~IIVsrq5RB-tlOa4vMuiWOd-oaXUH2PY.4 2024-09-12T18:59:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6164222527589133158', time=2024-09-12T20:43:47.049375+0000, chain.objs.size()=1 2024-09-12T18:59:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:Zl.enCShb0yJfeR-46rrK7K41OpVG5._._1LkjG-3PIhvkL-5fZuLh6zO7D5NDKN_0 2024-09-12T18:59:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4168637323819831454', time=2024-09-12T20:43:52.722983+0000, chain.objs.size()=1 2024-09-12T18:59:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:j6IN8SKWJmYOgxEXP-JODf-SdHmolpX_.Ko3vByk0IBi-zEt_p6f2TVStvuChyiM_0 2024-09-12T18:59:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1554930903446892982', time=2024-09-12T20:44:32.884082+0000, chain.objs.size()=1 2024-09-12T18:59:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.659+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.576__shadow:nDSO52.USNVeAyDHRQp93YOxCO4mG8d_.NiESYFXV-Fd6YmFeo5b2yD6qspKJsFp_0 2024-09-12T18:59:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.663+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7350741539882078393', time=2024-09-12T20:44:42.689846+0000, chain.objs.size()=1 2024-09-12T18:59:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.663+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:CGwY9un2g2XCKsBqRm.dhoonH.mCYzT_.IGSmxccIHbNp1TjRy2n_Ypz3v_2nL4s_0 2024-09-12T18:59:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.663+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11543826464130453618', time=2024-09-12T20:45:12.906961+0000, chain.objs.size()=1 2024-09-12T18:59:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.663+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:3pxqroBbSivtaDTvPNkIHGj2vCwpEAO_.Je2k9uQsrgI5RFPEaY1Eu1mU8fw2a0s_0 2024-09-12T18:59:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.663+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15287371229401490232', time=2024-09-12T20:59:21.862672+0000, chain.objs.size()=1 2024-09-12T18:59:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.663+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.782__shadow_.pRK__q7AXleBZgte8Is20PNE_qRwYuY_0 2024-09-12T18:59:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.663+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.667+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:59:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.667+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.667+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52951' 2024-09-12T18:59:59.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16204750025052244440', time=2024-09-12T20:26:32.392983+0000, chain.objs.size()=1 2024-09-12T18:59:59.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.236__shadow_.5ayU5zskb_ePqBt4VPu9iR99fGYe-bv_0 2024-09-12T18:59:59.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14284118454068485177', time=2024-09-12T20:26:36.482839+0000, chain.objs.size()=1 2024-09-12T18:59:59.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.238__shadow_.XBAlZLbsuPBFS3Sn1LTsn28EE_PGmX7_0 2024-09-12T18:59:59.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10656598645709199825', time=2024-09-12T20:26:37.528612+0000, chain.objs.size()=1 2024-09-12T18:59:59.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.239__shadow_.KQjwv6-rSF4-l_9rud6Xgy82k4tuarI_0 2024-09-12T18:59:59.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5096735286377373383', time=2024-09-12T20:26:49.648222+0000, chain.objs.size()=1 2024-09-12T18:59:59.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.247__shadow_.gqbMDw_8UZOaSI5-1S8uW7J98AwC-fO_0 2024-09-12T18:59:59.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3473567996269813571', time=2024-09-12T20:28:47.821939+0000, chain.objs.size()=1 2024-09-12T18:59:59.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VCb0RBDSW4ari8fIYdOBXLsh_5Jd_TO_0 2024-09-12T18:59:59.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1011647612304357401', time=2024-09-12T20:28:48.256378+0000, chain.objs.size()=1 2024-09-12T18:59:59.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.mn3Ci0djRKRny1EC9569pTxNCEMiDSH_0 2024-09-12T18:59:59.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12450687594989425549', time=2024-09-12T20:28:48.370795+0000, chain.objs.size()=1 2024-09-12T18:59:59.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8-HoXFQdUOr9cgdeL3gDX8yTtXRy66R_0 2024-09-12T18:59:59.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7865550227008850249', time=2024-09-12T20:28:48.481859+0000, chain.objs.size()=1 2024-09-12T18:59:59.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2vJhJYAESWFsohsqrK5N8qGQ1ciZexZ_0 2024-09-12T18:59:59.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1495757980171170920', time=2024-09-12T20:28:48.994971+0000, chain.objs.size()=1 2024-09-12T18:59:59.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OgIKehBHJ-TSXUdOfJwpz_ihaEoYM-t_0 2024-09-12T18:59:59.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17307938615182118707', time=2024-09-12T20:28:49.802471+0000, chain.objs.size()=1 2024-09-12T18:59:59.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3nPixRoppad620ej-Jw2eRBeweE3JAC_0 2024-09-12T18:59:59.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18405074279862318325', time=2024-09-12T20:28:51.657220+0000, chain.objs.size()=1 2024-09-12T18:59:59.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gtPoUzGu0c1L2j9g54Xk_PslM1HLyjD_0 2024-09-12T18:59:59.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5255212569121746825', time=2024-09-12T20:28:51.660646+0000, chain.objs.size()=1 2024-09-12T18:59:59.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.4xvDhtpC_9eHqDIcciBar0Rj6GlpS2B_0 2024-09-12T18:59:59.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15552029939018087025', time=2024-09-12T20:28:52.456914+0000, chain.objs.size()=1 2024-09-12T18:59:59.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gKCoSmRGutnssY9K7k3SuyPQasBft62_0 2024-09-12T18:59:59.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11380115411394250983', time=2024-09-12T20:28:53.329090+0000, chain.objs.size()=1 2024-09-12T18:59:59.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3QuU6uWzvq3GkyKrKqNtdd7rTMyiTjD_0 2024-09-12T18:59:59.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17123677406902245961', time=2024-09-12T20:28:56.985354+0000, chain.objs.size()=1 2024-09-12T18:59:59.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DHhVoO_m_ghftAbldiFlWaILZ5PMiAa_0 2024-09-12T18:59:59.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11989681321202685434', time=2024-09-12T20:28:58.069097+0000, chain.objs.size()=1 2024-09-12T18:59:59.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rMH3ls7WrD-ppOTbUb2Xd3FrUghRiuw_0 2024-09-12T18:59:59.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5116185904509036646', time=2024-09-12T20:28:58.976463+0000, chain.objs.size()=1 2024-09-12T18:59:59.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.E__iVsvJyDS5fQKiin2ZR7rsTunokEc_0 2024-09-12T18:59:59.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4201611673582553548', time=2024-09-12T20:29:00.386394+0000, chain.objs.size()=1 2024-09-12T18:59:59.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Tk5FngIfAwBfje5XMwYpGgnhEy3Nt0F_0 2024-09-12T18:59:59.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5263484431627141773', time=2024-09-12T20:29:01.698478+0000, chain.objs.size()=1 2024-09-12T18:59:59.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ksiZS3qDIbywR57o_vNrMkDU7bhWPNi_0 2024-09-12T18:59:59.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13741534273108455545', time=2024-09-12T20:29:02.525905+0000, chain.objs.size()=1 2024-09-12T18:59:59.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.0zGLYUiWUACx9Z3j5LuIfrtelrCsfMK_0 2024-09-12T18:59:59.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3328177454584302090', time=2024-09-12T20:29:02.701432+0000, chain.objs.size()=1 2024-09-12T18:59:59.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.QJy5Xu3wnETMtpHNQj7PaPQhnccE2pl_0 2024-09-12T18:59:59.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3322217986206824742', time=2024-09-12T20:29:03.293760+0000, chain.objs.size()=1 2024-09-12T18:59:59.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gvVtF_5s9aXJtznAVQHBY7tCVZYfR7w_0 2024-09-12T18:59:59.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2030667690301837949', time=2024-09-12T20:29:03.639525+0000, chain.objs.size()=1 2024-09-12T18:59:59.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.nw8-Sn85GoNIgfTa91TW_qsHAmRHT4__0 2024-09-12T18:59:59.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5589016594965776309', time=2024-09-12T20:29:05.271443+0000, chain.objs.size()=1 2024-09-12T18:59:59.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.XUU3HbKvMUzFtLKRlussAR9ya3_sChp_0 2024-09-12T18:59:59.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13003104499766686789', time=2024-09-12T20:29:06.442833+0000, chain.objs.size()=1 2024-09-12T18:59:59.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._9_Ftrkx3dDI5Unynj59oYRCLC1ei45_0 2024-09-12T18:59:59.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6766297113996872271', time=2024-09-12T20:29:08.435605+0000, chain.objs.size()=1 2024-09-12T18:59:59.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.671+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.L4mdtlO8Jz7voNqjok9tNYFUq5asmox_0 2024-09-12T18:59:59.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10475512654289301437', time=2024-09-12T20:29:09.882169+0000, chain.objs.size()=1 2024-09-12T18:59:59.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ObnaOWFdM2vXObU4QLKMrKqHKSxNQ8a_0 2024-09-12T18:59:59.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4689521409988552217', time=2024-09-12T20:29:10.547449+0000, chain.objs.size()=1 2024-09-12T18:59:59.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fKvTWGF9vaBKWYMNcOxV6GSOr4rqROF_0 2024-09-12T18:59:59.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3253499127061866956', time=2024-09-12T20:29:11.018308+0000, chain.objs.size()=1 2024-09-12T18:59:59.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.dNuskf4eLixvygmNUPJvN680MEqa1U3_0 2024-09-12T18:59:59.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16640167778664704627', time=2024-09-12T20:29:11.661622+0000, chain.objs.size()=1 2024-09-12T18:59:59.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SEk1I2ZmpwCblDprT3861BtPsoNVqqn_0 2024-09-12T18:59:59.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8463014602393812320', time=2024-09-12T20:29:13.236508+0000, chain.objs.size()=1 2024-09-12T18:59:59.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.siIqHRb8Y-_Ctf4tKokGkfG3TKbBVDU_0 2024-09-12T18:59:59.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5412023857522072926', time=2024-09-12T20:29:13.248387+0000, chain.objs.size()=1 2024-09-12T18:59:59.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.6WxaFo48Cw2as-5l-YUk-UC5KAJOIJG_0 2024-09-12T18:59:59.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11507210453966830595', time=2024-09-12T20:29:13.677313+0000, chain.objs.size()=1 2024-09-12T18:59:59.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5lCpwtNDltfWBrXBWyo74FCmi9TRHRL_0 2024-09-12T18:59:59.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13381092591513754389', time=2024-09-12T20:29:14.054324+0000, chain.objs.size()=1 2024-09-12T18:59:59.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.MzZgp6JSHXZHs9rLUjBYXGbrfQ207tO_0 2024-09-12T18:59:59.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.553372662738938832', time=2024-09-12T20:29:14.482450+0000, chain.objs.size()=1 2024-09-12T18:59:59.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.McdCs2bwn5s1Ko04VWHSEq4JUfm5S78_0 2024-09-12T18:59:59.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10164156972524452318', time=2024-09-12T20:29:14.491053+0000, chain.objs.size()=1 2024-09-12T18:59:59.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.4NpQlkC-giOZ3B3BechRDVZvvPI6eF5_0 2024-09-12T18:59:59.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11265921993193950667', time=2024-09-12T20:29:15.069467+0000, chain.objs.size()=1 2024-09-12T18:59:59.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SASwLsTuefGRQF8D2LUgHjnkQO1FcoC_0 2024-09-12T18:59:59.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6141079933120938370', time=2024-09-12T20:29:15.302400+0000, chain.objs.size()=1 2024-09-12T18:59:59.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.675+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.IQMLJwxj8i0mSniNZ5nfL_dEkNyqj_Y_0 2024-09-12T18:59:59.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17787885606740428606', time=2024-09-12T20:29:15.362617+0000, chain.objs.size()=1 2024-09-12T18:59:59.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ptWencaP0gqu2JeY_oSLVyyqzAR-xaR_0 2024-09-12T18:59:59.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5018311067372033706', time=2024-09-12T20:29:15.465799+0000, chain.objs.size()=1 2024-09-12T18:59:59.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7UhTYToCq7JHKHGXuAc3M6dO7WQkWS-_0 2024-09-12T18:59:59.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1505147539352403284', time=2024-09-12T20:29:39.135961+0000, chain.objs.size()=1 2024-09-12T18:59:59.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.280__shadow_.m07nezW7LuRpy83AW8w3qts6sHJVdZK_0 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1010524746594929614', time=2024-09-12T20:29:47.730516+0000, chain.objs.size()=1 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.286__shadow_.hPQKJW2PUrWoJDoIvZ8BkRT4ygKSVR-_0 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7844866956502100480', time=2024-09-12T20:32:27.577995+0000, chain.objs.size()=1 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.W-LAeatYVCx5KcDg5mQYAKKssZQkl1G_0 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6293032843198638296', time=2024-09-12T20:32:30.634989+0000, chain.objs.size()=1 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gQ2GnaDtXf2Ayc1Vyi095tTqG3VHeaa_0 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9458727976085997080', time=2024-09-12T20:32:31.463489+0000, chain.objs.size()=1 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.CD9PdhyTLBtDKL4zsix0eYkOGiDeAm0_0 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5968959176267747270', time=2024-09-12T20:32:32.208766+0000, chain.objs.size()=1 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3nGGQdHv83n0gqGoAx-9mWCmxqvdczn_0 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1008325089798293155', time=2024-09-12T20:32:32.685584+0000, chain.objs.size()=1 2024-09-12T18:59:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.npteuCBepTlgWyvnMjY3m0f0B7dQn2b_0 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18260618920936627437', time=2024-09-12T20:32:34.353071+0000, chain.objs.size()=1 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.GjzIEQlAK-E5lRgaNEF-BTdu7kbFj-A_0 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17886351536934652049', time=2024-09-12T20:32:34.359909+0000, chain.objs.size()=1 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eMPR1VW7LysCkF_RVXvNIhlV0wWuCWE_0 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1405118039848255141', time=2024-09-12T20:32:34.788039+0000, chain.objs.size()=1 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IrLq4jRK0hJ_UqZqW45lkdxdVHu9jOh_0 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5839026183928837403', time=2024-09-12T20:32:35.052229+0000, chain.objs.size()=1 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.68qV6qraCrCOs8vSpwPIMwNk3h-ILbG_0 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.113177710615976776', time=2024-09-12T20:32:35.287556+0000, chain.objs.size()=1 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.q6HmMmu-RVTk5GYJ92yWM_JTi97MoYz_0 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5391696279662870806', time=2024-09-12T20:32:35.682173+0000, chain.objs.size()=1 2024-09-12T18:59:59.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IwtrGvpOxAW_6pDgcNdMbIDwGY-37hG_0 2024-09-12T18:59:59.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.840265533329535582', time=2024-09-12T20:32:38.811649+0000, chain.objs.size()=1 2024-09-12T18:59:59.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gDLHDQ4cdUc83zEMePDC4fWfAdcTl9F_0 2024-09-12T18:59:59.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11572702721598460098', time=2024-09-12T20:32:39.157085+0000, chain.objs.size()=1 2024-09-12T18:59:59.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.j6d6uPmoF7KbgdcW4qDDN-yt7uu0ES8_0 2024-09-12T18:59:59.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6966733020809674587', time=2024-09-12T20:32:41.377361+0000, chain.objs.size()=1 2024-09-12T18:59:59.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.RA4uRJvTfb6MDG3N-G4hKxZnxOS_-mG_0 2024-09-12T18:59:59.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7485280074577763674', time=2024-09-12T20:32:41.868081+0000, chain.objs.size()=1 2024-09-12T18:59:59.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._wqF9fOsn4HNqy0FVp-KYA4XUy6Agam_0 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10510781301193623700', time=2024-09-12T20:32:42.163528+0000, chain.objs.size()=1 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.fJbZ7RA4E0LDuLBLu3RqRy0AIVLZQTd_0 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15872641326260916212', time=2024-09-12T20:32:42.165704+0000, chain.objs.size()=1 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.XlaodsOp8MBa73l1j4MY9Ey0EpwEGgm_0 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.835097393099033716', time=2024-09-12T20:32:42.627114+0000, chain.objs.size()=1 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.679+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.O__Tcnl_jXtiVUJo5h_n96943tUnxCv_0 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12345339866448115370', time=2024-09-12T20:32:42.909822+0000, chain.objs.size()=1 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sCCq6XAX6yBIJs_Sdd4FdSOiQ_gXArE_0 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4077540537135530367', time=2024-09-12T20:32:43.583948+0000, chain.objs.size()=1 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Lrs3vc3dmqqRNBn8vh1viLeJVFT_eob_0 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7571084129497781194', time=2024-09-12T20:32:45.361933+0000, chain.objs.size()=1 2024-09-12T18:59:59.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.o4IW6PR2gqBP-7I0DDMNrdP6sqfbSuk_0 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15579735237504020783', time=2024-09-12T20:32:45.871808+0000, chain.objs.size()=1 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pYowaKGzNSZpHJFRVjLi8scnx--G008_0 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4974706899606388216', time=2024-09-12T20:32:46.179937+0000, chain.objs.size()=1 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dUhUu1ng1mZSVEWJA-58PY00VLd7Yq5_0 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18431548667596016154', time=2024-09-12T20:32:47.002065+0000, chain.objs.size()=1 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kdl4gpYmfy19UmyX-25dumZBUE0-dHV_0 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15221702911830207436', time=2024-09-12T20:32:48.297043+0000, chain.objs.size()=1 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7cUsyPysj2e08r-_4jisK0ubmU4P3C4_0 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10224826890448555627', time=2024-09-12T20:32:48.655945+0000, chain.objs.size()=1 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.5320cxTVfxaHpZScpB_ZSFKHj3BfKAI_0 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5861326064859217325', time=2024-09-12T20:32:49.006010+0000, chain.objs.size()=1 2024-09-12T18:59:59.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Vv17-SkLLevx-3-XUe2QK72OfEd9JtK_0 2024-09-12T18:59:59.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16731823310606902678', time=2024-09-12T20:32:49.787806+0000, chain.objs.size()=1 2024-09-12T18:59:59.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hDRLhDI1xrxAEGAE0QcqYOWN3pZW5Pp_0 2024-09-12T18:59:59.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1398370992859610055', time=2024-09-12T20:32:50.952786+0000, chain.objs.size()=1 2024-09-12T18:59:59.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.683+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.v-TVNQW18MQjL6_4Joh5xAqAovPiZ1M_0 2024-09-12T18:59:59.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8238713185887787761', time=2024-09-12T20:32:51.547680+0000, chain.objs.size()=1 2024-09-12T18:59:59.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.EMJCQi150OekDVCHP_LifM3JnaEOnpL_0 2024-09-12T18:59:59.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2167293857433028944', time=2024-09-12T20:32:52.428773+0000, chain.objs.size()=1 2024-09-12T18:59:59.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wj_pevPMqpV74BaVqWEBid76c5dM3HA_0 2024-09-12T18:59:59.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17651291448103506382', time=2024-09-12T20:34:33.992234+0000, chain.objs.size()=1 2024-09-12T18:59:59.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.GVZX4gtq-Qe3589VNo4gYYOCq8RDx3K_0 2024-09-12T18:59:59.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5889843438494002998', time=2024-09-12T20:34:34.138858+0000, chain.objs.size()=1 2024-09-12T18:59:59.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.yyn2UHiLijSDW3YB_yo8vfFGH7F2lor_0 2024-09-12T18:59:59.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6525754237463818472', time=2024-09-12T20:34:34.927806+0000, chain.objs.size()=1 2024-09-12T18:59:59.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.aYY0uFjKZmd4aezR6GGO58Xvt2hEwwW_0 2024-09-12T18:59:59.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7076162084699665621', time=2024-09-12T20:34:35.340945+0000, chain.objs.size()=1 2024-09-12T18:59:59.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ihDcGPQZnmzOPG3P_-cfMEcfmMv5j5O_0 2024-09-12T18:59:59.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5212914798896743861', time=2024-09-12T20:34:35.976998+0000, chain.objs.size()=1 2024-09-12T18:59:59.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.WApedVx2XOAU4YF4288N0f9L3QjUnGH_0 2024-09-12T18:59:59.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11660467603347217782', time=2024-09-12T20:34:36.603073+0000, chain.objs.size()=1 2024-09-12T18:59:59.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.r2NYpDUAe1kM3xjrnEiwJFq-Qs5N6w5_0 2024-09-12T18:59:59.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1773382818631153770', time=2024-09-12T20:34:36.660376+0000, chain.objs.size()=1 2024-09-12T18:59:59.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bH242GJN_sJIEH0oILi2L-rjySCLTKW_0 2024-09-12T18:59:59.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5591499715379724215', time=2024-09-12T20:34:36.663793+0000, chain.objs.size()=1 2024-09-12T18:59:59.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.IvH_wzAgMRvxR--cly98DKn4qSLwC0Z_0 2024-09-12T18:59:59.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2614770270622417366', time=2024-09-12T20:34:38.617531+0000, chain.objs.size()=1 2024-09-12T18:59:59.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PwMhbfysDjfvEbxXooWP0L5j0tLSOjF_0 2024-09-12T18:59:59.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8307523449094543392', time=2024-09-12T20:34:38.641565+0000, chain.objs.size()=1 2024-09-12T18:59:59.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.F3u4TucUA3uBJdXNSOVPfMEKscEYYol_0 2024-09-12T18:59:59.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17533777526047567640', time=2024-09-12T20:34:38.672702+0000, chain.objs.size()=1 2024-09-12T18:59:59.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.O-sR6nzVcG2YXybDkvxgy1Wfjl9LkFC_0 2024-09-12T18:59:59.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17838173083681307754', time=2024-09-12T20:34:40.385034+0000, chain.objs.size()=1 2024-09-12T18:59:59.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PUYLH7eyQSVDemHwdxcV7KczDs6FUTe_0 2024-09-12T18:59:59.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12210681913547239665', time=2024-09-12T20:34:40.695141+0000, chain.objs.size()=1 2024-09-12T18:59:59.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Uo3ICoTzDSwWrrjtLSviQBzB8PngCjr_0 2024-09-12T18:59:59.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12043992524645076453', time=2024-09-12T20:34:41.503354+0000, chain.objs.size()=1 2024-09-12T18:59:59.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Ba3HJmHC__s_ftPpkOs-j8F7HiLcCvB_0 2024-09-12T18:59:59.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10293057723673050998', time=2024-09-12T20:34:42.583569+0000, chain.objs.size()=1 2024-09-12T18:59:59.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.C-dY2Y7aTsmu1n1sMzQ2ppYD50ik3wk_0 2024-09-12T18:59:59.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7961283480056466756', time=2024-09-12T20:34:43.141925+0000, chain.objs.size()=1 2024-09-12T18:59:59.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.aHXCEgIxDFoUz3hFntKCSSNAU2rdcYM_0 2024-09-12T18:59:59.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1275834859671468962', time=2024-09-12T20:34:43.288004+0000, chain.objs.size()=1 2024-09-12T18:59:59.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Irr1aLauFCwkrtijSaXe4_LjObvsmJO_0 2024-09-12T18:59:59.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4462059774765683439', time=2024-09-12T20:34:43.952635+0000, chain.objs.size()=1 2024-09-12T18:59:59.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RteGeLKviQ5M44W_vShiUrrZxyeHuyj_0 2024-09-12T18:59:59.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1261461164541065937', time=2024-09-12T20:34:46.423247+0000, chain.objs.size()=1 2024-09-12T18:59:59.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4KLZ4ZOucQCh1-0chApgm6uhuCgE4Rx_0 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14567632421676107813', time=2024-09-12T20:34:47.625743+0000, chain.objs.size()=1 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.687+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3l56frkvkqyQ8hLINgtieEHngRXBBPu_0 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8789951222438807880', time=2024-09-12T20:34:48.787435+0000, chain.objs.size()=1 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ai9b1ZOs1s3N8yFf2u4Fyl5CPDiWpg6_0 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1070067624068724504', time=2024-09-12T20:34:49.914042+0000, chain.objs.size()=1 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.EW45MP2vgP_e552wmq4htea2fcz7eNr_0 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12914092839384862765', time=2024-09-12T20:34:51.033321+0000, chain.objs.size()=1 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ds_wAHbb6e_rw5kF4cpPWnODWoPL4Bg_0 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17375645024500956960', time=2024-09-12T20:34:53.182135+0000, chain.objs.size()=1 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.OGVDT0EyUciJx5OTZdSsruhejmZy_58_0 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8213165298569579046', time=2024-09-12T20:34:56.304310+0000, chain.objs.size()=1 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.glDnNLAX0aH6AxMyilV8JjXAcLZoHDO_0 2024-09-12T18:59:59.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7109165913201106046', time=2024-09-12T20:34:58.551167+0000, chain.objs.size()=1 2024-09-12T18:59:59.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.zeSXfurFkqFQADhXgNEgLDzQAAMBlmd_0 2024-09-12T18:59:59.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9123694538445031054', time=2024-09-12T20:34:58.738722+0000, chain.objs.size()=1 2024-09-12T18:59:59.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.gdivLg4Vtrm7E-Bpi5nZo5ep-WBpLUs_0 2024-09-12T18:59:59.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.691+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52951 2024-09-12T18:59:59.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:59:59.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5355332712472515645', time=2024-09-12T20:34:58.792159+0000, chain.objs.size()=1 2024-09-12T18:59:59.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MkqscD8sGSyH0Mb8pCTBUKsf_m0A8eV_0 2024-09-12T18:59:59.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18355568924733972648', time=2024-09-12T20:34:59.462803+0000, chain.objs.size()=1 2024-09-12T18:59:59.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.blFl_WDcZnM5r7h24kfutW-xDfhAVlK_0 2024-09-12T18:59:59.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12394617726115955686', time=2024-09-12T20:34:59.925533+0000, chain.objs.size()=1 2024-09-12T18:59:59.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YxKFsFM2VGq0mVqBVpGc3m6iX3_ZD5m_0 2024-09-12T18:59:59.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10362945289072123115', time=2024-09-12T20:35:01.082186+0000, chain.objs.size()=1 2024-09-12T18:59:59.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.2VC-rfpHYtN8pz4B9NzRuQXPt44wgCd_0 2024-09-12T18:59:59.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5489883322563248145', time=2024-09-12T20:35:04.604933+0000, chain.objs.size()=1 2024-09-12T18:59:59.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.327__shadow_.atR8x6p2IZ5RB4PS6wLs3_QIicCW9Hf_0 2024-09-12T18:59:59.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2779638576992818483', time=2024-09-12T20:38:38.487914+0000, chain.objs.size()=6 2024-09-12T18:59:59.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.1 2024-09-12T18:59:59.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.2 2024-09-12T18:59:59.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.3 2024-09-12T18:59:59.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.4 2024-09-12T18:59:59.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.5 2024-09-12T18:59:59.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.6 2024-09-12T18:59:59.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8544045996471785160', time=2024-09-12T20:41:20.547209+0000, chain.objs.size()=2 2024-09-12T18:59:59.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~4EjaKy77rsrERq01RLfpkTDJUtGS6fJ.1 2024-09-12T18:59:59.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__shadow_mymultipart.2~4EjaKy77rsrERq01RLfpkTDJUtGS6fJ.1_1 2024-09-12T18:59:59.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~afmBJBjAohtwtBXauVIKeMKoQtP2Pbf', time=2024-09-12T20:41:55.344527+0000, chain.objs.size()=1 2024-09-12T18:59:59.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.695+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.534__multipart_mymultipart.2~afmBJBjAohtwtBXauVIKeMKoQtP2Pbf.1 2024-09-12T18:59:59.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.402646868780174384', time=2024-09-12T20:42:21.566027+0000, chain.objs.size()=1 2024-09-12T18:59:59.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.537__shadow_.ul_3bIEx3DSTvkZaMogBqFWCumLBwdF_0 2024-09-12T18:59:59.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5082733491080436798', time=2024-09-12T20:42:49.016579+0000, chain.objs.size()=1 2024-09-12T18:59:59.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.551__shadow_.6CAtDU_b9myQCOCt-g8gx64zycsEG0K_0 2024-09-12T18:59:59.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17546967609123228867', time=2024-09-12T20:44:53.625781+0000, chain.objs.size()=1 2024-09-12T18:59:59.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:Y9YVa20DQkBc0WeNyZEqKgCHxcCgY6C_.rNB-yomUslAlkh_K-JpUsVN0INUA1Bm_0 2024-09-12T18:59:59.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4677835440525273932', time=2024-09-12T20:45:02.476031+0000, chain.objs.size()=1 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:C6SdXqv7sW4NdbhTjCcExcQg.lt2vst_.MDfg2n_3PUSFr_G9Ti8bI8NRFeqRFHd_0 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8928025906543137294', time=2024-09-12T20:50:40.732940+0000, chain.objs.size()=1 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.627__shadow_.xLy6tcHKzhCVaFnqDXXG8bwqHFXS7kH_0 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.212414322887820559', time=2024-09-12T20:51:27.414339+0000, chain.objs.size()=2 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.655__shadow_.Q2qghoVT9zH4RtyBw6gt5fG9LdwxenN_0 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.655__shadow_.Q2qghoVT9zH4RtyBw6gt5fG9LdwxenN_1 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17267116222865920286', time=2024-09-12T20:52:29.196892+0000, chain.objs.size()=1 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.694__shadow:10tb51yaB2uQ-JWKABKB5ljAm5Pj72R_.UKNSxzSaJCkXwAJEp8xk4JIwdnTCL2M_0 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9188087408252199960', time=2024-09-12T20:53:53.131141+0000, chain.objs.size()=1 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.740__shadow_.0VgVVi_i9MHxR1SpBZMc0BhCWX4oQdu_0 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7598148873696044147', time=2024-09-12T20:54:28.775447+0000, chain.objs.size()=1 2024-09-12T18:59:59.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.699+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.745__shadow_.YI2a4gIeUObvus8g3oXCpe3JKgPm5zA_0 2024-09-12T18:59:59.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.703+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.703+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:59:59.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46586' 2024-09-12T18:59:59.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6210367742445962582', time=2024-09-12T20:22:16.374174+0000, chain.objs.size()=3 2024-09-12T18:59:59.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.158__shadow_.C3_OgAZwMhOMEZr26rFV-NOzF0EHz0N_0 2024-09-12T18:59:59.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.158__shadow_.C3_OgAZwMhOMEZr26rFV-NOzF0EHz0N_1 2024-09-12T18:59:59.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.158__shadow_.C3_OgAZwMhOMEZr26rFV-NOzF0EHz0N_2 2024-09-12T18:59:59.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12724514993365646850', time=2024-09-12T20:26:46.847518+0000, chain.objs.size()=1 2024-09-12T18:59:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.245__shadow_.r-6DTf5upAdP8kM-H6X3C6QDArNUi-l_0 2024-09-12T18:59:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8317241945215179478', time=2024-09-12T20:26:48.283838+0000, chain.objs.size()=1 2024-09-12T18:59:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.246__shadow_.WYMy57xGaclPKj11VMwRYNLP0KOkZrK_0 2024-09-12T18:59:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10241963076474371393', time=2024-09-12T20:26:51.057984+0000, chain.objs.size()=1 2024-09-12T18:59:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.248__shadow_.4xwbeqYhzxLhgZJL-AChY7KIjSyvxXu_0 2024-09-12T18:59:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16381762996245215989', time=2024-09-12T20:27:06.107925+0000, chain.objs.size()=1 2024-09-12T18:59:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.259__shadow_.Btvj4fxAIZdq95kbgIH50xv7B2CkH1W_0 2024-09-12T18:59:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15557315315593319067', time=2024-09-12T20:28:49.176121+0000, chain.objs.size()=1 2024-09-12T18:59:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OCywNVkuKQVI7DcAwN1_XdnY_OsxFQ0_0 2024-09-12T18:59:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7285612590672088336', time=2024-09-12T20:28:49.574755+0000, chain.objs.size()=1 2024-09-12T18:59:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VFmzTHd7Zj8YY_GMiYtkR6Ggq9sZnNY_0 2024-09-12T18:59:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18384512566471210168', time=2024-09-12T20:28:50.128270+0000, chain.objs.size()=1 2024-09-12T18:59:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VSMgbXVXfP0RcbseIQX1LeAIKYokypw_0 2024-09-12T18:59:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9777432430171471397', time=2024-09-12T20:28:50.375756+0000, chain.objs.size()=1 2024-09-12T18:59:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.uyGSrMHNLccNuS-H83ejC_F6kQETTqs_0 2024-09-12T18:59:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1165121882570578312', time=2024-09-12T20:28:53.002100+0000, chain.objs.size()=1 2024-09-12T18:59:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.707+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ezR5C_SFL_v7VsQCr4heotFExJKdIzE_0 2024-09-12T18:59:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6537592632214266597', time=2024-09-12T20:28:56.090410+0000, chain.objs.size()=1 2024-09-12T18:59:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2NyjqNo0MeOP2OY55EF4ReajOx-UwN8_0 2024-09-12T18:59:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14438394890916451055', time=2024-09-12T20:28:56.110221+0000, chain.objs.size()=1 2024-09-12T18:59:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.KdIvMVM8V3iedgdL4Sln2RhBQYgo2D5_0 2024-09-12T18:59:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15618174181344796387', time=2024-09-12T20:28:56.331080+0000, chain.objs.size()=1 2024-09-12T18:59:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.dQ2EUoYGSDqMniWG5T-cFN1sjWLVHab_0 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4965713090398653310', time=2024-09-12T20:28:56.472011+0000, chain.objs.size()=1 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.W9FZ-FvSVbHiYl1nyMxBS0g__8YKfCX_0 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13822395398317977762', time=2024-09-12T20:28:57.604841+0000, chain.objs.size()=1 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2O-EuDfMQqcrDHQkZYoxSnJV_IC6ODa_0 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14900329301514042276', time=2024-09-12T20:28:57.824743+0000, chain.objs.size()=1 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.BnaUJkSM0V4TK0ANISAmEcCqAF-Vg5A_0 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.891574486040938222', time=2024-09-12T20:28:58.046238+0000, chain.objs.size()=1 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.oM430jLUsOoUXEnkX6ZmzMigMFjQvjm_0 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5959605123859004808', time=2024-09-12T20:29:00.678099+0000, chain.objs.size()=1 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tgG2cOHVql7cdFfVbAvdpaTQ_2hUgpT_0 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614347837114950632', time=2024-09-12T20:29:00.834472+0000, chain.objs.size()=1 2024-09-12T18:59:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HgCmRRIx4w4baykm7s8Eeq1q2sMo2pB_0 2024-09-12T18:59:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13042769473091168653', time=2024-09-12T20:29:01.266225+0000, chain.objs.size()=1 2024-09-12T18:59:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.C90pdQ9gJSJD4oU7JuaS5_lpA_DgtF2_0 2024-09-12T18:59:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4279c5640 0 -- 172.21.15.157:0/1674604574 >> [v2:172.21.15.157:6808/3345787243,v1:172.21.15.157:6809/3345787243] conn(0x7fe2f00815e0 msgr2=0x7fe2f0083a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:59:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2795768324046265857', time=2024-09-12T20:29:01.316067+0000, chain.objs.size()=1 2024-09-12T18:59:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2KCW6sDNOwKNRFHX0SVN35uKtMIEaDK_0 2024-09-12T18:59:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15716171017982534257', time=2024-09-12T20:29:03.718608+0000, chain.objs.size()=1 2024-09-12T18:59:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.e5Zshsc-6gHS2gPSHk88P8pRJWA5y8P_0 2024-09-12T18:59:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.778276826787159131', time=2024-09-12T20:29:04.751028+0000, chain.objs.size()=1 2024-09-12T18:59:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.711+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vfnzsHF0lkIA7uYNFvSgyO9drCyrP3h_0 2024-09-12T18:59:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1885956495352180265', time=2024-09-12T20:29:06.068671+0000, chain.objs.size()=1 2024-09-12T18:59:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VRirUuNSuTDT_NI4Ghx66YVCujk4Hpx_0 2024-09-12T18:59:59.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.356230933573721615', time=2024-09-12T20:29:10.535356+0000, chain.objs.size()=1 2024-09-12T18:59:59.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8275yhDfe9Yv_pE01g46mVsLo1_v5Bc_0 2024-09-12T18:59:59.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1186738628574288539', time=2024-09-12T20:29:10.819716+0000, chain.objs.size()=1 2024-09-12T18:59:59.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9Fg8Hh-Y4pUUGe9DLLm96rTl1NfnxiE_0 2024-09-12T18:59:59.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9111081478003622274', time=2024-09-12T20:29:11.652848+0000, chain.objs.size()=1 2024-09-12T18:59:59.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2-6ZqHd-S-FZ3lJpkSTjx8i3ycVB68C_0 2024-09-12T18:59:59.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7617796555059293308', time=2024-09-12T20:29:12.161391+0000, chain.objs.size()=1 2024-09-12T18:59:59.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3D6Hd_1BzF8IOEj92q7bzQij20qHZV2_0 2024-09-12T18:59:59.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8022454371181280423', time=2024-09-12T20:29:12.290917+0000, chain.objs.size()=1 2024-09-12T18:59:59.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.EHS8BvZq7kCojPTx75cOFKnUJ0d-KMG_0 2024-09-12T18:59:59.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11468799998867064489', time=2024-09-12T20:29:13.261034+0000, chain.objs.size()=1 2024-09-12T18:59:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9ZOfuC-hbeQjqzexnDkaB7L0PAm7xqo_0 2024-09-12T18:59:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18017049861927553833', time=2024-09-12T20:29:13.263360+0000, chain.objs.size()=1 2024-09-12T18:59:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.yjPeWzlEzueVRC-xPulGHeofUVNtQFU_0 2024-09-12T18:59:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3446885438432170122', time=2024-09-12T20:29:14.013348+0000, chain.objs.size()=1 2024-09-12T18:59:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.j5uWOvrq0cV1mdbMu6IUdyML8CnAtOb_0 2024-09-12T18:59:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9818137244690350809', time=2024-09-12T20:29:14.146801+0000, chain.objs.size()=1 2024-09-12T18:59:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.uW2h9Z1ml7imj_cv1y90ShYANuuVeA6_0 2024-09-12T18:59:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17502096224962689030', time=2024-09-12T20:29:14.478188+0000, chain.objs.size()=1 2024-09-12T18:59:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Y1MviH_IoA8IASZueyniQNccAXzAh1z_0 2024-09-12T18:59:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14121932375764049120', time=2024-09-12T20:29:14.724388+0000, chain.objs.size()=1 2024-09-12T18:59:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kUxp9msd_UYO1MlJx74WgXGwvZLTFsx_0 2024-09-12T18:59:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.93430664406767305', time=2024-09-12T20:29:14.726244+0000, chain.objs.size()=1 2024-09-12T18:59:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.C2sYp-U1A6KZ8twejDiJC64rQXMoKYa_0 2024-09-12T18:59:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8754560646901248830', time=2024-09-12T20:29:15.268129+0000, chain.objs.size()=1 2024-09-12T18:59:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.QsxNhNEelQu56mK8cPb0O5GIdEouty-_0 2024-09-12T18:59:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16294867545087408944', time=2024-09-12T20:29:15.402657+0000, chain.objs.size()=1 2024-09-12T18:59:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.v7nyfdLrs3M1TMkf6EUyuD_CGVe3_Jb_0 2024-09-12T18:59:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3160009503030162536', time=2024-09-12T20:29:25.694484+0000, chain.objs.size()=1 2024-09-12T18:59:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.270__shadow_.WmpyJlhd7vRusvi5VTRwX3ckug3zlZY_0 2024-09-12T18:59:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10634112559309541179', time=2024-09-12T20:29:28.198488+0000, chain.objs.size()=1 2024-09-12T18:59:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.272__shadow_.UTIsrHCLhWYUcmervktOnXXY471PXe8_0 2024-09-12T18:59:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10604160487867032142', time=2024-09-12T20:29:46.262779+0000, chain.objs.size()=1 2024-09-12T18:59:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.285__shadow_.GNayjpJ54Vrhfpl-2KUeV9BEyVx9XiM_0 2024-09-12T18:59:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4721438635473214213', time=2024-09-12T20:29:59.071177+0000, chain.objs.size()=1 2024-09-12T18:59:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.ZFiq8xRrJV6Vxo0HWRnDYxDvCjp3ieH_0 2024-09-12T18:59:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14177136086837258716', time=2024-09-12T20:29:59.072949+0000, chain.objs.size()=1 2024-09-12T18:59:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.xEAQ1Mhz_Kv5pohHcWaesqsXaBVqA-J_0 2024-09-12T18:59:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10902267367451316849', time=2024-09-12T20:30:03.691189+0000, chain.objs.size()=1 2024-09-12T18:59:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.YCh5r-uctddoHoPaG5_5OIy_balQtSM_0 2024-09-12T18:59:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.715+0000 7fe4269c3640 0 -- 172.21.15.157:0/1674604574 >> [v2:172.21.15.157:6800/2182114182,v1:172.21.15.157:6801/2182114182] conn(0x56001ec87d30 msgr2=0x56001ec8a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16946366637526422384', time=2024-09-12T20:30:08.096391+0000, chain.objs.size()=1 2024-09-12T18:59:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.296__shadow_.5A8YhMVn_T4IXvJxL_bzyhYfkcP2tTj_0 2024-09-12T18:59:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4115195282530834449', time=2024-09-12T20:30:10.978708+0000, chain.objs.size()=1 2024-09-12T18:59:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.298__shadow_.Y-tU0JikgLSAAmr4sV4hyMXkSetqmnj_0 2024-09-12T18:59:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5180561650147593330', time=2024-09-12T20:30:24.999121+0000, chain.objs.size()=1 2024-09-12T18:59:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.307__shadow:5lW9mclDJEY1aFsqOVpbRU0RQWCgC57_.xIVcFNOPpuN_CzN2E8YbPU6aWWZjnqK_0 2024-09-12T18:59:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14628780141271033610', time=2024-09-12T20:32:26.940086+0000, chain.objs.size()=1 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Qd7to2zQvA26OKJVY7y_ZQYLTDmWM5N_0 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15170755074204996270', time=2024-09-12T20:32:27.714692+0000, chain.objs.size()=1 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.DZjOKeJTXdSd5tVrNPxsELQEHoncZzS_0 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3407926236836616220', time=2024-09-12T20:32:27.799113+0000, chain.objs.size()=1 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nwa4hA6mNkAKNEnvvd6DmDTCCCe7SgB_0 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11009820974098075828', time=2024-09-12T20:32:29.483183+0000, chain.objs.size()=1 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Lb2fNTAIg2r4gJKuoT-AqTfxXlfUyvy_0 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15379679522023933940', time=2024-09-12T20:32:31.061235+0000, chain.objs.size()=1 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.SC8HD8eA31cw4WJkvwe1D1Dh4y54hEo_0 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18077050781920486352', time=2024-09-12T20:32:31.452648+0000, chain.objs.size()=1 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.LfhbAdvyNs-K2Rxm_Ff4yMcwOJCr1ps_0 2024-09-12T18:59:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1202381608142538956', time=2024-09-12T20:32:31.454911+0000, chain.objs.size()=1 2024-09-12T18:59:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.stGZzcsQA3h-CGoZkwshGSJVKTcYLYn_0 2024-09-12T18:59:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14650114793762738210', time=2024-09-12T20:32:31.697811+0000, chain.objs.size()=1 2024-09-12T18:59:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.M_QsmfdwJOR0Hz32UItyDAWc1vTvf24_0 2024-09-12T18:59:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16580534010381720159', time=2024-09-12T20:32:31.864260+0000, chain.objs.size()=1 2024-09-12T18:59:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.vppPWMo1DzkLkhpnZmP-mASztw36VRj_0 2024-09-12T18:59:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11054337851031318072', time=2024-09-12T20:32:33.135558+0000, chain.objs.size()=1 2024-09-12T18:59:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rxUlKvA3oKPreWWbLR_DicyQa9k_sPI_0 2024-09-12T18:59:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4271c4640 0 -- 172.21.15.157:0/1674604574 >> [v2:172.21.15.157:6816/2202738069,v1:172.21.15.157:6817/2202738069] conn(0x56001ec8caf0 msgr2=0x7fe2f0086370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:59:59.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11770948562351665859', time=2024-09-12T20:32:35.180071+0000, chain.objs.size()=1 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.DZO4MpoR2Tx0H-nZsitpeQegovUcNFc_0 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11921258447750180538', time=2024-09-12T20:32:35.682514+0000, chain.objs.size()=1 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.719+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.XIqMQEFYBjVFH9-gqvD8hy3G_EDAHz-_0 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18197910447404887629', time=2024-09-12T20:32:36.294346+0000, chain.objs.size()=1 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.xCItX9O79-mBSab0lhzTVQxbW4vJv9__0 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13683034859662322414', time=2024-09-12T20:32:36.396172+0000, chain.objs.size()=1 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.22cL6WVREp8O_eRcSczyL_5sQzF3BF7_0 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8024031617921590280', time=2024-09-12T20:32:36.944308+0000, chain.objs.size()=1 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3HsMkL38ihxq_EIxlaBSN-vlMWiLjHi_0 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2013604487078934194', time=2024-09-12T20:32:37.909544+0000, chain.objs.size()=1 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.S0OUtb_ju1Ezh-nQYB87wMkH9cW2tOL_0 2024-09-12T18:59:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15784151220724144098', time=2024-09-12T20:32:38.194621+0000, chain.objs.size()=1 2024-09-12T18:59:59.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sdwQm_akwX3wBczl_oPRUIHvGoTDsJY_0 2024-09-12T18:59:59.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.781951943097617347', time=2024-09-12T20:32:39.521347+0000, chain.objs.size()=1 2024-09-12T18:59:59.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gaGBryuC6fyQNgwYZPs197xvw9w5spe_0 2024-09-12T18:59:59.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12509478948237158118', time=2024-09-12T20:32:39.586011+0000, chain.objs.size()=1 2024-09-12T18:59:59.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dsexkbqrz3bMf15YixzjXr5Iz4MO1EL_0 2024-09-12T18:59:59.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5114678011295873230', time=2024-09-12T20:32:39.894569+0000, chain.objs.size()=1 2024-09-12T18:59:59.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.iqiXvUfO_vWxZ8ggdpU49A85U0fP2v7_0 2024-09-12T18:59:59.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12503197301104202639', time=2024-09-12T20:32:40.440669+0000, chain.objs.size()=1 2024-09-12T18:59:59.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.mFmc_raZIIZLQYKlulKSEims8Ctk96q_0 2024-09-12T18:59:59.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17889306572720680770', time=2024-09-12T20:32:41.199450+0000, chain.objs.size()=1 2024-09-12T18:59:59.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.JsweX0F3cTT8qSC6qwBsYKV4-tUHOjc_0 2024-09-12T18:59:59.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13197747921394769290', time=2024-09-12T20:32:41.379038+0000, chain.objs.size()=1 2024-09-12T18:59:59.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.RhbChKeWR6xv7p7D3NqOjI8OVt9flkT_0 2024-09-12T18:59:59.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12124986101240055157', time=2024-09-12T20:32:41.625365+0000, chain.objs.size()=1 2024-09-12T18:59:59.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dcv5Hdgi6IxKvt6qRDmM1A3yGMJwa9f_0 2024-09-12T18:59:59.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17485981108829827945', time=2024-09-12T20:32:41.668888+0000, chain.objs.size()=1 2024-09-12T18:59:59.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.bDFYt3r-sOPXygh0ivSF8-Iungd-1NV_0 2024-09-12T18:59:59.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5503715838989459746', time=2024-09-12T20:32:42.775079+0000, chain.objs.size()=1 2024-09-12T18:59:59.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.R72NMTtg-CX1viHMgYZB54mzeSoEBVw_0 2024-09-12T18:59:59.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1851417590576825544', time=2024-09-12T20:32:43.359445+0000, chain.objs.size()=1 2024-09-12T18:59:59.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.YIbiw22X5et4bzMdzAnQoEJyYGeeuno_0 2024-09-12T18:59:59.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4139131588871490743', time=2024-09-12T20:32:44.647878+0000, chain.objs.size()=1 2024-09-12T18:59:59.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Gy90hkiVgT3oIZ0xF7yVTKIeJ9NIhO6_0 2024-09-12T18:59:59.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9399719796160026460', time=2024-09-12T20:32:45.133523+0000, chain.objs.size()=1 2024-09-12T18:59:59.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uYGbVOcSLOKAtcBjFdlA-EzmTdoxku1_0 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7016610043841437780', time=2024-09-12T20:32:45.616953+0000, chain.objs.size()=1 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BzlnMatzNsy-RQGbsDlj7NQbNIxksi6_0 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16886165561901251647', time=2024-09-12T20:32:46.865170+0000, chain.objs.size()=1 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.mzn-p5OetE4Dfs1MXKLnzY-1Xv9AIt6_0 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5883718006986500098', time=2024-09-12T20:32:47.339059+0000, chain.objs.size()=1 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0sCyZr-_m6T3N--L2YTXmICsn5-W6pT_0 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6155751432876694782', time=2024-09-12T20:32:48.659873+0000, chain.objs.size()=1 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.GH5MC_xUjpLFviuGYT23XEjcyYQf9gE_0 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3207611182759306932', time=2024-09-12T20:32:48.956987+0000, chain.objs.size()=1 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hcIioj2mfE7LWtsH0fLJDsZ8Gsd-uBc_0 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6337443957882070743', time=2024-09-12T20:32:49.016214+0000, chain.objs.size()=1 2024-09-12T18:59:59.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.723+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zzU58EVAaHWTOlIk7Q-LDbP70ECdS-c_0 2024-09-12T18:59:59.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15951389495709607745', time=2024-09-12T20:32:50.135565+0000, chain.objs.size()=1 2024-09-12T18:59:59.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ETbXqg0XLn4YSlR3yfAfUPLELt8uMNl_0 2024-09-12T18:59:59.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.237328257334750991', time=2024-09-12T20:32:50.960524+0000, chain.objs.size()=1 2024-09-12T18:59:59.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.182lpMkmMFrjHJiYED6bk9EbMlPxiKy_0 2024-09-12T18:59:59.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3550269801799204691', time=2024-09-12T20:32:51.010879+0000, chain.objs.size()=1 2024-09-12T18:59:59.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.-wqnpSeXQ0Z00yiAq2JO5DcsG3JlJ7g_0 2024-09-12T18:59:59.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18414743149394986034', time=2024-09-12T20:32:51.639453+0000, chain.objs.size()=1 2024-09-12T18:59:59.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.FK1xQAtzVnYcs01cdFOYA64oN26TX5d_0 2024-09-12T18:59:59.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15672530441494191799', time=2024-09-12T20:32:52.377453+0000, chain.objs.size()=1 2024-09-12T18:59:59.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.bumtvldBoK4I_PcQjIUs0ykopIn1Ecd_0 2024-09-12T18:59:59.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16237127004613921912', time=2024-09-12T20:32:53.115730+0000, chain.objs.size()=1 2024-09-12T18:59:59.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HS_d3bGL3RZor7CLn1SB4Mw10qIl9Mu_0 2024-09-12T18:59:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8653154934616714325', time=2024-09-12T20:32:53.445228+0000, chain.objs.size()=1 2024-09-12T18:59:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jfjbR-Pz4UyFVynJP9EReucgmFUBqhc_0 2024-09-12T18:59:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12494495874083160489', time=2024-09-12T20:32:53.719980+0000, chain.objs.size()=1 2024-09-12T18:59:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wvOWcpqD9kwqT5-yWQMrUm8QOqXgomI_0 2024-09-12T18:59:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.860105323640808764', time=2024-09-12T20:34:35.315111+0000, chain.objs.size()=1 2024-09-12T18:59:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.X75vcpdyFMlXBiq9R4LMj3niA4c7SaD_0 2024-09-12T18:59:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4113789367671682644', time=2024-09-12T20:34:36.151155+0000, chain.objs.size()=1 2024-09-12T18:59:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RUjuqpVkj2hfpiYr0Q4yxhN6N9OGGKY_0 2024-09-12T18:59:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5646793219889391906', time=2024-09-12T20:34:36.253839+0000, chain.objs.size()=1 2024-09-12T18:59:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BOsjtFyJR14CRppa37_gfcQm7IUniyg_0 2024-09-12T18:59:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10282047256919798834', time=2024-09-12T20:34:36.680245+0000, chain.objs.size()=1 2024-09-12T18:59:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.l9p7BpnhJlP8rcoltSBBNF4SoApUVZO_0 2024-09-12T18:59:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8605148998664761332', time=2024-09-12T20:34:37.965152+0000, chain.objs.size()=1 2024-09-12T18:59:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UymVLf0N_u3AgscjxouFvcnCsZeVgEp_0 2024-09-12T18:59:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.229665713722937963', time=2024-09-12T20:34:39.078543+0000, chain.objs.size()=1 2024-09-12T18:59:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vFeQvsOmtIp__nmN3zZqQh7ai5R5BXJ_0 2024-09-12T18:59:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18171731012415907991', time=2024-09-12T20:34:39.495523+0000, chain.objs.size()=1 2024-09-12T18:59:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HbS8Polg4sgx81DRc3iPlGCXWGrA0_4_0 2024-09-12T18:59:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13534162556164656284', time=2024-09-12T20:34:41.891958+0000, chain.objs.size()=1 2024-09-12T18:59:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.727+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.GuLib6njG1t7YcnUlw056urEONJkZIE_0 2024-09-12T18:59:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.731+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15784313820868443446', time=2024-09-12T20:34:42.021730+0000, chain.objs.size()=1 2024-09-12T18:59:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.731+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.gJI5wXbFZuBgzQ0dt6SbYXa3CFTGomI_0 2024-09-12T18:59:59.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.731+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10230022864432428826', time=2024-09-12T20:34:43.894506+0000, chain.objs.size()=1 2024-09-12T18:59:59.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.731+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.CiYHpG5TBx4GW3NihD2GAEFeFYGMrZl_0 2024-09-12T18:59:59.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.731+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46586 2024-09-12T18:59:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-12T18:59:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8707788123539542705', time=2024-09-12T20:34:45.406098+0000, chain.objs.size()=1 2024-09-12T18:59:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.xolToo3wLJkXBwXzp3tY5FCH6mLZjsT_0 2024-09-12T18:59:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17420801004011563781', time=2024-09-12T20:34:46.484635+0000, chain.objs.size()=1 2024-09-12T18:59:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.U0Jprg-ZOh43hoHeJqRDJ6WMS6oeYj1_0 2024-09-12T18:59:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16597445643022651174', time=2024-09-12T20:34:47.225733+0000, chain.objs.size()=1 2024-09-12T18:59:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.aX1FQQKX16XkPzvYBDAntJD35g_OuJa_0 2024-09-12T18:59:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7082380722021829627', time=2024-09-12T20:34:49.268458+0000, chain.objs.size()=1 2024-09-12T18:59:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.AEorTH4xk6D5GTBQnn0zD_fxMg_OSVN_0 2024-09-12T18:59:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5496847230590155336', time=2024-09-12T20:34:50.430254+0000, chain.objs.size()=1 2024-09-12T18:59:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.aHJ2a9j9ljKwNRLN7bo3hl2WVZeDiSU_0 2024-09-12T18:59:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3379442690628983009', time=2024-09-12T20:34:50.577825+0000, chain.objs.size()=1 2024-09-12T18:59:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.L2Tt2DYTJ2OPsVz8fEPT6Qk3m1n29Ai_0 2024-09-12T18:59:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9350682175220379607', time=2024-09-12T20:34:51.050263+0000, chain.objs.size()=1 2024-09-12T18:59:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HSZ9lE9iRqtTCHdALNiIpEPkoP1sJMC_0 2024-09-12T18:59:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15349506618814825201', time=2024-09-12T20:34:51.242880+0000, chain.objs.size()=1 2024-09-12T18:59:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.mL8SCe7IHdLIg2hy2fcH__G28rWw1sz_0 2024-09-12T18:59:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3315873857548189228', time=2024-09-12T20:34:52.681967+0000, chain.objs.size()=1 2024-09-12T18:59:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.r2iNH3VazyTxyfsHlsOMShKlHrZFN4q_0 2024-09-12T18:59:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8543242025989642867', time=2024-09-12T20:34:55.865134+0000, chain.objs.size()=1 2024-09-12T18:59:59.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.xVCvjKxtJEFDUU-blSuKb9Omqv8mDZq_0 2024-09-12T18:59:59.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7690971353089485522', time=2024-09-12T20:34:56.071927+0000, chain.objs.size()=1 2024-09-12T18:59:59.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.aOvMccVXQxBnV6XYiJT6DiRAisnAE2__0 2024-09-12T18:59:59.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2770837274020708209', time=2024-09-12T20:34:57.087580+0000, chain.objs.size()=1 2024-09-12T18:59:59.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.CBIUZkFxM4DV1YAnAMbzk6LCQbFsOW2_0 2024-09-12T18:59:59.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.610125730964075174', time=2024-09-12T20:34:57.995858+0000, chain.objs.size()=1 2024-09-12T18:59:59.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YmJY1lTjYjCyTtMCc8sQ5oox9eP2RRK_0 2024-09-12T18:59:59.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13602623704517734999', time=2024-09-12T20:34:58.710635+0000, chain.objs.size()=1 2024-09-12T18:59:59.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.pzjFj_bHoI5mxPgxZeJ49HC-J4QgYU3_0 2024-09-12T18:59:59.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18070405625238334304', time=2024-09-12T20:34:59.799776+0000, chain.objs.size()=1 2024-09-12T18:59:59.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BtceRCMJF9ppYJ7tWqpayVA-7dWiu9l_0 2024-09-12T18:59:59.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5375004102240749120', time=2024-09-12T20:35:00.243191+0000, chain.objs.size()=1 2024-09-12T18:59:59.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kIfxesFal7gBECpnhNPI-IKbYK9xWFA_0 2024-09-12T18:59:59.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1749944622873103985', time=2024-09-12T20:35:00.385431+0000, chain.objs.size()=1 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.s0j3xnUDqpsGCqGpHCR1gHGROQQlt2u_0 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14889800321542373142', time=2024-09-12T20:35:01.457687+0000, chain.objs.size()=1 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.TjvRb2sPj2M_AdMUS3sw7UEsybPC4c5_0 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6954029434634170045', time=2024-09-12T20:35:01.547641+0000, chain.objs.size()=1 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.VScH1xSQliaA91yZ1FdZVR3KUSPhYvb_0 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5816729013144045973', time=2024-09-12T20:37:37.054536+0000, chain.objs.size()=1 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.464__shadow_._BP2Bmbcc2CMM_V9li7UihnIJFyYdX7_0 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3964937705948353944', time=2024-09-12T20:37:37.589979+0000, chain.objs.size()=1 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.464__shadow_.BkrnRfXSxCNSRSrFVkb4abaiAEymlHy_0 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2622331011975255929', time=2024-09-12T20:37:58.437273+0000, chain.objs.size()=1 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.484__shadow_.YN-9iNFaiuZI31wR57o-dYp5yYuKw5O_0 2024-09-12T18:59:59.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12913581107206882877', time=2024-09-12T20:38:15.497957+0000, chain.objs.size()=1 2024-09-12T18:59:59.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.735+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.496__shadow_.y7d2ohbd2KOzz4wjTFsl3P_yo8DTgZP_0 2024-09-12T18:59:59.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4116868466706381628', time=2024-09-12T20:38:17.833354+0000, chain.objs.size()=1 2024-09-12T18:59:59.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.497__shadow_.aWDAUbQvPQrlPEiuRlT6sIY8nobQ36e_0 2024-09-12T18:59:59.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14617907361509342347', time=2024-09-12T20:40:33.333270+0000, chain.objs.size()=6 2024-09-12T18:59:59.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~901PsBCcJUXXZkNS8iXucYc7-HWZ9RE.1 2024-09-12T18:59:59.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~901PsBCcJUXXZkNS8iXucYc7-HWZ9RE.2 2024-09-12T18:59:59.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.smDK-sKgDlvl7sokp6_PwZLvXYd7UDbI.3 2024-09-12T18:59:59.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~901PsBCcJUXXZkNS8iXucYc7-HWZ9RE.4 2024-09-12T18:59:59.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~901PsBCcJUXXZkNS8iXucYc7-HWZ9RE.5 2024-09-12T18:59:59.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~901PsBCcJUXXZkNS8iXucYc7-HWZ9RE.6 2024-09-12T18:59:59.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2110585459364815455', time=2024-09-12T20:42:48.591501+0000, chain.objs.size()=1 2024-09-12T18:59:59.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.551__shadow_.qtQq2M_TIwR8gIsDdlGKpXg8nfbCeKI_0 2024-09-12T18:59:59.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12987125124989976187', time=2024-09-12T20:43:10.358799+0000, chain.objs.size()=1 2024-09-12T18:59:59.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.557__shadow_.TgsVVBOu-szzz9jr5haLWlBhOntgHzv_0 2024-09-12T18:59:59.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4352616859497770555', time=2024-09-12T20:43:54.196743+0000, chain.objs.size()=1 2024-09-12T18:59:59.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:PijVy-3B0G23H.tADtC4.8gom5wdKql_.f7eQbnFVl64arwRZroDjsgpB9JD1U3Q_0 2024-09-12T18:59:59.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17768107492642165584', time=2024-09-12T20:44:13.200072+0000, chain.objs.size()=1 2024-09-12T18:59:59.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574__shadow_.CKn2PalV04jOTLweI6-ZSktbljcM3C5_0 2024-09-12T18:59:59.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15104261255312029403', time=2024-09-12T20:44:53.167120+0000, chain.objs.size()=1 2024-09-12T18:59:59.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:mefGFXK4jbx2v28ueCdDpwmuFXN1jj7_.GhMzIMWvRIyvAhmr04U0d2NtJvBY2tZ_0 2024-09-12T18:59:59.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14836003094415935396', time=2024-09-12T20:45:11.666058+0000, chain.objs.size()=1 2024-09-12T18:59:59.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.739+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:Rqhpam9PDnsOTSxVk4LcLYqXvXXmKxc_.zLbClyoHZUih1I8HBcPvvR_MsutbMiS_0 2024-09-12T18:59:59.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2033097823289608533', time=2024-09-12T20:45:39.214317+0000, chain.objs.size()=1 2024-09-12T18:59:59.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.580__shadow:gSyCbv7JlZ4b7cjM3iKnyLb1.eZeLDX_.glXCm9i6SyKWFOrIBwQdyquP5XrF40I_0 2024-09-12T18:59:59.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16501136544171030464', time=2024-09-12T20:46:10.644770+0000, chain.objs.size()=1 2024-09-12T18:59:59.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.605__shadow_.l9at_TN447lZH1Am7Bj-ybSnyku5tk3_0 2024-09-12T18:59:59.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4393296350691324997', time=2024-09-12T20:51:22.667133+0000, chain.objs.size()=1 2024-09-12T18:59:59.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.653__shadow_.khRZx83PvH8rh7t2PZ1UcceKOkaf9b3_0 2024-09-12T18:59:59.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8939039066261957520', time=2024-09-12T20:51:29.739132+0000, chain.objs.size()=1 2024-09-12T18:59:59.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.656__shadow_.j_cbw36AwPLj0vMX3hIf25uBak9Xeaq_0 2024-09-12T18:59:59.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13216399536212838049', time=2024-09-12T20:52:03.661585+0000, chain.objs.size()=1 2024-09-12T18:59:59.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.668__shadow_.rbP5OINoNx35oRLpU4AtKoKxOd9YJv__0 2024-09-12T18:59:59.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.283794265809283167', time=2024-09-12T20:52:37.046667+0000, chain.objs.size()=1 2024-09-12T18:59:59.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.700__shadow:TaA9GQH.Tggw6uBX.Cxu4sRNSJXgFUR_.BOVCWUo2EJHY8WyKJdsLlYc5j5SgqGy_0 2024-09-12T18:59:59.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9665569878898002193', time=2024-09-12T20:52:44.292499+0000, chain.objs.size()=1 2024-09-12T18:59:59.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.705__shadow:gaE4NLy-qgxCrGX4jRMJ8hlxHneXn1w_.s2EoaLZzSMcUcCanLiz8G_8FiBFh418_0 2024-09-12T18:59:59.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.743+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.747+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:59:59.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.747+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.747+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45986' 2024-09-12T18:59:59.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14817083881713901954', time=2024-09-12T20:26:43.417882+0000, chain.objs.size()=1 2024-09-12T18:59:59.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.243__shadow_.5rc8hqA80XgO0IHk_4oTcutikFIxqZ8_0 2024-09-12T18:59:59.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1329120318112419119', time=2024-09-12T20:26:58.083143+0000, chain.objs.size()=1 2024-09-12T18:59:59.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.253__shadow_.nXGpTEcbavoBjlFOFoCgcCQfYeiwjfJ_0 2024-09-12T18:59:59.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9748214402301337261', time=2024-09-12T20:28:48.863571+0000, chain.objs.size()=1 2024-09-12T18:59:59.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.z_LBs2zZzDG8v_9TPKD0D_-8DnfFqZB_0 2024-09-12T18:59:59.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8831843430760743629', time=2024-09-12T20:28:49.999200+0000, chain.objs.size()=1 2024-09-12T18:59:59.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Jn1jljKikANLqehqgnG0LY4Kko-Z-rm_0 2024-09-12T18:59:59.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12323133464064970891', time=2024-09-12T20:28:50.106518+0000, chain.objs.size()=1 2024-09-12T18:59:59.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OyRNg3ctVv73yd21XcjT-AhLTxUx_Y2_0 2024-09-12T18:59:59.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17918474589600248636', time=2024-09-12T20:28:50.442625+0000, chain.objs.size()=1 2024-09-12T18:59:59.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Mm90uho9_CoYOV_9xWFmhpZzaN-sXez_0 2024-09-12T18:59:59.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3154141947672090394', time=2024-09-12T20:28:52.004098+0000, chain.objs.size()=1 2024-09-12T18:59:59.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tdoXD5beueZU3E4N_LYREom0SOQDME6_0 2024-09-12T18:59:59.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14448618745433739331', time=2024-09-12T20:28:52.877027+0000, chain.objs.size()=1 2024-09-12T18:59:59.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._AmbUCMcSyzl96CddXd7uAmQDtbhdLU_0 2024-09-12T18:59:59.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17080989667774948209', time=2024-09-12T20:28:52.966972+0000, chain.objs.size()=1 2024-09-12T18:59:59.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.R4H8TAobfAfdl-1PAb1nw-WWRv5tJ2t_0 2024-09-12T18:59:59.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.950264831604847130', time=2024-09-12T20:28:52.968989+0000, chain.objs.size()=1 2024-09-12T18:59:59.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1h2jkyKfg_vGNnu5s49315AX_zqANoo_0 2024-09-12T18:59:59.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4918445916077570459', time=2024-09-12T20:28:53.334066+0000, chain.objs.size()=1 2024-09-12T18:59:59.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ip1lrngw9w4biZpxTq7QLdrVwl8YPbV_0 2024-09-12T18:59:59.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.378580649399597049', time=2024-09-12T20:28:53.672310+0000, chain.objs.size()=1 2024-09-12T18:59:59.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.LiqTX_mhvR63MYKJftsnztR-BrP_BJE_0 2024-09-12T18:59:59.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2977539724595780055', time=2024-09-12T20:28:53.770136+0000, chain.objs.size()=1 2024-09-12T18:59:59.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.W83EDw-uqMm5mBfvpSlqaN3VDXUZBjc_0 2024-09-12T18:59:59.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.162624651584483594', time=2024-09-12T20:28:55.397451+0000, chain.objs.size()=1 2024-09-12T18:59:59.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.YfSjQwBGwkePX3Z1tD6Ps2l2Au0JbmK_0 2024-09-12T18:59:59.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8305940685425569778', time=2024-09-12T20:28:55.451746+0000, chain.objs.size()=1 2024-09-12T18:59:59.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JD9wnV8EzvKtGaWAEvo4_a4LglCvld9_0 2024-09-12T18:59:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3346009576786954272', time=2024-09-12T20:28:56.958641+0000, chain.objs.size()=1 2024-09-12T18:59:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._4R_Mu1FYwpgqRWOVZcPc1nWtompuJ0_0 2024-09-12T18:59:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3593250545888326569', time=2024-09-12T20:28:57.168894+0000, chain.objs.size()=1 2024-09-12T18:59:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OIXaekZMRNqG7DnUxGTOCpe1F8-4y0A_0 2024-09-12T18:59:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11114544065625089644', time=2024-09-12T20:28:57.407950+0000, chain.objs.size()=1 2024-09-12T18:59:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.B9RoynG_xAeRFnCrP-zz02nlwrUazHI_0 2024-09-12T18:59:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7864523665957237247', time=2024-09-12T20:28:57.808193+0000, chain.objs.size()=1 2024-09-12T18:59:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SgV06vADDxuAeHL_n7Ou4l5c6db13Sq_0 2024-09-12T18:59:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4659705930312373051', time=2024-09-12T20:28:59.324517+0000, chain.objs.size()=1 2024-09-12T18:59:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.PZpV4qHlX7keKCjRkC4MAvoFAT1aqpa_0 2024-09-12T18:59:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9089045565681458271', time=2024-09-12T20:29:00.551484+0000, chain.objs.size()=1 2024-09-12T18:59:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.eiDvWvRHCsLr5sashw5SjXAPBDpfqON_0 2024-09-12T18:59:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14294896550535203670', time=2024-09-12T20:29:00.553291+0000, chain.objs.size()=1 2024-09-12T18:59:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AEflxukUV1yV1zEtUD0TPkHhJ8XN4eQ_0 2024-09-12T18:59:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.675726413008590735', time=2024-09-12T20:29:01.285960+0000, chain.objs.size()=1 2024-09-12T18:59:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.e5MbLuEG_bFhSIPGPTgLI2nZlL0d452_0 2024-09-12T18:59:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14438904877176562654', time=2024-09-12T20:29:01.700480+0000, chain.objs.size()=1 2024-09-12T18:59:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.751+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ODMcEO-p_8bfuBq4Q2vMKbtLaNdCVDb_0 2024-09-12T18:59:59.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6941657068191050764', time=2024-09-12T20:29:04.550913+0000, chain.objs.size()=1 2024-09-12T18:59:59.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.0sUYX3VSZiov-2j7ZbQ8Se4-Hab2hoe_0 2024-09-12T18:59:59.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15211606958144915740', time=2024-09-12T20:29:04.893008+0000, chain.objs.size()=1 2024-09-12T18:59:59.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.z4F2y1xiP2Z6Ajm12utSXjO_zQWbxqc_0 2024-09-12T18:59:59.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1432157329723665491', time=2024-09-12T20:29:08.045803+0000, chain.objs.size()=1 2024-09-12T18:59:59.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.dj2APgze3yocp0HujQDSHv7r-6B5H2h_0 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.545861509319060492', time=2024-09-12T20:29:10.668356+0000, chain.objs.size()=1 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.eemw-XQfNfJFnEA6ueQS2HqiVOxUoct_0 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18288357933032172842', time=2024-09-12T20:29:12.495681+0000, chain.objs.size()=1 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.xqqSk8Yg2lTaFSCZ0AJ6UwGa5oUZnfq_0 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4514074686038553452', time=2024-09-12T20:29:12.550433+0000, chain.objs.size()=1 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.pKAfgIuu0Vc2nkkuakYoCFU-dsiez2o_0 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5811555837024981822', time=2024-09-12T20:29:14.507147+0000, chain.objs.size()=1 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rqGagROFefgGWOknOHWh-rOhd18rrOn_0 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10769541799883164970', time=2024-09-12T20:29:14.605323+0000, chain.objs.size()=1 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.nt5OHbyXq8G0DOeEkkWidBuTJ8YHWSf_0 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15286378308944490281', time=2024-09-12T20:29:16.797732+0000, chain.objs.size()=1 2024-09-12T18:59:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.263__shadow_.MS6cd44g3rDdpp2ULvJZTN4DkfzVCyM_0 2024-09-12T18:59:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7673646655178904510', time=2024-09-12T20:29:29.494522+0000, chain.objs.size()=1 2024-09-12T18:59:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.273__shadow_.swxCgCD0pOMb2wci58OblwcXX36j2k1_0 2024-09-12T18:59:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11429244661883226440', time=2024-09-12T20:29:33.545343+0000, chain.objs.size()=1 2024-09-12T18:59:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.276__shadow_.5nh7khalPNGAf7rnUOuuwkdIW8iy0i2_0 2024-09-12T18:59:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16160755572701720765', time=2024-09-12T20:29:34.946474+0000, chain.objs.size()=1 2024-09-12T18:59:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.277__shadow_.9GgKXkmnHi_xJcMHnqlg9kZshcN0JW7_0 2024-09-12T18:59:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9951368595860227766', time=2024-09-12T20:29:59.038848+0000, chain.objs.size()=1 2024-09-12T18:59:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.Ia87YUG3fky76ave6KVCxocIA-NzrlL_0 2024-09-12T18:59:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15896164490021906201', time=2024-09-12T20:30:05.321689+0000, chain.objs.size()=1 2024-09-12T18:59:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.294__shadow_.9zEtlgQ1BHSPAX8VFwzfqL8NZzOPz72_0 2024-09-12T18:59:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16394668812538396347', time=2024-09-12T20:30:16.682742+0000, chain.objs.size()=1 2024-09-12T18:59:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.755+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.302__shadow_.0Ryf2aDpHm1-NUWS05jJ5nsBm2VyZFG_0 2024-09-12T18:59:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2158452022537368748', time=2024-09-12T20:30:18.038054+0000, chain.objs.size()=1 2024-09-12T18:59:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.303__shadow_.u-zk3cMar710maPWqS1PCTGydEZeXRa_0 2024-09-12T18:59:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7847821433937994615', time=2024-09-12T20:32:27.637535+0000, chain.objs.size()=1 2024-09-12T18:59:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.g9IILmeyzNldmexYupSzLbQd9hpJXHD_0 2024-09-12T18:59:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9823223865803656795', time=2024-09-12T20:32:28.367525+0000, chain.objs.size()=1 2024-09-12T18:59:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.VmdI7PSwWwJlS86tsNiSn7oEMsdUAJy_0 2024-09-12T18:59:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3436982882195191053', time=2024-09-12T20:32:28.617223+0000, chain.objs.size()=1 2024-09-12T18:59:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dQ2GsFigb0WEhC8Xt4FYPn5kKakGqzr_0 2024-09-12T18:59:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6770862942627770356', time=2024-09-12T20:32:31.045517+0000, chain.objs.size()=1 2024-09-12T18:59:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.WlaHnuh6ueycd2Wd1zAhqwLS3h6jWR6_0 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7477289107279138385', time=2024-09-12T20:32:31.860027+0000, chain.objs.size()=1 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ni1Pl923hz8Y4u270b3OlQijHZhAJGY_0 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.593789106601988498', time=2024-09-12T20:32:33.125065+0000, chain.objs.size()=1 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.QcsYaGgpVFJjqqeoN8sRO5qozO2mVl5_0 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1267600400181463915', time=2024-09-12T20:32:34.686664+0000, chain.objs.size()=1 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.FmT-kjEebHJaJrgi8Z3rHXP2qHM1rUj_0 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18110762763728857116', time=2024-09-12T20:32:35.425581+0000, chain.objs.size()=1 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hFx7GYV89o5xmQjbbXXpIRcAnYydYAl_0 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3337028596746925588', time=2024-09-12T20:32:36.041948+0000, chain.objs.size()=1 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Vi7h7Oy7fLeE1Vlwrf3hC9-NaNeWsvf_0 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17865225666584505368', time=2024-09-12T20:32:36.659297+0000, chain.objs.size()=1 2024-09-12T18:59:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wKtEa7JrrLsbgMXIke4D-K0iUk_g0-N_0 2024-09-12T18:59:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6401429786158343511', time=2024-09-12T20:32:36.661031+0000, chain.objs.size()=1 2024-09-12T18:59:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.JRHkinGxA_manSzRUIUZoBTmeqAbaUP_0 2024-09-12T18:59:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12092804183439541387', time=2024-09-12T20:32:36.849428+0000, chain.objs.size()=1 2024-09-12T18:59:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.2DjEnWAvcnJ7UGHbChOijR7wYUyIsnX_0 2024-09-12T18:59:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18045863627132378013', time=2024-09-12T20:32:37.814312+0000, chain.objs.size()=1 2024-09-12T18:59:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.e0-z4TeLA9L-pL7TwY9rcUYFmPDLs6S_0 2024-09-12T18:59:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7498673691303875688', time=2024-09-12T20:32:39.465410+0000, chain.objs.size()=1 2024-09-12T18:59:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yGCSS_g82lrjntQ6_z7fI26sAo3s3Lk_0 2024-09-12T18:59:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2072849370947352639', time=2024-09-12T20:32:39.527826+0000, chain.objs.size()=1 2024-09-12T18:59:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.XsThffDZMioEtZkeEWuJRwUKpfBjsav_0 2024-09-12T18:59:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5885855364794995027', time=2024-09-12T20:32:40.140013+0000, chain.objs.size()=1 2024-09-12T18:59:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.759+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.U5L-sfraHs8vPczJHp151dIkxjlR_DL_0 2024-09-12T18:59:59.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1429128623934596605', time=2024-09-12T20:32:40.194198+0000, chain.objs.size()=1 2024-09-12T18:59:59.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.RJfE-po4WJltZIBksLUG_wJ0DGbJqIi_0 2024-09-12T18:59:59.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16441147832718156444', time=2024-09-12T20:32:41.389923+0000, chain.objs.size()=1 2024-09-12T18:59:59.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tVxzfDpY0nf7jkRvdcNOkKgiTGfljZG_0 2024-09-12T18:59:59.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14584412504881772601', time=2024-09-12T20:32:42.609563+0000, chain.objs.size()=1 2024-09-12T18:59:59.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BVftgZfJJqq5LYAqUSfNUiT0ddmnnOX_0 2024-09-12T18:59:59.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.755073473088647614', time=2024-09-12T20:32:42.912574+0000, chain.objs.size()=1 2024-09-12T18:59:59.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uSMMwCLMwJN3k-R4CQySwbScFOUgf3m_0 2024-09-12T18:59:59.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6489640652211212035', time=2024-09-12T20:32:42.964138+0000, chain.objs.size()=1 2024-09-12T18:59:59.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3ild-nEO1rwclifCmuEIzf8H-kzioqR_0 2024-09-12T18:59:59.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13886448082578386939', time=2024-09-12T20:32:42.966373+0000, chain.objs.size()=1 2024-09-12T18:59:59.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.C6FzK8iny7GvM6_3kymLPfEbTNxf9r2_0 2024-09-12T18:59:59.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17751306456274580875', time=2024-09-12T20:32:43.245292+0000, chain.objs.size()=1 2024-09-12T18:59:59.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.DzYcmp_mqBpeqU3Nvwxj0xz8fhW19sB_0 2024-09-12T18:59:59.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5642388743705029976', time=2024-09-12T20:32:45.429878+0000, chain.objs.size()=1 2024-09-12T18:59:59.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nUKXQN_lpHDjTvj4Jl5do2m4T1wXmXE_0 2024-09-12T18:59:59.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10240099007426041597', time=2024-09-12T20:32:46.607896+0000, chain.objs.size()=1 2024-09-12T18:59:59.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.aayUniIu92fG6LwZdYXko9ZNIfGQrL7_0 2024-09-12T18:59:59.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13584567125567735257', time=2024-09-12T20:32:46.862564+0000, chain.objs.size()=1 2024-09-12T18:59:59.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ugd0sy4VnQ6WeunuH1c5oDv7amscSc0_0 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10831274384783997570', time=2024-09-12T20:32:47.253792+0000, chain.objs.size()=1 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eJwqVvNJIAvmzJiJAnLT8MWA3J5mjUf_0 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8821344161457841750', time=2024-09-12T20:32:48.300232+0000, chain.objs.size()=1 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8z0C-I7KGLRMtKpDYWFwUYWg73GOK6H_0 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13491466950743199193', time=2024-09-12T20:32:48.302107+0000, chain.objs.size()=1 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.763+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.N2u5jLBv4e2icPN7fzMqg4FtH3KmBiL_0 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17830370074212330837', time=2024-09-12T20:32:49.446659+0000, chain.objs.size()=1 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.OnKZhyD5DdyiUkAM-8mX1legbFNFUz2_0 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8229129430388074254', time=2024-09-12T20:32:50.139438+0000, chain.objs.size()=1 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.H7q1LppPmz68Zh4NCd7RC_labNWvUwL_0 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10391519296588855304', time=2024-09-12T20:32:50.632590+0000, chain.objs.size()=1 2024-09-12T18:59:59.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.pb4-z-ldJOea9GzvDbeExA0KWBjB9SM_0 2024-09-12T18:59:59.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11753547376917450346', time=2024-09-12T20:34:37.902196+0000, chain.objs.size()=1 2024-09-12T18:59:59.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.DUMrz7LtnmU6cmQ6UPa3862b2EM--z3_0 2024-09-12T18:59:59.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8751025843975388728', time=2024-09-12T20:34:39.922351+0000, chain.objs.size()=1 2024-09-12T18:59:59.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.SZ9QcqpxCWQN6WmO1sIOWmXM5jCarcz_0 2024-09-12T18:59:59.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1208952716861554305', time=2024-09-12T20:34:40.387861+0000, chain.objs.size()=1 2024-09-12T18:59:59.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.COJVs4rUB-lr_53rYINSmuKQtgQP3_J_0 2024-09-12T18:59:59.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17992253335625373011', time=2024-09-12T20:34:42.135537+0000, chain.objs.size()=1 2024-09-12T18:59:59.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.0kIWBC4yXUakOiwkBEyC7Hcjfcv6IMg_0 2024-09-12T18:59:59.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15110557870523142292', time=2024-09-12T20:34:42.442034+0000, chain.objs.size()=1 2024-09-12T18:59:59.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.OEigu48QAWhtzmaIQ-bKNvv2-p8w02-_0 2024-09-12T18:59:59.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17727235568228018718', time=2024-09-12T20:34:45.058150+0000, chain.objs.size()=1 2024-09-12T18:59:59.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hFh0l2Gcd5l1hApf7AG6FjLGIe28wb0_0 2024-09-12T18:59:59.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7035255725115754900', time=2024-09-12T20:34:45.741109+0000, chain.objs.size()=1 2024-09-12T18:59:59.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3hoH89R9fkSTE0x8P70CbKHHMLu_LNq_0 2024-09-12T18:59:59.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.147494168704391139', time=2024-09-12T20:34:49.052492+0000, chain.objs.size()=1 2024-09-12T18:59:59.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tzVmCI0ZrdLjF2lzRG6yHAZMMIQk4m0_0 2024-09-12T18:59:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2818323355947968068', time=2024-09-12T20:34:49.172605+0000, chain.objs.size()=1 2024-09-12T18:59:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wn5WvulUxyqq-ALGrt-CYY3Jp0Y3-iL_0 2024-09-12T18:59:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15244405773368110067', time=2024-09-12T20:34:50.810239+0000, chain.objs.size()=1 2024-09-12T18:59:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.lxi9bxNCr6ck4I6L09GOma7krb-ELlZ_0 2024-09-12T18:59:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10553809565172769562', time=2024-09-12T20:34:51.144905+0000, chain.objs.size()=1 2024-09-12T18:59:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.7Qqrz-Dt3rDAkORIHlX_pn0xzO1C-o3_0 2024-09-12T18:59:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1036851302544943376', time=2024-09-12T20:34:51.146269+0000, chain.objs.size()=1 2024-09-12T18:59:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.r5H0Yfeof8fYzbrQCsAvTsYOIpXJ4z__0 2024-09-12T18:59:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.719708281006443024', time=2024-09-12T20:34:51.493798+0000, chain.objs.size()=1 2024-09-12T18:59:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.xqZXMExDqYgOntaoEfJtKivE4SID6Qb_0 2024-09-12T18:59:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11300841634767152729', time=2024-09-12T20:34:53.719331+0000, chain.objs.size()=1 2024-09-12T18:59:59.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.a0C1la49uhmZD1CF9c4JfT2lGaFoTYP_0 2024-09-12T18:59:59.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6803445919022918206', time=2024-09-12T20:34:54.070783+0000, chain.objs.size()=1 2024-09-12T18:59:59.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UwF68Bg61nnepuziKakQrBdh436Xeq__0 2024-09-12T18:59:59.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5085952740289716274', time=2024-09-12T20:34:57.240907+0000, chain.objs.size()=1 2024-09-12T18:59:59.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5SlQ_AxUuXA_v1eSYCaswdhPdIcvCHR_0 2024-09-12T18:59:59.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11678246714501187659', time=2024-09-12T20:34:57.867088+0000, chain.objs.size()=1 2024-09-12T18:59:59.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HkeTb3ZnKAmRziv3uzk90XGeiqUAGkh_0 2024-09-12T18:59:59.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5008012119058921732', time=2024-09-12T20:35:00.814674+0000, chain.objs.size()=1 2024-09-12T18:59:59.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ulN5-qMKmO7tcDzdKhbRqf7cMZBra_M_0 2024-09-12T18:59:59.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4277106141472198126', time=2024-09-12T20:35:01.278851+0000, chain.objs.size()=1 2024-09-12T18:59:59.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.767+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bTLZX-ODByaXWnSShN7iPlqCvI-r7xx_0 2024-09-12T18:59:59.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13574723814573253552', time=2024-09-12T20:35:06.496496+0000, chain.objs.size()=1 2024-09-12T18:59:59.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.329__shadow_.gy8g5ijRIJtBsFY9lqTVq4X3TG98d0N_0 2024-09-12T18:59:59.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11711158640720741949', time=2024-09-12T20:36:02.845425+0000, chain.objs.size()=1 2024-09-12T18:59:59.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.384__shadow_.WxIacfvX4A-sTxVVMhUe9mzRX0bMUCp_0 2024-09-12T18:59:59.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5588661114920773507', time=2024-09-12T20:37:38.713030+0000, chain.objs.size()=1 2024-09-12T18:59:59.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.465__shadow_.T_PpKheI7GqO_JWrNdnk_fdzvYY4-Bo_0 2024-09-12T18:59:59.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~2RX4yvD3u5KiN2pa8nFkkh2KzVoe6eN', time=2024-09-12T20:41:51.359088+0000, chain.objs.size()=1 2024-09-12T18:59:59.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.531__multipart_mymultipart.2~2RX4yvD3u5KiN2pa8nFkkh2KzVoe6eN.1 2024-09-12T18:59:59.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16525091196608056737', time=2024-09-12T20:43:58.349435+0000, chain.objs.size()=1 2024-09-12T18:59:59.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:PfLgzOuQ092yhbfOTZUq4BZW5T10Rim_.GCVnnk_1OPL1gEygJ0lCE4pw8SYOI1p_0 2024-09-12T18:59:59.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12294794820450403855', time=2024-09-12T20:43:58.849301+0000, chain.objs.size()=1 2024-09-12T18:59:59.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:L58i3mvTsuQLuX0Eq5m20TaKhpbahwp_.1h-srDuzGmzZK9d1tf0DWZ_8mWT_wKj_0 2024-09-12T18:59:59.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3827733231977639608', time=2024-09-12T20:44:43.260606+0000, chain.objs.size()=1 2024-09-12T18:59:59.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:9RrTGzqwRkR4BzWNPBmaTP2XqYNobG-_.v_HML1Lrca54lRMGor-F7ZbyHsi8b1m_0 2024-09-12T18:59:59.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4636432903109164402', time=2024-09-12T20:45:06.555893+0000, chain.objs.size()=1 2024-09-12T18:59:59.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:54pbH.96FgTd6zPKIjVG2rMnnEnKnmu_.-MHXpPuKnqEpqgAZYhbLt7WbbAe1W7i_0 2024-09-12T18:59:59.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3404730599394834285', time=2024-09-12T20:45:29.313672+0000, chain.objs.size()=4 2024-09-12T18:59:59.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~DZ6_qmkRByNmUUT2ZyakebzWJ2myC2F.1 2024-09-12T18:59:59.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~DZ6_qmkRByNmUUT2ZyakebzWJ2myC2F.2 2024-09-12T18:59:59.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~DZ6_qmkRByNmUUT2ZyakebzWJ2myC2F.3 2024-09-12T18:59:59.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.771+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.578__multipart_testobj.2~DZ6_qmkRByNmUUT2ZyakebzWJ2myC2F.4 2024-09-12T18:59:59.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45986 2024-09-12T18:59:59.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:59:59.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4682539063522755568', time=2024-09-12T20:45:34.653166+0000, chain.objs.size()=1 2024-09-12T18:59:59.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.579__shadow:rTXgeMvDnCXdsUo7rUErALoJNxO2Oa8_.7xshxsB3Ux8PKlavI2xoSi5MZmux7jz_0 2024-09-12T18:59:59.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3166593763041968863', time=2024-09-12T20:46:07.021566+0000, chain.objs.size()=1 2024-09-12T18:59:59.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.602__shadow_.6TggGin5ke4MSa0H1fB5YUNv0Xp0Afo_0 2024-09-12T18:59:59.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12207215008143202064', time=2024-09-12T20:46:11.875371+0000, chain.objs.size()=1 2024-09-12T18:59:59.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.606__shadow_.efrvgv4wcfMwQbf6_1RJnok1s6qH2al_0 2024-09-12T18:59:59.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12477967759253163450', time=2024-09-12T20:52:01.410726+0000, chain.objs.size()=1 2024-09-12T18:59:59.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.666__shadow_.JuCIDPB2lIKv31an1QwoFNIE6DL3RYD_0 2024-09-12T18:59:59.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9271056358844004257', time=2024-09-12T20:53:47.138702+0000, chain.objs.size()=20 2024-09-12T18:59:59.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__multipart_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.1 2024-09-12T18:59:59.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__shadow_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.1_1 2024-09-12T18:59:59.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__multipart_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.2 2024-09-12T18:59:59.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__shadow_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.2_1 2024-09-12T18:59:59.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__multipart_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.3 2024-09-12T18:59:59.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__shadow_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.3_1 2024-09-12T18:59:59.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__multipart_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.4 2024-09-12T18:59:59.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.775+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__shadow_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.4_1 2024-09-12T18:59:59.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.779+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__multipart_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.5 2024-09-12T18:59:59.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.779+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__shadow_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.5_1 2024-09-12T18:59:59.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.779+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__multipart_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.6 2024-09-12T18:59:59.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.779+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__shadow_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.6_1 2024-09-12T18:59:59.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.779+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__multipart_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.7 2024-09-12T18:59:59.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.779+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__shadow_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.7_1 2024-09-12T18:59:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.783+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__multipart_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.8 2024-09-12T18:59:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.783+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__shadow_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.8_1 2024-09-12T18:59:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.783+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__multipart_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.9 2024-09-12T18:59:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.783+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__shadow_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.9_1 2024-09-12T18:59:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.783+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__multipart_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.10 2024-09-12T18:59:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.783+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735__shadow_foo.2~3z-z371PTHKUif0Jo-j-HcRxw39MmP7.10_1 2024-09-12T18:59:59.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.787+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.787+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:59:59.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.787+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.787+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49446' 2024-09-12T18:59:59.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18377951744279347883', time=2024-09-12T20:22:10.524733+0000, chain.objs.size()=1 2024-09-12T18:59:59.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.157__shadow:J0r9VFHWW8xCxcGMMbF7CBjhnrccl7P_.zbYaL2MvePiYO60h8t0ZUxwZ8S7kby3_0 2024-09-12T18:59:59.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15960106245146382050', time=2024-09-12T20:22:16.300092+0000, chain.objs.size()=3 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.158__shadow_.edpDpL2BzGaNyjJ_cjYNtG5j7d774E__0 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.158__shadow_.edpDpL2BzGaNyjJ_cjYNtG5j7d774E__1 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.158__shadow_.edpDpL2BzGaNyjJ_cjYNtG5j7d774E__2 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5166499576660424682', time=2024-09-12T20:23:16.803027+0000, chain.objs.size()=1 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.181__shadow_.xhMzUiEkJLVezTy9bTPWb-lW8ySvIu6_0 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17912171765965326124', time=2024-09-12T20:26:39.946302+0000, chain.objs.size()=1 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.241__shadow_.GAQ9ZmK_BsCDCV_qiiBJGtVcuIhgZ7U_0 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2651906003813205890', time=2024-09-12T20:27:02.268135+0000, chain.objs.size()=1 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.256__shadow_.VU-gt4CnOd_qDoh2pAx_7wlb6al9PIJ_0 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3277636460919945386', time=2024-09-12T20:27:04.788503+0000, chain.objs.size()=1 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.258__shadow_.r2GdpRcxla1x95zKYitAamrTD3q34j1_0 2024-09-12T18:59:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10985111784491834869', time=2024-09-12T20:28:50.202558+0000, chain.objs.size()=1 2024-09-12T18:59:59.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.uiPW7mIg9bi95MDgj0EHdwVuMIkS4LV_0 2024-09-12T18:59:59.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7589317604502612711', time=2024-09-12T20:28:50.291528+0000, chain.objs.size()=1 2024-09-12T18:59:59.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.eP9S6bIYsvlyK_2MwBIxQjQKuOpXuuc_0 2024-09-12T18:59:59.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.163212078858430826', time=2024-09-12T20:28:50.659973+0000, chain.objs.size()=1 2024-09-12T18:59:59.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5NFSQ1OXvvDFZIL9UCkLWV5_OTcXmzp_0 2024-09-12T18:59:59.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10138862412949698101', time=2024-09-12T20:28:53.017504+0000, chain.objs.size()=1 2024-09-12T18:59:59.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.zTilguvlqPat4I2vAEoa86qWVN_ztAJ_0 2024-09-12T18:59:59.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17795766987090937305', time=2024-09-12T20:28:53.942156+0000, chain.objs.size()=1 2024-09-12T18:59:59.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.712C3epSooKz43KDYURVgEp6qU5Q_w2_0 2024-09-12T18:59:59.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2494450338574402644', time=2024-09-12T20:28:55.670987+0000, chain.objs.size()=1 2024-09-12T18:59:59.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ctxcUIMtoQhsVMVrBmZ2RHeiWlUkgbg_0 2024-09-12T18:59:59.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12033673482170208952', time=2024-09-12T20:28:55.988435+0000, chain.objs.size()=1 2024-09-12T18:59:59.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.pXcTerezey6z9xuj3yChJxM3Om8tev8_0 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4959944594941477152', time=2024-09-12T20:28:57.492468+0000, chain.objs.size()=1 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.jqNta99KeAAd87khodestIKoTbmVgx-_0 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8416271931435920154', time=2024-09-12T20:28:58.008235+0000, chain.objs.size()=1 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9GJTZQRbfmyRDRFYaTwHSF2P8gE2qCD_0 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8987797812792760987', time=2024-09-12T20:28:59.305233+0000, chain.objs.size()=1 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wjWUJvoHAXp7U22iOU2mKe8CWWRClTm_0 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17990241802015936611', time=2024-09-12T20:29:00.700990+0000, chain.objs.size()=1 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.d_FUo7W5nB_iJV2ddMzF59x-m16f3iu_0 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3866183873253399509', time=2024-09-12T20:29:01.363719+0000, chain.objs.size()=1 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.iDZciqlZMhSigIPLaEQOC0rdydyoeYd_0 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3948789784598589637', time=2024-09-12T20:29:02.525042+0000, chain.objs.size()=1 2024-09-12T18:59:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AVt384JamjhuiqQzv-gCoGdw9zRB8jV_0 2024-09-12T18:59:59.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12700824099081775296', time=2024-09-12T20:29:03.066949+0000, chain.objs.size()=1 2024-09-12T18:59:59.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1Pj0lgsILLrLKS3BlL9qbCzQTsWycMr_0 2024-09-12T18:59:59.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2396922458053121355', time=2024-09-12T20:29:03.964667+0000, chain.objs.size()=1 2024-09-12T18:59:59.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.791+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.b4yEyzVnaEA5VzLll7F_IQtSoLq4T3W_0 2024-09-12T18:59:59.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.987623529030185185', time=2024-09-12T20:29:04.226626+0000, chain.objs.size()=1 2024-09-12T18:59:59.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AbXj3CKcQCxOebmNyiLGnEosbtM_O_D_0 2024-09-12T18:59:59.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9564025098779132314', time=2024-09-12T20:29:05.129633+0000, chain.objs.size()=1 2024-09-12T18:59:59.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Hvyi60V3YP55_HOAl8_fVo1X7T1AWOe_0 2024-09-12T18:59:59.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8569362224326110147', time=2024-09-12T20:29:06.183286+0000, chain.objs.size()=1 2024-09-12T18:59:59.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.PsjvbiJlDn5PFK8ijGiDjyljWpoAJE2_0 2024-09-12T18:59:59.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17720947281023662563', time=2024-09-12T20:29:06.184928+0000, chain.objs.size()=1 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3ZwCsX77OsafC4THg5gms1Udtdvq-26_0 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16841885451187970365', time=2024-09-12T20:29:06.526571+0000, chain.objs.size()=1 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Brakk3AAkEBMEyCipcyp0bCySvC0P1F_0 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16763434751354544745', time=2024-09-12T20:29:07.171040+0000, chain.objs.size()=1 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.89N8kH4EQCwuqhdD5qOtUDvpBxyjW2-_0 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16483063517515044389', time=2024-09-12T20:29:07.666257+0000, chain.objs.size()=1 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kJ2ebc82nZaerwqfwztW7AWUg3xK6UO_0 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6321543608974530088', time=2024-09-12T20:29:07.869780+0000, chain.objs.size()=1 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.j_aU-88ik_r0ZCE0xIYANzgiJPJ33Nu_0 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1953655128571861399', time=2024-09-12T20:29:08.349180+0000, chain.objs.size()=1 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.nxXLggbLfnI3eqW8EwjZqAa96ogSYs0_0 2024-09-12T18:59:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17985292530736620405', time=2024-09-12T20:29:08.429276+0000, chain.objs.size()=1 2024-09-12T18:59:59.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AbdB246tr1FsmYxJJiXSjv2d5PTO4hs_0 2024-09-12T18:59:59.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16560835083215161059', time=2024-09-12T20:29:08.430839+0000, chain.objs.size()=1 2024-09-12T18:59:59.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.4vtjDFFLdBIKZN7WbbXrWQ2P2EEv8jF_0 2024-09-12T18:59:59.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7743395167776127618', time=2024-09-12T20:29:09.498539+0000, chain.objs.size()=1 2024-09-12T18:59:59.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gRZUt7JR40UWUnupX3lP34K3LPjPA6U_0 2024-09-12T18:59:59.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11072464045503519521', time=2024-09-12T20:29:09.571424+0000, chain.objs.size()=1 2024-09-12T18:59:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.r4vNPn3qwLQnY5VwnNOD84nKsuGKP8v_0 2024-09-12T18:59:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4529410137099399298', time=2024-09-12T20:29:10.909061+0000, chain.objs.size()=1 2024-09-12T18:59:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.795+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.aQMB6OShpsHPwqPTLa3-6z0y-iBQK-F_0 2024-09-12T18:59:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6004445532473010573', time=2024-09-12T20:29:11.652848+0000, chain.objs.size()=1 2024-09-12T18:59:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.xwcsqA45QyY8kZl6NXU0Er5A6e3VHQj_0 2024-09-12T18:59:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4435672073035271408', time=2024-09-12T20:29:12.161491+0000, chain.objs.size()=1 2024-09-12T18:59:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.xg9aKVk7hYvAMNk5z5kHMN_JvLvoAIo_0 2024-09-12T18:59:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12215772438816352399', time=2024-09-12T20:29:13.560060+0000, chain.objs.size()=1 2024-09-12T18:59:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3N3WL109bCW2WhGbwL8tV58CSRxaxnI_0 2024-09-12T18:59:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.494553123547777444', time=2024-09-12T20:29:21.841437+0000, chain.objs.size()=1 2024-09-12T18:59:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.267__shadow_.gnka1vQMTmn-TQRycu4rUCiiLyeroNf_0 2024-09-12T18:59:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.945104914153579801', time=2024-09-12T20:29:25.678207+0000, chain.objs.size()=1 2024-09-12T18:59:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.270__shadow_.pGn__DXi6ranBqRLFuULmoPgmWYNSOG_0 2024-09-12T18:59:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5058491157335209386', time=2024-09-12T20:29:41.988815+0000, chain.objs.size()=1 2024-09-12T18:59:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.282__shadow_.Znqaz50ZxdBv7wzejHpCAKufhSyaJYY_0 2024-09-12T18:59:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.966017383088694160', time=2024-09-12T20:29:44.765423+0000, chain.objs.size()=1 2024-09-12T18:59:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.284__shadow_.7EpLh5AfP-40io3tsD_5YITRjzxSSLC_0 2024-09-12T18:59:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1484245524449494129', time=2024-09-12T20:29:46.262686+0000, chain.objs.size()=1 2024-09-12T18:59:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.285__shadow_.Y3hLO0sFj3sFvkS4Ohv8eJE95iEcFol_0 2024-09-12T18:59:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10956182316257603955', time=2024-09-12T20:30:03.690550+0000, chain.objs.size()=1 2024-09-12T18:59:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.MnUBr-O4VBa375qZ8UJZaduJ10CaVEa_0 2024-09-12T18:59:59.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15195835880174660679', time=2024-09-12T20:30:11.013990+0000, chain.objs.size()=1 2024-09-12T18:59:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.298__shadow_.wrMucA6GADF__NsJXvOrEHKXtulS0cy_0 2024-09-12T18:59:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3694747438894595001', time=2024-09-12T20:30:41.346780+0000, chain.objs.size()=1 2024-09-12T18:59:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.319__shadow:acuzXcJdsXUaCiy6UfFfoRuirALTi2k_.E9uuZPE9Vyin2v6cXqbgJ9gQpLTpNMk_0 2024-09-12T18:59:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11842198364598176214', time=2024-09-12T20:32:26.940109+0000, chain.objs.size()=1 2024-09-12T18:59:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.RhNKNMPvLLsm1OBqSO2sprnGH5yujTR_0 2024-09-12T18:59:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14948418631351086618', time=2024-09-12T20:32:27.591738+0000, chain.objs.size()=1 2024-09-12T18:59:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1A6N49N2rNNVfMCszjUuN3w-wKtRO6m_0 2024-09-12T18:59:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4463190438049256069', time=2024-09-12T20:32:27.637069+0000, chain.objs.size()=1 2024-09-12T18:59:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.9pa3KQwvkLf7JDidHewQfZT7S977Yhm_0 2024-09-12T18:59:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1520091967088231919', time=2024-09-12T20:32:27.894368+0000, chain.objs.size()=1 2024-09-12T18:59:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.FrP4IZnUw2xvWDpRcq450k-3YhmCpZh_0 2024-09-12T18:59:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6490248912387053820', time=2024-09-12T20:32:29.120129+0000, chain.objs.size()=1 2024-09-12T18:59:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0SYxtu4oGjv-ERdOOGeAvblP7kMMnUb_0 2024-09-12T18:59:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9793652434521457908', time=2024-09-12T20:32:29.365383+0000, chain.objs.size()=1 2024-09-12T18:59:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.FVeBEI7YS_m4o5ydd3TVcIYlecOrUEG_0 2024-09-12T18:59:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17090756111138215232', time=2024-09-12T20:32:31.452673+0000, chain.objs.size()=1 2024-09-12T18:59:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.QHOKB1sAoClEtRTvHSMqK5foC56r3dk_0 2024-09-12T18:59:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16941769459683911405', time=2024-09-12T20:32:32.034779+0000, chain.objs.size()=1 2024-09-12T18:59:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.aTkZcfvQ6YWLI1_0S6oZEqehmczvl6D_0 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7616370964800991117', time=2024-09-12T20:32:34.699525+0000, chain.objs.size()=1 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0WxYJ6vuO6libusYcuuU4cbbQ8mfbuh_0 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14695622954757652025', time=2024-09-12T20:32:35.838481+0000, chain.objs.size()=1 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0kVUZW49UgazPNYgK_g27EcDxpnJ0mA_0 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15104286894319937770', time=2024-09-12T20:32:36.882030+0000, chain.objs.size()=1 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Vm6CzGnyE__mIubbJcDcbnw_6Cp9HRh_0 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15820940843414406259', time=2024-09-12T20:32:39.755871+0000, chain.objs.size()=1 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.799+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._7N41seXUsbVgqJ1sODRGaIc7Mo35Vm_0 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13889788053525631810', time=2024-09-12T20:32:41.379038+0000, chain.objs.size()=1 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.OxKeWI5ZDLyPYuuopcXBLPzChZ4ZP_5_0 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8627755604937359597', time=2024-09-12T20:32:41.625246+0000, chain.objs.size()=1 2024-09-12T18:59:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6iGyk9xTt3AlzejH5UAKVzhj-Y7MLC0_0 2024-09-12T18:59:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9465641559587288669', time=2024-09-12T20:32:42.158872+0000, chain.objs.size()=1 2024-09-12T18:59:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6ZljAPA1KIiaypyKzR-JQ7f_NXeizPr_0 2024-09-12T18:59:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11639020333784257409', time=2024-09-12T20:32:42.305080+0000, chain.objs.size()=1 2024-09-12T18:59:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BZMxnUKUy40UR3ViZwAWmktFi2D6D0k_0 2024-09-12T18:59:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.848815808531176521', time=2024-09-12T20:32:43.954009+0000, chain.objs.size()=1 2024-09-12T18:59:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rKAgrDj4h6Dga5JpkJjMVr4rn731Pxb_0 2024-09-12T18:59:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15158922353150744971', time=2024-09-12T20:32:44.742675+0000, chain.objs.size()=1 2024-09-12T18:59:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.v0nKTBoIvXFrDiizULi7aK24ham3_4o_0 2024-09-12T18:59:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5901402117015430161', time=2024-09-12T20:32:45.361412+0000, chain.objs.size()=1 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7617d8drnh5LPnlClh2vW6lr3rUYy3z_0 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13282270221341825653', time=2024-09-12T20:32:45.527584+0000, chain.objs.size()=1 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.SEQTls3Cwu0gaBh9Mhr7ep16ljWpcVk_0 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13567816969928383477', time=2024-09-12T20:32:45.930311+0000, chain.objs.size()=1 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.aRhaysEnR0AW8LWKsGqjJnbrR6TlI5I_0 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16851952832379718090', time=2024-09-12T20:32:46.713836+0000, chain.objs.size()=1 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dcVcKg5lUgBbgnAyaQbD9wKaRUxClE7_0 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6484036165658632393', time=2024-09-12T20:32:47.338821+0000, chain.objs.size()=1 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.lYtRx-EPJ7rILWVsxHhcV4fHsZppglO_0 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6843894652702779180', time=2024-09-12T20:32:49.407099+0000, chain.objs.size()=1 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.lONxxARWDBwyZ59D1VsUSOGUJ2Wl1Ll_0 2024-09-12T18:59:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2350124501843550351', time=2024-09-12T20:32:52.070638+0000, chain.objs.size()=1 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hWXnoBI9e3ecAgUXJze2f98rjnF67f-_0 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13865978565676726978', time=2024-09-12T20:34:34.481955+0000, chain.objs.size()=1 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.DHcj1ZmUtZqb9cZ0r8FEGuac7__-gWP_0 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10548703348117846757', time=2024-09-12T20:34:34.656388+0000, chain.objs.size()=1 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QFiO89EB1p9ljNNDAER4RzARlNEsjun_0 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7877788046106087721', time=2024-09-12T20:34:38.847666+0000, chain.objs.size()=1 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.KFesDiNKRPAc3MzGwQVt8hLyAkVT9ww_0 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12142104495224617818', time=2024-09-12T20:34:39.753644+0000, chain.objs.size()=1 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.803+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.oXn2wmpm25HAOeDSVlvJaOk47Y91dxd_0 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8079759933290495046', time=2024-09-12T20:34:42.530137+0000, chain.objs.size()=1 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YtPeO3KZLmYG0pFj5Fh_4xU-7su-Uaf_0 2024-09-12T18:59:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1152387642973590842', time=2024-09-12T20:34:42.831594+0000, chain.objs.size()=1 2024-09-12T18:59:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.gTxHzotbfkKbVoUW_DKCHyb5NF4m1FP_0 2024-09-12T18:59:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18172989956639057382', time=2024-09-12T20:34:42.833862+0000, chain.objs.size()=1 2024-09-12T18:59:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Coju1QzYwtwaLGPhv3roQ4eO_D1HIzQ_0 2024-09-12T18:59:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9432059361968811766', time=2024-09-12T20:34:43.894549+0000, chain.objs.size()=1 2024-09-12T18:59:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.CGtCzBwVrsPeWqT9VbFPr63aNicr3Vp_0 2024-09-12T18:59:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16112649823076212785', time=2024-09-12T20:34:45.352542+0000, chain.objs.size()=1 2024-09-12T18:59:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Ifeqx8I_33pZ3nCj1Za_Ht7d_kIsJqn_0 2024-09-12T18:59:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5188613670884097409', time=2024-09-12T20:34:45.974697+0000, chain.objs.size()=1 2024-09-12T18:59:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HW__-qCePZ9LGgRG4AARx60AKBOdNAD_0 2024-09-12T18:59:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4664590628400551194', time=2024-09-12T20:34:46.265094+0000, chain.objs.size()=1 2024-09-12T18:59:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.d3yKkYnd6fmpVVUEdBB25G9_dtZGzNE_0 2024-09-12T18:59:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5149788129716755033', time=2024-09-12T20:34:46.267311+0000, chain.objs.size()=1 2024-09-12T18:59:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Ti3GUw8N4ErEeh3RnCEHYM5niWHyVZ0_0 2024-09-12T18:59:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4162783639167185239', time=2024-09-12T20:34:50.694430+0000, chain.objs.size()=1 2024-09-12T18:59:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RZ7h-1AC7qnBWn7Eq2O2ESe_DNB-NsX_0 2024-09-12T18:59:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14251056932967374907', time=2024-09-12T20:34:52.614986+0000, chain.objs.size()=1 2024-09-12T18:59:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9sZw13XHD-FWn0amGOh9ACD520v-CSn_0 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1237542188529065353', time=2024-09-12T20:34:53.908710+0000, chain.objs.size()=1 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.40JOkH_aHQH0I66a8ISoSYwLTgok-0p_0 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9294405598690789423', time=2024-09-12T20:34:54.539689+0000, chain.objs.size()=1 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.8qHDezat7noDnpF8gKa_7bxbcuOjEDx_0 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15066377511205902860', time=2024-09-12T20:34:57.994357+0000, chain.objs.size()=1 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.AfUkvWU34c8jjhLPo4FC2fFzpZ98grs_0 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12976429962843252101', time=2024-09-12T20:35:00.198667+0000, chain.objs.size()=1 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6J8o3uA14LjB0a3AIt73Gco5VFVzAJi_0 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7057994099868648792', time=2024-09-12T20:35:00.508957+0000, chain.objs.size()=1 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qYsv3i0ExlxFJP0eo9aPCZNMV1H9RL7_0 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18348024820067143476', time=2024-09-12T20:36:15.065666+0000, chain.objs.size()=1 2024-09-12T18:59:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.394__shadow:5zAyKxDGf-Dfc1NuZ287LJoBC3C5owm_.z1jv8Tqu40CARcWDl4RcONoN2GUSTyv_0 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12831524273072550307', time=2024-09-12T20:36:29.156939+0000, chain.objs.size()=1 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.408__shadow_.bF6E9kBJyubi-_MQu_faEsKFP5807P8_0 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10400579699785637740', time=2024-09-12T20:37:39.548260+0000, chain.objs.size()=1 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.807+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.465__shadow_.Uz9ALKfSqllLRSk4kf7oJ4xNQ-xZJyr_0 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15452834580229945372', time=2024-09-12T20:37:56.795591+0000, chain.objs.size()=1 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.76KdOt7VpXCvDn5QLW5h5IX86OIyWng_0 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.264682271991567109', time=2024-09-12T20:37:56.857846+0000, chain.objs.size()=1 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.iyXUxG63EKvg9iPZnhgLw134evBYka-_0 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2909876619623576547', time=2024-09-12T20:37:58.473919+0000, chain.objs.size()=1 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.484__shadow_.-K38v3WPHZPN2ww2a3FLc6Uo5uRAZlh_0 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2243055435724035374', time=2024-09-12T20:38:04.346223+0000, chain.objs.size()=4 2024-09-12T18:59:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.486__shadow_.u61vayJ5cjcohMwa4A1c3JAUonelwoJ_0 2024-09-12T18:59:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.486__shadow_.u61vayJ5cjcohMwa4A1c3JAUonelwoJ_1 2024-09-12T18:59:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4271c4640 0 -- 172.21.15.157:0/1674604574 >> [v2:172.21.15.190:6824/996962901,v1:172.21.15.190:6825/996962901] conn(0x7fe420008040 msgr2=0x7fe420039400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:59:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.486__shadow_.u61vayJ5cjcohMwa4A1c3JAUonelwoJ_2 2024-09-12T18:59:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.486__shadow_.u61vayJ5cjcohMwa4A1c3JAUonelwoJ_3 2024-09-12T18:59:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11602061960508381702', time=2024-09-12T20:38:14.079395+0000, chain.objs.size()=1 2024-09-12T18:59:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.495__shadow_.C5z6OsTJYn9L-ihAmJuKXCfZ5ejh_9a_0 2024-09-12T18:59:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9205533993993492346', time=2024-09-12T20:38:25.326378+0000, chain.objs.size()=1 2024-09-12T18:59:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.503__shadow:RrE07h9QVCnd4UDOAeK8Om93tXQxxPE_.hyGvE7kfORPSZwwerfxAYNUofTKRYRK_0 2024-09-12T18:59:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6950872190205486844', time=2024-09-12T20:44:46.766461+0000, chain.objs.size()=1 2024-09-12T18:59:59.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.811+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:5Yh.sR6wS9r6VeDRYtbw-HUWQwsMahw_.P0uVfTO8HVo-wMZ304v7I8yfeDoCUuL_0 2024-09-12T18:59:59.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49446 2024-09-12T18:59:59.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:59:59.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2131964152795810179', time=2024-09-12T20:45:09.974657+0000, chain.objs.size()=1 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:qmfweefrV9yxZtl4-IyYtcTwW1Av-bg_.CU0-EvA2y91nwB77PJAUDf3g_pfLEvi_0 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX', time=2024-09-12T20:50:30.043692+0000, chain.objs.size()=12 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__multipart_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.1 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__shadow_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.1_1 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__multipart_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.2 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__shadow_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.2_1 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__multipart_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.3 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__shadow_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.3_1 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__multipart_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.4 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__shadow_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.4_1 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__multipart_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.5 2024-09-12T18:59:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__shadow_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.5_1 2024-09-12T18:59:59.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.815+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__multipart_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.6 2024-09-12T18:59:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.624__shadow_multipart_enc.2~s5kJlOKmZXIimXFmxU5LQroQIKak9kX.6_1 2024-09-12T18:59:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1907149627564015359', time=2024-09-12T20:50:41.865557+0000, chain.objs.size()=1 2024-09-12T18:59:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.628__shadow_.ft0z985AErJ6ZK-o2-6O8Te0J3UfGvg_0 2024-09-12T18:59:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2563218055502183439', time=2024-09-12T20:52:25.643474+0000, chain.objs.size()=1 2024-09-12T18:59:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.691__shadow_.k-t8ASZLrMnkcxv8zsi3wqfGHzw15UB_0 2024-09-12T18:59:59.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.819+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3277783581880979510', time=2024-09-12T20:53:06.489527+0000, chain.objs.size()=1 2024-09-12T18:59:59.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.819+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.715__shadow:8mZBtJyxefL20T-Izhi86gFaknTOe0n_.gfket4vwFXv6huqxddXES0KHMPevEJn_0 2024-09-12T18:59:59.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.823+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.823+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:59:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44243' 2024-09-12T18:59:59.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16860583439130821206', time=2024-09-12T20:22:25.462468+0000, chain.objs.size()=1 2024-09-12T18:59:59.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.160__shadow_.dWCd3t_TbVWInUXd-Q82VCFBGKEv1Zd_0 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11572653799390640305', time=2024-09-12T20:26:34.421640+0000, chain.objs.size()=1 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.237__shadow_.18GUnMmiECoZwn9o3Da-pxfmAxngbgh_0 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13045712596692184583', time=2024-09-12T20:26:51.041843+0000, chain.objs.size()=1 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.248__shadow_.381ac82jUAsBMYlYuavU16uEl8OpT90_0 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9933033924191532724', time=2024-09-12T20:27:08.947567+0000, chain.objs.size()=1 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.261__shadow_.7YlaWG98AvwzdJBrU25cm3ON5DJnTq0_0 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5573643193276925047', time=2024-09-12T20:28:48.685523+0000, chain.objs.size()=1 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1DbNNpmt1r-ASITq22jtcorpjcJiGm7_0 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17266726563203707536', time=2024-09-12T20:28:49.483942+0000, chain.objs.size()=1 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CigqToR4WjSNR4H5dK78bUFgNEurmy-_0 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3062134940773217580', time=2024-09-12T20:28:52.853703+0000, chain.objs.size()=1 2024-09-12T18:59:59.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ceL6uFdYwnmB3g0hKxcz-5TsliG_U7C_0 2024-09-12T18:59:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14154978568006925876', time=2024-09-12T20:28:53.559505+0000, chain.objs.size()=1 2024-09-12T18:59:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.w33tmA41NTmZK1HnPU1TO5Hkm6XzbHr_0 2024-09-12T18:59:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12192565773672159162', time=2024-09-12T20:28:55.706526+0000, chain.objs.size()=1 2024-09-12T18:59:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.R0w9DeYBYiCKUstH5PuL5xm6UgeRhvq_0 2024-09-12T18:59:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12553424768292406349', time=2024-09-12T20:28:55.911367+0000, chain.objs.size()=1 2024-09-12T18:59:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.YnqCCY7Mdmot2G4CZAI_btUynGygoz4_0 2024-09-12T18:59:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8025415336216059877', time=2024-09-12T20:28:56.006864+0000, chain.objs.size()=1 2024-09-12T18:59:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.o-FoyjtOpD4imatVyHTj2I-iK7I8QHu_0 2024-09-12T18:59:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6431557787280480473', time=2024-09-12T20:28:56.549280+0000, chain.objs.size()=1 2024-09-12T18:59:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.y9BzE2M9o4baH6rhn1i48L17r8ZtsuQ_0 2024-09-12T18:59:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4194321068459198308', time=2024-09-12T20:28:59.019928+0000, chain.objs.size()=1 2024-09-12T18:59:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.KJenkY_5Fis3IesJO0wHu8NAcuh-78T_0 2024-09-12T18:59:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12771581818779450713', time=2024-09-12T20:28:59.323242+0000, chain.objs.size()=1 2024-09-12T18:59:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.qZKmn7Xw4-UOQv-_JsrKZcBIsX9dqre_0 2024-09-12T18:59:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18164857947953163606', time=2024-09-12T20:28:59.397487+0000, chain.objs.size()=1 2024-09-12T18:59:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rdqVICNC3Zn54nee3RXslOGb1EKT_xQ_0 2024-09-12T18:59:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11467378080834536928', time=2024-09-12T20:28:59.843636+0000, chain.objs.size()=1 2024-09-12T18:59:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.827+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.yqbY3GPhGsWYmt8CNiDOar5YwiDP1sz_0 2024-09-12T18:59:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1705981094529120316', time=2024-09-12T20:29:00.599410+0000, chain.objs.size()=1 2024-09-12T18:59:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.RrdRHNltL0VPesRtOEFe1qJuyJ6AaG6_0 2024-09-12T18:59:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11175703031679887802', time=2024-09-12T20:29:00.933090+0000, chain.objs.size()=1 2024-09-12T18:59:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.iDkDIKhTh9vM2wVY2Iot4dqzhdfEBD3_0 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7497227893066310767', time=2024-09-12T20:29:01.453605+0000, chain.objs.size()=1 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._9bvNUv08cS-yDbWYcqIVs96gbwaF7E_0 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6915122290597097316', time=2024-09-12T20:29:02.710336+0000, chain.objs.size()=1 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.jsmPShqnYLS3RQzs8cPIcn7ZBdt3-QW_0 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10326491685777758670', time=2024-09-12T20:29:02.887609+0000, chain.objs.size()=1 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.QUuUDgsg23KHlpr6wbF-u8MhIHklBN8_0 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17063858023712607344', time=2024-09-12T20:29:03.100393+0000, chain.objs.size()=1 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OVnGyN4RK6iGIJLlbFO0HVxU_MuYVEJ_0 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11229157947234083736', time=2024-09-12T20:29:03.475847+0000, chain.objs.size()=1 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JBq7E01ryJ59TM3v56ttm7X2NiTdf0u_0 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1088957843367141993', time=2024-09-12T20:29:04.154289+0000, chain.objs.size()=1 2024-09-12T18:59:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._uycmnBMQjlIiZmgpIpFqvSMARW8_ck_0 2024-09-12T18:59:59.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1367718829826871241', time=2024-09-12T20:29:04.485041+0000, chain.objs.size()=1 2024-09-12T18:59:59.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AlZuK1oSYxHCk1OswXbvKoV9JVQ856i_0 2024-09-12T18:59:59.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17212437509080988759', time=2024-09-12T20:29:05.291088+0000, chain.objs.size()=1 2024-09-12T18:59:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.c3CDBpvDWxP-bOB5GxO4w6K0SkMkeMu_0 2024-09-12T18:59:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12612125086848418989', time=2024-09-12T20:29:06.073752+0000, chain.objs.size()=1 2024-09-12T18:59:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.uxnWES4yS4ma7VeJtNg8XlBUOxmZkzD_0 2024-09-12T18:59:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17722483753172871309', time=2024-09-12T20:29:06.496565+0000, chain.objs.size()=1 2024-09-12T18:59:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.npOzDDO5WBh-Uho9pqwaySHT6a080jR_0 2024-09-12T18:59:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8210269662646080305', time=2024-09-12T20:29:09.560455+0000, chain.objs.size()=1 2024-09-12T18:59:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8Z9cQpFxDhrFa7fA_PmjPH_ld1mfgCb_0 2024-09-12T18:59:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18303216106412306732', time=2024-09-12T20:29:10.554467+0000, chain.objs.size()=1 2024-09-12T18:59:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5hYA47lMzboGenZhV9izb7hWDKutWCz_0 2024-09-12T18:59:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10028211298894357022', time=2024-09-12T20:29:11.399449+0000, chain.objs.size()=1 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.K5Z4zZgaIovl9uYe20auu1iP4AX3BYX_0 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8177188118250746263', time=2024-09-12T20:29:12.077299+0000, chain.objs.size()=1 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bbBK-j6QeXA-PICu380Igg037YsuQgR_0 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10088390201577350534', time=2024-09-12T20:29:13.294827+0000, chain.objs.size()=1 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.nPdALX42yEttixGHyBl11y8r8uTucT3_0 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10138257238732007277', time=2024-09-12T20:29:14.901373+0000, chain.objs.size()=1 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WD8coGNJ-Q9Aunov9WSQYaADNt-_O5q_0 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11065763096759598533', time=2024-09-12T20:29:30.741603+0000, chain.objs.size()=1 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.274__shadow_.py53ugreCWZ984tu2jFiG5z8q6V1GY6_0 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14885196748443513129', time=2024-09-12T20:29:53.277481+0000, chain.objs.size()=1 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.290__shadow_.WM50VGrDG3HEZnOa6NHzFZQGOvtvhyz_0 2024-09-12T18:59:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4499375466346949716', time=2024-09-12T20:29:54.817915+0000, chain.objs.size()=1 2024-09-12T18:59:59.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.831+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.291__shadow_.7ATtEQdLYVL-m508bH3GOTPT37_GEll_0 2024-09-12T18:59:59.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14277488800192103336', time=2024-09-12T20:29:59.048539+0000, chain.objs.size()=1 2024-09-12T18:59:59.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.ptIvyCqNOpEu-M7M3_WQDdSZ7raE8ar_0 2024-09-12T18:59:59.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10758403168155377313', time=2024-09-12T20:30:09.527335+0000, chain.objs.size()=1 2024-09-12T18:59:59.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.297__shadow_.BmLExUfEwtqa7W9GFb539EO-fc_U6d3_0 2024-09-12T18:59:59.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9116606955867018787', time=2024-09-12T20:30:22.619520+0000, chain.objs.size()=1 2024-09-12T18:59:59.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.306__shadow_.-dl-eCMkI9ipvZCx8FnrFAA_nskZkBJ_0 2024-09-12T18:59:59.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.411375025739355025', time=2024-09-12T20:32:27.316840+0000, chain.objs.size()=1 2024-09-12T18:59:59.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.xrICs9tzYDLQ0afMJscYgQFy8cxqKHf_0 2024-09-12T18:59:59.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9459155977221314498', time=2024-09-12T20:32:27.319368+0000, chain.objs.size()=1 2024-09-12T18:59:59.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.l0dvaZDaK4WZWSz4dUIUGcFwqlrFUMD_0 2024-09-12T18:59:59.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15873718667108240852', time=2024-09-12T20:32:27.798474+0000, chain.objs.size()=1 2024-09-12T18:59:59.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7FmRA_X2jy817SMYATY2ojHhIej3WlB_0 2024-09-12T18:59:59.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14220707268995962932', time=2024-09-12T20:32:27.913174+0000, chain.objs.size()=1 2024-09-12T18:59:59.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3VJeXTTZd2QqCEynJc4qYjeoKpB2S1__0 2024-09-12T18:59:59.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2308457287144109024', time=2024-09-12T20:32:28.103395+0000, chain.objs.size()=1 2024-09-12T18:59:59.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.bJdtrHCWkHhnybFeSCpqgtWBMNH6stw_0 2024-09-12T18:59:59.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3161937187484411551', time=2024-09-12T20:32:31.097946+0000, chain.objs.size()=1 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Yg-blRCRvkLhgz-4QWsXU7JeVauI3gi_0 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6333976560700429405', time=2024-09-12T20:32:31.099623+0000, chain.objs.size()=1 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wvmaWj-we8YDQ2vXzWTiGt8ZR3Oa8_F_0 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6193384110557343836', time=2024-09-12T20:32:31.861416+0000, chain.objs.size()=1 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.G4WWQ3U0q0nq5aruENMstTOjKtbNQbI_0 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1494682378799213210', time=2024-09-12T20:32:35.083619+0000, chain.objs.size()=1 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.LTYfDgYsnBuyZkqG3-0Nd5Gyum2hI3l_0 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3097383431238304791', time=2024-09-12T20:32:35.115340+0000, chain.objs.size()=1 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.-nFEJR83iYQoGz6sNx4LDbUTZHShXiP_0 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16546281809801860462', time=2024-09-12T20:32:35.357128+0000, chain.objs.size()=1 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.eIT6JuRo1Dk8PUXIJf3gMIWPDhwvnJS_0 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10243515584009445884', time=2024-09-12T20:32:35.607813+0000, chain.objs.size()=1 2024-09-12T18:59:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rulG-UquhIx5n6z0ZBUwnE_BZxS9ro5_0 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16668668318043422427', time=2024-09-12T20:32:36.191019+0000, chain.objs.size()=1 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.-9bvHzY0Wfy2wunb2AMDj4v0NXB7_81_0 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2157514683687076537', time=2024-09-12T20:32:36.899028+0000, chain.objs.size()=1 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.iwlq0KW1HDOYmdJKybvD1UWtnpNYbLh_0 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2919114850890387360', time=2024-09-12T20:32:37.891422+0000, chain.objs.size()=1 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.kTvU5cWKnRys_im-eW7fm4QxhIle9UL_0 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.634650617786421961', time=2024-09-12T20:32:38.124673+0000, chain.objs.size()=1 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.alwyOq12fpuZeYBf_mXuzPyQHJOGd7c_0 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6455425180331599997', time=2024-09-12T20:32:38.343299+0000, chain.objs.size()=1 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.-o8g97Y-cz5ZGakcAF6QdBV_dbO41-0_0 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6706509928281525483', time=2024-09-12T20:32:38.794447+0000, chain.objs.size()=1 2024-09-12T18:59:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.4dTpl1Lm7q9ewS8TrDOsdIj6HAHp9qE_0 2024-09-12T18:59:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4458658975868107343', time=2024-09-12T20:32:39.528144+0000, chain.objs.size()=1 2024-09-12T18:59:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.835+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.MAwSnACWGx2wF3rVYO3ZCGrnQUgphCX_0 2024-09-12T18:59:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10501103753611625418', time=2024-09-12T20:32:39.578224+0000, chain.objs.size()=1 2024-09-12T18:59:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.r3Jw6RaSkCQoFoNdUkgix-atNCfzCSS_0 2024-09-12T18:59:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14321591164440390261', time=2024-09-12T20:32:40.201009+0000, chain.objs.size()=1 2024-09-12T18:59:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.N92ceZ0aIqeHi8UrqE4WHBHknC5sCt__0 2024-09-12T18:59:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16517520168728048304', time=2024-09-12T20:32:42.066854+0000, chain.objs.size()=1 2024-09-12T18:59:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.qNuuHuC08uHXj9XYqFdC6XzzM1b5UAc_0 2024-09-12T18:59:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5092845697049156798', time=2024-09-12T20:32:42.514493+0000, chain.objs.size()=1 2024-09-12T18:59:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.vOmYk3OgvYom7aincWdLSq9aApDICWs_0 2024-09-12T18:59:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13092787408660156347', time=2024-09-12T20:32:43.516407+0000, chain.objs.size()=1 2024-09-12T18:59:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gvRtxLBq0_EFLFkOl87KEIPbuojoYdB_0 2024-09-12T18:59:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3095318197232523867', time=2024-09-12T20:32:44.814790+0000, chain.objs.size()=1 2024-09-12T18:59:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.f7fcTj5NsUTIW07g-VPSdoG8mL8VD6T_0 2024-09-12T18:59:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2879199637928119218', time=2024-09-12T20:32:45.125633+0000, chain.objs.size()=1 2024-09-12T18:59:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.S4Ms0BCJ0BvBWY7q43OFN90MxHalQy0_0 2024-09-12T18:59:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9979996275855781784', time=2024-09-12T20:32:46.963100+0000, chain.objs.size()=1 2024-09-12T18:59:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.qS_ySBcdIVSpZYy-_ZV25bBOm7_0U3D_0 2024-09-12T18:59:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9591763324889511921', time=2024-09-12T20:32:48.740340+0000, chain.objs.size()=1 2024-09-12T18:59:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.suGBpDtKd39R7XJMtwmwX4GJ2whCAoK_0 2024-09-12T18:59:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10486691403473068393', time=2024-09-12T20:32:49.218857+0000, chain.objs.size()=1 2024-09-12T18:59:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.xN368Fm1Z19ZXYTbMGuJ3lLtvk9W21i_0 2024-09-12T18:59:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13414766740806644652', time=2024-09-12T20:32:51.643181+0000, chain.objs.size()=1 2024-09-12T18:59:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Pw6z0zjtorU2cvrsG0mTElLwWH-jihD_0 2024-09-12T18:59:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3724857774678005585', time=2024-09-12T20:32:52.108696+0000, chain.objs.size()=1 2024-09-12T18:59:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.F5f-Ckaz0OR1jc9gQzvS5VU6p2pSyNu_0 2024-09-12T18:59:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6235128764123137149', time=2024-09-12T20:32:52.648976+0000, chain.objs.size()=1 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Td-23_1P_GY7Gg5d8vHw-4BGbpLrvb8_0 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12056685132798265259', time=2024-09-12T20:32:53.016475+0000, chain.objs.size()=1 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.JE1Fg-LQUdMq7N8d-PhDXvy3uZnQyRn_0 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3378901567759803363', time=2024-09-12T20:32:53.353961+0000, chain.objs.size()=1 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3ZuVQ7-jJxZg6vYENSXIAtyznX-Fld0_0 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12306542002266611258', time=2024-09-12T20:32:53.613343+0000, chain.objs.size()=1 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.J_KhbSxKllAp5KUgydkkJaVfBYr2Qnh_0 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6338958652229168810', time=2024-09-12T20:32:53.615476+0000, chain.objs.size()=1 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.McgVfn0N9AhCHrGvYMuE4nA8Q1ysdEy_0 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11246130532380372250', time=2024-09-12T20:34:34.485869+0000, chain.objs.size()=1 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9Dk8G-6T7minAGP2Jl5N6v1MFvnergY_0 2024-09-12T18:59:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5487204317895463038', time=2024-09-12T20:34:35.068747+0000, chain.objs.size()=1 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.2hhtDbjeL2OwBnQGMh1SiJnk3zQpL0T_0 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6654625224256138572', time=2024-09-12T20:34:38.580082+0000, chain.objs.size()=1 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Z-djp-0iDBoi3TDXYHbtZUl9fxTsd_l_0 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8259267599924856171', time=2024-09-12T20:34:38.618972+0000, chain.objs.size()=1 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.839+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.7sROyFmWikKnrAJg-vVLpugyKl4MKWO_0 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11804387854552497877', time=2024-09-12T20:34:38.764027+0000, chain.objs.size()=1 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hcOAthUKPAj5E1M4aq7uEFgNGq6ostV_0 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1929595008092587390', time=2024-09-12T20:34:39.277792+0000, chain.objs.size()=1 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Fxx5oLar7mO6i2GYD8QFRloxuuEgvfX_0 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5947286590957241331', time=2024-09-12T20:34:41.528831+0000, chain.objs.size()=1 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.VetKjorgw0wsVdcp19gNdrmZRsflD_S_0 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4914380510887266764', time=2024-09-12T20:34:41.531198+0000, chain.objs.size()=1 2024-09-12T18:59:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.I17CR_-CgtG2mn7iN-V_pUuENx3-SO4_0 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4352583783695793449', time=2024-09-12T20:34:41.711029+0000, chain.objs.size()=1 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JTNc1FIbQ7vnH07TU1pjvCxd2oOFIrp_0 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7547202099083574022', time=2024-09-12T20:34:41.877542+0000, chain.objs.size()=1 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JxSbcunQ9Enq9_X7o3RH1d9bUc3PltD_0 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.714578102141465645', time=2024-09-12T20:34:42.137258+0000, chain.objs.size()=1 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ncTHS1DrSZ3l1U8VkBlrG1JUDcuWdmP_0 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18145629845228455197', time=2024-09-12T20:34:44.197058+0000, chain.objs.size()=1 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kz4bA0CA2ghHGRU6gqrenVDr6nZWY10_0 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11754215580273436720', time=2024-09-12T20:34:44.198670+0000, chain.objs.size()=1 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.64h4GvtQkw1p8vuMen31FAxLTdAm3zs_0 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3398249642744819070', time=2024-09-12T20:34:45.404041+0000, chain.objs.size()=1 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._VWDcC8AbdE8G-2qqX9vJNFLhLxb0ry_0 2024-09-12T18:59:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8969224910308796037', time=2024-09-12T20:34:46.761341+0000, chain.objs.size()=1 2024-09-12T18:59:59.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tjB95iVWl6vZYlfxp1X7zNVyQ3K-J8b_0 2024-09-12T18:59:59.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11101146353615613759', time=2024-09-12T20:34:48.810294+0000, chain.objs.size()=1 2024-09-12T18:59:59.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.GDUZVwVdYfZC-Yh2bS-7cyTWeD497uo_0 2024-09-12T18:59:59.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3990880866494976357', time=2024-09-12T20:34:49.597372+0000, chain.objs.size()=1 2024-09-12T18:59:59.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tgJKEfPb6FHPzNL96PcG838QTy6JUyY_0 2024-09-12T18:59:59.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6086560843044695139', time=2024-09-12T20:34:50.850162+0000, chain.objs.size()=1 2024-09-12T18:59:59.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RTrK_fDZNUtCFFgIvgs3xI41Yd87Xf2_0 2024-09-12T18:59:59.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7663447024466726074', time=2024-09-12T20:34:52.657932+0000, chain.objs.size()=1 2024-09-12T18:59:59.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vs6BfhIoY5fMLcPcNxBJ2pE0_LhwtWD_0 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.251397368180904120', time=2024-09-12T20:34:53.490563+0000, chain.objs.size()=1 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.843+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ceieDZWamYJoLfZYwf1jPRdGv-xF6Qy_0 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.847+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13569484909907824430', time=2024-09-12T20:34:53.492252+0000, chain.objs.size()=1 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.847+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.zuww4oEeHkb57ijlZmuOVXfZkVJiWPt_0 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.847+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7036661659302410782', time=2024-09-12T20:34:54.993026+0000, chain.objs.size()=1 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.847+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5lOpHlMvCCo9eTJS7JhUk1ksUolk8m9_0 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.847+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2509963795947814466', time=2024-09-12T20:34:55.805124+0000, chain.objs.size()=1 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.847+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.baSkfUpsJ2eMC0o4Rwwn2Rjh-9iJNJx_0 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.847+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1777212447599222142', time=2024-09-12T20:34:57.243150+0000, chain.objs.size()=1 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.847+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3IZ1bhJNpuzAeXItfcs8OSoNdoRuscH_0 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.847+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44243 2024-09-12T18:59:59.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1941398780840732249', time=2024-09-12T20:34:57.967108+0000, chain.objs.size()=1 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.aOCxEQ4tARLHzxdKy4V7cMNq55-kTfe_0 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16693051480573373479', time=2024-09-12T20:34:58.304521+0000, chain.objs.size()=1 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.36phoncCYSmVKPPsoIXkPOgnAxUTZVn_0 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8034132025522804692', time=2024-09-12T20:34:58.733231+0000, chain.objs.size()=1 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.izKdXTC9BwPGcVK9taAXeZsuBQv6RmD_0 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7463738626382436986', time=2024-09-12T20:34:59.936891+0000, chain.objs.size()=1 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.cdIZcrCRPmAPCa6oNUUc6pPiQnH77Ww_0 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4061221500802136955', time=2024-09-12T20:35:00.955170+0000, chain.objs.size()=1 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RO14sYJkjrhedtOsfnlVy-ddybEIi5T_0 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9382204017954121608', time=2024-09-12T20:35:01.389363+0000, chain.objs.size()=1 2024-09-12T18:59:59.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.NymjXu5s924TaKxsyM2uFGR80QW8wa-_0 2024-09-12T18:59:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10915444846846819419', time=2024-09-12T20:35:01.465397+0000, chain.objs.size()=1 2024-09-12T18:59:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.heUBShGSkpVEXzUMnzfIWdkBtf754Nu_0 2024-09-12T18:59:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16310791482139925351', time=2024-09-12T20:35:54.257300+0000, chain.objs.size()=1 2024-09-12T18:59:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.377__shadow_.7W7CX7nQQKaHQWQNMXfAccm-7PCmH46_0 2024-09-12T18:59:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14291364915172511743', time=2024-09-12T20:37:56.754513+0000, chain.objs.size()=1 2024-09-12T18:59:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.dAFKBUOSw8bH0QfubV88oyZkXlZP-vZ_0 2024-09-12T18:59:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9929172205124195173', time=2024-09-12T20:38:25.337620+0000, chain.objs.size()=1 2024-09-12T18:59:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.503__shadow:RrE07h9QVCnd4UDOAeK8Om93tXQxxPE_.hyGvE7kfORPSZwwerfxAYNUofTKRYRK_0 2024-09-12T18:59:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17696616777352336330', time=2024-09-12T20:38:44.780549+0000, chain.objs.size()=2 2024-09-12T18:59:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.512__shadow_.fnjl49Blt1VEXw52fkgJLnpyBi-ZUcg_0 2024-09-12T18:59:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.512__shadow_.fnjl49Blt1VEXw52fkgJLnpyBi-ZUcg_1 2024-09-12T18:59:59.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~0XFDFRKzX3NSo9l6zV-HigKxtv0dHRS', time=2024-09-12T20:40:33.272687+0000, chain.objs.size()=1 2024-09-12T18:59:59.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~0XFDFRKzX3NSo9l6zV-HigKxtv0dHRS.2 2024-09-12T18:59:59.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~0XFDFRKzX3NSo9l6zV-HigKxtv0dHRS', time=2024-09-12T20:40:33.282508+0000, chain.objs.size()=1 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.522__multipart_mymultipart.2~0XFDFRKzX3NSo9l6zV-HigKxtv0dHRS.3 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9083219869402216005', time=2024-09-12T20:43:44.556229+0000, chain.objs.size()=1 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:6BuQD7RhoAQmuTTGOqrn.osZBpIzuZ6_.bRyC3lTgEmAjfShR-T7VoRXOEylmvwS_0 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10130345406825075038', time=2024-09-12T20:45:05.206554+0000, chain.objs.size()=1 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:mmQhMt7PCjMlMRdmAaxGLCEoDt8sAlf_.lDsiFJYM78TTWceMXnIA5j_CONG4a4I_0 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2784281290434951680', time=2024-09-12T20:46:14.030721+0000, chain.objs.size()=1 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.608__shadow_.MVm3voRx-ao8JIJntHC-kryu9pU0jKi_0 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17906696183127454613', time=2024-09-12T20:51:53.406998+0000, chain.objs.size()=6 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.851+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.662__multipart_foo.2~mWMSoLHQUfT8EEOgsZgSASUff0sNxRG.1 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.662__multipart_foo.2~mWMSoLHQUfT8EEOgsZgSASUff0sNxRG.2 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.662__multipart_foo.2~mWMSoLHQUfT8EEOgsZgSASUff0sNxRG.3 2024-09-12T18:59:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.662__multipart_foo.2~mWMSoLHQUfT8EEOgsZgSASUff0sNxRG.4 2024-09-12T18:59:59.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.662__multipart_foo.2~mWMSoLHQUfT8EEOgsZgSASUff0sNxRG.5 2024-09-12T18:59:59.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.662__multipart_foo.2~mWMSoLHQUfT8EEOgsZgSASUff0sNxRG.6 2024-09-12T18:59:59.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.855+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18431219717771609714', time=2024-09-12T20:51:59.295313+0000, chain.objs.size()=1 2024-09-12T18:59:59.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.665__shadow_.0iwHhLq54PfwRwxx9vn-xHsXtjAj0xy_0 2024-09-12T18:59:59.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.855+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:59:59.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47334' 2024-09-12T18:59:59.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14739065177366636332', time=2024-09-12T20:22:43.966047+0000, chain.objs.size()=5 2024-09-12T18:59:59.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__multipart_foo-FROZEN.2~XZvkEGf2rka3EIE59Ww877FqM_kOJCz.1 2024-09-12T18:59:59.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_foo-FROZEN.2~XZvkEGf2rka3EIE59Ww877FqM_kOJCz.1_1 2024-09-12T18:59:59.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__multipart_foo-FROZEN.2~XZvkEGf2rka3EIE59Ww877FqM_kOJCz.2 2024-09-12T18:59:59.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_foo-FROZEN.2~XZvkEGf2rka3EIE59Ww877FqM_kOJCz.2_1 2024-09-12T18:59:59.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__multipart_foo-FROZEN.2~XZvkEGf2rka3EIE59Ww877FqM_kOJCz.3 2024-09-12T18:59:59.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16553645030505533444', time=2024-09-12T20:23:14.923730+0000, chain.objs.size()=1 2024-09-12T18:59:59.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.179__shadow_.H1-RN6IMElssCc6H57fBgMC_dA50DSP_0 2024-09-12T18:59:59.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5889119428043727707', time=2024-09-12T20:26:34.385339+0000, chain.objs.size()=1 2024-09-12T18:59:59.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.237__shadow_.QT9wNECfX0Oedlx6pZ7fcbDKI-woj2d_0 2024-09-12T18:59:59.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8570355496973201196', time=2024-09-12T20:26:58.083445+0000, chain.objs.size()=1 2024-09-12T18:59:59.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.253__shadow_.q1LuFGCcInOgsvkm7TYEiVS7Qva1hBX_0 2024-09-12T18:59:59.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11154511847250946773', time=2024-09-12T20:26:59.454852+0000, chain.objs.size()=1 2024-09-12T18:59:59.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.254__shadow_.znH2ob-aN484zxr4TOxFTOOla8YoQz8_0 2024-09-12T18:59:59.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17119927525363499744', time=2024-09-12T20:27:00.848203+0000, chain.objs.size()=1 2024-09-12T18:59:59.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.255__shadow_.VpTIuFGPDEBdvKna4Ru0vwdFjOqa5a__0 2024-09-12T18:59:59.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11781182973981164277', time=2024-09-12T20:27:03.542162+0000, chain.objs.size()=1 2024-09-12T18:59:59.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.257__shadow_.ZvUrOS4-JNemBuzz73dC41oXANrTp3J_0 2024-09-12T18:59:59.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4499570285440562229', time=2024-09-12T20:28:48.042597+0000, chain.objs.size()=1 2024-09-12T18:59:59.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.859+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.u8kCQUyAoWY0u64DZ3vB_u4xrX5N4W5_0 2024-09-12T18:59:59.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11050887625263315728', time=2024-09-12T20:28:48.563886+0000, chain.objs.size()=1 2024-09-12T18:59:59.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9BZ73G8C5FavlgyLmKnOkAuA5aPwNFt_0 2024-09-12T18:59:59.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12784290889671112217', time=2024-09-12T20:28:48.684394+0000, chain.objs.size()=1 2024-09-12T18:59:59.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._lPKacBmM0ASVJ8YgKMNHv65cMhZtwu_0 2024-09-12T18:59:59.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13742839268331302262', time=2024-09-12T20:28:49.090053+0000, chain.objs.size()=1 2024-09-12T18:59:59.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Saz2_FBjACWa05GpSTLCtJ5YiLrzk3B_0 2024-09-12T18:59:59.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11501448815478600866', time=2024-09-12T20:28:49.479083+0000, chain.objs.size()=1 2024-09-12T18:59:59.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8RMpPeBH93XhNr9dDcGPj1qfjzWQ2Tb_0 2024-09-12T18:59:59.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5685802958613106257', time=2024-09-12T20:28:52.602701+0000, chain.objs.size()=1 2024-09-12T18:59:59.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AYwtSL8biHcFid7AKXJFRD_3qt5OD3d_0 2024-09-12T18:59:59.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11322266344837854337', time=2024-09-12T20:28:54.099730+0000, chain.objs.size()=1 2024-09-12T18:59:59.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fVSEcWRQ2FsO1v4R84NcRpAAUE0RNJy_0 2024-09-12T18:59:59.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5411566201553016837', time=2024-09-12T20:28:55.371687+0000, chain.objs.size()=1 2024-09-12T18:59:59.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CdzNF5g7IIF3imhoyTpoYua7X-gXyNw_0 2024-09-12T18:59:59.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6709911880386844840', time=2024-09-12T20:28:55.670592+0000, chain.objs.size()=1 2024-09-12T18:59:59.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.NYn4hh1T5z0e1tsTjWomtO00ZpDGyNr_0 2024-09-12T18:59:59.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11365182262330784698', time=2024-09-12T20:28:55.892262+0000, chain.objs.size()=1 2024-09-12T18:59:59.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.OL2duxuBRDPKBT3RtYfXyv71DWNbzgn_0 2024-09-12T18:59:59.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16303237853308587124', time=2024-09-12T20:28:56.665496+0000, chain.objs.size()=1 2024-09-12T18:59:59.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.XxhvqpW5GzyPesGplFCmv6iobGWAcKQ_0 2024-09-12T18:59:59.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12188176158190931992', time=2024-09-12T20:28:57.332113+0000, chain.objs.size()=1 2024-09-12T18:59:59.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.jrbsTVtTzRRQkWgkb4Nzdr3hpGQX7p2_0 2024-09-12T18:59:59.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2755921534743414395', time=2024-09-12T20:28:57.664412+0000, chain.objs.size()=1 2024-09-12T18:59:59.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VKeXphQmqk1XSBrPRtgs0pEZFcnKXzs_0 2024-09-12T18:59:59.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16087715064317372806', time=2024-09-12T20:28:57.666455+0000, chain.objs.size()=1 2024-09-12T18:59:59.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3-NDMs5W8QcM1RyBUjBibipRgjQXKYg_0 2024-09-12T18:59:59.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7015723370969350004', time=2024-09-12T20:28:58.985420+0000, chain.objs.size()=1 2024-09-12T18:59:59.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ltwXERO2JpGydbgq8hdR_qt_P9mhvLz_0 2024-09-12T18:59:59.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6539941009859791471', time=2024-09-12T20:28:59.401108+0000, chain.objs.size()=1 2024-09-12T18:59:59.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.863+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8lgHjOJp9gx-o-3yPZLSrC92tN2Ai1m_0 2024-09-12T18:59:59.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12419573324219191577', time=2024-09-12T20:28:59.700630+0000, chain.objs.size()=1 2024-09-12T18:59:59.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tbky6jR_wID2hQwfdJFA-Tq1jkkY89Q_0 2024-09-12T18:59:59.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8793196883756158803', time=2024-09-12T20:28:59.803718+0000, chain.objs.size()=1 2024-09-12T18:59:59.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.zxe3xHY7pDnvxRyxhXdYKLACjK5a3zE_0 2024-09-12T18:59:59.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8441163510403151662', time=2024-09-12T20:28:59.805183+0000, chain.objs.size()=1 2024-09-12T18:59:59.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.uRB8UH4ewCifhlgVj83RcS6rP4q-Ixl_0 2024-09-12T18:59:59.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16289091494723639132', time=2024-09-12T20:29:00.384234+0000, chain.objs.size()=1 2024-09-12T18:59:59.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.6p4xn6OZKpAZ6kMGiEMizlsJoH4PxBE_0 2024-09-12T18:59:59.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5841700221428074721', time=2024-09-12T20:29:01.109122+0000, chain.objs.size()=1 2024-09-12T18:59:59.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ePoIJ2h8SvceFwZ1q1ytevEUxn_IZyT_0 2024-09-12T18:59:59.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1000650011226319160', time=2024-09-12T20:29:01.468245+0000, chain.objs.size()=1 2024-09-12T18:59:59.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.de7WLzu_PsU69s43yaJt3_pojwNmU57_0 2024-09-12T18:59:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12591589804892886356', time=2024-09-12T20:29:01.680700+0000, chain.objs.size()=1 2024-09-12T18:59:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.0DoHNx-SqA0Tnq27-OSUdDmhzw9qS6R_0 2024-09-12T18:59:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16935750988731487882', time=2024-09-12T20:29:02.525082+0000, chain.objs.size()=1 2024-09-12T18:59:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ctXpEvOiHUpUkWCBBXfpnLk33otjmZn_0 2024-09-12T18:59:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8612118208870303786', time=2024-09-12T20:29:03.066977+0000, chain.objs.size()=1 2024-09-12T18:59:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.821UKRve3frBm2cTJouj9rMeb2Wg42U_0 2024-09-12T18:59:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14366900129735768349', time=2024-09-12T20:29:03.929726+0000, chain.objs.size()=1 2024-09-12T18:59:59.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bKvjhhYkm0t98X1y0w-QIy-UkgNA3M__0 2024-09-12T18:59:59.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5345341945506912342', time=2024-09-12T20:29:04.076820+0000, chain.objs.size()=1 2024-09-12T18:59:59.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7ebuKyNGaK4X5eKeCE8-WTfzRhfvZCf_0 2024-09-12T18:59:59.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14135153277618711350', time=2024-09-12T20:29:05.260081+0000, chain.objs.size()=1 2024-09-12T18:59:59.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.-nXsspMYdo3_9Te2c0GdNxXe52udyw3_0 2024-09-12T18:59:59.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6989948323200706596', time=2024-09-12T20:29:05.262225+0000, chain.objs.size()=1 2024-09-12T18:59:59.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3BMl0F2j_xer-zC8d7r4FGs0adLnRAh_0 2024-09-12T18:59:59.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5160838168460854628', time=2024-09-12T20:29:07.217430+0000, chain.objs.size()=1 2024-09-12T18:59:59.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.867+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._mazknpuGvZY5KBiRgqjuLBm3tjOpwP_0 2024-09-12T18:59:59.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5457935389969608702', time=2024-09-12T20:29:07.435609+0000, chain.objs.size()=1 2024-09-12T18:59:59.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bTD33UEcx_jCyNJCV7Tgzo-gIpkcEB__0 2024-09-12T18:59:59.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7511287050247847435', time=2024-09-12T20:29:07.666302+0000, chain.objs.size()=1 2024-09-12T18:59:59.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.lU_jMYQX6M_w8ylWvjuLqe2-HGc2tdT_0 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8004959975637386092', time=2024-09-12T20:29:08.348919+0000, chain.objs.size()=1 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ooHwhlG81zRT-1extdhZuUS71pwIRjq_0 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11541469331125598669', time=2024-09-12T20:29:09.498432+0000, chain.objs.size()=1 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.TGmLSj4ky1h34mS05plPcpPQChOIyNU_0 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.593373374136759069', time=2024-09-12T20:29:09.571503+0000, chain.objs.size()=1 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kqG6s5Ed8qG8yMO0wnzHP72cGUuuaPT_0 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.651487775111642936', time=2024-09-12T20:29:10.270131+0000, chain.objs.size()=1 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.zXsMF3SIFBe4CxZ8Dv_j4cj0kK-TsZA_0 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18002479642588161807', time=2024-09-12T20:29:11.689163+0000, chain.objs.size()=1 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.hyTqwnUoS-GVbEq3s02QkwB1cnlccsy_0 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16831083332781167808', time=2024-09-12T20:29:13.261138+0000, chain.objs.size()=1 2024-09-12T18:59:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Q--RTDCO3eumRIv-Gskml5cMltentfq_0 2024-09-12T18:59:59.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11491304787848168312', time=2024-09-12T20:29:13.658434+0000, chain.objs.size()=1 2024-09-12T18:59:59.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.6kmk_QoPFA_GWSSdW_VbbvbJBW3Hxxi_0 2024-09-12T18:59:59.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17299870554764731171', time=2024-09-12T20:29:14.042446+0000, chain.objs.size()=1 2024-09-12T18:59:59.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FSQOCcdxwDcfzndZpFj5RxF6dZseSDO_0 2024-09-12T18:59:59.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14450274779670668852', time=2024-09-12T20:29:15.234551+0000, chain.objs.size()=1 2024-09-12T18:59:59.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fVAKtDTWNAdLIaOz-4aXslfUWA2Kb4B_0 2024-09-12T18:59:59.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15541521746850819737', time=2024-09-12T20:29:15.441253+0000, chain.objs.size()=1 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VmRAR9NaWgSY4YLr9gde0bpc2ByaibD_0 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15199146110388131953', time=2024-09-12T20:29:19.328567+0000, chain.objs.size()=1 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.265__shadow_.sYb-3jRV9vF02hQJaipNOY-xtINJsXZ_0 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6642059752424768272', time=2024-09-12T20:29:39.171299+0000, chain.objs.size()=1 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.280__shadow_.Y9c5Fqo9H_SZgeARw2pX_YWo5XHNByq_0 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.216442619270296414', time=2024-09-12T20:29:59.071331+0000, chain.objs.size()=1 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.IRI1z5OvH8FSWigsNErguovQM6vVumH_0 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15529361001544840435', time=2024-09-12T20:30:12.545552+0000, chain.objs.size()=1 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.299__shadow_.4GyVf7tMCg5CqpG8EFqglsg81KCnSwt_0 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7449651094277398023', time=2024-09-12T20:30:12.547488+0000, chain.objs.size()=1 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.299__shadow_.FXmugnFIaNLaMK_JjSHEC6qe0BiDfCT_0 2024-09-12T18:59:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6769028019455605482', time=2024-09-12T20:30:41.169499+0000, chain.objs.size()=1 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.871+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.319__shadow:uUzg--.HNvwVoOTBtcapBOrYgiRhMBJ_.nsehvuHo1rZF8BAh2uPc0-BZl7J0OqC_0 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14755169266084671262', time=2024-09-12T20:32:27.541790+0000, chain.objs.size()=1 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.d-G-8Xi7mdLcTuy8vor37tF3SOlzyYq_0 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8230464439077268905', time=2024-09-12T20:32:31.864193+0000, chain.objs.size()=1 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.UJOTWiDI9IvbneOHeGOoVXjPBD-u1PP_0 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10352425648579924078', time=2024-09-12T20:32:31.899109+0000, chain.objs.size()=1 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.a_6YqHLjCimcyU-EKkC87352aYenJjA_0 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7145369055665120748', time=2024-09-12T20:32:32.333141+0000, chain.objs.size()=1 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wGc8Ch31He93DAYuJDjn-nu_QKJEGlb_0 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15636386836332736069', time=2024-09-12T20:32:32.759530+0000, chain.objs.size()=1 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.A15ORO8YzRyJga-mpXVfoho9NYZe4g-_0 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4542880123236620898', time=2024-09-12T20:32:33.310738+0000, chain.objs.size()=1 2024-09-12T18:59:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Lw_we6Ki3ksYyzIKGtz4HElKC1nkReq_0 2024-09-12T18:59:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2634308564755075260', time=2024-09-12T20:32:34.699798+0000, chain.objs.size()=1 2024-09-12T18:59:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.an0KtPOH7_3WCZIVOpdUj992nJhz7V-_0 2024-09-12T18:59:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16572378744265920393', time=2024-09-12T20:32:37.799047+0000, chain.objs.size()=1 2024-09-12T18:59:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HUvgK0P2uIhfR2evC4uwXaPsW9E5M3R_0 2024-09-12T18:59:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1342001268497854190', time=2024-09-12T20:32:37.909493+0000, chain.objs.size()=1 2024-09-12T18:59:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.6xafvpqAAkK4YzKK1AJCXsrpd5dbOx__0 2024-09-12T18:59:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13038373331356064816', time=2024-09-12T20:32:38.123709+0000, chain.objs.size()=1 2024-09-12T18:59:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.IHGVVN2G3fM4hxHbLvTGi-Mn1LAPC9X_0 2024-09-12T18:59:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10940901504050783788', time=2024-09-12T20:32:38.790865+0000, chain.objs.size()=1 2024-09-12T18:59:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.9RwZ9Y5n0B0Gnoe-6WL_HabKs73nU84_0 2024-09-12T18:59:59.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11875016163725358255', time=2024-09-12T20:32:39.297452+0000, chain.objs.size()=1 2024-09-12T18:59:59.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HeDKT6_vwA9CqyOevIalb5P0rSfWCLm_0 2024-09-12T18:59:59.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6801746204626774665', time=2024-09-12T20:32:40.207955+0000, chain.objs.size()=1 2024-09-12T18:59:59.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.L8XeSVzHAy-ib6gOrhqpkvjs1P2mD-C_0 2024-09-12T18:59:59.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2423483660640148968', time=2024-09-12T20:32:41.256933+0000, chain.objs.size()=1 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nclugFZmJjTRy3_p-bTp7Aa3B3U251h_0 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10845111118901115669', time=2024-09-12T20:32:42.030259+0000, chain.objs.size()=1 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.L6Cja8F5o0HyCPzZAmG9Y211xQsAuj2_0 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16136667545454060021', time=2024-09-12T20:32:42.854483+0000, chain.objs.size()=1 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.xpixozLd9xBK6ZIgJ-SlFCM2DkIz2DE_0 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16330048926163323099', time=2024-09-12T20:32:43.862660+0000, chain.objs.size()=1 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.X5GQsj6PPqgvVc_0p08C4f6gt-UHNeP_0 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1603974621140325902', time=2024-09-12T20:32:44.647992+0000, chain.objs.size()=1 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.cJFpggq75fQszWvepPz7MnAO21eaRNj_0 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7164038144694375568', time=2024-09-12T20:32:45.439184+0000, chain.objs.size()=1 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8HlQWQqziRWb9es73yq3S6YZE_5yErx_0 2024-09-12T18:59:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18418188974934560181', time=2024-09-12T20:32:45.691222+0000, chain.objs.size()=1 2024-09-12T18:59:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gfjm8WGAUY3dINctvaUEjhbHy1RofhX_0 2024-09-12T18:59:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17321572064758838567', time=2024-09-12T20:32:45.930311+0000, chain.objs.size()=1 2024-09-12T18:59:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Vfkn0-EtLd2nn_WvfCrky-4IQw4_w37_0 2024-09-12T18:59:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11969095134896414889', time=2024-09-12T20:32:47.030154+0000, chain.objs.size()=1 2024-09-12T18:59:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.TIsqbhPFJy7qmraOxBLVOa57U-asYKB_0 2024-09-12T18:59:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7505564872080441581', time=2024-09-12T20:32:48.361496+0000, chain.objs.size()=1 2024-09-12T18:59:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.e5VsK-b7wtAz8nMXaXdCA0bQvzeb94j_0 2024-09-12T18:59:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16128730965751907410', time=2024-09-12T20:32:48.660125+0000, chain.objs.size()=1 2024-09-12T18:59:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.875+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ztAmj49paE5e2yI0ENK2UcjVd4HuZ6I_0 2024-09-12T18:59:59.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11115596091737074320', time=2024-09-12T20:32:49.215877+0000, chain.objs.size()=1 2024-09-12T18:59:59.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.DQq2NYAQjPxSWlbCtMZWsHrdVp5Mt64_0 2024-09-12T18:59:59.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4594423591587509756', time=2024-09-12T20:32:49.449566+0000, chain.objs.size()=1 2024-09-12T18:59:59.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.F0XqRXWJFemKn4_vW_PtgKl0tdsMoVZ_0 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12381799854261326584', time=2024-09-12T20:32:50.028121+0000, chain.objs.size()=1 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.NV-78Z-y0JPywgfvCenfNBv5IWA_3c__0 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15686607384274480213', time=2024-09-12T20:32:50.960455+0000, chain.objs.size()=1 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.DeHitc7VF6cXflPHa669SEH1AbDfR-H_0 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5057342066350249563', time=2024-09-12T20:32:52.637462+0000, chain.objs.size()=1 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.iAFHtxgzdw6RtgFSg1aOUdRghrgGHfV_0 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10005976315427683566', time=2024-09-12T20:32:53.331368+0000, chain.objs.size()=1 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.V9SLrk4eN4uwCbDXSxeKcUzmaBi08FQ_0 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14530651493202991053', time=2024-09-12T20:34:34.078169+0000, chain.objs.size()=1 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.WaxTvNMANybaspfXWeM0XAla1HKge4X_0 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2397026753560121753', time=2024-09-12T20:34:34.481924+0000, chain.objs.size()=1 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._PH6kVr8Oia7IekSWiK1NHjaKyIeqoQ_0 2024-09-12T18:59:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6985061209174502022', time=2024-09-12T20:34:36.062413+0000, chain.objs.size()=1 2024-09-12T18:59:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.lttC4bmPakfqZ1nBGQBv0txxUlaZYwV_0 2024-09-12T18:59:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16010051509300040224', time=2024-09-12T20:34:39.078628+0000, chain.objs.size()=1 2024-09-12T18:59:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.byf49--DHzth8sZgBmiDDLMm-axfPTl_0 2024-09-12T18:59:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18446666409355920960', time=2024-09-12T20:34:39.220848+0000, chain.objs.size()=1 2024-09-12T18:59:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.TKM7jZdteRBATnGCRbHooz_k95gWUvR_0 2024-09-12T18:59:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1867632346435704923', time=2024-09-12T20:34:39.943904+0000, chain.objs.size()=1 2024-09-12T18:59:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.879+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5tVF8k2ML5P5TlPocyE2vMZhE38eDOa_0 2024-09-12T18:59:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11786978061936449934', time=2024-09-12T20:34:40.129781+0000, chain.objs.size()=1 2024-09-12T18:59:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Qyt7wSY7JlR3k1roUOvWXjxiDVVYyPU_0 2024-09-12T18:59:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6310872576142895910', time=2024-09-12T20:34:41.418637+0000, chain.objs.size()=1 2024-09-12T18:59:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.zOX7U5SDTpX1W8TZ0bQqD8J3lwvhoNe_0 2024-09-12T18:59:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15464938801176484455', time=2024-09-12T20:34:42.259505+0000, chain.objs.size()=1 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XrXut7XGo6CFv68Fn5-c5AiXJjhgOcS_0 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17954783266679041923', time=2024-09-12T20:34:42.388179+0000, chain.objs.size()=1 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vPlrhuuzIze9UttPen890ibc4ROsTCk_0 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2312076954992870780', time=2024-09-12T20:34:42.831566+0000, chain.objs.size()=1 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9FZY9QRCtRErXpr1l0s11yArwoDTSNp_0 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9295680707149848545', time=2024-09-12T20:34:43.091201+0000, chain.objs.size()=1 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.x_okdyyM38EhrQ9ZAaMxjr6xQWHoleD_0 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5363951540183617250', time=2024-09-12T20:34:43.559821+0000, chain.objs.size()=1 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ugNOF7qWSQOXyOoxvDuIRp08D3GtOqB_0 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14207771767804020755', time=2024-09-12T20:34:43.894504+0000, chain.objs.size()=1 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.7PoUCelg754MJumOAvShLn-gJTqwlUK_0 2024-09-12T18:59:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17776370303433151137', time=2024-09-12T20:34:44.279812+0000, chain.objs.size()=1 2024-09-12T18:59:59.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vNrrRQCmRpwtjGtFcOYMO-DnN94CcB9_0 2024-09-12T18:59:59.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.883+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47334 2024-09-12T18:59:59.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-12T18:59:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11207203669994140075', time=2024-09-12T20:34:45.102893+0000, chain.objs.size()=1 2024-09-12T18:59:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wb6NvCulewiVy-wjZfC3K9OdxKL5pCh_0 2024-09-12T18:59:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6250402158863392654', time=2024-09-12T20:34:45.249413+0000, chain.objs.size()=1 2024-09-12T18:59:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1EpJWtJfNYBPIDps7P2wan3KX8G3FDh_0 2024-09-12T18:59:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.313216658412526595', time=2024-09-12T20:34:45.411125+0000, chain.objs.size()=1 2024-09-12T18:59:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Fy2_1Jl1AsMHqwOnOZtvYCK17PeGiUa_0 2024-09-12T18:59:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9158698733553569085', time=2024-09-12T20:34:46.433775+0000, chain.objs.size()=1 2024-09-12T18:59:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.2L2HhsPXvcrST-tJrqjdv-T_s3_GSXz_0 2024-09-12T18:59:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1410318319570536605', time=2024-09-12T20:34:46.635594+0000, chain.objs.size()=1 2024-09-12T18:59:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ag-iBUYsgZefeNVuChB_ExzgMInfHBS_0 2024-09-12T18:59:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17398793561102888393', time=2024-09-12T20:34:48.861651+0000, chain.objs.size()=1 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.o6sn3XIJedqFQECDEMvtsAwMc8WrReF_0 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18338233298193586319', time=2024-09-12T20:34:49.268577+0000, chain.objs.size()=1 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.zPAJg46HH9NObUOsBePu7QyjDAMKWFo_0 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3248140220071107388', time=2024-09-12T20:34:49.599535+0000, chain.objs.size()=1 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.82Zv5Pjorj0VMO6_HvFtO3eKYrHSmci_0 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6071775772727481822', time=2024-09-12T20:34:49.860697+0000, chain.objs.size()=1 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.z8fnIp7Lz8oOzokV587KvVVkE77RF1m_0 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7498809984567625786', time=2024-09-12T20:34:51.048433+0000, chain.objs.size()=1 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PYCibsqxdzdiKEk9yZu2i2r_1oI4nMe_0 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6558090605644429261', time=2024-09-12T20:34:52.532138+0000, chain.objs.size()=1 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3pAOM_pQYsjkofyB2ah2oCX7M0R8hXN_0 2024-09-12T18:59:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.670019475651899822', time=2024-09-12T20:34:53.036308+0000, chain.objs.size()=1 2024-09-12T18:59:59.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-HlkNLKIWcVeKrHAVXYzFlXk84EMlJZ_0 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18198834628519887503', time=2024-09-12T20:34:53.634612+0000, chain.objs.size()=1 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BQgmV4oewLRiv_O3EDwwEq7dbUcsh0G_0 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2316417985423849278', time=2024-09-12T20:34:54.641691+0000, chain.objs.size()=1 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.gSjHILyqDSJ5lFAikGJvpAL-URN5I1I_0 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8302897148998372474', time=2024-09-12T20:34:56.975696+0000, chain.objs.size()=1 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.fRkYbassP08AUSSMN-PpElxkRg338Qg_0 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16823734901913131443', time=2024-09-12T20:34:57.120168+0000, chain.objs.size()=1 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Tc3Sz1Cl8RAYwlgUqqpccsjFmEIgEam_0 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6308797528060061582', time=2024-09-12T20:34:57.305075+0000, chain.objs.size()=1 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nlm1jmvcIpnRAN1UdnQ-lhuyoEPslSX_0 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2113644109900217779', time=2024-09-12T20:34:57.472561+0000, chain.objs.size()=1 2024-09-12T18:59:59.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UOGu8S-jsbeEV6pGCfWKrzf6wj2xPcH_0 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3504790228330321212', time=2024-09-12T20:34:58.191784+0000, chain.objs.size()=1 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.L2LXw-_2OmcLjROaBzxPkqwwCPvvs7U_0 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7005042116035559546', time=2024-09-12T20:34:59.602349+0000, chain.objs.size()=1 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6lvXM9DgA1KUTTSEDKeN5FhVeNULX_0_0 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6884415662657869516', time=2024-09-12T20:35:00.239100+0000, chain.objs.size()=1 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.mQSUIhJbNYaWCIOu18MkWXdb7sZqOm3_0 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2133847210043145401', time=2024-09-12T20:35:00.508955+0000, chain.objs.size()=1 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.pztQM3yPchdIU8dIvUcFmLsTwJwhLuO_0 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9048822637379246147', time=2024-09-12T20:35:01.081861+0000, chain.objs.size()=1 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.41NeuC_69tPBbIZildLtDFQX94liDGW_0 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14572261513522867631', time=2024-09-12T20:35:01.355117+0000, chain.objs.size()=1 2024-09-12T18:59:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.887+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.PvYUATxq2AxSZZafpLxzJ6DgF20bxxt_0 2024-09-12T18:59:59.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6567768415221482809', time=2024-09-12T20:35:07.951958+0000, chain.objs.size()=1 2024-09-12T18:59:59.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.330__shadow_.5_X9NRh9qg-BEIQhmkYJ4R_eyJFc2XW_0 2024-09-12T18:59:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2477621120558373216', time=2024-09-12T20:35:53.840767+0000, chain.objs.size()=1 2024-09-12T18:59:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.377__shadow_.imgR-M8EyXLRjvrzFtxdtB_FoPa8njh_0 2024-09-12T18:59:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12030433129473994651', time=2024-09-12T20:37:26.808673+0000, chain.objs.size()=1 2024-09-12T18:59:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.458__shadow_.as2ru-UGebZwKrJSo9xa3NA0E1uiIMJ_0 2024-09-12T18:59:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11585192036621265659', time=2024-09-12T20:38:08.882206+0000, chain.objs.size()=1 2024-09-12T18:59:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.490__shadow_.XQOLDgIaECRMIAR2XcxfIS2p-A56SIc_0 2024-09-12T18:59:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11585192036621265659', time=2024-09-12T20:38:09.299648+0000, chain.objs.size()=1 2024-09-12T18:59:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.490__shadow_.XQOLDgIaECRMIAR2XcxfIS2p-A56SIc_0 2024-09-12T18:59:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11522625285234421133', time=2024-09-12T20:38:25.354986+0000, chain.objs.size()=1 2024-09-12T18:59:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.503__shadow:RrE07h9QVCnd4UDOAeK8Om93tXQxxPE_.hyGvE7kfORPSZwwerfxAYNUofTKRYRK_0 2024-09-12T18:59:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10470102063405139518', time=2024-09-12T20:43:22.620915+0000, chain.objs.size()=1 2024-09-12T18:59:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.561__multipart_mymultipart.Ysafjo-15MTlOru3xuxGkmsiewfPIzm6.1 2024-09-12T18:59:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8281332905085720385', time=2024-09-12T20:43:54.766406+0000, chain.objs.size()=1 2024-09-12T18:59:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:yIyaFni2WevwzHHbO941PUYjmuxUh1j_.6wzeHXdS221yP5h7fypIeu2jN75uLRQ_0 2024-09-12T18:59:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16130815071991652492', time=2024-09-12T20:44:08.291434+0000, chain.objs.size()=1 2024-09-12T18:59:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.572__shadow_.Qz79KXOBsgUDJG8eJIt79Y8UnFcNMrd_0 2024-09-12T18:59:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12670570881503224810', time=2024-09-12T20:46:01.540045+0000, chain.objs.size()=1 2024-09-12T18:59:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.596__shadow_.EKXNJLR4CE8iQwNKKC_zXTuxVxh0Ys5_0 2024-09-12T18:59:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17980813763921570587', time=2024-09-12T20:51:09.522756+0000, chain.objs.size()=1 2024-09-12T18:59:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.646__shadow_.32pbdZBJWk2E7wvZLfJkq7-OicKjZMW_0 2024-09-12T18:59:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13995242688934493235', time=2024-09-12T20:51:57.224430+0000, chain.objs.size()=1 2024-09-12T18:59:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.664__shadow_.fBB0hvVknBisO1EzxHTdiBj6FPQ1Msj_0 2024-09-12T18:59:59.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11527179193090321421', time=2024-09-12T20:52:39.809330+0000, chain.objs.size()=1 2024-09-12T18:59:59.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.702__multipart_file1.2~v0UBvxHXy9wB001QTcjZSkfRcwCL5l-.1 2024-09-12T18:59:59.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2248394083195521340', time=2024-09-12T20:53:20.721538+0000, chain.objs.size()=1 2024-09-12T18:59:59.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.891+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.719__shadow_.5Ao_C61p-MC2HISD4SQbT98aZBlM4jX_0 2024-09-12T18:59:59.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.895+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:59:59.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.895+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51905' 2024-09-12T18:59:59.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17375698821534805063', time=2024-09-12T20:22:39.711071+0000, chain.objs.size()=5 2024-09-12T18:59:59.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__multipart_foo-LUKEWARM.2~hqPRE0T-SZRBWgke1MGn8JJCNJmTt8O.1 2024-09-12T18:59:59.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_foo-LUKEWARM.2~hqPRE0T-SZRBWgke1MGn8JJCNJmTt8O.1_1 2024-09-12T18:59:59.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__multipart_foo-LUKEWARM.2~hqPRE0T-SZRBWgke1MGn8JJCNJmTt8O.2 2024-09-12T18:59:59.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_foo-LUKEWARM.2~hqPRE0T-SZRBWgke1MGn8JJCNJmTt8O.2_1 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__multipart_foo-LUKEWARM.2~hqPRE0T-SZRBWgke1MGn8JJCNJmTt8O.3 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18304783004347933582', time=2024-09-12T20:23:53.270682+0000, chain.objs.size()=1 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.204__shadow_.d-EBp78QopuUFQKJYqywbxyqJcE7jvN_0 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6632101859396116299', time=2024-09-12T20:26:32.369662+0000, chain.objs.size()=1 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.236__shadow_.MeODdN4sZPqQxaGZyjVNmNmpJg1HpwX_0 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18215241809009374300', time=2024-09-12T20:26:51.063395+0000, chain.objs.size()=1 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.248__shadow_.ORmAsuCeicywkrZj-LUuJJHaYKAqyGc_0 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9319007157721826475', time=2024-09-12T20:26:53.836866+0000, chain.objs.size()=1 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.250__shadow_.JmG2c4SbYEf6rxtSm_hNpFRKSeYl5Np_0 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13644240779376616488', time=2024-09-12T20:27:07.538358+0000, chain.objs.size()=1 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.260__shadow_.CHqZLQ5senU2uayniBzPBlPQxnAVEHV_0 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12641525899219610220', time=2024-09-12T20:28:48.255101+0000, chain.objs.size()=1 2024-09-12T18:59:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.76--deCV5Qie8TZAYZfa0pqcbW2a5v2_0 2024-09-12T18:59:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.976510937892873800', time=2024-09-12T20:28:49.295599+0000, chain.objs.size()=1 2024-09-12T18:59:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.899+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.QkC-uF3ayBHDuYAw7VPRZfN_kDkJK5K_0 2024-09-12T18:59:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11010238527643689401', time=2024-09-12T20:28:52.917316+0000, chain.objs.size()=1 2024-09-12T18:59:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fYC7bu0-Ou7hmJJPUUaeGbDBDommZno_0 2024-09-12T18:59:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16942509436800037945', time=2024-09-12T20:28:53.768223+0000, chain.objs.size()=1 2024-09-12T18:59:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WeoF0VRtUtJD3Ndtg-y_EO_umtsGiqL_0 2024-09-12T18:59:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15876284760497208125', time=2024-09-12T20:28:53.770083+0000, chain.objs.size()=1 2024-09-12T18:59:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CeNiNdEzqRvrj4d5mPphkZwtfWCBJv4_0 2024-09-12T18:59:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1291514557202447967', time=2024-09-12T20:28:55.875967+0000, chain.objs.size()=1 2024-09-12T18:59:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.uqxno6rhggl8N-ej-goHjOQTmhuS9xi_0 2024-09-12T18:59:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11839909324537668183', time=2024-09-12T20:28:57.076366+0000, chain.objs.size()=1 2024-09-12T18:59:59.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.S4ZzCpnx1bZRaVrsHC-GTENo3KSBwFN_0 2024-09-12T18:59:59.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11343560525536004893', time=2024-09-12T20:28:57.358405+0000, chain.objs.size()=1 2024-09-12T18:59:59.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.-CJWQ3P1I79H7eedt3jaA0ukEp7ogMy_0 2024-09-12T18:59:59.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14648022181273681989', time=2024-09-12T20:28:57.921369+0000, chain.objs.size()=1 2024-09-12T18:59:59.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.q_hSVgclFdl6Nk9Bf3I_6uG89RqBLXR_0 2024-09-12T18:59:59.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.196195851853157490', time=2024-09-12T20:28:59.298626+0000, chain.objs.size()=1 2024-09-12T18:59:59.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FSQdCip_OAPD31QIDdVXCPCt1fAioom_0 2024-09-12T18:59:59.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13750555306179433132', time=2024-09-12T20:28:59.301728+0000, chain.objs.size()=1 2024-09-12T18:59:59.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.pY7tsGvbHJorO7Ytx2TeFwX9J_w34vq_0 2024-09-12T18:59:59.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13217693239878319698', time=2024-09-12T20:29:00.259691+0000, chain.objs.size()=1 2024-09-12T18:59:59.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3-_X8oFfA-9FGLaDtcpohEaZIM9ls30_0 2024-09-12T18:59:59.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.258529066860722366', time=2024-09-12T20:29:00.847894+0000, chain.objs.size()=1 2024-09-12T18:59:59.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.HGgHmoDklKfwRQJcTWSw7u6Z4R-c3L3_0 2024-09-12T18:59:59.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.171664765196986086', time=2024-09-12T20:29:02.675111+0000, chain.objs.size()=1 2024-09-12T18:59:59.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.IVJDoZqo-7CztnVL2FIniegObT_HaTa_0 2024-09-12T18:59:59.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16883504372897224628', time=2024-09-12T20:29:03.595257+0000, chain.objs.size()=1 2024-09-12T18:59:59.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Rv_-szBmz41pLTFg8d5dCPSPq5ceZ9b_0 2024-09-12T18:59:59.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9499979621530277018', time=2024-09-12T20:29:04.309211+0000, chain.objs.size()=1 2024-09-12T18:59:59.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.dasXCab5wZ69OfqV0SQkmcKlzl1t6mX_0 2024-09-12T18:59:59.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12511154176833136553', time=2024-09-12T20:29:04.311307+0000, chain.objs.size()=1 2024-09-12T18:59:59.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.PUB8wlM9DjbDZgqi9UrlfQXbJzPbq6n_0 2024-09-12T18:59:59.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10324652420359661024', time=2024-09-12T20:29:05.130124+0000, chain.objs.size()=1 2024-09-12T18:59:59.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9ZZ_D6EWPIK6P8HMzHnuDFxnkHZPwiK_0 2024-09-12T18:59:59.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15790391116153292351', time=2024-09-12T20:29:05.265405+0000, chain.objs.size()=1 2024-09-12T18:59:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.gPLe085Jt71cC4ZUOfy6VKmU9CC_Iqd_0 2024-09-12T18:59:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14957860634640881695', time=2024-09-12T20:29:10.020073+0000, chain.objs.size()=1 2024-09-12T18:59:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3jlsn_VC-CNYRUUOPl3RBfPJJvBkcdW_0 2024-09-12T18:59:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7094034912773404418', time=2024-09-12T20:29:11.376006+0000, chain.objs.size()=1 2024-09-12T18:59:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.K1mxgwNpwxiVlbYSBpNiXwVLiKVLRUd_0 2024-09-12T18:59:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9538480913751704571', time=2024-09-12T20:29:11.721102+0000, chain.objs.size()=1 2024-09-12T18:59:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ypQ_lL2yxp4CJeSwtGBcYSOuFCBO9Lc_0 2024-09-12T18:59:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8253191524420281376', time=2024-09-12T20:29:13.235389+0000, chain.objs.size()=1 2024-09-12T18:59:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.YlSUqN95L7otPH5CVRUlv8T2Tr_oHgF_0 2024-09-12T18:59:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14702108756168672402', time=2024-09-12T20:29:13.870887+0000, chain.objs.size()=1 2024-09-12T18:59:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.903+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FYAA2A2kdXBHjjMfzieNvRxcZTG5_2H_0 2024-09-12T18:59:59.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2486395873982383051', time=2024-09-12T20:29:14.371643+0000, chain.objs.size()=1 2024-09-12T18:59:59.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.RYkUHX397aQ3aC27oPd_kJpOFsT2Kxh_0 2024-09-12T18:59:59.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16903111928214509484', time=2024-09-12T20:29:15.374525+0000, chain.objs.size()=1 2024-09-12T18:59:59.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.beuwe16TwxAFOw6AsLb_ZOWL15IhSUw_0 2024-09-12T18:59:59.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3472877055179014027', time=2024-09-12T20:29:26.950901+0000, chain.objs.size()=1 2024-09-12T18:59:59.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.271__shadow_.sQHaWfHr1f4p9jwN4ZQlV95SAARzvR3_0 2024-09-12T18:59:59.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14504680853240572052', time=2024-09-12T20:29:36.316149+0000, chain.objs.size()=1 2024-09-12T18:59:59.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.278__shadow_.oag-2DGWVSS3vjUo2CPH96gKaatPlxF_0 2024-09-12T18:59:59.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4287582460437741988', time=2024-09-12T20:29:37.748870+0000, chain.objs.size()=1 2024-09-12T18:59:59.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.279__shadow_.wwurD_uUlx861CiYb5MjbP-WDaE4LtV_0 2024-09-12T18:59:59.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9576471652772900933', time=2024-09-12T20:29:59.036269+0000, chain.objs.size()=1 2024-09-12T18:59:59.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.Rm_A6uQ1r3Guu-qr-t_9esG0WEE4cds_0 2024-09-12T18:59:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17138940336872777191', time=2024-09-12T20:30:09.506223+0000, chain.objs.size()=1 2024-09-12T18:59:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.297__shadow_.1rCYqXcbPniabzAGLDgJk3H49PW25Ug_0 2024-09-12T18:59:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1324537659520470873', time=2024-09-12T20:32:26.994467+0000, chain.objs.size()=1 2024-09-12T18:59:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.faJ8lZfPYZMC04qU1qJ6zAGIoSrHNLr_0 2024-09-12T18:59:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6215679462409251575', time=2024-09-12T20:32:28.245108+0000, chain.objs.size()=1 2024-09-12T18:59:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dBySmkJSmRa_LjaB7mtUCgCECnbm5zx_0 2024-09-12T18:59:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614395148697447481', time=2024-09-12T20:32:29.241431+0000, chain.objs.size()=1 2024-09-12T18:59:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.U7nmZ8VBwlpmfe-AihuNIK3gTkgxwv6_0 2024-09-12T18:59:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7239877666514340439', time=2024-09-12T20:32:29.545851+0000, chain.objs.size()=1 2024-09-12T18:59:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sMR9BEP1fY5uaLWoNWq5GIwce4UP-9Z_0 2024-09-12T18:59:59.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15094448956371589471', time=2024-09-12T20:32:30.972272+0000, chain.objs.size()=1 2024-09-12T18:59:59.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.PMl-HRoJlPT89Yz3Q0HmpWTybr1Y5kK_0 2024-09-12T18:59:59.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4108985490763036350', time=2024-09-12T20:32:31.559357+0000, chain.objs.size()=1 2024-09-12T18:59:59.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.LDXhrmIQhqVeoXyNHbOdUbYrIqWYaiv_0 2024-09-12T18:59:59.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5825981761513919066', time=2024-09-12T20:32:31.807215+0000, chain.objs.size()=1 2024-09-12T18:59:59.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.X5FUuZ6PM1Q2iMG4XGwVy0PLnlfzRAO_0 2024-09-12T18:59:59.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4107898232758619756', time=2024-09-12T20:32:32.855249+0000, chain.objs.size()=1 2024-09-12T18:59:59.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.-pjUe0z-BTdPyQ1aDF6iVBjt_T-bIBa_0 2024-09-12T18:59:59.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18324634477061671084', time=2024-09-12T20:32:34.996539+0000, chain.objs.size()=1 2024-09-12T18:59:59.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.YQ3IFwoYlXQ8HeXzCMbZ5K3yEKaG6pI_0 2024-09-12T18:59:59.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13456384820695721339', time=2024-09-12T20:32:38.514678+0000, chain.objs.size()=1 2024-09-12T18:59:59.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jrKqbluHU1Ze5WRa6fYtduU85hk8Th-_0 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12542728270400400497', time=2024-09-12T20:32:38.781799+0000, chain.objs.size()=1 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nZUqxuscg6RlrYCna8kxpuQzXCjfRMw_0 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12780963803726585346', time=2024-09-12T20:32:40.462990+0000, chain.objs.size()=1 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.zEkMO0ZgbjqGIXi1ImzzTBcMm8iURP0_0 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7692933446943492956', time=2024-09-12T20:32:42.400007+0000, chain.objs.size()=1 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.907+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wOhBqrIZ7PaaZSsodBGCs_2-trkbzv__0 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1549734214345368934', time=2024-09-12T20:32:43.546986+0000, chain.objs.size()=1 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hBDlonV66y8DnuP4RfjgA6SmqrCZVyh_0 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15091795483336706887', time=2024-09-12T20:32:43.571268+0000, chain.objs.size()=1 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0WIrCwIviA-v-8ZCOkZryk0QS-fzdsV_0 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7804773481674712455', time=2024-09-12T20:32:43.959709+0000, chain.objs.size()=1 2024-09-12T18:59:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ASVcou5eS7D8Bji5kEYdG7Za2uUk_yI_0 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14929160358392514012', time=2024-09-12T20:32:45.136709+0000, chain.objs.size()=1 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HUhmVYLmrPetKT31ak2W74Og56bmtFu_0 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1996225219034341999', time=2024-09-12T20:32:46.457423+0000, chain.objs.size()=1 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.DpSpUkteD7mgglb5h7pbx7nssixlITL_0 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16192255242493285541', time=2024-09-12T20:32:46.596361+0000, chain.objs.size()=1 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Yh99dIEGnKENQ4dmETlLNh6xq3Dc7mj_0 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5557451845172983368', time=2024-09-12T20:32:47.366784+0000, chain.objs.size()=1 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.invBKD2C0lrp7TQuNUDR0-W1rnYjGHa_0 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3561414309088248562', time=2024-09-12T20:32:48.714141+0000, chain.objs.size()=1 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.RhSY7SYyVV02m3n3FvF1WwZuUEVMblp_0 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7446243943073481953', time=2024-09-12T20:32:52.104822+0000, chain.objs.size()=1 2024-09-12T18:59:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ylU6ZJVZgYLtHTteSqAMo8-uFpk6sK6_0 2024-09-12T18:59:59.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12658973638168645867', time=2024-09-12T20:32:52.638639+0000, chain.objs.size()=1 2024-09-12T18:59:59.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.TFnBmaq2Pn1FqCYAz6_UD_8MMvlLnX6_0 2024-09-12T18:59:59.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.905309875316661539', time=2024-09-12T20:32:53.693296+0000, chain.objs.size()=1 2024-09-12T18:59:59.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.GZWzoXiRDvrcgjYrM7l2lJlFQrlnWW6_0 2024-09-12T18:59:59.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10193123465814010211', time=2024-09-12T20:32:53.743647+0000, chain.objs.size()=1 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.911+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.UYSotacnrOcC0tVMN703Hkvgr4U2BYX_0 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11026125212005847617', time=2024-09-12T20:34:34.751567+0000, chain.objs.size()=1 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RWDsGpTQQfU4n8jL96cIN-HTeSXES0U_0 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5271239861076065216', time=2024-09-12T20:34:34.775448+0000, chain.objs.size()=1 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vAmsqzROaRV9OBMnX4O-UYTZlKSm7WL_0 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17061845820083012802', time=2024-09-12T20:34:35.286914+0000, chain.objs.size()=1 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.DCexzpG9ANJvHwWgjGy_HYBtPFIM4vb_0 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1943336487679595415', time=2024-09-12T20:34:35.809986+0000, chain.objs.size()=1 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MIhf0gGyUBOdPg4gk4Oz4X8Fhqy65xR_0 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14696732460866761699', time=2024-09-12T20:34:35.811908+0000, chain.objs.size()=1 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.imHi2yj9RO8UDJA1QSZxkGGiQ9Gi6ux_0 2024-09-12T18:59:59.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11049027320783280041', time=2024-09-12T20:34:36.507413+0000, chain.objs.size()=1 2024-09-12T18:59:59.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BxJpUl5AdjfiaBuHgV2hyJB4AsXZOxY_0 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12736312394479947658', time=2024-09-12T20:34:36.714026+0000, chain.objs.size()=1 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.rsWn1pdR4Xgty_xvT0wLbospFXx3uzc_0 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14535028958126655149', time=2024-09-12T20:34:37.821284+0000, chain.objs.size()=1 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RukaOsYPXJtwvK2LroB8WIHOh2VF7ER_0 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11787909359867967856', time=2024-09-12T20:34:39.232859+0000, chain.objs.size()=1 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.YhBGuLYhwME6_zUQGbnxL81Y4CF5BCY_0 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11579114689796422688', time=2024-09-12T20:34:41.824585+0000, chain.objs.size()=1 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.pnXjklAb4BSKOxG6TCnM4uUy_DQNeYt_0 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5260755214103764620', time=2024-09-12T20:34:42.383394+0000, chain.objs.size()=1 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Rpy015Vc7QzHvQTEEm5SYdA6u3BR_Ft_0 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7098027094640778978', time=2024-09-12T20:34:42.385041+0000, chain.objs.size()=1 2024-09-12T18:59:59.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kuyK2sqCWDmY_31yY2xUAZbDfZCgjhv_0 2024-09-12T18:59:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11128213316181861467', time=2024-09-12T20:34:42.781677+0000, chain.objs.size()=1 2024-09-12T18:59:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.IWT8I9gSCkf8siYWWssAcMOPeRIICSs_0 2024-09-12T18:59:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7552267846492460042', time=2024-09-12T20:34:43.258621+0000, chain.objs.size()=1 2024-09-12T18:59:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.mPFu4s_DodHG3p5e2JHaSKFLo8D6fmG_0 2024-09-12T18:59:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3165363681224907792', time=2024-09-12T20:34:43.914061+0000, chain.objs.size()=1 2024-09-12T18:59:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UzG41HDvf7qnjpizITVNHCDGoWc6mEQ_0 2024-09-12T18:59:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8883223635389676356', time=2024-09-12T20:34:45.517109+0000, chain.objs.size()=1 2024-09-12T18:59:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4CbaOKkJ8vBHbfTP2DiyWgnca1D2F7i_0 2024-09-12T18:59:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13602330224958310760', time=2024-09-12T20:34:46.063833+0000, chain.objs.size()=1 2024-09-12T18:59:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.915+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3Q_PKumknx-ybmjh3yun6phIpSmaVpA_0 2024-09-12T18:59:59.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9492604082764005628', time=2024-09-12T20:34:46.793151+0000, chain.objs.size()=1 2024-09-12T18:59:59.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.2gz8fDC5Shaah4zptDZ6qOUEDjHalWt_0 2024-09-12T18:59:59.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12093317272837807571', time=2024-09-12T20:34:46.838567+0000, chain.objs.size()=1 2024-09-12T18:59:59.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XQKSVPhLzn_cOeJalZ4acnGnmi9brbf_0 2024-09-12T18:59:59.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15855034642213335417', time=2024-09-12T20:34:47.550647+0000, chain.objs.size()=1 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.w0ITb55IJ0AnBlD7SUM_HoAB0tWNudP_0 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3490438326034515231', time=2024-09-12T20:34:47.779482+0000, chain.objs.size()=1 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.rLU2yo7eJRESwfyJhGAszR9cNQfyY5R_0 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17268407570723404994', time=2024-09-12T20:34:48.796861+0000, chain.objs.size()=1 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RNY-oqySZLkU3Kl9HqNI0rOGVGo9p_n_0 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3996533334650177378', time=2024-09-12T20:34:50.508499+0000, chain.objs.size()=1 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.cRTfZtwOomGridoDoP3EYGOYVdA_JRp_0 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17827176854856058980', time=2024-09-12T20:34:50.755059+0000, chain.objs.size()=1 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LV8P5CG5YyrArAOV71pOhRPu29HCDT8_0 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16836657773654909527', time=2024-09-12T20:34:52.358093+0000, chain.objs.size()=1 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.cihVJQNTHpBZjB8pOneXd5lNW635SA6_0 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1798396644061689109', time=2024-09-12T20:34:53.025237+0000, chain.objs.size()=1 2024-09-12T18:59:59.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Fp7KJ1jHjeC7g4bKdE5pGgoljipKIWK_0 2024-09-12T18:59:59.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12273579839568959939', time=2024-09-12T20:34:53.030407+0000, chain.objs.size()=1 2024-09-12T18:59:59.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.c80En4C-qJmiWWa--p_8cstQwlaJzXN_0 2024-09-12T18:59:59.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7065277064185375452', time=2024-09-12T20:34:53.353237+0000, chain.objs.size()=1 2024-09-12T18:59:59.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UKWvEJL6dX986vgsP53tMptgYF6-XH6_0 2024-09-12T18:59:59.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3149762513490510897', time=2024-09-12T20:34:53.479544+0000, chain.objs.size()=1 2024-09-12T18:59:59.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-4fw_L-cKM7YezBqYKkJTZa_jdaWWpq_0 2024-09-12T18:59:59.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17395243012703706895', time=2024-09-12T20:34:53.513941+0000, chain.objs.size()=1 2024-09-12T18:59:59.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.D87yx7HZbViff9IevxYZ3r6-ZY-yGka_0 2024-09-12T18:59:59.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13821430973044488668', time=2024-09-12T20:34:53.906625+0000, chain.objs.size()=1 2024-09-12T18:59:59.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ZjCX6Mi2rlUYyQ8eFvOr1LOCobwRQ1I_0 2024-09-12T18:59:59.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15288973266887029521', time=2024-09-12T20:34:54.294454+0000, chain.objs.size()=1 2024-09-12T18:59:59.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wbK8vkSMkHtIIoRg3io5bPd1QjtNBjn_0 2024-09-12T18:59:59.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2712629703738670937', time=2024-09-12T20:34:54.712435+0000, chain.objs.size()=1 2024-09-12T18:59:59.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.7YiyEYi9DM_PNbf0s3uRpAZj5YnuXzO_0 2024-09-12T18:59:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2900450512132134576', time=2024-09-12T20:34:54.946212+0000, chain.objs.size()=1 2024-09-12T18:59:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.jBw2mr80tVbYWGGAKF96c1RaemgiO_F_0 2024-09-12T18:59:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9867414037050465984', time=2024-09-12T20:34:56.969704+0000, chain.objs.size()=1 2024-09-12T18:59:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ns1XNaFEHaV0R9vtyaoez96DvE-wsfF_0 2024-09-12T18:59:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12587258019451358023', time=2024-09-12T20:34:57.259355+0000, chain.objs.size()=1 2024-09-12T18:59:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.c5zvMhaAi77ZWvhC_GUA4yn9OXlEkA0_0 2024-09-12T18:59:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3061387045822920829', time=2024-09-12T20:34:57.261441+0000, chain.objs.size()=1 2024-09-12T18:59:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.n6o7JQXDbfkdAAY4L5Wm77q-1zfVtoO_0 2024-09-12T18:59:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15945144798469463390', time=2024-09-12T20:34:57.914442+0000, chain.objs.size()=1 2024-09-12T18:59:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.919+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HEsAlE9w2WZCl4TgWQg0q8-a-j9L0ym_0 2024-09-12T18:59:59.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51905 2024-09-12T18:59:59.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:59:59.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17578154519096302370', time=2024-09-12T20:34:57.916738+0000, chain.objs.size()=1 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.77HLs3Sl_ZTpCBgcGEwdSezTJIQgwAC_0 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14535326352579405207', time=2024-09-12T20:34:58.178989+0000, chain.objs.size()=1 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._ygH9Hku81Q_Hq_jcW9WDYK0LxfOQnA_0 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2109085982205927346', time=2024-09-12T20:34:58.610992+0000, chain.objs.size()=1 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.V3pwfCeF7Dp-mNJCzdNbE2vWShFI3Ng_0 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6630407855203677285', time=2024-09-12T20:35:01.270960+0000, chain.objs.size()=1 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.c9iXCBQ6ImBHRbQNAv8YO3rXhMgch3h_0 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10376488906557376726', time=2024-09-12T20:38:58.409511+0000, chain.objs.size()=1 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.518__multipart_mymultipart.2~_ai5OaoxpSfO7XRU7qANaBnFwZIVS7a.1 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10189913674196725747', time=2024-09-12T20:43:09.104630+0000, chain.objs.size()=1 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.557__shadow_.6ypX8SYFjusqKWYySPyFrz1u44TCi-o_0 2024-09-12T18:59:59.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6494225256438570699', time=2024-09-12T20:43:18.721893+0000, chain.objs.size()=1 2024-09-12T18:59:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.559__shadow_._OdxVz8I5LCFOfjO-OLrWSf4UBSv845_0 2024-09-12T18:59:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11517323027158128058', time=2024-09-12T20:43:53.503251+0000, chain.objs.size()=1 2024-09-12T18:59:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:pQTTBqt6bipdcadbHx4Sk6YjwC.NJcV_.-0d31kDTT5Hi5dyF7VcPAOGjER7nr-k_0 2024-09-12T18:59:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14437136236605879625', time=2024-09-12T20:43:57.775312+0000, chain.objs.size()=1 2024-09-12T18:59:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:jglCoBxO1B1xbv0LZLIHjDKpOdN2kF2_.TehgGshWF64J9D5Uj8IVzRki5vge2TJ_0 2024-09-12T18:59:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6573467217846457758', time=2024-09-12T20:44:04.850410+0000, chain.objs.size()=1 2024-09-12T18:59:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.570__shadow:UoTtKAymlIp3.kmVQyKjzbDzdu2hw8S_.Ln51G9rqz2oSkWBh3T4gL9vcbm5dKAn_0 2024-09-12T18:59:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15920292237437962439', time=2024-09-12T20:44:04.986008+0000, chain.objs.size()=1 2024-09-12T18:59:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.570__shadow:lzlecteVJo51dKuzNg3dBqF2D.T.GBH_.27k-zm1Ci4LzArytKipqYv-U4xIPFiX_0 2024-09-12T18:59:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16335868660981324643', time=2024-09-12T20:44:21.881017+0000, chain.objs.size()=1 2024-09-12T18:59:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.923+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.575__shadow_.EXeXBi98btFJozS17mI_NuHj-Od3h6V_0 2024-09-12T18:59:59.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2657370615071263024', time=2024-09-12T20:44:32.428614+0000, chain.objs.size()=1 2024-09-12T18:59:59.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.576__shadow:ld4U8r8YNTSrNYYK6lizgYN8MaeFx0o_.3x6saLu8n2shr9glnwaNVeageiwy1-K_0 2024-09-12T18:59:59.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7310002809888527946', time=2024-09-12T20:44:41.222225+0000, chain.objs.size()=1 2024-09-12T18:59:59.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:Pq3G24JeLhYa31UESvF92pXovHyZAw2_.EMSZV-PNV0iK871gh44x6h_bTzuk2jP_0 2024-09-12T18:59:59.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16064244054752401181', time=2024-09-12T20:45:07.779641+0000, chain.objs.size()=1 2024-09-12T18:59:59.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:rI1DeNVBpf74NH5MIbPLI3L7vq6JduB_.4FnLVOLbybTNd4g_dJNw9pZ2JraMWG2_0 2024-09-12T18:59:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10683467703223684059', time=2024-09-12T20:45:39.109167+0000, chain.objs.size()=1 2024-09-12T18:59:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.580__shadow:yMU8APiZiUwFvOs15EjFdoiuGrl9xCA_._JdH5UOni97x9mgS6kgqPXl7qhEaGz4_0 2024-09-12T18:59:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7858514147934202281', time=2024-09-12T20:46:08.117121+0000, chain.objs.size()=1 2024-09-12T18:59:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.603__shadow_.ALwX9wRw3KxFzRDpPntxMbBG4Qoyj_4_0 2024-09-12T18:59:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3041663993636272727', time=2024-09-12T20:51:20.436150+0000, chain.objs.size()=1 2024-09-12T18:59:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.651__shadow_.jJnJyjdcynKKaqasYg94YN7bzEGg645_0 2024-09-12T18:59:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11424417140994592616', time=2024-09-12T20:51:59.281775+0000, chain.objs.size()=1 2024-09-12T18:59:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.665__shadow_.yLtOJtX0HFGnJbe1uLOva0UdJqp_HaS_0 2024-09-12T18:59:59.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.927+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:59:59.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56373' 2024-09-12T18:59:59.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15066272760428806426', time=2024-09-12T20:22:22.812466+0000, chain.objs.size()=5 2024-09-12T18:59:59.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__multipart_mymultipart-FROZEN.2~YG1-b2vbOO-TmGfFh_PYXj9QTE8t8Qz.1 2024-09-12T18:59:59.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__shadow_mymultipart-FROZEN.2~YG1-b2vbOO-TmGfFh_PYXj9QTE8t8Qz.1_1 2024-09-12T18:59:59.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__multipart_mymultipart-FROZEN.2~YG1-b2vbOO-TmGfFh_PYXj9QTE8t8Qz.2 2024-09-12T18:59:59.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__shadow_mymultipart-FROZEN.2~YG1-b2vbOO-TmGfFh_PYXj9QTE8t8Qz.2_1 2024-09-12T18:59:59.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.159__multipart_mymultipart-FROZEN.2~YG1-b2vbOO-TmGfFh_PYXj9QTE8t8Qz.3 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_nmv92GxijaBj9tzHMz4zIfHVvslHntd', time=2024-09-12T20:22:49.320553+0000, chain.objs.size()=1 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.163__shadow_.3KGnS3NrfoNLyl-keJDrEaz2zlylNqs_0 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6603108777903449813', time=2024-09-12T20:23:51.754108+0000, chain.objs.size()=1 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.203__shadow_.uZIhENjRmZ1v1BxqpgpBFMDoB_hwWKZ_0 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9585198607131827894', time=2024-09-12T20:26:25.290303+0000, chain.objs.size()=1 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.231__shadow_.fpevDtS9e_KGu04Qw00p3uZv-0oFhnU_0 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5299755963390582713', time=2024-09-12T20:26:34.398534+0000, chain.objs.size()=1 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.237__shadow_.qKOEDg4nXDXQiIyI5fmpo2-V9PNiie7_0 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10287656839490936639', time=2024-09-12T20:28:47.708773+0000, chain.objs.size()=1 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JHYuVQm0RoLnbvv4H7ZPWVljihGRCy5_0 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15319868249943506304', time=2024-09-12T20:28:48.544782+0000, chain.objs.size()=1 2024-09-12T18:59:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.R5aXwYiRswFm_KnQL9pJhEwTyXYP_jv_0 2024-09-12T18:59:59.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16196862000335334159', time=2024-09-12T20:28:49.580389+0000, chain.objs.size()=1 2024-09-12T18:59:59.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.931+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wxZOI3BEZTNtawcf4ZcJZpiCxDKAw_2_0 2024-09-12T18:59:59.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7832364893916605911', time=2024-09-12T20:28:50.058726+0000, chain.objs.size()=1 2024-09-12T18:59:59.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3rXpawWslJEQTkszNHeUPlT7L96evM-_0 2024-09-12T18:59:59.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10626922132934834742', time=2024-09-12T20:28:50.522950+0000, chain.objs.size()=1 2024-09-12T18:59:59.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tHUlQCgdY1VtB1qZOMFDQHm8OfmUzYZ_0 2024-09-12T18:59:59.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4944820769312788997', time=2024-09-12T20:28:50.564112+0000, chain.objs.size()=1 2024-09-12T18:59:59.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.6RwE03Vzq8BWP46aPRDS4CLrZIDcNCT_0 2024-09-12T18:59:59.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.734565741416443324', time=2024-09-12T20:28:52.006026+0000, chain.objs.size()=1 2024-09-12T18:59:59.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.smW9ecW3z-p5VygLJAtT69UWq5pe_VI_0 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9886317684669216082', time=2024-09-12T20:28:53.980299+0000, chain.objs.size()=1 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.72ogZ9B5WDUytuKLytEmSqUJ1R8tGNe_0 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15958018445205841002', time=2024-09-12T20:28:56.588315+0000, chain.objs.size()=1 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.pgCDVxAkOWVQsWoiac96P2cLLKM5x4B_0 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17766600958796788917', time=2024-09-12T20:28:57.074020+0000, chain.objs.size()=1 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.iemYqA4sNazcqQEDXMZOrASI_wErlJd_0 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.835946888443279156', time=2024-09-12T20:28:57.333445+0000, chain.objs.size()=1 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kRdE9ItxunZMErPnuyBedSQ2N05y4x8_0 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8585723139065837512', time=2024-09-12T20:29:01.531759+0000, chain.objs.size()=1 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.u3UPDTRk7zrEQL03BgjmQigs4pkryz5_0 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17472414401419703678', time=2024-09-12T20:29:01.682081+0000, chain.objs.size()=1 2024-09-12T18:59:59.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8aGdsRVQ7GZZfr5dJLELCP8WMsgWL2R_0 2024-09-12T18:59:59.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13337716415281202097', time=2024-09-12T20:29:03.063128+0000, chain.objs.size()=1 2024-09-12T18:59:59.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VZojsMcdEns8gnvrTgRHeiLKhxGlGBl_0 2024-09-12T18:59:59.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13180956909559299185', time=2024-09-12T20:29:05.148278+0000, chain.objs.size()=1 2024-09-12T18:59:59.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.935+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.75kY9LQZdaAEtgowyd-AI13-tpwUsa6_0 2024-09-12T18:59:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9621647056425105139', time=2024-09-12T20:29:06.477117+0000, chain.objs.size()=1 2024-09-12T18:59:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.b6es62HrBBd0ClbTzfDdGgNGVsgYfpn_0 2024-09-12T18:59:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7412495157402347675', time=2024-09-12T20:29:06.825903+0000, chain.objs.size()=1 2024-09-12T18:59:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.sxRG867YPL1wfoakj-b_NaUYt1k1SPr_0 2024-09-12T18:59:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.128107090816131240', time=2024-09-12T20:29:08.003511+0000, chain.objs.size()=1 2024-09-12T18:59:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.UeAsd5plKW3WPK582zoKB5HgIAWbfKm_0 2024-09-12T18:59:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3773121853069411896', time=2024-09-12T20:29:08.351356+0000, chain.objs.size()=1 2024-09-12T18:59:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.PvZNDFNsUL_47Is-li2W5HPdl7Flg3G_0 2024-09-12T18:59:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.185293133787634148', time=2024-09-12T20:29:08.589911+0000, chain.objs.size()=1 2024-09-12T18:59:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.psgQkHJWCzieJ-AgTzbEeSqz-8wpE9f_0 2024-09-12T18:59:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13427686034812668038', time=2024-09-12T20:29:08.835329+0000, chain.objs.size()=1 2024-09-12T18:59:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8k6Nivpnuqd8z5O0DBfmvl5_5Hr3T2R_0 2024-09-12T18:59:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17437212213211883600', time=2024-09-12T20:29:09.499824+0000, chain.objs.size()=1 2024-09-12T18:59:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.h42YuePFOGecndzFZRiuuiGxlKzuLH5_0 2024-09-12T18:59:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.56161339507781751', time=2024-09-12T20:29:09.972049+0000, chain.objs.size()=1 2024-09-12T18:59:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.0e3KJmq_i3vKS9srAz6Vf-l7LmiSS7o_0 2024-09-12T18:59:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.123578108998005729', time=2024-09-12T20:29:10.105321+0000, chain.objs.size()=1 2024-09-12T18:59:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.cCtGAHkJPgaLuGubRf-PpFvVyT3oVnN_0 2024-09-12T18:59:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16243803834780255257', time=2024-09-12T20:29:10.382038+0000, chain.objs.size()=1 2024-09-12T18:59:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.u4RZViW_dg3J1SG8DyuscAIsijDsDNa_0 2024-09-12T18:59:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6427462263396306647', time=2024-09-12T20:29:10.759348+0000, chain.objs.size()=1 2024-09-12T18:59:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.SKUpuWnobvZusEa1m4WV21dV4A8iKth_0 2024-09-12T18:59:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10050995155559345001', time=2024-09-12T20:29:11.359222+0000, chain.objs.size()=1 2024-09-12T18:59:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.akD9TPjzF3vZ9nLzHJJNTHBNOZWc6SU_0 2024-09-12T18:59:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16643410798556481554', time=2024-09-12T20:29:11.978029+0000, chain.objs.size()=1 2024-09-12T18:59:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.9gtGbcTTFkPCGcZFT36SYV5VI_WvW6k_0 2024-09-12T18:59:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13212442880445457468', time=2024-09-12T20:29:12.447208+0000, chain.objs.size()=1 2024-09-12T18:59:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.TVaGwT2nLB8azl2zVY0P33feLXHPemn_0 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7225277616246172596', time=2024-09-12T20:29:13.188290+0000, chain.objs.size()=1 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.GLC8bQA8uayRKd0Qh8rfP1eSFb9AwO9_0 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6471694935824581159', time=2024-09-12T20:29:13.247558+0000, chain.objs.size()=1 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kbE11u2FwhdwKmXRfSBAgRFoRAVWXJe_0 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11645745684575842642', time=2024-09-12T20:29:13.564682+0000, chain.objs.size()=1 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.mtb-RQ5OLR9ASQaOpnfiKuJbVH6c6fR_0 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8629871556461339022', time=2024-09-12T20:29:13.656092+0000, chain.objs.size()=1 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.dNX4pWcEvSA3FNQgGRfT8a5c3OlUzHh_0 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17927298421999611333', time=2024-09-12T20:29:14.847621+0000, chain.objs.size()=1 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.leE13vSNEtsBavwvqbZe-i3zQEnUSfQ_0 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3494721943040882774', time=2024-09-12T20:29:15.407569+0000, chain.objs.size()=1 2024-09-12T18:59:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._dntJiRDf-uQFisohHAZjjG8Gi27-qd_0 2024-09-12T18:59:59.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16473222444216034710', time=2024-09-12T20:29:16.800166+0000, chain.objs.size()=1 2024-09-12T18:59:59.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.263__shadow_.N5a-8vyZOE9w4E0jA84ArFOZVo5xEtv_0 2024-09-12T18:59:59.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15327368494061083404', time=2024-09-12T20:30:03.697888+0000, chain.objs.size()=1 2024-09-12T18:59:59.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.939+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.0knACQ7ZnfJhmEGHTfl6B1kM3tbewYs_0 2024-09-12T18:59:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9221647664858548562', time=2024-09-12T20:30:20.839536+0000, chain.objs.size()=1 2024-09-12T18:59:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.305__shadow_.fOpGRU-0DW8-HqNxD2vzGl8jbvf65HM_0 2024-09-12T18:59:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2385655745103299066', time=2024-09-12T20:32:27.887639+0000, chain.objs.size()=1 2024-09-12T18:59:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tC_86uKNh-V5KkRHcYxFh_LBEqR_ofr_0 2024-09-12T18:59:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10748812755404259506', time=2024-09-12T20:32:27.889068+0000, chain.objs.size()=1 2024-09-12T18:59:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.bJuVVXYoAgwQAtR1xFENtxqL-rWr2S7_0 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12229627332197301066', time=2024-09-12T20:32:28.458189+0000, chain.objs.size()=1 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3cI52tBcZiIzzi7dgS9E_LvydaVmzd2_0 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4348578950903267072', time=2024-09-12T20:32:29.462873+0000, chain.objs.size()=1 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.oN-IGOeG5_5xEu3bX3VNXeS9dnobPT3_0 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10490089764957630334', time=2024-09-12T20:32:29.603254+0000, chain.objs.size()=1 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.vGBu8m4iZWYrjVA5Xa_aCrdW3l6Df9a_0 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6969423033564781772', time=2024-09-12T20:32:30.608467+0000, chain.objs.size()=1 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.2nFoxTqnGlVfbia7bVhN6kV1eNi2olG_0 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13796128534290572394', time=2024-09-12T20:32:31.295313+0000, chain.objs.size()=1 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tXAyt7Z7vCtNYHOMpiZL27WHFXXSyYh_0 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1846218526339800478', time=2024-09-12T20:32:31.802070+0000, chain.objs.size()=1 2024-09-12T18:59:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.N0NZqfLfvSRML-ylh_uskszT08J_0wc_0 2024-09-12T18:59:59.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10041040898248943151', time=2024-09-12T20:32:31.845697+0000, chain.objs.size()=1 2024-09-12T18:59:59.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0LQjTpW8bLXTbBRNLY5dfs6W7yGIO2j_0 2024-09-12T18:59:59.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14953593690828048050', time=2024-09-12T20:32:32.181466+0000, chain.objs.size()=1 2024-09-12T18:59:59.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yjGoMprYfi0s6EZV09AdGdHsbLQ5ZWr_0 2024-09-12T18:59:59.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9712356781922741606', time=2024-09-12T20:32:38.529554+0000, chain.objs.size()=1 2024-09-12T18:59:59.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.bk7USd_EKL2-SarWsGXeRpkSKddhMJG_0 2024-09-12T18:59:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3146319022283912355', time=2024-09-12T20:32:39.892361+0000, chain.objs.size()=1 2024-09-12T18:59:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.SEvkKMjGfs7_uPQp_proEsslYVJaKj8_0 2024-09-12T18:59:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1263760579176245605', time=2024-09-12T20:32:40.345260+0000, chain.objs.size()=1 2024-09-12T18:59:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.P-dbWKOqqW8L_bk47p4zw2Yzrqf5O8N_0 2024-09-12T18:59:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15748423940738042825', time=2024-09-12T20:32:44.753438+0000, chain.objs.size()=1 2024-09-12T18:59:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.xQSYHOhFN_N2KoBLv_8yWLIir6wlph1_0 2024-09-12T18:59:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16335018725399469532', time=2024-09-12T20:32:45.062479+0000, chain.objs.size()=1 2024-09-12T18:59:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.DdXue4Isg22sza-U3P4Sl5jPY-QbKb0_0 2024-09-12T18:59:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3524799971827461620', time=2024-09-12T20:32:46.158654+0000, chain.objs.size()=1 2024-09-12T18:59:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.943+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.G9xVkSlsur8Ui-oDx7Fyq4F9FdchMcE_0 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12580416366477739669', time=2024-09-12T20:32:46.392615+0000, chain.objs.size()=1 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BsMT3uh_FhbWeaRSgsXQWAbfWn59q-p_0 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14410388169266917411', time=2024-09-12T20:32:49.606060+0000, chain.objs.size()=1 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.K3meDH_LwhpZ8fp-IzqG00tr6n5Wq2F_0 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7033883538898717913', time=2024-09-12T20:32:49.678636+0000, chain.objs.size()=1 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.QAeP2eoDJ5sWNXh15SeYyfP5jlHaTwG_0 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9771361515110485161', time=2024-09-12T20:32:50.081821+0000, chain.objs.size()=1 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yd15HQCgq7PFNc06sdfytQB92vlqAuF_0 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16103029132716208131', time=2024-09-12T20:32:50.946373+0000, chain.objs.size()=1 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.RNATsRxXLbbrv4GZ4_4WMJn-7Tedweo_0 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10277475838345204784', time=2024-09-12T20:32:50.989667+0000, chain.objs.size()=1 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.dMEQPZcoD0iao7b1Tqs8fzg1UH18RLj_0 2024-09-12T18:59:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3897745618693058703', time=2024-09-12T20:32:51.886926+0000, chain.objs.size()=1 2024-09-12T18:59:59.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.lW1YAP8Y2DA0aHYf6ato6Tgj7MII_UD_0 2024-09-12T18:59:59.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.447773270767025230', time=2024-09-12T20:32:52.030254+0000, chain.objs.size()=1 2024-09-12T18:59:59.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nHUa6IyC5lyQiE-BUPfjoUU4E0LP8E4_0 2024-09-12T18:59:59.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3299234487162206812', time=2024-09-12T20:32:52.769587+0000, chain.objs.size()=1 2024-09-12T18:59:59.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.mzq7u0vRzJtStT-d4ZeOWmIX4hxqkTW_0 2024-09-12T18:59:59.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16282883135338643184', time=2024-09-12T20:32:53.067699+0000, chain.objs.size()=1 2024-09-12T18:59:59.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.k4FKYzrKGltznTlYRnbkD2yyv5TzjE7_0 2024-09-12T18:59:59.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.822262953278409719', time=2024-09-12T20:34:34.455338+0000, chain.objs.size()=1 2024-09-12T18:59:59.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.orHan1oTL2PwOv8V94P8ZnvTeYKaqu4_0 2024-09-12T18:59:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3857481771917215117', time=2024-09-12T20:34:34.936300+0000, chain.objs.size()=1 2024-09-12T18:59:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.TJknPmA88eyMtT8pUiiocv7lrfawy6U_0 2024-09-12T18:59:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16628637575999284244', time=2024-09-12T20:34:35.418097+0000, chain.objs.size()=1 2024-09-12T18:59:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.947+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Mzfh14CV3WOB3Wg56djL9zDYf6CfOhm_0 2024-09-12T18:59:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16127092697786225558', time=2024-09-12T20:34:36.251579+0000, chain.objs.size()=1 2024-09-12T18:59:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.exsau77oz12_YQj0pt7U8-CsjckKVLt_0 2024-09-12T18:59:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9919462661932930838', time=2024-09-12T20:34:36.351908+0000, chain.objs.size()=1 2024-09-12T18:59:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.LGtDbLJgunlpp6T0uvYcy9JkLjg-Zjx_0 2024-09-12T18:59:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15968628955032208281', time=2024-09-12T20:34:36.511687+0000, chain.objs.size()=1 2024-09-12T18:59:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._ZO9n1Otoky3Y3rQJVDmalGBw1BuwkY_0 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8706343914452313004', time=2024-09-12T20:34:37.955585+0000, chain.objs.size()=1 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.fBRhfJhMCvR_r1GsYUMr6hSbL1_vTGM_0 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3380532742531488956', time=2024-09-12T20:34:38.941969+0000, chain.objs.size()=1 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MKjGgCnf-liAGjzRcLrIT5wJM8HGTMI_0 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10050294239328941272', time=2024-09-12T20:34:40.258800+0000, chain.objs.size()=1 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Nw2jJUaThK_WxAdpnuEYY5-Tr7vj4RX_0 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16061979824764626659', time=2024-09-12T20:34:41.412138+0000, chain.objs.size()=1 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.0STk-qVDNlmtCcL_Rd8_Yq6Vs1BgVgR_0 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10711098543573894595', time=2024-09-12T20:34:41.969402+0000, chain.objs.size()=1 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Z4NqkF5XnGnEFEnw9za-jRNaTO6KPlL_0 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7675387442668712129', time=2024-09-12T20:34:46.958918+0000, chain.objs.size()=1 2024-09-12T18:59:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.eB4O7IRJJbHLe4WdA1caM5uOxhk0wj5_0 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10273512372853904546', time=2024-09-12T20:34:46.961048+0000, chain.objs.size()=1 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.yHr9qOm-bsb5bkYUz0Ewo_9WLKX19S-_0 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1911504159330341868', time=2024-09-12T20:34:49.256755+0000, chain.objs.size()=1 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nSoPfylhCklgWawgLvRSwI62W3opAug_0 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.612402356324447606', time=2024-09-12T20:34:52.980943+0000, chain.objs.size()=1 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kvzoBsAO6hG-kwFa6MMBbtCwsP37anf_0 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18216880283135099640', time=2024-09-12T20:34:53.113384+0000, chain.objs.size()=1 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.us2BvTLrhhyTu9MmdRLdw2_jTMT4vZI_0 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15949154649970548428', time=2024-09-12T20:34:53.597656+0000, chain.objs.size()=1 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HO-zilJMYiNEfpq2WS0E4V4cnW0RsXj_0 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18169971318332112160', time=2024-09-12T20:34:53.726863+0000, chain.objs.size()=1 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qAq2heYGhc0PKW27qa-wDIW7bq0DMnu_0 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4882944355569099916', time=2024-09-12T20:34:54.638570+0000, chain.objs.size()=1 2024-09-12T18:59:59.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kT-zlJu6oxHEN6_Ul9uf6NobP9rB1Ei_0 2024-09-12T18:59:59.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3553421894374317951', time=2024-09-12T20:34:54.796377+0000, chain.objs.size()=1 2024-09-12T18:59:59.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4fNsEMUb1dNAwbk6GkqT1Ov8ctuXBqj_0 2024-09-12T18:59:59.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8272884125050505938', time=2024-09-12T20:34:55.724127+0000, chain.objs.size()=1 2024-09-12T18:59:59.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4y1kfjwaHhk9zMliE10yhZ5w_YY8Hlx_0 2024-09-12T18:59:59.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.116087122754881512', time=2024-09-12T20:34:56.174010+0000, chain.objs.size()=1 2024-09-12T18:59:59.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.q4juLYju23ehASiFkdBZIuNlwf5ffnw_0 2024-09-12T18:59:59.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15461982360925176278', time=2024-09-12T20:34:57.163012+0000, chain.objs.size()=1 2024-09-12T18:59:59.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nKxDgUUHLHwuPaQPOuekBedChbXNkvo_0 2024-09-12T18:59:59.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1236943081000137448', time=2024-09-12T20:34:57.277822+0000, chain.objs.size()=1 2024-09-12T18:59:59.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.vRK5FMjUOswYoNKh57FTjo1xpJK_JFR_0 2024-09-12T18:59:59.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12107586118406093324', time=2024-09-12T20:34:57.502984+0000, chain.objs.size()=1 2024-09-12T18:59:59.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.951+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.V4n3Mzul2pF4SuZlICos0vYRPwFxP1C_0 2024-09-12T18:59:59.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.976419396391063769', time=2024-09-12T20:34:57.788272+0000, chain.objs.size()=1 2024-09-12T18:59:59.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.M_B86ECggehQ7plGI3NHvZU7RzEqRh5_0 2024-09-12T18:59:59.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1870861263692023805', time=2024-09-12T20:34:57.978041+0000, chain.objs.size()=1 2024-09-12T18:59:59.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JEYLtssdaDBikxoWYQx9Nd_QGmLj3Wb_0 2024-09-12T18:59:59.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11715652407826439166', time=2024-09-12T20:34:58.191059+0000, chain.objs.size()=1 2024-09-12T18:59:59.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HyvCfxM2ZSham05J1CJ2NtoFaq1Q2Ju_0 2024-09-12T18:59:59.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15435100244460437351', time=2024-09-12T20:34:58.278469+0000, chain.objs.size()=1 2024-09-12T18:59:59.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Rm2ledUmHWtnPEHFxLVoooKdFxw_cDT_0 2024-09-12T18:59:59.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15432269344938094295', time=2024-09-12T20:34:58.600047+0000, chain.objs.size()=1 2024-09-12T18:59:59.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.2ITcpO33fhuXkiDEtLfxs5d3O-6uRLg_0 2024-09-12T18:59:59.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10974391737109861419', time=2024-09-12T20:35:00.375090+0000, chain.objs.size()=1 2024-09-12T18:59:59.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.j0rhKpMVlghTjDYWdsX4eRyOV1e5MX2_0 2024-09-12T18:59:59.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/56373 2024-09-12T18:59:59.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T18:59:59.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17138411637293718150', time=2024-09-12T20:35:01.378890+0000, chain.objs.size()=1 2024-09-12T18:59:59.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5djGIvdaXixxtjdrZu1kQgYmV6qK3pi_0 2024-09-12T18:59:59.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16908277306759428792', time=2024-09-12T20:35:01.543195+0000, chain.objs.size()=1 2024-09-12T18:59:59.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.TyPNTWbT1eYMwG-cYSpiKhmGSWYZDgh_0 2024-09-12T18:59:59.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6157680818151302573', time=2024-09-12T20:35:10.253537+0000, chain.objs.size()=1 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.332__shadow_.6GcrFSEXLsMHRpPdFfNbVCvS5jrRvd1_0 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10999268105331384328', time=2024-09-12T20:35:11.026520+0000, chain.objs.size()=1 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.333__shadow_.SAcOTET3GYPs_EkpNqRtnBwf18yFubY_0 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2947203332177167620', time=2024-09-12T20:35:11.392382+0000, chain.objs.size()=1 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.333__shadow_.3-thapGWI-r3wD1comuq2GdFUH9DHuV_0 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9968596669135409690', time=2024-09-12T20:35:12.451029+0000, chain.objs.size()=1 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.334__shadow_.9fgwzpde1HLgWafomeTXAxltJ4hHezq_0 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13090752499508289042', time=2024-09-12T20:35:51.822676+0000, chain.objs.size()=1 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.375__shadow_.fLKz_5KtxKfycmF_difzPo97VJzEH-T_0 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17641948818249656621', time=2024-09-12T20:37:01.813421+0000, chain.objs.size()=1 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.955+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.439__shadow_.7NJtTVcW95-3kjiF9j7oEnxnP5ZtzkO_0 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4126643418466443437', time=2024-09-12T20:37:21.492972+0000, chain.objs.size()=1 2024-09-12T18:59:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.455__shadow_.XoUIwZ4KcAB5IOHDtXv311HvuvsgDjE_0 2024-09-12T18:59:59.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.61351004135324036', time=2024-09-12T20:37:23.206788+0000, chain.objs.size()=1 2024-09-12T18:59:59.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.456__shadow_.rjPrA5XvN0yqsDUuu9dXGZ6j6eW2Kr1_0 2024-09-12T18:59:59.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16393232869180410243', time=2024-09-12T20:37:33.883719+0000, chain.objs.size()=1 2024-09-12T18:59:59.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.462__shadow_.jBlGz_K9duelEwOipkzS88G214p79s9_0 2024-09-12T18:59:59.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3764162133283884718', time=2024-09-12T20:37:56.794130+0000, chain.objs.size()=1 2024-09-12T18:59:59.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.u3TcKpBaytGPygTF7KzLHFWTBMxdeBy_0 2024-09-12T18:59:59.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16137662497446488510', time=2024-09-12T20:38:07.015085+0000, chain.objs.size()=1 2024-09-12T18:59:59.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.488__shadow_.cXBiGa1PeDzFg1BUxSMr240Bru9A7qA_0 2024-09-12T18:59:59.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9012874624411566010', time=2024-09-12T20:38:38.963589+0000, chain.objs.size()=6 2024-09-12T18:59:59.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.1 2024-09-12T18:59:59.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.2 2024-09-12T18:59:59.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.3 2024-09-12T18:59:59.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.4 2024-09-12T18:59:59.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.5 2024-09-12T18:59:59.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.507__multipart_srcmultipart.2~uJ16ZQ3Vsd0dYTbjxnzn1jrCrso75Rz.6 2024-09-12T18:59:59.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3721124231322705792', time=2024-09-12T20:42:53.163431+0000, chain.objs.size()=2 2024-09-12T18:59:59.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.552__shadow_.shHhDAHj3QlsRguhm5tLuwyQMpZ9Mr9_0 2024-09-12T18:59:59.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.552__shadow_.shHhDAHj3QlsRguhm5tLuwyQMpZ9Mr9_1 2024-09-12T18:59:59.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8356534653631101086', time=2024-09-12T20:44:21.647101+0000, chain.objs.size()=1 2024-09-12T18:59:59.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.575__shadow_.EXeXBi98btFJozS17mI_NuHj-Od3h6V_0 2024-09-12T18:59:59.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12567384648675501280', time=2024-09-12T20:44:51.114220+0000, chain.objs.size()=1 2024-09-12T18:59:59.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.959+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:DysMi0fH4oyHqPfSvQzQARTu20Dl8DD_.76abWomke80Tji5wt8OkuG4kIw8WgXC_0 2024-09-12T18:59:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17525067886984810024', time=2024-09-12T20:45:49.175478+0000, chain.objs.size()=1 2024-09-12T18:59:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.586__shadow:skpHOTRqofTXPiCPq9SpAStn23ceRd3_.v3UZ3ZzRbfU-rLNInrRlOCgEHPHcWlK_0 2024-09-12T18:59:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11892140680233712419', time=2024-09-12T20:45:52.381750+0000, chain.objs.size()=1 2024-09-12T18:59:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.587__shadow:n.ai9Be3n.ghUVFL.8PbS7.qSpklZRZ_.oT0DXzk4D29mehB7yKl8moAAXqkJTP3_0 2024-09-12T18:59:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1235547338850631504', time=2024-09-12T20:47:34.077114+0000, chain.objs.size()=12 2024-09-12T18:59:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__multipart_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.1 2024-09-12T18:59:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__shadow_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.1_1 2024-09-12T18:59:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__multipart_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.2 2024-09-12T18:59:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__shadow_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.2_1 2024-09-12T18:59:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__multipart_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.3 2024-09-12T18:59:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__shadow_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.3_1 2024-09-12T18:59:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__multipart_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.4 2024-09-12T18:59:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__shadow_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.4_1 2024-09-12T18:59:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__multipart_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.5 2024-09-12T18:59:59.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__shadow_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.5_1 2024-09-12T18:59:59.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.963+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__multipart_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.6 2024-09-12T18:59:59.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.614__shadow_multipart_enc.2~1PmetU2inYjatDTuaVDCcTJ2B3BoAYy.6_1 2024-09-12T18:59:59.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11831040978748915702', time=2024-09-12T20:49:48.699383+0000, chain.objs.size()=1 2024-09-12T18:59:59.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.618__shadow_.kTt516h4FcLvdRCqHC5TD15Oho_XkV9_0 2024-09-12T18:59:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16740354211059456651', time=2024-09-12T20:52:14.504236+0000, chain.objs.size()=1 2024-09-12T18:59:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.679__shadow_.jXCzDSWV_8zqAHA_twFTs2lkDXT2GmX_0 2024-09-12T18:59:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1079925310431238591', time=2024-09-12T20:52:45.354979+0000, chain.objs.size()=1 2024-09-12T18:59:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.706__shadow_.OH0diFSRjmjzwXwOVk6ffbud6ZFv5Sf_0 2024-09-12T18:59:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.967+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16395118297268228771', time=2024-09-12T20:52:50.364600+0000, chain.objs.size()=1 2024-09-12T18:59:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.710__shadow:B6CLiB83E-R-KKHstguQTxgcav-iPm4_.BpPFEzPWoIDAslEn1gkjKVzARZoFnTQ_0 2024-09-12T18:59:59.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.967+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:59:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:59:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:59:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:59:59.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51275' 2024-09-12T18:59:59.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='_h3ceJ1U-kqnrRM3ctKm_SsTCvah_n9o', time=2024-09-12T20:22:44.752108+0000, chain.objs.size()=3 2024-09-12T18:59:59.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.M5k__MVX4lFoVyZuMjaoV8NqvBwwlUc_0 2024-09-12T18:59:59.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.M5k__MVX4lFoVyZuMjaoV8NqvBwwlUc_1 2024-09-12T18:59:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.161__shadow_.M5k__MVX4lFoVyZuMjaoV8NqvBwwlUc_2 2024-09-12T18:59:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1963383028596997978', time=2024-09-12T20:23:23.154944+0000, chain.objs.size()=1 2024-09-12T18:59:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.188__shadow_.0VpQa2e3JvPdGun8a-KY_fC3l7QmcVU_0 2024-09-12T18:59:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5096157634525488207', time=2024-09-12T20:26:28.135544+0000, chain.objs.size()=1 2024-09-12T18:59:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.233__shadow_.pw3hNM7WuAhlnr-ZK_8CRj-qgRifXj2_0 2024-09-12T18:59:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11762122311866793084', time=2024-09-12T20:26:43.416624+0000, chain.objs.size()=1 2024-09-12T18:59:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.243__shadow_.syN7COL9TfNJVNjr6OdTdcm0aBoWE0m_0 2024-09-12T18:59:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16080244417051038952', time=2024-09-12T20:26:56.674220+0000, chain.objs.size()=1 2024-09-12T18:59:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.252__shadow_.-cHPzfKEjsz8XUCZcK-20c4oriORpoB_0 2024-09-12T18:59:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9038448816462840328', time=2024-09-12T20:28:48.136246+0000, chain.objs.size()=1 2024-09-12T18:59:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.n6bTo0N4o7mEjfyW8f2aZmGYZlNmm9y_0 2024-09-12T18:59:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16515814149270557949', time=2024-09-12T20:28:50.371134+0000, chain.objs.size()=1 2024-09-12T18:59:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.FT7CXZMDpK0_-oBeT4asR2Oga76DYjk_0 2024-09-12T18:59:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6248050495542174690', time=2024-09-12T20:28:52.023052+0000, chain.objs.size()=1 2024-09-12T18:59:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kWzwJviRxvwVt7m2OPypHt0rK6SwT12_0 2024-09-12T18:59:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9492393181039500598', time=2024-09-12T20:28:52.819625+0000, chain.objs.size()=1 2024-09-12T18:59:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Mla79n67wPRe-wAFHNh0odQ8DzwMt0t_0 2024-09-12T18:59:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10941214626796851618', time=2024-09-12T20:28:53.318786+0000, chain.objs.size()=1 2024-09-12T18:59:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.971+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5m4ipaOVJsCUqNDFowiq-l8z_L6OSqf_0 2024-09-12T18:59:59.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4018557759992418284', time=2024-09-12T20:28:55.907901+0000, chain.objs.size()=1 2024-09-12T18:59:59.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.uu2zPwWtBgqWC31sj6gIXxX0pompacZ_0 2024-09-12T18:59:59.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15636779330695563585', time=2024-09-12T20:28:57.528620+0000, chain.objs.size()=1 2024-09-12T18:59:59.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.xJaVYqqvUflJ11tzQ2nAD93-FQJncIg_0 2024-09-12T18:59:59.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6151640492086768869', time=2024-09-12T20:28:57.621378+0000, chain.objs.size()=1 2024-09-12T18:59:59.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WtKLPqsrHGiw42vprKQnAgyPpb0ipW__0 2024-09-12T18:59:59.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9332577468637710876', time=2024-09-12T20:29:00.969647+0000, chain.objs.size()=1 2024-09-12T18:59:59.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rfzkI-NksUTkhgciwruxi7tOMV_PBpt_0 2024-09-12T18:59:59.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16524265993788935633', time=2024-09-12T20:29:00.971965+0000, chain.objs.size()=1 2024-09-12T18:59:59.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.f_EYJ3mdDyoyNzsQNBbSmFu7H7v36V6_0 2024-09-12T18:59:59.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7672713188271929058', time=2024-09-12T20:29:01.574002+0000, chain.objs.size()=1 2024-09-12T18:59:59.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.ve_XOb__cOttRsSnEeyAYTsZP2XSnSG_0 2024-09-12T18:59:59.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17999389221931074607', time=2024-09-12T20:29:03.779107+0000, chain.objs.size()=1 2024-09-12T18:59:59.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DXKVu0RKLHS0tSBslUQ_ahgzUYWzkQt_0 2024-09-12T18:59:59.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6440449323926624901', time=2024-09-12T20:29:06.049574+0000, chain.objs.size()=1 2024-09-12T18:59:59.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vcrKungyR2ccWYu5KNkZG3qUu6DtNUo_0 2024-09-12T18:59:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13286721686983599676', time=2024-09-12T20:29:06.386236+0000, chain.objs.size()=1 2024-09-12T18:59:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.KmtwKn_ISqcWwn7TjaF6PjUUY9DvAGj_0 2024-09-12T18:59:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8789525458998962488', time=2024-09-12T20:29:06.853211+0000, chain.objs.size()=1 2024-09-12T18:59:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fXORgvc9AXaf1KMgFgT0xgMM-OgtvQr_0 2024-09-12T18:59:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14344851676010942020', time=2024-09-12T20:29:07.693996+0000, chain.objs.size()=1 2024-09-12T18:59:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.wbZINk02VT3JaCXPQ77bV0tTVMkfdqm_0 2024-09-12T18:59:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7518367202474292322', time=2024-09-12T20:29:07.703871+0000, chain.objs.size()=1 2024-09-12T18:59:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.975+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.-oPsZWQTddFnuSSVaK-iyiyLtgf0f7u_0 2024-09-12T18:59:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14683487970867123717', time=2024-09-12T20:29:08.354788+0000, chain.objs.size()=1 2024-09-12T18:59:59.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WcfBS58rD-ZhHMHQzFoJkpeHH98TYjQ_0 2024-09-12T18:59:59.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16660538980848108989', time=2024-09-12T20:29:09.746031+0000, chain.objs.size()=1 2024-09-12T18:59:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.O2evIppVkpb0n4Yf4iKKtpBD10caLrW_0 2024-09-12T18:59:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1411020232241150526', time=2024-09-12T20:29:10.300070+0000, chain.objs.size()=1 2024-09-12T18:59:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_._LcqYqX915ae1zvOTcQjjDyVpU5qHs0_0 2024-09-12T18:59:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17295330380174227818', time=2024-09-12T20:29:10.646908+0000, chain.objs.size()=1 2024-09-12T18:59:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.kcITXttu4r6y_QFUuZ0-V435maGCCgh_0 2024-09-12T18:59:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7810490258878462208', time=2024-09-12T20:29:11.871136+0000, chain.objs.size()=1 2024-09-12T18:59:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.q7kR84AfqO6lCxuWT1Ak93mYWK0praz_0 2024-09-12T18:59:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13770882753041107619', time=2024-09-12T20:29:13.238741+0000, chain.objs.size()=1 2024-09-12T18:59:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.l4KvbA0Mlx-w6m7eiw9MV7H52vHzW8__0 2024-09-12T18:59:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8951121219493841575', time=2024-09-12T20:29:13.667459+0000, chain.objs.size()=1 2024-09-12T18:59:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.VOUPMFmhgNSGueDaff58X_cIk1SDLi4_0 2024-09-12T18:59:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18056488681979296655', time=2024-09-12T20:29:14.272189+0000, chain.objs.size()=1 2024-09-12T18:59:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.MSBwGJJx1daflJ2PB3iRb6zg0zGNJdy_0 2024-09-12T18:59:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3288973925419692213', time=2024-09-12T20:29:14.591956+0000, chain.objs.size()=1 2024-09-12T18:59:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.DBq5IfmcWNb6BeWIUmvBt6tzeUGLaWf_0 2024-09-12T18:59:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4954621463160764111', time=2024-09-12T20:29:24.450913+0000, chain.objs.size()=1 2024-09-12T18:59:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.269__shadow_.8xA5Sl43IRVpB4q0T3GHlzqGeayjP7m_0 2024-09-12T18:59:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12188451792021591801', time=2024-09-12T20:29:49.130057+0000, chain.objs.size()=1 2024-09-12T18:59:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.287__shadow_._EviRvsbdDZ_4BHUiFQeXfHOApvipU2_0 2024-09-12T18:59:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6302662658288067747', time=2024-09-12T20:29:50.544036+0000, chain.objs.size()=1 2024-09-12T18:59:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.288__shadow_.YI6L95mo8jXAn4knVYfrO4R9h53n6Yw_0 2024-09-12T18:59:59.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10059636753217749765', time=2024-09-12T20:29:53.286036+0000, chain.objs.size()=1 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.290__shadow_.eFO_SXceMtayEy4s1hBtKmwaNxWbYDr_0 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8273758112637417843', time=2024-09-12T20:29:59.296656+0000, chain.objs.size()=1 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.U0KiA3q3oUkMVrPTfYr4i9JPEffVK0i_0 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.93788519587271125', time=2024-09-12T20:29:59.299508+0000, chain.objs.size()=1 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.-RLI0Df5kZjcy8RuAkrCNPclZP3-W7r_0 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.606691675874483920', time=2024-09-12T20:29:59.337101+0000, chain.objs.size()=1 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.sHEjeqTPN6tgokDxffldRYDV6KW4DNd_0 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10086117927052895880', time=2024-09-12T20:30:03.564255+0000, chain.objs.size()=1 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.979+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.vdwiOmRDcejzIUy4uEVS4A1WaxPJ_88_0 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16199059917656603688', time=2024-09-12T20:30:03.633672+0000, chain.objs.size()=1 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.N8hjekQdnQi4yN0xvJyD8YOMRLyswQI_0 2024-09-12T18:59:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6493915107980630274', time=2024-09-12T20:30:03.881359+0000, chain.objs.size()=1 2024-09-12T18:59:59.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.bXIPyhrUgBWFm2RUHlAG8GLmNNpKUJK_0 2024-09-12T18:59:59.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8839902164583663786', time=2024-09-12T20:30:15.302612+0000, chain.objs.size()=1 2024-09-12T18:59:59.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.301__shadow_.4JvSjmr1CAM1ztJUihZJ2JTcHz2cV6i_0 2024-09-12T18:59:59.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12930183574945080941', time=2024-09-12T20:30:44.030805+0000, chain.objs.size()=1 2024-09-12T18:59:59.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.321__shadow_.DwCqVipgs7iq5ZbgP45SKgxeiL0ZHVF_0 2024-09-12T18:59:59.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4831317617888145983', time=2024-09-12T20:32:26.903665+0000, chain.objs.size()=1 2024-09-12T18:59:59.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._YHuvude87qzfr5LnX7O1fa390Aq3VG_0 2024-09-12T18:59:59.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8150980980505922925', time=2024-09-12T20:32:26.905345+0000, chain.objs.size()=1 2024-09-12T18:59:59.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Fi5a-CmiZ_ddfSJJZEP-JJrx_6jOKNt_0 2024-09-12T18:59:59.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13248376904595186763', time=2024-09-12T20:32:28.135703+0000, chain.objs.size()=1 2024-09-12T18:59:59.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.utKAhf_LoLqezCzsVA9sMvK4i6KjoK8_0 2024-09-12T18:59:59.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17334528411737678015', time=2024-09-12T20:32:28.479781+0000, chain.objs.size()=1 2024-09-12T18:59:59.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.PDiT5wXgikZCxf6OLo6AJcrTXan48n8_0 2024-09-12T18:59:59.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3809830755512646693', time=2024-09-12T20:32:29.042346+0000, chain.objs.size()=1 2024-09-12T18:59:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.OHjfycLm7ppucdoSGvRQdL4KTScbacP_0 2024-09-12T18:59:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9891989085188393945', time=2024-09-12T20:32:29.078007+0000, chain.objs.size()=1 2024-09-12T18:59:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.icgNPVhG74jO8iMSZWOWVV7d-UHPxl1_0 2024-09-12T18:59:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4494583961188429961', time=2024-09-12T20:32:29.162232+0000, chain.objs.size()=1 2024-09-12T18:59:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1qdYBT79kmfRHBuhyWpmbxxl017pUZl_0 2024-09-12T18:59:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5591123831932917460', time=2024-09-12T20:32:31.465042+0000, chain.objs.size()=1 2024-09-12T18:59:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.59xgdLLDU0_dpHIYklCk38Nm0MCR6YC_0 2024-09-12T18:59:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4946873156970843269', time=2024-09-12T20:32:32.685450+0000, chain.objs.size()=1 2024-09-12T18:59:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gapetjGcMVRFbScjKgWm42hOuFbL2eq_0 2024-09-12T18:59:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9762342945222527165', time=2024-09-12T20:32:34.293515+0000, chain.objs.size()=1 2024-09-12T18:59:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yyqu-YyV0zmB8bUy7TlGn9iU3FW57kx_0 2024-09-12T18:59:59.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1891812250195263172', time=2024-09-12T20:32:34.356659+0000, chain.objs.size()=1 2024-09-12T18:59:59.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.OkG433cBwMFBTyni0C4bYqRO6OV72yg_0 2024-09-12T18:59:59.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12609442884552459365', time=2024-09-12T20:32:35.582106+0000, chain.objs.size()=1 2024-09-12T18:59:59.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ZO6DHgCw5QKc87nyrxzDGYXbDJyvR88_0 2024-09-12T18:59:59.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3106015193344634815', time=2024-09-12T20:32:35.676875+0000, chain.objs.size()=1 2024-09-12T18:59:59.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.KCt9xLNTl6h0SAUXRcs7ux6wndzQgWg_0 2024-09-12T18:59:59.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4161406262441536545', time=2024-09-12T20:32:35.791878+0000, chain.objs.size()=1 2024-09-12T18:59:59.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.D2G7PFoRHybRc-ljVYeIv3_hBJQGCcc_0 2024-09-12T18:59:59.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7262488133992736392', time=2024-09-12T20:32:35.795364+0000, chain.objs.size()=1 2024-09-12T18:59:59.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.983+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.68T8mqXmdOdGpoewPz7uSNvwC0o3PXx_0 2024-09-12T18:59:59.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13314274199402304296', time=2024-09-12T20:32:38.517283+0000, chain.objs.size()=1 2024-09-12T18:59:59.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.y35sTEh50BAvsdokTHW7T2jXmGhrf5W_0 2024-09-12T18:59:59.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12725275827006189732', time=2024-09-12T20:32:38.519637+0000, chain.objs.size()=1 2024-09-12T18:59:59.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.J5H0KbenlVFJvIGG4BOnoyB4XsPQ0HP_0 2024-09-12T18:59:59.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5744067959499758108', time=2024-09-12T20:32:38.801296+0000, chain.objs.size()=1 2024-09-12T18:59:59.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Xj1-Q8RReLKhPTiFZQhh8_GRePCBDFK_0 2024-09-12T18:59:59.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7618266589220977295', time=2024-09-12T20:32:39.572799+0000, chain.objs.size()=1 2024-09-12T18:59:59.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.KKsaeNb0eTYQj7mSjRWsE72P5GybhxY_0 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13292874211356817624', time=2024-09-12T20:32:40.416990+0000, chain.objs.size()=1 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0pDTIlxSvOvw8buKVSK_-TCRb_JWAub_0 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6854664352442726443', time=2024-09-12T20:32:44.797013+0000, chain.objs.size()=1 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.paBR2BgVdwrAbt5LKw0v1KEy8qoAI2R_0 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11096342184646905857', time=2024-09-12T20:32:44.983671+0000, chain.objs.size()=1 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.1bWRKGO7LthX0hNIoEy12wH4JcEebTD_0 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7233697795870353989', time=2024-09-12T20:32:46.513693+0000, chain.objs.size()=1 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.T2BmvZDvzmjDv-iWwLvyebU9AOjCbPJ_0 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7844050120344744264', time=2024-09-12T20:32:49.446997+0000, chain.objs.size()=1 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.owjBmY1ibEbOWiLoCxss6n1q501bPxI_0 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14788375526568830085', time=2024-09-12T20:32:50.366290+0000, chain.objs.size()=1 2024-09-12T18:59:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.G4inOKIcLl4DKDeieFfJbn2g3olg5Nz_0 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6175308440328300118', time=2024-09-12T20:32:50.940537+0000, chain.objs.size()=1 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.NeL9mPLOP49lm9Eq4b5sWqAQ28LsJ3r_0 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14291261517320700699', time=2024-09-12T20:32:51.626865+0000, chain.objs.size()=1 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rZBywcF20DvxmspVZfh8yXcJmgEa8o1_0 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.193999560189730882', time=2024-09-12T20:32:52.039204+0000, chain.objs.size()=1 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.oQqAsf_lFBhX5KdUXjDJQdMwjJevXYY_0 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6420147889737937603', time=2024-09-12T20:32:52.115025+0000, chain.objs.size()=1 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hx3cB523FHpUHyon3bCmg3ges-48JvR_0 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10590711422679223668', time=2024-09-12T20:32:53.233570+0000, chain.objs.size()=1 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.hGQ3c3l_Gfo0GRZ5y5rRI4DiDIE0O9K_0 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2749858599794111507', time=2024-09-12T20:34:34.040008+0000, chain.objs.size()=1 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wgEm0sjRBEpvQymH3iLJWf1N_wHv4K1_0 2024-09-12T18:59:59.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16512802934872678748', time=2024-09-12T20:34:34.927529+0000, chain.objs.size()=1 2024-09-12T18:59:59.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kDWcyga3cdEYypvxRzZGVS9p3hQVQi7_0 2024-09-12T18:59:59.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6680102390089429091', time=2024-09-12T20:34:35.759864+0000, chain.objs.size()=1 2024-09-12T18:59:59.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BepZ1I9CTondeBtI6ysniOH4hDfrsUq_0 2024-09-12T18:59:59.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9775666510483845513', time=2024-09-12T20:34:36.175028+0000, chain.objs.size()=1 2024-09-12T18:59:59.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HEerSrLRilHmAiZqFohf5VuYOI2g-y3_0 2024-09-12T18:59:59.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3605348807521108577', time=2024-09-12T20:34:36.298157+0000, chain.objs.size()=1 2024-09-12T18:59:59.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.9FQuJDioq3CIRb08xx9t3xkuzYQkcWc_0 2024-09-12T18:59:59.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3287029292891868122', time=2024-09-12T20:34:36.717612+0000, chain.objs.size()=1 2024-09-12T18:59:59.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1YSmhft42nDPbgXvzRhshRHMDKDsLtb_0 2024-09-12T18:59:59.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3394646800562106569', time=2024-09-12T20:34:38.257275+0000, chain.objs.size()=1 2024-09-12T18:59:59.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.987+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Aw2pEljxJvBUevqp_q27fq4pgYNS19R_0 2024-09-12T18:59:59.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14375153751372315515', time=2024-09-12T20:34:39.569483+0000, chain.objs.size()=1 2024-09-12T18:59:59.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._u6bQtc1poYhssu6YEM5HCw3tUVkxDX_0 2024-09-12T18:59:59.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2343607531610955132', time=2024-09-12T20:34:39.850051+0000, chain.objs.size()=1 2024-09-12T18:59:59.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Rjk8XOxPbdyL5u0Uc-xeTbR-av25pnJ_0 2024-09-12T18:59:59.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1470145575496835920', time=2024-09-12T20:34:39.928493+0000, chain.objs.size()=1 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.13Gbznnk2isHeyfHe_xpWGdHmlVRgib_0 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15906105252439444593', time=2024-09-12T20:34:40.194553+0000, chain.objs.size()=1 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.z32nA4pW-74lPveHgFHu3guKo_K5eXv_0 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7652927549332078724', time=2024-09-12T20:34:40.419807+0000, chain.objs.size()=1 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3AkLNMR3kk429W3ebsYoqHJUV11b6SM_0 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12008418724368850637', time=2024-09-12T20:34:41.617635+0000, chain.objs.size()=1 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.g319lrTFzj84WlIlcipmSIO1TSOsXTv_0 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7497567140155389342', time=2024-09-12T20:34:42.176612+0000, chain.objs.size()=1 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.gn1d89GK1Un9xQRIixu-18-vIrzS4V1_0 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4609343179185598540', time=2024-09-12T20:34:44.266170+0000, chain.objs.size()=1 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4IAdUYM3xMsKEKdLwupbBSAPu7M-EAz_0 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15518933903289679333', time=2024-09-12T20:34:45.078151+0000, chain.objs.size()=1 2024-09-12T18:59:59.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6zvWOxCZ6Who0RuFfG5jxwOZUU752uu_0 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4323784443251512070', time=2024-09-12T20:34:45.079560+0000, chain.objs.size()=1 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.sRNtyDsmd0AYOBgDuXKXxeL_8s8vzgq_0 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1057559561366981059', time=2024-09-12T20:34:45.894678+0000, chain.objs.size()=1 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.1fI1ieRpvbnEKK7s9oQO5Nk7oM0Z6FO_0 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.735048944050888301', time=2024-09-12T20:34:48.786978+0000, chain.objs.size()=1 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.7LxVXK77g63KF6jDgKEXRwq9EYX0xb8_0 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6815950225746386160', time=2024-09-12T20:34:49.862461+0000, chain.objs.size()=1 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.bWoyEX-bjIMfN24cyBEnrnH7cqelpwu_0 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1269089434045665891', time=2024-09-12T20:34:50.512487+0000, chain.objs.size()=1 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.991+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qZuPI3UKUgYWtpLKGMfed2JQzg8oyw7_0 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3053811095871857314', time=2024-09-12T20:34:50.851340+0000, chain.objs.size()=1 2024-09-12T18:59:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Lg5F91lTr6DLM89CcrUDgNt5cRkrEJj_0 2024-09-12T18:59:59.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2763168161204992648', time=2024-09-12T20:34:51.455372+0000, chain.objs.size()=1 2024-09-12T18:59:59.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.mAQgu3MzjrMEKt4bF-EsTHGYKbfitT__0 2024-09-12T18:59:59.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17646063379725346292', time=2024-09-12T20:34:52.705922+0000, chain.objs.size()=1 2024-09-12T18:59:59.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QzrKdrPmWrJDZJz3Q_F9ZpkQtLNU4uf_0 2024-09-12T18:59:59.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17482065474616117376', time=2024-09-12T20:34:53.496546+0000, chain.objs.size()=1 2024-09-12T18:59:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.TLg7HZQwZnTk-qwx2UCHICMk-st1_jS_0 2024-09-12T18:59:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2602878884150791013', time=2024-09-12T20:34:53.894310+0000, chain.objs.size()=1 2024-09-12T18:59:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.65BRo8_Ey4VCiHY1RAC2K_xTaoSFaL2_0 2024-09-12T18:59:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5712150229352489657', time=2024-09-12T20:34:54.421272+0000, chain.objs.size()=1 2024-09-12T18:59:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3C5did4EK9k-Cnc9H26qqevv4tMlaXd_0 2024-09-12T18:59:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51275 2024-09-12T19:00:00.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T19:00:00.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11915364987094127051', time=2024-09-12T20:34:54.640803+0000, chain.objs.size()=1 2024-09-12T19:00:00.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.NdNptUqM3v0hSz-8GbqSBRQLtbPGnDe_0 2024-09-12T19:00:00.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.995+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16564290087171688134', time=2024-09-12T20:34:54.983890+0000, chain.objs.size()=1 2024-09-12T19:00:00.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.6P31YbW8Kd_w_t-Zkea1o-Lpzc1t9dj_0 2024-09-12T19:00:00.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10064549557791873578', time=2024-09-12T20:34:56.952102+0000, chain.objs.size()=1 2024-09-12T19:00:00.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Oc3jCp_Q9DTv1tmld-ORa3ktGPhqPEU_0 2024-09-12T19:00:00.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7878323926926661594', time=2024-09-12T20:34:57.652414+0000, chain.objs.size()=1 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.MHs33l_cqMJ2RqSJmAJBpNRs7zQgv_R_0 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15609825146263122431', time=2024-09-12T20:34:58.492461+0000, chain.objs.size()=1 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.zWMD6oj77mPV1Sefp6hjiU6pXtrAlfE_0 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10750895141496141735', time=2024-09-12T20:34:59.535927+0000, chain.objs.size()=1 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Vameu_9KT3WXCkHiXn9GhALvR3zaan__0 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4883196119932224630', time=2024-09-12T20:35:00.195502+0000, chain.objs.size()=1 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.rn3b8UapF4srVV6tfrp0RV_kksUF6lC_0 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15014339379010634558', time=2024-09-12T20:35:00.230785+0000, chain.objs.size()=1 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UwRNOS0m11K6qXh0krnxjHi2i6KuK66_0 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14155928922857463720', time=2024-09-12T20:35:00.260628+0000, chain.objs.size()=1 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.gzWKGcwLkLZooUaFJnLxu_mm11Pd1pG_0 2024-09-12T19:00:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7608414426229628324', time=2024-09-12T20:35:01.429319+0000, chain.objs.size()=1 2024-09-12T19:00:00.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.2msevWWUq8oYkDCph_brJ5ZH1Wx_zes_0 2024-09-12T19:00:00.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17334873381915463835', time=2024-09-12T20:35:19.914644+0000, chain.objs.size()=1 2024-09-12T19:00:00.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.341__shadow_.nVJGTHqrrGnPqXM-doHprE7LMzKHnVu_0 2024-09-12T19:00:00.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5258874426764408219', time=2024-09-12T20:35:50.769769+0000, chain.objs.size()=1 2024-09-12T19:00:00.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.374__shadow_.BJKE0zyUiyEAtjvWLArbGQIGR4dsxHu_0 2024-09-12T19:00:00.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2195348047432575700', time=2024-09-12T20:36:28.175716+0000, chain.objs.size()=1 2024-09-12T19:00:00.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.407__shadow_.sVhp5pWNoeS7w65dttrbmfxAbCfPQVq_0 2024-09-12T19:00:00.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7157682458188302008', time=2024-09-12T20:36:52.497407+0000, chain.objs.size()=1 2024-09-12T19:00:00.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.431__shadow_.pdbm7Kumh0u3rka_Hqdr7jd89dbFPuG_0 2024-09-12T19:00:00.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2988273436523135944', time=2024-09-12T20:37:03.047681+0000, chain.objs.size()=1 2024-09-12T19:00:00.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.440__shadow_.KGac9Sp0glT5pltPHSho1nc-iAuxEWc_0 2024-09-12T19:00:00.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2022135393973989526', time=2024-09-12T20:38:17.822795+0000, chain.objs.size()=1 2024-09-12T19:00:00.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.497__shadow_.aWDAUbQvPQrlPEiuRlT6sIY8nobQ36e_0 2024-09-12T19:00:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13170728272558502078', time=2024-09-12T20:38:25.317989+0000, chain.objs.size()=1 2024-09-12T19:00:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.503__shadow:RrE07h9QVCnd4UDOAeK8Om93tXQxxPE_.hyGvE7kfORPSZwwerfxAYNUofTKRYRK_0 2024-09-12T19:00:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.883764344722956892', time=2024-09-12T20:39:36.366244+0000, chain.objs.size()=1 2024-09-12T19:00:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.520__shadow:zJeJ80w9g1nwStMSRoP9HAPqq6.nD-d_.KXXGK4aZstqWcdtOx4k4dJq5IWfWGHF_0 2024-09-12T19:00:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5626086893817761923', time=2024-09-12T20:39:36.421030+0000, chain.objs.size()=1 2024-09-12T19:00:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.520__shadow:KLztzChIStu2ubrxh1mWQ4.8fP96QSM_.NpMsbQnLcUOL3p_VY6HaYc5HFISQLG1_0 2024-09-12T19:00:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12509865328666179137', time=2024-09-12T20:41:09.370223+0000, chain.objs.size()=2 2024-09-12T19:00:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~i2An0AX6rQcYr-f3bvmhxg_12C9Om6_.1 2024-09-12T19:00:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.523__multipart_mymultipart.2~i2An0AX6rQcYr-f3bvmhxg_12C9Om6_.2 2024-09-12T19:00:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10417627730917841050', time=2024-09-12T20:43:44.095786+0000, chain.objs.size()=1 2024-09-12T19:00:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:rb6Ka5ETZPjxTyXS6umk9Av-BmC4-4R_.aT24KGVcwhoBN6wPEgncdwBvJGUZXI3_0 2024-09-12T19:00:00.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10629885150980030458', time=2024-09-12T20:44:00.702375+0000, chain.objs.size()=1 2024-09-12T19:00:00.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T18:59:59.999+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:4FR9pBpTVKAqgBVTPAxxzufTIjiGpxB_.Q5hldVcc-mcUCc3A3dIVD_5j-cnynz-_0 2024-09-12T19:00:00.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.848832707212241178', time=2024-09-12T20:44:02.422523+0000, chain.objs.size()=1 2024-09-12T19:00:00.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:ikV93uyex4JThFxXcEisDVFMfIPIdPN_.oWeFAYfFi65R01h90HAFrukPhLg-0Nn_0 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6884398171266679831', time=2024-09-12T20:44:59.063206+0000, chain.objs.size()=1 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:dwvVU77cjGjQG1Ie3cYB8f1QrQkw14v_.1RoZw-NyFEQiXsdzwYyVUpNBoDEDJlx_0 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15205920894492644793', time=2024-09-12T20:45:34.976192+0000, chain.objs.size()=1 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.579__shadow:kT4BLBo41DFUMko9Or4jpgPg9mKB2H7_.mjWjzouE0txCKfC_ghqEsO8MLE_e_QY_0 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13603173174721175456', time=2024-09-12T20:45:39.289849+0000, chain.objs.size()=1 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.580__shadow:yMU8APiZiUwFvOs15EjFdoiuGrl9xCA_._JdH5UOni97x9mgS6kgqPXl7qhEaGz4_0 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2949606410954231310', time=2024-09-12T20:47:45.191887+0000, chain.objs.size()=1 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.616__shadow_.vSGB8nFd5mWae2jxx1RjKu-zILbmBY1_0 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10099919424982564349', time=2024-09-12T20:50:50.412964+0000, chain.objs.size()=1 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.635__shadow_.RJkxao61LXK0uE6l4jvfU0uFI7Ko5LR_0 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1298399310510158031', time=2024-09-12T20:52:05.191906+0000, chain.objs.size()=1 2024-09-12T19:00:00.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.670__shadow_.vvZuNp32RVd-CT9ZYUxOw8dJNbMPZPc_0 2024-09-12T19:00:00.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.003+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:00:00.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T19:00:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:00:00.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:00:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51880' 2024-09-12T19:00:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~NeMqX7l09TAK-bVHKtv8WCMBlcbu08y', time=2024-09-12T20:23:50.211915+0000, chain.objs.size()=1 2024-09-12T19:00:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.202__multipart_mymultipart.2~NeMqX7l09TAK-bVHKtv8WCMBlcbu08y.1 2024-09-12T19:00:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17522006494091329219', time=2024-09-12T20:26:36.484139+0000, chain.objs.size()=1 2024-09-12T19:00:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.238__shadow_.Jf691VPKfoEK8jwGdpxIZTboimPcPUb_0 2024-09-12T19:00:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11222940136699610941', time=2024-09-12T20:26:41.328894+0000, chain.objs.size()=1 2024-09-12T19:00:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.242__shadow_.Hh8v6e1JaVbvF1Tk6vdDtqlu96Tx1rP_0 2024-09-12T19:00:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6542075288152636798', time=2024-09-12T20:26:49.671731+0000, chain.objs.size()=1 2024-09-12T19:00:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.247__shadow_.2SMIvFeed3cDWV4N2-nDRxcGO5leEP6_0 2024-09-12T19:00:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13931040654607596527', time=2024-09-12T20:27:04.796957+0000, chain.objs.size()=1 2024-09-12T19:00:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.258__shadow_.64gwQk10af30cnYn0iWRcXCre-pZisZ_0 2024-09-12T19:00:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14910178509544767919', time=2024-09-12T20:28:47.859692+0000, chain.objs.size()=1 2024-09-12T19:00:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.vRqF7AKEeIFDxRGixE91HLORaxzIvT1_0 2024-09-12T19:00:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2599497567377307727', time=2024-09-12T20:28:48.685676+0000, chain.objs.size()=1 2024-09-12T19:00:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.O4jK3mvVrVCY7hqEt6frLyN6L4u8Vuo_0 2024-09-12T19:00:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16288750115166610728', time=2024-09-12T20:28:49.098892+0000, chain.objs.size()=1 2024-09-12T19:00:00.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.AMd3asLBzlY7NedBFD60Ju0-RKysdwX_0 2024-09-12T19:00:00.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11284072291211253394', time=2024-09-12T20:28:50.397198+0000, chain.objs.size()=1 2024-09-12T19:00:00.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3JAKKVTjgNyu1OnBhibISIG7bormpwf_0 2024-09-12T19:00:00.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11832605445714029756', time=2024-09-12T20:28:53.438338+0000, chain.objs.size()=1 2024-09-12T19:00:00.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.rr_K1jlf5vinFx-emIS7Em_4G9OyHyC_0 2024-09-12T19:00:00.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15389613496192540399', time=2024-09-12T20:28:54.279087+0000, chain.objs.size()=1 2024-09-12T19:00:00.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.87Thl5HJHTPZV8rTcjxTVFpOnHxaaQm_0 2024-09-12T19:00:00.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7389371250483111699', time=2024-09-12T20:28:54.280821+0000, chain.objs.size()=1 2024-09-12T19:00:00.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.007+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2k9Lof_xvlX_wT1gNMKfnrtvmk228Qc_0 2024-09-12T19:00:00.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16176159170394441660', time=2024-09-12T20:28:57.961408+0000, chain.objs.size()=1 2024-09-12T19:00:00.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.1EFIDzaYe9eYXtKEdiy3cO93Nmd97dC_0 2024-09-12T19:00:00.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16988347743777110521', time=2024-09-12T20:28:59.720197+0000, chain.objs.size()=1 2024-09-12T19:00:00.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.LrW1f5R92m5tT2U7H9sIgA5SQSjtAb2_0 2024-09-12T19:00:00.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12004687841766628917', time=2024-09-12T20:28:59.938128+0000, chain.objs.size()=1 2024-09-12T19:00:00.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.CjMD8kTb37bTIjg9H7P0X_b95yeq7lB_0 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13792065031785653251', time=2024-09-12T20:29:00.051106+0000, chain.objs.size()=1 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.oOCuv104SifnWDqZhQTjkFbkRvj2ks4_0 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14616734841294423488', time=2024-09-12T20:29:00.161370+0000, chain.objs.size()=1 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.fz4WYlH2Yl44wZdQsKLcQtIjGpXwuA1_0 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14361687188350815997', time=2024-09-12T20:29:00.932926+0000, chain.objs.size()=1 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.s09f-n4UG4EcufjAu7Ds46kNr0QLfUE_0 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14346316112404955334', time=2024-09-12T20:29:00.998282+0000, chain.objs.size()=1 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.8wtzZsAiep8QlJr2wYguheM3Io2ldsY_0 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17269137933480020259', time=2024-09-12T20:29:01.265181+0000, chain.objs.size()=1 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.09M0YfNOFevw1QEFzAgwauXKZPuiMLL_0 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16706211000422587610', time=2024-09-12T20:29:01.700496+0000, chain.objs.size()=1 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.USw7HFHZE0SZ9OdxuduCwZJOOg3NS82_0 2024-09-12T19:00:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18380967129123106810', time=2024-09-12T20:29:07.333990+0000, chain.objs.size()=1 2024-09-12T19:00:00.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.y1jPS7VXU-6owuhs9-c97BNMI_3UpSi_0 2024-09-12T19:00:00.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.814109699370534414', time=2024-09-12T20:29:07.514284+0000, chain.objs.size()=1 2024-09-12T19:00:00.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tcGuw8Qkz3YD4gryuaNMJnz9pSkn0v5_0 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18024117891513924729', time=2024-09-12T20:29:07.719211+0000, chain.objs.size()=1 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.B2sOhWPSRdtdZKyF4HRqWSSaYkIy9g5_0 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9600681507721293979', time=2024-09-12T20:29:08.158343+0000, chain.objs.size()=1 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.011+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.e6w18JeM_wrxp_bR9HRZguxkr8xbk-U_0 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8008799813822608026', time=2024-09-12T20:29:09.560166+0000, chain.objs.size()=1 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.F2zb1oCPA2mc7bzBUAipiktRFS6NMs9_0 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18432104788608359552', time=2024-09-12T20:29:09.666393+0000, chain.objs.size()=1 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.bwx9uLPsKOvcl_Yft4B9Xpi3-9-kRmI_0 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13904905458127965495', time=2024-09-12T20:29:09.874932+0000, chain.objs.size()=1 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WmlcfybOEkbtd6NNc63I57xKaHS0eS8_0 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17295056455753928597', time=2024-09-12T20:29:10.310754+0000, chain.objs.size()=1 2024-09-12T19:00:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.oNq_JQ5n7YFYU1pWAyB0TArMTVY5VbZ_0 2024-09-12T19:00:00.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2009095122677446838', time=2024-09-12T20:29:12.174381+0000, chain.objs.size()=1 2024-09-12T19:00:00.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.cVIrlqIx8Dp08SqoRX7--DB8B3v70vF_0 2024-09-12T19:00:00.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4335835921586925473', time=2024-09-12T20:29:12.497152+0000, chain.objs.size()=1 2024-09-12T19:00:00.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.tXyReV2wji3oiy7EyZFGlguY0NNAwS4_0 2024-09-12T19:00:00.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4826513560589461637', time=2024-09-12T20:29:13.681352+0000, chain.objs.size()=1 2024-09-12T19:00:00.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.MUZUcPbfQMWq747mCOfKvgScjiRGgXT_0 2024-09-12T19:00:00.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7824666377524687874', time=2024-09-12T20:29:14.424190+0000, chain.objs.size()=1 2024-09-12T19:00:00.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Yn889hiMXH0BSu1tqF2RdKLTQEVyjWW_0 2024-09-12T19:00:00.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14371221592142619111', time=2024-09-12T20:29:43.336689+0000, chain.objs.size()=1 2024-09-12T19:00:00.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.283__shadow_.Dqj1cTYbrEnU-fGmPyNNLCmQitdeE6P_0 2024-09-12T19:00:00.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10111322111218586045', time=2024-09-12T20:29:50.519815+0000, chain.objs.size()=1 2024-09-12T19:00:00.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.288__shadow_.d34MtO3P_LPHGUzwIAiZrlCRiphdQ3O_0 2024-09-12T19:00:00.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7539627115507714357', time=2024-09-12T20:30:03.879035+0000, chain.objs.size()=1 2024-09-12T19:00:00.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.293__shadow_.tDOobADCzSYXYQ-ApWA89wFDDSMBToR_0 2024-09-12T19:00:00.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5314143887859004122', time=2024-09-12T20:30:05.319429+0000, chain.objs.size()=1 2024-09-12T19:00:00.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.294__shadow_.RO5H_VaEePQDjPqAGL2SwsmIO1CWVM3_0 2024-09-12T19:00:00.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1112712056701887058', time=2024-09-12T20:30:15.279426+0000, chain.objs.size()=1 2024-09-12T19:00:00.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.301__shadow_.A5tpLFDCM3HxyBXa1VFUbnfpY9OINgf_0 2024-09-12T19:00:00.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.74362286323268483', time=2024-09-12T20:32:27.316788+0000, chain.objs.size()=1 2024-09-12T19:00:00.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.015+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.LKYHztlqZPYleI62EP9UK_mnWSjLjJG_0 2024-09-12T19:00:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4413658507602821323', time=2024-09-12T20:32:28.103645+0000, chain.objs.size()=1 2024-09-12T19:00:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HPuv7TQn5wUjJVuRCzzl90Q8h1TIsf__0 2024-09-12T19:00:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3415893820002825598', time=2024-09-12T20:32:30.644745+0000, chain.objs.size()=1 2024-09-12T19:00:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.V_cVQ8n4DwNa9Sb7rWM5gGZA8bn9xPC_0 2024-09-12T19:00:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8787041984247439837', time=2024-09-12T20:32:31.095602+0000, chain.objs.size()=1 2024-09-12T19:00:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.N_NWPoaw_R9HH9Uaahl5ma9-mGgMYLc_0 2024-09-12T19:00:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17498230915274594063', time=2024-09-12T20:32:32.323588+0000, chain.objs.size()=1 2024-09-12T19:00:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._sx6tN63ezw_3mVoYmVDjxnRqqCiztZ_0 2024-09-12T19:00:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13865201456130250809', time=2024-09-12T20:32:33.307668+0000, chain.objs.size()=1 2024-09-12T19:00:00.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.E5fupw3ubqSUuQyM7StPQfJjpRgxbM8_0 2024-09-12T19:00:00.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8457095283684821066', time=2024-09-12T20:32:33.332670+0000, chain.objs.size()=1 2024-09-12T19:00:00.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.Ooyx5OpoZS9SGWyWnzEPq31bb48NNyB_0 2024-09-12T19:00:00.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9371967843226751277', time=2024-09-12T20:32:33.360816+0000, chain.objs.size()=1 2024-09-12T19:00:00.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.OW3brYdVn59vG-dTNiuyAgZ163bG2QH_0 2024-09-12T19:00:00.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16543320456069515821', time=2024-09-12T20:32:34.312281+0000, chain.objs.size()=1 2024-09-12T19:00:00.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.94yBGIhc_SP3wK1hKygqAc5NKJsVKHh_0 2024-09-12T19:00:00.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6154286062319984413', time=2024-09-12T20:32:34.615599+0000, chain.objs.size()=1 2024-09-12T19:00:00.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.wTqdFlrLpmu5J0sPDr1KGwGoVzr4hjJ_0 2024-09-12T19:00:00.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14397937912982367820', time=2024-09-12T20:32:35.083756+0000, chain.objs.size()=1 2024-09-12T19:00:00.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.T4OTATjm46DuJQfUt7UM02EciBb1EXH_0 2024-09-12T19:00:00.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15183930670242601559', time=2024-09-12T20:32:35.357188+0000, chain.objs.size()=1 2024-09-12T19:00:00.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rGzjbtWupCMPNqSTftSjJb9SGlMKT1N_0 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9497721819011358325', time=2024-09-12T20:32:37.802138+0000, chain.objs.size()=1 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.4N7Hgj0AZvXOBu_F5UVA5KIajFwmaWX_0 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7374209001776301662', time=2024-09-12T20:32:37.803979+0000, chain.objs.size()=1 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8fXeNOFAF2eS6-FI1qjk3dv8to2sv65_0 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17046243557123368071', time=2024-09-12T20:32:38.182465+0000, chain.objs.size()=1 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.sgnG9vFT23gD2WtlBGZ_tq8mOKoyo9V_0 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9622104952914228770', time=2024-09-12T20:32:38.380540+0000, chain.objs.size()=1 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HZ_K5XzjhEii4t9Ka0iEj7JH-lgvgFG_0 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17827256084737771962', time=2024-09-12T20:32:39.026829+0000, chain.objs.size()=1 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.4fljhFemZqqy6rq01PzXRsoCfc_lEK3_0 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4654979307585022979', time=2024-09-12T20:32:42.696956+0000, chain.objs.size()=1 2024-09-12T19:00:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.3160jJps7TjJ107ZWhe-W_W3steMqfd_0 2024-09-12T19:00:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2787676091363762547', time=2024-09-12T20:32:43.788016+0000, chain.objs.size()=1 2024-09-12T19:00:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.PlolhU23oIpE7hIuzBPFYkJNkn5Qygc_0 2024-09-12T19:00:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9812675880452978611', time=2024-09-12T20:32:43.789386+0000, chain.objs.size()=1 2024-09-12T19:00:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.O1LhA3BLOicdUQyjveoCEUGrKHNq-KE_0 2024-09-12T19:00:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7150358581840445245', time=2024-09-12T20:32:43.930905+0000, chain.objs.size()=1 2024-09-12T19:00:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.019+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.fFCkcoFnb9KPeO4NNyywr-JLf_1-Ih6_0 2024-09-12T19:00:00.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17742651982203443117', time=2024-09-12T20:32:44.720402+0000, chain.objs.size()=1 2024-09-12T19:00:00.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.HVBos-JAPoMish8mWlN2ihm_Y-Rrzuc_0 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9156155341391907281', time=2024-09-12T20:32:45.079353+0000, chain.objs.size()=1 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.aDxeZcgk4-oZySd7p2f5oNYx-ufXUIE_0 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17573689988061772295', time=2024-09-12T20:32:46.628397+0000, chain.objs.size()=1 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BPL5nG0cGfRwkbFRDgf6uIIpGD-k7gG_0 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12492912124711478948', time=2024-09-12T20:32:49.218825+0000, chain.objs.size()=1 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.tR10vvwuw0agC1NzsAnqAbakDTnFOJp_0 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11358574643956551090', time=2024-09-12T20:32:50.051780+0000, chain.objs.size()=1 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.nKa62dqwIoI2D-JtvPRAHsxlEpyWDHi_0 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10095807543587440022', time=2024-09-12T20:32:50.053943+0000, chain.objs.size()=1 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BwN-VFJBS0WRH1gZDA9Sr_SnQ3KXPLr_0 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14920086713707938378', time=2024-09-12T20:32:50.055663+0000, chain.objs.size()=1 2024-09-12T19:00:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.diR2n0ZzajzrBsTiIgruPr6C8_vZB4H_0 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11301055411994747520', time=2024-09-12T20:32:50.351265+0000, chain.objs.size()=1 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.PXYXlFa0Yj7FlKDTm2GemqsmPhQC_ie_0 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5475935822520264759', time=2024-09-12T20:32:50.565862+0000, chain.objs.size()=1 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.owC1sbKjlBpnD1WNesrQNariXcK19er_0 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11663705129932852741', time=2024-09-12T20:32:50.733906+0000, chain.objs.size()=1 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.0PAIoXB6o5OklDPzAcUheMKCibtseJK_0 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8646910941756718554', time=2024-09-12T20:32:50.780444+0000, chain.objs.size()=1 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.8oHM0_PW9y4my7UR-Jk0Jyi4QtN9TZr_0 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6925153252328679420', time=2024-09-12T20:32:50.926278+0000, chain.objs.size()=1 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.VzTnZBKsCnrRR1sLZr2g_ttFILy3vEo_0 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5907387623835900134', time=2024-09-12T20:32:51.643297+0000, chain.objs.size()=1 2024-09-12T19:00:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.BKrsAG29D0k6jvprjhMNAsJ2nAZihtl_0 2024-09-12T19:00:00.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2190324234265035411', time=2024-09-12T20:32:52.293411+0000, chain.objs.size()=1 2024-09-12T19:00:00.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.08rcTuqvwjELyU56ZRgDw_2TlQBfth5_0 2024-09-12T19:00:00.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13563913161999650773', time=2024-09-12T20:32:53.016367+0000, chain.objs.size()=1 2024-09-12T19:00:00.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.FmaA5YwPI5cZhHpD4p3Dxiv8MviN7sc_0 2024-09-12T19:00:00.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15863402994061600914', time=2024-09-12T20:34:34.485706+0000, chain.objs.size()=1 2024-09-12T19:00:00.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ExnntP_aF3uuR77D7cZGmfjKRlD1Al6_0 2024-09-12T19:00:00.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6050826371079559963', time=2024-09-12T20:34:36.711891+0000, chain.objs.size()=1 2024-09-12T19:00:00.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.QPngWvcgweR6H9sA0XQCCtcP6IPyWdx_0 2024-09-12T19:00:00.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3157695470359399297', time=2024-09-12T20:34:36.763130+0000, chain.objs.size()=1 2024-09-12T19:00:00.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5qf_bblqHnh0w7w4E02MTk1PIkNcXoV_0 2024-09-12T19:00:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16838619362846310506', time=2024-09-12T20:34:38.086917+0000, chain.objs.size()=1 2024-09-12T19:00:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.wnMZsPvN4OKmsxa5m4qhwz3rdH9njz2_0 2024-09-12T19:00:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11137044222447716346', time=2024-09-12T20:34:39.828311+0000, chain.objs.size()=1 2024-09-12T19:00:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.023+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.INVO-Y8t-KxIrAmMGkft7pITkSeFBpj_0 2024-09-12T19:00:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11547409347443955937', time=2024-09-12T20:34:40.143795+0000, chain.objs.size()=1 2024-09-12T19:00:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.pWCQ3P4QxDlKCZ5zKIRKauCjdFWITwu_0 2024-09-12T19:00:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9831866773437337889', time=2024-09-12T20:34:43.947353+0000, chain.objs.size()=1 2024-09-12T19:00:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.DbXmBLrscb6lllu7R5XVy2lMA6033uU_0 2024-09-12T19:00:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2284322727856615870', time=2024-09-12T20:34:44.197246+0000, chain.objs.size()=1 2024-09-12T19:00:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.kCV-KsoiaJnt1H3lChgzJe9nKVG5s0A_0 2024-09-12T19:00:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.238506376083350821', time=2024-09-12T20:34:45.080362+0000, chain.objs.size()=1 2024-09-12T19:00:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.qVC5ME7du0AhlNZrMsul9xxcKQ66pkO_0 2024-09-12T19:00:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13280584085591046431', time=2024-09-12T20:34:46.610495+0000, chain.objs.size()=1 2024-09-12T19:00:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.VM-fq-XtM0s_5GBmtpskOJwr-8vTyUc_0 2024-09-12T19:00:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14973325189133977801', time=2024-09-12T20:34:46.922371+0000, chain.objs.size()=1 2024-09-12T19:00:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.244PPrymEI7Io9ViZHM5EBqyu5YYFay_0 2024-09-12T19:00:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10575075360209949170', time=2024-09-12T20:34:47.208664+0000, chain.objs.size()=1 2024-09-12T19:00:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.KVyOHxHcbW8pKv3ORVdhakX3HyMdCjb_0 2024-09-12T19:00:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1455646663910019371', time=2024-09-12T20:34:47.498972+0000, chain.objs.size()=1 2024-09-12T19:00:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4u_DlvqXvd5Hvmkf-rmbhX6mUzRaS5h_0 2024-09-12T19:00:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3304507923634936980', time=2024-09-12T20:34:48.660375+0000, chain.objs.size()=1 2024-09-12T19:00:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Mog_yvsVjw_BIj5fwNfIgt1ZUu-BcFp_0 2024-09-12T19:00:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10919670889366042032', time=2024-09-12T20:34:48.716047+0000, chain.objs.size()=1 2024-09-12T19:00:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.fk-pKtE2Gh2CGYoNPwMjHD-W0rnzHcC_0 2024-09-12T19:00:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5996003478409214922', time=2024-09-12T20:34:49.553201+0000, chain.objs.size()=1 2024-09-12T19:00:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.C3u6spH8IgDgiZfGzN9jSK9Gylgj2xp_0 2024-09-12T19:00:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1167585739905462808', time=2024-09-12T20:34:49.862093+0000, chain.objs.size()=1 2024-09-12T19:00:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-w3-gjvq3N4Rvbck61U_RR5lQLDvuZd_0 2024-09-12T19:00:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5197103173970418901', time=2024-09-12T20:34:50.956618+0000, chain.objs.size()=1 2024-09-12T19:00:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.XLRCkTuH9EY85b2Abja-U8zGTFqIcdt_0 2024-09-12T19:00:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7593605729112431101', time=2024-09-12T20:34:50.994796+0000, chain.objs.size()=1 2024-09-12T19:00:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UW9kVNGgip7VTuhZ7YFHBo7SKF57O0n_0 2024-09-12T19:00:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2583327183172788234', time=2024-09-12T20:34:51.450204+0000, chain.objs.size()=1 2024-09-12T19:00:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.I2AWIXlhtESFpQuic3YX9oASe_Ht7wM_0 2024-09-12T19:00:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17553877874736337377', time=2024-09-12T20:34:52.458297+0000, chain.objs.size()=1 2024-09-12T19:00:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.yGcFeCTGGMkFpQh4KQ58ANqJcGlGSTl_0 2024-09-12T19:00:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1039764386909622742', time=2024-09-12T20:34:52.502941+0000, chain.objs.size()=1 2024-09-12T19:00:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ohJa1f7ju5A1L-CqBZZ1Zue74NK9ne6_0 2024-09-12T19:00:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16394924566957362735', time=2024-09-12T20:34:53.031385+0000, chain.objs.size()=1 2024-09-12T19:00:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.pl1yRDlNSrvvr2OxLgt90VpEg5EInHa_0 2024-09-12T19:00:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4362618316720628892', time=2024-09-12T20:34:54.037518+0000, chain.objs.size()=1 2024-09-12T19:00:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Au2KyspLpUfRu29O_brYDa5wvyERW2r_0 2024-09-12T19:00:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12097011364462268495', time=2024-09-12T20:34:56.087252+0000, chain.objs.size()=1 2024-09-12T19:00:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.I6Mq66oXkx6oyMZWgH1ZTRbeQvlQjV4_0 2024-09-12T19:00:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11286350935222051646', time=2024-09-12T20:34:56.210845+0000, chain.objs.size()=1 2024-09-12T19:00:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.027+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.xugWvJdk-lAW4Xea5X9-Hldnu91D7cQ_0 2024-09-12T19:00:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.031+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51880 2024-09-12T19:00:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T19:00:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7070088820273183803', time=2024-09-12T20:34:56.566917+0000, chain.objs.size()=1 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Jcdbz0y5mwyCUajbdfdnXkSNgGLHQBz_0 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9097710444392290814', time=2024-09-12T20:34:56.568711+0000, chain.objs.size()=1 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.550zXUXpacJj6B7xJupwwBcBF-2Lqcb_0 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4076690605848692968', time=2024-09-12T20:34:58.592103+0000, chain.objs.size()=1 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hrYWhnjI4YX9NYIzFDaEO4fBOE1Zqo3_0 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12081985318824223142', time=2024-09-12T20:34:58.631000+0000, chain.objs.size()=1 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.JJYwUDyFKR4rHVDoaAT3bEUcffIRhNn_0 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11520244503954560942', time=2024-09-12T20:35:00.553637+0000, chain.objs.size()=1 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.5D4f-R-QgBT9pHEVkD4TYpLQpJClbo9_0 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1075656165430440621', time=2024-09-12T20:35:01.361152+0000, chain.objs.size()=1 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UD-JXL_eLq8aPxyE6ULAIKm_8xkxt4s_0 2024-09-12T19:00:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18281657220513301684', time=2024-09-12T20:35:24.955220+0000, chain.objs.size()=1 2024-09-12T19:00:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.346__shadow_.fo15gE6XibeDkc78GsxH59BLiPEmztU_0 2024-09-12T19:00:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16839308055504118953', time=2024-09-12T20:35:30.750449+0000, chain.objs.size()=1 2024-09-12T19:00:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.353__shadow_.Imvm-nzkGZgZ7wLxcmKGM6gehCU4xQO_0 2024-09-12T19:00:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9135455273136597340', time=2024-09-12T20:37:32.075818+0000, chain.objs.size()=1 2024-09-12T19:00:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.461__shadow_.DMIeN1fdhQLoWYq-AeVlVPaE4E_4HZe_0 2024-09-12T19:00:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11761628191340028249', time=2024-09-12T20:37:35.699707+0000, chain.objs.size()=1 2024-09-12T19:00:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.463__shadow_.5NkFmZBozVLWBhAO5z7J6qi1jCBp9Tr_0 2024-09-12T19:00:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13579960618983239640', time=2024-09-12T20:37:36.830242+0000, chain.objs.size()=1 2024-09-12T19:00:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.464__shadow_.WgNB0YbjAVXgm8z-_3ZJMWMdeY3TVQS_0 2024-09-12T19:00:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7427314974276890532', time=2024-09-12T20:37:56.792920+0000, chain.objs.size()=1 2024-09-12T19:00:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.uUIojGbb9jNaaAsdeA3K-i6RkWtyCxc_0 2024-09-12T19:00:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9602895271448406195', time=2024-09-12T20:37:56.830068+0000, chain.objs.size()=1 2024-09-12T19:00:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.483__shadow_.NVlecYGiZYHif0s82k9V0bZYWbmu7zK_0 2024-09-12T19:00:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5981345312483771187', time=2024-09-12T20:37:59.262666+0000, chain.objs.size()=1 2024-09-12T19:00:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.485__shadow_._FXlbEumCDMCW6GD-y7mARQaW0nFlLt_0 2024-09-12T19:00:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7522891165583859172', time=2024-09-12T20:38:52.919703+0000, chain.objs.size()=1 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.518__multipart_mymultipart.2~1QHgVfZ3WZLUXfwFLkW0QR-qOl-qcGb.1 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6054663935061802170', time=2024-09-12T20:43:04.065381+0000, chain.objs.size()=1 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.555__shadow_.f5Jr_-4aeXT5VPHK-FS7we2ZiNkH0TQ_0 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3378291121428483618', time=2024-09-12T20:43:43.515721+0000, chain.objs.size()=1 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:JJ6jw0llm9OEeDoLhMmz2.BWLZhJmuO_.PzaV1Atp_dNqQQqj3JqRyFsOWMou-7I_0 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7395788443549659632', time=2024-09-12T20:43:46.373184+0000, chain.objs.size()=1 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.569__shadow:LRmHriXahw2FRHM0ijSC-wOD-pj7DAA_.DsOpO6X4cS9hrup_IVdlmrQuwwKeld7_0 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10267223849424498561', time=2024-09-12T20:44:12.915791+0000, chain.objs.size()=1 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574__shadow_.0etvmez4SGKpX_hXmNqkarZUdY_EGob_0 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.268783725124491668', time=2024-09-12T20:45:00.140557+0000, chain.objs.size()=1 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:HhpGFA.FG8tH1RaeCMRUVcag56sLnNv_.dTHWKR0hVnvoeoFRdaDKAcuvQK3uR4J_0 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11567180473575744897', time=2024-09-12T20:45:34.567134+0000, chain.objs.size()=1 2024-09-12T19:00:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.579__shadow:FvCU9O6rlizt1DC0S6gj1yAHzlyTrCE_.Az9EPpC1gTPiuZ2ktKqYE7y2gL5pfTm_0 2024-09-12T19:00:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17336882810974473101', time=2024-09-12T20:45:34.839980+0000, chain.objs.size()=1 2024-09-12T19:00:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.579__shadow:Fquv2PVF9C-hzC7ZAvqfwWoIbKohgpF_.qKs0OlpdGbn0azBp82JKiuDx2dxzgvx_0 2024-09-12T19:00:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15905110051336963556', time=2024-09-12T20:45:39.119970+0000, chain.objs.size()=1 2024-09-12T19:00:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.580__shadow:zZIydmVUTKFCziSS7nc1o8T.oM7Xq-p_.bBttjkFMfqpcaQ5SmJV9V9Ojsj3adnp_0 2024-09-12T19:00:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj', time=2024-09-12T20:50:38.711472+0000, chain.objs.size()=12 2024-09-12T19:00:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.035+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__multipart_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.1 2024-09-12T19:00:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__shadow_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.1_1 2024-09-12T19:00:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__multipart_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.2 2024-09-12T19:00:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__shadow_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.2_1 2024-09-12T19:00:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__multipart_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.3 2024-09-12T19:00:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__shadow_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.3_1 2024-09-12T19:00:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__multipart_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.4 2024-09-12T19:00:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__shadow_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.4_1 2024-09-12T19:00:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__multipart_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.5 2024-09-12T19:00:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__shadow_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.5_1 2024-09-12T19:00:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__multipart_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.6 2024-09-12T19:00:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.625__shadow_multipart_enc.2~bc7QdN5tJmEIYWflw1k94sAvdhZDAbj.6_1 2024-09-12T19:00:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7313492549664882296', time=2024-09-12T20:52:41.343339+0000, chain.objs.size()=1 2024-09-12T19:00:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.703__shadow:yV8.cW66G-WMNnUKfnxwDFva.L10ydh_.QEIThj7twehgb4Td1gOPJm5kBVEuKs9_0 2024-09-12T19:00:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2676794683654825848', time=2024-09-12T20:52:46.492498+0000, chain.objs.size()=1 2024-09-12T19:00:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.039+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.707__shadow:p9Zu2hAebdavGjzNPx6uTZLO.b4ZDin_.q5W0NYvqu7V5OEquNAphEbELiI1QkYc_0 2024-09-12T19:00:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.043+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10256731684053112012', time=2024-09-12T20:53:54.300507+0000, chain.objs.size()=1 2024-09-12T19:00:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.741__shadow_.ojMDcdLAJhuNOD2nvEt3Zemmi6SpX_I_0 2024-09-12T19:00:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.043+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1500728681357507613', time=2024-09-12T20:54:01.674044+0000, chain.objs.size()=6 2024-09-12T19:00:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.743__multipart_mymultipart3.2~Dki9d9P-I3qE-0PqK3uBGOpFx0aaerB.1 2024-09-12T19:00:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.743__shadow_mymultipart3.2~Dki9d9P-I3qE-0PqK3uBGOpFx0aaerB.1_1 2024-09-12T19:00:00.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.743__multipart_mymultipart3.2~Dki9d9P-I3qE-0PqK3uBGOpFx0aaerB.2 2024-09-12T19:00:00.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.743__shadow_mymultipart3.2~Dki9d9P-I3qE-0PqK3uBGOpFx0aaerB.2_1 2024-09-12T19:00:00.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.743__multipart_mymultipart3.2~Dki9d9P-I3qE-0PqK3uBGOpFx0aaerB.3 2024-09-12T19:00:00.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.743__shadow_mymultipart3.2~Dki9d9P-I3qE-0PqK3uBGOpFx0aaerB.3_1 2024-09-12T19:00:00.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.043+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:00:00.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.047+0000 7fe4296be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T19:00:00.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.047+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:00:00.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.047+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:00:00.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52587' 2024-09-12T19:00:00.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16075807644607364355', time=2024-09-12T20:22:00.417723+0000, chain.objs.size()=1 2024-09-12T19:00:00.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.148__shadow_.JvbFJwiNmhNf4b8DdwX_xxputBlFD6x_0 2024-09-12T19:00:00.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1878289452726901396', time=2024-09-12T20:22:53.800051+0000, chain.objs.size()=1 2024-09-12T19:00:00.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.166__shadow_.rCw0QjhPqv4h_MNEFKYgdVTuLjIiu0x_0 2024-09-12T19:00:00.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1741442073721530518', time=2024-09-12T20:26:30.971754+0000, chain.objs.size()=1 2024-09-12T19:00:00.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.235__shadow_.BHoHPtK2gCf9KaBA4LePPzth06YFhsq_0 2024-09-12T19:00:00.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7795196084923840281', time=2024-09-12T20:26:39.968705+0000, chain.objs.size()=1 2024-09-12T19:00:00.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.241__shadow_.pbf7SER2gcU46Z4MiTs3TVXtNx1cDeN_0 2024-09-12T19:00:00.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2047951564228807431', time=2024-09-12T20:26:43.397924+0000, chain.objs.size()=1 2024-09-12T19:00:00.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.243__shadow_.eeYh4H1DbBaGXc4TlvN_qzszCoI4YMO_0 2024-09-12T19:00:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1503887746866574958', time=2024-09-12T20:26:43.439051+0000, chain.objs.size()=1 2024-09-12T19:00:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.243__shadow_.aA_JJERmhzFN8vqR4bl2S81xe5MWDV8_0 2024-09-12T19:00:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11612891021455867597', time=2024-09-12T20:26:49.674437+0000, chain.objs.size()=1 2024-09-12T19:00:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.247__shadow_.Cy7W-Ab_d4RvlpDWsPraSuxOC2YUj7H_0 2024-09-12T19:00:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3593693596706801805', time=2024-09-12T20:26:52.471918+0000, chain.objs.size()=1 2024-09-12T19:00:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.249__shadow_.pR32_pr-4wHpZjYFgIn3vjRGfEHxjXO_0 2024-09-12T19:00:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.434896546662481663', time=2024-09-12T20:26:52.473962+0000, chain.objs.size()=1 2024-09-12T19:00:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.249__shadow_.AdBB2VnvWs38ODMoiPt-a-0BuZ33zCu_0 2024-09-12T19:00:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16983438841211326615', time=2024-09-12T20:26:58.054764+0000, chain.objs.size()=1 2024-09-12T19:00:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.253__shadow_.rrh8F-aK0BZZgE3Y3AURrxIisvzf1PO_0 2024-09-12T19:00:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9812937499695682142', time=2024-09-12T20:26:59.442357+0000, chain.objs.size()=1 2024-09-12T19:00:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.254__shadow_.62i6uOEe2_4TnXmPKq5gEJMb2PTtYPK_0 2024-09-12T19:00:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11068399836470968147', time=2024-09-12T20:28:48.650019+0000, chain.objs.size()=1 2024-09-12T19:00:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7GGHBfOrQy6dsGODOOr1_BX04CfvQB3_0 2024-09-12T19:00:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13547676619748675709', time=2024-09-12T20:28:48.947184+0000, chain.objs.size()=1 2024-09-12T19:00:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.jWchpF9Bn1mtyDjmGLWytS-CfuOfmR9_0 2024-09-12T19:00:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12834254985256242748', time=2024-09-12T20:28:49.805084+0000, chain.objs.size()=1 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.2Ng8XxC2ggz-Ro1PztyaJYyuSDWcVg5_0 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14194731986137564545', time=2024-09-12T20:28:50.056449+0000, chain.objs.size()=1 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.T4w3zB8uaq1Wzpb_IRxiDTBZkTkDwAo_0 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13040875656866563901', time=2024-09-12T20:28:50.476910+0000, chain.objs.size()=1 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Uy1QW9zxPTxSFMQOg_eLWwNmZd-CpWs_0 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18151337637290326404', time=2024-09-12T20:28:50.641382+0000, chain.objs.size()=1 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.7LqWvla7nUMuB3XnMPyc46uBJq-E0X7_0 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4941524141367187025', time=2024-09-12T20:28:51.581070+0000, chain.objs.size()=1 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.0KdHLWNfYATaSjx96nHOfUA85rshHP8_0 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15950907839275488928', time=2024-09-12T20:28:51.714228+0000, chain.objs.size()=1 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Pq1-WaHdUpCo_j57alqIkAehYgiGt5c_0 2024-09-12T19:00:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10186282349715505107', time=2024-09-12T20:28:52.076004+0000, chain.objs.size()=1 2024-09-12T19:00:00.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.dAfCES-5xxPukJKkVHTe3TLSTKde3f1_0 2024-09-12T19:00:00.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4166680373229408955', time=2024-09-12T20:28:55.996486+0000, chain.objs.size()=1 2024-09-12T19:00:00.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.UoYp6LUFhLgrKPGeh3CKlwQD-d6ORfl_0 2024-09-12T19:00:00.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4340168241756066603', time=2024-09-12T20:28:57.650269+0000, chain.objs.size()=1 2024-09-12T19:00:00.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.JQ2fedoR5kCJHqbzJ-dww8HP-edhAyf_0 2024-09-12T19:00:00.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.051+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16266549721489733743', time=2024-09-12T20:28:59.017007+0000, chain.objs.size()=1 2024-09-12T19:00:00.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.5EnB0LgyK8chF5psWldrCthniMJrMfT_0 2024-09-12T19:00:00.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12934971607595368195', time=2024-09-12T20:28:59.018583+0000, chain.objs.size()=1 2024-09-12T19:00:00.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.XEMr9YWRGt_F7JVEngq-DOxzPnqjN7B_0 2024-09-12T19:00:00.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9192797475898541049', time=2024-09-12T20:29:00.679954+0000, chain.objs.size()=1 2024-09-12T19:00:00.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.KmVVc0EDmsao5v6JjwisEMHhVRtw40s_0 2024-09-12T19:00:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14221699220930275386', time=2024-09-12T20:29:03.721111+0000, chain.objs.size()=1 2024-09-12T19:00:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Syxs8-dg3wmgbO_iYmlknVnQoh6e82j_0 2024-09-12T19:00:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12747171775986329460', time=2024-09-12T20:29:04.529124+0000, chain.objs.size()=1 2024-09-12T19:00:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.r_1PEyUDhC01I5AZotyNFn8Acjv_9Ty_0 2024-09-12T19:00:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14576655915782604538', time=2024-09-12T20:29:04.531162+0000, chain.objs.size()=1 2024-09-12T19:00:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.3im6LppHtXZKYF79UE3jqtIISHSmqy4_0 2024-09-12T19:00:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5085726097386890754', time=2024-09-12T20:29:05.262035+0000, chain.objs.size()=1 2024-09-12T19:00:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.RfyFAPUpF5wwBSnS3CR6eqApIkEaMUd_0 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13690530151643871702', time=2024-09-12T20:29:06.848767+0000, chain.objs.size()=1 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.cSDMOjUWdTtGvN8P8rHQCv0FgWkLjIK_0 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14382853977174594140', time=2024-09-12T20:29:06.850603+0000, chain.objs.size()=1 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.s21zZL3UXYrp0qJb7Hl4Kwvo3rmo6i1_0 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4503790576953554902', time=2024-09-12T20:29:08.827632+0000, chain.objs.size()=1 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.Xaw4UKaQizvBRUJpZDsgU-Xv_uAThDl_0 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.393561118635545189', time=2024-09-12T20:29:12.452568+0000, chain.objs.size()=1 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.BQFs9NcmNvBWAKvu9FpDngBot2vQtAR_0 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10160912533134859152', time=2024-09-12T20:29:12.454353+0000, chain.objs.size()=1 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.O3iFkOezySh4eRJVL7k0ox_NPm_36Eb_0 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3722912083432441359', time=2024-09-12T20:29:15.425679+0000, chain.objs.size()=1 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.262__shadow_.WvKq4qX1LxsABFw5yeDiqWKX7QyikNQ_0 2024-09-12T19:00:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7843505574359842536', time=2024-09-12T20:29:26.939129+0000, chain.objs.size()=1 2024-09-12T19:00:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.055+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.271__shadow_._nfqoe-38H_pR0sh9_WtfIsGDQFIJDn_0 2024-09-12T19:00:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14181449880519991815', time=2024-09-12T20:29:34.933226+0000, chain.objs.size()=1 2024-09-12T19:00:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.277__shadow_.BHGqOSqtjdrfOWGjmn1d981YEW2pMno_0 2024-09-12T19:00:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.892595936041473084', time=2024-09-12T20:29:34.951289+0000, chain.objs.size()=1 2024-09-12T19:00:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.277__shadow_.LLv1FbemJH8NWA5TSUzj_USpChbvRli_0 2024-09-12T19:00:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13094397482092390762', time=2024-09-12T20:29:39.170712+0000, chain.objs.size()=1 2024-09-12T19:00:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.280__shadow_.cMriMIogpwIFDm2iRMYquLkuELkE2fB_0 2024-09-12T19:00:00.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6486162813882368211', time=2024-09-12T20:29:40.630689+0000, chain.objs.size()=1 2024-09-12T19:00:00.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.281__shadow_.pr7YApPWP2gw9l5E0ejmkahMfX0eu5Y_0 2024-09-12T19:00:00.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7863320374208344157', time=2024-09-12T20:29:47.727436+0000, chain.objs.size()=1 2024-09-12T19:00:00.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.286__shadow_.QJhLxnufTcIOe6l2VItcPogdAtQTcnv_0 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6496549816156571350', time=2024-09-12T20:29:50.539813+0000, chain.objs.size()=1 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.288__shadow_.tULy2F9OMcFi1YKLsQFGtqbj8NqkrxC_0 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14709154342227825801', time=2024-09-12T20:29:59.320405+0000, chain.objs.size()=1 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.292__shadow_.T7rpenK_FY0-C-6gkkhiCCyZlWqDbJH_0 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17567149281506653261', time=2024-09-12T20:30:13.905050+0000, chain.objs.size()=1 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.300__shadow_.fpXx5il5uaoAPuPv4XdMSsyr6yNo_R__0 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4551814004296697580', time=2024-09-12T20:30:15.298112+0000, chain.objs.size()=1 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.301__shadow_.3u1upw_G5TyOspKkq9BMIOR1-RXTbvO_0 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16105653923735057253', time=2024-09-12T20:32:27.241895+0000, chain.objs.size()=1 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.oH_BLPIuy4aLnRl5SKmERgT0tDQKF4U_0 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13086780950825266906', time=2024-09-12T20:32:27.558556+0000, chain.objs.size()=1 2024-09-12T19:00:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.czT95M2ch75JaaBozw389q5YVpOwc8i_0 2024-09-12T19:00:00.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13857363135311342019', time=2024-09-12T20:32:29.285592+0000, chain.objs.size()=1 2024-09-12T19:00:00.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7aSbVOopIKjKqG-s2D2Nk9FBLu-bNDg_0 2024-09-12T19:00:00.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16097878771641956652', time=2024-09-12T20:32:30.717560+0000, chain.objs.size()=1 2024-09-12T19:00:00.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.z4t462xf1pdX2vK_-iGSQheLSUIzAXF_0 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9792698751045217914', time=2024-09-12T20:32:31.483851+0000, chain.objs.size()=1 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.EUu1dCe5YxwCVCCIBmrqqL2lRFYLxJ2_0 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9155240175483792295', time=2024-09-12T20:32:31.696951+0000, chain.objs.size()=1 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.bytzvyrnbqAUFw_pkAKhDQjTrrJHyoL_0 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16377865220645272568', time=2024-09-12T20:32:31.904800+0000, chain.objs.size()=1 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.MyYjevk_H6YI2WUBrFAMTyrdW5-STyu_0 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12380852888166520380', time=2024-09-12T20:32:32.395810+0000, chain.objs.size()=1 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.FlCZ0DMFIhv_XJNjOQpuIfz8G4Io6hn_0 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7428835758935273307', time=2024-09-12T20:32:33.075074+0000, chain.objs.size()=1 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.45EmpjGEMlXvnrbyj0zq0TIpXTHmFDQ_0 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3826219323615707339', time=2024-09-12T20:32:34.288713+0000, chain.objs.size()=1 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.rOGNCF2lEqDNYZnCwK4IfjRyHisdfwM_0 2024-09-12T19:00:00.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15923055290978477060', time=2024-09-12T20:32:39.971061+0000, chain.objs.size()=1 2024-09-12T19:00:00.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.059+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.75t7S9M9EumsCmA_ecl8a0RqZ9d3hI7_0 2024-09-12T19:00:00.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9080284431705321362', time=2024-09-12T20:32:41.258532+0000, chain.objs.size()=1 2024-09-12T19:00:00.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.jvcOXkOoyKCZ33utEGBFtT9rnZBJXlu_0 2024-09-12T19:00:00.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17041748742037449790', time=2024-09-12T20:32:43.365093+0000, chain.objs.size()=1 2024-09-12T19:00:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_._lBSqEQ2ur7RrLYxqfkQsMEwLbrOL4f_0 2024-09-12T19:00:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8856739543101414614', time=2024-09-12T20:32:43.576214+0000, chain.objs.size()=1 2024-09-12T19:00:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.CmHPl4S2hbr3NJrmNxAn146JfF9h0FQ_0 2024-09-12T19:00:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5141969192236918215', time=2024-09-12T20:32:44.962577+0000, chain.objs.size()=1 2024-09-12T19:00:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.gglPbO1P7i94zXG-HNTArtSirZDl9t0_0 2024-09-12T19:00:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5076156929857754476', time=2024-09-12T20:32:46.305523+0000, chain.objs.size()=1 2024-09-12T19:00:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uonFGBD6cmJuqM3BxosQPF5V2lcDnDZ_0 2024-09-12T19:00:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11715113984365328941', time=2024-09-12T20:32:46.306982+0000, chain.objs.size()=1 2024-09-12T19:00:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.4TweRWSRpQhByWUwbO1vQyzL0JcD-CW_0 2024-09-12T19:00:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6823917536180021201', time=2024-09-12T20:32:46.308579+0000, chain.objs.size()=1 2024-09-12T19:00:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.yng40d4Zrv-E-XAzwrr0KaHQ6zo4Z5s_0 2024-09-12T19:00:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13665713857600021015', time=2024-09-12T20:32:46.608892+0000, chain.objs.size()=1 2024-09-12T19:00:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.ZRxPTaKn6LicRnplzOPRV-E3u5Uz4kD_0 2024-09-12T19:00:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9584128578523545719', time=2024-09-12T20:32:46.955474+0000, chain.objs.size()=1 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.VfnmEDvqwJ9A0k0WIhzy4fTvOh9zcg7_0 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13586510145322719145', time=2024-09-12T20:32:49.099332+0000, chain.objs.size()=1 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.cjAMVTM7aopu8061vWL-vxjzEwfvFOD_0 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13324173302458554941', time=2024-09-12T20:32:50.429152+0000, chain.objs.size()=1 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.uRUU7pdOgXWcNjjmoUJRT3Lik5EE0Th_0 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4215300279560908260', time=2024-09-12T20:32:53.648101+0000, chain.objs.size()=1 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.323__shadow_.7H3CjJkYF_XoF0BJDvtwJ_c7og4AG0X_0 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17456651112433574842', time=2024-09-12T20:34:34.415644+0000, chain.objs.size()=1 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.AL01iidQS3FVh_XBq6Ro6CYowRfqJcp_0 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7592173550322739106', time=2024-09-12T20:34:35.361929+0000, chain.objs.size()=1 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RYmElmCziDwjBh3MIuTzDGKxhIj6GVU_0 2024-09-12T19:00:00.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11871596602116324298', time=2024-09-12T20:34:35.986905+0000, chain.objs.size()=1 2024-09-12T19:00:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.3vochyufC2Veu-1N3Zf83RVF1N_akeJ_0 2024-09-12T19:00:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1298773072226534028', time=2024-09-12T20:34:38.332562+0000, chain.objs.size()=1 2024-09-12T19:00:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.063+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.sCNwnJsBiUlHzSsd8eXNfQhoTOUEtph_0 2024-09-12T19:00:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6046449236870965629', time=2024-09-12T20:34:38.818708+0000, chain.objs.size()=1 2024-09-12T19:00:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.V1WSdKxWyVylSXiRx69c4V4-rEjHWKf_0 2024-09-12T19:00:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10376103387276037360', time=2024-09-12T20:34:38.907990+0000, chain.objs.size()=1 2024-09-12T19:00:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.0MOduFK0KMJ72Mv1qyfgR253yeAIiVR_0 2024-09-12T19:00:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.17064325766491291174', time=2024-09-12T20:34:38.934788+0000, chain.objs.size()=1 2024-09-12T19:00:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.tHwDRO4y5YA1UP9cnxoFHlBfsbpt1WO_0 2024-09-12T19:00:00.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.786452309472223439', time=2024-09-12T20:34:39.844586+0000, chain.objs.size()=1 2024-09-12T19:00:00.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.c1YsEoxZ9oJ2xCfFvSi4uyx6NPZQ4e4_0 2024-09-12T19:00:00.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1970495496410259609', time=2024-09-12T20:34:40.207766+0000, chain.objs.size()=1 2024-09-12T19:00:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.DFKtvA0BGSTl-K5n5-H0_Kmz98uxbhh_0 2024-09-12T19:00:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15179318861479504291', time=2024-09-12T20:34:41.833531+0000, chain.objs.size()=1 2024-09-12T19:00:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.oj03Hc7CUkVj0IQymq7Y5IUlwzrHCb0_0 2024-09-12T19:00:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1895061515018374229', time=2024-09-12T20:34:41.883187+0000, chain.objs.size()=1 2024-09-12T19:00:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Wyfei9sXMbS6Lwz5XdVCp49HDyF6cHL_0 2024-09-12T19:00:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6059410057093265482', time=2024-09-12T20:34:43.259479+0000, chain.objs.size()=1 2024-09-12T19:00:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UlgvkPzOrOEiAd4oMnKi05rXskdi1UZ_0 2024-09-12T19:00:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1785059416402471969', time=2024-09-12T20:34:43.455272+0000, chain.objs.size()=1 2024-09-12T19:00:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.FN8mK5LdlgT_wa28pTZ-iitf4v5Waaw_0 2024-09-12T19:00:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14576191658397155927', time=2024-09-12T20:34:43.628640+0000, chain.objs.size()=1 2024-09-12T19:00:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RNAmxNWXXZRKcfqpHDPrTV8UkAkC-9V_0 2024-09-12T19:00:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3309577592379650178', time=2024-09-12T20:34:43.926518+0000, chain.objs.size()=1 2024-09-12T19:00:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hFB5CRBvGjNeKPgy5MMgVimJwqPTWUx_0 2024-09-12T19:00:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1545256766095614064', time=2024-09-12T20:34:44.095314+0000, chain.objs.size()=1 2024-09-12T19:00:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.UHNJM1YWSlLQrApEMcCmRajGnC8MjB8_0 2024-09-12T19:00:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2208675312837191373', time=2024-09-12T20:34:45.052802+0000, chain.objs.size()=1 2024-09-12T19:00:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.Gk9tK4eoA91I4KSBe_Z-XXfzSmwC_ST_0 2024-09-12T19:00:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.346995446812489736', time=2024-09-12T20:34:45.456297+0000, chain.objs.size()=1 2024-09-12T19:00:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_._NdwSmkYuqRRqriw8mxe9SMWLX85A9a_0 2024-09-12T19:00:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12034834781695260886', time=2024-09-12T20:34:45.518723+0000, chain.objs.size()=1 2024-09-12T19:00:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.BVSwpunyEbw3NAGb7q0IV0DN9c75lbI_0 2024-09-12T19:00:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14277617620154276994', time=2024-09-12T20:34:45.611619+0000, chain.objs.size()=1 2024-09-12T19:00:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.NIOwA9n6y02GvirU9_bdXT4O-iVHZkC_0 2024-09-12T19:00:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18217873583699679772', time=2024-09-12T20:34:46.146653+0000, chain.objs.size()=1 2024-09-12T19:00:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.nj2JHydPlUHaCQDvGNE-G91xXF6OCgO_0 2024-09-12T19:00:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13690658179178378203', time=2024-09-12T20:34:46.148766+0000, chain.objs.size()=1 2024-09-12T19:00:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.CFBqe3ewRp-peUw4BbcbYM9PDXubHnb_0 2024-09-12T19:00:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13562203723721456048', time=2024-09-12T20:34:46.916782+0000, chain.objs.size()=1 2024-09-12T19:00:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.4QFNuHcWdnTcOl7emyxbxy42q-3Ouwf_0 2024-09-12T19:00:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9142803315307068518', time=2024-09-12T20:34:47.310968+0000, chain.objs.size()=1 2024-09-12T19:00:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.067+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.-6zKX-xriL6GjFfuJBim0LnNBU_s8wF_0 2024-09-12T19:00:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12218781366126249155', time=2024-09-12T20:34:50.816468+0000, chain.objs.size()=1 2024-09-12T19:00:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.ny4vqyVKZzV2H_OYAYJzAGIuPizvsjF_0 2024-09-12T19:00:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15657846441138315280', time=2024-09-12T20:34:52.927037+0000, chain.objs.size()=1 2024-09-12T19:00:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.CPdCc072IPMkoX-b0XFwp8z9kywjC2D_0 2024-09-12T19:00:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3702723083777488135', time=2024-09-12T20:34:54.029083+0000, chain.objs.size()=1 2024-09-12T19:00:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.sbsy8KMGtRk9asUw9qaRJy5lQUmk2d8_0 2024-09-12T19:00:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15314562933826551351', time=2024-09-12T20:34:54.338078+0000, chain.objs.size()=1 2024-09-12T19:00:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.RTZcLDt-PdbwB8vk2bRREtbeAj4u-1H_0 2024-09-12T19:00:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.12636196271250026854', time=2024-09-12T20:34:55.805952+0000, chain.objs.size()=1 2024-09-12T19:00:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.hhlnxXWlGTiJXVM7DUHd-SsGDN2kPNd_0 2024-09-12T19:00:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.4899232512993462835', time=2024-09-12T20:34:56.089505+0000, chain.objs.size()=1 2024-09-12T19:00:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.FCPfbmEEzvdxtoAj_LuyCSC6Sr6Cj5g_0 2024-09-12T19:00:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.794404404865148975', time=2024-09-12T20:34:57.947433+0000, chain.objs.size()=1 2024-09-12T19:00:00.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.aIxr95j-MNIMLNREzNv0v-Y2hqHigNR_0 2024-09-12T19:00:00.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.10439859798078899332', time=2024-09-12T20:34:58.179673+0000, chain.objs.size()=1 2024-09-12T19:00:00.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.HtH49m1kjMc1rFoIDyM3u9noS7zrrJL_0 2024-09-12T19:00:00.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.071+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52587 2024-09-12T19:00:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T19:00:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6457859427930238529', time=2024-09-12T20:34:58.288288+0000, chain.objs.size()=1 2024-09-12T19:00:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.w63U9lzfZZTiRttyQBCfJViD97wixl6_0 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2650629802276432997', time=2024-09-12T20:34:59.461262+0000, chain.objs.size()=1 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.X2-fTZBiQCoA1njNTh6vW2rf9dEnTYO_0 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8823320746644922834', time=2024-09-12T20:34:59.511127+0000, chain.objs.size()=1 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.l423f3rttDr8SNRSLGz9Nk8NxiLz1Qz_0 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16853263142666202788', time=2024-09-12T20:35:00.283035+0000, chain.objs.size()=1 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.KwJQpSqr4wDfqnK5_43HhXKB_SVzO-N_0 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16875452122378172078', time=2024-09-12T20:35:00.610390+0000, chain.objs.size()=1 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.sArojyTLh3dLkp-RMpSKNw7E3t5zZBd_0 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.7287461586414738525', time=2024-09-12T20:35:00.831507+0000, chain.objs.size()=1 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.324__shadow_.iFJAYrafXOsCDIJ3JjLsfpwJxaGXi63_0 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3206442107135131491', time=2024-09-12T20:36:53.549331+0000, chain.objs.size()=1 2024-09-12T19:00:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.432__shadow_.FX2D2FyCk8DPqkfNkiZBiT0gvaaL4v4_0 2024-09-12T19:00:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8083484519421388570', time=2024-09-12T20:36:59.719330+0000, chain.objs.size()=1 2024-09-12T19:00:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.437__shadow_.B__M9Apfw9YG4vKFvrH4dkc4QH6OBYo_0 2024-09-12T19:00:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6362753603647507285', time=2024-09-12T20:37:04.360924+0000, chain.objs.size()=1 2024-09-12T19:00:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.441__shadow_.FfmIeMRnElrzqIe4ee9n_h7oKffARQp_0 2024-09-12T19:00:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.3908912569509320071', time=2024-09-12T20:37:05.575293+0000, chain.objs.size()=1 2024-09-12T19:00:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.442__shadow_.NOSFGpnd0BFeTvJbCF4sQyqEUyS9A8N_0 2024-09-12T19:00:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11152214988141306175', time=2024-09-12T20:38:15.879793+0000, chain.objs.size()=1 2024-09-12T19:00:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.496__shadow_.y7d2ohbd2KOzz4wjTFsl3P_yo8DTgZP_0 2024-09-12T19:00:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6977914948294111983', time=2024-09-12T20:38:15.884596+0000, chain.objs.size()=1 2024-09-12T19:00:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.496__shadow_.y7d2ohbd2KOzz4wjTFsl3P_yo8DTgZP_0 2024-09-12T19:00:00.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.5491675379478887492', time=2024-09-12T20:41:24.952704+0000, chain.objs.size()=2 2024-09-12T19:00:00.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.075+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~52uH5IOIrlv0FWDDGt0B4_p-aaQEPFU.1 2024-09-12T19:00:00.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.525__multipart_mymultipart.2~52uH5IOIrlv0FWDDGt0B4_p-aaQEPFU.2 2024-09-12T19:00:00.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.9387945328203063239', time=2024-09-12T20:43:34.665705+0000, chain.objs.size()=2 2024-09-12T19:00:00.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.563__shadow_.CF99kvDbXsVjiEWODC_-9tCPh72k1OS_0 2024-09-12T19:00:00.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.563__shadow_.CF99kvDbXsVjiEWODC_-9tCPh72k1OS_1 2024-09-12T19:00:00.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.900939821417060746', time=2024-09-12T20:44:12.755309+0000, chain.objs.size()=1 2024-09-12T19:00:00.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.574__shadow_.DObkBlODiw_YaiYrgNCAN7mPpV4AFHK_0 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.18365856912204789316', time=2024-09-12T20:44:30.384678+0000, chain.objs.size()=1 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.576__shadow:T5AiJOk6B8J8VvQcbHS8.zD0Q7NNuzg_.B9z5i_PgXQ6JXc1woVuzl1sFqzXYwyI_0 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11137174313730158180', time=2024-09-12T20:44:45.409818+0000, chain.objs.size()=1 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.577__shadow:tA1sJ.Ev85o5UY1Tohg1XJaeU1pH7Qc_.qcOsEWPjbykH8hUq0f6O0EpC-jE-qxe_0 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.13572386052022467857', time=2024-09-12T20:45:47.084646+0000, chain.objs.size()=1 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.585__shadow:HhO6lnhisRcsBqIqOQR38uWr5KIv1rm_.BCMwrewmZ9-spo7zymF2a4gaNLWBlVl_0 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.16210275165758069832', time=2024-09-12T20:45:49.117129+0000, chain.objs.size()=1 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.586__shadow:OcNzrbiRJAsOmcVDnX1r-Hbx11Z1RsO_.hQfuXX6abPODDgrKqbgqUReigvWKcnr_0 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.2145282641366074441', time=2024-09-12T20:45:49.238767+0000, chain.objs.size()=1 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.586__shadow:O40kpppm0ur1FjDERUk6s1DH4.f0aq2_.JC4X5jduHvkl3CkIuh8oyKFNJgOqnX4_0 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.11261920607139651355', time=2024-09-12T20:45:52.641814+0000, chain.objs.size()=1 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.587__shadow:tMCBc-ib7pX0J5nGkLVgcAx9Bcub-30_.6_1e1BbzAcLg4oFXJAIQvCWzmORH1yl_0 2024-09-12T19:00:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.14571915314974822695', time=2024-09-12T20:50:44.358904+0000, chain.objs.size()=1 2024-09-12T19:00:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.079+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.630__shadow_.hrNYcN8ykS4uDKoqGUsIJiGtlRizJ-t_0 2024-09-12T19:00:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.083+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8590986342698892329', time=2024-09-12T20:50:49.090896+0000, chain.objs.size()=1 2024-09-12T19:00:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.083+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.634__shadow_.Lu-Kw4EiC_4bYVMm9srQdtxT3SIdbdx_0 2024-09-12T19:00:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.083+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.6304708599149778919', time=2024-09-12T20:52:14.524400+0000, chain.objs.size()=1 2024-09-12T19:00:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.083+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.679__shadow_.jFcq-sJZn0A7CbpDI1F3uMB98R9Nzqs_0 2024-09-12T19:00:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.083+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.1903531830188148166', time=2024-09-12T20:52:33.104277+0000, chain.objs.size()=1 2024-09-12T19:00:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.083+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.697__shadow:nWELQoaqeF.Ufz5k9onchMy-v4e4Wd5_.X1CIHQxRFIDAHdqcfjJlv4hQcfXk7ZT_0 2024-09-12T19:00:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.083+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.15967434352070148029', time=2024-09-12T20:52:42.639567+0000, chain.objs.size()=1 2024-09-12T19:00:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.083+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.704__shadow:S95Y8OOKyPG2tW8VLAN0FiuyjN7hXlL_.Vn0Fq76aFyU-p7S8WolrDCz1_aJt2fH_0 2024-09-12T19:00:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.083+0000 7fe4296be9c0 20 garbage collection: RGWGC::process iterating over entry tag='e807567e-1eb5-4a0c-9e30-862938396cf3.4526.8815892173207447350', time=2024-09-12T20:52:52.871013+0000, chain.objs.size()=1 2024-09-12T19:00:00.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.083+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e807567e-1eb5-4a0c-9e30-862938396cf3.4526.712__shadow:xIhu3l7Gz0ktG6ltIlSdFnP.zZCyYfq_.WjmZULufojE4P9jPk1jYO5uoPU8dpUV_0 2024-09-12T19:00:00.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.083+0000 7fe4296be9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:00:00.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.087+0000 7fe2de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:00:00.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.091+0000 7fe4296be9c0 20 remove_watcher() i=0 2024-09-12T19:00:00.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.091+0000 7fe4296be9c0 2 removed watcher, disabling cache 2024-09-12T19:00:00.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.091+0000 7fe4296be9c0 20 remove_watcher() i=1 2024-09-12T19:00:00.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.091+0000 7fe4296be9c0 20 remove_watcher() i=2 2024-09-12T19:00:00.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.091+0000 7fe4296be9c0 20 remove_watcher() i=3 2024-09-12T19:00:00.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.095+0000 7fe4296be9c0 20 remove_watcher() i=4 2024-09-12T19:00:00.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.095+0000 7fe4296be9c0 20 remove_watcher() i=5 2024-09-12T19:00:00.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.095+0000 7fe4296be9c0 20 remove_watcher() i=6 2024-09-12T19:00:00.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-12T19:00:00.095+0000 7fe4296be9c0 20 remove_watcher() i=7 2024-09-12T19:00:00.110 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T19:00:00.122 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T19:00:00.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T19:00:00.132 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:00:00.475 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T19:00:00.490 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-09-12T19:00:00.498 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":2656,"stamp":"2024-09-12T18:59:59.321639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":795277064,"num_objects":4897,"num_object_clones":0,"num_object_copies":9794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4897,"num_whiteouts":0,"num_read":179022,"num_read_kb":2404787,"num_write":140334,"num_write_kb":2445958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13289,"ondisk_log_size":13289,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2899464,"kb_used_data":1613128,"kb_used_omap":12,"kb_used_meta":1286195,"kb_avail":752075256,"statfs":{"total":773094113280,"available":770125062144,"internally_reserved":0,"allocated":1651843072,"data_stored":1606633496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1317064243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007647"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639884+0000","last_change":"2024-09-12T18:19:57.854037+0000","last_active":"2024-09-12T18:57:27.639884+0000","last_peered":"2024-09-12T18:57:27.639884+0000","last_clean":"2024-09-12T18:57:27.639884+0000","last_became_active":"2024-09-12T18:19:57.853375+0000","last_became_peered":"2024-09-12T18:19:57.853375+0000","last_unstale":"2024-09-12T18:57:27.639884+0000","last_undegraded":"2024-09-12T18:57:27.639884+0000","last_fullsized":"2024-09-12T18:57:27.639884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:39.334575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'1","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.636250+0000","last_change":"2024-09-12T17:59:43.011642+0000","last_active":"2024-09-12T18:57:12.636250+0000","last_peered":"2024-09-12T18:57:12.636250+0000","last_clean":"2024-09-12T18:57:12.636250+0000","last_became_active":"2024-09-12T17:59:43.010854+0000","last_became_peered":"2024-09-12T17:59:43.010854+0000","last_unstale":"2024-09-12T18:57:12.636250+0000","last_undegraded":"2024-09-12T18:57:12.636250+0000","last_fullsized":"2024-09-12T18:57:12.636250+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:05.224690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454697+0000","last_change":"2024-09-12T17:59:38.988698+0000","last_active":"2024-09-12T18:57:12.454697+0000","last_peered":"2024-09-12T18:57:12.454697+0000","last_clean":"2024-09-12T18:57:12.454697+0000","last_became_active":"2024-09-12T17:59:38.987739+0000","last_became_peered":"2024-09-12T17:59:38.987739+0000","last_unstale":"2024-09-12T18:57:12.454697+0000","last_undegraded":"2024-09-12T18:57:12.454697+0000","last_fullsized":"2024-09-12T18:57:12.454697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:32.330775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'44","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.460341+0000","last_change":"2024-09-12T17:55:59.359070+0000","last_active":"2024-09-12T18:56:27.460341+0000","last_peered":"2024-09-12T18:56:27.460341+0000","last_clean":"2024-09-12T18:56:27.460341+0000","last_became_active":"2024-09-12T17:55:59.358302+0000","last_became_peered":"2024-09-12T17:55:59.358302+0000","last_unstale":"2024-09-12T18:56:27.460341+0000","last_undegraded":"2024-09-12T18:56:27.460341+0000","last_fullsized":"2024-09-12T18:56:27.460341+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:31.219330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":154,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:54:59.420325+0000","last_change":"2024-09-12T18:19:57.839639+0000","last_active":"2024-09-12T18:54:59.420325+0000","last_peered":"2024-09-12T18:54:59.420325+0000","last_clean":"2024-09-12T18:54:59.420325+0000","last_became_active":"2024-09-12T18:19:57.838918+0000","last_became_peered":"2024-09-12T18:19:57.838918+0000","last_unstale":"2024-09-12T18:54:59.420325+0000","last_undegraded":"2024-09-12T18:54:59.420325+0000","last_fullsized":"2024-09-12T18:54:59.420325+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:14.062322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'1","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.816864+0000","last_change":"2024-09-12T17:59:43.018636+0000","last_active":"2024-09-12T18:57:12.816864+0000","last_peered":"2024-09-12T18:57:12.816864+0000","last_clean":"2024-09-12T18:57:12.816864+0000","last_became_active":"2024-09-12T17:59:43.005733+0000","last_became_peered":"2024-09-12T17:59:43.005733+0000","last_unstale":"2024-09-12T18:57:12.816864+0000","last_undegraded":"2024-09-12T18:57:12.816864+0000","last_fullsized":"2024-09-12T18:57:12.816864+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.942784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.460544+0000","last_change":"2024-09-12T17:59:38.990543+0000","last_active":"2024-09-12T18:57:12.460544+0000","last_peered":"2024-09-12T18:57:12.460544+0000","last_clean":"2024-09-12T18:57:12.460544+0000","last_became_active":"2024-09-12T17:59:38.989854+0000","last_became_peered":"2024-09-12T17:59:38.989854+0000","last_unstale":"2024-09-12T18:57:12.460544+0000","last_undegraded":"2024-09-12T18:57:12.460544+0000","last_fullsized":"2024-09-12T18:57:12.460544+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:58.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7924395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":8763,"num_write":5,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'34","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:14.436391+0000","last_change":"2024-09-12T17:55:59.368156+0000","last_active":"2024-09-12T18:56:14.436391+0000","last_peered":"2024-09-12T18:56:14.436391+0000","last_clean":"2024-09-12T18:56:14.436391+0000","last_became_active":"2024-09-12T17:55:59.367426+0000","last_became_peered":"2024-09-12T17:55:59.367426+0000","last_unstale":"2024-09-12T18:56:14.436391+0000","last_undegraded":"2024-09-12T18:56:14.436391+0000","last_fullsized":"2024-09-12T18:56:14.436391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:37.601556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":114,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.427354+0000","last_change":"2024-09-12T18:19:57.849468+0000","last_active":"2024-09-12T18:56:12.427354+0000","last_peered":"2024-09-12T18:56:12.427354+0000","last_clean":"2024-09-12T18:56:12.427354+0000","last_became_active":"2024-09-12T18:19:57.848735+0000","last_became_peered":"2024-09-12T18:19:57.848735+0000","last_unstale":"2024-09-12T18:56:12.427354+0000","last_undegraded":"2024-09-12T18:56:12.427354+0000","last_fullsized":"2024-09-12T18:56:12.427354+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:59.827170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453948+0000","last_change":"2024-09-12T17:59:43.012346+0000","last_active":"2024-09-12T18:55:57.453948+0000","last_peered":"2024-09-12T18:55:57.453948+0000","last_clean":"2024-09-12T18:55:57.453948+0000","last_became_active":"2024-09-12T17:59:43.011603+0000","last_became_peered":"2024-09-12T17:59:43.011603+0000","last_unstale":"2024-09-12T18:55:57.453948+0000","last_undegraded":"2024-09-12T18:55:57.453948+0000","last_fullsized":"2024-09-12T18:55:57.453948+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:19.770482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":9,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:54.456240+0000","last_change":"2024-09-12T17:59:38.985703+0000","last_active":"2024-09-12T18:57:54.456240+0000","last_peered":"2024-09-12T18:57:54.456240+0000","last_clean":"2024-09-12T18:57:54.456240+0000","last_became_active":"2024-09-12T17:59:38.984980+0000","last_became_peered":"2024-09-12T17:59:38.984980+0000","last_unstale":"2024-09-12T18:57:54.456240+0000","last_undegraded":"2024-09-12T18:57:54.456240+0000","last_fullsized":"2024-09-12T18:57:54.456240+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:03.988908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'15","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.454640+0000","last_change":"2024-09-12T17:55:59.357028+0000","last_active":"2024-09-12T18:56:02.454640+0000","last_peered":"2024-09-12T18:56:02.454640+0000","last_clean":"2024-09-12T18:56:02.454640+0000","last_became_active":"2024-09-12T17:55:59.356144+0000","last_became_peered":"2024-09-12T17:55:59.356144+0000","last_unstale":"2024-09-12T18:56:02.454640+0000","last_undegraded":"2024-09-12T18:56:02.454640+0000","last_fullsized":"2024-09-12T18:56:02.454640+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:40.644103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442648+0000","last_change":"2024-09-12T18:19:57.861119+0000","last_active":"2024-09-12T18:56:27.442648+0000","last_peered":"2024-09-12T18:56:27.442648+0000","last_clean":"2024-09-12T18:56:27.442648+0000","last_became_active":"2024-09-12T18:19:57.860464+0000","last_became_peered":"2024-09-12T18:19:57.860464+0000","last_unstale":"2024-09-12T18:56:27.442648+0000","last_undegraded":"2024-09-12T18:56:27.442648+0000","last_fullsized":"2024-09-12T18:56:27.442648+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:37.217624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'3","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437344+0000","last_change":"2024-09-12T17:59:43.031327+0000","last_active":"2024-09-12T18:56:02.437344+0000","last_peered":"2024-09-12T18:56:02.437344+0000","last_clean":"2024-09-12T18:56:02.437344+0000","last_became_active":"2024-09-12T17:59:43.030545+0000","last_became_peered":"2024-09-12T17:59:43.030545+0000","last_unstale":"2024-09-12T18:56:02.437344+0000","last_undegraded":"2024-09-12T18:56:02.437344+0000","last_fullsized":"2024-09-12T18:56:02.437344+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:11.859283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48431,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4192,"num_write":3,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800776+0000","last_change":"2024-09-12T17:59:38.946186+0000","last_active":"2024-09-12T18:55:57.800776+0000","last_peered":"2024-09-12T18:55:57.800776+0000","last_clean":"2024-09-12T18:55:57.800776+0000","last_became_active":"2024-09-12T17:59:38.945373+0000","last_became_peered":"2024-09-12T17:59:38.945373+0000","last_unstale":"2024-09-12T18:55:57.800776+0000","last_undegraded":"2024-09-12T18:55:57.800776+0000","last_fullsized":"2024-09-12T18:55:57.800776+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:18.147516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'6","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437289+0000","last_change":"2024-09-12T17:55:59.340661+0000","last_active":"2024-09-12T18:56:02.437289+0000","last_peered":"2024-09-12T18:56:02.437289+0000","last_clean":"2024-09-12T18:56:02.437289+0000","last_became_active":"2024-09-12T17:55:59.338550+0000","last_became_peered":"2024-09-12T17:55:59.338550+0000","last_unstale":"2024-09-12T18:56:02.437289+0000","last_undegraded":"2024-09-12T18:56:02.437289+0000","last_fullsized":"2024-09-12T18:56:02.437289+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:44.861905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439345+0000","last_change":"2024-09-12T18:19:57.871984+0000","last_active":"2024-09-12T18:56:12.439345+0000","last_peered":"2024-09-12T18:56:12.439345+0000","last_clean":"2024-09-12T18:56:12.439345+0000","last_became_active":"2024-09-12T18:19:57.871345+0000","last_became_peered":"2024-09-12T18:19:57.871345+0000","last_unstale":"2024-09-12T18:56:12.439345+0000","last_undegraded":"2024-09-12T18:56:12.439345+0000","last_fullsized":"2024-09-12T18:56:12.439345+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:45.284109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.612304+0000","last_change":"2024-09-12T17:59:43.034960+0000","last_active":"2024-09-12T18:55:27.612304+0000","last_peered":"2024-09-12T18:55:27.612304+0000","last_clean":"2024-09-12T18:55:27.612304+0000","last_became_active":"2024-09-12T17:59:43.034299+0000","last_became_peered":"2024-09-12T17:59:43.034299+0000","last_unstale":"2024-09-12T18:55:27.612304+0000","last_undegraded":"2024-09-12T18:55:27.612304+0000","last_fullsized":"2024-09-12T18:55:27.612304+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:55.095948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.444546+0000","last_change":"2024-09-12T17:59:38.981877+0000","last_active":"2024-09-12T18:55:17.444546+0000","last_peered":"2024-09-12T18:55:17.444546+0000","last_clean":"2024-09-12T18:55:17.444546+0000","last_became_active":"2024-09-12T17:59:38.976348+0000","last_became_peered":"2024-09-12T17:59:38.976348+0000","last_unstale":"2024-09-12T18:55:17.444546+0000","last_undegraded":"2024-09-12T18:55:17.444546+0000","last_fullsized":"2024-09-12T18:55:17.444546+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:41.558530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'16","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437226+0000","last_change":"2024-09-12T17:55:59.357701+0000","last_active":"2024-09-12T18:56:02.437226+0000","last_peered":"2024-09-12T18:56:02.437226+0000","last_clean":"2024-09-12T18:56:02.437226+0000","last_became_active":"2024-09-12T17:55:59.356970+0000","last_became_peered":"2024-09-12T17:55:59.356970+0000","last_unstale":"2024-09-12T18:56:02.437226+0000","last_undegraded":"2024-09-12T18:56:02.437226+0000","last_fullsized":"2024-09-12T18:56:02.437226+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:46.362725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":58,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464203+0000","last_change":"2024-09-12T18:19:57.867587+0000","last_active":"2024-09-12T18:57:27.464203+0000","last_peered":"2024-09-12T18:57:27.464203+0000","last_clean":"2024-09-12T18:57:27.464203+0000","last_became_active":"2024-09-12T18:19:57.865319+0000","last_became_peered":"2024-09-12T18:19:57.865319+0000","last_unstale":"2024-09-12T18:57:27.464203+0000","last_undegraded":"2024-09-12T18:57:27.464203+0000","last_fullsized":"2024-09-12T18:57:27.464203+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:03.710006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'1","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.415707+0000","last_change":"2024-09-12T17:59:56.386718+0000","last_active":"2024-09-12T18:55:17.415707+0000","last_peered":"2024-09-12T18:55:17.415707+0000","last_clean":"2024-09-12T18:55:17.415707+0000","last_became_active":"2024-09-12T17:59:56.386194+0000","last_became_peered":"2024-09-12T17:59:56.386194+0000","last_unstale":"2024-09-12T18:55:17.415707+0000","last_undegraded":"2024-09-12T18:55:17.415707+0000","last_fullsized":"2024-09-12T18:55:17.415707+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:16.043399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'7","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.794094+0000","last_change":"2024-09-12T17:59:38.978120+0000","last_active":"2024-09-12T18:55:27.794094+0000","last_peered":"2024-09-12T18:55:27.794094+0000","last_clean":"2024-09-12T18:55:27.794094+0000","last_became_active":"2024-09-12T17:59:38.977316+0000","last_became_peered":"2024-09-12T17:59:38.977316+0000","last_unstale":"2024-09-12T18:55:27.794094+0000","last_undegraded":"2024-09-12T18:55:27.794094+0000","last_fullsized":"2024-09-12T18:55:27.794094+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:26.707491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":16386,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'37","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.425307+0000","last_change":"2024-09-12T17:55:59.366994+0000","last_active":"2024-09-12T18:56:02.425307+0000","last_peered":"2024-09-12T18:56:02.425307+0000","last_clean":"2024-09-12T18:56:02.425307+0000","last_became_active":"2024-09-12T17:55:59.366177+0000","last_became_peered":"2024-09-12T17:55:59.366177+0000","last_unstale":"2024-09-12T18:56:02.425307+0000","last_undegraded":"2024-09-12T18:56:02.425307+0000","last_fullsized":"2024-09-12T18:56:02.425307+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:03.524473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":133,"num_write":64,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457338+0000","last_change":"2024-09-12T18:19:57.844732+0000","last_active":"2024-09-12T18:57:27.457338+0000","last_peered":"2024-09-12T18:57:27.457338+0000","last_clean":"2024-09-12T18:57:27.457338+0000","last_became_active":"2024-09-12T18:19:57.843946+0000","last_became_peered":"2024-09-12T18:19:57.843946+0000","last_unstale":"2024-09-12T18:57:27.457338+0000","last_undegraded":"2024-09-12T18:57:27.457338+0000","last_fullsized":"2024-09-12T18:57:27.457338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:48.999189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.440013+0000","last_change":"2024-09-12T17:59:43.014049+0000","last_active":"2024-09-12T18:57:12.440013+0000","last_peered":"2024-09-12T18:57:12.440013+0000","last_clean":"2024-09-12T18:57:12.440013+0000","last_became_active":"2024-09-12T17:59:43.013293+0000","last_became_peered":"2024-09-12T17:59:43.013293+0000","last_unstale":"2024-09-12T18:57:12.440013+0000","last_undegraded":"2024-09-12T18:57:12.440013+0000","last_fullsized":"2024-09-12T18:57:12.440013+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:47.290570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.816755+0000","last_change":"2024-09-12T17:59:38.984819+0000","last_active":"2024-09-12T18:57:12.816755+0000","last_peered":"2024-09-12T18:57:12.816755+0000","last_clean":"2024-09-12T18:57:12.816755+0000","last_became_active":"2024-09-12T17:59:38.984004+0000","last_became_peered":"2024-09-12T17:59:38.984004+0000","last_unstale":"2024-09-12T18:57:12.816755+0000","last_undegraded":"2024-09-12T18:57:12.816755+0000","last_fullsized":"2024-09-12T18:57:12.816755+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:47.953455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'21","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463100+0000","last_change":"2024-09-12T17:55:59.367890+0000","last_active":"2024-09-12T18:56:42.463100+0000","last_peered":"2024-09-12T18:56:42.463100+0000","last_clean":"2024-09-12T18:56:42.463100+0000","last_became_active":"2024-09-12T17:55:59.366968+0000","last_became_peered":"2024-09-12T17:55:59.366968+0000","last_unstale":"2024-09-12T18:56:42.463100+0000","last_undegraded":"2024-09-12T18:56:42.463100+0000","last_fullsized":"2024-09-12T18:56:42.463100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:25.297113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457398+0000","last_change":"2024-09-12T18:19:57.871547+0000","last_active":"2024-09-12T18:57:27.457398+0000","last_peered":"2024-09-12T18:57:27.457398+0000","last_clean":"2024-09-12T18:57:27.457398+0000","last_became_active":"2024-09-12T18:19:57.870750+0000","last_became_peered":"2024-09-12T18:19:57.870750+0000","last_unstale":"2024-09-12T18:57:27.457398+0000","last_undegraded":"2024-09-12T18:57:27.457398+0000","last_fullsized":"2024-09-12T18:57:27.457398+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:27.428422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454597+0000","last_change":"2024-09-12T17:59:43.027485+0000","last_active":"2024-09-12T18:57:12.454597+0000","last_peered":"2024-09-12T18:57:12.454597+0000","last_clean":"2024-09-12T18:57:12.454597+0000","last_became_active":"2024-09-12T17:59:43.021777+0000","last_became_peered":"2024-09-12T17:59:43.021777+0000","last_unstale":"2024-09-12T18:57:12.454597+0000","last_undegraded":"2024-09-12T18:57:12.454597+0000","last_fullsized":"2024-09-12T18:57:12.454597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:26.307507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.469779+0000","last_change":"2024-09-12T17:59:38.990405+0000","last_active":"2024-09-12T18:57:12.469779+0000","last_peered":"2024-09-12T18:57:12.469779+0000","last_clean":"2024-09-12T18:57:12.469779+0000","last_became_active":"2024-09-12T17:59:38.989753+0000","last_became_peered":"2024-09-12T17:59:38.989753+0000","last_unstale":"2024-09-12T18:57:12.469779+0000","last_undegraded":"2024-09-12T18:57:12.469779+0000","last_fullsized":"2024-09-12T18:57:12.469779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:31.519684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'22","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.450554+0000","last_change":"2024-09-12T17:55:59.330535+0000","last_active":"2024-09-12T18:56:27.450554+0000","last_peered":"2024-09-12T18:56:27.450554+0000","last_clean":"2024-09-12T18:56:27.450554+0000","last_became_active":"2024-09-12T17:55:59.329792+0000","last_became_peered":"2024-09-12T17:55:59.329792+0000","last_unstale":"2024-09-12T18:56:27.450554+0000","last_undegraded":"2024-09-12T18:56:27.450554+0000","last_fullsized":"2024-09-12T18:56:27.450554+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:50.850228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.461644+0000","last_change":"2024-09-12T18:19:57.868119+0000","last_active":"2024-09-12T18:57:17.461644+0000","last_peered":"2024-09-12T18:57:17.461644+0000","last_clean":"2024-09-12T18:57:17.461644+0000","last_became_active":"2024-09-12T18:19:57.863600+0000","last_became_peered":"2024-09-12T18:19:57.863600+0000","last_unstale":"2024-09-12T18:57:17.461644+0000","last_undegraded":"2024-09-12T18:57:17.461644+0000","last_fullsized":"2024-09-12T18:57:17.461644+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.347599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426455+0000","last_change":"2024-09-12T17:59:43.033456+0000","last_active":"2024-09-12T18:55:17.426455+0000","last_peered":"2024-09-12T18:55:17.426455+0000","last_clean":"2024-09-12T18:55:17.426455+0000","last_became_active":"2024-09-12T17:59:43.031016+0000","last_became_peered":"2024-09-12T17:59:43.031016+0000","last_unstale":"2024-09-12T18:55:17.426455+0000","last_undegraded":"2024-09-12T18:55:17.426455+0000","last_fullsized":"2024-09-12T18:55:17.426455+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:41.898618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:52.618126+0000","last_change":"2024-09-12T17:59:38.966961+0000","last_active":"2024-09-12T18:55:52.618126+0000","last_peered":"2024-09-12T18:55:52.618126+0000","last_clean":"2024-09-12T18:55:52.618126+0000","last_became_active":"2024-09-12T17:59:38.966158+0000","last_became_peered":"2024-09-12T17:59:38.966158+0000","last_unstale":"2024-09-12T18:55:52.618126+0000","last_undegraded":"2024-09-12T18:55:52.618126+0000","last_fullsized":"2024-09-12T18:55:52.618126+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:05.792036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'26","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.460293+0000","last_change":"2024-09-12T17:55:59.367819+0000","last_active":"2024-09-12T18:56:27.460293+0000","last_peered":"2024-09-12T18:56:27.460293+0000","last_clean":"2024-09-12T18:56:27.460293+0000","last_became_active":"2024-09-12T17:55:59.366803+0000","last_became_peered":"2024-09-12T17:55:59.366803+0000","last_unstale":"2024-09-12T18:56:27.460293+0000","last_undegraded":"2024-09-12T18:56:27.460293+0000","last_fullsized":"2024-09-12T18:56:27.460293+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:11.044959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:19.448910+0000","last_change":"2024-09-12T18:19:57.846272+0000","last_active":"2024-09-12T18:57:19.448910+0000","last_peered":"2024-09-12T18:57:19.448910+0000","last_clean":"2024-09-12T18:57:19.448910+0000","last_became_active":"2024-09-12T18:19:57.845474+0000","last_became_peered":"2024-09-12T18:19:57.845474+0000","last_unstale":"2024-09-12T18:57:19.448910+0000","last_undegraded":"2024-09-12T18:57:19.448910+0000","last_fullsized":"2024-09-12T18:57:19.448910+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:36.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437270+0000","last_change":"2024-09-12T17:59:43.034867+0000","last_active":"2024-09-12T18:56:02.437270+0000","last_peered":"2024-09-12T18:56:02.437270+0000","last_clean":"2024-09-12T18:56:02.437270+0000","last_became_active":"2024-09-12T17:59:43.034159+0000","last_became_peered":"2024-09-12T17:59:43.034159+0000","last_unstale":"2024-09-12T18:56:02.437270+0000","last_undegraded":"2024-09-12T18:56:02.437270+0000","last_fullsized":"2024-09-12T18:56:02.437270+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:55.391915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426051+0000","last_change":"2024-09-12T17:59:38.981580+0000","last_active":"2024-09-12T18:55:17.426051+0000","last_peered":"2024-09-12T18:55:17.426051+0000","last_clean":"2024-09-12T18:55:17.426051+0000","last_became_active":"2024-09-12T17:59:38.980797+0000","last_became_peered":"2024-09-12T17:59:38.980797+0000","last_unstale":"2024-09-12T18:55:17.426051+0000","last_undegraded":"2024-09-12T18:55:17.426051+0000","last_fullsized":"2024-09-12T18:55:17.426051+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:47.982971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'6","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442893+0000","last_change":"2024-09-12T17:55:59.367443+0000","last_active":"2024-09-12T18:56:27.442893+0000","last_peered":"2024-09-12T18:56:27.442893+0000","last_clean":"2024-09-12T18:56:27.442893+0000","last_became_active":"2024-09-12T17:55:59.366679+0000","last_became_peered":"2024-09-12T17:55:59.366679+0000","last_unstale":"2024-09-12T18:56:27.442893+0000","last_undegraded":"2024-09-12T18:56:27.442893+0000","last_fullsized":"2024-09-12T18:56:27.442893+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.004334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.454894+0000","last_change":"2024-09-12T18:19:57.841634+0000","last_active":"2024-09-12T18:57:17.454894+0000","last_peered":"2024-09-12T18:57:17.454894+0000","last_clean":"2024-09-12T18:57:17.454894+0000","last_became_active":"2024-09-12T18:19:57.840855+0000","last_became_peered":"2024-09-12T18:19:57.840855+0000","last_unstale":"2024-09-12T18:57:17.454894+0000","last_undegraded":"2024-09-12T18:57:17.454894+0000","last_fullsized":"2024-09-12T18:57:17.454894+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:43.276958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426540+0000","last_change":"2024-09-12T17:59:43.029670+0000","last_active":"2024-09-12T18:55:17.426540+0000","last_peered":"2024-09-12T18:55:17.426540+0000","last_clean":"2024-09-12T18:55:17.426540+0000","last_became_active":"2024-09-12T17:59:43.021538+0000","last_became_peered":"2024-09-12T17:59:43.021538+0000","last_unstale":"2024-09-12T18:55:17.426540+0000","last_undegraded":"2024-09-12T18:55:17.426540+0000","last_fullsized":"2024-09-12T18:55:17.426540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:19.134601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:14.423842+0000","last_change":"2024-09-12T17:59:38.980849+0000","last_active":"2024-09-12T18:55:14.423842+0000","last_peered":"2024-09-12T18:55:14.423842+0000","last_clean":"2024-09-12T18:55:14.423842+0000","last_became_active":"2024-09-12T17:59:38.979939+0000","last_became_peered":"2024-09-12T17:59:38.979939+0000","last_unstale":"2024-09-12T18:55:14.423842+0000","last_undegraded":"2024-09-12T18:55:14.423842+0000","last_fullsized":"2024-09-12T18:55:14.423842+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:42.205852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'36","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:24.438322+0000","last_change":"2024-09-12T17:55:59.331420+0000","last_active":"2024-09-12T18:56:24.438322+0000","last_peered":"2024-09-12T18:56:24.438322+0000","last_clean":"2024-09-12T18:56:24.438322+0000","last_became_active":"2024-09-12T17:55:59.330570+0000","last_became_peered":"2024-09-12T17:55:59.330570+0000","last_unstale":"2024-09-12T18:56:24.438322+0000","last_undegraded":"2024-09-12T18:56:24.438322+0000","last_fullsized":"2024-09-12T18:56:24.438322+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:37.462782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":139,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637308+0000","last_change":"2024-09-12T18:19:57.854199+0000","last_active":"2024-09-12T18:57:17.637308+0000","last_peered":"2024-09-12T18:57:17.637308+0000","last_clean":"2024-09-12T18:57:17.637308+0000","last_became_active":"2024-09-12T18:19:57.853269+0000","last_became_peered":"2024-09-12T18:19:57.853269+0000","last_unstale":"2024-09-12T18:57:17.637308+0000","last_undegraded":"2024-09-12T18:57:17.637308+0000","last_fullsized":"2024-09-12T18:57:17.637308+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:58.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.791801+0000","last_change":"2024-09-12T17:59:43.022601+0000","last_active":"2024-09-12T18:55:17.791801+0000","last_peered":"2024-09-12T18:55:17.791801+0000","last_clean":"2024-09-12T18:55:17.791801+0000","last_became_active":"2024-09-12T17:59:43.020450+0000","last_became_peered":"2024-09-12T17:59:43.020450+0000","last_unstale":"2024-09-12T18:55:17.791801+0000","last_undegraded":"2024-09-12T18:55:17.791801+0000","last_fullsized":"2024-09-12T18:55:17.791801+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:53.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'5","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.444851+0000","last_change":"2024-09-12T17:59:38.983301+0000","last_active":"2024-09-12T18:55:17.444851+0000","last_peered":"2024-09-12T18:55:17.444851+0000","last_clean":"2024-09-12T18:55:17.444851+0000","last_became_active":"2024-09-12T17:59:38.982556+0000","last_became_peered":"2024-09-12T17:59:38.982556+0000","last_unstale":"2024-09-12T18:55:17.444851+0000","last_undegraded":"2024-09-12T18:55:17.444851+0000","last_fullsized":"2024-09-12T18:55:17.444851+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:24.195379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'83","reported_seq":293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450356+0000","last_change":"2024-09-12T17:55:59.364021+0000","last_active":"2024-09-12T18:56:57.450356+0000","last_peered":"2024-09-12T18:56:57.450356+0000","last_clean":"2024-09-12T18:56:57.450356+0000","last_became_active":"2024-09-12T17:55:59.363431+0000","last_became_peered":"2024-09-12T17:55:59.363431+0000","last_unstale":"2024-09-12T18:56:57.450356+0000","last_undegraded":"2024-09-12T18:56:57.450356+0000","last_fullsized":"2024-09-12T18:56:57.450356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.240236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":321,"num_write":127,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439374+0000","last_change":"2024-09-12T18:19:57.836599+0000","last_active":"2024-09-12T18:56:12.439374+0000","last_peered":"2024-09-12T18:56:12.439374+0000","last_clean":"2024-09-12T18:56:12.439374+0000","last_became_active":"2024-09-12T18:19:57.835852+0000","last_became_peered":"2024-09-12T18:19:57.835852+0000","last_unstale":"2024-09-12T18:56:12.439374+0000","last_undegraded":"2024-09-12T18:56:12.439374+0000","last_fullsized":"2024-09-12T18:56:12.439374+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:03.387557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'1","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.441459+0000","last_change":"2024-09-12T17:59:43.024923+0000","last_active":"2024-09-12T18:55:42.441459+0000","last_peered":"2024-09-12T18:55:42.441459+0000","last_clean":"2024-09-12T18:55:42.441459+0000","last_became_active":"2024-09-12T17:59:43.024103+0000","last_became_peered":"2024-09-12T17:59:43.024103+0000","last_unstale":"2024-09-12T18:55:42.441459+0000","last_undegraded":"2024-09-12T18:55:42.441459+0000","last_fullsized":"2024-09-12T18:55:42.441459+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:49.895418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.797325+0000","last_change":"2024-09-12T17:59:38.978753+0000","last_active":"2024-09-12T18:55:42.797325+0000","last_peered":"2024-09-12T18:55:42.797325+0000","last_clean":"2024-09-12T18:55:42.797325+0000","last_became_active":"2024-09-12T17:59:38.978126+0000","last_became_peered":"2024-09-12T17:59:38.978126+0000","last_unstale":"2024-09-12T18:55:42.797325+0000","last_undegraded":"2024-09-12T18:55:42.797325+0000","last_fullsized":"2024-09-12T18:55:42.797325+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:24.186587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'82","reported_seq":334,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446848+0000","last_change":"2024-09-12T17:55:59.364464+0000","last_active":"2024-09-12T18:56:42.446848+0000","last_peered":"2024-09-12T18:56:42.446848+0000","last_clean":"2024-09-12T18:56:42.446848+0000","last_became_active":"2024-09-12T17:55:59.363574+0000","last_became_peered":"2024-09-12T17:55:59.363574+0000","last_unstale":"2024-09-12T18:56:42.446848+0000","last_undegraded":"2024-09-12T18:56:42.446848+0000","last_fullsized":"2024-09-12T18:56:42.446848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:45.008706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":530,"num_read_kb":371,"num_write":118,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456819+0000","last_change":"2024-09-12T18:19:57.847909+0000","last_active":"2024-09-12T18:56:12.456819+0000","last_peered":"2024-09-12T18:56:12.456819+0000","last_clean":"2024-09-12T18:56:12.456819+0000","last_became_active":"2024-09-12T18:19:57.847092+0000","last_became_peered":"2024-09-12T18:19:57.847092+0000","last_unstale":"2024-09-12T18:56:12.456819+0000","last_undegraded":"2024-09-12T18:56:12.456819+0000","last_fullsized":"2024-09-12T18:56:12.456819+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:58.160509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.441383+0000","last_change":"2024-09-12T17:59:43.034884+0000","last_active":"2024-09-12T18:55:42.441383+0000","last_peered":"2024-09-12T18:55:42.441383+0000","last_clean":"2024-09-12T18:55:42.441383+0000","last_became_active":"2024-09-12T17:59:43.034180+0000","last_became_peered":"2024-09-12T17:59:43.034180+0000","last_unstale":"2024-09-12T18:55:42.441383+0000","last_undegraded":"2024-09-12T18:55:42.441383+0000","last_fullsized":"2024-09-12T18:55:42.441383+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:28.291989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.432566+0000","last_change":"2024-09-12T17:59:38.976298+0000","last_active":"2024-09-12T18:55:42.432566+0000","last_peered":"2024-09-12T18:55:42.432566+0000","last_clean":"2024-09-12T18:55:42.432566+0000","last_became_active":"2024-09-12T17:59:38.969338+0000","last_became_peered":"2024-09-12T17:59:38.969338+0000","last_unstale":"2024-09-12T18:55:42.432566+0000","last_undegraded":"2024-09-12T18:55:42.432566+0000","last_fullsized":"2024-09-12T18:55:42.432566+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:06.102519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'36","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463141+0000","last_change":"2024-09-12T17:55:59.357946+0000","last_active":"2024-09-12T18:56:42.463141+0000","last_peered":"2024-09-12T18:56:42.463141+0000","last_clean":"2024-09-12T18:56:42.463141+0000","last_became_active":"2024-09-12T17:55:59.357330+0000","last_became_peered":"2024-09-12T17:55:59.357330+0000","last_unstale":"2024-09-12T18:56:42.463141+0000","last_undegraded":"2024-09-12T18:56:42.463141+0000","last_fullsized":"2024-09-12T18:56:42.463141+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.691647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":130,"num_write":63,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473367+0000","last_change":"2024-09-12T18:19:57.840998+0000","last_active":"2024-09-12T18:57:27.473367+0000","last_peered":"2024-09-12T18:57:27.473367+0000","last_clean":"2024-09-12T18:57:27.473367+0000","last_became_active":"2024-09-12T18:19:57.839696+0000","last_became_peered":"2024-09-12T18:19:57.839696+0000","last_unstale":"2024-09-12T18:57:27.473367+0000","last_undegraded":"2024-09-12T18:57:27.473367+0000","last_fullsized":"2024-09-12T18:57:27.473367+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:36.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.432690+0000","last_change":"2024-09-12T17:59:43.031197+0000","last_active":"2024-09-12T18:55:42.432690+0000","last_peered":"2024-09-12T18:55:42.432690+0000","last_clean":"2024-09-12T18:55:42.432690+0000","last_became_active":"2024-09-12T17:59:43.030490+0000","last_became_peered":"2024-09-12T17:59:43.030490+0000","last_unstale":"2024-09-12T18:55:42.432690+0000","last_undegraded":"2024-09-12T18:55:42.432690+0000","last_fullsized":"2024-09-12T18:55:42.432690+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:07.847587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8972971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":16955,"num_write":3,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"261'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421218+0000","last_change":"2024-09-12T17:59:38.990771+0000","last_active":"2024-09-12T18:55:42.421218+0000","last_peered":"2024-09-12T18:55:42.421218+0000","last_clean":"2024-09-12T18:55:42.421218+0000","last_became_active":"2024-09-12T17:59:38.990212+0000","last_became_peered":"2024-09-12T17:59:38.990212+0000","last_unstale":"2024-09-12T18:55:42.421218+0000","last_undegraded":"2024-09-12T18:55:42.421218+0000","last_fullsized":"2024-09-12T18:55:42.421218+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:13.467525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'28","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.810172+0000","last_change":"2024-09-12T17:55:59.357645+0000","last_active":"2024-09-12T18:56:42.810172+0000","last_peered":"2024-09-12T18:56:42.810172+0000","last_clean":"2024-09-12T18:56:42.810172+0000","last_became_active":"2024-09-12T17:55:59.356838+0000","last_became_peered":"2024-09-12T17:55:59.356838+0000","last_unstale":"2024-09-12T18:56:42.810172+0000","last_undegraded":"2024-09-12T18:56:42.810172+0000","last_fullsized":"2024-09-12T18:56:42.810172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:09.388925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":96,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439310+0000","last_change":"2024-09-12T18:19:57.837873+0000","last_active":"2024-09-12T18:56:12.439310+0000","last_peered":"2024-09-12T18:56:12.439310+0000","last_clean":"2024-09-12T18:56:12.439310+0000","last_became_active":"2024-09-12T18:19:57.837079+0000","last_became_peered":"2024-09-12T18:19:57.837079+0000","last_unstale":"2024-09-12T18:56:12.439310+0000","last_undegraded":"2024-09-12T18:56:12.439310+0000","last_fullsized":"2024-09-12T18:56:12.439310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:28.254760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421187+0000","last_change":"2024-09-12T17:59:43.033009+0000","last_active":"2024-09-12T18:55:42.421187+0000","last_peered":"2024-09-12T18:55:42.421187+0000","last_clean":"2024-09-12T18:55:42.421187+0000","last_became_active":"2024-09-12T17:59:43.032008+0000","last_became_peered":"2024-09-12T17:59:43.032008+0000","last_unstale":"2024-09-12T18:55:42.421187+0000","last_undegraded":"2024-09-12T18:55:42.421187+0000","last_fullsized":"2024-09-12T18:55:42.421187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:48.490537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'4","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.615900+0000","last_change":"2024-09-12T17:59:38.982851+0000","last_active":"2024-09-12T18:55:42.615900+0000","last_peered":"2024-09-12T18:55:42.615900+0000","last_clean":"2024-09-12T18:55:42.615900+0000","last_became_active":"2024-09-12T17:59:38.982037+0000","last_became_peered":"2024-09-12T17:59:38.982037+0000","last_unstale":"2024-09-12T18:55:42.615900+0000","last_undegraded":"2024-09-12T18:55:42.615900+0000","last_fullsized":"2024-09-12T18:55:42.615900+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:27.861115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446599+0000","last_change":"2024-09-12T17:55:59.358325+0000","last_active":"2024-09-12T18:56:42.446599+0000","last_peered":"2024-09-12T18:56:42.446599+0000","last_clean":"2024-09-12T18:56:42.446599+0000","last_became_active":"2024-09-12T17:55:59.357659+0000","last_became_peered":"2024-09-12T17:55:59.357659+0000","last_unstale":"2024-09-12T18:56:42.446599+0000","last_undegraded":"2024-09-12T18:56:42.446599+0000","last_fullsized":"2024-09-12T18:56:42.446599+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:47.942214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":69,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:59.444670+0000","last_change":"2024-09-12T18:19:57.850425+0000","last_active":"2024-09-12T18:56:59.444670+0000","last_peered":"2024-09-12T18:56:59.444670+0000","last_clean":"2024-09-12T18:56:59.444670+0000","last_became_active":"2024-09-12T18:19:57.849682+0000","last_became_peered":"2024-09-12T18:19:57.849682+0000","last_unstale":"2024-09-12T18:56:59.444670+0000","last_undegraded":"2024-09-12T18:56:59.444670+0000","last_fullsized":"2024-09-12T18:56:59.444670+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:20.403776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'1","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436381+0000","last_change":"2024-09-12T17:59:43.027722+0000","last_active":"2024-09-12T18:55:57.436381+0000","last_peered":"2024-09-12T18:55:57.436381+0000","last_clean":"2024-09-12T18:55:57.436381+0000","last_became_active":"2024-09-12T17:59:43.026619+0000","last_became_peered":"2024-09-12T17:59:43.026619+0000","last_unstale":"2024-09-12T18:55:57.436381+0000","last_undegraded":"2024-09-12T18:55:57.436381+0000","last_fullsized":"2024-09-12T18:55:57.436381+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:14.706171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436215+0000","last_change":"2024-09-12T17:59:38.988617+0000","last_active":"2024-09-12T18:55:57.436215+0000","last_peered":"2024-09-12T18:55:57.436215+0000","last_clean":"2024-09-12T18:55:57.436215+0000","last_became_active":"2024-09-12T17:59:38.988028+0000","last_became_peered":"2024-09-12T17:59:38.988028+0000","last_unstale":"2024-09-12T18:55:57.436215+0000","last_undegraded":"2024-09-12T18:55:57.436215+0000","last_fullsized":"2024-09-12T18:55:57.436215+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:44.387070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'56","reported_seq":214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.453486+0000","last_change":"2024-09-12T17:55:59.361430+0000","last_active":"2024-09-12T18:57:07.453486+0000","last_peered":"2024-09-12T18:57:07.453486+0000","last_clean":"2024-09-12T18:57:07.453486+0000","last_became_active":"2024-09-12T17:55:59.360197+0000","last_became_peered":"2024-09-12T17:55:59.360197+0000","last_unstale":"2024-09-12T18:57:07.453486+0000","last_undegraded":"2024-09-12T18:57:07.453486+0000","last_fullsized":"2024-09-12T18:57:07.453486+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:56.611826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":199,"num_write":102,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436067+0000","last_change":"2024-09-12T18:19:57.869950+0000","last_active":"2024-09-12T18:55:57.436067+0000","last_peered":"2024-09-12T18:55:57.436067+0000","last_clean":"2024-09-12T18:55:57.436067+0000","last_became_active":"2024-09-12T18:19:57.869302+0000","last_became_peered":"2024-09-12T18:19:57.869302+0000","last_unstale":"2024-09-12T18:55:57.436067+0000","last_undegraded":"2024-09-12T18:55:57.436067+0000","last_fullsized":"2024-09-12T18:55:57.436067+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:38.615499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436275+0000","last_change":"2024-09-12T17:59:43.034683+0000","last_active":"2024-09-12T18:55:57.436275+0000","last_peered":"2024-09-12T18:55:57.436275+0000","last_clean":"2024-09-12T18:55:57.436275+0000","last_became_active":"2024-09-12T17:59:43.030846+0000","last_became_peered":"2024-09-12T17:59:43.030846+0000","last_unstale":"2024-09-12T18:55:57.436275+0000","last_undegraded":"2024-09-12T18:55:57.436275+0000","last_fullsized":"2024-09-12T18:55:57.436275+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:40.165184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:54.432260+0000","last_change":"2024-09-12T17:59:38.969547+0000","last_active":"2024-09-12T18:55:54.432260+0000","last_peered":"2024-09-12T18:55:54.432260+0000","last_clean":"2024-09-12T18:55:54.432260+0000","last_became_active":"2024-09-12T17:59:38.968775+0000","last_became_peered":"2024-09-12T17:59:38.968775+0000","last_unstale":"2024-09-12T18:55:54.432260+0000","last_undegraded":"2024-09-12T18:55:54.432260+0000","last_fullsized":"2024-09-12T18:55:54.432260+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:07.669336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48431,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":5,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.630374+0000","last_change":"2024-09-12T17:55:59.362984+0000","last_active":"2024-09-12T18:56:47.630374+0000","last_peered":"2024-09-12T18:56:47.630374+0000","last_clean":"2024-09-12T18:56:47.630374+0000","last_became_active":"2024-09-12T17:55:59.358747+0000","last_became_peered":"2024-09-12T17:55:59.358747+0000","last_unstale":"2024-09-12T18:56:47.630374+0000","last_undegraded":"2024-09-12T18:56:47.630374+0000","last_fullsized":"2024-09-12T18:56:47.630374+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:28.675045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.434729+0000","last_change":"2024-09-12T18:19:57.823688+0000","last_active":"2024-09-12T18:56:47.434729+0000","last_peered":"2024-09-12T18:56:47.434729+0000","last_clean":"2024-09-12T18:56:47.434729+0000","last_became_active":"2024-09-12T18:19:57.822958+0000","last_became_peered":"2024-09-12T18:19:57.822958+0000","last_unstale":"2024-09-12T18:56:47.434729+0000","last_undegraded":"2024-09-12T18:56:47.434729+0000","last_fullsized":"2024-09-12T18:56:47.434729+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:54.471704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'4","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447688+0000","last_change":"2024-09-12T17:59:43.007833+0000","last_active":"2024-09-12T18:56:12.447688+0000","last_peered":"2024-09-12T18:56:12.447688+0000","last_clean":"2024-09-12T18:56:12.447688+0000","last_became_active":"2024-09-12T17:59:43.006748+0000","last_became_peered":"2024-09-12T17:59:43.006748+0000","last_unstale":"2024-09-12T18:56:12.447688+0000","last_undegraded":"2024-09-12T18:56:12.447688+0000","last_fullsized":"2024-09-12T18:56:12.447688+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:10.151387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453872+0000","last_change":"2024-09-12T17:59:38.963724+0000","last_active":"2024-09-12T18:55:57.453872+0000","last_peered":"2024-09-12T18:55:57.453872+0000","last_clean":"2024-09-12T18:55:57.453872+0000","last_became_active":"2024-09-12T17:59:38.962944+0000","last_became_peered":"2024-09-12T17:59:38.962944+0000","last_unstale":"2024-09-12T18:55:57.453872+0000","last_undegraded":"2024-09-12T18:55:57.453872+0000","last_fullsized":"2024-09-12T18:55:57.453872+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:57.731165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'30","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.434839+0000","last_change":"2024-09-12T17:55:59.347093+0000","last_active":"2024-09-12T18:56:47.434839+0000","last_peered":"2024-09-12T18:56:47.434839+0000","last_clean":"2024-09-12T18:56:47.434839+0000","last_became_active":"2024-09-12T17:55:59.345735+0000","last_became_peered":"2024-09-12T17:55:59.345735+0000","last_unstale":"2024-09-12T18:56:47.434839+0000","last_undegraded":"2024-09-12T18:56:47.434839+0000","last_fullsized":"2024-09-12T18:56:47.434839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:02.647291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.447954+0000","last_change":"2024-09-12T18:19:57.856472+0000","last_active":"2024-09-12T18:56:47.447954+0000","last_peered":"2024-09-12T18:56:47.447954+0000","last_clean":"2024-09-12T18:56:47.447954+0000","last_became_active":"2024-09-12T18:19:57.855728+0000","last_became_peered":"2024-09-12T18:19:57.855728+0000","last_unstale":"2024-09-12T18:56:47.447954+0000","last_undegraded":"2024-09-12T18:56:47.447954+0000","last_fullsized":"2024-09-12T18:56:47.447954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:06.104974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'1","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436433+0000","last_change":"2024-09-12T17:59:43.020154+0000","last_active":"2024-09-12T18:55:57.436433+0000","last_peered":"2024-09-12T18:55:57.436433+0000","last_clean":"2024-09-12T18:55:57.436433+0000","last_became_active":"2024-09-12T17:59:43.019325+0000","last_became_peered":"2024-09-12T17:59:43.019325+0000","last_unstale":"2024-09-12T18:55:57.436433+0000","last_undegraded":"2024-09-12T18:55:57.436433+0000","last_fullsized":"2024-09-12T18:55:57.436433+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.764700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447641+0000","last_change":"2024-09-12T17:59:38.978392+0000","last_active":"2024-09-12T18:56:12.447641+0000","last_peered":"2024-09-12T18:56:12.447641+0000","last_clean":"2024-09-12T18:56:12.447641+0000","last_became_active":"2024-09-12T17:59:38.977733+0000","last_became_peered":"2024-09-12T17:59:38.977733+0000","last_unstale":"2024-09-12T18:56:12.447641+0000","last_undegraded":"2024-09-12T18:56:12.447641+0000","last_fullsized":"2024-09-12T18:56:12.447641+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:10.294635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'50","reported_seq":197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:44.441874+0000","last_change":"2024-09-12T17:55:59.341871+0000","last_active":"2024-09-12T18:56:44.441874+0000","last_peered":"2024-09-12T18:56:44.441874+0000","last_clean":"2024-09-12T18:56:44.441874+0000","last_became_active":"2024-09-12T17:55:59.341145+0000","last_became_peered":"2024-09-12T17:55:59.341145+0000","last_unstale":"2024-09-12T18:56:44.441874+0000","last_undegraded":"2024-09-12T18:56:44.441874+0000","last_fullsized":"2024-09-12T18:56:44.441874+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:36.782820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":177,"num_write":99,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436472+0000","last_change":"2024-09-12T18:19:57.865840+0000","last_active":"2024-09-12T18:55:57.436472+0000","last_peered":"2024-09-12T18:55:57.436472+0000","last_clean":"2024-09-12T18:55:57.436472+0000","last_became_active":"2024-09-12T18:19:57.865311+0000","last_became_peered":"2024-09-12T18:19:57.865311+0000","last_unstale":"2024-09-12T18:55:57.436472+0000","last_undegraded":"2024-09-12T18:55:57.436472+0000","last_fullsized":"2024-09-12T18:55:57.436472+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:05.947872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'7","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.801680+0000","last_change":"2024-09-12T17:59:43.030010+0000","last_active":"2024-09-12T18:56:02.801680+0000","last_peered":"2024-09-12T18:56:02.801680+0000","last_clean":"2024-09-12T18:56:02.801680+0000","last_became_active":"2024-09-12T17:59:43.029489+0000","last_became_peered":"2024-09-12T17:59:43.029489+0000","last_unstale":"2024-09-12T18:56:02.801680+0000","last_undegraded":"2024-09-12T18:56:02.801680+0000","last_fullsized":"2024-09-12T18:56:02.801680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:49.435494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.454562+0000","last_change":"2024-09-12T17:59:38.976141+0000","last_active":"2024-09-12T18:56:02.454562+0000","last_peered":"2024-09-12T18:56:02.454562+0000","last_clean":"2024-09-12T18:56:02.454562+0000","last_became_active":"2024-09-12T17:59:38.965185+0000","last_became_peered":"2024-09-12T17:59:38.965185+0000","last_unstale":"2024-09-12T18:56:02.454562+0000","last_undegraded":"2024-09-12T18:56:02.454562+0000","last_fullsized":"2024-09-12T18:56:02.454562+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:28.251671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'20","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464249+0000","last_change":"2024-09-12T17:55:59.360413+0000","last_active":"2024-09-12T18:56:47.464249+0000","last_peered":"2024-09-12T18:56:47.464249+0000","last_clean":"2024-09-12T18:56:47.464249+0000","last_became_active":"2024-09-12T17:55:59.359849+0000","last_became_peered":"2024-09-12T17:55:59.359849+0000","last_unstale":"2024-09-12T18:56:47.464249+0000","last_undegraded":"2024-09-12T18:56:47.464249+0000","last_fullsized":"2024-09-12T18:56:47.464249+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:05.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:07.438710+0000","last_change":"2024-09-12T18:19:57.855820+0000","last_active":"2024-09-12T18:56:07.438710+0000","last_peered":"2024-09-12T18:56:07.438710+0000","last_clean":"2024-09-12T18:56:07.438710+0000","last_became_active":"2024-09-12T18:19:57.855140+0000","last_became_peered":"2024-09-12T18:19:57.855140+0000","last_unstale":"2024-09-12T18:56:07.438710+0000","last_undegraded":"2024-09-12T18:56:07.438710+0000","last_fullsized":"2024-09-12T18:56:07.438710+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:19.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437282+0000","last_change":"2024-09-12T17:59:43.016545+0000","last_active":"2024-09-12T18:56:02.437282+0000","last_peered":"2024-09-12T18:56:02.437282+0000","last_clean":"2024-09-12T18:56:02.437282+0000","last_became_active":"2024-09-12T17:59:43.015273+0000","last_became_peered":"2024-09-12T17:59:43.015273+0000","last_unstale":"2024-09-12T18:56:02.437282+0000","last_undegraded":"2024-09-12T18:56:02.437282+0000","last_fullsized":"2024-09-12T18:56:02.437282+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:00.852160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'6","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.445112+0000","last_change":"2024-09-12T17:59:38.985394+0000","last_active":"2024-09-12T18:56:02.445112+0000","last_peered":"2024-09-12T18:56:02.445112+0000","last_clean":"2024-09-12T18:56:02.445112+0000","last_became_active":"2024-09-12T17:59:38.984684+0000","last_became_peered":"2024-09-12T17:59:38.984684+0000","last_unstale":"2024-09-12T18:56:02.445112+0000","last_undegraded":"2024-09-12T18:56:02.445112+0000","last_fullsized":"2024-09-12T18:56:02.445112+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:33.698538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'48","reported_seq":197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450249+0000","last_change":"2024-09-12T17:55:59.346860+0000","last_active":"2024-09-12T18:56:57.450249+0000","last_peered":"2024-09-12T18:56:57.450249+0000","last_clean":"2024-09-12T18:56:57.450249+0000","last_became_active":"2024-09-12T17:55:59.346128+0000","last_became_peered":"2024-09-12T17:55:59.346128+0000","last_unstale":"2024-09-12T18:56:57.450249+0000","last_undegraded":"2024-09-12T18:56:57.450249+0000","last_fullsized":"2024-09-12T18:56:57.450249+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:20.618591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":194,"num_write":71,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436169+0000","last_change":"2024-09-12T18:19:57.851475+0000","last_active":"2024-09-12T18:55:57.436169+0000","last_peered":"2024-09-12T18:55:57.436169+0000","last_clean":"2024-09-12T18:55:57.436169+0000","last_became_active":"2024-09-12T18:19:57.848892+0000","last_became_peered":"2024-09-12T18:19:57.848892+0000","last_unstale":"2024-09-12T18:55:57.436169+0000","last_undegraded":"2024-09-12T18:55:57.436169+0000","last_fullsized":"2024-09-12T18:55:57.436169+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:29.052912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'5","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.444266+0000","last_change":"2024-09-12T17:59:43.038219+0000","last_active":"2024-09-12T18:55:57.444266+0000","last_peered":"2024-09-12T18:55:57.444266+0000","last_clean":"2024-09-12T18:55:57.444266+0000","last_became_active":"2024-09-12T17:59:43.034558+0000","last_became_peered":"2024-09-12T17:59:43.034558+0000","last_unstale":"2024-09-12T18:55:57.444266+0000","last_undegraded":"2024-09-12T18:55:57.444266+0000","last_fullsized":"2024-09-12T18:55:57.444266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:16.222044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.457891+0000","last_change":"2024-09-12T17:59:38.981757+0000","last_active":"2024-09-12T18:56:17.457891+0000","last_peered":"2024-09-12T18:56:17.457891+0000","last_clean":"2024-09-12T18:56:17.457891+0000","last_became_active":"2024-09-12T17:59:38.973403+0000","last_became_peered":"2024-09-12T17:59:38.973403+0000","last_unstale":"2024-09-12T18:56:17.457891+0000","last_undegraded":"2024-09-12T18:56:17.457891+0000","last_fullsized":"2024-09-12T18:56:17.457891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:16.251811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'38","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446643+0000","last_change":"2024-09-12T17:55:59.346585+0000","last_active":"2024-09-12T18:56:42.446643+0000","last_peered":"2024-09-12T18:56:42.446643+0000","last_clean":"2024-09-12T18:56:42.446643+0000","last_became_active":"2024-09-12T17:55:59.345382+0000","last_became_peered":"2024-09-12T17:55:59.345382+0000","last_unstale":"2024-09-12T18:56:42.446643+0000","last_undegraded":"2024-09-12T18:56:42.446643+0000","last_fullsized":"2024-09-12T18:56:42.446643+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:18.100800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":134,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453836+0000","last_change":"2024-09-12T18:19:57.844298+0000","last_active":"2024-09-12T18:55:57.453836+0000","last_peered":"2024-09-12T18:55:57.453836+0000","last_clean":"2024-09-12T18:55:57.453836+0000","last_became_active":"2024-09-12T18:19:57.843489+0000","last_became_peered":"2024-09-12T18:19:57.843489+0000","last_unstale":"2024-09-12T18:55:57.453836+0000","last_undegraded":"2024-09-12T18:55:57.453836+0000","last_fullsized":"2024-09-12T18:55:57.453836+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:30.667507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.440945+0000","last_change":"2024-09-12T17:59:43.023323+0000","last_active":"2024-09-12T18:56:17.440945+0000","last_peered":"2024-09-12T18:56:17.440945+0000","last_clean":"2024-09-12T18:56:17.440945+0000","last_became_active":"2024-09-12T17:59:43.022592+0000","last_became_peered":"2024-09-12T17:59:43.022592+0000","last_unstale":"2024-09-12T18:56:17.440945+0000","last_undegraded":"2024-09-12T18:56:17.440945+0000","last_fullsized":"2024-09-12T18:56:17.440945+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:49.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'3","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800656+0000","last_change":"2024-09-12T17:59:38.976388+0000","last_active":"2024-09-12T18:55:57.800656+0000","last_peered":"2024-09-12T18:55:57.800656+0000","last_clean":"2024-09-12T18:55:57.800656+0000","last_became_active":"2024-09-12T17:59:38.975635+0000","last_became_peered":"2024-09-12T17:59:38.975635+0000","last_unstale":"2024-09-12T18:55:57.800656+0000","last_undegraded":"2024-09-12T18:55:57.800656+0000","last_fullsized":"2024-09-12T18:55:57.800656+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:08.497281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'44","reported_seq":180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433653+0000","last_change":"2024-09-12T17:55:59.352208+0000","last_active":"2024-09-12T18:56:42.433653+0000","last_peered":"2024-09-12T18:56:42.433653+0000","last_clean":"2024-09-12T18:56:42.433653+0000","last_became_active":"2024-09-12T17:55:59.351492+0000","last_became_peered":"2024-09-12T17:55:59.351492+0000","last_unstale":"2024-09-12T18:56:42.433653+0000","last_undegraded":"2024-09-12T18:56:42.433653+0000","last_fullsized":"2024-09-12T18:56:42.433653+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:59.997737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":151,"num_write":82,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457255+0000","last_change":"2024-09-12T18:19:57.856229+0000","last_active":"2024-09-12T18:57:27.457255+0000","last_peered":"2024-09-12T18:57:27.457255+0000","last_clean":"2024-09-12T18:57:27.457255+0000","last_became_active":"2024-09-12T18:19:57.855547+0000","last_became_peered":"2024-09-12T18:19:57.855547+0000","last_unstale":"2024-09-12T18:57:27.457255+0000","last_undegraded":"2024-09-12T18:57:27.457255+0000","last_fullsized":"2024-09-12T18:57:27.457255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:07.356723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'9","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456706+0000","last_change":"2024-09-12T17:59:43.010558+0000","last_active":"2024-09-12T18:56:12.456706+0000","last_peered":"2024-09-12T18:56:12.456706+0000","last_clean":"2024-09-12T18:56:12.456706+0000","last_became_active":"2024-09-12T17:59:43.009629+0000","last_became_peered":"2024-09-12T17:59:43.009629+0000","last_unstale":"2024-09-12T18:56:12.456706+0000","last_undegraded":"2024-09-12T18:56:12.456706+0000","last_fullsized":"2024-09-12T18:56:12.456706+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:57.722700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":19,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436134+0000","last_change":"2024-09-12T17:59:38.980397+0000","last_active":"2024-09-12T18:55:57.436134+0000","last_peered":"2024-09-12T18:55:57.436134+0000","last_clean":"2024-09-12T18:55:57.436134+0000","last_became_active":"2024-09-12T17:59:38.979704+0000","last_became_peered":"2024-09-12T17:59:38.979704+0000","last_unstale":"2024-09-12T18:55:57.436134+0000","last_undegraded":"2024-09-12T18:55:57.436134+0000","last_fullsized":"2024-09-12T18:55:57.436134+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:15.520490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463327+0000","last_change":"2024-09-12T17:55:59.357098+0000","last_active":"2024-09-12T18:56:42.463327+0000","last_peered":"2024-09-12T18:56:42.463327+0000","last_clean":"2024-09-12T18:56:42.463327+0000","last_became_active":"2024-09-12T17:55:59.356402+0000","last_became_peered":"2024-09-12T17:55:59.356402+0000","last_unstale":"2024-09-12T18:56:42.463327+0000","last_undegraded":"2024-09-12T18:56:42.463327+0000","last_fullsized":"2024-09-12T18:56:42.463327+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:21.680579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639954+0000","last_change":"2024-09-12T18:19:57.860245+0000","last_active":"2024-09-12T18:57:27.639954+0000","last_peered":"2024-09-12T18:57:27.639954+0000","last_clean":"2024-09-12T18:57:27.639954+0000","last_became_active":"2024-09-12T18:19:57.859591+0000","last_became_peered":"2024-09-12T18:19:57.859591+0000","last_unstale":"2024-09-12T18:57:27.639954+0000","last_undegraded":"2024-09-12T18:57:27.639954+0000","last_fullsized":"2024-09-12T18:57:27.639954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:28.131141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453794+0000","last_change":"2024-09-12T17:59:43.009259+0000","last_active":"2024-09-12T18:55:57.453794+0000","last_peered":"2024-09-12T18:55:57.453794+0000","last_clean":"2024-09-12T18:55:57.453794+0000","last_became_active":"2024-09-12T17:59:43.008547+0000","last_became_peered":"2024-09-12T17:59:43.008547+0000","last_unstale":"2024-09-12T18:55:57.453794+0000","last_undegraded":"2024-09-12T18:55:57.453794+0000","last_fullsized":"2024-09-12T18:55:57.453794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:53.908690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:09.435251+0000","last_change":"2024-09-12T17:59:38.969392+0000","last_active":"2024-09-12T18:56:09.435251+0000","last_peered":"2024-09-12T18:56:09.435251+0000","last_clean":"2024-09-12T18:56:09.435251+0000","last_became_active":"2024-09-12T17:59:38.968249+0000","last_became_peered":"2024-09-12T17:59:38.968249+0000","last_unstale":"2024-09-12T18:56:09.435251+0000","last_undegraded":"2024-09-12T18:56:09.435251+0000","last_fullsized":"2024-09-12T18:56:09.435251+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.740724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'17","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433857+0000","last_change":"2024-09-12T17:55:59.355112+0000","last_active":"2024-09-12T18:56:42.433857+0000","last_peered":"2024-09-12T18:56:42.433857+0000","last_clean":"2024-09-12T18:56:42.433857+0000","last_became_active":"2024-09-12T17:55:59.354383+0000","last_became_peered":"2024-09-12T17:55:59.354383+0000","last_unstale":"2024-09-12T18:56:42.433857+0000","last_undegraded":"2024-09-12T18:56:42.433857+0000","last_fullsized":"2024-09-12T18:56:42.433857+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:12.015628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:07.446185+0000","last_change":"2024-09-12T18:19:57.864592+0000","last_active":"2024-09-12T18:56:07.446185+0000","last_peered":"2024-09-12T18:56:07.446185+0000","last_clean":"2024-09-12T18:56:07.446185+0000","last_became_active":"2024-09-12T18:19:57.858987+0000","last_became_peered":"2024-09-12T18:19:57.858987+0000","last_unstale":"2024-09-12T18:56:07.446185+0000","last_undegraded":"2024-09-12T18:56:07.446185+0000","last_fullsized":"2024-09-12T18:56:07.446185+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:30.509797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437573+0000","last_change":"2024-09-12T17:59:43.023426+0000","last_active":"2024-09-12T18:56:02.437573+0000","last_peered":"2024-09-12T18:56:02.437573+0000","last_clean":"2024-09-12T18:56:02.437573+0000","last_became_active":"2024-09-12T17:59:43.022405+0000","last_became_peered":"2024-09-12T17:59:43.022405+0000","last_unstale":"2024-09-12T18:56:02.437573+0000","last_undegraded":"2024-09-12T18:56:02.437573+0000","last_fullsized":"2024-09-12T18:56:02.437573+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:15.217520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":12356,"num_write":7,"num_write_kb":8260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.620294+0000","last_change":"2024-09-12T17:59:38.966348+0000","last_active":"2024-09-12T18:56:02.620294+0000","last_peered":"2024-09-12T18:56:02.620294+0000","last_clean":"2024-09-12T18:56:02.620294+0000","last_became_active":"2024-09-12T17:59:38.964439+0000","last_became_peered":"2024-09-12T17:59:38.964439+0000","last_unstale":"2024-09-12T18:56:02.620294+0000","last_undegraded":"2024-09-12T18:56:02.620294+0000","last_fullsized":"2024-09-12T18:56:02.620294+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:16.500555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1069,"num_write":3,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'113","reported_seq":414,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446927+0000","last_change":"2024-09-12T17:55:59.361437+0000","last_active":"2024-09-12T18:56:42.446927+0000","last_peered":"2024-09-12T18:56:42.446927+0000","last_clean":"2024-09-12T18:56:42.446927+0000","last_became_active":"2024-09-12T17:55:59.360296+0000","last_became_peered":"2024-09-12T17:55:59.360296+0000","last_unstale":"2024-09-12T18:56:42.446927+0000","last_undegraded":"2024-09-12T18:56:42.446927+0000","last_fullsized":"2024-09-12T18:56:42.446927+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:54.893983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":493,"num_write":148,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.819989+0000","last_change":"2024-09-12T18:19:57.871333+0000","last_active":"2024-09-12T18:57:27.819989+0000","last_peered":"2024-09-12T18:57:27.819989+0000","last_clean":"2024-09-12T18:57:27.819989+0000","last_became_active":"2024-09-12T18:19:57.870563+0000","last_became_peered":"2024-09-12T18:19:57.870563+0000","last_unstale":"2024-09-12T18:57:27.819989+0000","last_undegraded":"2024-09-12T18:57:27.819989+0000","last_fullsized":"2024-09-12T18:57:27.819989+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:12.142130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.801846+0000","last_change":"2024-09-12T17:59:43.019692+0000","last_active":"2024-09-12T18:56:02.801846+0000","last_peered":"2024-09-12T18:56:02.801846+0000","last_clean":"2024-09-12T18:56:02.801846+0000","last_became_active":"2024-09-12T17:59:43.018869+0000","last_became_peered":"2024-09-12T17:59:43.018869+0000","last_unstale":"2024-09-12T18:56:02.801846+0000","last_undegraded":"2024-09-12T18:56:02.801846+0000","last_fullsized":"2024-09-12T18:56:02.801846+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:27.333833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'1","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437605+0000","last_change":"2024-09-12T17:59:38.989030+0000","last_active":"2024-09-12T18:56:02.437605+0000","last_peered":"2024-09-12T18:56:02.437605+0000","last_clean":"2024-09-12T18:56:02.437605+0000","last_became_active":"2024-09-12T17:59:38.988237+0000","last_became_peered":"2024-09-12T17:59:38.988237+0000","last_unstale":"2024-09-12T18:56:02.437605+0000","last_undegraded":"2024-09-12T18:56:02.437605+0000","last_fullsized":"2024-09-12T18:56:02.437605+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:13.770105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'6","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.450666+0000","last_change":"2024-09-12T17:55:59.354590+0000","last_active":"2024-09-12T18:56:27.450666+0000","last_peered":"2024-09-12T18:56:27.450666+0000","last_clean":"2024-09-12T18:56:27.450666+0000","last_became_active":"2024-09-12T17:55:59.353823+0000","last_became_peered":"2024-09-12T17:55:59.353823+0000","last_unstale":"2024-09-12T18:56:27.450666+0000","last_undegraded":"2024-09-12T18:56:27.450666+0000","last_fullsized":"2024-09-12T18:56:27.450666+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:54.453586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:49.442825+0000","last_change":"2024-09-12T18:19:57.840515+0000","last_active":"2024-09-12T18:56:49.442825+0000","last_peered":"2024-09-12T18:56:49.442825+0000","last_clean":"2024-09-12T18:56:49.442825+0000","last_became_active":"2024-09-12T18:19:57.839756+0000","last_became_peered":"2024-09-12T18:19:57.839756+0000","last_unstale":"2024-09-12T18:56:49.442825+0000","last_undegraded":"2024-09-12T18:56:49.442825+0000","last_fullsized":"2024-09-12T18:56:49.442825+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:01.658644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.444196+0000","last_change":"2024-09-12T17:59:43.038905+0000","last_active":"2024-09-12T18:55:57.444196+0000","last_peered":"2024-09-12T18:55:57.444196+0000","last_clean":"2024-09-12T18:55:57.444196+0000","last_became_active":"2024-09-12T17:59:43.033049+0000","last_became_peered":"2024-09-12T17:59:43.033049+0000","last_unstale":"2024-09-12T18:55:57.444196+0000","last_undegraded":"2024-09-12T18:55:57.444196+0000","last_fullsized":"2024-09-12T18:55:57.444196+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:33.443562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'9","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464697+0000","last_change":"2024-09-12T17:59:38.986578+0000","last_active":"2024-09-12T18:57:57.464697+0000","last_peered":"2024-09-12T18:57:57.464697+0000","last_clean":"2024-09-12T18:57:57.464697+0000","last_became_active":"2024-09-12T17:59:38.985971+0000","last_became_peered":"2024-09-12T17:59:38.985971+0000","last_unstale":"2024-09-12T18:57:57.464697+0000","last_undegraded":"2024-09-12T18:57:57.464697+0000","last_fullsized":"2024-09-12T18:57:57.464697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:41.717343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'13","reported_seq":101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.625796+0000","last_change":"2024-09-12T17:55:59.358658+0000","last_active":"2024-09-12T18:56:27.625796+0000","last_peered":"2024-09-12T18:56:27.625796+0000","last_clean":"2024-09-12T18:56:27.625796+0000","last_became_active":"2024-09-12T17:55:59.352474+0000","last_became_peered":"2024-09-12T17:55:59.352474+0000","last_unstale":"2024-09-12T18:56:27.625796+0000","last_undegraded":"2024-09-12T18:56:27.625796+0000","last_fullsized":"2024-09-12T18:56:27.625796+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:54.466534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464409+0000","last_change":"2024-09-12T18:19:57.847713+0000","last_active":"2024-09-12T18:56:47.464409+0000","last_peered":"2024-09-12T18:56:47.464409+0000","last_clean":"2024-09-12T18:56:47.464409+0000","last_became_active":"2024-09-12T18:19:57.846907+0000","last_became_peered":"2024-09-12T18:19:57.846907+0000","last_unstale":"2024-09-12T18:56:47.464409+0000","last_undegraded":"2024-09-12T18:56:47.464409+0000","last_fullsized":"2024-09-12T18:56:47.464409+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:30.600770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'11","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:52.656029+0000","last_change":"2024-09-12T17:59:43.023811+0000","last_active":"2024-09-12T18:57:52.656029+0000","last_peered":"2024-09-12T18:57:52.656029+0000","last_clean":"2024-09-12T18:57:52.656029+0000","last_became_active":"2024-09-12T17:59:43.022991+0000","last_became_peered":"2024-09-12T17:59:43.022991+0000","last_unstale":"2024-09-12T18:57:52.656029+0000","last_undegraded":"2024-09-12T18:57:52.656029+0000","last_fullsized":"2024-09-12T18:57:52.656029+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:41.803212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20482,"num_write":21,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'1","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.435949+0000","last_change":"2024-09-12T17:59:38.990278+0000","last_active":"2024-09-12T18:55:57.435949+0000","last_peered":"2024-09-12T18:55:57.435949+0000","last_clean":"2024-09-12T18:55:57.435949+0000","last_became_active":"2024-09-12T17:59:38.989530+0000","last_became_peered":"2024-09-12T17:59:38.989530+0000","last_unstale":"2024-09-12T18:55:57.435949+0000","last_undegraded":"2024-09-12T18:55:57.435949+0000","last_fullsized":"2024-09-12T18:55:57.435949+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:27.646889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'9","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.807160+0000","last_change":"2024-09-12T17:55:59.345043+0000","last_active":"2024-09-12T18:56:27.807160+0000","last_peered":"2024-09-12T18:56:27.807160+0000","last_clean":"2024-09-12T18:56:27.807160+0000","last_became_active":"2024-09-12T17:55:59.344251+0000","last_became_peered":"2024-09-12T17:55:59.344251+0000","last_unstale":"2024-09-12T18:56:27.807160+0000","last_undegraded":"2024-09-12T18:56:27.807160+0000","last_fullsized":"2024-09-12T18:56:27.807160+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:29.508189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473350+0000","last_change":"2024-09-12T18:19:57.848079+0000","last_active":"2024-09-12T18:57:27.473350+0000","last_peered":"2024-09-12T18:57:27.473350+0000","last_clean":"2024-09-12T18:57:27.473350+0000","last_became_active":"2024-09-12T18:19:57.847330+0000","last_became_peered":"2024-09-12T18:19:57.847330+0000","last_unstale":"2024-09-12T18:57:27.473350+0000","last_undegraded":"2024-09-12T18:57:27.473350+0000","last_fullsized":"2024-09-12T18:57:27.473350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:06.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'3","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.424284+0000","last_change":"2024-09-12T17:59:43.028989+0000","last_active":"2024-09-12T18:55:57.424284+0000","last_peered":"2024-09-12T18:55:57.424284+0000","last_clean":"2024-09-12T18:55:57.424284+0000","last_became_active":"2024-09-12T17:59:43.028305+0000","last_became_peered":"2024-09-12T17:59:43.028305+0000","last_unstale":"2024-09-12T18:55:57.424284+0000","last_undegraded":"2024-09-12T18:55:57.424284+0000","last_fullsized":"2024-09-12T18:55:57.424284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:37.271016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.444237+0000","last_change":"2024-09-12T17:59:38.987789+0000","last_active":"2024-09-12T18:55:57.444237+0000","last_peered":"2024-09-12T18:55:57.444237+0000","last_clean":"2024-09-12T18:55:57.444237+0000","last_became_active":"2024-09-12T17:59:38.986062+0000","last_became_peered":"2024-09-12T17:59:38.986062+0000","last_unstale":"2024-09-12T18:55:57.444237+0000","last_undegraded":"2024-09-12T18:55:57.444237+0000","last_fullsized":"2024-09-12T18:55:57.444237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:17.162069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'31","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.430557+0000","last_change":"2024-09-12T17:55:59.346330+0000","last_active":"2024-09-12T18:56:27.430557+0000","last_peered":"2024-09-12T18:56:27.430557+0000","last_clean":"2024-09-12T18:56:27.430557+0000","last_became_active":"2024-09-12T17:55:59.345469+0000","last_became_peered":"2024-09-12T17:55:59.345469+0000","last_unstale":"2024-09-12T18:56:27.430557+0000","last_undegraded":"2024-09-12T18:56:27.430557+0000","last_fullsized":"2024-09-12T18:56:27.430557+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:40.512299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":47,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.459721+0000","last_change":"2024-09-12T18:19:57.845031+0000","last_active":"2024-09-12T18:57:37.459721+0000","last_peered":"2024-09-12T18:57:37.459721+0000","last_clean":"2024-09-12T18:57:37.459721+0000","last_became_active":"2024-09-12T18:19:57.844161+0000","last_became_peered":"2024-09-12T18:19:57.844161+0000","last_unstale":"2024-09-12T18:57:37.459721+0000","last_undegraded":"2024-09-12T18:57:37.459721+0000","last_fullsized":"2024-09-12T18:57:37.459721+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:42.398579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800569+0000","last_change":"2024-09-12T17:59:43.020614+0000","last_active":"2024-09-12T18:55:57.800569+0000","last_peered":"2024-09-12T18:55:57.800569+0000","last_clean":"2024-09-12T18:55:57.800569+0000","last_became_active":"2024-09-12T17:59:43.019274+0000","last_became_peered":"2024-09-12T17:59:43.019274+0000","last_unstale":"2024-09-12T18:55:57.800569+0000","last_undegraded":"2024-09-12T18:55:57.800569+0000","last_fullsized":"2024-09-12T18:55:57.800569+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:20.608735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'6","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.424329+0000","last_change":"2024-09-12T17:59:38.969202+0000","last_active":"2024-09-12T18:55:57.424329+0000","last_peered":"2024-09-12T18:55:57.424329+0000","last_clean":"2024-09-12T18:55:57.424329+0000","last_became_active":"2024-09-12T17:59:38.968500+0000","last_became_peered":"2024-09-12T17:59:38.968500+0000","last_unstale":"2024-09-12T18:55:57.424329+0000","last_undegraded":"2024-09-12T18:55:57.424329+0000","last_fullsized":"2024-09-12T18:55:57.424329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:19.956318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4242729,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":16,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.440783+0000","last_change":"2024-09-12T17:55:59.355326+0000","last_active":"2024-09-12T18:56:17.440783+0000","last_peered":"2024-09-12T18:56:17.440783+0000","last_clean":"2024-09-12T18:56:17.440783+0000","last_became_active":"2024-09-12T17:55:59.354620+0000","last_became_peered":"2024-09-12T17:55:59.354620+0000","last_unstale":"2024-09-12T18:56:17.440783+0000","last_undegraded":"2024-09-12T18:56:17.440783+0000","last_fullsized":"2024-09-12T18:56:17.440783+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:05.701171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":145,"num_write":78,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'318","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457452+0000","last_change":"2024-09-12T17:40:18.786112+0000","last_active":"2024-09-12T18:57:27.457452+0000","last_peered":"2024-09-12T18:57:27.457452+0000","last_clean":"2024-09-12T18:57:27.457452+0000","last_became_active":"2024-09-12T17:40:18.784159+0000","last_became_peered":"2024-09-12T17:40:18.784159+0000","last_unstale":"2024-09-12T18:57:27.457452+0000","last_undegraded":"2024-09-12T18:57:27.457452+0000","last_fullsized":"2024-09-12T18:57:27.457452+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:09.077635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13398493,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":458,"num_read_kb":37913,"num_write":1138,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'93","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.611092+0000","last_change":"2024-09-12T17:40:20.139437+0000","last_active":"2024-09-12T18:55:22.611092+0000","last_peered":"2024-09-12T18:55:22.611092+0000","last_clean":"2024-09-12T18:55:22.611092+0000","last_became_active":"2024-09-12T17:40:20.138680+0000","last_became_peered":"2024-09-12T17:40:20.138680+0000","last_unstale":"2024-09-12T18:55:22.611092+0000","last_undegraded":"2024-09-12T18:55:22.611092+0000","last_fullsized":"2024-09-12T18:55:22.611092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:20.357774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'253","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:21.882505+0000","last_change":"2024-09-12T17:40:18.761793+0000","last_active":"2024-09-12T18:59:21.882505+0000","last_peered":"2024-09-12T18:59:21.882505+0000","last_clean":"2024-09-12T18:59:21.882505+0000","last_became_active":"2024-09-12T17:40:18.761214+0000","last_became_peered":"2024-09-12T17:40:18.761214+0000","last_unstale":"2024-09-12T18:59:21.882505+0000","last_undegraded":"2024-09-12T18:59:21.882505+0000","last_fullsized":"2024-09-12T18:59:21.882505+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:52.345302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9324513,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":409,"num_read_kb":37090,"num_write":889,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'255","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:19.678404+0000","last_change":"2024-09-12T17:40:20.134527+0000","last_active":"2024-09-12T18:56:19.678404+0000","last_peered":"2024-09-12T18:56:19.678404+0000","last_clean":"2024-09-12T18:56:19.678404+0000","last_became_active":"2024-09-12T17:40:20.133791+0000","last_became_peered":"2024-09-12T17:40:20.133791+0000","last_unstale":"2024-09-12T18:56:19.678404+0000","last_undegraded":"2024-09-12T18:56:19.678404+0000","last_fullsized":"2024-09-12T18:56:19.678404+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:41.729662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1087,"num_read_kb":867,"num_write":420,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'326","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:25.636751+0000","last_change":"2024-09-12T17:40:18.757584+0000","last_active":"2024-09-12T18:59:25.636751+0000","last_peered":"2024-09-12T18:59:25.636751+0000","last_clean":"2024-09-12T18:59:25.636751+0000","last_became_active":"2024-09-12T17:40:18.755606+0000","last_became_peered":"2024-09-12T17:40:18.755606+0000","last_unstale":"2024-09-12T18:59:25.636751+0000","last_undegraded":"2024-09-12T18:59:25.636751+0000","last_fullsized":"2024-09-12T18:59:25.636751+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:15.359537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17736649,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":495,"num_read_kb":26527,"num_write":1202,"num_write_kb":46376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'130","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.375203+0000","last_change":"2024-09-12T17:40:20.130876+0000","last_active":"2024-09-12T18:58:04.375203+0000","last_peered":"2024-09-12T18:58:04.375203+0000","last_clean":"2024-09-12T18:58:04.375203+0000","last_became_active":"2024-09-12T17:40:20.130123+0000","last_became_peered":"2024-09-12T17:40:20.130123+0000","last_unstale":"2024-09-12T18:58:04.375203+0000","last_undegraded":"2024-09-12T18:58:04.375203+0000","last_fullsized":"2024-09-12T18:58:04.375203+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:31.564674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":589,"num_read_kb":499,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'285","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.106105+0000","last_change":"2024-09-12T17:40:18.768963+0000","last_active":"2024-09-12T18:57:45.106105+0000","last_peered":"2024-09-12T18:57:45.106105+0000","last_clean":"2024-09-12T18:57:45.106105+0000","last_became_active":"2024-09-12T17:40:18.768170+0000","last_became_peered":"2024-09-12T17:40:18.768170+0000","last_unstale":"2024-09-12T18:57:45.106105+0000","last_undegraded":"2024-09-12T18:57:45.106105+0000","last_fullsized":"2024-09-12T18:57:45.106105+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:12.117915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19926609,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":485,"num_read_kb":59190,"num_write":1153,"num_write_kb":44467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'100","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.445911+0000","last_change":"2024-09-12T17:40:20.115278+0000","last_active":"2024-09-12T18:55:22.445911+0000","last_peered":"2024-09-12T18:55:22.445911+0000","last_clean":"2024-09-12T18:55:22.445911+0000","last_became_active":"2024-09-12T17:40:20.114923+0000","last_became_peered":"2024-09-12T17:40:20.114923+0000","last_unstale":"2024-09-12T18:55:22.445911+0000","last_undegraded":"2024-09-12T18:55:22.445911+0000","last_fullsized":"2024-09-12T18:55:22.445911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:28.492838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":408,"num_write":151,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'251","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427198+0000","last_change":"2024-09-12T17:40:18.779851+0000","last_active":"2024-09-12T18:55:22.427198+0000","last_peered":"2024-09-12T18:55:22.427198+0000","last_clean":"2024-09-12T18:55:22.427198+0000","last_became_active":"2024-09-12T17:40:18.778991+0000","last_became_peered":"2024-09-12T17:40:18.778991+0000","last_unstale":"2024-09-12T18:55:22.427198+0000","last_undegraded":"2024-09-12T18:55:22.427198+0000","last_fullsized":"2024-09-12T18:55:22.427198+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:35.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4458351,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":389,"num_read_kb":19943,"num_write":925,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'100","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433806+0000","last_change":"2024-09-12T17:40:20.128328+0000","last_active":"2024-09-12T18:56:42.433806+0000","last_peered":"2024-09-12T18:56:42.433806+0000","last_clean":"2024-09-12T18:56:42.433806+0000","last_became_active":"2024-09-12T17:40:20.127556+0000","last_became_peered":"2024-09-12T17:40:20.127556+0000","last_unstale":"2024-09-12T18:56:42.433806+0000","last_undegraded":"2024-09-12T18:56:42.433806+0000","last_fullsized":"2024-09-12T18:56:42.433806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:12.259064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":458,"num_read_kb":378,"num_write":157,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'305","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.611191+0000","last_change":"2024-09-12T17:40:18.761760+0000","last_active":"2024-09-12T18:55:22.611191+0000","last_peered":"2024-09-12T18:55:22.611191+0000","last_clean":"2024-09-12T18:55:22.611191+0000","last_became_active":"2024-09-12T17:40:18.760958+0000","last_became_peered":"2024-09-12T17:40:18.760958+0000","last_unstale":"2024-09-12T18:55:22.611191+0000","last_undegraded":"2024-09-12T18:55:22.611191+0000","last_fullsized":"2024-09-12T18:55:22.611191+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:50.452114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4848723,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":425,"num_read_kb":8660,"num_write":1143,"num_write_kb":27182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'123","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820225+0000","last_change":"2024-09-12T17:40:20.136587+0000","last_active":"2024-09-12T18:57:27.820225+0000","last_peered":"2024-09-12T18:57:27.820225+0000","last_clean":"2024-09-12T18:57:27.820225+0000","last_became_active":"2024-09-12T17:40:20.132985+0000","last_became_peered":"2024-09-12T17:40:20.132985+0000","last_unstale":"2024-09-12T18:57:27.820225+0000","last_undegraded":"2024-09-12T18:57:27.820225+0000","last_fullsized":"2024-09-12T18:57:27.820225+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:46.649354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":462,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'332","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.238876+0000","last_change":"2024-09-12T17:40:18.761925+0000","last_active":"2024-09-12T18:57:17.238876+0000","last_peered":"2024-09-12T18:57:17.238876+0000","last_clean":"2024-09-12T18:57:17.238876+0000","last_became_active":"2024-09-12T17:40:18.761056+0000","last_became_peered":"2024-09-12T17:40:18.761056+0000","last_unstale":"2024-09-12T18:57:17.238876+0000","last_undegraded":"2024-09-12T18:57:17.238876+0000","last_fullsized":"2024-09-12T18:57:17.238876+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:43.265328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7453140,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":564,"num_read_kb":74800,"num_write":1167,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'208","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.640055+0000","last_change":"2024-09-12T17:40:20.135326+0000","last_active":"2024-09-12T18:57:27.640055+0000","last_peered":"2024-09-12T18:57:27.640055+0000","last_clean":"2024-09-12T18:57:27.640055+0000","last_became_active":"2024-09-12T17:40:20.134441+0000","last_became_peered":"2024-09-12T17:40:20.134441+0000","last_unstale":"2024-09-12T18:57:27.640055+0000","last_undegraded":"2024-09-12T18:57:27.640055+0000","last_fullsized":"2024-09-12T18:57:27.640055+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:29.851316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":897,"num_read_kb":734,"num_write":311,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'303","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:20.928833+0000","last_change":"2024-09-12T17:40:18.774112+0000","last_active":"2024-09-12T18:59:20.928833+0000","last_peered":"2024-09-12T18:59:20.928833+0000","last_clean":"2024-09-12T18:59:20.928833+0000","last_became_active":"2024-09-12T17:40:18.773843+0000","last_became_peered":"2024-09-12T17:40:18.773843+0000","last_unstale":"2024-09-12T18:59:20.928833+0000","last_undegraded":"2024-09-12T18:59:20.928833+0000","last_fullsized":"2024-09-12T18:59:20.928833+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:24.163598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9058338,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":567,"num_read_kb":30255,"num_write":1096,"num_write_kb":52642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'233","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:24.450044+0000","last_change":"2024-09-12T17:40:20.122021+0000","last_active":"2024-09-12T18:57:24.450044+0000","last_peered":"2024-09-12T18:57:24.450044+0000","last_clean":"2024-09-12T18:57:24.450044+0000","last_became_active":"2024-09-12T17:40:20.120891+0000","last_became_peered":"2024-09-12T17:40:20.120891+0000","last_unstale":"2024-09-12T18:57:24.450044+0000","last_undegraded":"2024-09-12T18:57:24.450044+0000","last_fullsized":"2024-09-12T18:57:24.450044+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:49.408719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":858,"num_write":384,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'192","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.818850+0000","last_change":"2024-09-12T17:40:20.135279+0000","last_active":"2024-09-12T18:57:22.818850+0000","last_peered":"2024-09-12T18:57:22.818850+0000","last_clean":"2024-09-12T18:57:22.818850+0000","last_became_active":"2024-09-12T17:40:20.132466+0000","last_became_peered":"2024-09-12T17:40:20.132466+0000","last_unstale":"2024-09-12T18:57:22.818850+0000","last_undegraded":"2024-09-12T18:57:22.818850+0000","last_fullsized":"2024-09-12T18:57:22.818850+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:47.393866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":674,"num_write":287,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'262","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:32.430208+0000","last_change":"2024-09-12T17:40:18.784241+0000","last_active":"2024-09-12T18:55:32.430208+0000","last_peered":"2024-09-12T18:55:32.430208+0000","last_clean":"2024-09-12T18:55:32.430208+0000","last_became_active":"2024-09-12T17:40:18.783282+0000","last_became_peered":"2024-09-12T17:40:18.783282+0000","last_unstale":"2024-09-12T18:55:32.430208+0000","last_undegraded":"2024-09-12T18:55:32.430208+0000","last_fullsized":"2024-09-12T18:55:32.430208+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:11.061277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14708958,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":334,"num_read_kb":17792,"num_write":943,"num_write_kb":32630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'128","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456078+0000","last_change":"2024-09-12T17:40:20.144162+0000","last_active":"2024-09-12T18:57:22.456078+0000","last_peered":"2024-09-12T18:57:22.456078+0000","last_clean":"2024-09-12T18:57:22.456078+0000","last_became_active":"2024-09-12T17:40:20.143471+0000","last_became_peered":"2024-09-12T17:40:20.143471+0000","last_unstale":"2024-09-12T18:57:22.456078+0000","last_undegraded":"2024-09-12T18:57:22.456078+0000","last_fullsized":"2024-09-12T18:57:22.456078+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:17.136156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":544,"num_read_kb":441,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'246","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.415871+0000","last_change":"2024-09-12T17:40:18.758730+0000","last_active":"2024-09-12T18:55:17.415871+0000","last_peered":"2024-09-12T18:55:17.415871+0000","last_clean":"2024-09-12T18:55:17.415871+0000","last_became_active":"2024-09-12T17:40:18.756814+0000","last_became_peered":"2024-09-12T17:40:18.756814+0000","last_unstale":"2024-09-12T18:55:17.415871+0000","last_undegraded":"2024-09-12T18:55:17.415871+0000","last_fullsized":"2024-09-12T18:55:17.415871+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:55.503868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486581,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":345,"num_read_kb":9609,"num_write":926,"num_write_kb":28982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'86","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.642204+0000","last_change":"2024-09-12T17:40:20.124840+0000","last_active":"2024-09-12T18:57:37.642204+0000","last_peered":"2024-09-12T18:57:37.642204+0000","last_clean":"2024-09-12T18:57:37.642204+0000","last_became_active":"2024-09-12T17:40:20.124104+0000","last_became_peered":"2024-09-12T17:40:20.124104+0000","last_unstale":"2024-09-12T18:57:37.642204+0000","last_undegraded":"2024-09-12T18:57:37.642204+0000","last_fullsized":"2024-09-12T18:57:37.642204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:12.896981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":294,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'334","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:47.914801+0000","last_change":"2024-09-12T17:40:18.774434+0000","last_active":"2024-09-12T18:55:47.914801+0000","last_peered":"2024-09-12T18:55:47.914801+0000","last_clean":"2024-09-12T18:55:47.914801+0000","last_became_active":"2024-09-12T17:40:18.773787+0000","last_became_peered":"2024-09-12T17:40:18.773787+0000","last_unstale":"2024-09-12T18:55:47.914801+0000","last_undegraded":"2024-09-12T18:55:47.914801+0000","last_fullsized":"2024-09-12T18:55:47.914801+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:11.321051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11432262,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":578,"num_read_kb":7582,"num_write":1158,"num_write_kb":45057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'153","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.591660+0000","last_change":"2024-09-12T17:40:20.121404+0000","last_active":"2024-09-12T18:57:32.591660+0000","last_peered":"2024-09-12T18:57:32.591660+0000","last_clean":"2024-09-12T18:57:32.591660+0000","last_became_active":"2024-09-12T17:40:20.120803+0000","last_became_peered":"2024-09-12T17:40:20.120803+0000","last_unstale":"2024-09-12T18:57:32.591660+0000","last_undegraded":"2024-09-12T18:57:32.591660+0000","last_fullsized":"2024-09-12T18:57:32.591660+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:19.129000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":714,"num_read_kb":606,"num_write":221,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'257","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.791708+0000","last_change":"2024-09-12T17:40:18.770515+0000","last_active":"2024-09-12T18:55:17.791708+0000","last_peered":"2024-09-12T18:55:17.791708+0000","last_clean":"2024-09-12T18:55:17.791708+0000","last_became_active":"2024-09-12T17:40:18.769867+0000","last_became_peered":"2024-09-12T17:40:18.769867+0000","last_unstale":"2024-09-12T18:55:17.791708+0000","last_undegraded":"2024-09-12T18:55:17.791708+0000","last_fullsized":"2024-09-12T18:55:17.791708+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:27.168781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9822617,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":413,"num_read_kb":25356,"num_write":1031,"num_write_kb":19597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'166","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:14.423789+0000","last_change":"2024-09-12T17:40:20.132059+0000","last_active":"2024-09-12T18:55:14.423789+0000","last_peered":"2024-09-12T18:55:14.423789+0000","last_clean":"2024-09-12T18:55:14.423789+0000","last_became_active":"2024-09-12T17:40:20.131603+0000","last_became_peered":"2024-09-12T17:40:20.131603+0000","last_unstale":"2024-09-12T18:55:14.423789+0000","last_undegraded":"2024-09-12T18:55:14.423789+0000","last_fullsized":"2024-09-12T18:55:14.423789+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:41.698653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":647,"num_write":268,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'271","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426374+0000","last_change":"2024-09-12T17:40:18.766165+0000","last_active":"2024-09-12T18:55:17.426374+0000","last_peered":"2024-09-12T18:55:17.426374+0000","last_clean":"2024-09-12T18:55:17.426374+0000","last_became_active":"2024-09-12T17:40:18.765584+0000","last_became_peered":"2024-09-12T17:40:18.765584+0000","last_unstale":"2024-09-12T18:55:17.426374+0000","last_undegraded":"2024-09-12T18:55:17.426374+0000","last_fullsized":"2024-09-12T18:55:17.426374+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:22.295131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7414200,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":441,"num_read_kb":14371,"num_write":1035,"num_write_kb":24714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'218","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:28.107651+0000","last_change":"2024-09-12T17:40:20.134311+0000","last_active":"2024-09-12T18:56:28.107651+0000","last_peered":"2024-09-12T18:56:28.107651+0000","last_clean":"2024-09-12T18:56:28.107651+0000","last_became_active":"2024-09-12T17:40:20.132166+0000","last_became_peered":"2024-09-12T17:40:20.132166+0000","last_unstale":"2024-09-12T18:56:28.107651+0000","last_undegraded":"2024-09-12T18:56:28.107651+0000","last_fullsized":"2024-09-12T18:56:28.107651+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:01.198659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":801,"num_write":328,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'254","reported_seq":898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.475534+0000","last_change":"2024-09-12T17:40:18.754672+0000","last_active":"2024-09-12T18:57:37.475534+0000","last_peered":"2024-09-12T18:57:37.475534+0000","last_clean":"2024-09-12T18:57:37.475534+0000","last_became_active":"2024-09-12T17:40:18.753673+0000","last_became_peered":"2024-09-12T17:40:18.753673+0000","last_unstale":"2024-09-12T18:57:37.475534+0000","last_undegraded":"2024-09-12T18:57:37.475534+0000","last_fullsized":"2024-09-12T18:57:37.475534+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:52.046955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7819696,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":407,"num_read_kb":9306,"num_write":950,"num_write_kb":26120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'143","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.275130+0000","last_change":"2024-09-12T17:40:28.202080+0000","last_active":"2024-09-12T18:58:06.275130+0000","last_peered":"2024-09-12T18:58:06.275130+0000","last_clean":"2024-09-12T18:58:06.275130+0000","last_became_active":"2024-09-12T17:40:28.201205+0000","last_became_peered":"2024-09-12T17:40:28.201205+0000","last_unstale":"2024-09-12T18:58:06.275130+0000","last_undegraded":"2024-09-12T18:58:06.275130+0000","last_fullsized":"2024-09-12T18:58:06.275130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:51.763724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'257","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427749+0000","last_change":"2024-09-12T17:40:20.133338+0000","last_active":"2024-09-12T18:55:22.427749+0000","last_peered":"2024-09-12T18:55:22.427749+0000","last_clean":"2024-09-12T18:55:22.427749+0000","last_became_active":"2024-09-12T17:40:20.132930+0000","last_became_peered":"2024-09-12T17:40:20.132930+0000","last_unstale":"2024-09-12T18:55:22.427749+0000","last_undegraded":"2024-09-12T18:55:22.427749+0000","last_fullsized":"2024-09-12T18:55:22.427749+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:26.732786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1081,"num_read_kb":890,"num_write":398,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'267","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456141+0000","last_change":"2024-09-12T17:40:18.786389+0000","last_active":"2024-09-12T18:57:22.456141+0000","last_peered":"2024-09-12T18:57:22.456141+0000","last_clean":"2024-09-12T18:57:22.456141+0000","last_became_active":"2024-09-12T17:40:18.785762+0000","last_became_peered":"2024-09-12T17:40:18.785762+0000","last_unstale":"2024-09-12T18:57:22.456141+0000","last_undegraded":"2024-09-12T18:57:22.456141+0000","last_fullsized":"2024-09-12T18:57:22.456141+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.306882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8559470,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":591,"num_read_kb":5513,"num_write":1061,"num_write_kb":17948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.609904+0000","last_change":"2024-09-12T17:40:22.146973+0000","last_active":"2024-09-12T18:55:17.609904+0000","last_peered":"2024-09-12T18:55:17.609904+0000","last_clean":"2024-09-12T18:55:17.609904+0000","last_became_active":"2024-09-12T17:40:22.146112+0000","last_became_peered":"2024-09-12T17:40:22.146112+0000","last_unstale":"2024-09-12T18:55:17.609904+0000","last_undegraded":"2024-09-12T18:55:17.609904+0000","last_fullsized":"2024-09-12T18:55:17.609904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:09.636474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'334","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.478019+0000","last_change":"2024-09-12T17:40:24.162348+0000","last_active":"2024-09-12T18:57:47.478019+0000","last_peered":"2024-09-12T18:57:47.478019+0000","last_clean":"2024-09-12T18:57:47.478019+0000","last_became_active":"2024-09-12T17:40:24.161536+0000","last_became_peered":"2024-09-12T17:40:24.161536+0000","last_unstale":"2024-09-12T18:57:47.478019+0000","last_undegraded":"2024-09-12T18:57:47.478019+0000","last_fullsized":"2024-09-12T18:57:47.478019+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:26.371603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":1078,"num_write":434,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427469+0000","last_change":"2024-09-12T17:40:26.189627+0000","last_active":"2024-09-12T18:55:22.427469+0000","last_peered":"2024-09-12T18:55:22.427469+0000","last_clean":"2024-09-12T18:55:22.427469+0000","last_became_active":"2024-09-12T17:40:26.188831+0000","last_became_peered":"2024-09-12T17:40:26.188831+0000","last_unstale":"2024-09-12T18:55:22.427469+0000","last_undegraded":"2024-09-12T18:55:22.427469+0000","last_fullsized":"2024-09-12T18:55:22.427469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:08.240916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'158","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.658358+0000","last_change":"2024-09-12T17:40:28.190678+0000","last_active":"2024-09-12T18:58:02.658358+0000","last_peered":"2024-09-12T18:58:02.658358+0000","last_clean":"2024-09-12T18:58:02.658358+0000","last_became_active":"2024-09-12T17:40:28.189899+0000","last_became_peered":"2024-09-12T17:40:28.189899+0000","last_unstale":"2024-09-12T18:58:02.658358+0000","last_undegraded":"2024-09-12T18:58:02.658358+0000","last_fullsized":"2024-09-12T18:58:02.658358+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:37.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":230,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'92","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:35.155067+0000","last_change":"2024-09-12T17:40:20.137996+0000","last_active":"2024-09-12T18:55:35.155067+0000","last_peered":"2024-09-12T18:55:35.155067+0000","last_clean":"2024-09-12T18:55:35.155067+0000","last_became_active":"2024-09-12T17:40:20.137252+0000","last_became_peered":"2024-09-12T17:40:20.137252+0000","last_unstale":"2024-09-12T18:55:35.155067+0000","last_undegraded":"2024-09-12T18:55:35.155067+0000","last_fullsized":"2024-09-12T18:55:35.155067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:53.184648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":356,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'271","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.471998+0000","last_change":"2024-09-12T17:40:18.758093+0000","last_active":"2024-09-12T18:57:22.471998+0000","last_peered":"2024-09-12T18:57:22.471998+0000","last_clean":"2024-09-12T18:57:22.471998+0000","last_became_active":"2024-09-12T17:40:18.756518+0000","last_became_peered":"2024-09-12T17:40:18.756518+0000","last_unstale":"2024-09-12T18:57:22.471998+0000","last_undegraded":"2024-09-12T18:57:22.471998+0000","last_fullsized":"2024-09-12T18:57:22.471998+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:19.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15261432,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":398,"num_read_kb":2590,"num_write":955,"num_write_kb":33023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427791+0000","last_change":"2024-09-12T17:40:22.153805+0000","last_active":"2024-09-12T18:55:22.427791+0000","last_peered":"2024-09-12T18:55:22.427791+0000","last_clean":"2024-09-12T18:55:22.427791+0000","last_became_active":"2024-09-12T17:40:22.153074+0000","last_became_peered":"2024-09-12T17:40:22.153074+0000","last_unstale":"2024-09-12T18:55:22.427791+0000","last_undegraded":"2024-09-12T18:55:22.427791+0000","last_fullsized":"2024-09-12T18:55:22.427791+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:18.398925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'102","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793167+0000","last_change":"2024-09-12T17:40:24.170127+0000","last_active":"2024-09-12T18:55:22.793167+0000","last_peered":"2024-09-12T18:55:22.793167+0000","last_clean":"2024-09-12T18:55:22.793167+0000","last_became_active":"2024-09-12T17:40:24.169431+0000","last_became_peered":"2024-09-12T17:40:24.169431+0000","last_unstale":"2024-09-12T18:55:22.793167+0000","last_undegraded":"2024-09-12T18:55:22.793167+0000","last_fullsized":"2024-09-12T18:55:22.793167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:42.784293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793126+0000","last_change":"2024-09-12T17:40:26.189218+0000","last_active":"2024-09-12T18:55:22.793126+0000","last_peered":"2024-09-12T18:55:22.793126+0000","last_clean":"2024-09-12T18:55:22.793126+0000","last_became_active":"2024-09-12T17:40:26.188501+0000","last_became_peered":"2024-09-12T17:40:26.188501+0000","last_unstale":"2024-09-12T18:55:22.793126+0000","last_undegraded":"2024-09-12T18:55:22.793126+0000","last_fullsized":"2024-09-12T18:55:22.793126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.657079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'131","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:20.748031+0000","last_change":"2024-09-12T17:40:28.186974+0000","last_active":"2024-09-12T18:56:20.748031+0000","last_peered":"2024-09-12T18:56:20.748031+0000","last_clean":"2024-09-12T18:56:20.748031+0000","last_became_active":"2024-09-12T17:40:28.186224+0000","last_became_peered":"2024-09-12T17:40:28.186224+0000","last_unstale":"2024-09-12T18:56:20.748031+0000","last_undegraded":"2024-09-12T18:56:20.748031+0000","last_fullsized":"2024-09-12T18:56:20.748031+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:16.871107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":201,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'278","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.444792+0000","last_change":"2024-09-12T17:40:20.116147+0000","last_active":"2024-09-12T18:55:17.444792+0000","last_peered":"2024-09-12T18:55:17.444792+0000","last_clean":"2024-09-12T18:55:17.444792+0000","last_became_active":"2024-09-12T17:40:20.115862+0000","last_became_peered":"2024-09-12T17:40:20.115862+0000","last_unstale":"2024-09-12T18:55:17.444792+0000","last_undegraded":"2024-09-12T18:55:17.444792+0000","last_fullsized":"2024-09-12T18:55:17.444792+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:27.732090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1211,"num_read_kb":988,"num_write":419,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'309","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:18.375060+0000","last_change":"2024-09-12T17:40:55.329992+0000","last_active":"2024-09-12T18:59:18.375060+0000","last_peered":"2024-09-12T18:59:18.375060+0000","last_clean":"2024-09-12T18:59:18.375060+0000","last_became_active":"2024-09-12T17:40:55.329597+0000","last_became_peered":"2024-09-12T17:40:55.329597+0000","last_unstale":"2024-09-12T18:59:18.375060+0000","last_undegraded":"2024-09-12T18:59:18.375060+0000","last_fullsized":"2024-09-12T18:59:18.375060+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:13.339944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14275251,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":491,"num_read_kb":44050,"num_write":1183,"num_write_kb":40700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426595+0000","last_change":"2024-09-12T17:40:22.146475+0000","last_active":"2024-09-12T18:55:17.426595+0000","last_peered":"2024-09-12T18:55:17.426595+0000","last_clean":"2024-09-12T18:55:17.426595+0000","last_became_active":"2024-09-12T17:40:22.145769+0000","last_became_peered":"2024-09-12T17:40:22.145769+0000","last_unstale":"2024-09-12T18:55:17.426595+0000","last_undegraded":"2024-09-12T18:55:17.426595+0000","last_fullsized":"2024-09-12T18:55:17.426595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:33.677268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'144","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:24.425893+0000","last_change":"2024-09-12T17:40:24.164714+0000","last_active":"2024-09-12T18:55:24.425893+0000","last_peered":"2024-09-12T18:55:24.425893+0000","last_clean":"2024-09-12T18:55:24.425893+0000","last_became_active":"2024-09-12T17:40:24.163809+0000","last_became_peered":"2024-09-12T17:40:24.163809+0000","last_unstale":"2024-09-12T18:55:24.425893+0000","last_undegraded":"2024-09-12T18:55:24.425893+0000","last_fullsized":"2024-09-12T18:55:24.425893+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:13.691022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":124,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'760","reported_seq":2940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.828883+0000","last_change":"2024-09-12T17:40:26.201403+0000","last_active":"2024-09-12T18:59:30.828883+0000","last_peered":"2024-09-12T18:59:30.828883+0000","last_clean":"2024-09-12T18:59:30.828883+0000","last_became_active":"2024-09-12T17:40:26.200567+0000","last_became_peered":"2024-09-12T17:40:26.200567+0000","last_unstale":"2024-09-12T18:59:30.828883+0000","last_undegraded":"2024-09-12T18:59:30.828883+0000","last_fullsized":"2024-09-12T18:59:30.828883+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":701,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:56.480672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'215","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.683461+0000","last_change":"2024-09-12T17:40:28.172338+0000","last_active":"2024-09-12T18:58:04.683461+0000","last_peered":"2024-09-12T18:58:04.683461+0000","last_clean":"2024-09-12T18:58:04.683461+0000","last_became_active":"2024-09-12T17:40:28.171602+0000","last_became_peered":"2024-09-12T17:40:28.171602+0000","last_unstale":"2024-09-12T18:58:04.683461+0000","last_undegraded":"2024-09-12T18:58:04.683461+0000","last_fullsized":"2024-09-12T18:58:04.683461+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:30.488801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":670,"num_read_kb":661,"num_write":473,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'82","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:20.741811+0000","last_change":"2024-09-12T17:40:55.305375+0000","last_active":"2024-09-12T18:56:20.741811+0000","last_peered":"2024-09-12T18:56:20.741811+0000","last_clean":"2024-09-12T18:56:20.741811+0000","last_became_active":"2024-09-12T17:40:55.305123+0000","last_became_peered":"2024-09-12T17:40:55.305123+0000","last_unstale":"2024-09-12T18:56:20.741811+0000","last_undegraded":"2024-09-12T18:56:20.741811+0000","last_fullsized":"2024-09-12T18:56:20.741811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:09.120196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":316,"num_write":118,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"264'349","reported_seq":1098,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.441952+0000","last_change":"2024-09-12T17:40:18.757642+0000","last_active":"2024-09-12T18:57:22.441952+0000","last_peered":"2024-09-12T18:57:22.441952+0000","last_clean":"2024-09-12T18:57:22.441952+0000","last_became_active":"2024-09-12T17:40:18.755758+0000","last_became_peered":"2024-09-12T17:40:18.755758+0000","last_unstale":"2024-09-12T18:57:22.441952+0000","last_undegraded":"2024-09-12T18:57:22.441952+0000","last_fullsized":"2024-09-12T18:57:22.441952+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:52.135911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3608682,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":695,"num_read_kb":10976,"num_write":1200,"num_write_kb":39454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.610050+0000","last_change":"2024-09-12T17:40:22.145057+0000","last_active":"2024-09-12T18:55:17.610050+0000","last_peered":"2024-09-12T18:55:17.610050+0000","last_clean":"2024-09-12T18:55:17.610050+0000","last_became_active":"2024-09-12T17:40:22.144266+0000","last_became_peered":"2024-09-12T17:40:22.144266+0000","last_unstale":"2024-09-12T18:55:17.610050+0000","last_undegraded":"2024-09-12T18:55:17.610050+0000","last_fullsized":"2024-09-12T18:55:17.610050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:51.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'274","reported_seq":852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.462287+0000","last_change":"2024-09-12T17:40:24.333448+0000","last_active":"2024-09-12T18:57:47.462287+0000","last_peered":"2024-09-12T18:57:47.462287+0000","last_clean":"2024-09-12T18:57:47.462287+0000","last_became_active":"2024-09-12T17:40:24.332623+0000","last_became_peered":"2024-09-12T17:40:24.332623+0000","last_unstale":"2024-09-12T18:57:47.462287+0000","last_undegraded":"2024-09-12T18:57:47.462287+0000","last_fullsized":"2024-09-12T18:57:47.462287+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:26.074531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56611,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":973,"num_write":370,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'782","reported_seq":4955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.819165+0000","last_change":"2024-09-12T17:40:26.195115+0000","last_active":"2024-09-12T18:59:30.819165+0000","last_peered":"2024-09-12T18:59:30.819165+0000","last_clean":"2024-09-12T18:59:30.819165+0000","last_became_active":"2024-09-12T17:40:26.194264+0000","last_became_peered":"2024-09-12T17:40:26.194264+0000","last_unstale":"2024-09-12T18:59:30.819165+0000","last_undegraded":"2024-09-12T18:59:30.819165+0000","last_fullsized":"2024-09-12T18:59:30.819165+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:28.079379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'4312","reported_seq":4925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:22.662701+0000","last_change":"2024-09-12T17:40:20.137536+0000","last_active":"2024-09-12T18:58:22.662701+0000","last_peered":"2024-09-12T18:58:22.662701+0000","last_clean":"2024-09-12T18:58:22.662701+0000","last_became_active":"2024-09-12T17:40:20.136595+0000","last_became_peered":"2024-09-12T17:40:20.136595+0000","last_unstale":"2024-09-12T18:58:22.662701+0000","last_undegraded":"2024-09-12T18:58:22.662701+0000","last_fullsized":"2024-09-12T18:58:22.662701+0000","mapping_epoch":25,"log_start":"264'4300","ondisk_log_start":"264'4300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:18.692389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17313,"num_read_kb":14480,"num_write":6459,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'265","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.452784+0000","last_change":"2024-09-12T17:40:18.792864+0000","last_active":"2024-09-12T18:57:07.452784+0000","last_peered":"2024-09-12T18:57:07.452784+0000","last_clean":"2024-09-12T18:57:07.452784+0000","last_became_active":"2024-09-12T17:40:18.792274+0000","last_became_peered":"2024-09-12T17:40:18.792274+0000","last_unstale":"2024-09-12T18:57:07.452784+0000","last_undegraded":"2024-09-12T18:57:07.452784+0000","last_fullsized":"2024-09-12T18:57:07.452784+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:56.734666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3754663,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":495,"num_read_kb":45932,"num_write":1030,"num_write_kb":27157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439724+0000","last_change":"2024-09-12T17:40:22.152894+0000","last_active":"2024-09-12T18:56:12.439724+0000","last_peered":"2024-09-12T18:56:12.439724+0000","last_clean":"2024-09-12T18:56:12.439724+0000","last_became_active":"2024-09-12T17:40:22.150553+0000","last_became_peered":"2024-09-12T17:40:22.150553+0000","last_unstale":"2024-09-12T18:56:12.439724+0000","last_undegraded":"2024-09-12T18:56:12.439724+0000","last_fullsized":"2024-09-12T18:56:12.439724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:24.942654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'407","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:42.667592+0000","last_change":"2024-09-12T17:40:24.333149+0000","last_active":"2024-09-12T18:58:42.667592+0000","last_peered":"2024-09-12T18:58:42.667592+0000","last_clean":"2024-09-12T18:58:42.667592+0000","last_became_active":"2024-09-12T17:40:24.332413+0000","last_became_peered":"2024-09-12T17:40:24.332413+0000","last_unstale":"2024-09-12T18:58:42.667592+0000","last_undegraded":"2024-09-12T18:58:42.667592+0000","last_fullsized":"2024-09-12T18:58:42.667592+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:54.765665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60683,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":634,"num_read_kb":1155,"num_write":496,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.457290+0000","last_change":"2024-09-12T17:40:26.197292+0000","last_active":"2024-09-12T18:56:57.457290+0000","last_peered":"2024-09-12T18:56:57.457290+0000","last_clean":"2024-09-12T18:56:57.457290+0000","last_became_active":"2024-09-12T17:40:26.180448+0000","last_became_peered":"2024-09-12T17:40:26.180448+0000","last_unstale":"2024-09-12T18:56:57.457290+0000","last_undegraded":"2024-09-12T18:56:57.457290+0000","last_fullsized":"2024-09-12T18:56:57.457290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:40.842285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'559","reported_seq":1375,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.758187+0000","last_change":"2024-09-12T17:40:28.190641+0000","last_active":"2024-09-12T18:59:27.758187+0000","last_peered":"2024-09-12T18:59:27.758187+0000","last_clean":"2024-09-12T18:59:27.758187+0000","last_became_active":"2024-09-12T17:40:28.189872+0000","last_became_peered":"2024-09-12T17:40:28.189872+0000","last_unstale":"2024-09-12T18:59:27.758187+0000","last_undegraded":"2024-09-12T18:59:27.758187+0000","last_fullsized":"2024-09-12T18:59:27.758187+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:20.487874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1323,"num_read_kb":1321,"num_write":1170,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'151","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.803902+0000","last_change":"2024-09-12T17:40:20.134586+0000","last_active":"2024-09-12T18:56:12.803902+0000","last_peered":"2024-09-12T18:56:12.803902+0000","last_clean":"2024-09-12T18:56:12.803902+0000","last_became_active":"2024-09-12T17:40:20.133890+0000","last_became_peered":"2024-09-12T17:40:20.133890+0000","last_unstale":"2024-09-12T18:56:12.803902+0000","last_undegraded":"2024-09-12T18:56:12.803902+0000","last_fullsized":"2024-09-12T18:56:12.803902+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:21.170793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":596,"num_write":262,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'316","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.022630+0000","last_change":"2024-09-12T17:40:18.779965+0000","last_active":"2024-09-12T18:57:47.022630+0000","last_peered":"2024-09-12T18:57:47.022630+0000","last_clean":"2024-09-12T18:57:47.022630+0000","last_became_active":"2024-09-12T17:40:18.779278+0000","last_became_peered":"2024-09-12T17:40:18.779278+0000","last_unstale":"2024-09-12T18:57:47.022630+0000","last_undegraded":"2024-09-12T18:57:47.022630+0000","last_fullsized":"2024-09-12T18:57:47.022630+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:40.197710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12165714,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":505,"num_read_kb":90798,"num_write":1100,"num_write_kb":50508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"35'5","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.367452+0000","last_change":"2024-09-12T17:40:22.133983+0000","last_active":"2024-09-12T18:59:27.367452+0000","last_peered":"2024-09-12T18:59:27.367452+0000","last_clean":"2024-09-12T18:59:27.367452+0000","last_became_active":"2024-09-12T17:40:22.133525+0000","last_became_peered":"2024-09-12T17:40:22.133525+0000","last_unstale":"2024-09-12T18:59:27.367452+0000","last_undegraded":"2024-09-12T18:59:27.367452+0000","last_fullsized":"2024-09-12T18:59:27.367452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:35.003569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'284","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:12.480635+0000","last_change":"2024-09-12T17:40:24.178387+0000","last_active":"2024-09-12T18:59:12.480635+0000","last_peered":"2024-09-12T18:59:12.480635+0000","last_clean":"2024-09-12T18:59:12.480635+0000","last_became_active":"2024-09-12T17:40:24.177609+0000","last_became_peered":"2024-09-12T17:40:24.177609+0000","last_unstale":"2024-09-12T18:59:12.480635+0000","last_undegraded":"2024-09-12T18:59:12.480635+0000","last_fullsized":"2024-09-12T18:59:12.480635+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.549312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55961,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":980,"num_write":382,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.445281+0000","last_change":"2024-09-12T17:40:26.203926+0000","last_active":"2024-09-12T18:56:37.445281+0000","last_peered":"2024-09-12T18:56:37.445281+0000","last_clean":"2024-09-12T18:56:37.445281+0000","last_became_active":"2024-09-12T17:40:26.203313+0000","last_became_peered":"2024-09-12T17:40:26.203313+0000","last_unstale":"2024-09-12T18:56:37.445281+0000","last_undegraded":"2024-09-12T18:56:37.445281+0000","last_fullsized":"2024-09-12T18:56:37.445281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:57.623918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2394","reported_seq":4223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:19.224714+0000","last_change":"2024-09-12T17:40:28.184253+0000","last_active":"2024-09-12T18:59:19.224714+0000","last_peered":"2024-09-12T18:59:19.224714+0000","last_clean":"2024-09-12T18:59:19.224714+0000","last_became_active":"2024-09-12T17:40:28.183181+0000","last_became_peered":"2024-09-12T17:40:28.183181+0000","last_unstale":"2024-09-12T18:59:19.224714+0000","last_undegraded":"2024-09-12T18:59:19.224714+0000","last_fullsized":"2024-09-12T18:59:19.224714+0000","mapping_epoch":33,"log_start":"264'2300","ondisk_log_start":"264'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:07.933119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6012,"num_read_kb":6017,"num_write":4828,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'261","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:32.431640+0000","last_change":"2024-09-12T17:40:20.138917+0000","last_active":"2024-09-12T18:56:32.431640+0000","last_peered":"2024-09-12T18:56:32.431640+0000","last_clean":"2024-09-12T18:56:32.431640+0000","last_became_active":"2024-09-12T17:40:20.133614+0000","last_became_peered":"2024-09-12T17:40:20.133614+0000","last_unstale":"2024-09-12T18:56:32.431640+0000","last_undegraded":"2024-09-12T18:56:32.431640+0000","last_fullsized":"2024-09-12T18:56:32.431640+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:17.955544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1175,"num_read_kb":965,"num_write":385,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'245","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.219980+0000","last_change":"2024-09-12T17:40:18.787022+0000","last_active":"2024-09-12T18:57:17.219980+0000","last_peered":"2024-09-12T18:57:17.219980+0000","last_clean":"2024-09-12T18:57:17.219980+0000","last_became_active":"2024-09-12T17:40:18.786288+0000","last_became_peered":"2024-09-12T17:40:18.786288+0000","last_unstale":"2024-09-12T18:57:17.219980+0000","last_undegraded":"2024-09-12T18:57:17.219980+0000","last_fullsized":"2024-09-12T18:57:17.219980+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:05.492643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10052947,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":337,"num_read_kb":29289,"num_write":868,"num_write_kb":24158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:54.443737+0000","last_change":"2024-09-12T17:40:22.132236+0000","last_active":"2024-09-12T18:56:54.443737+0000","last_peered":"2024-09-12T18:56:54.443737+0000","last_clean":"2024-09-12T18:56:54.443737+0000","last_became_active":"2024-09-12T17:40:22.131242+0000","last_became_peered":"2024-09-12T17:40:22.131242+0000","last_unstale":"2024-09-12T18:56:54.443737+0000","last_undegraded":"2024-09-12T18:56:54.443737+0000","last_fullsized":"2024-09-12T18:56:54.443737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:50.985889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'299","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:27.471824+0000","last_change":"2024-09-12T17:40:24.163379+0000","last_active":"2024-09-12T18:58:27.471824+0000","last_peered":"2024-09-12T18:58:27.471824+0000","last_clean":"2024-09-12T18:58:27.471824+0000","last_became_active":"2024-09-12T17:40:24.162722+0000","last_became_peered":"2024-09-12T17:40:24.162722+0000","last_unstale":"2024-09-12T18:58:27.471824+0000","last_undegraded":"2024-09-12T18:58:27.471824+0000","last_fullsized":"2024-09-12T18:58:27.471824+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:54.964194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52424,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":926,"num_write":376,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'757","reported_seq":2695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.803097+0000","last_change":"2024-09-12T17:40:26.182440+0000","last_active":"2024-09-12T18:59:30.803097+0000","last_peered":"2024-09-12T18:59:30.803097+0000","last_clean":"2024-09-12T18:59:30.803097+0000","last_became_active":"2024-09-12T17:40:26.181656+0000","last_became_peered":"2024-09-12T17:40:26.181656+0000","last_unstale":"2024-09-12T18:59:30.803097+0000","last_undegraded":"2024-09-12T18:59:30.803097+0000","last_fullsized":"2024-09-12T18:59:30.803097+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:17.173815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'117","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.441759+0000","last_change":"2024-09-12T17:40:28.187639+0000","last_active":"2024-09-12T18:59:26.441759+0000","last_peered":"2024-09-12T18:59:26.441759+0000","last_clean":"2024-09-12T18:59:26.441759+0000","last_became_active":"2024-09-12T17:40:28.185975+0000","last_became_peered":"2024-09-12T17:40:28.185975+0000","last_unstale":"2024-09-12T18:59:26.441759+0000","last_undegraded":"2024-09-12T18:59:26.441759+0000","last_fullsized":"2024-09-12T18:59:26.441759+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:59.724854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'268","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.465535+0000","last_change":"2024-09-12T17:40:20.125734+0000","last_active":"2024-09-12T18:56:52.465535+0000","last_peered":"2024-09-12T18:56:52.465535+0000","last_clean":"2024-09-12T18:56:52.465535+0000","last_became_active":"2024-09-12T17:40:20.125386+0000","last_became_peered":"2024-09-12T17:40:20.125386+0000","last_unstale":"2024-09-12T18:56:52.465535+0000","last_undegraded":"2024-09-12T18:56:52.465535+0000","last_fullsized":"2024-09-12T18:56:52.465535+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:49.257336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1147,"num_read_kb":967,"num_write":444,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'274","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.631617+0000","last_change":"2024-09-12T17:40:18.761857+0000","last_active":"2024-09-12T18:56:52.631617+0000","last_peered":"2024-09-12T18:56:52.631617+0000","last_clean":"2024-09-12T18:56:52.631617+0000","last_became_active":"2024-09-12T17:40:18.761052+0000","last_became_peered":"2024-09-12T17:40:18.761052+0000","last_unstale":"2024-09-12T18:56:52.631617+0000","last_undegraded":"2024-09-12T18:56:52.631617+0000","last_fullsized":"2024-09-12T18:56:52.631617+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:11.433675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20283170,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":416,"num_read_kb":20006,"num_write":993,"num_write_kb":43376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:34.440085+0000","last_change":"2024-09-12T17:40:22.134731+0000","last_active":"2024-09-12T18:56:34.440085+0000","last_peered":"2024-09-12T18:56:34.440085+0000","last_clean":"2024-09-12T18:56:34.440085+0000","last_became_active":"2024-09-12T17:40:22.134290+0000","last_became_peered":"2024-09-12T17:40:22.134290+0000","last_unstale":"2024-09-12T18:56:34.440085+0000","last_undegraded":"2024-09-12T18:56:34.440085+0000","last_fullsized":"2024-09-12T18:56:34.440085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:09.025873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'481","reported_seq":1124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.666304+0000","last_change":"2024-09-12T17:40:24.161967+0000","last_active":"2024-09-12T18:59:27.666304+0000","last_peered":"2024-09-12T18:59:27.666304+0000","last_clean":"2024-09-12T18:59:27.666304+0000","last_became_active":"2024-09-12T17:40:24.161322+0000","last_became_peered":"2024-09-12T17:40:24.161322+0000","last_unstale":"2024-09-12T18:59:27.666304+0000","last_undegraded":"2024-09-12T18:59:27.666304+0000","last_fullsized":"2024-09-12T18:59:27.666304+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.436434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107875,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":843,"num_read_kb":1880,"num_write":698,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:19.437407+0000","last_change":"2024-09-12T17:40:26.192044+0000","last_active":"2024-09-12T18:56:19.437407+0000","last_peered":"2024-09-12T18:56:19.437407+0000","last_clean":"2024-09-12T18:56:19.437407+0000","last_became_active":"2024-09-12T17:40:26.191395+0000","last_became_peered":"2024-09-12T17:40:26.191395+0000","last_unstale":"2024-09-12T18:56:19.437407+0000","last_undegraded":"2024-09-12T18:56:19.437407+0000","last_fullsized":"2024-09-12T18:56:19.437407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:01.918115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'146","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:33.286149+0000","last_change":"2024-09-12T17:40:28.205050+0000","last_active":"2024-09-12T18:56:33.286149+0000","last_peered":"2024-09-12T18:56:33.286149+0000","last_clean":"2024-09-12T18:56:33.286149+0000","last_became_active":"2024-09-12T17:40:28.204260+0000","last_became_peered":"2024-09-12T17:40:28.204260+0000","last_unstale":"2024-09-12T18:56:33.286149+0000","last_undegraded":"2024-09-12T18:56:33.286149+0000","last_fullsized":"2024-09-12T18:56:33.286149+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:03.489071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":166,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'137","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812393+0000","last_change":"2024-09-12T17:40:20.143727+0000","last_active":"2024-09-12T18:56:52.812393+0000","last_peered":"2024-09-12T18:56:52.812393+0000","last_clean":"2024-09-12T18:56:52.812393+0000","last_became_active":"2024-09-12T17:40:20.137143+0000","last_became_peered":"2024-09-12T17:40:20.137143+0000","last_unstale":"2024-09-12T18:56:52.812393+0000","last_undegraded":"2024-09-12T18:56:52.812393+0000","last_fullsized":"2024-09-12T18:56:52.812393+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:59.463752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":630,"num_read_kb":531,"num_write":209,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'296","reported_seq":1127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.449237+0000","last_change":"2024-09-12T17:40:18.759820+0000","last_active":"2024-09-12T18:56:52.449237+0000","last_peered":"2024-09-12T18:56:52.449237+0000","last_clean":"2024-09-12T18:56:52.449237+0000","last_became_active":"2024-09-12T17:40:18.759516+0000","last_became_peered":"2024-09-12T17:40:18.759516+0000","last_unstale":"2024-09-12T18:56:52.449237+0000","last_undegraded":"2024-09-12T18:56:52.449237+0000","last_fullsized":"2024-09-12T18:56:52.449237+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:00.153624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5998334,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":751,"num_read_kb":9130,"num_write":1059,"num_write_kb":40035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:54.443796+0000","last_change":"2024-09-12T17:40:22.152256+0000","last_active":"2024-09-12T18:56:54.443796+0000","last_peered":"2024-09-12T18:56:54.443796+0000","last_clean":"2024-09-12T18:56:54.443796+0000","last_became_active":"2024-09-12T17:40:22.151755+0000","last_became_peered":"2024-09-12T17:40:22.151755+0000","last_unstale":"2024-09-12T18:56:54.443796+0000","last_undegraded":"2024-09-12T18:56:54.443796+0000","last_fullsized":"2024-09-12T18:56:54.443796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:30.113972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'323","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:12.843855+0000","last_change":"2024-09-12T17:40:24.172818+0000","last_active":"2024-09-12T18:59:12.843855+0000","last_peered":"2024-09-12T18:59:12.843855+0000","last_clean":"2024-09-12T18:59:12.843855+0000","last_became_active":"2024-09-12T17:40:24.171973+0000","last_became_peered":"2024-09-12T17:40:24.171973+0000","last_unstale":"2024-09-12T18:59:12.843855+0000","last_undegraded":"2024-09-12T18:59:12.843855+0000","last_fullsized":"2024-09-12T18:59:12.843855+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:48.182083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":1037,"num_write":468,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.469988+0000","last_change":"2024-09-12T17:40:26.185794+0000","last_active":"2024-09-12T18:57:12.469988+0000","last_peered":"2024-09-12T18:57:12.469988+0000","last_clean":"2024-09-12T18:57:12.469988+0000","last_became_active":"2024-09-12T17:40:26.185070+0000","last_became_peered":"2024-09-12T17:40:26.185070+0000","last_unstale":"2024-09-12T18:57:12.469988+0000","last_undegraded":"2024-09-12T18:57:12.469988+0000","last_fullsized":"2024-09-12T18:57:12.469988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:50.080805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'139","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:47.476159+0000","last_change":"2024-09-12T17:40:28.195461+0000","last_active":"2024-09-12T18:58:47.476159+0000","last_peered":"2024-09-12T18:58:47.476159+0000","last_clean":"2024-09-12T18:58:47.476159+0000","last_became_active":"2024-09-12T17:40:28.194137+0000","last_became_peered":"2024-09-12T17:40:28.194137+0000","last_unstale":"2024-09-12T18:58:47.476159+0000","last_undegraded":"2024-09-12T18:58:47.476159+0000","last_fullsized":"2024-09-12T18:58:47.476159+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:02.040950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":145,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'125","reported_seq":703,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812491+0000","last_change":"2024-09-12T17:40:20.132955+0000","last_active":"2024-09-12T18:56:52.812491+0000","last_peered":"2024-09-12T18:56:52.812491+0000","last_clean":"2024-09-12T18:56:52.812491+0000","last_became_active":"2024-09-12T17:40:20.132115+0000","last_became_peered":"2024-09-12T17:40:20.132115+0000","last_unstale":"2024-09-12T18:56:52.812491+0000","last_undegraded":"2024-09-12T18:56:52.812491+0000","last_fullsized":"2024-09-12T18:56:52.812491+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:35.227492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":428,"num_write":212,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'276","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:14.416472+0000","last_change":"2024-09-12T17:40:18.774103+0000","last_active":"2024-09-12T18:57:14.416472+0000","last_peered":"2024-09-12T18:57:14.416472+0000","last_clean":"2024-09-12T18:57:14.416472+0000","last_became_active":"2024-09-12T17:40:18.773579+0000","last_became_peered":"2024-09-12T17:40:18.773579+0000","last_unstale":"2024-09-12T18:57:14.416472+0000","last_undegraded":"2024-09-12T18:57:14.416472+0000","last_fullsized":"2024-09-12T18:57:14.416472+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:15.108347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6979127,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":440,"num_read_kb":44851,"num_write":964,"num_write_kb":35490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.456281+0000","last_change":"2024-09-12T17:40:22.143512+0000","last_active":"2024-09-12T18:56:52.456281+0000","last_peered":"2024-09-12T18:56:52.456281+0000","last_clean":"2024-09-12T18:56:52.456281+0000","last_became_active":"2024-09-12T17:40:22.142112+0000","last_became_peered":"2024-09-12T17:40:22.142112+0000","last_unstale":"2024-09-12T18:56:52.456281+0000","last_undegraded":"2024-09-12T18:56:52.456281+0000","last_fullsized":"2024-09-12T18:56:52.456281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:23.695955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'332","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.741657+0000","last_change":"2024-09-12T17:40:24.182665+0000","last_active":"2024-09-12T18:59:27.741657+0000","last_peered":"2024-09-12T18:59:27.741657+0000","last_clean":"2024-09-12T18:59:27.741657+0000","last_became_active":"2024-09-12T17:40:24.181982+0000","last_became_peered":"2024-09-12T17:40:24.181982+0000","last_unstale":"2024-09-12T18:59:27.741657+0000","last_undegraded":"2024-09-12T18:59:27.741657+0000","last_fullsized":"2024-09-12T18:59:27.741657+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:55.908753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62664,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":1091,"num_write":438,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'721","reported_seq":2531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.805991+0000","last_change":"2024-09-12T17:40:26.187935+0000","last_active":"2024-09-12T18:59:30.805991+0000","last_peered":"2024-09-12T18:59:30.805991+0000","last_clean":"2024-09-12T18:59:30.805991+0000","last_became_active":"2024-09-12T17:40:26.187269+0000","last_became_peered":"2024-09-12T17:40:26.187269+0000","last_unstale":"2024-09-12T18:59:30.805991+0000","last_undegraded":"2024-09-12T18:59:30.805991+0000","last_fullsized":"2024-09-12T18:59:30.805991+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:57.828902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'139","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.277441+0000","last_change":"2024-09-12T17:40:28.192959+0000","last_active":"2024-09-12T18:58:02.277441+0000","last_peered":"2024-09-12T18:58:02.277441+0000","last_clean":"2024-09-12T18:58:02.277441+0000","last_became_active":"2024-09-12T17:40:28.192211+0000","last_became_peered":"2024-09-12T17:40:28.192211+0000","last_unstale":"2024-09-12T18:58:02.277441+0000","last_undegraded":"2024-09-12T18:58:02.277441+0000","last_fullsized":"2024-09-12T18:58:02.277441+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:29.331632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":224,"num_write":356,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'4139","reported_seq":4785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812556+0000","last_change":"2024-09-12T17:40:20.137018+0000","last_active":"2024-09-12T18:56:52.812556+0000","last_peered":"2024-09-12T18:56:52.812556+0000","last_clean":"2024-09-12T18:56:52.812556+0000","last_became_active":"2024-09-12T17:40:20.136148+0000","last_became_peered":"2024-09-12T17:40:20.136148+0000","last_unstale":"2024-09-12T18:56:52.812556+0000","last_undegraded":"2024-09-12T18:56:52.812556+0000","last_fullsized":"2024-09-12T18:56:52.812556+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":3000,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:28.267156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16638,"num_read_kb":13967,"num_write":6216,"num_write_kb":3097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'239","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:14.426006+0000","last_change":"2024-09-12T17:40:18.774322+0000","last_active":"2024-09-12T18:56:14.426006+0000","last_peered":"2024-09-12T18:56:14.426006+0000","last_clean":"2024-09-12T18:56:14.426006+0000","last_became_active":"2024-09-12T17:40:18.773552+0000","last_became_peered":"2024-09-12T17:40:18.773552+0000","last_unstale":"2024-09-12T18:56:14.426006+0000","last_undegraded":"2024-09-12T18:56:14.426006+0000","last_fullsized":"2024-09-12T18:56:14.426006+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:46.449493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10461028,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":414,"num_read_kb":17946,"num_write":865,"num_write_kb":45991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.378738+0000","last_change":"2024-09-12T17:40:22.144205+0000","last_active":"2024-09-12T18:59:27.378738+0000","last_peered":"2024-09-12T18:59:27.378738+0000","last_clean":"2024-09-12T18:59:27.378738+0000","last_became_active":"2024-09-12T17:40:22.143463+0000","last_became_peered":"2024-09-12T17:40:22.143463+0000","last_unstale":"2024-09-12T18:59:27.378738+0000","last_undegraded":"2024-09-12T18:59:27.378738+0000","last_fullsized":"2024-09-12T18:59:27.378738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:11.027627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":949,"num_read_kb":949,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'110","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450877+0000","last_change":"2024-09-12T17:40:24.330084+0000","last_active":"2024-09-12T18:56:57.450877+0000","last_peered":"2024-09-12T18:56:57.450877+0000","last_clean":"2024-09-12T18:56:57.450877+0000","last_became_active":"2024-09-12T17:40:24.329452+0000","last_became_peered":"2024-09-12T17:40:24.329452+0000","last_unstale":"2024-09-12T18:56:57.450877+0000","last_undegraded":"2024-09-12T18:56:57.450877+0000","last_fullsized":"2024-09-12T18:56:57.450877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:41.298862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'750","reported_seq":2622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.822927+0000","last_change":"2024-09-12T17:40:26.183775+0000","last_active":"2024-09-12T18:59:30.822927+0000","last_peered":"2024-09-12T18:59:30.822927+0000","last_clean":"2024-09-12T18:59:30.822927+0000","last_became_active":"2024-09-12T17:40:26.183016+0000","last_became_peered":"2024-09-12T17:40:26.183016+0000","last_unstale":"2024-09-12T18:59:30.822927+0000","last_undegraded":"2024-09-12T18:59:30.822927+0000","last_fullsized":"2024-09-12T18:59:30.822927+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:45.838846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'112","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821328+0000","last_change":"2024-09-12T17:40:28.180920+0000","last_active":"2024-09-12T18:57:32.821328+0000","last_peered":"2024-09-12T18:57:32.821328+0000","last_clean":"2024-09-12T18:57:32.821328+0000","last_became_active":"2024-09-12T17:40:28.180192+0000","last_became_peered":"2024-09-12T17:40:28.180192+0000","last_unstale":"2024-09-12T18:57:32.821328+0000","last_undegraded":"2024-09-12T18:57:32.821328+0000","last_fullsized":"2024-09-12T18:57:32.821328+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:20.350489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":167,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'272","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.460652+0000","last_change":"2024-09-12T17:40:20.126559+0000","last_active":"2024-09-12T18:57:12.460652+0000","last_peered":"2024-09-12T18:57:12.460652+0000","last_clean":"2024-09-12T18:57:12.460652+0000","last_became_active":"2024-09-12T17:40:20.125511+0000","last_became_peered":"2024-09-12T17:40:20.125511+0000","last_unstale":"2024-09-12T18:57:12.460652+0000","last_undegraded":"2024-09-12T18:57:12.460652+0000","last_fullsized":"2024-09-12T18:57:12.460652+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:21.984534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1212,"num_read_kb":1000,"num_write":434,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'234","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439056+0000","last_change":"2024-09-12T17:40:18.769294+0000","last_active":"2024-09-12T18:56:12.439056+0000","last_peered":"2024-09-12T18:56:12.439056+0000","last_clean":"2024-09-12T18:56:12.439056+0000","last_became_active":"2024-09-12T17:40:18.769054+0000","last_became_peered":"2024-09-12T17:40:18.769054+0000","last_unstale":"2024-09-12T18:56:12.439056+0000","last_undegraded":"2024-09-12T18:56:12.439056+0000","last_fullsized":"2024-09-12T18:56:12.439056+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:10.356128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4761001,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":352,"num_read_kb":78920,"num_write":837,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812532+0000","last_change":"2024-09-12T17:40:22.139642+0000","last_active":"2024-09-12T18:56:52.812532+0000","last_peered":"2024-09-12T18:56:52.812532+0000","last_clean":"2024-09-12T18:56:52.812532+0000","last_became_active":"2024-09-12T17:40:22.138875+0000","last_became_peered":"2024-09-12T17:40:22.138875+0000","last_unstale":"2024-09-12T18:56:52.812532+0000","last_undegraded":"2024-09-12T18:56:52.812532+0000","last_fullsized":"2024-09-12T18:56:52.812532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:04.385118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'392","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:12.674294+0000","last_change":"2024-09-12T17:40:24.174213+0000","last_active":"2024-09-12T18:59:12.674294+0000","last_peered":"2024-09-12T18:59:12.674294+0000","last_clean":"2024-09-12T18:59:12.674294+0000","last_became_active":"2024-09-12T17:40:24.173537+0000","last_became_peered":"2024-09-12T17:40:24.173537+0000","last_unstale":"2024-09-12T18:59:12.674294+0000","last_undegraded":"2024-09-12T18:59:12.674294+0000","last_fullsized":"2024-09-12T18:59:12.674294+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:35.315463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63339,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":637,"num_read_kb":1220,"num_write":502,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.436922+0000","last_change":"2024-09-12T17:40:26.184072+0000","last_active":"2024-09-12T18:56:57.436922+0000","last_peered":"2024-09-12T18:56:57.436922+0000","last_clean":"2024-09-12T18:56:57.436922+0000","last_became_active":"2024-09-12T17:40:26.183228+0000","last_became_peered":"2024-09-12T17:40:26.183228+0000","last_unstale":"2024-09-12T18:56:57.436922+0000","last_undegraded":"2024-09-12T18:56:57.436922+0000","last_fullsized":"2024-09-12T18:56:57.436922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.239515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'138","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.417590+0000","last_change":"2024-09-12T17:40:28.192535+0000","last_active":"2024-09-12T18:58:04.417590+0000","last_peered":"2024-09-12T18:58:04.417590+0000","last_clean":"2024-09-12T18:58:04.417590+0000","last_became_active":"2024-09-12T17:40:28.191461+0000","last_became_peered":"2024-09-12T17:40:28.191461+0000","last_unstale":"2024-09-12T18:58:04.417590+0000","last_undegraded":"2024-09-12T18:58:04.417590+0000","last_fullsized":"2024-09-12T18:58:04.417590+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:39.691469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":326,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'92","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.447236+0000","last_change":"2024-09-12T17:40:20.146944+0000","last_active":"2024-09-12T18:57:47.447236+0000","last_peered":"2024-09-12T18:57:47.447236+0000","last_clean":"2024-09-12T18:57:47.447236+0000","last_became_active":"2024-09-12T17:40:20.146160+0000","last_became_peered":"2024-09-12T17:40:20.146160+0000","last_unstale":"2024-09-12T18:57:47.447236+0000","last_undegraded":"2024-09-12T18:57:47.447236+0000","last_fullsized":"2024-09-12T18:57:47.447236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:10.252891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:22.442012+0000","last_change":"2024-09-12T17:40:03.638745+0000","last_active":"2024-09-12T18:56:22.442012+0000","last_peered":"2024-09-12T18:56:22.442012+0000","last_clean":"2024-09-12T18:56:22.442012+0000","last_became_active":"2024-09-12T17:40:03.636856+0000","last_became_peered":"2024-09-12T17:40:03.636856+0000","last_unstale":"2024-09-12T18:56:22.442012+0000","last_undegraded":"2024-09-12T18:56:22.442012+0000","last_fullsized":"2024-09-12T18:56:22.442012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_clean_scrub_stamp":"2024-09-12T17:40:02.615744+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:44.815912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637481+0000","last_change":"2024-09-12T17:40:11.694118+0000","last_active":"2024-09-12T18:57:17.637481+0000","last_peered":"2024-09-12T18:57:17.637481+0000","last_clean":"2024-09-12T18:57:17.637481+0000","last_became_active":"2024-09-12T17:40:09.670674+0000","last_became_peered":"2024-09-12T17:40:09.670674+0000","last_unstale":"2024-09-12T18:57:17.637481+0000","last_undegraded":"2024-09-12T18:57:17.637481+0000","last_fullsized":"2024-09-12T18:57:17.637481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:11.615670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001302742,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'313","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.458042+0000","last_change":"2024-09-12T17:40:18.774699+0000","last_active":"2024-09-12T18:57:27.458042+0000","last_peered":"2024-09-12T18:57:27.458042+0000","last_clean":"2024-09-12T18:57:27.458042+0000","last_became_active":"2024-09-12T17:40:18.774164+0000","last_became_peered":"2024-09-12T17:40:18.774164+0000","last_unstale":"2024-09-12T18:57:27.458042+0000","last_undegraded":"2024-09-12T18:57:27.458042+0000","last_fullsized":"2024-09-12T18:57:27.458042+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:30.058615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10725583,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":669,"num_read_kb":41233,"num_write":1060,"num_write_kb":37796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457318+0000","last_change":"2024-09-12T17:40:22.150388+0000","last_active":"2024-09-12T18:57:27.457318+0000","last_peered":"2024-09-12T18:57:27.457318+0000","last_clean":"2024-09-12T18:57:27.457318+0000","last_became_active":"2024-09-12T17:40:22.148190+0000","last_became_peered":"2024-09-12T17:40:22.148190+0000","last_unstale":"2024-09-12T18:57:27.457318+0000","last_undegraded":"2024-09-12T18:57:27.457318+0000","last_fullsized":"2024-09-12T18:57:27.457318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:47.144440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'721","reported_seq":1423,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.706201+0000","last_change":"2024-09-12T17:40:24.177543+0000","last_active":"2024-09-12T18:59:27.706201+0000","last_peered":"2024-09-12T18:59:27.706201+0000","last_clean":"2024-09-12T18:59:27.706201+0000","last_became_active":"2024-09-12T17:40:24.176757+0000","last_became_peered":"2024-09-12T17:40:24.176757+0000","last_unstale":"2024-09-12T18:59:27.706201+0000","last_undegraded":"2024-09-12T18:59:27.706201+0000","last_fullsized":"2024-09-12T18:59:27.706201+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.566492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172295,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1398,"num_read_kb":2961,"num_write":1334,"num_write_kb":1179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.458091+0000","last_change":"2024-09-12T17:40:26.191218+0000","last_active":"2024-09-12T18:56:17.458091+0000","last_peered":"2024-09-12T18:56:17.458091+0000","last_clean":"2024-09-12T18:56:17.458091+0000","last_became_active":"2024-09-12T17:40:26.190522+0000","last_became_peered":"2024-09-12T17:40:26.190522+0000","last_unstale":"2024-09-12T18:56:17.458091+0000","last_undegraded":"2024-09-12T18:56:17.458091+0000","last_fullsized":"2024-09-12T18:56:17.458091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:36.917179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'197","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.131600+0000","last_change":"2024-09-12T17:40:28.194274+0000","last_active":"2024-09-12T18:58:06.131600+0000","last_peered":"2024-09-12T18:58:06.131600+0000","last_clean":"2024-09-12T18:58:06.131600+0000","last_became_active":"2024-09-12T17:40:28.193456+0000","last_became_peered":"2024-09-12T17:40:28.193456+0000","last_unstale":"2024-09-12T18:58:06.131600+0000","last_undegraded":"2024-09-12T18:58:06.131600+0000","last_fullsized":"2024-09-12T18:58:06.131600+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:18.966712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":530,"num_write":424,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'121","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456780+0000","last_change":"2024-09-12T17:40:20.131034+0000","last_active":"2024-09-12T18:56:12.456780+0000","last_peered":"2024-09-12T18:56:12.456780+0000","last_clean":"2024-09-12T18:56:12.456780+0000","last_became_active":"2024-09-12T17:40:20.130774+0000","last_became_peered":"2024-09-12T17:40:20.130774+0000","last_unstale":"2024-09-12T18:56:12.456780+0000","last_undegraded":"2024-09-12T18:56:12.456780+0000","last_fullsized":"2024-09-12T18:56:12.456780+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:27.582751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":441,"num_write":172,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.443272+0000","last_change":"2024-09-12T17:40:11.747849+0000","last_active":"2024-09-12T18:56:27.443272+0000","last_peered":"2024-09-12T18:56:27.443272+0000","last_clean":"2024-09-12T18:56:27.443272+0000","last_became_active":"2024-09-12T17:40:09.666272+0000","last_became_peered":"2024-09-12T17:40:09.666272+0000","last_unstale":"2024-09-12T18:56:27.443272+0000","last_undegraded":"2024-09-12T18:56:27.443272+0000","last_fullsized":"2024-09-12T18:56:27.443272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:15.707497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001052545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'301","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473202+0000","last_change":"2024-09-12T17:40:18.775027+0000","last_active":"2024-09-12T18:57:27.473202+0000","last_peered":"2024-09-12T18:57:27.473202+0000","last_clean":"2024-09-12T18:57:27.473202+0000","last_became_active":"2024-09-12T17:40:18.774751+0000","last_became_peered":"2024-09-12T17:40:18.774751+0000","last_unstale":"2024-09-12T18:57:27.473202+0000","last_undegraded":"2024-09-12T18:57:27.473202+0000","last_fullsized":"2024-09-12T18:57:27.473202+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.877317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":708879,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":444,"num_read_kb":728,"num_write":1139,"num_write_kb":17029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.622557+0000","last_change":"2024-09-12T17:40:22.147871+0000","last_active":"2024-09-12T18:56:12.622557+0000","last_peered":"2024-09-12T18:56:12.622557+0000","last_clean":"2024-09-12T18:56:12.622557+0000","last_became_active":"2024-09-12T17:40:22.147184+0000","last_became_peered":"2024-09-12T17:40:22.147184+0000","last_unstale":"2024-09-12T18:56:12.622557+0000","last_undegraded":"2024-09-12T18:56:12.622557+0000","last_fullsized":"2024-09-12T18:56:12.622557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:31.847917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1331","reported_seq":3223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:31.357353+0000","last_change":"2024-09-12T17:40:24.169842+0000","last_active":"2024-09-12T18:59:31.357353+0000","last_peered":"2024-09-12T18:59:31.357353+0000","last_clean":"2024-09-12T18:59:31.357353+0000","last_became_active":"2024-09-12T17:40:24.169050+0000","last_became_peered":"2024-09-12T17:40:24.169050+0000","last_unstale":"2024-09-12T18:59:31.357353+0000","last_undegraded":"2024-09-12T18:59:31.357353+0000","last_fullsized":"2024-09-12T18:59:31.357353+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":1300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:15.887934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177592,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2117,"num_read_kb":3763,"num_write":1248,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.462335+0000","last_change":"2024-09-12T17:40:26.203093+0000","last_active":"2024-09-12T18:57:47.462335+0000","last_peered":"2024-09-12T18:57:47.462335+0000","last_clean":"2024-09-12T18:57:47.462335+0000","last_became_active":"2024-09-12T17:40:26.202360+0000","last_became_peered":"2024-09-12T17:40:26.202360+0000","last_unstale":"2024-09-12T18:57:47.462335+0000","last_undegraded":"2024-09-12T18:57:47.462335+0000","last_fullsized":"2024-09-12T18:57:47.462335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:51.977257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'190","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.452907+0000","last_change":"2024-09-12T17:40:28.190152+0000","last_active":"2024-09-12T18:56:37.452907+0000","last_peered":"2024-09-12T18:56:37.452907+0000","last_clean":"2024-09-12T18:56:37.452907+0000","last_became_active":"2024-09-12T17:40:28.189387+0000","last_became_peered":"2024-09-12T17:40:28.189387+0000","last_unstale":"2024-09-12T18:56:37.452907+0000","last_undegraded":"2024-09-12T18:56:37.452907+0000","last_fullsized":"2024-09-12T18:56:37.452907+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:39.878519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":364,"num_write":413,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'193","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447713+0000","last_change":"2024-09-12T17:40:20.129924+0000","last_active":"2024-09-12T18:56:12.447713+0000","last_peered":"2024-09-12T18:56:12.447713+0000","last_clean":"2024-09-12T18:56:12.447713+0000","last_became_active":"2024-09-12T17:40:20.129646+0000","last_became_peered":"2024-09-12T17:40:20.129646+0000","last_unstale":"2024-09-12T18:56:12.447713+0000","last_undegraded":"2024-09-12T18:56:12.447713+0000","last_fullsized":"2024-09-12T18:56:12.447713+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:01.198659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":706,"num_write":294,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:14.447959+0000","last_change":"2024-09-12T17:40:11.749016+0000","last_active":"2024-09-12T18:57:14.447959+0000","last_peered":"2024-09-12T18:57:14.447959+0000","last_clean":"2024-09-12T18:57:14.447959+0000","last_became_active":"2024-09-12T17:40:09.771196+0000","last_became_peered":"2024-09-12T17:40:09.771196+0000","last_unstale":"2024-09-12T18:57:14.447959+0000","last_undegraded":"2024-09-12T18:57:14.447959+0000","last_fullsized":"2024-09-12T18:57:14.447959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:48.611278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010655720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'263","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:16.016475+0000","last_change":"2024-09-12T17:40:18.766281+0000","last_active":"2024-09-12T18:59:16.016475+0000","last_peered":"2024-09-12T18:59:16.016475+0000","last_clean":"2024-09-12T18:59:16.016475+0000","last_became_active":"2024-09-12T17:40:18.759514+0000","last_became_peered":"2024-09-12T17:40:18.759514+0000","last_unstale":"2024-09-12T18:59:16.016475+0000","last_undegraded":"2024-09-12T18:59:16.016475+0000","last_fullsized":"2024-09-12T18:59:16.016475+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:37.907891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14413366,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":506,"num_read_kb":20357,"num_write":968,"num_write_kb":29003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:14.436342+0000","last_change":"2024-09-12T17:40:22.139338+0000","last_active":"2024-09-12T18:56:14.436342+0000","last_peered":"2024-09-12T18:56:14.436342+0000","last_clean":"2024-09-12T18:56:14.436342+0000","last_became_active":"2024-09-12T17:40:22.138606+0000","last_became_peered":"2024-09-12T17:40:22.138606+0000","last_unstale":"2024-09-12T18:56:14.436342+0000","last_undegraded":"2024-09-12T18:56:14.436342+0000","last_fullsized":"2024-09-12T18:56:14.436342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:11.361933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'294","reported_seq":1802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.983546+0000","last_change":"2024-09-12T17:40:24.330435+0000","last_active":"2024-09-12T18:59:27.983546+0000","last_peered":"2024-09-12T18:59:27.983546+0000","last_clean":"2024-09-12T18:59:27.983546+0000","last_became_active":"2024-09-12T17:40:24.329425+0000","last_became_peered":"2024-09-12T17:40:24.329425+0000","last_unstale":"2024-09-12T18:59:27.983546+0000","last_undegraded":"2024-09-12T18:59:27.983546+0000","last_fullsized":"2024-09-12T18:59:27.983546+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:18.922243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":264,"num_read_kb":256,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.474435+0000","last_change":"2024-09-12T17:40:26.190790+0000","last_active":"2024-09-12T18:57:32.474435+0000","last_peered":"2024-09-12T18:57:32.474435+0000","last_clean":"2024-09-12T18:57:32.474435+0000","last_became_active":"2024-09-12T17:40:26.188740+0000","last_became_peered":"2024-09-12T17:40:26.188740+0000","last_unstale":"2024-09-12T18:57:32.474435+0000","last_undegraded":"2024-09-12T18:57:32.474435+0000","last_fullsized":"2024-09-12T18:57:32.474435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:41.526051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'269","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.609250+0000","last_change":"2024-09-12T17:40:28.202892+0000","last_active":"2024-09-12T18:58:06.609250+0000","last_peered":"2024-09-12T18:58:06.609250+0000","last_clean":"2024-09-12T18:58:06.609250+0000","last_became_active":"2024-09-12T17:40:28.202238+0000","last_became_peered":"2024-09-12T17:40:28.202238+0000","last_unstale":"2024-09-12T18:58:06.609250+0000","last_undegraded":"2024-09-12T18:58:06.609250+0000","last_fullsized":"2024-09-12T18:58:06.609250+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:40.299625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":592,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'387","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464045+0000","last_change":"2024-09-12T17:40:20.128374+0000","last_active":"2024-09-12T18:57:27.464045+0000","last_peered":"2024-09-12T18:57:27.464045+0000","last_clean":"2024-09-12T18:57:27.464045+0000","last_became_active":"2024-09-12T17:40:20.127774+0000","last_became_peered":"2024-09-12T17:40:20.127774+0000","last_unstale":"2024-09-12T18:57:27.464045+0000","last_undegraded":"2024-09-12T18:57:27.464045+0000","last_fullsized":"2024-09-12T18:57:27.464045+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:30.582322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1689,"num_read_kb":1329,"num_write":647,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637396+0000","last_change":"2024-09-12T17:40:11.695547+0000","last_active":"2024-09-12T18:57:17.637396+0000","last_peered":"2024-09-12T18:57:17.637396+0000","last_clean":"2024-09-12T18:57:17.637396+0000","last_became_active":"2024-09-12T17:40:09.672745+0000","last_became_peered":"2024-09-12T17:40:09.672745+0000","last_unstale":"2024-09-12T18:57:17.637396+0000","last_undegraded":"2024-09-12T18:57:17.637396+0000","last_fullsized":"2024-09-12T18:57:17.637396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:10.363335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002775694,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'316","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820175+0000","last_change":"2024-09-12T17:40:18.770896+0000","last_active":"2024-09-12T18:57:27.820175+0000","last_peered":"2024-09-12T18:57:27.820175+0000","last_clean":"2024-09-12T18:57:27.820175+0000","last_became_active":"2024-09-12T17:40:18.769909+0000","last_became_peered":"2024-09-12T17:40:18.769909+0000","last_unstale":"2024-09-12T18:57:27.820175+0000","last_undegraded":"2024-09-12T18:57:27.820175+0000","last_fullsized":"2024-09-12T18:57:27.820175+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:26.327437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3465362,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":506,"num_read_kb":12377,"num_write":1241,"num_write_kb":22203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.476785+0000","last_change":"2024-09-12T17:40:22.145902+0000","last_active":"2024-09-12T18:57:42.476785+0000","last_peered":"2024-09-12T18:57:42.476785+0000","last_clean":"2024-09-12T18:57:42.476785+0000","last_became_active":"2024-09-12T17:40:22.145410+0000","last_became_peered":"2024-09-12T17:40:22.145410+0000","last_unstale":"2024-09-12T18:57:42.476785+0000","last_undegraded":"2024-09-12T18:57:42.476785+0000","last_fullsized":"2024-09-12T18:57:42.476785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:20.122905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'162","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:25.961675+0000","last_change":"2024-09-12T17:40:24.170740+0000","last_active":"2024-09-12T18:59:25.961675+0000","last_peered":"2024-09-12T18:59:25.961675+0000","last_clean":"2024-09-12T18:59:25.961675+0000","last_became_active":"2024-09-12T17:40:24.169937+0000","last_became_peered":"2024-09-12T17:40:24.169937+0000","last_unstale":"2024-09-12T18:59:25.961675+0000","last_undegraded":"2024-09-12T18:59:25.961675+0000","last_fullsized":"2024-09-12T18:59:25.961675+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:52.608977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":193,"num_write":146,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.428609+0000","last_change":"2024-09-12T17:40:26.172468+0000","last_active":"2024-09-12T18:56:17.428609+0000","last_peered":"2024-09-12T18:56:17.428609+0000","last_clean":"2024-09-12T18:56:17.428609+0000","last_became_active":"2024-09-12T17:40:26.171660+0000","last_became_peered":"2024-09-12T17:40:26.171660+0000","last_unstale":"2024-09-12T18:56:17.428609+0000","last_undegraded":"2024-09-12T18:56:17.428609+0000","last_fullsized":"2024-09-12T18:56:17.428609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:42.338225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'122","reported_seq":672,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.623502+0000","last_change":"2024-09-12T17:40:28.202494+0000","last_active":"2024-09-12T18:56:17.623502+0000","last_peered":"2024-09-12T18:56:17.623502+0000","last_clean":"2024-09-12T18:56:17.623502+0000","last_became_active":"2024-09-12T17:40:28.201694+0000","last_became_peered":"2024-09-12T17:40:28.201694+0000","last_unstale":"2024-09-12T18:56:17.623502+0000","last_undegraded":"2024-09-12T18:56:17.623502+0000","last_fullsized":"2024-09-12T18:56:17.623502+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:49.909677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":250,"num_write":312,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'144","reported_seq":749,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.463949+0000","last_change":"2024-09-12T17:40:20.128037+0000","last_active":"2024-09-12T18:57:27.463949+0000","last_peered":"2024-09-12T18:57:27.463949+0000","last_clean":"2024-09-12T18:57:27.463949+0000","last_became_active":"2024-09-12T17:40:20.127727+0000","last_became_peered":"2024-09-12T17:40:20.127727+0000","last_unstale":"2024-09-12T18:57:27.463949+0000","last_undegraded":"2024-09-12T18:57:27.463949+0000","last_fullsized":"2024-09-12T18:57:27.463949+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:36.420192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":625,"num_read_kb":513,"num_write":241,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'245","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.653908+0000","last_change":"2024-09-12T17:40:18.769528+0000","last_active":"2024-09-12T18:57:42.653908+0000","last_peered":"2024-09-12T18:57:42.653908+0000","last_clean":"2024-09-12T18:57:42.653908+0000","last_became_active":"2024-09-12T17:40:18.768544+0000","last_became_peered":"2024-09-12T17:40:18.768544+0000","last_unstale":"2024-09-12T18:57:42.653908+0000","last_undegraded":"2024-09-12T18:57:42.653908+0000","last_fullsized":"2024-09-12T18:57:42.653908+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:48.979420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23471,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":360,"num_read_kb":64899,"num_write":862,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.461730+0000","last_change":"2024-09-12T17:40:11.682969+0000","last_active":"2024-09-12T18:57:17.461730+0000","last_peered":"2024-09-12T18:57:17.461730+0000","last_clean":"2024-09-12T18:57:17.461730+0000","last_became_active":"2024-09-12T17:40:09.770645+0000","last_became_peered":"2024-09-12T17:40:09.770645+0000","last_unstale":"2024-09-12T18:57:17.461730+0000","last_undegraded":"2024-09-12T18:57:17.461730+0000","last_fullsized":"2024-09-12T18:57:17.461730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:00.566138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091158000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473305+0000","last_change":"2024-09-12T17:40:22.136717+0000","last_active":"2024-09-12T18:57:27.473305+0000","last_peered":"2024-09-12T18:57:27.473305+0000","last_clean":"2024-09-12T18:57:27.473305+0000","last_became_active":"2024-09-12T17:40:22.136155+0000","last_became_peered":"2024-09-12T17:40:22.136155+0000","last_unstale":"2024-09-12T18:57:27.473305+0000","last_undegraded":"2024-09-12T18:57:27.473305+0000","last_fullsized":"2024-09-12T18:57:27.473305+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:23.121643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'641","reported_seq":1327,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.688030+0000","last_change":"2024-09-12T17:40:24.174815+0000","last_active":"2024-09-12T18:59:27.688030+0000","last_peered":"2024-09-12T18:59:27.688030+0000","last_clean":"2024-09-12T18:59:27.688030+0000","last_became_active":"2024-09-12T17:40:24.173380+0000","last_became_peered":"2024-09-12T17:40:24.173380+0000","last_unstale":"2024-09-12T18:59:27.688030+0000","last_undegraded":"2024-09-12T18:59:27.688030+0000","last_fullsized":"2024-09-12T18:59:27.688030+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:43.915482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128155,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1676,"num_read_kb":2774,"num_write":2188,"num_write_kb":2016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821238+0000","last_change":"2024-09-12T17:40:26.192118+0000","last_active":"2024-09-12T18:57:32.821238+0000","last_peered":"2024-09-12T18:57:32.821238+0000","last_clean":"2024-09-12T18:57:32.821238+0000","last_became_active":"2024-09-12T17:40:26.191417+0000","last_became_peered":"2024-09-12T17:40:26.191417+0000","last_unstale":"2024-09-12T18:57:32.821238+0000","last_undegraded":"2024-09-12T18:57:32.821238+0000","last_fullsized":"2024-09-12T18:57:32.821238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:38.892952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'174","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.340189+0000","last_change":"2024-09-12T17:40:28.187802+0000","last_active":"2024-09-12T18:58:06.340189+0000","last_peered":"2024-09-12T18:58:06.340189+0000","last_clean":"2024-09-12T18:58:06.340189+0000","last_became_active":"2024-09-12T17:40:28.186922+0000","last_became_peered":"2024-09-12T17:40:28.186922+0000","last_unstale":"2024-09-12T18:58:06.340189+0000","last_undegraded":"2024-09-12T18:58:06.340189+0000","last_fullsized":"2024-09-12T18:58:06.340189+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.041023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'143","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473328+0000","last_change":"2024-09-12T17:40:20.112762+0000","last_active":"2024-09-12T18:57:27.473328+0000","last_peered":"2024-09-12T18:57:27.473328+0000","last_clean":"2024-09-12T18:57:27.473328+0000","last_became_active":"2024-09-12T17:40:20.112490+0000","last_became_peered":"2024-09-12T17:40:20.112490+0000","last_unstale":"2024-09-12T18:57:27.473328+0000","last_undegraded":"2024-09-12T18:57:27.473328+0000","last_fullsized":"2024-09-12T18:57:27.473328+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:36.390829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":606,"num_read_kb":504,"num_write":208,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'243","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464086+0000","last_change":"2024-09-12T17:40:18.760773+0000","last_active":"2024-09-12T18:57:27.464086+0000","last_peered":"2024-09-12T18:57:27.464086+0000","last_clean":"2024-09-12T18:57:27.464086+0000","last_became_active":"2024-09-12T17:40:18.760130+0000","last_became_peered":"2024-09-12T17:40:18.760130+0000","last_unstale":"2024-09-12T18:57:27.464086+0000","last_undegraded":"2024-09-12T18:57:27.464086+0000","last_fullsized":"2024-09-12T18:57:27.464086+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:54.991344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2431354,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":360,"num_read_kb":2116,"num_write":864,"num_write_kb":13193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.458586+0000","last_change":"2024-09-12T17:40:11.747892+0000","last_active":"2024-09-12T18:57:32.458586+0000","last_peered":"2024-09-12T18:57:32.458586+0000","last_clean":"2024-09-12T18:57:32.458586+0000","last_became_active":"2024-09-12T17:40:09.770504+0000","last_became_peered":"2024-09-12T17:40:09.770504+0000","last_unstale":"2024-09-12T18:57:32.458586+0000","last_undegraded":"2024-09-12T18:57:32.458586+0000","last_fullsized":"2024-09-12T18:57:32.458586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:45.742830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001093257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443134+0000","last_change":"2024-09-12T17:40:22.136820+0000","last_active":"2024-09-12T18:57:27.443134+0000","last_peered":"2024-09-12T18:57:27.443134+0000","last_clean":"2024-09-12T18:57:27.443134+0000","last_became_active":"2024-09-12T17:40:22.136095+0000","last_became_peered":"2024-09-12T17:40:22.136095+0000","last_unstale":"2024-09-12T18:57:27.443134+0000","last_undegraded":"2024-09-12T18:57:27.443134+0000","last_fullsized":"2024-09-12T18:57:27.443134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:59.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'255","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:25.949567+0000","last_change":"2024-09-12T17:40:24.333148+0000","last_active":"2024-09-12T18:58:25.949567+0000","last_peered":"2024-09-12T18:58:25.949567+0000","last_clean":"2024-09-12T18:58:25.949567+0000","last_became_active":"2024-09-12T17:40:24.332477+0000","last_became_peered":"2024-09-12T17:40:24.332477+0000","last_unstale":"2024-09-12T18:58:25.949567+0000","last_undegraded":"2024-09-12T18:58:25.949567+0000","last_fullsized":"2024-09-12T18:58:25.949567+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:09.053613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":296,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'755","reported_seq":3092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.818273+0000","last_change":"2024-09-12T17:40:26.180479+0000","last_active":"2024-09-12T18:59:30.818273+0000","last_peered":"2024-09-12T18:59:30.818273+0000","last_clean":"2024-09-12T18:59:30.818273+0000","last_became_active":"2024-09-12T17:40:26.179728+0000","last_became_peered":"2024-09-12T17:40:26.179728+0000","last_unstale":"2024-09-12T18:59:30.818273+0000","last_undegraded":"2024-09-12T18:59:30.818273+0000","last_fullsized":"2024-09-12T18:59:30.818273+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:15.964800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'144","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.754378+0000","last_change":"2024-09-12T17:40:28.202506+0000","last_active":"2024-09-12T18:59:27.754378+0000","last_peered":"2024-09-12T18:59:27.754378+0000","last_clean":"2024-09-12T18:59:27.754378+0000","last_became_active":"2024-09-12T17:40:28.201571+0000","last_became_peered":"2024-09-12T17:40:28.201571+0000","last_unstale":"2024-09-12T18:59:27.754378+0000","last_undegraded":"2024-09-12T18:59:27.754378+0000","last_fullsized":"2024-09-12T18:59:27.754378+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:40.742392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":253,"num_write":364,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'450","reported_seq":1163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446531+0000","last_change":"2024-09-12T17:40:20.136291+0000","last_active":"2024-09-12T18:56:42.446531+0000","last_peered":"2024-09-12T18:56:42.446531+0000","last_clean":"2024-09-12T18:56:42.446531+0000","last_became_active":"2024-09-12T17:40:20.135950+0000","last_became_peered":"2024-09-12T17:40:20.135950+0000","last_unstale":"2024-09-12T18:56:42.446531+0000","last_undegraded":"2024-09-12T18:56:42.446531+0000","last_fullsized":"2024-09-12T18:56:42.446531+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:02.260304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1875,"num_read_kb":1500,"num_write":660,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'263","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439422+0000","last_change":"2024-09-12T17:40:18.762841+0000","last_active":"2024-09-12T18:56:12.439422+0000","last_peered":"2024-09-12T18:56:12.439422+0000","last_clean":"2024-09-12T18:56:12.439422+0000","last_became_active":"2024-09-12T17:40:18.762324+0000","last_became_peered":"2024-09-12T17:40:18.762324+0000","last_unstale":"2024-09-12T18:56:12.439422+0000","last_undegraded":"2024-09-12T18:56:12.439422+0000","last_fullsized":"2024-09-12T18:56:12.439422+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:21.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13971098,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":434,"num_read_kb":85957,"num_write":956,"num_write_kb":37704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.445258+0000","last_change":"2024-09-12T17:40:11.683217+0000","last_active":"2024-09-12T18:56:02.445258+0000","last_peered":"2024-09-12T18:56:02.445258+0000","last_clean":"2024-09-12T18:56:02.445258+0000","last_became_active":"2024-09-12T17:40:09.671019+0000","last_became_peered":"2024-09-12T17:40:09.671019+0000","last_unstale":"2024-09-12T18:56:02.445258+0000","last_undegraded":"2024-09-12T18:56:02.445258+0000","last_fullsized":"2024-09-12T18:56:02.445258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:29.653884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096571,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820072+0000","last_change":"2024-09-12T17:40:22.146908+0000","last_active":"2024-09-12T18:57:27.820072+0000","last_peered":"2024-09-12T18:57:27.820072+0000","last_clean":"2024-09-12T18:57:27.820072+0000","last_became_active":"2024-09-12T17:40:22.146131+0000","last_became_peered":"2024-09-12T17:40:22.146131+0000","last_unstale":"2024-09-12T18:57:27.820072+0000","last_undegraded":"2024-09-12T18:57:27.820072+0000","last_fullsized":"2024-09-12T18:57:27.820072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:43.916632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'135","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821299+0000","last_change":"2024-09-12T17:40:24.165118+0000","last_active":"2024-09-12T18:57:32.821299+0000","last_peered":"2024-09-12T18:57:32.821299+0000","last_clean":"2024-09-12T18:57:32.821299+0000","last_became_active":"2024-09-12T17:40:24.163566+0000","last_became_peered":"2024-09-12T17:40:24.163566+0000","last_unstale":"2024-09-12T18:57:32.821299+0000","last_undegraded":"2024-09-12T18:57:32.821299+0000","last_fullsized":"2024-09-12T18:57:32.821299+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.865870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'783","reported_seq":2820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:31.415589+0000","last_change":"2024-09-12T17:40:26.195048+0000","last_active":"2024-09-12T18:59:31.415589+0000","last_peered":"2024-09-12T18:59:31.415589+0000","last_clean":"2024-09-12T18:59:31.415589+0000","last_became_active":"2024-09-12T17:40:26.194293+0000","last_became_peered":"2024-09-12T17:40:26.194293+0000","last_unstale":"2024-09-12T18:59:31.415589+0000","last_undegraded":"2024-09-12T18:59:31.415589+0000","last_fullsized":"2024-09-12T18:59:31.415589+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:29.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'199","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.466585+0000","last_change":"2024-09-12T17:40:28.207712+0000","last_active":"2024-09-12T18:56:57.466585+0000","last_peered":"2024-09-12T18:56:57.466585+0000","last_clean":"2024-09-12T18:56:57.466585+0000","last_became_active":"2024-09-12T17:40:28.207048+0000","last_became_peered":"2024-09-12T17:40:28.207048+0000","last_unstale":"2024-09-12T18:56:57.466585+0000","last_undegraded":"2024-09-12T18:56:57.466585+0000","last_fullsized":"2024-09-12T18:56:57.466585+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:43.200882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":318,"num_write":457,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'86","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820038+0000","last_change":"2024-09-12T17:40:20.143011+0000","last_active":"2024-09-12T18:57:27.820038+0000","last_peered":"2024-09-12T18:57:27.820038+0000","last_clean":"2024-09-12T18:57:27.820038+0000","last_became_active":"2024-09-12T17:40:20.142323+0000","last_became_peered":"2024-09-12T17:40:20.142323+0000","last_unstale":"2024-09-12T18:57:27.820038+0000","last_undegraded":"2024-09-12T18:57:27.820038+0000","last_fullsized":"2024-09-12T18:57:27.820038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:05.353429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":391,"num_read_kb":327,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'354","reported_seq":1135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:41.610134+0000","last_change":"2024-09-12T17:40:18.767413+0000","last_active":"2024-09-12T18:56:41.610134+0000","last_peered":"2024-09-12T18:56:41.610134+0000","last_clean":"2024-09-12T18:56:41.610134+0000","last_became_active":"2024-09-12T17:40:18.766817+0000","last_became_peered":"2024-09-12T17:40:18.766817+0000","last_unstale":"2024-09-12T18:56:41.610134+0000","last_undegraded":"2024-09-12T18:56:41.610134+0000","last_fullsized":"2024-09-12T18:56:41.610134+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:50.259112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11303299,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":878,"num_read_kb":8527,"num_write":1293,"num_write_kb":43864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.425422+0000","last_change":"2024-09-12T17:40:11.748529+0000","last_active":"2024-09-12T18:56:02.425422+0000","last_peered":"2024-09-12T18:56:02.425422+0000","last_clean":"2024-09-12T18:56:02.425422+0000","last_became_active":"2024-09-12T17:40:09.674331+0000","last_became_peered":"2024-09-12T17:40:09.674331+0000","last_unstale":"2024-09-12T18:56:02.425422+0000","last_undegraded":"2024-09-12T18:56:02.425422+0000","last_fullsized":"2024-09-12T18:56:02.425422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:20.063434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446575+0000","last_change":"2024-09-12T17:40:22.147841+0000","last_active":"2024-09-12T18:56:42.446575+0000","last_peered":"2024-09-12T18:56:42.446575+0000","last_clean":"2024-09-12T18:56:42.446575+0000","last_became_active":"2024-09-12T17:40:22.147341+0000","last_became_peered":"2024-09-12T17:40:22.147341+0000","last_unstale":"2024-09-12T18:56:42.446575+0000","last_undegraded":"2024-09-12T18:56:42.446575+0000","last_fullsized":"2024-09-12T18:56:42.446575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:33.825775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'774","reported_seq":1504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.694672+0000","last_change":"2024-09-12T17:40:24.330059+0000","last_active":"2024-09-12T18:59:27.694672+0000","last_peered":"2024-09-12T18:59:27.694672+0000","last_clean":"2024-09-12T18:59:27.694672+0000","last_became_active":"2024-09-12T17:40:24.329314+0000","last_became_peered":"2024-09-12T17:40:24.329314+0000","last_unstale":"2024-09-12T18:59:27.694672+0000","last_undegraded":"2024-09-12T18:59:27.694672+0000","last_fullsized":"2024-09-12T18:59:27.694672+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:42.536254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178451,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1364,"num_read_kb":2999,"num_write":1126,"num_write_kb":919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.458785+0000","last_change":"2024-09-12T17:40:26.199233+0000","last_active":"2024-09-12T18:57:32.458785+0000","last_peered":"2024-09-12T18:57:32.458785+0000","last_clean":"2024-09-12T18:57:32.458785+0000","last_became_active":"2024-09-12T17:40:26.197718+0000","last_became_peered":"2024-09-12T17:40:26.197718+0000","last_unstale":"2024-09-12T18:57:32.458785+0000","last_undegraded":"2024-09-12T18:57:32.458785+0000","last_fullsized":"2024-09-12T18:57:32.458785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:57.822527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'117","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.632901+0000","last_change":"2024-09-12T17:40:28.199911+0000","last_active":"2024-09-12T18:56:57.632901+0000","last_peered":"2024-09-12T18:56:57.632901+0000","last_clean":"2024-09-12T18:56:57.632901+0000","last_became_active":"2024-09-12T17:40:28.199295+0000","last_became_peered":"2024-09-12T17:40:28.199295+0000","last_unstale":"2024-09-12T18:56:57.632901+0000","last_undegraded":"2024-09-12T18:56:57.632901+0000","last_fullsized":"2024-09-12T18:56:57.632901+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:22.472810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":147,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'106","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.518640+0000","last_change":"2024-09-12T17:40:28.192741+0000","last_active":"2024-09-12T18:58:06.518640+0000","last_peered":"2024-09-12T18:58:06.518640+0000","last_clean":"2024-09-12T18:58:06.518640+0000","last_became_active":"2024-09-12T17:40:28.192019+0000","last_became_peered":"2024-09-12T17:40:28.192019+0000","last_unstale":"2024-09-12T18:58:06.518640+0000","last_undegraded":"2024-09-12T18:58:06.518640+0000","last_fullsized":"2024-09-12T18:58:06.518640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:03.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":192,"num_write":225,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'111","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.818982+0000","last_change":"2024-09-12T17:40:20.136571+0000","last_active":"2024-09-12T18:57:22.818982+0000","last_peered":"2024-09-12T18:57:22.818982+0000","last_clean":"2024-09-12T18:57:22.818982+0000","last_became_active":"2024-09-12T17:40:20.135868+0000","last_became_peered":"2024-09-12T17:40:20.135868+0000","last_unstale":"2024-09-12T18:57:22.818982+0000","last_undegraded":"2024-09-12T18:57:22.818982+0000","last_fullsized":"2024-09-12T18:57:22.818982+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:37.134752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":445,"num_write":160,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'223","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821377+0000","last_change":"2024-09-12T17:40:18.789847+0000","last_active":"2024-09-12T18:57:32.821377+0000","last_peered":"2024-09-12T18:57:32.821377+0000","last_clean":"2024-09-12T18:57:32.821377+0000","last_became_active":"2024-09-12T17:40:18.788674+0000","last_became_peered":"2024-09-12T17:40:18.788674+0000","last_unstale":"2024-09-12T18:57:32.821377+0000","last_undegraded":"2024-09-12T18:57:32.821377+0000","last_fullsized":"2024-09-12T18:57:32.821377+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:37.689644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6387521,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":354,"num_read_kb":10615,"num_write":846,"num_write_kb":14901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.462809+0000","last_change":"2024-09-12T17:40:22.141831+0000","last_active":"2024-09-12T18:57:22.462809+0000","last_peered":"2024-09-12T18:57:22.462809+0000","last_clean":"2024-09-12T18:57:22.462809+0000","last_became_active":"2024-09-12T17:40:22.141326+0000","last_became_peered":"2024-09-12T17:40:22.141326+0000","last_unstale":"2024-09-12T18:57:22.462809+0000","last_undegraded":"2024-09-12T18:57:22.462809+0000","last_fullsized":"2024-09-12T18:57:22.462809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:09.004014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'299","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.713756+0000","last_change":"2024-09-12T17:40:24.171008+0000","last_active":"2024-09-12T18:59:27.713756+0000","last_peered":"2024-09-12T18:59:27.713756+0000","last_clean":"2024-09-12T18:59:27.713756+0000","last_became_active":"2024-09-12T17:40:24.169248+0000","last_became_peered":"2024-09-12T17:40:24.169248+0000","last_unstale":"2024-09-12T18:59:27.713756+0000","last_undegraded":"2024-09-12T18:59:27.713756+0000","last_fullsized":"2024-09-12T18:59:27.713756+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:18.401232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60948,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":1072,"num_write":414,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457958+0000","last_change":"2024-09-12T17:40:26.204596+0000","last_active":"2024-09-12T18:57:27.457958+0000","last_peered":"2024-09-12T18:57:27.457958+0000","last_clean":"2024-09-12T18:57:27.457958+0000","last_became_active":"2024-09-12T17:40:26.203855+0000","last_became_peered":"2024-09-12T17:40:26.203855+0000","last_unstale":"2024-09-12T18:57:27.457958+0000","last_undegraded":"2024-09-12T18:57:27.457958+0000","last_fullsized":"2024-09-12T18:57:27.457958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:26.029987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.597637+0000","last_change":"2024-09-12T17:40:28.205116+0000","last_active":"2024-09-12T18:57:32.597637+0000","last_peered":"2024-09-12T18:57:32.597637+0000","last_clean":"2024-09-12T18:57:32.597637+0000","last_became_active":"2024-09-12T17:40:28.204204+0000","last_became_peered":"2024-09-12T17:40:28.204204+0000","last_unstale":"2024-09-12T18:57:32.597637+0000","last_undegraded":"2024-09-12T18:57:32.597637+0000","last_fullsized":"2024-09-12T18:57:32.597637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:13.281028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":252,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'238","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.462857+0000","last_change":"2024-09-12T17:40:20.128888+0000","last_active":"2024-09-12T18:57:22.462857+0000","last_peered":"2024-09-12T18:57:22.462857+0000","last_clean":"2024-09-12T18:57:22.462857+0000","last_became_active":"2024-09-12T17:40:20.128532+0000","last_became_peered":"2024-09-12T17:40:20.128532+0000","last_unstale":"2024-09-12T18:57:22.462857+0000","last_undegraded":"2024-09-12T18:57:22.462857+0000","last_fullsized":"2024-09-12T18:57:22.462857+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:10.062006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":846,"num_write":360,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'325","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:23.456540+0000","last_change":"2024-09-12T17:40:55.306539+0000","last_active":"2024-09-12T18:57:23.456540+0000","last_peered":"2024-09-12T18:57:23.456540+0000","last_clean":"2024-09-12T18:57:23.456540+0000","last_became_active":"2024-09-12T17:40:55.305689+0000","last_became_peered":"2024-09-12T17:40:55.305689+0000","last_unstale":"2024-09-12T18:57:23.456540+0000","last_undegraded":"2024-09-12T18:57:23.456540+0000","last_fullsized":"2024-09-12T18:57:23.456540+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:55.468206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17849249,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":566,"num_read_kb":44915,"num_write":1234,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.457130+0000","last_change":"2024-09-12T17:40:22.143900+0000","last_active":"2024-09-12T18:57:22.457130+0000","last_peered":"2024-09-12T18:57:22.457130+0000","last_clean":"2024-09-12T18:57:22.457130+0000","last_became_active":"2024-09-12T17:40:22.143466+0000","last_became_peered":"2024-09-12T17:40:22.143466+0000","last_unstale":"2024-09-12T18:57:22.457130+0000","last_undegraded":"2024-09-12T18:57:22.457130+0000","last_fullsized":"2024-09-12T18:57:22.457130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:12.032718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'61","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473152+0000","last_change":"2024-09-12T17:40:24.152265+0000","last_active":"2024-09-12T18:57:27.473152+0000","last_peered":"2024-09-12T18:57:27.473152+0000","last_clean":"2024-09-12T18:57:27.473152+0000","last_became_active":"2024-09-12T17:40:24.151530+0000","last_became_peered":"2024-09-12T17:40:24.151530+0000","last_unstale":"2024-09-12T18:57:27.473152+0000","last_undegraded":"2024-09-12T18:57:27.473152+0000","last_fullsized":"2024-09-12T18:57:27.473152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:13.980036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457196+0000","last_change":"2024-09-12T17:40:26.187903+0000","last_active":"2024-09-12T18:57:27.457196+0000","last_peered":"2024-09-12T18:57:27.457196+0000","last_clean":"2024-09-12T18:57:27.457196+0000","last_became_active":"2024-09-12T17:40:26.187122+0000","last_became_peered":"2024-09-12T17:40:26.187122+0000","last_unstale":"2024-09-12T18:57:27.457196+0000","last_undegraded":"2024-09-12T18:57:27.457196+0000","last_fullsized":"2024-09-12T18:57:27.457196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:36.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'248","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.372703+0000","last_change":"2024-09-12T17:40:28.194923+0000","last_active":"2024-09-12T18:58:04.372703+0000","last_peered":"2024-09-12T18:58:04.372703+0000","last_clean":"2024-09-12T18:58:04.372703+0000","last_became_active":"2024-09-12T17:40:28.194047+0000","last_became_peered":"2024-09-12T17:40:28.194047+0000","last_unstale":"2024-09-12T18:58:04.372703+0000","last_undegraded":"2024-09-12T18:58:04.372703+0000","last_fullsized":"2024-09-12T18:58:04.372703+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:44.148991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":352,"num_write":540,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'120","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.457021+0000","last_change":"2024-09-12T17:40:20.130891+0000","last_active":"2024-09-12T18:57:22.457021+0000","last_peered":"2024-09-12T18:57:22.457021+0000","last_clean":"2024-09-12T18:57:22.457021+0000","last_became_active":"2024-09-12T17:40:20.130567+0000","last_became_peered":"2024-09-12T17:40:20.130567+0000","last_unstale":"2024-09-12T18:57:22.457021+0000","last_undegraded":"2024-09-12T18:57:22.457021+0000","last_fullsized":"2024-09-12T18:57:22.457021+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:59.283457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":440,"num_write":198,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'320","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:18.554738+0000","last_change":"2024-09-12T17:40:18.781889+0000","last_active":"2024-09-12T18:56:18.554738+0000","last_peered":"2024-09-12T18:56:18.554738+0000","last_clean":"2024-09-12T18:56:18.554738+0000","last_became_active":"2024-09-12T17:40:18.781135+0000","last_became_peered":"2024-09-12T17:40:18.781135+0000","last_unstale":"2024-09-12T18:56:18.554738+0000","last_undegraded":"2024-09-12T18:56:18.554738+0000","last_fullsized":"2024-09-12T18:56:18.554738+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:39.897090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10870011,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":603,"num_read_kb":11926,"num_write":1125,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456026+0000","last_change":"2024-09-12T17:40:22.151655+0000","last_active":"2024-09-12T18:57:22.456026+0000","last_peered":"2024-09-12T18:57:22.456026+0000","last_clean":"2024-09-12T18:57:22.456026+0000","last_became_active":"2024-09-12T17:40:22.150912+0000","last_became_peered":"2024-09-12T17:40:22.150912+0000","last_unstale":"2024-09-12T18:57:22.456026+0000","last_undegraded":"2024-09-12T18:57:22.456026+0000","last_fullsized":"2024-09-12T18:57:22.456026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:49.335095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'337","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.682727+0000","last_change":"2024-09-12T17:40:24.177728+0000","last_active":"2024-09-12T18:59:27.682727+0000","last_peered":"2024-09-12T18:59:27.682727+0000","last_clean":"2024-09-12T18:59:27.682727+0000","last_became_active":"2024-09-12T17:40:24.176722+0000","last_became_peered":"2024-09-12T17:40:24.176722+0000","last_unstale":"2024-09-12T18:59:27.682727+0000","last_undegraded":"2024-09-12T18:59:27.682727+0000","last_fullsized":"2024-09-12T18:59:27.682727+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.865870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62937,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1095,"num_write":436,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443157+0000","last_change":"2024-09-12T17:40:26.168192+0000","last_active":"2024-09-12T18:57:27.443157+0000","last_peered":"2024-09-12T18:57:27.443157+0000","last_clean":"2024-09-12T18:57:27.443157+0000","last_became_active":"2024-09-12T17:40:26.167280+0000","last_became_peered":"2024-09-12T17:40:26.167280+0000","last_unstale":"2024-09-12T18:57:27.443157+0000","last_undegraded":"2024-09-12T18:57:27.443157+0000","last_fullsized":"2024-09-12T18:57:27.443157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:03.370653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'106","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.559076+0000","last_change":"2024-09-12T17:40:28.194951+0000","last_active":"2024-09-12T18:58:04.559076+0000","last_peered":"2024-09-12T18:58:04.559076+0000","last_clean":"2024-09-12T18:58:04.559076+0000","last_became_active":"2024-09-12T17:40:28.192629+0000","last_became_peered":"2024-09-12T17:40:28.192629+0000","last_unstale":"2024-09-12T18:58:04.559076+0000","last_undegraded":"2024-09-12T18:58:04.559076+0000","last_fullsized":"2024-09-12T18:58:04.559076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:40.252151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456946+0000","last_change":"2024-09-12T17:40:55.302689+0000","last_active":"2024-09-12T18:57:22.456946+0000","last_peered":"2024-09-12T18:57:22.456946+0000","last_clean":"2024-09-12T18:57:22.456946+0000","last_became_active":"2024-09-12T17:40:55.301950+0000","last_became_peered":"2024-09-12T17:40:55.301950+0000","last_unstale":"2024-09-12T18:57:22.456946+0000","last_undegraded":"2024-09-12T18:57:22.456946+0000","last_fullsized":"2024-09-12T18:57:22.456946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.652662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":400,"num_write":158,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'323","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:19.308683+0000","last_change":"2024-09-12T17:40:18.755957+0000","last_active":"2024-09-12T18:59:19.308683+0000","last_peered":"2024-09-12T18:59:19.308683+0000","last_clean":"2024-09-12T18:59:19.308683+0000","last_became_active":"2024-09-12T17:40:18.755694+0000","last_became_peered":"2024-09-12T17:40:18.755694+0000","last_unstale":"2024-09-12T18:59:19.308683+0000","last_undegraded":"2024-09-12T18:59:19.308683+0000","last_fullsized":"2024-09-12T18:59:19.308683+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:08.561309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14056521,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":484,"num_read_kb":35553,"num_write":1195,"num_write_kb":53517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.442028+0000","last_change":"2024-09-12T17:40:22.136120+0000","last_active":"2024-09-12T18:57:22.442028+0000","last_peered":"2024-09-12T18:57:22.442028+0000","last_clean":"2024-09-12T18:57:22.442028+0000","last_became_active":"2024-09-12T17:40:22.135547+0000","last_became_peered":"2024-09-12T17:40:22.135547+0000","last_unstale":"2024-09-12T18:57:22.442028+0000","last_undegraded":"2024-09-12T18:57:22.442028+0000","last_fullsized":"2024-09-12T18:57:22.442028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:28.203301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'304","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.672666+0000","last_change":"2024-09-12T17:40:24.163735+0000","last_active":"2024-09-12T18:59:27.672666+0000","last_peered":"2024-09-12T18:59:27.672666+0000","last_clean":"2024-09-12T18:59:27.672666+0000","last_became_active":"2024-09-12T17:40:24.162901+0000","last_became_peered":"2024-09-12T17:40:24.162901+0000","last_unstale":"2024-09-12T18:59:27.672666+0000","last_undegraded":"2024-09-12T18:59:27.672666+0000","last_fullsized":"2024-09-12T18:59:27.672666+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:08.268660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66249,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":495,"num_read_kb":1080,"num_write":410,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473259+0000","last_change":"2024-09-12T17:40:26.191520+0000","last_active":"2024-09-12T18:57:27.473259+0000","last_peered":"2024-09-12T18:57:27.473259+0000","last_clean":"2024-09-12T18:57:27.473259+0000","last_became_active":"2024-09-12T17:40:26.190755+0000","last_became_peered":"2024-09-12T17:40:26.190755+0000","last_unstale":"2024-09-12T18:57:27.473259+0000","last_undegraded":"2024-09-12T18:57:27.473259+0000","last_fullsized":"2024-09-12T18:57:27.473259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:00.734100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'428","reported_seq":1192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443251+0000","last_change":"2024-09-12T17:40:20.128385+0000","last_active":"2024-09-12T18:57:27.443251+0000","last_peered":"2024-09-12T18:57:27.443251+0000","last_clean":"2024-09-12T18:57:27.443251+0000","last_became_active":"2024-09-12T17:40:20.127413+0000","last_became_peered":"2024-09-12T17:40:20.127413+0000","last_unstale":"2024-09-12T18:57:27.443251+0000","last_undegraded":"2024-09-12T18:57:27.443251+0000","last_fullsized":"2024-09-12T18:57:27.443251+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:36.669281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2096,"num_read_kb":1807,"num_write":754,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'282","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:34.458382+0000","last_change":"2024-09-12T17:40:18.759774+0000","last_active":"2024-09-12T18:55:34.458382+0000","last_peered":"2024-09-12T18:55:34.458382+0000","last_clean":"2024-09-12T18:55:34.458382+0000","last_became_active":"2024-09-12T17:40:18.759467+0000","last_became_peered":"2024-09-12T17:40:18.759467+0000","last_unstale":"2024-09-12T18:55:34.458382+0000","last_undegraded":"2024-09-12T18:55:34.458382+0000","last_fullsized":"2024-09-12T18:55:34.458382+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:33.483800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8811196,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":453,"num_read_kb":67738,"num_write":1036,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.462225+0000","last_change":"2024-09-12T17:40:22.144503+0000","last_active":"2024-09-12T18:56:37.462225+0000","last_peered":"2024-09-12T18:56:37.462225+0000","last_clean":"2024-09-12T18:56:37.462225+0000","last_became_active":"2024-09-12T17:40:22.143764+0000","last_became_peered":"2024-09-12T17:40:22.143764+0000","last_unstale":"2024-09-12T18:56:37.462225+0000","last_undegraded":"2024-09-12T18:56:37.462225+0000","last_fullsized":"2024-09-12T18:56:37.462225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:07.658407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'529","reported_seq":1166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.671468+0000","last_change":"2024-09-12T17:40:24.179162+0000","last_active":"2024-09-12T18:59:27.671468+0000","last_peered":"2024-09-12T18:59:27.671468+0000","last_clean":"2024-09-12T18:59:27.671468+0000","last_became_active":"2024-09-12T17:40:24.178354+0000","last_became_peered":"2024-09-12T17:40:24.178354+0000","last_unstale":"2024-09-12T18:59:27.671468+0000","last_undegraded":"2024-09-12T18:59:27.671468+0000","last_fullsized":"2024-09-12T18:59:27.671468+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:39.728053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138484,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":927,"num_read_kb":2071,"num_write":814,"num_write_kb":738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.612487+0000","last_change":"2024-09-12T17:40:26.185364+0000","last_active":"2024-09-12T18:55:27.612487+0000","last_peered":"2024-09-12T18:55:27.612487+0000","last_clean":"2024-09-12T18:55:27.612487+0000","last_became_active":"2024-09-12T17:40:26.184572+0000","last_became_peered":"2024-09-12T17:40:26.184572+0000","last_unstale":"2024-09-12T18:55:27.612487+0000","last_undegraded":"2024-09-12T18:55:27.612487+0000","last_fullsized":"2024-09-12T18:55:27.612487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:35.867018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'243","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:05.971764+0000","last_change":"2024-09-12T17:40:28.201022+0000","last_active":"2024-09-12T18:58:05.971764+0000","last_peered":"2024-09-12T18:58:05.971764+0000","last_clean":"2024-09-12T18:58:05.971764+0000","last_became_active":"2024-09-12T17:40:28.200289+0000","last_became_peered":"2024-09-12T17:40:28.200289+0000","last_unstale":"2024-09-12T18:58:05.971764+0000","last_undegraded":"2024-09-12T18:58:05.971764+0000","last_fullsized":"2024-09-12T18:58:05.971764+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:57.750960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":402,"num_read_kb":380,"num_write":484,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'278","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.462201+0000","last_change":"2024-09-12T17:40:20.129095+0000","last_active":"2024-09-12T18:56:37.462201+0000","last_peered":"2024-09-12T18:56:37.462201+0000","last_clean":"2024-09-12T18:56:37.462201+0000","last_became_active":"2024-09-12T17:40:20.128840+0000","last_became_peered":"2024-09-12T17:40:20.128840+0000","last_unstale":"2024-09-12T18:56:37.462201+0000","last_undegraded":"2024-09-12T18:56:37.462201+0000","last_fullsized":"2024-09-12T18:56:37.462201+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:40.313847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1419,"num_read_kb":1187,"num_write":525,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'241","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.108435+0000","last_change":"2024-09-12T17:40:18.763123+0000","last_active":"2024-09-12T18:57:45.108435+0000","last_peered":"2024-09-12T18:57:45.108435+0000","last_clean":"2024-09-12T18:57:45.108435+0000","last_became_active":"2024-09-12T17:40:18.762421+0000","last_became_peered":"2024-09-12T17:40:18.762421+0000","last_unstale":"2024-09-12T18:57:45.108435+0000","last_undegraded":"2024-09-12T18:57:45.108435+0000","last_fullsized":"2024-09-12T18:57:45.108435+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:57.212684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4246739,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":369,"num_read_kb":9963,"num_write":906,"num_write_kb":16756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443274+0000","last_change":"2024-09-12T17:40:22.134660+0000","last_active":"2024-09-12T18:57:27.443274+0000","last_peered":"2024-09-12T18:57:27.443274+0000","last_clean":"2024-09-12T18:57:27.443274+0000","last_became_active":"2024-09-12T17:40:22.133919+0000","last_became_peered":"2024-09-12T17:40:22.133919+0000","last_unstale":"2024-09-12T18:57:27.443274+0000","last_undegraded":"2024-09-12T18:57:27.443274+0000","last_fullsized":"2024-09-12T18:57:27.443274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:06.193287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'308","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464883+0000","last_change":"2024-09-12T17:40:24.168575+0000","last_active":"2024-09-12T18:57:57.464883+0000","last_peered":"2024-09-12T18:57:57.464883+0000","last_clean":"2024-09-12T18:57:57.464883+0000","last_became_active":"2024-09-12T17:40:24.167870+0000","last_became_peered":"2024-09-12T17:40:24.167870+0000","last_unstale":"2024-09-12T18:57:57.464883+0000","last_undegraded":"2024-09-12T18:57:57.464883+0000","last_fullsized":"2024-09-12T18:57:57.464883+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:06.921434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52491,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":980,"num_write":420,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.438227+0000","last_change":"2024-09-12T17:40:26.199740+0000","last_active":"2024-09-12T18:55:27.438227+0000","last_peered":"2024-09-12T18:55:27.438227+0000","last_clean":"2024-09-12T18:55:27.438227+0000","last_became_active":"2024-09-12T17:40:26.199065+0000","last_became_peered":"2024-09-12T17:40:26.199065+0000","last_unstale":"2024-09-12T18:55:27.438227+0000","last_undegraded":"2024-09-12T18:55:27.438227+0000","last_fullsized":"2024-09-12T18:55:27.438227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:29.279788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'184","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:00.492872+0000","last_change":"2024-09-12T17:40:28.193740+0000","last_active":"2024-09-12T18:58:00.492872+0000","last_peered":"2024-09-12T18:58:00.492872+0000","last_clean":"2024-09-12T18:58:00.492872+0000","last_became_active":"2024-09-12T17:40:28.192588+0000","last_became_peered":"2024-09-12T17:40:28.192588+0000","last_unstale":"2024-09-12T18:58:00.492872+0000","last_undegraded":"2024-09-12T18:58:00.492872+0000","last_fullsized":"2024-09-12T18:58:00.492872+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:35.257214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":737,"num_read_kb":706,"num_write":515,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'254","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:55.231898+0000","last_change":"2024-09-12T17:40:20.133443+0000","last_active":"2024-09-12T18:56:55.231898+0000","last_peered":"2024-09-12T18:56:55.231898+0000","last_clean":"2024-09-12T18:56:55.231898+0000","last_became_active":"2024-09-12T17:40:20.133067+0000","last_became_peered":"2024-09-12T17:40:20.133067+0000","last_unstale":"2024-09-12T18:56:55.231898+0000","last_undegraded":"2024-09-12T18:56:55.231898+0000","last_fullsized":"2024-09-12T18:56:55.231898+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:22.211007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1200,"num_read_kb":1015,"num_write":444,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'268","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.792878+0000","last_change":"2024-09-12T17:40:18.773839+0000","last_active":"2024-09-12T18:55:22.792878+0000","last_peered":"2024-09-12T18:55:22.792878+0000","last_clean":"2024-09-12T18:55:22.792878+0000","last_became_active":"2024-09-12T17:40:18.773029+0000","last_became_peered":"2024-09-12T17:40:18.773029+0000","last_unstale":"2024-09-12T18:55:22.792878+0000","last_undegraded":"2024-09-12T18:55:22.792878+0000","last_fullsized":"2024-09-12T18:55:22.792878+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:13.992637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10005600,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":353,"num_read_kb":38404,"num_write":1013,"num_write_kb":31393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793065+0000","last_change":"2024-09-12T17:40:22.146616+0000","last_active":"2024-09-12T18:55:22.793065+0000","last_peered":"2024-09-12T18:55:22.793065+0000","last_clean":"2024-09-12T18:55:22.793065+0000","last_became_active":"2024-09-12T17:40:22.145871+0000","last_became_peered":"2024-09-12T17:40:22.145871+0000","last_unstale":"2024-09-12T18:55:22.793065+0000","last_undegraded":"2024-09-12T18:55:22.793065+0000","last_fullsized":"2024-09-12T18:55:22.793065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:17.363777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'303","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.725748+0000","last_change":"2024-09-12T17:40:24.330122+0000","last_active":"2024-09-12T18:59:27.725748+0000","last_peered":"2024-09-12T18:59:27.725748+0000","last_clean":"2024-09-12T18:59:27.725748+0000","last_became_active":"2024-09-12T17:40:24.329413+0000","last_became_peered":"2024-09-12T17:40:24.329413+0000","last_unstale":"2024-09-12T18:59:27.725748+0000","last_undegraded":"2024-09-12T18:59:27.725748+0000","last_fullsized":"2024-09-12T18:59:27.725748+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:11.778689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60142,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":1065,"num_write":414,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.455205+0000","last_change":"2024-09-12T17:40:26.199588+0000","last_active":"2024-09-12T18:56:47.455205+0000","last_peered":"2024-09-12T18:56:47.455205+0000","last_clean":"2024-09-12T18:56:47.455205+0000","last_became_active":"2024-09-12T17:40:26.198930+0000","last_became_peered":"2024-09-12T17:40:26.198930+0000","last_unstale":"2024-09-12T18:56:47.455205+0000","last_undegraded":"2024-09-12T18:56:47.455205+0000","last_fullsized":"2024-09-12T18:56:47.455205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:48.763531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'117","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.763203+0000","last_change":"2024-09-12T17:40:28.194240+0000","last_active":"2024-09-12T18:59:27.763203+0000","last_peered":"2024-09-12T18:59:27.763203+0000","last_clean":"2024-09-12T18:59:27.763203+0000","last_became_active":"2024-09-12T17:40:28.192689+0000","last_became_peered":"2024-09-12T17:40:28.192689+0000","last_unstale":"2024-09-12T18:59:27.763203+0000","last_undegraded":"2024-09-12T18:59:27.763203+0000","last_fullsized":"2024-09-12T18:59:27.763203+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:53.085665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":258,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'197","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:19.424791+0000","last_change":"2024-09-12T17:40:20.133429+0000","last_active":"2024-09-12T18:55:19.424791+0000","last_peered":"2024-09-12T18:55:19.424791+0000","last_clean":"2024-09-12T18:55:19.424791+0000","last_became_active":"2024-09-12T17:40:20.132998+0000","last_became_peered":"2024-09-12T17:40:20.132998+0000","last_unstale":"2024-09-12T18:55:19.424791+0000","last_undegraded":"2024-09-12T18:55:19.424791+0000","last_fullsized":"2024-09-12T18:55:19.424791+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:53.514892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":791,"num_read_kb":641,"num_write":284,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'361","reported_seq":1104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.445890+0000","last_change":"2024-09-12T17:40:18.775765+0000","last_active":"2024-09-12T18:55:22.445890+0000","last_peered":"2024-09-12T18:55:22.445890+0000","last_clean":"2024-09-12T18:55:22.445890+0000","last_became_active":"2024-09-12T17:40:18.774892+0000","last_became_peered":"2024-09-12T17:40:18.774892+0000","last_unstale":"2024-09-12T18:55:22.445890+0000","last_undegraded":"2024-09-12T18:55:22.445890+0000","last_fullsized":"2024-09-12T18:55:22.445890+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:12.027391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15589393,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":658,"num_read_kb":87832,"num_write":1341,"num_write_kb":30285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.437110+0000","last_change":"2024-09-12T17:40:22.142115+0000","last_active":"2024-09-12T18:55:22.437110+0000","last_peered":"2024-09-12T18:55:22.437110+0000","last_clean":"2024-09-12T18:55:22.437110+0000","last_became_active":"2024-09-12T17:40:22.141670+0000","last_became_peered":"2024-09-12T17:40:22.141670+0000","last_unstale":"2024-09-12T18:55:22.437110+0000","last_undegraded":"2024-09-12T18:55:22.437110+0000","last_fullsized":"2024-09-12T18:55:22.437110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:01.417527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'131","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.809263+0000","last_change":"2024-09-12T17:40:24.330200+0000","last_active":"2024-09-12T18:56:37.809263+0000","last_peered":"2024-09-12T18:56:37.809263+0000","last_clean":"2024-09-12T18:56:37.809263+0000","last_became_active":"2024-09-12T17:40:24.329446+0000","last_became_peered":"2024-09-12T17:40:24.329446+0000","last_unstale":"2024-09-12T18:56:37.809263+0000","last_undegraded":"2024-09-12T18:56:37.809263+0000","last_fullsized":"2024-09-12T18:56:37.809263+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:39.604725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'750","reported_seq":4493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:31.363117+0000","last_change":"2024-09-12T17:40:26.193089+0000","last_active":"2024-09-12T18:59:31.363117+0000","last_peered":"2024-09-12T18:59:31.363117+0000","last_clean":"2024-09-12T18:59:31.363117+0000","last_became_active":"2024-09-12T17:40:26.192341+0000","last_became_peered":"2024-09-12T17:40:26.192341+0000","last_unstale":"2024-09-12T18:59:31.363117+0000","last_undegraded":"2024-09-12T18:59:31.363117+0000","last_fullsized":"2024-09-12T18:59:31.363117+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:04.649327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'116","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457136+0000","last_change":"2024-09-12T17:40:28.187817+0000","last_active":"2024-09-12T18:57:27.457136+0000","last_peered":"2024-09-12T18:57:27.457136+0000","last_clean":"2024-09-12T18:57:27.457136+0000","last_became_active":"2024-09-12T17:40:28.187089+0000","last_became_peered":"2024-09-12T17:40:28.187089+0000","last_unstale":"2024-09-12T18:57:27.457136+0000","last_undegraded":"2024-09-12T18:57:27.457136+0000","last_fullsized":"2024-09-12T18:57:27.457136+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:39.669386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'387","reported_seq":1131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.792997+0000","last_change":"2024-09-12T17:40:20.143118+0000","last_active":"2024-09-12T18:55:22.792997+0000","last_peered":"2024-09-12T18:55:22.792997+0000","last_clean":"2024-09-12T18:55:22.792997+0000","last_became_active":"2024-09-12T17:40:20.142478+0000","last_became_peered":"2024-09-12T17:40:20.142478+0000","last_unstale":"2024-09-12T18:55:22.792997+0000","last_undegraded":"2024-09-12T18:55:22.792997+0000","last_fullsized":"2024-09-12T18:55:22.792997+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:38.246221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1845,"num_read_kb":1583,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'277","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:59.433256+0000","last_change":"2024-09-12T17:40:55.331083+0000","last_active":"2024-09-12T18:55:59.433256+0000","last_peered":"2024-09-12T18:55:59.433256+0000","last_clean":"2024-09-12T18:55:59.433256+0000","last_became_active":"2024-09-12T17:40:55.330696+0000","last_became_peered":"2024-09-12T17:40:55.330696+0000","last_unstale":"2024-09-12T18:55:59.433256+0000","last_undegraded":"2024-09-12T18:55:59.433256+0000","last_fullsized":"2024-09-12T18:55:59.433256+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:46.573367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5332400,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":853,"num_read_kb":9625,"num_write":1128,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427131+0000","last_change":"2024-09-12T17:40:22.152165+0000","last_active":"2024-09-12T18:55:22.427131+0000","last_peered":"2024-09-12T18:55:22.427131+0000","last_clean":"2024-09-12T18:55:22.427131+0000","last_became_active":"2024-09-12T17:40:22.151083+0000","last_became_peered":"2024-09-12T17:40:22.151083+0000","last_unstale":"2024-09-12T18:55:22.427131+0000","last_undegraded":"2024-09-12T18:55:22.427131+0000","last_fullsized":"2024-09-12T18:55:22.427131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:28.338986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'330","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.658405+0000","last_change":"2024-09-12T17:40:24.174149+0000","last_active":"2024-09-12T18:58:02.658405+0000","last_peered":"2024-09-12T18:58:02.658405+0000","last_clean":"2024-09-12T18:58:02.658405+0000","last_became_active":"2024-09-12T17:40:24.173360+0000","last_became_peered":"2024-09-12T17:40:24.173360+0000","last_unstale":"2024-09-12T18:58:02.658405+0000","last_undegraded":"2024-09-12T18:58:02.658405+0000","last_fullsized":"2024-09-12T18:58:02.658405+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:01.318365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70298,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":548,"num_read_kb":1110,"num_write":440,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.445804+0000","last_change":"2024-09-12T17:40:26.164532+0000","last_active":"2024-09-12T18:55:22.445804+0000","last_peered":"2024-09-12T18:55:22.445804+0000","last_clean":"2024-09-12T18:55:22.445804+0000","last_became_active":"2024-09-12T17:40:26.163773+0000","last_became_peered":"2024-09-12T17:40:26.163773+0000","last_unstale":"2024-09-12T18:55:22.445804+0000","last_undegraded":"2024-09-12T18:55:22.445804+0000","last_fullsized":"2024-09-12T18:55:22.445804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:29.445382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'102","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.270680+0000","last_change":"2024-09-12T17:40:28.199692+0000","last_active":"2024-09-12T18:58:02.270680+0000","last_peered":"2024-09-12T18:58:02.270680+0000","last_clean":"2024-09-12T18:58:02.270680+0000","last_became_active":"2024-09-12T17:40:28.198792+0000","last_became_peered":"2024-09-12T17:40:28.198792+0000","last_unstale":"2024-09-12T18:58:02.270680+0000","last_undegraded":"2024-09-12T18:58:02.270680+0000","last_fullsized":"2024-09-12T18:58:02.270680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:10.816115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":239,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'185","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.792933+0000","last_change":"2024-09-12T17:40:20.147084+0000","last_active":"2024-09-12T18:55:22.792933+0000","last_peered":"2024-09-12T18:55:22.792933+0000","last_clean":"2024-09-12T18:55:22.792933+0000","last_became_active":"2024-09-12T17:40:20.136564+0000","last_became_peered":"2024-09-12T17:40:20.136564+0000","last_unstale":"2024-09-12T18:55:22.792933+0000","last_undegraded":"2024-09-12T18:55:22.792933+0000","last_fullsized":"2024-09-12T18:55:22.792933+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:10.062006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":640,"num_write":266,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'353","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.083750+0000","last_change":"2024-09-12T17:40:18.782734+0000","last_active":"2024-09-12T18:57:45.083750+0000","last_peered":"2024-09-12T18:57:45.083750+0000","last_clean":"2024-09-12T18:57:45.083750+0000","last_became_active":"2024-09-12T17:40:18.779946+0000","last_became_peered":"2024-09-12T17:40:18.779946+0000","last_unstale":"2024-09-12T18:57:45.083750+0000","last_undegraded":"2024-09-12T18:57:45.083750+0000","last_fullsized":"2024-09-12T18:57:45.083750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:48.387265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12103370,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":646,"num_read_kb":21189,"num_write":1128,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.611277+0000","last_change":"2024-09-12T17:40:22.138047+0000","last_active":"2024-09-12T18:55:22.611277+0000","last_peered":"2024-09-12T18:55:22.611277+0000","last_clean":"2024-09-12T18:55:22.611277+0000","last_became_active":"2024-09-12T17:40:22.137291+0000","last_became_peered":"2024-09-12T17:40:22.137291+0000","last_unstale":"2024-09-12T18:55:22.611277+0000","last_undegraded":"2024-09-12T18:55:22.611277+0000","last_fullsized":"2024-09-12T18:55:22.611277+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:51.771726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'259","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.477834+0000","last_change":"2024-09-12T17:40:24.175430+0000","last_active":"2024-09-12T18:57:47.477834+0000","last_peered":"2024-09-12T18:57:47.477834+0000","last_clean":"2024-09-12T18:57:47.477834+0000","last_became_active":"2024-09-12T17:40:24.174681+0000","last_became_peered":"2024-09-12T17:40:24.174681+0000","last_unstale":"2024-09-12T18:57:47.477834+0000","last_undegraded":"2024-09-12T18:57:47.477834+0000","last_fullsized":"2024-09-12T18:57:47.477834+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:33.406641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":890,"num_write":338,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421121+0000","last_change":"2024-09-12T17:40:26.188512+0000","last_active":"2024-09-12T18:55:42.421121+0000","last_peered":"2024-09-12T18:55:42.421121+0000","last_clean":"2024-09-12T18:55:42.421121+0000","last_became_active":"2024-09-12T17:40:26.187438+0000","last_became_peered":"2024-09-12T17:40:26.187438+0000","last_unstale":"2024-09-12T18:55:42.421121+0000","last_undegraded":"2024-09-12T18:55:42.421121+0000","last_fullsized":"2024-09-12T18:55:42.421121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:20.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'124","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427909+0000","last_change":"2024-09-12T17:40:28.202550+0000","last_active":"2024-09-12T18:55:22.427909+0000","last_peered":"2024-09-12T18:55:22.427909+0000","last_clean":"2024-09-12T18:55:22.427909+0000","last_became_active":"2024-09-12T17:40:28.201534+0000","last_became_peered":"2024-09-12T17:40:28.201534+0000","last_unstale":"2024-09-12T18:55:22.427909+0000","last_undegraded":"2024-09-12T18:55:22.427909+0000","last_fullsized":"2024-09-12T18:55:22.427909+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:43.430181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":291,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'52","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:37.431358+0000","last_change":"2024-09-12T17:40:20.117919+0000","last_active":"2024-09-12T18:55:37.431358+0000","last_peered":"2024-09-12T18:55:37.431358+0000","last_clean":"2024-09-12T18:55:37.431358+0000","last_became_active":"2024-09-12T17:40:20.117604+0000","last_became_peered":"2024-09-12T17:40:20.117604+0000","last_unstale":"2024-09-12T18:55:37.431358+0000","last_undegraded":"2024-09-12T18:55:37.431358+0000","last_fullsized":"2024-09-12T18:55:37.431358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:01.530409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":67,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'272","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446902+0000","last_change":"2024-09-12T17:40:18.767654+0000","last_active":"2024-09-12T18:56:42.446902+0000","last_peered":"2024-09-12T18:56:42.446902+0000","last_clean":"2024-09-12T18:56:42.446902+0000","last_became_active":"2024-09-12T17:40:18.767103+0000","last_became_peered":"2024-09-12T17:40:18.767103+0000","last_unstale":"2024-09-12T18:56:42.446902+0000","last_undegraded":"2024-09-12T18:56:42.446902+0000","last_fullsized":"2024-09-12T18:56:42.446902+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:13.247336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15730389,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":384,"num_read_kb":34280,"num_write":1016,"num_write_kb":41945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.791546+0000","last_change":"2024-09-12T17:40:22.135061+0000","last_active":"2024-09-12T18:55:17.791546+0000","last_peered":"2024-09-12T18:55:17.791546+0000","last_clean":"2024-09-12T18:55:17.791546+0000","last_became_active":"2024-09-12T17:40:22.134242+0000","last_became_peered":"2024-09-12T17:40:22.134242+0000","last_unstale":"2024-09-12T18:55:17.791546+0000","last_undegraded":"2024-09-12T18:55:17.791546+0000","last_fullsized":"2024-09-12T18:55:17.791546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:19.741434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'234","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464348+0000","last_change":"2024-09-12T17:40:24.183504+0000","last_active":"2024-09-12T18:57:57.464348+0000","last_peered":"2024-09-12T18:57:57.464348+0000","last_clean":"2024-09-12T18:57:57.464348+0000","last_became_active":"2024-09-12T17:40:24.181581+0000","last_became_peered":"2024-09-12T17:40:24.181581+0000","last_unstale":"2024-09-12T18:57:57.464348+0000","last_undegraded":"2024-09-12T18:57:57.464348+0000","last_fullsized":"2024-09-12T18:57:57.464348+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:34.205562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54177,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":858,"num_write":310,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.794291+0000","last_change":"2024-09-12T17:40:26.196580+0000","last_active":"2024-09-12T18:55:27.794291+0000","last_peered":"2024-09-12T18:55:27.794291+0000","last_clean":"2024-09-12T18:55:27.794291+0000","last_became_active":"2024-09-12T17:40:26.195603+0000","last_became_peered":"2024-09-12T17:40:26.195603+0000","last_unstale":"2024-09-12T18:55:27.794291+0000","last_undegraded":"2024-09-12T18:55:27.794291+0000","last_fullsized":"2024-09-12T18:55:27.794291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:00.612716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'168","reported_seq":1281,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:00.089777+0000","last_change":"2024-09-12T17:40:28.200915+0000","last_active":"2024-09-12T18:58:00.089777+0000","last_peered":"2024-09-12T18:58:00.089777+0000","last_clean":"2024-09-12T18:58:00.089777+0000","last_became_active":"2024-09-12T17:40:28.200126+0000","last_became_peered":"2024-09-12T17:40:28.200126+0000","last_unstale":"2024-09-12T18:58:00.089777+0000","last_undegraded":"2024-09-12T18:58:00.089777+0000","last_fullsized":"2024-09-12T18:58:00.089777+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:27.740825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":872,"num_read_kb":859,"num_write":427,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'166","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:30.310895+0000","last_change":"2024-09-12T17:40:20.135214+0000","last_active":"2024-09-12T18:55:30.310895+0000","last_peered":"2024-09-12T18:55:30.310895+0000","last_clean":"2024-09-12T18:55:30.310895+0000","last_became_active":"2024-09-12T17:40:20.131459+0000","last_became_peered":"2024-09-12T17:40:20.131459+0000","last_unstale":"2024-09-12T18:55:30.310895+0000","last_undegraded":"2024-09-12T18:55:30.310895+0000","last_fullsized":"2024-09-12T18:55:30.310895+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:02.260304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":677,"num_write":293,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'274","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473486+0000","last_change":"2024-09-12T17:40:18.773986+0000","last_active":"2024-09-12T18:57:27.473486+0000","last_peered":"2024-09-12T18:57:27.473486+0000","last_clean":"2024-09-12T18:57:27.473486+0000","last_became_active":"2024-09-12T17:40:18.773667+0000","last_became_peered":"2024-09-12T17:40:18.773667+0000","last_unstale":"2024-09-12T18:57:27.473486+0000","last_undegraded":"2024-09-12T18:57:27.473486+0000","last_fullsized":"2024-09-12T18:57:27.473486+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:09.724574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1313045,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":494,"num_read_kb":8712,"num_write":1019,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"35'4","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.368401+0000","last_change":"2024-09-12T17:40:22.141628+0000","last_active":"2024-09-12T18:59:27.368401+0000","last_peered":"2024-09-12T18:59:27.368401+0000","last_clean":"2024-09-12T18:59:27.368401+0000","last_became_active":"2024-09-12T17:40:22.141182+0000","last_became_peered":"2024-09-12T17:40:22.141182+0000","last_unstale":"2024-09-12T18:59:27.368401+0000","last_undegraded":"2024-09-12T18:59:27.368401+0000","last_fullsized":"2024-09-12T18:59:27.368401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:38.121269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'301","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.595019+0000","last_change":"2024-09-12T17:40:24.167135+0000","last_active":"2024-09-12T18:59:26.595019+0000","last_peered":"2024-09-12T18:59:26.595019+0000","last_clean":"2024-09-12T18:59:26.595019+0000","last_became_active":"2024-09-12T17:40:24.166330+0000","last_became_peered":"2024-09-12T17:40:24.166330+0000","last_unstale":"2024-09-12T18:59:26.595019+0000","last_undegraded":"2024-09-12T18:59:26.595019+0000","last_fullsized":"2024-09-12T18:59:26.595019+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.549312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58768,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":495,"num_read_kb":1011,"num_write":394,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.447210+0000","last_change":"2024-09-12T17:40:26.189177+0000","last_active":"2024-09-12T18:55:27.447210+0000","last_peered":"2024-09-12T18:55:27.447210+0000","last_clean":"2024-09-12T18:55:27.447210+0000","last_became_active":"2024-09-12T17:40:26.188351+0000","last_became_peered":"2024-09-12T17:40:26.188351+0000","last_unstale":"2024-09-12T18:55:27.447210+0000","last_undegraded":"2024-09-12T18:55:27.447210+0000","last_fullsized":"2024-09-12T18:55:27.447210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:14.730369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'136","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.548505+0000","last_change":"2024-09-12T17:40:28.180850+0000","last_active":"2024-09-12T18:59:26.548505+0000","last_peered":"2024-09-12T18:59:26.548505+0000","last_clean":"2024-09-12T18:59:26.548505+0000","last_became_active":"2024-09-12T17:40:28.180148+0000","last_became_peered":"2024-09-12T17:40:28.180148+0000","last_unstale":"2024-09-12T18:59:26.548505+0000","last_undegraded":"2024-09-12T18:59:26.548505+0000","last_fullsized":"2024-09-12T18:59:26.548505+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:56.213405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":171,"num_read_kb":158,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'174","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447667+0000","last_change":"2024-09-12T17:40:20.127371+0000","last_active":"2024-09-12T18:56:12.447667+0000","last_peered":"2024-09-12T18:56:12.447667+0000","last_clean":"2024-09-12T18:56:12.447667+0000","last_became_active":"2024-09-12T17:40:20.127006+0000","last_became_peered":"2024-09-12T17:40:20.127006+0000","last_unstale":"2024-09-12T18:56:12.447667+0000","last_undegraded":"2024-09-12T18:56:12.447667+0000","last_fullsized":"2024-09-12T18:56:12.447667+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:28.267156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":779,"num_read_kb":649,"num_write":260,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'262","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443019+0000","last_change":"2024-09-12T17:40:18.759600+0000","last_active":"2024-09-12T18:57:27.443019+0000","last_peered":"2024-09-12T18:57:27.443019+0000","last_clean":"2024-09-12T18:57:27.443019+0000","last_became_active":"2024-09-12T17:40:18.757444+0000","last_became_peered":"2024-09-12T17:40:18.757444+0000","last_unstale":"2024-09-12T18:57:27.443019+0000","last_undegraded":"2024-09-12T18:57:27.443019+0000","last_fullsized":"2024-09-12T18:57:27.443019+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:50.933887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20999376,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":435,"num_read_kb":91614,"num_write":1023,"num_write_kb":46187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'4205","reported_seq":4819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447609+0000","last_change":"2024-09-12T17:40:20.125927+0000","last_active":"2024-09-12T18:56:12.447609+0000","last_peered":"2024-09-12T18:56:12.447609+0000","last_clean":"2024-09-12T18:56:12.447609+0000","last_became_active":"2024-09-12T17:40:20.125586+0000","last_became_peered":"2024-09-12T17:40:20.125586+0000","last_unstale":"2024-09-12T18:56:12.447609+0000","last_undegraded":"2024-09-12T18:56:12.447609+0000","last_fullsized":"2024-09-12T18:56:12.447609+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":3000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:28.284212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16904,"num_read_kb":14161,"num_write":6332,"num_write_kb":3161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'261","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:24.449879+0000","last_change":"2024-09-12T17:40:18.754599+0000","last_active":"2024-09-12T18:57:24.449879+0000","last_peered":"2024-09-12T18:57:24.449879+0000","last_clean":"2024-09-12T18:57:24.449879+0000","last_became_active":"2024-09-12T17:40:18.754335+0000","last_became_peered":"2024-09-12T17:40:18.754335+0000","last_unstale":"2024-09-12T18:57:24.449879+0000","last_undegraded":"2024-09-12T18:57:24.449879+0000","last_fullsized":"2024-09-12T18:57:24.449879+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:31.973695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293678,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":373,"num_read_kb":13727,"num_write":944,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'413","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.622495+0000","last_change":"2024-09-12T17:40:20.137604+0000","last_active":"2024-09-12T18:56:12.622495+0000","last_peered":"2024-09-12T18:56:12.622495+0000","last_clean":"2024-09-12T18:56:12.622495+0000","last_became_active":"2024-09-12T17:40:20.136831+0000","last_became_peered":"2024-09-12T17:40:20.136831+0000","last_unstale":"2024-09-12T18:56:12.622495+0000","last_undegraded":"2024-09-12T18:56:12.622495+0000","last_fullsized":"2024-09-12T18:56:12.622495+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:14.463672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1812,"num_read_kb":1536,"num_write":694,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'262","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639914+0000","last_change":"2024-09-12T17:40:18.754536+0000","last_active":"2024-09-12T18:57:27.639914+0000","last_peered":"2024-09-12T18:57:27.639914+0000","last_clean":"2024-09-12T18:57:27.639914+0000","last_became_active":"2024-09-12T17:40:18.753576+0000","last_became_peered":"2024-09-12T17:40:18.753576+0000","last_unstale":"2024-09-12T18:57:27.639914+0000","last_undegraded":"2024-09-12T18:57:27.639914+0000","last_fullsized":"2024-09-12T18:57:27.639914+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:25.780872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9213402,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":377,"num_read_kb":36529,"num_write":945,"num_write_kb":32314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'363","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:18.053251+0000","last_change":"2024-09-12T17:40:20.133110+0000","last_active":"2024-09-12T18:57:18.053251+0000","last_peered":"2024-09-12T18:57:18.053251+0000","last_clean":"2024-09-12T18:57:18.053251+0000","last_became_active":"2024-09-12T17:40:20.132826+0000","last_became_peered":"2024-09-12T17:40:20.132826+0000","last_unstale":"2024-09-12T18:57:18.053251+0000","last_undegraded":"2024-09-12T18:57:18.053251+0000","last_fullsized":"2024-09-12T18:57:18.053251+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:07.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1596,"num_read_kb":1285,"num_write":598,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'283","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.476688+0000","last_change":"2024-09-12T17:40:18.755673+0000","last_active":"2024-09-12T18:57:42.476688+0000","last_peered":"2024-09-12T18:57:42.476688+0000","last_clean":"2024-09-12T18:57:42.476688+0000","last_became_active":"2024-09-12T17:40:18.754933+0000","last_became_peered":"2024-09-12T17:40:18.754933+0000","last_unstale":"2024-09-12T18:57:42.476688+0000","last_undegraded":"2024-09-12T18:57:42.476688+0000","last_fullsized":"2024-09-12T18:57:42.476688+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:43.716617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6326374,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":393,"num_read_kb":46825,"num_write":979,"num_write_kb":45673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'114","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.066485+0000","last_change":"2024-09-12T17:40:20.130446+0000","last_active":"2024-09-12T18:58:06.066485+0000","last_peered":"2024-09-12T18:58:06.066485+0000","last_clean":"2024-09-12T18:58:06.066485+0000","last_became_active":"2024-09-12T17:40:20.129769+0000","last_became_peered":"2024-09-12T17:40:20.129769+0000","last_unstale":"2024-09-12T18:58:06.066485+0000","last_undegraded":"2024-09-12T18:58:06.066485+0000","last_fullsized":"2024-09-12T18:58:06.066485+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:07.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":414,"num_write":175,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'279","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:22.471039+0000","last_change":"2024-09-12T17:40:18.773850+0000","last_active":"2024-09-12T18:58:22.471039+0000","last_peered":"2024-09-12T18:58:22.471039+0000","last_clean":"2024-09-12T18:58:22.471039+0000","last_became_active":"2024-09-12T17:40:18.773052+0000","last_became_peered":"2024-09-12T17:40:18.773052+0000","last_unstale":"2024-09-12T18:58:22.471039+0000","last_undegraded":"2024-09-12T18:58:22.471039+0000","last_fullsized":"2024-09-12T18:58:22.471039+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:03.999190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10012785,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":551,"num_read_kb":23542,"num_write":991,"num_write_kb":26208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'141","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820110+0000","last_change":"2024-09-12T17:40:20.149013+0000","last_active":"2024-09-12T18:57:27.820110+0000","last_peered":"2024-09-12T18:57:27.820110+0000","last_clean":"2024-09-12T18:57:27.820110+0000","last_became_active":"2024-09-12T17:40:20.146835+0000","last_became_peered":"2024-09-12T17:40:20.146835+0000","last_unstale":"2024-09-12T18:57:27.820110+0000","last_undegraded":"2024-09-12T18:57:27.820110+0000","last_fullsized":"2024-09-12T18:57:27.820110+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:22.211007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":516,"num_write":222,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'373","reported_seq":1147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447567+0000","last_change":"2024-09-12T17:40:18.765218+0000","last_active":"2024-09-12T18:56:12.447567+0000","last_peered":"2024-09-12T18:56:12.447567+0000","last_clean":"2024-09-12T18:56:12.447567+0000","last_became_active":"2024-09-12T17:40:18.764545+0000","last_became_peered":"2024-09-12T17:40:18.764545+0000","last_unstale":"2024-09-12T18:56:12.447567+0000","last_undegraded":"2024-09-12T18:56:12.447567+0000","last_fullsized":"2024-09-12T18:56:12.447567+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:46.840426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6336635,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":841,"num_read_kb":25412,"num_write":1299,"num_write_kb":29284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'206","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457994+0000","last_change":"2024-09-12T17:40:20.133394+0000","last_active":"2024-09-12T18:57:27.457994+0000","last_peered":"2024-09-12T18:57:27.457994+0000","last_clean":"2024-09-12T18:57:27.457994+0000","last_became_active":"2024-09-12T17:40:20.133055+0000","last_became_peered":"2024-09-12T17:40:20.133055+0000","last_unstale":"2024-09-12T18:57:27.457994+0000","last_undegraded":"2024-09-12T18:57:27.457994+0000","last_fullsized":"2024-09-12T18:57:27.457994+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:30.582322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":974,"num_read_kb":794,"num_write":355,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'267","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:23.476089+0000","last_change":"2024-09-12T17:40:18.765505+0000","last_active":"2024-09-12T18:57:23.476089+0000","last_peered":"2024-09-12T18:57:23.476089+0000","last_clean":"2024-09-12T18:57:23.476089+0000","last_became_active":"2024-09-12T17:40:18.764658+0000","last_became_peered":"2024-09-12T17:40:18.764658+0000","last_unstale":"2024-09-12T18:57:23.476089+0000","last_undegraded":"2024-09-12T18:57:23.476089+0000","last_fullsized":"2024-09-12T18:57:23.476089+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:18.339542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10154406,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":421,"num_read_kb":14116,"num_write":1003,"num_write_kb":26720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'195","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443066+0000","last_change":"2024-09-12T17:40:20.125114+0000","last_active":"2024-09-12T18:57:27.443066+0000","last_peered":"2024-09-12T18:57:27.443066+0000","last_clean":"2024-09-12T18:57:27.443066+0000","last_became_active":"2024-09-12T17:40:20.124247+0000","last_became_peered":"2024-09-12T17:40:20.124247+0000","last_unstale":"2024-09-12T18:57:27.443066+0000","last_undegraded":"2024-09-12T18:57:27.443066+0000","last_fullsized":"2024-09-12T18:57:27.443066+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:39.697115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":903,"num_read_kb":737,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'307","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:16.668519+0000","last_change":"2024-09-12T17:40:18.774283+0000","last_active":"2024-09-12T18:56:16.668519+0000","last_peered":"2024-09-12T18:56:16.668519+0000","last_clean":"2024-09-12T18:56:16.668519+0000","last_became_active":"2024-09-12T17:40:18.772776+0000","last_became_peered":"2024-09-12T17:40:18.772776+0000","last_unstale":"2024-09-12T18:56:16.668519+0000","last_undegraded":"2024-09-12T18:56:16.668519+0000","last_fullsized":"2024-09-12T18:56:16.668519+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:23.569697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5280730,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":563,"num_read_kb":25353,"num_write":1083,"num_write_kb":19697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'233","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.472184+0000","last_change":"2024-09-12T17:40:20.116396+0000","last_active":"2024-09-12T18:57:22.472184+0000","last_peered":"2024-09-12T18:57:22.472184+0000","last_clean":"2024-09-12T18:57:22.472184+0000","last_became_active":"2024-09-12T17:40:20.116064+0000","last_became_peered":"2024-09-12T17:40:20.116064+0000","last_unstale":"2024-09-12T18:57:22.472184+0000","last_undegraded":"2024-09-12T18:57:22.472184+0000","last_fullsized":"2024-09-12T18:57:22.472184+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:07.387378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1004,"num_read_kb":824,"num_write":355,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'283","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:45.741790+0000","last_change":"2024-09-12T17:40:18.760207+0000","last_active":"2024-09-12T18:56:45.741790+0000","last_peered":"2024-09-12T18:56:45.741790+0000","last_clean":"2024-09-12T18:56:45.741790+0000","last_became_active":"2024-09-12T17:40:18.753693+0000","last_became_peered":"2024-09-12T17:40:18.753693+0000","last_unstale":"2024-09-12T18:56:45.741790+0000","last_undegraded":"2024-09-12T18:56:45.741790+0000","last_fullsized":"2024-09-12T18:56:45.741790+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:50.968987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21644128,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":404,"num_read_kb":12118,"num_write":1027,"num_write_kb":50446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'82","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.819071+0000","last_change":"2024-09-12T17:40:20.130558+0000","last_active":"2024-09-12T18:57:22.819071+0000","last_peered":"2024-09-12T18:57:22.819071+0000","last_clean":"2024-09-12T18:57:22.819071+0000","last_became_active":"2024-09-12T17:40:20.129687+0000","last_became_peered":"2024-09-12T17:40:20.129687+0000","last_unstale":"2024-09-12T18:57:22.819071+0000","last_undegraded":"2024-09-12T18:57:22.819071+0000","last_fullsized":"2024-09-12T18:57:22.819071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:16.096110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":302,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'316","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:20.524908+0000","last_change":"2024-09-12T17:40:18.773313+0000","last_active":"2024-09-12T18:57:20.524908+0000","last_peered":"2024-09-12T18:57:20.524908+0000","last_clean":"2024-09-12T18:57:20.524908+0000","last_became_active":"2024-09-12T17:40:18.772969+0000","last_became_peered":"2024-09-12T17:40:18.772969+0000","last_unstale":"2024-09-12T18:57:20.524908+0000","last_undegraded":"2024-09-12T18:57:20.524908+0000","last_fullsized":"2024-09-12T18:57:20.524908+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:42.889939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10553500,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":405,"num_read_kb":13353,"num_write":1040,"num_write_kb":30519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'211","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:09.446951+0000","last_change":"2024-09-12T17:40:20.130883+0000","last_active":"2024-09-12T18:57:09.446951+0000","last_peered":"2024-09-12T18:57:09.446951+0000","last_clean":"2024-09-12T18:57:09.446951+0000","last_became_active":"2024-09-12T17:40:20.130606+0000","last_became_peered":"2024-09-12T17:40:20.130606+0000","last_unstale":"2024-09-12T18:57:09.446951+0000","last_undegraded":"2024-09-12T18:57:09.446951+0000","last_fullsized":"2024-09-12T18:57:09.446951+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:31.071071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":765,"num_write":331,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'294","reported_seq":1068,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:54.040487+0000","last_change":"2024-09-12T17:40:18.781646+0000","last_active":"2024-09-12T18:56:54.040487+0000","last_peered":"2024-09-12T18:56:54.040487+0000","last_clean":"2024-09-12T18:56:54.040487+0000","last_became_active":"2024-09-12T17:40:18.780861+0000","last_became_peered":"2024-09-12T17:40:18.780861+0000","last_unstale":"2024-09-12T18:56:54.040487+0000","last_undegraded":"2024-09-12T18:56:54.040487+0000","last_fullsized":"2024-09-12T18:56:54.040487+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:37.689644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10210687,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":822,"num_read_kb":18824,"num_write":1122,"num_write_kb":42628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'422","reported_seq":1180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812440+0000","last_change":"2024-09-12T17:40:20.149871+0000","last_active":"2024-09-12T18:56:52.812440+0000","last_peered":"2024-09-12T18:56:52.812440+0000","last_clean":"2024-09-12T18:56:52.812440+0000","last_became_active":"2024-09-12T17:40:20.149176+0000","last_became_peered":"2024-09-12T17:40:20.149176+0000","last_unstale":"2024-09-12T18:56:52.812440+0000","last_undegraded":"2024-09-12T18:56:52.812440+0000","last_fullsized":"2024-09-12T18:56:52.812440+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.618043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2034,"num_read_kb":1768,"num_write":658,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'275","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.108916+0000","last_change":"2024-09-12T17:40:18.781947+0000","last_active":"2024-09-12T18:57:45.108916+0000","last_peered":"2024-09-12T18:57:45.108916+0000","last_clean":"2024-09-12T18:57:45.108916+0000","last_became_active":"2024-09-12T17:40:18.781543+0000","last_became_peered":"2024-09-12T17:40:18.781543+0000","last_unstale":"2024-09-12T18:57:45.108916+0000","last_undegraded":"2024-09-12T18:57:45.108916+0000","last_fullsized":"2024-09-12T18:57:45.108916+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:45.216097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8657378,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":490,"num_read_kb":27146,"num_write":1057,"num_write_kb":17169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'186","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.449104+0000","last_change":"2024-09-12T17:40:20.133684+0000","last_active":"2024-09-12T18:56:52.449104+0000","last_peered":"2024-09-12T18:56:52.449104+0000","last_clean":"2024-09-12T18:56:52.449104+0000","last_became_active":"2024-09-12T17:40:20.132914+0000","last_became_peered":"2024-09-12T17:40:20.132914+0000","last_unstale":"2024-09-12T18:56:52.449104+0000","last_undegraded":"2024-09-12T18:56:52.449104+0000","last_fullsized":"2024-09-12T18:56:52.449104+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:10.481286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":685,"num_write":286,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'352","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.435866+0000","last_change":"2024-09-12T17:40:18.774804+0000","last_active":"2024-09-12T18:56:52.435866+0000","last_peered":"2024-09-12T18:56:52.435866+0000","last_clean":"2024-09-12T18:56:52.435866+0000","last_became_active":"2024-09-12T17:40:18.773572+0000","last_became_peered":"2024-09-12T17:40:18.773572+0000","last_unstale":"2024-09-12T18:56:52.435866+0000","last_undegraded":"2024-09-12T18:56:52.435866+0000","last_fullsized":"2024-09-12T18:56:52.435866+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:04.216779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23394053,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":735,"num_read_kb":27791,"num_write":1348,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'106","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.465444+0000","last_change":"2024-09-12T17:40:20.125236+0000","last_active":"2024-09-12T18:56:52.465444+0000","last_peered":"2024-09-12T18:56:52.465444+0000","last_clean":"2024-09-12T18:56:52.465444+0000","last_became_active":"2024-09-12T17:40:20.124905+0000","last_became_peered":"2024-09-12T17:40:20.124905+0000","last_unstale":"2024-09-12T18:56:52.465444+0000","last_undegraded":"2024-09-12T18:56:52.465444+0000","last_fullsized":"2024-09-12T18:56:52.465444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:52.008144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":441,"num_write":144,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'330","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.452697+0000","last_change":"2024-09-12T17:40:18.777519+0000","last_active":"2024-09-12T18:57:07.452697+0000","last_peered":"2024-09-12T18:57:07.452697+0000","last_clean":"2024-09-12T18:57:07.452697+0000","last_became_active":"2024-09-12T17:40:18.776865+0000","last_became_peered":"2024-09-12T17:40:18.776865+0000","last_unstale":"2024-09-12T18:57:07.452697+0000","last_undegraded":"2024-09-12T18:57:07.452697+0000","last_fullsized":"2024-09-12T18:57:07.452697+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:29.028273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1370996,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":654,"num_read_kb":1992,"num_write":1192,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'104","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.554319+0000","last_change":"2024-09-12T17:40:20.119380+0000","last_active":"2024-09-12T18:59:26.554319+0000","last_peered":"2024-09-12T18:59:26.554319+0000","last_clean":"2024-09-12T18:59:26.554319+0000","last_became_active":"2024-09-12T17:40:20.119036+0000","last_became_peered":"2024-09-12T17:40:20.119036+0000","last_unstale":"2024-09-12T18:59:26.554319+0000","last_undegraded":"2024-09-12T18:59:26.554319+0000","last_fullsized":"2024-09-12T18:59:26.554319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:31.564674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":455,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'417","reported_seq":1121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:19.448994+0000","last_change":"2024-09-12T17:40:18.770214+0000","last_active":"2024-09-12T18:57:19.448994+0000","last_peered":"2024-09-12T18:57:19.448994+0000","last_clean":"2024-09-12T18:57:19.448994+0000","last_became_active":"2024-09-12T17:40:18.768688+0000","last_became_peered":"2024-09-12T17:40:18.768688+0000","last_unstale":"2024-09-12T18:57:19.448994+0000","last_undegraded":"2024-09-12T18:57:19.448994+0000","last_fullsized":"2024-09-12T18:57:19.448994+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:46.076255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12351575,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":796,"num_read_kb":49767,"num_write":1329,"num_write_kb":26119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'159","reported_seq":736,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.443217+0000","last_change":"2024-09-12T17:40:20.133523+0000","last_active":"2024-09-12T18:56:27.443217+0000","last_peered":"2024-09-12T18:56:27.443217+0000","last_clean":"2024-09-12T18:56:27.443217+0000","last_became_active":"2024-09-12T17:40:20.132698+0000","last_became_peered":"2024-09-12T17:40:20.132698+0000","last_unstale":"2024-09-12T18:56:27.443217+0000","last_undegraded":"2024-09-12T18:56:27.443217+0000","last_fullsized":"2024-09-12T18:56:27.443217+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:07.059934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":512,"num_write":259,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'289","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.638758+0000","last_change":"2024-09-12T17:40:18.784825+0000","last_active":"2024-09-12T18:57:22.638758+0000","last_peered":"2024-09-12T18:57:22.638758+0000","last_clean":"2024-09-12T18:57:22.638758+0000","last_became_active":"2024-09-12T17:40:18.784024+0000","last_became_peered":"2024-09-12T17:40:18.784024+0000","last_unstale":"2024-09-12T18:57:22.638758+0000","last_undegraded":"2024-09-12T18:57:22.638758+0000","last_fullsized":"2024-09-12T18:57:22.638758+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:14.215607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5753437,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":409,"num_read_kb":13538,"num_write":1052,"num_write_kb":25363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'303","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:39.428993+0000","last_change":"2024-09-12T17:40:55.332141+0000","last_active":"2024-09-12T18:55:39.428993+0000","last_peered":"2024-09-12T18:55:39.428993+0000","last_clean":"2024-09-12T18:55:39.428993+0000","last_became_active":"2024-09-12T17:40:55.331839+0000","last_became_peered":"2024-09-12T17:40:55.331839+0000","last_unstale":"2024-09-12T18:55:39.428993+0000","last_undegraded":"2024-09-12T18:55:39.428993+0000","last_fullsized":"2024-09-12T18:55:39.428993+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.377874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18979519,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":458,"num_read_kb":31466,"num_write":997,"num_write_kb":39606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'70","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:32.448457+0000","last_change":"2024-09-12T17:40:20.116528+0000","last_active":"2024-09-12T18:55:32.448457+0000","last_peered":"2024-09-12T18:55:32.448457+0000","last_clean":"2024-09-12T18:55:32.448457+0000","last_became_active":"2024-09-12T17:40:20.116230+0000","last_became_peered":"2024-09-12T17:40:20.116230+0000","last_unstale":"2024-09-12T18:55:32.448457+0000","last_undegraded":"2024-09-12T18:55:32.448457+0000","last_fullsized":"2024-09-12T18:55:32.448457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:18.767693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":294,"num_write":113,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'328","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.462720+0000","last_change":"2024-09-12T17:40:18.774940+0000","last_active":"2024-09-12T18:57:22.462720+0000","last_peered":"2024-09-12T18:57:22.462720+0000","last_clean":"2024-09-12T18:57:22.462720+0000","last_became_active":"2024-09-12T17:40:18.774332+0000","last_became_peered":"2024-09-12T17:40:18.774332+0000","last_unstale":"2024-09-12T18:57:22.462720+0000","last_undegraded":"2024-09-12T18:57:22.462720+0000","last_fullsized":"2024-09-12T18:57:22.462720+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:36.078701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11573126,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":588,"num_read_kb":8119,"num_write":1403,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'266","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.610008+0000","last_change":"2024-09-12T17:40:20.113318+0000","last_active":"2024-09-12T18:55:17.610008+0000","last_peered":"2024-09-12T18:55:17.610008+0000","last_clean":"2024-09-12T18:55:17.610008+0000","last_became_active":"2024-09-12T17:40:20.112521+0000","last_became_peered":"2024-09-12T17:40:20.112521+0000","last_unstale":"2024-09-12T18:55:17.610008+0000","last_undegraded":"2024-09-12T18:55:17.610008+0000","last_fullsized":"2024-09-12T18:55:17.610008+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:29.322254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1090,"num_read_kb":887,"num_write":395,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5850,"num_read_kb":4138,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16272,"num_read_kb":15940,"num_write":16723,"num_write_kb":4884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1758,"ondisk_log_size":1758,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":457,"ondisk_log_size":457,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1915679,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":18614,"num_read_kb":35597,"num_write":15741,"num_write_kb":11986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":2795574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2091,"ondisk_log_size":2091,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2852,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103249,"num_read_kb":86122,"num_write":37396,"num_write_kb":18900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3947,"ondisk_log_size":3947,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":642493580,"num_objects":4513,"num_object_clones":0,"num_object_copies":9026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4513,"num_whiteouts":0,"num_read":32284,"num_read_kb":1876573,"num_write":68075,"num_write_kb":2152272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1317863424,"data_stored":1284987160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3736,"ondisk_log_size":3736,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":75130115,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":143,"num_read_kb":197405,"num_write":158,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":150265856,"data_stored":150260230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":75130115,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":139,"num_read_kb":186093,"num_write":158,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":150265856,"data_stored":150260230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510404,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451440,"kb_used_data":203680,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93920400,"statfs":{"total":96636764160,"available":96174489600,"internally_reserved":0,"allocated":208568320,"data_stored":202396353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":253688266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510404,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":425536,"kb_used_data":195824,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93946304,"statfs":{"total":96636764160,"available":96201015296,"internally_reserved":0,"allocated":200523776,"data_stored":196040359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510403,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343480,"kb_used_data":231848,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94028360,"statfs":{"total":96636764160,"available":96285040640,"internally_reserved":0,"allocated":237412352,"data_stored":230936096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510404,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276480,"kb_used_data":209200,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94095360,"statfs":{"total":96636764160,"available":96353648640,"internally_reserved":0,"allocated":214220800,"data_stored":207815616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510402,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":497148,"kb_used_data":253548,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":93874692,"statfs":{"total":96636764160,"available":96127684608,"internally_reserved":0,"allocated":259633152,"data_stored":253357114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510402,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245736,"kb_used_data":146584,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94126104,"statfs":{"total":96636764160,"available":96385130496,"internally_reserved":0,"allocated":150102016,"data_stored":145754399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510404,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434708,"kb_used_data":223044,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":93937132,"statfs":{"total":96636764160,"available":96191623168,"internally_reserved":0,"allocated":228397056,"data_stored":221677622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575810,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224936,"kb_used_data":149400,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94146904,"statfs":{"total":96636764160,"available":96406429696,"internally_reserved":0,"allocated":152985600,"data_stored":148655937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77330888},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":187408384,"data_stored":182261511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":99299328,"data_stored":96490580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114515968,"data_stored":111678165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":195018752,"data_stored":190317682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":185356288,"data_stored":180424589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":207863808,"data_stored":203004921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":148754432,"data_stored":145771761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":179646464,"data_stored":175037951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":347978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":475136,"data_stored":399372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":132861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":492975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":82687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":684032,"data_stored":573019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":258551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":508131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18458586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13680640,"data_stored":13679919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29409280,"data_stored":29408553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17874944,"data_stored":17874217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":21019951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34189312,"data_stored":34187226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18458580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:00:00.514 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:00:00.840 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T19:00:00.855 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-09-12T19:00:00.866 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":2656,"stamp":"2024-09-12T18:59:59.321639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":795277064,"num_objects":4897,"num_object_clones":0,"num_object_copies":9794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4897,"num_whiteouts":0,"num_read":179022,"num_read_kb":2404787,"num_write":140334,"num_write_kb":2445958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13289,"ondisk_log_size":13289,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2899464,"kb_used_data":1613128,"kb_used_omap":12,"kb_used_meta":1286195,"kb_avail":752075256,"statfs":{"total":773094113280,"available":770125062144,"internally_reserved":0,"allocated":1651843072,"data_stored":1606633496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1317064243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007647"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639884+0000","last_change":"2024-09-12T18:19:57.854037+0000","last_active":"2024-09-12T18:57:27.639884+0000","last_peered":"2024-09-12T18:57:27.639884+0000","last_clean":"2024-09-12T18:57:27.639884+0000","last_became_active":"2024-09-12T18:19:57.853375+0000","last_became_peered":"2024-09-12T18:19:57.853375+0000","last_unstale":"2024-09-12T18:57:27.639884+0000","last_undegraded":"2024-09-12T18:57:27.639884+0000","last_fullsized":"2024-09-12T18:57:27.639884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:39.334575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'1","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.636250+0000","last_change":"2024-09-12T17:59:43.011642+0000","last_active":"2024-09-12T18:57:12.636250+0000","last_peered":"2024-09-12T18:57:12.636250+0000","last_clean":"2024-09-12T18:57:12.636250+0000","last_became_active":"2024-09-12T17:59:43.010854+0000","last_became_peered":"2024-09-12T17:59:43.010854+0000","last_unstale":"2024-09-12T18:57:12.636250+0000","last_undegraded":"2024-09-12T18:57:12.636250+0000","last_fullsized":"2024-09-12T18:57:12.636250+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:05.224690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454697+0000","last_change":"2024-09-12T17:59:38.988698+0000","last_active":"2024-09-12T18:57:12.454697+0000","last_peered":"2024-09-12T18:57:12.454697+0000","last_clean":"2024-09-12T18:57:12.454697+0000","last_became_active":"2024-09-12T17:59:38.987739+0000","last_became_peered":"2024-09-12T17:59:38.987739+0000","last_unstale":"2024-09-12T18:57:12.454697+0000","last_undegraded":"2024-09-12T18:57:12.454697+0000","last_fullsized":"2024-09-12T18:57:12.454697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:32.330775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'44","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.460341+0000","last_change":"2024-09-12T17:55:59.359070+0000","last_active":"2024-09-12T18:56:27.460341+0000","last_peered":"2024-09-12T18:56:27.460341+0000","last_clean":"2024-09-12T18:56:27.460341+0000","last_became_active":"2024-09-12T17:55:59.358302+0000","last_became_peered":"2024-09-12T17:55:59.358302+0000","last_unstale":"2024-09-12T18:56:27.460341+0000","last_undegraded":"2024-09-12T18:56:27.460341+0000","last_fullsized":"2024-09-12T18:56:27.460341+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:31.219330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":154,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:54:59.420325+0000","last_change":"2024-09-12T18:19:57.839639+0000","last_active":"2024-09-12T18:54:59.420325+0000","last_peered":"2024-09-12T18:54:59.420325+0000","last_clean":"2024-09-12T18:54:59.420325+0000","last_became_active":"2024-09-12T18:19:57.838918+0000","last_became_peered":"2024-09-12T18:19:57.838918+0000","last_unstale":"2024-09-12T18:54:59.420325+0000","last_undegraded":"2024-09-12T18:54:59.420325+0000","last_fullsized":"2024-09-12T18:54:59.420325+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:14.062322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'1","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.816864+0000","last_change":"2024-09-12T17:59:43.018636+0000","last_active":"2024-09-12T18:57:12.816864+0000","last_peered":"2024-09-12T18:57:12.816864+0000","last_clean":"2024-09-12T18:57:12.816864+0000","last_became_active":"2024-09-12T17:59:43.005733+0000","last_became_peered":"2024-09-12T17:59:43.005733+0000","last_unstale":"2024-09-12T18:57:12.816864+0000","last_undegraded":"2024-09-12T18:57:12.816864+0000","last_fullsized":"2024-09-12T18:57:12.816864+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.942784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.460544+0000","last_change":"2024-09-12T17:59:38.990543+0000","last_active":"2024-09-12T18:57:12.460544+0000","last_peered":"2024-09-12T18:57:12.460544+0000","last_clean":"2024-09-12T18:57:12.460544+0000","last_became_active":"2024-09-12T17:59:38.989854+0000","last_became_peered":"2024-09-12T17:59:38.989854+0000","last_unstale":"2024-09-12T18:57:12.460544+0000","last_undegraded":"2024-09-12T18:57:12.460544+0000","last_fullsized":"2024-09-12T18:57:12.460544+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:58.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7924395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":8763,"num_write":5,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'34","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:14.436391+0000","last_change":"2024-09-12T17:55:59.368156+0000","last_active":"2024-09-12T18:56:14.436391+0000","last_peered":"2024-09-12T18:56:14.436391+0000","last_clean":"2024-09-12T18:56:14.436391+0000","last_became_active":"2024-09-12T17:55:59.367426+0000","last_became_peered":"2024-09-12T17:55:59.367426+0000","last_unstale":"2024-09-12T18:56:14.436391+0000","last_undegraded":"2024-09-12T18:56:14.436391+0000","last_fullsized":"2024-09-12T18:56:14.436391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:37.601556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":114,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.427354+0000","last_change":"2024-09-12T18:19:57.849468+0000","last_active":"2024-09-12T18:56:12.427354+0000","last_peered":"2024-09-12T18:56:12.427354+0000","last_clean":"2024-09-12T18:56:12.427354+0000","last_became_active":"2024-09-12T18:19:57.848735+0000","last_became_peered":"2024-09-12T18:19:57.848735+0000","last_unstale":"2024-09-12T18:56:12.427354+0000","last_undegraded":"2024-09-12T18:56:12.427354+0000","last_fullsized":"2024-09-12T18:56:12.427354+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:59.827170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453948+0000","last_change":"2024-09-12T17:59:43.012346+0000","last_active":"2024-09-12T18:55:57.453948+0000","last_peered":"2024-09-12T18:55:57.453948+0000","last_clean":"2024-09-12T18:55:57.453948+0000","last_became_active":"2024-09-12T17:59:43.011603+0000","last_became_peered":"2024-09-12T17:59:43.011603+0000","last_unstale":"2024-09-12T18:55:57.453948+0000","last_undegraded":"2024-09-12T18:55:57.453948+0000","last_fullsized":"2024-09-12T18:55:57.453948+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:19.770482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":9,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:54.456240+0000","last_change":"2024-09-12T17:59:38.985703+0000","last_active":"2024-09-12T18:57:54.456240+0000","last_peered":"2024-09-12T18:57:54.456240+0000","last_clean":"2024-09-12T18:57:54.456240+0000","last_became_active":"2024-09-12T17:59:38.984980+0000","last_became_peered":"2024-09-12T17:59:38.984980+0000","last_unstale":"2024-09-12T18:57:54.456240+0000","last_undegraded":"2024-09-12T18:57:54.456240+0000","last_fullsized":"2024-09-12T18:57:54.456240+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:03.988908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'15","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.454640+0000","last_change":"2024-09-12T17:55:59.357028+0000","last_active":"2024-09-12T18:56:02.454640+0000","last_peered":"2024-09-12T18:56:02.454640+0000","last_clean":"2024-09-12T18:56:02.454640+0000","last_became_active":"2024-09-12T17:55:59.356144+0000","last_became_peered":"2024-09-12T17:55:59.356144+0000","last_unstale":"2024-09-12T18:56:02.454640+0000","last_undegraded":"2024-09-12T18:56:02.454640+0000","last_fullsized":"2024-09-12T18:56:02.454640+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:40.644103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442648+0000","last_change":"2024-09-12T18:19:57.861119+0000","last_active":"2024-09-12T18:56:27.442648+0000","last_peered":"2024-09-12T18:56:27.442648+0000","last_clean":"2024-09-12T18:56:27.442648+0000","last_became_active":"2024-09-12T18:19:57.860464+0000","last_became_peered":"2024-09-12T18:19:57.860464+0000","last_unstale":"2024-09-12T18:56:27.442648+0000","last_undegraded":"2024-09-12T18:56:27.442648+0000","last_fullsized":"2024-09-12T18:56:27.442648+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:37.217624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'3","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437344+0000","last_change":"2024-09-12T17:59:43.031327+0000","last_active":"2024-09-12T18:56:02.437344+0000","last_peered":"2024-09-12T18:56:02.437344+0000","last_clean":"2024-09-12T18:56:02.437344+0000","last_became_active":"2024-09-12T17:59:43.030545+0000","last_became_peered":"2024-09-12T17:59:43.030545+0000","last_unstale":"2024-09-12T18:56:02.437344+0000","last_undegraded":"2024-09-12T18:56:02.437344+0000","last_fullsized":"2024-09-12T18:56:02.437344+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:11.859283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48431,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4192,"num_write":3,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800776+0000","last_change":"2024-09-12T17:59:38.946186+0000","last_active":"2024-09-12T18:55:57.800776+0000","last_peered":"2024-09-12T18:55:57.800776+0000","last_clean":"2024-09-12T18:55:57.800776+0000","last_became_active":"2024-09-12T17:59:38.945373+0000","last_became_peered":"2024-09-12T17:59:38.945373+0000","last_unstale":"2024-09-12T18:55:57.800776+0000","last_undegraded":"2024-09-12T18:55:57.800776+0000","last_fullsized":"2024-09-12T18:55:57.800776+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:18.147516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'6","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437289+0000","last_change":"2024-09-12T17:55:59.340661+0000","last_active":"2024-09-12T18:56:02.437289+0000","last_peered":"2024-09-12T18:56:02.437289+0000","last_clean":"2024-09-12T18:56:02.437289+0000","last_became_active":"2024-09-12T17:55:59.338550+0000","last_became_peered":"2024-09-12T17:55:59.338550+0000","last_unstale":"2024-09-12T18:56:02.437289+0000","last_undegraded":"2024-09-12T18:56:02.437289+0000","last_fullsized":"2024-09-12T18:56:02.437289+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:44.861905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439345+0000","last_change":"2024-09-12T18:19:57.871984+0000","last_active":"2024-09-12T18:56:12.439345+0000","last_peered":"2024-09-12T18:56:12.439345+0000","last_clean":"2024-09-12T18:56:12.439345+0000","last_became_active":"2024-09-12T18:19:57.871345+0000","last_became_peered":"2024-09-12T18:19:57.871345+0000","last_unstale":"2024-09-12T18:56:12.439345+0000","last_undegraded":"2024-09-12T18:56:12.439345+0000","last_fullsized":"2024-09-12T18:56:12.439345+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:45.284109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.612304+0000","last_change":"2024-09-12T17:59:43.034960+0000","last_active":"2024-09-12T18:55:27.612304+0000","last_peered":"2024-09-12T18:55:27.612304+0000","last_clean":"2024-09-12T18:55:27.612304+0000","last_became_active":"2024-09-12T17:59:43.034299+0000","last_became_peered":"2024-09-12T17:59:43.034299+0000","last_unstale":"2024-09-12T18:55:27.612304+0000","last_undegraded":"2024-09-12T18:55:27.612304+0000","last_fullsized":"2024-09-12T18:55:27.612304+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:55.095948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.444546+0000","last_change":"2024-09-12T17:59:38.981877+0000","last_active":"2024-09-12T18:55:17.444546+0000","last_peered":"2024-09-12T18:55:17.444546+0000","last_clean":"2024-09-12T18:55:17.444546+0000","last_became_active":"2024-09-12T17:59:38.976348+0000","last_became_peered":"2024-09-12T17:59:38.976348+0000","last_unstale":"2024-09-12T18:55:17.444546+0000","last_undegraded":"2024-09-12T18:55:17.444546+0000","last_fullsized":"2024-09-12T18:55:17.444546+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:41.558530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'16","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437226+0000","last_change":"2024-09-12T17:55:59.357701+0000","last_active":"2024-09-12T18:56:02.437226+0000","last_peered":"2024-09-12T18:56:02.437226+0000","last_clean":"2024-09-12T18:56:02.437226+0000","last_became_active":"2024-09-12T17:55:59.356970+0000","last_became_peered":"2024-09-12T17:55:59.356970+0000","last_unstale":"2024-09-12T18:56:02.437226+0000","last_undegraded":"2024-09-12T18:56:02.437226+0000","last_fullsized":"2024-09-12T18:56:02.437226+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:46.362725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":58,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464203+0000","last_change":"2024-09-12T18:19:57.867587+0000","last_active":"2024-09-12T18:57:27.464203+0000","last_peered":"2024-09-12T18:57:27.464203+0000","last_clean":"2024-09-12T18:57:27.464203+0000","last_became_active":"2024-09-12T18:19:57.865319+0000","last_became_peered":"2024-09-12T18:19:57.865319+0000","last_unstale":"2024-09-12T18:57:27.464203+0000","last_undegraded":"2024-09-12T18:57:27.464203+0000","last_fullsized":"2024-09-12T18:57:27.464203+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:03.710006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'1","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.415707+0000","last_change":"2024-09-12T17:59:56.386718+0000","last_active":"2024-09-12T18:55:17.415707+0000","last_peered":"2024-09-12T18:55:17.415707+0000","last_clean":"2024-09-12T18:55:17.415707+0000","last_became_active":"2024-09-12T17:59:56.386194+0000","last_became_peered":"2024-09-12T17:59:56.386194+0000","last_unstale":"2024-09-12T18:55:17.415707+0000","last_undegraded":"2024-09-12T18:55:17.415707+0000","last_fullsized":"2024-09-12T18:55:17.415707+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:16.043399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'7","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.794094+0000","last_change":"2024-09-12T17:59:38.978120+0000","last_active":"2024-09-12T18:55:27.794094+0000","last_peered":"2024-09-12T18:55:27.794094+0000","last_clean":"2024-09-12T18:55:27.794094+0000","last_became_active":"2024-09-12T17:59:38.977316+0000","last_became_peered":"2024-09-12T17:59:38.977316+0000","last_unstale":"2024-09-12T18:55:27.794094+0000","last_undegraded":"2024-09-12T18:55:27.794094+0000","last_fullsized":"2024-09-12T18:55:27.794094+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:26.707491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":16386,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'37","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.425307+0000","last_change":"2024-09-12T17:55:59.366994+0000","last_active":"2024-09-12T18:56:02.425307+0000","last_peered":"2024-09-12T18:56:02.425307+0000","last_clean":"2024-09-12T18:56:02.425307+0000","last_became_active":"2024-09-12T17:55:59.366177+0000","last_became_peered":"2024-09-12T17:55:59.366177+0000","last_unstale":"2024-09-12T18:56:02.425307+0000","last_undegraded":"2024-09-12T18:56:02.425307+0000","last_fullsized":"2024-09-12T18:56:02.425307+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:03.524473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":133,"num_write":64,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457338+0000","last_change":"2024-09-12T18:19:57.844732+0000","last_active":"2024-09-12T18:57:27.457338+0000","last_peered":"2024-09-12T18:57:27.457338+0000","last_clean":"2024-09-12T18:57:27.457338+0000","last_became_active":"2024-09-12T18:19:57.843946+0000","last_became_peered":"2024-09-12T18:19:57.843946+0000","last_unstale":"2024-09-12T18:57:27.457338+0000","last_undegraded":"2024-09-12T18:57:27.457338+0000","last_fullsized":"2024-09-12T18:57:27.457338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:48.999189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.440013+0000","last_change":"2024-09-12T17:59:43.014049+0000","last_active":"2024-09-12T18:57:12.440013+0000","last_peered":"2024-09-12T18:57:12.440013+0000","last_clean":"2024-09-12T18:57:12.440013+0000","last_became_active":"2024-09-12T17:59:43.013293+0000","last_became_peered":"2024-09-12T17:59:43.013293+0000","last_unstale":"2024-09-12T18:57:12.440013+0000","last_undegraded":"2024-09-12T18:57:12.440013+0000","last_fullsized":"2024-09-12T18:57:12.440013+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:47.290570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.816755+0000","last_change":"2024-09-12T17:59:38.984819+0000","last_active":"2024-09-12T18:57:12.816755+0000","last_peered":"2024-09-12T18:57:12.816755+0000","last_clean":"2024-09-12T18:57:12.816755+0000","last_became_active":"2024-09-12T17:59:38.984004+0000","last_became_peered":"2024-09-12T17:59:38.984004+0000","last_unstale":"2024-09-12T18:57:12.816755+0000","last_undegraded":"2024-09-12T18:57:12.816755+0000","last_fullsized":"2024-09-12T18:57:12.816755+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:47.953455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'21","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463100+0000","last_change":"2024-09-12T17:55:59.367890+0000","last_active":"2024-09-12T18:56:42.463100+0000","last_peered":"2024-09-12T18:56:42.463100+0000","last_clean":"2024-09-12T18:56:42.463100+0000","last_became_active":"2024-09-12T17:55:59.366968+0000","last_became_peered":"2024-09-12T17:55:59.366968+0000","last_unstale":"2024-09-12T18:56:42.463100+0000","last_undegraded":"2024-09-12T18:56:42.463100+0000","last_fullsized":"2024-09-12T18:56:42.463100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:25.297113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457398+0000","last_change":"2024-09-12T18:19:57.871547+0000","last_active":"2024-09-12T18:57:27.457398+0000","last_peered":"2024-09-12T18:57:27.457398+0000","last_clean":"2024-09-12T18:57:27.457398+0000","last_became_active":"2024-09-12T18:19:57.870750+0000","last_became_peered":"2024-09-12T18:19:57.870750+0000","last_unstale":"2024-09-12T18:57:27.457398+0000","last_undegraded":"2024-09-12T18:57:27.457398+0000","last_fullsized":"2024-09-12T18:57:27.457398+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:27.428422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454597+0000","last_change":"2024-09-12T17:59:43.027485+0000","last_active":"2024-09-12T18:57:12.454597+0000","last_peered":"2024-09-12T18:57:12.454597+0000","last_clean":"2024-09-12T18:57:12.454597+0000","last_became_active":"2024-09-12T17:59:43.021777+0000","last_became_peered":"2024-09-12T17:59:43.021777+0000","last_unstale":"2024-09-12T18:57:12.454597+0000","last_undegraded":"2024-09-12T18:57:12.454597+0000","last_fullsized":"2024-09-12T18:57:12.454597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:26.307507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.469779+0000","last_change":"2024-09-12T17:59:38.990405+0000","last_active":"2024-09-12T18:57:12.469779+0000","last_peered":"2024-09-12T18:57:12.469779+0000","last_clean":"2024-09-12T18:57:12.469779+0000","last_became_active":"2024-09-12T17:59:38.989753+0000","last_became_peered":"2024-09-12T17:59:38.989753+0000","last_unstale":"2024-09-12T18:57:12.469779+0000","last_undegraded":"2024-09-12T18:57:12.469779+0000","last_fullsized":"2024-09-12T18:57:12.469779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:31.519684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'22","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.450554+0000","last_change":"2024-09-12T17:55:59.330535+0000","last_active":"2024-09-12T18:56:27.450554+0000","last_peered":"2024-09-12T18:56:27.450554+0000","last_clean":"2024-09-12T18:56:27.450554+0000","last_became_active":"2024-09-12T17:55:59.329792+0000","last_became_peered":"2024-09-12T17:55:59.329792+0000","last_unstale":"2024-09-12T18:56:27.450554+0000","last_undegraded":"2024-09-12T18:56:27.450554+0000","last_fullsized":"2024-09-12T18:56:27.450554+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:50.850228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.461644+0000","last_change":"2024-09-12T18:19:57.868119+0000","last_active":"2024-09-12T18:57:17.461644+0000","last_peered":"2024-09-12T18:57:17.461644+0000","last_clean":"2024-09-12T18:57:17.461644+0000","last_became_active":"2024-09-12T18:19:57.863600+0000","last_became_peered":"2024-09-12T18:19:57.863600+0000","last_unstale":"2024-09-12T18:57:17.461644+0000","last_undegraded":"2024-09-12T18:57:17.461644+0000","last_fullsized":"2024-09-12T18:57:17.461644+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.347599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426455+0000","last_change":"2024-09-12T17:59:43.033456+0000","last_active":"2024-09-12T18:55:17.426455+0000","last_peered":"2024-09-12T18:55:17.426455+0000","last_clean":"2024-09-12T18:55:17.426455+0000","last_became_active":"2024-09-12T17:59:43.031016+0000","last_became_peered":"2024-09-12T17:59:43.031016+0000","last_unstale":"2024-09-12T18:55:17.426455+0000","last_undegraded":"2024-09-12T18:55:17.426455+0000","last_fullsized":"2024-09-12T18:55:17.426455+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:41.898618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:52.618126+0000","last_change":"2024-09-12T17:59:38.966961+0000","last_active":"2024-09-12T18:55:52.618126+0000","last_peered":"2024-09-12T18:55:52.618126+0000","last_clean":"2024-09-12T18:55:52.618126+0000","last_became_active":"2024-09-12T17:59:38.966158+0000","last_became_peered":"2024-09-12T17:59:38.966158+0000","last_unstale":"2024-09-12T18:55:52.618126+0000","last_undegraded":"2024-09-12T18:55:52.618126+0000","last_fullsized":"2024-09-12T18:55:52.618126+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:05.792036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'26","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.460293+0000","last_change":"2024-09-12T17:55:59.367819+0000","last_active":"2024-09-12T18:56:27.460293+0000","last_peered":"2024-09-12T18:56:27.460293+0000","last_clean":"2024-09-12T18:56:27.460293+0000","last_became_active":"2024-09-12T17:55:59.366803+0000","last_became_peered":"2024-09-12T17:55:59.366803+0000","last_unstale":"2024-09-12T18:56:27.460293+0000","last_undegraded":"2024-09-12T18:56:27.460293+0000","last_fullsized":"2024-09-12T18:56:27.460293+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:11.044959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:19.448910+0000","last_change":"2024-09-12T18:19:57.846272+0000","last_active":"2024-09-12T18:57:19.448910+0000","last_peered":"2024-09-12T18:57:19.448910+0000","last_clean":"2024-09-12T18:57:19.448910+0000","last_became_active":"2024-09-12T18:19:57.845474+0000","last_became_peered":"2024-09-12T18:19:57.845474+0000","last_unstale":"2024-09-12T18:57:19.448910+0000","last_undegraded":"2024-09-12T18:57:19.448910+0000","last_fullsized":"2024-09-12T18:57:19.448910+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:36.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437270+0000","last_change":"2024-09-12T17:59:43.034867+0000","last_active":"2024-09-12T18:56:02.437270+0000","last_peered":"2024-09-12T18:56:02.437270+0000","last_clean":"2024-09-12T18:56:02.437270+0000","last_became_active":"2024-09-12T17:59:43.034159+0000","last_became_peered":"2024-09-12T17:59:43.034159+0000","last_unstale":"2024-09-12T18:56:02.437270+0000","last_undegraded":"2024-09-12T18:56:02.437270+0000","last_fullsized":"2024-09-12T18:56:02.437270+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:55.391915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426051+0000","last_change":"2024-09-12T17:59:38.981580+0000","last_active":"2024-09-12T18:55:17.426051+0000","last_peered":"2024-09-12T18:55:17.426051+0000","last_clean":"2024-09-12T18:55:17.426051+0000","last_became_active":"2024-09-12T17:59:38.980797+0000","last_became_peered":"2024-09-12T17:59:38.980797+0000","last_unstale":"2024-09-12T18:55:17.426051+0000","last_undegraded":"2024-09-12T18:55:17.426051+0000","last_fullsized":"2024-09-12T18:55:17.426051+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:47.982971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'6","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442893+0000","last_change":"2024-09-12T17:55:59.367443+0000","last_active":"2024-09-12T18:56:27.442893+0000","last_peered":"2024-09-12T18:56:27.442893+0000","last_clean":"2024-09-12T18:56:27.442893+0000","last_became_active":"2024-09-12T17:55:59.366679+0000","last_became_peered":"2024-09-12T17:55:59.366679+0000","last_unstale":"2024-09-12T18:56:27.442893+0000","last_undegraded":"2024-09-12T18:56:27.442893+0000","last_fullsized":"2024-09-12T18:56:27.442893+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.004334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.454894+0000","last_change":"2024-09-12T18:19:57.841634+0000","last_active":"2024-09-12T18:57:17.454894+0000","last_peered":"2024-09-12T18:57:17.454894+0000","last_clean":"2024-09-12T18:57:17.454894+0000","last_became_active":"2024-09-12T18:19:57.840855+0000","last_became_peered":"2024-09-12T18:19:57.840855+0000","last_unstale":"2024-09-12T18:57:17.454894+0000","last_undegraded":"2024-09-12T18:57:17.454894+0000","last_fullsized":"2024-09-12T18:57:17.454894+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:43.276958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426540+0000","last_change":"2024-09-12T17:59:43.029670+0000","last_active":"2024-09-12T18:55:17.426540+0000","last_peered":"2024-09-12T18:55:17.426540+0000","last_clean":"2024-09-12T18:55:17.426540+0000","last_became_active":"2024-09-12T17:59:43.021538+0000","last_became_peered":"2024-09-12T17:59:43.021538+0000","last_unstale":"2024-09-12T18:55:17.426540+0000","last_undegraded":"2024-09-12T18:55:17.426540+0000","last_fullsized":"2024-09-12T18:55:17.426540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:19.134601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:14.423842+0000","last_change":"2024-09-12T17:59:38.980849+0000","last_active":"2024-09-12T18:55:14.423842+0000","last_peered":"2024-09-12T18:55:14.423842+0000","last_clean":"2024-09-12T18:55:14.423842+0000","last_became_active":"2024-09-12T17:59:38.979939+0000","last_became_peered":"2024-09-12T17:59:38.979939+0000","last_unstale":"2024-09-12T18:55:14.423842+0000","last_undegraded":"2024-09-12T18:55:14.423842+0000","last_fullsized":"2024-09-12T18:55:14.423842+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:42.205852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'36","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:24.438322+0000","last_change":"2024-09-12T17:55:59.331420+0000","last_active":"2024-09-12T18:56:24.438322+0000","last_peered":"2024-09-12T18:56:24.438322+0000","last_clean":"2024-09-12T18:56:24.438322+0000","last_became_active":"2024-09-12T17:55:59.330570+0000","last_became_peered":"2024-09-12T17:55:59.330570+0000","last_unstale":"2024-09-12T18:56:24.438322+0000","last_undegraded":"2024-09-12T18:56:24.438322+0000","last_fullsized":"2024-09-12T18:56:24.438322+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:37.462782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":139,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637308+0000","last_change":"2024-09-12T18:19:57.854199+0000","last_active":"2024-09-12T18:57:17.637308+0000","last_peered":"2024-09-12T18:57:17.637308+0000","last_clean":"2024-09-12T18:57:17.637308+0000","last_became_active":"2024-09-12T18:19:57.853269+0000","last_became_peered":"2024-09-12T18:19:57.853269+0000","last_unstale":"2024-09-12T18:57:17.637308+0000","last_undegraded":"2024-09-12T18:57:17.637308+0000","last_fullsized":"2024-09-12T18:57:17.637308+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:58.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.791801+0000","last_change":"2024-09-12T17:59:43.022601+0000","last_active":"2024-09-12T18:55:17.791801+0000","last_peered":"2024-09-12T18:55:17.791801+0000","last_clean":"2024-09-12T18:55:17.791801+0000","last_became_active":"2024-09-12T17:59:43.020450+0000","last_became_peered":"2024-09-12T17:59:43.020450+0000","last_unstale":"2024-09-12T18:55:17.791801+0000","last_undegraded":"2024-09-12T18:55:17.791801+0000","last_fullsized":"2024-09-12T18:55:17.791801+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:53.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'5","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.444851+0000","last_change":"2024-09-12T17:59:38.983301+0000","last_active":"2024-09-12T18:55:17.444851+0000","last_peered":"2024-09-12T18:55:17.444851+0000","last_clean":"2024-09-12T18:55:17.444851+0000","last_became_active":"2024-09-12T17:59:38.982556+0000","last_became_peered":"2024-09-12T17:59:38.982556+0000","last_unstale":"2024-09-12T18:55:17.444851+0000","last_undegraded":"2024-09-12T18:55:17.444851+0000","last_fullsized":"2024-09-12T18:55:17.444851+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:24.195379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'83","reported_seq":293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450356+0000","last_change":"2024-09-12T17:55:59.364021+0000","last_active":"2024-09-12T18:56:57.450356+0000","last_peered":"2024-09-12T18:56:57.450356+0000","last_clean":"2024-09-12T18:56:57.450356+0000","last_became_active":"2024-09-12T17:55:59.363431+0000","last_became_peered":"2024-09-12T17:55:59.363431+0000","last_unstale":"2024-09-12T18:56:57.450356+0000","last_undegraded":"2024-09-12T18:56:57.450356+0000","last_fullsized":"2024-09-12T18:56:57.450356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.240236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":321,"num_write":127,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439374+0000","last_change":"2024-09-12T18:19:57.836599+0000","last_active":"2024-09-12T18:56:12.439374+0000","last_peered":"2024-09-12T18:56:12.439374+0000","last_clean":"2024-09-12T18:56:12.439374+0000","last_became_active":"2024-09-12T18:19:57.835852+0000","last_became_peered":"2024-09-12T18:19:57.835852+0000","last_unstale":"2024-09-12T18:56:12.439374+0000","last_undegraded":"2024-09-12T18:56:12.439374+0000","last_fullsized":"2024-09-12T18:56:12.439374+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:03.387557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'1","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.441459+0000","last_change":"2024-09-12T17:59:43.024923+0000","last_active":"2024-09-12T18:55:42.441459+0000","last_peered":"2024-09-12T18:55:42.441459+0000","last_clean":"2024-09-12T18:55:42.441459+0000","last_became_active":"2024-09-12T17:59:43.024103+0000","last_became_peered":"2024-09-12T17:59:43.024103+0000","last_unstale":"2024-09-12T18:55:42.441459+0000","last_undegraded":"2024-09-12T18:55:42.441459+0000","last_fullsized":"2024-09-12T18:55:42.441459+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:49.895418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.797325+0000","last_change":"2024-09-12T17:59:38.978753+0000","last_active":"2024-09-12T18:55:42.797325+0000","last_peered":"2024-09-12T18:55:42.797325+0000","last_clean":"2024-09-12T18:55:42.797325+0000","last_became_active":"2024-09-12T17:59:38.978126+0000","last_became_peered":"2024-09-12T17:59:38.978126+0000","last_unstale":"2024-09-12T18:55:42.797325+0000","last_undegraded":"2024-09-12T18:55:42.797325+0000","last_fullsized":"2024-09-12T18:55:42.797325+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:24.186587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'82","reported_seq":334,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446848+0000","last_change":"2024-09-12T17:55:59.364464+0000","last_active":"2024-09-12T18:56:42.446848+0000","last_peered":"2024-09-12T18:56:42.446848+0000","last_clean":"2024-09-12T18:56:42.446848+0000","last_became_active":"2024-09-12T17:55:59.363574+0000","last_became_peered":"2024-09-12T17:55:59.363574+0000","last_unstale":"2024-09-12T18:56:42.446848+0000","last_undegraded":"2024-09-12T18:56:42.446848+0000","last_fullsized":"2024-09-12T18:56:42.446848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:45.008706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":530,"num_read_kb":371,"num_write":118,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456819+0000","last_change":"2024-09-12T18:19:57.847909+0000","last_active":"2024-09-12T18:56:12.456819+0000","last_peered":"2024-09-12T18:56:12.456819+0000","last_clean":"2024-09-12T18:56:12.456819+0000","last_became_active":"2024-09-12T18:19:57.847092+0000","last_became_peered":"2024-09-12T18:19:57.847092+0000","last_unstale":"2024-09-12T18:56:12.456819+0000","last_undegraded":"2024-09-12T18:56:12.456819+0000","last_fullsized":"2024-09-12T18:56:12.456819+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:58.160509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.441383+0000","last_change":"2024-09-12T17:59:43.034884+0000","last_active":"2024-09-12T18:55:42.441383+0000","last_peered":"2024-09-12T18:55:42.441383+0000","last_clean":"2024-09-12T18:55:42.441383+0000","last_became_active":"2024-09-12T17:59:43.034180+0000","last_became_peered":"2024-09-12T17:59:43.034180+0000","last_unstale":"2024-09-12T18:55:42.441383+0000","last_undegraded":"2024-09-12T18:55:42.441383+0000","last_fullsized":"2024-09-12T18:55:42.441383+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:28.291989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.432566+0000","last_change":"2024-09-12T17:59:38.976298+0000","last_active":"2024-09-12T18:55:42.432566+0000","last_peered":"2024-09-12T18:55:42.432566+0000","last_clean":"2024-09-12T18:55:42.432566+0000","last_became_active":"2024-09-12T17:59:38.969338+0000","last_became_peered":"2024-09-12T17:59:38.969338+0000","last_unstale":"2024-09-12T18:55:42.432566+0000","last_undegraded":"2024-09-12T18:55:42.432566+0000","last_fullsized":"2024-09-12T18:55:42.432566+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:06.102519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'36","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463141+0000","last_change":"2024-09-12T17:55:59.357946+0000","last_active":"2024-09-12T18:56:42.463141+0000","last_peered":"2024-09-12T18:56:42.463141+0000","last_clean":"2024-09-12T18:56:42.463141+0000","last_became_active":"2024-09-12T17:55:59.357330+0000","last_became_peered":"2024-09-12T17:55:59.357330+0000","last_unstale":"2024-09-12T18:56:42.463141+0000","last_undegraded":"2024-09-12T18:56:42.463141+0000","last_fullsized":"2024-09-12T18:56:42.463141+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.691647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":130,"num_write":63,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473367+0000","last_change":"2024-09-12T18:19:57.840998+0000","last_active":"2024-09-12T18:57:27.473367+0000","last_peered":"2024-09-12T18:57:27.473367+0000","last_clean":"2024-09-12T18:57:27.473367+0000","last_became_active":"2024-09-12T18:19:57.839696+0000","last_became_peered":"2024-09-12T18:19:57.839696+0000","last_unstale":"2024-09-12T18:57:27.473367+0000","last_undegraded":"2024-09-12T18:57:27.473367+0000","last_fullsized":"2024-09-12T18:57:27.473367+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:36.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.432690+0000","last_change":"2024-09-12T17:59:43.031197+0000","last_active":"2024-09-12T18:55:42.432690+0000","last_peered":"2024-09-12T18:55:42.432690+0000","last_clean":"2024-09-12T18:55:42.432690+0000","last_became_active":"2024-09-12T17:59:43.030490+0000","last_became_peered":"2024-09-12T17:59:43.030490+0000","last_unstale":"2024-09-12T18:55:42.432690+0000","last_undegraded":"2024-09-12T18:55:42.432690+0000","last_fullsized":"2024-09-12T18:55:42.432690+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:07.847587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8972971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":16955,"num_write":3,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"261'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421218+0000","last_change":"2024-09-12T17:59:38.990771+0000","last_active":"2024-09-12T18:55:42.421218+0000","last_peered":"2024-09-12T18:55:42.421218+0000","last_clean":"2024-09-12T18:55:42.421218+0000","last_became_active":"2024-09-12T17:59:38.990212+0000","last_became_peered":"2024-09-12T17:59:38.990212+0000","last_unstale":"2024-09-12T18:55:42.421218+0000","last_undegraded":"2024-09-12T18:55:42.421218+0000","last_fullsized":"2024-09-12T18:55:42.421218+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:13.467525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'28","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.810172+0000","last_change":"2024-09-12T17:55:59.357645+0000","last_active":"2024-09-12T18:56:42.810172+0000","last_peered":"2024-09-12T18:56:42.810172+0000","last_clean":"2024-09-12T18:56:42.810172+0000","last_became_active":"2024-09-12T17:55:59.356838+0000","last_became_peered":"2024-09-12T17:55:59.356838+0000","last_unstale":"2024-09-12T18:56:42.810172+0000","last_undegraded":"2024-09-12T18:56:42.810172+0000","last_fullsized":"2024-09-12T18:56:42.810172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:09.388925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":96,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439310+0000","last_change":"2024-09-12T18:19:57.837873+0000","last_active":"2024-09-12T18:56:12.439310+0000","last_peered":"2024-09-12T18:56:12.439310+0000","last_clean":"2024-09-12T18:56:12.439310+0000","last_became_active":"2024-09-12T18:19:57.837079+0000","last_became_peered":"2024-09-12T18:19:57.837079+0000","last_unstale":"2024-09-12T18:56:12.439310+0000","last_undegraded":"2024-09-12T18:56:12.439310+0000","last_fullsized":"2024-09-12T18:56:12.439310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:28.254760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421187+0000","last_change":"2024-09-12T17:59:43.033009+0000","last_active":"2024-09-12T18:55:42.421187+0000","last_peered":"2024-09-12T18:55:42.421187+0000","last_clean":"2024-09-12T18:55:42.421187+0000","last_became_active":"2024-09-12T17:59:43.032008+0000","last_became_peered":"2024-09-12T17:59:43.032008+0000","last_unstale":"2024-09-12T18:55:42.421187+0000","last_undegraded":"2024-09-12T18:55:42.421187+0000","last_fullsized":"2024-09-12T18:55:42.421187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:48.490537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'4","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.615900+0000","last_change":"2024-09-12T17:59:38.982851+0000","last_active":"2024-09-12T18:55:42.615900+0000","last_peered":"2024-09-12T18:55:42.615900+0000","last_clean":"2024-09-12T18:55:42.615900+0000","last_became_active":"2024-09-12T17:59:38.982037+0000","last_became_peered":"2024-09-12T17:59:38.982037+0000","last_unstale":"2024-09-12T18:55:42.615900+0000","last_undegraded":"2024-09-12T18:55:42.615900+0000","last_fullsized":"2024-09-12T18:55:42.615900+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:27.861115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446599+0000","last_change":"2024-09-12T17:55:59.358325+0000","last_active":"2024-09-12T18:56:42.446599+0000","last_peered":"2024-09-12T18:56:42.446599+0000","last_clean":"2024-09-12T18:56:42.446599+0000","last_became_active":"2024-09-12T17:55:59.357659+0000","last_became_peered":"2024-09-12T17:55:59.357659+0000","last_unstale":"2024-09-12T18:56:42.446599+0000","last_undegraded":"2024-09-12T18:56:42.446599+0000","last_fullsized":"2024-09-12T18:56:42.446599+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:47.942214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":69,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:59.444670+0000","last_change":"2024-09-12T18:19:57.850425+0000","last_active":"2024-09-12T18:56:59.444670+0000","last_peered":"2024-09-12T18:56:59.444670+0000","last_clean":"2024-09-12T18:56:59.444670+0000","last_became_active":"2024-09-12T18:19:57.849682+0000","last_became_peered":"2024-09-12T18:19:57.849682+0000","last_unstale":"2024-09-12T18:56:59.444670+0000","last_undegraded":"2024-09-12T18:56:59.444670+0000","last_fullsized":"2024-09-12T18:56:59.444670+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:20.403776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'1","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436381+0000","last_change":"2024-09-12T17:59:43.027722+0000","last_active":"2024-09-12T18:55:57.436381+0000","last_peered":"2024-09-12T18:55:57.436381+0000","last_clean":"2024-09-12T18:55:57.436381+0000","last_became_active":"2024-09-12T17:59:43.026619+0000","last_became_peered":"2024-09-12T17:59:43.026619+0000","last_unstale":"2024-09-12T18:55:57.436381+0000","last_undegraded":"2024-09-12T18:55:57.436381+0000","last_fullsized":"2024-09-12T18:55:57.436381+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:14.706171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436215+0000","last_change":"2024-09-12T17:59:38.988617+0000","last_active":"2024-09-12T18:55:57.436215+0000","last_peered":"2024-09-12T18:55:57.436215+0000","last_clean":"2024-09-12T18:55:57.436215+0000","last_became_active":"2024-09-12T17:59:38.988028+0000","last_became_peered":"2024-09-12T17:59:38.988028+0000","last_unstale":"2024-09-12T18:55:57.436215+0000","last_undegraded":"2024-09-12T18:55:57.436215+0000","last_fullsized":"2024-09-12T18:55:57.436215+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:44.387070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'56","reported_seq":214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.453486+0000","last_change":"2024-09-12T17:55:59.361430+0000","last_active":"2024-09-12T18:57:07.453486+0000","last_peered":"2024-09-12T18:57:07.453486+0000","last_clean":"2024-09-12T18:57:07.453486+0000","last_became_active":"2024-09-12T17:55:59.360197+0000","last_became_peered":"2024-09-12T17:55:59.360197+0000","last_unstale":"2024-09-12T18:57:07.453486+0000","last_undegraded":"2024-09-12T18:57:07.453486+0000","last_fullsized":"2024-09-12T18:57:07.453486+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:56.611826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":199,"num_write":102,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436067+0000","last_change":"2024-09-12T18:19:57.869950+0000","last_active":"2024-09-12T18:55:57.436067+0000","last_peered":"2024-09-12T18:55:57.436067+0000","last_clean":"2024-09-12T18:55:57.436067+0000","last_became_active":"2024-09-12T18:19:57.869302+0000","last_became_peered":"2024-09-12T18:19:57.869302+0000","last_unstale":"2024-09-12T18:55:57.436067+0000","last_undegraded":"2024-09-12T18:55:57.436067+0000","last_fullsized":"2024-09-12T18:55:57.436067+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:38.615499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436275+0000","last_change":"2024-09-12T17:59:43.034683+0000","last_active":"2024-09-12T18:55:57.436275+0000","last_peered":"2024-09-12T18:55:57.436275+0000","last_clean":"2024-09-12T18:55:57.436275+0000","last_became_active":"2024-09-12T17:59:43.030846+0000","last_became_peered":"2024-09-12T17:59:43.030846+0000","last_unstale":"2024-09-12T18:55:57.436275+0000","last_undegraded":"2024-09-12T18:55:57.436275+0000","last_fullsized":"2024-09-12T18:55:57.436275+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:40.165184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:54.432260+0000","last_change":"2024-09-12T17:59:38.969547+0000","last_active":"2024-09-12T18:55:54.432260+0000","last_peered":"2024-09-12T18:55:54.432260+0000","last_clean":"2024-09-12T18:55:54.432260+0000","last_became_active":"2024-09-12T17:59:38.968775+0000","last_became_peered":"2024-09-12T17:59:38.968775+0000","last_unstale":"2024-09-12T18:55:54.432260+0000","last_undegraded":"2024-09-12T18:55:54.432260+0000","last_fullsized":"2024-09-12T18:55:54.432260+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:07.669336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48431,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":5,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.630374+0000","last_change":"2024-09-12T17:55:59.362984+0000","last_active":"2024-09-12T18:56:47.630374+0000","last_peered":"2024-09-12T18:56:47.630374+0000","last_clean":"2024-09-12T18:56:47.630374+0000","last_became_active":"2024-09-12T17:55:59.358747+0000","last_became_peered":"2024-09-12T17:55:59.358747+0000","last_unstale":"2024-09-12T18:56:47.630374+0000","last_undegraded":"2024-09-12T18:56:47.630374+0000","last_fullsized":"2024-09-12T18:56:47.630374+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:28.675045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.434729+0000","last_change":"2024-09-12T18:19:57.823688+0000","last_active":"2024-09-12T18:56:47.434729+0000","last_peered":"2024-09-12T18:56:47.434729+0000","last_clean":"2024-09-12T18:56:47.434729+0000","last_became_active":"2024-09-12T18:19:57.822958+0000","last_became_peered":"2024-09-12T18:19:57.822958+0000","last_unstale":"2024-09-12T18:56:47.434729+0000","last_undegraded":"2024-09-12T18:56:47.434729+0000","last_fullsized":"2024-09-12T18:56:47.434729+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:54.471704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'4","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447688+0000","last_change":"2024-09-12T17:59:43.007833+0000","last_active":"2024-09-12T18:56:12.447688+0000","last_peered":"2024-09-12T18:56:12.447688+0000","last_clean":"2024-09-12T18:56:12.447688+0000","last_became_active":"2024-09-12T17:59:43.006748+0000","last_became_peered":"2024-09-12T17:59:43.006748+0000","last_unstale":"2024-09-12T18:56:12.447688+0000","last_undegraded":"2024-09-12T18:56:12.447688+0000","last_fullsized":"2024-09-12T18:56:12.447688+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:10.151387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453872+0000","last_change":"2024-09-12T17:59:38.963724+0000","last_active":"2024-09-12T18:55:57.453872+0000","last_peered":"2024-09-12T18:55:57.453872+0000","last_clean":"2024-09-12T18:55:57.453872+0000","last_became_active":"2024-09-12T17:59:38.962944+0000","last_became_peered":"2024-09-12T17:59:38.962944+0000","last_unstale":"2024-09-12T18:55:57.453872+0000","last_undegraded":"2024-09-12T18:55:57.453872+0000","last_fullsized":"2024-09-12T18:55:57.453872+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:57.731165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'30","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.434839+0000","last_change":"2024-09-12T17:55:59.347093+0000","last_active":"2024-09-12T18:56:47.434839+0000","last_peered":"2024-09-12T18:56:47.434839+0000","last_clean":"2024-09-12T18:56:47.434839+0000","last_became_active":"2024-09-12T17:55:59.345735+0000","last_became_peered":"2024-09-12T17:55:59.345735+0000","last_unstale":"2024-09-12T18:56:47.434839+0000","last_undegraded":"2024-09-12T18:56:47.434839+0000","last_fullsized":"2024-09-12T18:56:47.434839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:02.647291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.447954+0000","last_change":"2024-09-12T18:19:57.856472+0000","last_active":"2024-09-12T18:56:47.447954+0000","last_peered":"2024-09-12T18:56:47.447954+0000","last_clean":"2024-09-12T18:56:47.447954+0000","last_became_active":"2024-09-12T18:19:57.855728+0000","last_became_peered":"2024-09-12T18:19:57.855728+0000","last_unstale":"2024-09-12T18:56:47.447954+0000","last_undegraded":"2024-09-12T18:56:47.447954+0000","last_fullsized":"2024-09-12T18:56:47.447954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:06.104974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'1","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436433+0000","last_change":"2024-09-12T17:59:43.020154+0000","last_active":"2024-09-12T18:55:57.436433+0000","last_peered":"2024-09-12T18:55:57.436433+0000","last_clean":"2024-09-12T18:55:57.436433+0000","last_became_active":"2024-09-12T17:59:43.019325+0000","last_became_peered":"2024-09-12T17:59:43.019325+0000","last_unstale":"2024-09-12T18:55:57.436433+0000","last_undegraded":"2024-09-12T18:55:57.436433+0000","last_fullsized":"2024-09-12T18:55:57.436433+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.764700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447641+0000","last_change":"2024-09-12T17:59:38.978392+0000","last_active":"2024-09-12T18:56:12.447641+0000","last_peered":"2024-09-12T18:56:12.447641+0000","last_clean":"2024-09-12T18:56:12.447641+0000","last_became_active":"2024-09-12T17:59:38.977733+0000","last_became_peered":"2024-09-12T17:59:38.977733+0000","last_unstale":"2024-09-12T18:56:12.447641+0000","last_undegraded":"2024-09-12T18:56:12.447641+0000","last_fullsized":"2024-09-12T18:56:12.447641+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:10.294635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'50","reported_seq":197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:44.441874+0000","last_change":"2024-09-12T17:55:59.341871+0000","last_active":"2024-09-12T18:56:44.441874+0000","last_peered":"2024-09-12T18:56:44.441874+0000","last_clean":"2024-09-12T18:56:44.441874+0000","last_became_active":"2024-09-12T17:55:59.341145+0000","last_became_peered":"2024-09-12T17:55:59.341145+0000","last_unstale":"2024-09-12T18:56:44.441874+0000","last_undegraded":"2024-09-12T18:56:44.441874+0000","last_fullsized":"2024-09-12T18:56:44.441874+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:36.782820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":177,"num_write":99,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436472+0000","last_change":"2024-09-12T18:19:57.865840+0000","last_active":"2024-09-12T18:55:57.436472+0000","last_peered":"2024-09-12T18:55:57.436472+0000","last_clean":"2024-09-12T18:55:57.436472+0000","last_became_active":"2024-09-12T18:19:57.865311+0000","last_became_peered":"2024-09-12T18:19:57.865311+0000","last_unstale":"2024-09-12T18:55:57.436472+0000","last_undegraded":"2024-09-12T18:55:57.436472+0000","last_fullsized":"2024-09-12T18:55:57.436472+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:05.947872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'7","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.801680+0000","last_change":"2024-09-12T17:59:43.030010+0000","last_active":"2024-09-12T18:56:02.801680+0000","last_peered":"2024-09-12T18:56:02.801680+0000","last_clean":"2024-09-12T18:56:02.801680+0000","last_became_active":"2024-09-12T17:59:43.029489+0000","last_became_peered":"2024-09-12T17:59:43.029489+0000","last_unstale":"2024-09-12T18:56:02.801680+0000","last_undegraded":"2024-09-12T18:56:02.801680+0000","last_fullsized":"2024-09-12T18:56:02.801680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:49.435494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.454562+0000","last_change":"2024-09-12T17:59:38.976141+0000","last_active":"2024-09-12T18:56:02.454562+0000","last_peered":"2024-09-12T18:56:02.454562+0000","last_clean":"2024-09-12T18:56:02.454562+0000","last_became_active":"2024-09-12T17:59:38.965185+0000","last_became_peered":"2024-09-12T17:59:38.965185+0000","last_unstale":"2024-09-12T18:56:02.454562+0000","last_undegraded":"2024-09-12T18:56:02.454562+0000","last_fullsized":"2024-09-12T18:56:02.454562+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:28.251671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'20","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464249+0000","last_change":"2024-09-12T17:55:59.360413+0000","last_active":"2024-09-12T18:56:47.464249+0000","last_peered":"2024-09-12T18:56:47.464249+0000","last_clean":"2024-09-12T18:56:47.464249+0000","last_became_active":"2024-09-12T17:55:59.359849+0000","last_became_peered":"2024-09-12T17:55:59.359849+0000","last_unstale":"2024-09-12T18:56:47.464249+0000","last_undegraded":"2024-09-12T18:56:47.464249+0000","last_fullsized":"2024-09-12T18:56:47.464249+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:05.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:07.438710+0000","last_change":"2024-09-12T18:19:57.855820+0000","last_active":"2024-09-12T18:56:07.438710+0000","last_peered":"2024-09-12T18:56:07.438710+0000","last_clean":"2024-09-12T18:56:07.438710+0000","last_became_active":"2024-09-12T18:19:57.855140+0000","last_became_peered":"2024-09-12T18:19:57.855140+0000","last_unstale":"2024-09-12T18:56:07.438710+0000","last_undegraded":"2024-09-12T18:56:07.438710+0000","last_fullsized":"2024-09-12T18:56:07.438710+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:19.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437282+0000","last_change":"2024-09-12T17:59:43.016545+0000","last_active":"2024-09-12T18:56:02.437282+0000","last_peered":"2024-09-12T18:56:02.437282+0000","last_clean":"2024-09-12T18:56:02.437282+0000","last_became_active":"2024-09-12T17:59:43.015273+0000","last_became_peered":"2024-09-12T17:59:43.015273+0000","last_unstale":"2024-09-12T18:56:02.437282+0000","last_undegraded":"2024-09-12T18:56:02.437282+0000","last_fullsized":"2024-09-12T18:56:02.437282+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:00.852160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'6","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.445112+0000","last_change":"2024-09-12T17:59:38.985394+0000","last_active":"2024-09-12T18:56:02.445112+0000","last_peered":"2024-09-12T18:56:02.445112+0000","last_clean":"2024-09-12T18:56:02.445112+0000","last_became_active":"2024-09-12T17:59:38.984684+0000","last_became_peered":"2024-09-12T17:59:38.984684+0000","last_unstale":"2024-09-12T18:56:02.445112+0000","last_undegraded":"2024-09-12T18:56:02.445112+0000","last_fullsized":"2024-09-12T18:56:02.445112+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:33.698538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'48","reported_seq":197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450249+0000","last_change":"2024-09-12T17:55:59.346860+0000","last_active":"2024-09-12T18:56:57.450249+0000","last_peered":"2024-09-12T18:56:57.450249+0000","last_clean":"2024-09-12T18:56:57.450249+0000","last_became_active":"2024-09-12T17:55:59.346128+0000","last_became_peered":"2024-09-12T17:55:59.346128+0000","last_unstale":"2024-09-12T18:56:57.450249+0000","last_undegraded":"2024-09-12T18:56:57.450249+0000","last_fullsized":"2024-09-12T18:56:57.450249+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:20.618591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":194,"num_write":71,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436169+0000","last_change":"2024-09-12T18:19:57.851475+0000","last_active":"2024-09-12T18:55:57.436169+0000","last_peered":"2024-09-12T18:55:57.436169+0000","last_clean":"2024-09-12T18:55:57.436169+0000","last_became_active":"2024-09-12T18:19:57.848892+0000","last_became_peered":"2024-09-12T18:19:57.848892+0000","last_unstale":"2024-09-12T18:55:57.436169+0000","last_undegraded":"2024-09-12T18:55:57.436169+0000","last_fullsized":"2024-09-12T18:55:57.436169+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:29.052912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'5","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.444266+0000","last_change":"2024-09-12T17:59:43.038219+0000","last_active":"2024-09-12T18:55:57.444266+0000","last_peered":"2024-09-12T18:55:57.444266+0000","last_clean":"2024-09-12T18:55:57.444266+0000","last_became_active":"2024-09-12T17:59:43.034558+0000","last_became_peered":"2024-09-12T17:59:43.034558+0000","last_unstale":"2024-09-12T18:55:57.444266+0000","last_undegraded":"2024-09-12T18:55:57.444266+0000","last_fullsized":"2024-09-12T18:55:57.444266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:16.222044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.457891+0000","last_change":"2024-09-12T17:59:38.981757+0000","last_active":"2024-09-12T18:56:17.457891+0000","last_peered":"2024-09-12T18:56:17.457891+0000","last_clean":"2024-09-12T18:56:17.457891+0000","last_became_active":"2024-09-12T17:59:38.973403+0000","last_became_peered":"2024-09-12T17:59:38.973403+0000","last_unstale":"2024-09-12T18:56:17.457891+0000","last_undegraded":"2024-09-12T18:56:17.457891+0000","last_fullsized":"2024-09-12T18:56:17.457891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:16.251811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'38","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446643+0000","last_change":"2024-09-12T17:55:59.346585+0000","last_active":"2024-09-12T18:56:42.446643+0000","last_peered":"2024-09-12T18:56:42.446643+0000","last_clean":"2024-09-12T18:56:42.446643+0000","last_became_active":"2024-09-12T17:55:59.345382+0000","last_became_peered":"2024-09-12T17:55:59.345382+0000","last_unstale":"2024-09-12T18:56:42.446643+0000","last_undegraded":"2024-09-12T18:56:42.446643+0000","last_fullsized":"2024-09-12T18:56:42.446643+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:18.100800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":134,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453836+0000","last_change":"2024-09-12T18:19:57.844298+0000","last_active":"2024-09-12T18:55:57.453836+0000","last_peered":"2024-09-12T18:55:57.453836+0000","last_clean":"2024-09-12T18:55:57.453836+0000","last_became_active":"2024-09-12T18:19:57.843489+0000","last_became_peered":"2024-09-12T18:19:57.843489+0000","last_unstale":"2024-09-12T18:55:57.453836+0000","last_undegraded":"2024-09-12T18:55:57.453836+0000","last_fullsized":"2024-09-12T18:55:57.453836+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:30.667507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.440945+0000","last_change":"2024-09-12T17:59:43.023323+0000","last_active":"2024-09-12T18:56:17.440945+0000","last_peered":"2024-09-12T18:56:17.440945+0000","last_clean":"2024-09-12T18:56:17.440945+0000","last_became_active":"2024-09-12T17:59:43.022592+0000","last_became_peered":"2024-09-12T17:59:43.022592+0000","last_unstale":"2024-09-12T18:56:17.440945+0000","last_undegraded":"2024-09-12T18:56:17.440945+0000","last_fullsized":"2024-09-12T18:56:17.440945+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:49.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'3","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800656+0000","last_change":"2024-09-12T17:59:38.976388+0000","last_active":"2024-09-12T18:55:57.800656+0000","last_peered":"2024-09-12T18:55:57.800656+0000","last_clean":"2024-09-12T18:55:57.800656+0000","last_became_active":"2024-09-12T17:59:38.975635+0000","last_became_peered":"2024-09-12T17:59:38.975635+0000","last_unstale":"2024-09-12T18:55:57.800656+0000","last_undegraded":"2024-09-12T18:55:57.800656+0000","last_fullsized":"2024-09-12T18:55:57.800656+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:08.497281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'44","reported_seq":180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433653+0000","last_change":"2024-09-12T17:55:59.352208+0000","last_active":"2024-09-12T18:56:42.433653+0000","last_peered":"2024-09-12T18:56:42.433653+0000","last_clean":"2024-09-12T18:56:42.433653+0000","last_became_active":"2024-09-12T17:55:59.351492+0000","last_became_peered":"2024-09-12T17:55:59.351492+0000","last_unstale":"2024-09-12T18:56:42.433653+0000","last_undegraded":"2024-09-12T18:56:42.433653+0000","last_fullsized":"2024-09-12T18:56:42.433653+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:59.997737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":151,"num_write":82,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457255+0000","last_change":"2024-09-12T18:19:57.856229+0000","last_active":"2024-09-12T18:57:27.457255+0000","last_peered":"2024-09-12T18:57:27.457255+0000","last_clean":"2024-09-12T18:57:27.457255+0000","last_became_active":"2024-09-12T18:19:57.855547+0000","last_became_peered":"2024-09-12T18:19:57.855547+0000","last_unstale":"2024-09-12T18:57:27.457255+0000","last_undegraded":"2024-09-12T18:57:27.457255+0000","last_fullsized":"2024-09-12T18:57:27.457255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:07.356723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'9","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456706+0000","last_change":"2024-09-12T17:59:43.010558+0000","last_active":"2024-09-12T18:56:12.456706+0000","last_peered":"2024-09-12T18:56:12.456706+0000","last_clean":"2024-09-12T18:56:12.456706+0000","last_became_active":"2024-09-12T17:59:43.009629+0000","last_became_peered":"2024-09-12T17:59:43.009629+0000","last_unstale":"2024-09-12T18:56:12.456706+0000","last_undegraded":"2024-09-12T18:56:12.456706+0000","last_fullsized":"2024-09-12T18:56:12.456706+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:57.722700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":19,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436134+0000","last_change":"2024-09-12T17:59:38.980397+0000","last_active":"2024-09-12T18:55:57.436134+0000","last_peered":"2024-09-12T18:55:57.436134+0000","last_clean":"2024-09-12T18:55:57.436134+0000","last_became_active":"2024-09-12T17:59:38.979704+0000","last_became_peered":"2024-09-12T17:59:38.979704+0000","last_unstale":"2024-09-12T18:55:57.436134+0000","last_undegraded":"2024-09-12T18:55:57.436134+0000","last_fullsized":"2024-09-12T18:55:57.436134+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:15.520490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463327+0000","last_change":"2024-09-12T17:55:59.357098+0000","last_active":"2024-09-12T18:56:42.463327+0000","last_peered":"2024-09-12T18:56:42.463327+0000","last_clean":"2024-09-12T18:56:42.463327+0000","last_became_active":"2024-09-12T17:55:59.356402+0000","last_became_peered":"2024-09-12T17:55:59.356402+0000","last_unstale":"2024-09-12T18:56:42.463327+0000","last_undegraded":"2024-09-12T18:56:42.463327+0000","last_fullsized":"2024-09-12T18:56:42.463327+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:21.680579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639954+0000","last_change":"2024-09-12T18:19:57.860245+0000","last_active":"2024-09-12T18:57:27.639954+0000","last_peered":"2024-09-12T18:57:27.639954+0000","last_clean":"2024-09-12T18:57:27.639954+0000","last_became_active":"2024-09-12T18:19:57.859591+0000","last_became_peered":"2024-09-12T18:19:57.859591+0000","last_unstale":"2024-09-12T18:57:27.639954+0000","last_undegraded":"2024-09-12T18:57:27.639954+0000","last_fullsized":"2024-09-12T18:57:27.639954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:28.131141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453794+0000","last_change":"2024-09-12T17:59:43.009259+0000","last_active":"2024-09-12T18:55:57.453794+0000","last_peered":"2024-09-12T18:55:57.453794+0000","last_clean":"2024-09-12T18:55:57.453794+0000","last_became_active":"2024-09-12T17:59:43.008547+0000","last_became_peered":"2024-09-12T17:59:43.008547+0000","last_unstale":"2024-09-12T18:55:57.453794+0000","last_undegraded":"2024-09-12T18:55:57.453794+0000","last_fullsized":"2024-09-12T18:55:57.453794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:53.908690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:09.435251+0000","last_change":"2024-09-12T17:59:38.969392+0000","last_active":"2024-09-12T18:56:09.435251+0000","last_peered":"2024-09-12T18:56:09.435251+0000","last_clean":"2024-09-12T18:56:09.435251+0000","last_became_active":"2024-09-12T17:59:38.968249+0000","last_became_peered":"2024-09-12T17:59:38.968249+0000","last_unstale":"2024-09-12T18:56:09.435251+0000","last_undegraded":"2024-09-12T18:56:09.435251+0000","last_fullsized":"2024-09-12T18:56:09.435251+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.740724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'17","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433857+0000","last_change":"2024-09-12T17:55:59.355112+0000","last_active":"2024-09-12T18:56:42.433857+0000","last_peered":"2024-09-12T18:56:42.433857+0000","last_clean":"2024-09-12T18:56:42.433857+0000","last_became_active":"2024-09-12T17:55:59.354383+0000","last_became_peered":"2024-09-12T17:55:59.354383+0000","last_unstale":"2024-09-12T18:56:42.433857+0000","last_undegraded":"2024-09-12T18:56:42.433857+0000","last_fullsized":"2024-09-12T18:56:42.433857+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:12.015628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:07.446185+0000","last_change":"2024-09-12T18:19:57.864592+0000","last_active":"2024-09-12T18:56:07.446185+0000","last_peered":"2024-09-12T18:56:07.446185+0000","last_clean":"2024-09-12T18:56:07.446185+0000","last_became_active":"2024-09-12T18:19:57.858987+0000","last_became_peered":"2024-09-12T18:19:57.858987+0000","last_unstale":"2024-09-12T18:56:07.446185+0000","last_undegraded":"2024-09-12T18:56:07.446185+0000","last_fullsized":"2024-09-12T18:56:07.446185+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:30.509797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437573+0000","last_change":"2024-09-12T17:59:43.023426+0000","last_active":"2024-09-12T18:56:02.437573+0000","last_peered":"2024-09-12T18:56:02.437573+0000","last_clean":"2024-09-12T18:56:02.437573+0000","last_became_active":"2024-09-12T17:59:43.022405+0000","last_became_peered":"2024-09-12T17:59:43.022405+0000","last_unstale":"2024-09-12T18:56:02.437573+0000","last_undegraded":"2024-09-12T18:56:02.437573+0000","last_fullsized":"2024-09-12T18:56:02.437573+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:15.217520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":12356,"num_write":7,"num_write_kb":8260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.620294+0000","last_change":"2024-09-12T17:59:38.966348+0000","last_active":"2024-09-12T18:56:02.620294+0000","last_peered":"2024-09-12T18:56:02.620294+0000","last_clean":"2024-09-12T18:56:02.620294+0000","last_became_active":"2024-09-12T17:59:38.964439+0000","last_became_peered":"2024-09-12T17:59:38.964439+0000","last_unstale":"2024-09-12T18:56:02.620294+0000","last_undegraded":"2024-09-12T18:56:02.620294+0000","last_fullsized":"2024-09-12T18:56:02.620294+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:16.500555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1069,"num_write":3,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'113","reported_seq":414,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446927+0000","last_change":"2024-09-12T17:55:59.361437+0000","last_active":"2024-09-12T18:56:42.446927+0000","last_peered":"2024-09-12T18:56:42.446927+0000","last_clean":"2024-09-12T18:56:42.446927+0000","last_became_active":"2024-09-12T17:55:59.360296+0000","last_became_peered":"2024-09-12T17:55:59.360296+0000","last_unstale":"2024-09-12T18:56:42.446927+0000","last_undegraded":"2024-09-12T18:56:42.446927+0000","last_fullsized":"2024-09-12T18:56:42.446927+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:54.893983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":493,"num_write":148,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.819989+0000","last_change":"2024-09-12T18:19:57.871333+0000","last_active":"2024-09-12T18:57:27.819989+0000","last_peered":"2024-09-12T18:57:27.819989+0000","last_clean":"2024-09-12T18:57:27.819989+0000","last_became_active":"2024-09-12T18:19:57.870563+0000","last_became_peered":"2024-09-12T18:19:57.870563+0000","last_unstale":"2024-09-12T18:57:27.819989+0000","last_undegraded":"2024-09-12T18:57:27.819989+0000","last_fullsized":"2024-09-12T18:57:27.819989+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:12.142130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.801846+0000","last_change":"2024-09-12T17:59:43.019692+0000","last_active":"2024-09-12T18:56:02.801846+0000","last_peered":"2024-09-12T18:56:02.801846+0000","last_clean":"2024-09-12T18:56:02.801846+0000","last_became_active":"2024-09-12T17:59:43.018869+0000","last_became_peered":"2024-09-12T17:59:43.018869+0000","last_unstale":"2024-09-12T18:56:02.801846+0000","last_undegraded":"2024-09-12T18:56:02.801846+0000","last_fullsized":"2024-09-12T18:56:02.801846+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:27.333833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'1","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437605+0000","last_change":"2024-09-12T17:59:38.989030+0000","last_active":"2024-09-12T18:56:02.437605+0000","last_peered":"2024-09-12T18:56:02.437605+0000","last_clean":"2024-09-12T18:56:02.437605+0000","last_became_active":"2024-09-12T17:59:38.988237+0000","last_became_peered":"2024-09-12T17:59:38.988237+0000","last_unstale":"2024-09-12T18:56:02.437605+0000","last_undegraded":"2024-09-12T18:56:02.437605+0000","last_fullsized":"2024-09-12T18:56:02.437605+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:13.770105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'6","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.450666+0000","last_change":"2024-09-12T17:55:59.354590+0000","last_active":"2024-09-12T18:56:27.450666+0000","last_peered":"2024-09-12T18:56:27.450666+0000","last_clean":"2024-09-12T18:56:27.450666+0000","last_became_active":"2024-09-12T17:55:59.353823+0000","last_became_peered":"2024-09-12T17:55:59.353823+0000","last_unstale":"2024-09-12T18:56:27.450666+0000","last_undegraded":"2024-09-12T18:56:27.450666+0000","last_fullsized":"2024-09-12T18:56:27.450666+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:54.453586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:49.442825+0000","last_change":"2024-09-12T18:19:57.840515+0000","last_active":"2024-09-12T18:56:49.442825+0000","last_peered":"2024-09-12T18:56:49.442825+0000","last_clean":"2024-09-12T18:56:49.442825+0000","last_became_active":"2024-09-12T18:19:57.839756+0000","last_became_peered":"2024-09-12T18:19:57.839756+0000","last_unstale":"2024-09-12T18:56:49.442825+0000","last_undegraded":"2024-09-12T18:56:49.442825+0000","last_fullsized":"2024-09-12T18:56:49.442825+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:01.658644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.444196+0000","last_change":"2024-09-12T17:59:43.038905+0000","last_active":"2024-09-12T18:55:57.444196+0000","last_peered":"2024-09-12T18:55:57.444196+0000","last_clean":"2024-09-12T18:55:57.444196+0000","last_became_active":"2024-09-12T17:59:43.033049+0000","last_became_peered":"2024-09-12T17:59:43.033049+0000","last_unstale":"2024-09-12T18:55:57.444196+0000","last_undegraded":"2024-09-12T18:55:57.444196+0000","last_fullsized":"2024-09-12T18:55:57.444196+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:33.443562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'9","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464697+0000","last_change":"2024-09-12T17:59:38.986578+0000","last_active":"2024-09-12T18:57:57.464697+0000","last_peered":"2024-09-12T18:57:57.464697+0000","last_clean":"2024-09-12T18:57:57.464697+0000","last_became_active":"2024-09-12T17:59:38.985971+0000","last_became_peered":"2024-09-12T17:59:38.985971+0000","last_unstale":"2024-09-12T18:57:57.464697+0000","last_undegraded":"2024-09-12T18:57:57.464697+0000","last_fullsized":"2024-09-12T18:57:57.464697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:41.717343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'13","reported_seq":101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.625796+0000","last_change":"2024-09-12T17:55:59.358658+0000","last_active":"2024-09-12T18:56:27.625796+0000","last_peered":"2024-09-12T18:56:27.625796+0000","last_clean":"2024-09-12T18:56:27.625796+0000","last_became_active":"2024-09-12T17:55:59.352474+0000","last_became_peered":"2024-09-12T17:55:59.352474+0000","last_unstale":"2024-09-12T18:56:27.625796+0000","last_undegraded":"2024-09-12T18:56:27.625796+0000","last_fullsized":"2024-09-12T18:56:27.625796+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:54.466534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464409+0000","last_change":"2024-09-12T18:19:57.847713+0000","last_active":"2024-09-12T18:56:47.464409+0000","last_peered":"2024-09-12T18:56:47.464409+0000","last_clean":"2024-09-12T18:56:47.464409+0000","last_became_active":"2024-09-12T18:19:57.846907+0000","last_became_peered":"2024-09-12T18:19:57.846907+0000","last_unstale":"2024-09-12T18:56:47.464409+0000","last_undegraded":"2024-09-12T18:56:47.464409+0000","last_fullsized":"2024-09-12T18:56:47.464409+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:30.600770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'11","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:52.656029+0000","last_change":"2024-09-12T17:59:43.023811+0000","last_active":"2024-09-12T18:57:52.656029+0000","last_peered":"2024-09-12T18:57:52.656029+0000","last_clean":"2024-09-12T18:57:52.656029+0000","last_became_active":"2024-09-12T17:59:43.022991+0000","last_became_peered":"2024-09-12T17:59:43.022991+0000","last_unstale":"2024-09-12T18:57:52.656029+0000","last_undegraded":"2024-09-12T18:57:52.656029+0000","last_fullsized":"2024-09-12T18:57:52.656029+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:41.803212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20482,"num_write":21,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'1","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.435949+0000","last_change":"2024-09-12T17:59:38.990278+0000","last_active":"2024-09-12T18:55:57.435949+0000","last_peered":"2024-09-12T18:55:57.435949+0000","last_clean":"2024-09-12T18:55:57.435949+0000","last_became_active":"2024-09-12T17:59:38.989530+0000","last_became_peered":"2024-09-12T17:59:38.989530+0000","last_unstale":"2024-09-12T18:55:57.435949+0000","last_undegraded":"2024-09-12T18:55:57.435949+0000","last_fullsized":"2024-09-12T18:55:57.435949+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:27.646889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'9","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.807160+0000","last_change":"2024-09-12T17:55:59.345043+0000","last_active":"2024-09-12T18:56:27.807160+0000","last_peered":"2024-09-12T18:56:27.807160+0000","last_clean":"2024-09-12T18:56:27.807160+0000","last_became_active":"2024-09-12T17:55:59.344251+0000","last_became_peered":"2024-09-12T17:55:59.344251+0000","last_unstale":"2024-09-12T18:56:27.807160+0000","last_undegraded":"2024-09-12T18:56:27.807160+0000","last_fullsized":"2024-09-12T18:56:27.807160+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:29.508189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473350+0000","last_change":"2024-09-12T18:19:57.848079+0000","last_active":"2024-09-12T18:57:27.473350+0000","last_peered":"2024-09-12T18:57:27.473350+0000","last_clean":"2024-09-12T18:57:27.473350+0000","last_became_active":"2024-09-12T18:19:57.847330+0000","last_became_peered":"2024-09-12T18:19:57.847330+0000","last_unstale":"2024-09-12T18:57:27.473350+0000","last_undegraded":"2024-09-12T18:57:27.473350+0000","last_fullsized":"2024-09-12T18:57:27.473350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:06.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'3","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.424284+0000","last_change":"2024-09-12T17:59:43.028989+0000","last_active":"2024-09-12T18:55:57.424284+0000","last_peered":"2024-09-12T18:55:57.424284+0000","last_clean":"2024-09-12T18:55:57.424284+0000","last_became_active":"2024-09-12T17:59:43.028305+0000","last_became_peered":"2024-09-12T17:59:43.028305+0000","last_unstale":"2024-09-12T18:55:57.424284+0000","last_undegraded":"2024-09-12T18:55:57.424284+0000","last_fullsized":"2024-09-12T18:55:57.424284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:37.271016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.444237+0000","last_change":"2024-09-12T17:59:38.987789+0000","last_active":"2024-09-12T18:55:57.444237+0000","last_peered":"2024-09-12T18:55:57.444237+0000","last_clean":"2024-09-12T18:55:57.444237+0000","last_became_active":"2024-09-12T17:59:38.986062+0000","last_became_peered":"2024-09-12T17:59:38.986062+0000","last_unstale":"2024-09-12T18:55:57.444237+0000","last_undegraded":"2024-09-12T18:55:57.444237+0000","last_fullsized":"2024-09-12T18:55:57.444237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:17.162069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'31","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.430557+0000","last_change":"2024-09-12T17:55:59.346330+0000","last_active":"2024-09-12T18:56:27.430557+0000","last_peered":"2024-09-12T18:56:27.430557+0000","last_clean":"2024-09-12T18:56:27.430557+0000","last_became_active":"2024-09-12T17:55:59.345469+0000","last_became_peered":"2024-09-12T17:55:59.345469+0000","last_unstale":"2024-09-12T18:56:27.430557+0000","last_undegraded":"2024-09-12T18:56:27.430557+0000","last_fullsized":"2024-09-12T18:56:27.430557+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:40.512299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":47,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.459721+0000","last_change":"2024-09-12T18:19:57.845031+0000","last_active":"2024-09-12T18:57:37.459721+0000","last_peered":"2024-09-12T18:57:37.459721+0000","last_clean":"2024-09-12T18:57:37.459721+0000","last_became_active":"2024-09-12T18:19:57.844161+0000","last_became_peered":"2024-09-12T18:19:57.844161+0000","last_unstale":"2024-09-12T18:57:37.459721+0000","last_undegraded":"2024-09-12T18:57:37.459721+0000","last_fullsized":"2024-09-12T18:57:37.459721+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:42.398579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800569+0000","last_change":"2024-09-12T17:59:43.020614+0000","last_active":"2024-09-12T18:55:57.800569+0000","last_peered":"2024-09-12T18:55:57.800569+0000","last_clean":"2024-09-12T18:55:57.800569+0000","last_became_active":"2024-09-12T17:59:43.019274+0000","last_became_peered":"2024-09-12T17:59:43.019274+0000","last_unstale":"2024-09-12T18:55:57.800569+0000","last_undegraded":"2024-09-12T18:55:57.800569+0000","last_fullsized":"2024-09-12T18:55:57.800569+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:20.608735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'6","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.424329+0000","last_change":"2024-09-12T17:59:38.969202+0000","last_active":"2024-09-12T18:55:57.424329+0000","last_peered":"2024-09-12T18:55:57.424329+0000","last_clean":"2024-09-12T18:55:57.424329+0000","last_became_active":"2024-09-12T17:59:38.968500+0000","last_became_peered":"2024-09-12T17:59:38.968500+0000","last_unstale":"2024-09-12T18:55:57.424329+0000","last_undegraded":"2024-09-12T18:55:57.424329+0000","last_fullsized":"2024-09-12T18:55:57.424329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:19.956318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4242729,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":16,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.440783+0000","last_change":"2024-09-12T17:55:59.355326+0000","last_active":"2024-09-12T18:56:17.440783+0000","last_peered":"2024-09-12T18:56:17.440783+0000","last_clean":"2024-09-12T18:56:17.440783+0000","last_became_active":"2024-09-12T17:55:59.354620+0000","last_became_peered":"2024-09-12T17:55:59.354620+0000","last_unstale":"2024-09-12T18:56:17.440783+0000","last_undegraded":"2024-09-12T18:56:17.440783+0000","last_fullsized":"2024-09-12T18:56:17.440783+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:05.701171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":145,"num_write":78,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'318","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457452+0000","last_change":"2024-09-12T17:40:18.786112+0000","last_active":"2024-09-12T18:57:27.457452+0000","last_peered":"2024-09-12T18:57:27.457452+0000","last_clean":"2024-09-12T18:57:27.457452+0000","last_became_active":"2024-09-12T17:40:18.784159+0000","last_became_peered":"2024-09-12T17:40:18.784159+0000","last_unstale":"2024-09-12T18:57:27.457452+0000","last_undegraded":"2024-09-12T18:57:27.457452+0000","last_fullsized":"2024-09-12T18:57:27.457452+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:09.077635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13398493,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":458,"num_read_kb":37913,"num_write":1138,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'93","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.611092+0000","last_change":"2024-09-12T17:40:20.139437+0000","last_active":"2024-09-12T18:55:22.611092+0000","last_peered":"2024-09-12T18:55:22.611092+0000","last_clean":"2024-09-12T18:55:22.611092+0000","last_became_active":"2024-09-12T17:40:20.138680+0000","last_became_peered":"2024-09-12T17:40:20.138680+0000","last_unstale":"2024-09-12T18:55:22.611092+0000","last_undegraded":"2024-09-12T18:55:22.611092+0000","last_fullsized":"2024-09-12T18:55:22.611092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:20.357774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'253","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:21.882505+0000","last_change":"2024-09-12T17:40:18.761793+0000","last_active":"2024-09-12T18:59:21.882505+0000","last_peered":"2024-09-12T18:59:21.882505+0000","last_clean":"2024-09-12T18:59:21.882505+0000","last_became_active":"2024-09-12T17:40:18.761214+0000","last_became_peered":"2024-09-12T17:40:18.761214+0000","last_unstale":"2024-09-12T18:59:21.882505+0000","last_undegraded":"2024-09-12T18:59:21.882505+0000","last_fullsized":"2024-09-12T18:59:21.882505+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:52.345302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9324513,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":409,"num_read_kb":37090,"num_write":889,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'255","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:19.678404+0000","last_change":"2024-09-12T17:40:20.134527+0000","last_active":"2024-09-12T18:56:19.678404+0000","last_peered":"2024-09-12T18:56:19.678404+0000","last_clean":"2024-09-12T18:56:19.678404+0000","last_became_active":"2024-09-12T17:40:20.133791+0000","last_became_peered":"2024-09-12T17:40:20.133791+0000","last_unstale":"2024-09-12T18:56:19.678404+0000","last_undegraded":"2024-09-12T18:56:19.678404+0000","last_fullsized":"2024-09-12T18:56:19.678404+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:41.729662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1087,"num_read_kb":867,"num_write":420,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'326","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:25.636751+0000","last_change":"2024-09-12T17:40:18.757584+0000","last_active":"2024-09-12T18:59:25.636751+0000","last_peered":"2024-09-12T18:59:25.636751+0000","last_clean":"2024-09-12T18:59:25.636751+0000","last_became_active":"2024-09-12T17:40:18.755606+0000","last_became_peered":"2024-09-12T17:40:18.755606+0000","last_unstale":"2024-09-12T18:59:25.636751+0000","last_undegraded":"2024-09-12T18:59:25.636751+0000","last_fullsized":"2024-09-12T18:59:25.636751+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:15.359537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17736649,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":495,"num_read_kb":26527,"num_write":1202,"num_write_kb":46376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'130","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.375203+0000","last_change":"2024-09-12T17:40:20.130876+0000","last_active":"2024-09-12T18:58:04.375203+0000","last_peered":"2024-09-12T18:58:04.375203+0000","last_clean":"2024-09-12T18:58:04.375203+0000","last_became_active":"2024-09-12T17:40:20.130123+0000","last_became_peered":"2024-09-12T17:40:20.130123+0000","last_unstale":"2024-09-12T18:58:04.375203+0000","last_undegraded":"2024-09-12T18:58:04.375203+0000","last_fullsized":"2024-09-12T18:58:04.375203+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:31.564674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":589,"num_read_kb":499,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'285","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.106105+0000","last_change":"2024-09-12T17:40:18.768963+0000","last_active":"2024-09-12T18:57:45.106105+0000","last_peered":"2024-09-12T18:57:45.106105+0000","last_clean":"2024-09-12T18:57:45.106105+0000","last_became_active":"2024-09-12T17:40:18.768170+0000","last_became_peered":"2024-09-12T17:40:18.768170+0000","last_unstale":"2024-09-12T18:57:45.106105+0000","last_undegraded":"2024-09-12T18:57:45.106105+0000","last_fullsized":"2024-09-12T18:57:45.106105+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:12.117915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19926609,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":485,"num_read_kb":59190,"num_write":1153,"num_write_kb":44467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'100","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.445911+0000","last_change":"2024-09-12T17:40:20.115278+0000","last_active":"2024-09-12T18:55:22.445911+0000","last_peered":"2024-09-12T18:55:22.445911+0000","last_clean":"2024-09-12T18:55:22.445911+0000","last_became_active":"2024-09-12T17:40:20.114923+0000","last_became_peered":"2024-09-12T17:40:20.114923+0000","last_unstale":"2024-09-12T18:55:22.445911+0000","last_undegraded":"2024-09-12T18:55:22.445911+0000","last_fullsized":"2024-09-12T18:55:22.445911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:28.492838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":408,"num_write":151,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'251","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427198+0000","last_change":"2024-09-12T17:40:18.779851+0000","last_active":"2024-09-12T18:55:22.427198+0000","last_peered":"2024-09-12T18:55:22.427198+0000","last_clean":"2024-09-12T18:55:22.427198+0000","last_became_active":"2024-09-12T17:40:18.778991+0000","last_became_peered":"2024-09-12T17:40:18.778991+0000","last_unstale":"2024-09-12T18:55:22.427198+0000","last_undegraded":"2024-09-12T18:55:22.427198+0000","last_fullsized":"2024-09-12T18:55:22.427198+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:35.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4458351,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":389,"num_read_kb":19943,"num_write":925,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'100","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433806+0000","last_change":"2024-09-12T17:40:20.128328+0000","last_active":"2024-09-12T18:56:42.433806+0000","last_peered":"2024-09-12T18:56:42.433806+0000","last_clean":"2024-09-12T18:56:42.433806+0000","last_became_active":"2024-09-12T17:40:20.127556+0000","last_became_peered":"2024-09-12T17:40:20.127556+0000","last_unstale":"2024-09-12T18:56:42.433806+0000","last_undegraded":"2024-09-12T18:56:42.433806+0000","last_fullsized":"2024-09-12T18:56:42.433806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:12.259064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":458,"num_read_kb":378,"num_write":157,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'305","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.611191+0000","last_change":"2024-09-12T17:40:18.761760+0000","last_active":"2024-09-12T18:55:22.611191+0000","last_peered":"2024-09-12T18:55:22.611191+0000","last_clean":"2024-09-12T18:55:22.611191+0000","last_became_active":"2024-09-12T17:40:18.760958+0000","last_became_peered":"2024-09-12T17:40:18.760958+0000","last_unstale":"2024-09-12T18:55:22.611191+0000","last_undegraded":"2024-09-12T18:55:22.611191+0000","last_fullsized":"2024-09-12T18:55:22.611191+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:50.452114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4848723,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":425,"num_read_kb":8660,"num_write":1143,"num_write_kb":27182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'123","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820225+0000","last_change":"2024-09-12T17:40:20.136587+0000","last_active":"2024-09-12T18:57:27.820225+0000","last_peered":"2024-09-12T18:57:27.820225+0000","last_clean":"2024-09-12T18:57:27.820225+0000","last_became_active":"2024-09-12T17:40:20.132985+0000","last_became_peered":"2024-09-12T17:40:20.132985+0000","last_unstale":"2024-09-12T18:57:27.820225+0000","last_undegraded":"2024-09-12T18:57:27.820225+0000","last_fullsized":"2024-09-12T18:57:27.820225+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:46.649354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":462,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'332","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.238876+0000","last_change":"2024-09-12T17:40:18.761925+0000","last_active":"2024-09-12T18:57:17.238876+0000","last_peered":"2024-09-12T18:57:17.238876+0000","last_clean":"2024-09-12T18:57:17.238876+0000","last_became_active":"2024-09-12T17:40:18.761056+0000","last_became_peered":"2024-09-12T17:40:18.761056+0000","last_unstale":"2024-09-12T18:57:17.238876+0000","last_undegraded":"2024-09-12T18:57:17.238876+0000","last_fullsized":"2024-09-12T18:57:17.238876+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:43.265328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7453140,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":564,"num_read_kb":74800,"num_write":1167,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'208","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.640055+0000","last_change":"2024-09-12T17:40:20.135326+0000","last_active":"2024-09-12T18:57:27.640055+0000","last_peered":"2024-09-12T18:57:27.640055+0000","last_clean":"2024-09-12T18:57:27.640055+0000","last_became_active":"2024-09-12T17:40:20.134441+0000","last_became_peered":"2024-09-12T17:40:20.134441+0000","last_unstale":"2024-09-12T18:57:27.640055+0000","last_undegraded":"2024-09-12T18:57:27.640055+0000","last_fullsized":"2024-09-12T18:57:27.640055+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:29.851316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":897,"num_read_kb":734,"num_write":311,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'303","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:20.928833+0000","last_change":"2024-09-12T17:40:18.774112+0000","last_active":"2024-09-12T18:59:20.928833+0000","last_peered":"2024-09-12T18:59:20.928833+0000","last_clean":"2024-09-12T18:59:20.928833+0000","last_became_active":"2024-09-12T17:40:18.773843+0000","last_became_peered":"2024-09-12T17:40:18.773843+0000","last_unstale":"2024-09-12T18:59:20.928833+0000","last_undegraded":"2024-09-12T18:59:20.928833+0000","last_fullsized":"2024-09-12T18:59:20.928833+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:24.163598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9058338,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":567,"num_read_kb":30255,"num_write":1096,"num_write_kb":52642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'233","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:24.450044+0000","last_change":"2024-09-12T17:40:20.122021+0000","last_active":"2024-09-12T18:57:24.450044+0000","last_peered":"2024-09-12T18:57:24.450044+0000","last_clean":"2024-09-12T18:57:24.450044+0000","last_became_active":"2024-09-12T17:40:20.120891+0000","last_became_peered":"2024-09-12T17:40:20.120891+0000","last_unstale":"2024-09-12T18:57:24.450044+0000","last_undegraded":"2024-09-12T18:57:24.450044+0000","last_fullsized":"2024-09-12T18:57:24.450044+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:49.408719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":858,"num_write":384,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'192","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.818850+0000","last_change":"2024-09-12T17:40:20.135279+0000","last_active":"2024-09-12T18:57:22.818850+0000","last_peered":"2024-09-12T18:57:22.818850+0000","last_clean":"2024-09-12T18:57:22.818850+0000","last_became_active":"2024-09-12T17:40:20.132466+0000","last_became_peered":"2024-09-12T17:40:20.132466+0000","last_unstale":"2024-09-12T18:57:22.818850+0000","last_undegraded":"2024-09-12T18:57:22.818850+0000","last_fullsized":"2024-09-12T18:57:22.818850+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:47.393866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":674,"num_write":287,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'262","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:32.430208+0000","last_change":"2024-09-12T17:40:18.784241+0000","last_active":"2024-09-12T18:55:32.430208+0000","last_peered":"2024-09-12T18:55:32.430208+0000","last_clean":"2024-09-12T18:55:32.430208+0000","last_became_active":"2024-09-12T17:40:18.783282+0000","last_became_peered":"2024-09-12T17:40:18.783282+0000","last_unstale":"2024-09-12T18:55:32.430208+0000","last_undegraded":"2024-09-12T18:55:32.430208+0000","last_fullsized":"2024-09-12T18:55:32.430208+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:11.061277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14708958,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":334,"num_read_kb":17792,"num_write":943,"num_write_kb":32630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'128","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456078+0000","last_change":"2024-09-12T17:40:20.144162+0000","last_active":"2024-09-12T18:57:22.456078+0000","last_peered":"2024-09-12T18:57:22.456078+0000","last_clean":"2024-09-12T18:57:22.456078+0000","last_became_active":"2024-09-12T17:40:20.143471+0000","last_became_peered":"2024-09-12T17:40:20.143471+0000","last_unstale":"2024-09-12T18:57:22.456078+0000","last_undegraded":"2024-09-12T18:57:22.456078+0000","last_fullsized":"2024-09-12T18:57:22.456078+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:17.136156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":544,"num_read_kb":441,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'246","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.415871+0000","last_change":"2024-09-12T17:40:18.758730+0000","last_active":"2024-09-12T18:55:17.415871+0000","last_peered":"2024-09-12T18:55:17.415871+0000","last_clean":"2024-09-12T18:55:17.415871+0000","last_became_active":"2024-09-12T17:40:18.756814+0000","last_became_peered":"2024-09-12T17:40:18.756814+0000","last_unstale":"2024-09-12T18:55:17.415871+0000","last_undegraded":"2024-09-12T18:55:17.415871+0000","last_fullsized":"2024-09-12T18:55:17.415871+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:55.503868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486581,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":345,"num_read_kb":9609,"num_write":926,"num_write_kb":28982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'86","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.642204+0000","last_change":"2024-09-12T17:40:20.124840+0000","last_active":"2024-09-12T18:57:37.642204+0000","last_peered":"2024-09-12T18:57:37.642204+0000","last_clean":"2024-09-12T18:57:37.642204+0000","last_became_active":"2024-09-12T17:40:20.124104+0000","last_became_peered":"2024-09-12T17:40:20.124104+0000","last_unstale":"2024-09-12T18:57:37.642204+0000","last_undegraded":"2024-09-12T18:57:37.642204+0000","last_fullsized":"2024-09-12T18:57:37.642204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:12.896981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":294,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'334","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:47.914801+0000","last_change":"2024-09-12T17:40:18.774434+0000","last_active":"2024-09-12T18:55:47.914801+0000","last_peered":"2024-09-12T18:55:47.914801+0000","last_clean":"2024-09-12T18:55:47.914801+0000","last_became_active":"2024-09-12T17:40:18.773787+0000","last_became_peered":"2024-09-12T17:40:18.773787+0000","last_unstale":"2024-09-12T18:55:47.914801+0000","last_undegraded":"2024-09-12T18:55:47.914801+0000","last_fullsized":"2024-09-12T18:55:47.914801+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:11.321051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11432262,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":578,"num_read_kb":7582,"num_write":1158,"num_write_kb":45057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'153","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.591660+0000","last_change":"2024-09-12T17:40:20.121404+0000","last_active":"2024-09-12T18:57:32.591660+0000","last_peered":"2024-09-12T18:57:32.591660+0000","last_clean":"2024-09-12T18:57:32.591660+0000","last_became_active":"2024-09-12T17:40:20.120803+0000","last_became_peered":"2024-09-12T17:40:20.120803+0000","last_unstale":"2024-09-12T18:57:32.591660+0000","last_undegraded":"2024-09-12T18:57:32.591660+0000","last_fullsized":"2024-09-12T18:57:32.591660+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:19.129000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":714,"num_read_kb":606,"num_write":221,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'257","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.791708+0000","last_change":"2024-09-12T17:40:18.770515+0000","last_active":"2024-09-12T18:55:17.791708+0000","last_peered":"2024-09-12T18:55:17.791708+0000","last_clean":"2024-09-12T18:55:17.791708+0000","last_became_active":"2024-09-12T17:40:18.769867+0000","last_became_peered":"2024-09-12T17:40:18.769867+0000","last_unstale":"2024-09-12T18:55:17.791708+0000","last_undegraded":"2024-09-12T18:55:17.791708+0000","last_fullsized":"2024-09-12T18:55:17.791708+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:27.168781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9822617,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":413,"num_read_kb":25356,"num_write":1031,"num_write_kb":19597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'166","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:14.423789+0000","last_change":"2024-09-12T17:40:20.132059+0000","last_active":"2024-09-12T18:55:14.423789+0000","last_peered":"2024-09-12T18:55:14.423789+0000","last_clean":"2024-09-12T18:55:14.423789+0000","last_became_active":"2024-09-12T17:40:20.131603+0000","last_became_peered":"2024-09-12T17:40:20.131603+0000","last_unstale":"2024-09-12T18:55:14.423789+0000","last_undegraded":"2024-09-12T18:55:14.423789+0000","last_fullsized":"2024-09-12T18:55:14.423789+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:41.698653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":647,"num_write":268,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'271","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426374+0000","last_change":"2024-09-12T17:40:18.766165+0000","last_active":"2024-09-12T18:55:17.426374+0000","last_peered":"2024-09-12T18:55:17.426374+0000","last_clean":"2024-09-12T18:55:17.426374+0000","last_became_active":"2024-09-12T17:40:18.765584+0000","last_became_peered":"2024-09-12T17:40:18.765584+0000","last_unstale":"2024-09-12T18:55:17.426374+0000","last_undegraded":"2024-09-12T18:55:17.426374+0000","last_fullsized":"2024-09-12T18:55:17.426374+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:22.295131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7414200,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":441,"num_read_kb":14371,"num_write":1035,"num_write_kb":24714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'218","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:28.107651+0000","last_change":"2024-09-12T17:40:20.134311+0000","last_active":"2024-09-12T18:56:28.107651+0000","last_peered":"2024-09-12T18:56:28.107651+0000","last_clean":"2024-09-12T18:56:28.107651+0000","last_became_active":"2024-09-12T17:40:20.132166+0000","last_became_peered":"2024-09-12T17:40:20.132166+0000","last_unstale":"2024-09-12T18:56:28.107651+0000","last_undegraded":"2024-09-12T18:56:28.107651+0000","last_fullsized":"2024-09-12T18:56:28.107651+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:01.198659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":801,"num_write":328,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'254","reported_seq":898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.475534+0000","last_change":"2024-09-12T17:40:18.754672+0000","last_active":"2024-09-12T18:57:37.475534+0000","last_peered":"2024-09-12T18:57:37.475534+0000","last_clean":"2024-09-12T18:57:37.475534+0000","last_became_active":"2024-09-12T17:40:18.753673+0000","last_became_peered":"2024-09-12T17:40:18.753673+0000","last_unstale":"2024-09-12T18:57:37.475534+0000","last_undegraded":"2024-09-12T18:57:37.475534+0000","last_fullsized":"2024-09-12T18:57:37.475534+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:52.046955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7819696,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":407,"num_read_kb":9306,"num_write":950,"num_write_kb":26120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'143","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.275130+0000","last_change":"2024-09-12T17:40:28.202080+0000","last_active":"2024-09-12T18:58:06.275130+0000","last_peered":"2024-09-12T18:58:06.275130+0000","last_clean":"2024-09-12T18:58:06.275130+0000","last_became_active":"2024-09-12T17:40:28.201205+0000","last_became_peered":"2024-09-12T17:40:28.201205+0000","last_unstale":"2024-09-12T18:58:06.275130+0000","last_undegraded":"2024-09-12T18:58:06.275130+0000","last_fullsized":"2024-09-12T18:58:06.275130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:51.763724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'257","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427749+0000","last_change":"2024-09-12T17:40:20.133338+0000","last_active":"2024-09-12T18:55:22.427749+0000","last_peered":"2024-09-12T18:55:22.427749+0000","last_clean":"2024-09-12T18:55:22.427749+0000","last_became_active":"2024-09-12T17:40:20.132930+0000","last_became_peered":"2024-09-12T17:40:20.132930+0000","last_unstale":"2024-09-12T18:55:22.427749+0000","last_undegraded":"2024-09-12T18:55:22.427749+0000","last_fullsized":"2024-09-12T18:55:22.427749+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:26.732786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1081,"num_read_kb":890,"num_write":398,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'267","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456141+0000","last_change":"2024-09-12T17:40:18.786389+0000","last_active":"2024-09-12T18:57:22.456141+0000","last_peered":"2024-09-12T18:57:22.456141+0000","last_clean":"2024-09-12T18:57:22.456141+0000","last_became_active":"2024-09-12T17:40:18.785762+0000","last_became_peered":"2024-09-12T17:40:18.785762+0000","last_unstale":"2024-09-12T18:57:22.456141+0000","last_undegraded":"2024-09-12T18:57:22.456141+0000","last_fullsized":"2024-09-12T18:57:22.456141+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.306882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8559470,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":591,"num_read_kb":5513,"num_write":1061,"num_write_kb":17948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.609904+0000","last_change":"2024-09-12T17:40:22.146973+0000","last_active":"2024-09-12T18:55:17.609904+0000","last_peered":"2024-09-12T18:55:17.609904+0000","last_clean":"2024-09-12T18:55:17.609904+0000","last_became_active":"2024-09-12T17:40:22.146112+0000","last_became_peered":"2024-09-12T17:40:22.146112+0000","last_unstale":"2024-09-12T18:55:17.609904+0000","last_undegraded":"2024-09-12T18:55:17.609904+0000","last_fullsized":"2024-09-12T18:55:17.609904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:09.636474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'334","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.478019+0000","last_change":"2024-09-12T17:40:24.162348+0000","last_active":"2024-09-12T18:57:47.478019+0000","last_peered":"2024-09-12T18:57:47.478019+0000","last_clean":"2024-09-12T18:57:47.478019+0000","last_became_active":"2024-09-12T17:40:24.161536+0000","last_became_peered":"2024-09-12T17:40:24.161536+0000","last_unstale":"2024-09-12T18:57:47.478019+0000","last_undegraded":"2024-09-12T18:57:47.478019+0000","last_fullsized":"2024-09-12T18:57:47.478019+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:26.371603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":1078,"num_write":434,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427469+0000","last_change":"2024-09-12T17:40:26.189627+0000","last_active":"2024-09-12T18:55:22.427469+0000","last_peered":"2024-09-12T18:55:22.427469+0000","last_clean":"2024-09-12T18:55:22.427469+0000","last_became_active":"2024-09-12T17:40:26.188831+0000","last_became_peered":"2024-09-12T17:40:26.188831+0000","last_unstale":"2024-09-12T18:55:22.427469+0000","last_undegraded":"2024-09-12T18:55:22.427469+0000","last_fullsized":"2024-09-12T18:55:22.427469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:08.240916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'158","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.658358+0000","last_change":"2024-09-12T17:40:28.190678+0000","last_active":"2024-09-12T18:58:02.658358+0000","last_peered":"2024-09-12T18:58:02.658358+0000","last_clean":"2024-09-12T18:58:02.658358+0000","last_became_active":"2024-09-12T17:40:28.189899+0000","last_became_peered":"2024-09-12T17:40:28.189899+0000","last_unstale":"2024-09-12T18:58:02.658358+0000","last_undegraded":"2024-09-12T18:58:02.658358+0000","last_fullsized":"2024-09-12T18:58:02.658358+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:37.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":230,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'92","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:35.155067+0000","last_change":"2024-09-12T17:40:20.137996+0000","last_active":"2024-09-12T18:55:35.155067+0000","last_peered":"2024-09-12T18:55:35.155067+0000","last_clean":"2024-09-12T18:55:35.155067+0000","last_became_active":"2024-09-12T17:40:20.137252+0000","last_became_peered":"2024-09-12T17:40:20.137252+0000","last_unstale":"2024-09-12T18:55:35.155067+0000","last_undegraded":"2024-09-12T18:55:35.155067+0000","last_fullsized":"2024-09-12T18:55:35.155067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:53.184648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":356,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'271","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.471998+0000","last_change":"2024-09-12T17:40:18.758093+0000","last_active":"2024-09-12T18:57:22.471998+0000","last_peered":"2024-09-12T18:57:22.471998+0000","last_clean":"2024-09-12T18:57:22.471998+0000","last_became_active":"2024-09-12T17:40:18.756518+0000","last_became_peered":"2024-09-12T17:40:18.756518+0000","last_unstale":"2024-09-12T18:57:22.471998+0000","last_undegraded":"2024-09-12T18:57:22.471998+0000","last_fullsized":"2024-09-12T18:57:22.471998+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:19.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15261432,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":398,"num_read_kb":2590,"num_write":955,"num_write_kb":33023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427791+0000","last_change":"2024-09-12T17:40:22.153805+0000","last_active":"2024-09-12T18:55:22.427791+0000","last_peered":"2024-09-12T18:55:22.427791+0000","last_clean":"2024-09-12T18:55:22.427791+0000","last_became_active":"2024-09-12T17:40:22.153074+0000","last_became_peered":"2024-09-12T17:40:22.153074+0000","last_unstale":"2024-09-12T18:55:22.427791+0000","last_undegraded":"2024-09-12T18:55:22.427791+0000","last_fullsized":"2024-09-12T18:55:22.427791+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:18.398925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'102","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793167+0000","last_change":"2024-09-12T17:40:24.170127+0000","last_active":"2024-09-12T18:55:22.793167+0000","last_peered":"2024-09-12T18:55:22.793167+0000","last_clean":"2024-09-12T18:55:22.793167+0000","last_became_active":"2024-09-12T17:40:24.169431+0000","last_became_peered":"2024-09-12T17:40:24.169431+0000","last_unstale":"2024-09-12T18:55:22.793167+0000","last_undegraded":"2024-09-12T18:55:22.793167+0000","last_fullsized":"2024-09-12T18:55:22.793167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:42.784293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793126+0000","last_change":"2024-09-12T17:40:26.189218+0000","last_active":"2024-09-12T18:55:22.793126+0000","last_peered":"2024-09-12T18:55:22.793126+0000","last_clean":"2024-09-12T18:55:22.793126+0000","last_became_active":"2024-09-12T17:40:26.188501+0000","last_became_peered":"2024-09-12T17:40:26.188501+0000","last_unstale":"2024-09-12T18:55:22.793126+0000","last_undegraded":"2024-09-12T18:55:22.793126+0000","last_fullsized":"2024-09-12T18:55:22.793126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.657079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'131","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:20.748031+0000","last_change":"2024-09-12T17:40:28.186974+0000","last_active":"2024-09-12T18:56:20.748031+0000","last_peered":"2024-09-12T18:56:20.748031+0000","last_clean":"2024-09-12T18:56:20.748031+0000","last_became_active":"2024-09-12T17:40:28.186224+0000","last_became_peered":"2024-09-12T17:40:28.186224+0000","last_unstale":"2024-09-12T18:56:20.748031+0000","last_undegraded":"2024-09-12T18:56:20.748031+0000","last_fullsized":"2024-09-12T18:56:20.748031+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:16.871107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":201,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'278","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.444792+0000","last_change":"2024-09-12T17:40:20.116147+0000","last_active":"2024-09-12T18:55:17.444792+0000","last_peered":"2024-09-12T18:55:17.444792+0000","last_clean":"2024-09-12T18:55:17.444792+0000","last_became_active":"2024-09-12T17:40:20.115862+0000","last_became_peered":"2024-09-12T17:40:20.115862+0000","last_unstale":"2024-09-12T18:55:17.444792+0000","last_undegraded":"2024-09-12T18:55:17.444792+0000","last_fullsized":"2024-09-12T18:55:17.444792+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:27.732090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1211,"num_read_kb":988,"num_write":419,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'309","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:18.375060+0000","last_change":"2024-09-12T17:40:55.329992+0000","last_active":"2024-09-12T18:59:18.375060+0000","last_peered":"2024-09-12T18:59:18.375060+0000","last_clean":"2024-09-12T18:59:18.375060+0000","last_became_active":"2024-09-12T17:40:55.329597+0000","last_became_peered":"2024-09-12T17:40:55.329597+0000","last_unstale":"2024-09-12T18:59:18.375060+0000","last_undegraded":"2024-09-12T18:59:18.375060+0000","last_fullsized":"2024-09-12T18:59:18.375060+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:13.339944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14275251,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":491,"num_read_kb":44050,"num_write":1183,"num_write_kb":40700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426595+0000","last_change":"2024-09-12T17:40:22.146475+0000","last_active":"2024-09-12T18:55:17.426595+0000","last_peered":"2024-09-12T18:55:17.426595+0000","last_clean":"2024-09-12T18:55:17.426595+0000","last_became_active":"2024-09-12T17:40:22.145769+0000","last_became_peered":"2024-09-12T17:40:22.145769+0000","last_unstale":"2024-09-12T18:55:17.426595+0000","last_undegraded":"2024-09-12T18:55:17.426595+0000","last_fullsized":"2024-09-12T18:55:17.426595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:33.677268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'144","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:24.425893+0000","last_change":"2024-09-12T17:40:24.164714+0000","last_active":"2024-09-12T18:55:24.425893+0000","last_peered":"2024-09-12T18:55:24.425893+0000","last_clean":"2024-09-12T18:55:24.425893+0000","last_became_active":"2024-09-12T17:40:24.163809+0000","last_became_peered":"2024-09-12T17:40:24.163809+0000","last_unstale":"2024-09-12T18:55:24.425893+0000","last_undegraded":"2024-09-12T18:55:24.425893+0000","last_fullsized":"2024-09-12T18:55:24.425893+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:13.691022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":124,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'760","reported_seq":2940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.828883+0000","last_change":"2024-09-12T17:40:26.201403+0000","last_active":"2024-09-12T18:59:30.828883+0000","last_peered":"2024-09-12T18:59:30.828883+0000","last_clean":"2024-09-12T18:59:30.828883+0000","last_became_active":"2024-09-12T17:40:26.200567+0000","last_became_peered":"2024-09-12T17:40:26.200567+0000","last_unstale":"2024-09-12T18:59:30.828883+0000","last_undegraded":"2024-09-12T18:59:30.828883+0000","last_fullsized":"2024-09-12T18:59:30.828883+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":701,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:56.480672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'215","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.683461+0000","last_change":"2024-09-12T17:40:28.172338+0000","last_active":"2024-09-12T18:58:04.683461+0000","last_peered":"2024-09-12T18:58:04.683461+0000","last_clean":"2024-09-12T18:58:04.683461+0000","last_became_active":"2024-09-12T17:40:28.171602+0000","last_became_peered":"2024-09-12T17:40:28.171602+0000","last_unstale":"2024-09-12T18:58:04.683461+0000","last_undegraded":"2024-09-12T18:58:04.683461+0000","last_fullsized":"2024-09-12T18:58:04.683461+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:30.488801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":670,"num_read_kb":661,"num_write":473,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'82","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:20.741811+0000","last_change":"2024-09-12T17:40:55.305375+0000","last_active":"2024-09-12T18:56:20.741811+0000","last_peered":"2024-09-12T18:56:20.741811+0000","last_clean":"2024-09-12T18:56:20.741811+0000","last_became_active":"2024-09-12T17:40:55.305123+0000","last_became_peered":"2024-09-12T17:40:55.305123+0000","last_unstale":"2024-09-12T18:56:20.741811+0000","last_undegraded":"2024-09-12T18:56:20.741811+0000","last_fullsized":"2024-09-12T18:56:20.741811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:09.120196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":316,"num_write":118,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"264'349","reported_seq":1098,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.441952+0000","last_change":"2024-09-12T17:40:18.757642+0000","last_active":"2024-09-12T18:57:22.441952+0000","last_peered":"2024-09-12T18:57:22.441952+0000","last_clean":"2024-09-12T18:57:22.441952+0000","last_became_active":"2024-09-12T17:40:18.755758+0000","last_became_peered":"2024-09-12T17:40:18.755758+0000","last_unstale":"2024-09-12T18:57:22.441952+0000","last_undegraded":"2024-09-12T18:57:22.441952+0000","last_fullsized":"2024-09-12T18:57:22.441952+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:52.135911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3608682,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":695,"num_read_kb":10976,"num_write":1200,"num_write_kb":39454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.610050+0000","last_change":"2024-09-12T17:40:22.145057+0000","last_active":"2024-09-12T18:55:17.610050+0000","last_peered":"2024-09-12T18:55:17.610050+0000","last_clean":"2024-09-12T18:55:17.610050+0000","last_became_active":"2024-09-12T17:40:22.144266+0000","last_became_peered":"2024-09-12T17:40:22.144266+0000","last_unstale":"2024-09-12T18:55:17.610050+0000","last_undegraded":"2024-09-12T18:55:17.610050+0000","last_fullsized":"2024-09-12T18:55:17.610050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:51.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'274","reported_seq":852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.462287+0000","last_change":"2024-09-12T17:40:24.333448+0000","last_active":"2024-09-12T18:57:47.462287+0000","last_peered":"2024-09-12T18:57:47.462287+0000","last_clean":"2024-09-12T18:57:47.462287+0000","last_became_active":"2024-09-12T17:40:24.332623+0000","last_became_peered":"2024-09-12T17:40:24.332623+0000","last_unstale":"2024-09-12T18:57:47.462287+0000","last_undegraded":"2024-09-12T18:57:47.462287+0000","last_fullsized":"2024-09-12T18:57:47.462287+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:26.074531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56611,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":973,"num_write":370,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'782","reported_seq":4955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.819165+0000","last_change":"2024-09-12T17:40:26.195115+0000","last_active":"2024-09-12T18:59:30.819165+0000","last_peered":"2024-09-12T18:59:30.819165+0000","last_clean":"2024-09-12T18:59:30.819165+0000","last_became_active":"2024-09-12T17:40:26.194264+0000","last_became_peered":"2024-09-12T17:40:26.194264+0000","last_unstale":"2024-09-12T18:59:30.819165+0000","last_undegraded":"2024-09-12T18:59:30.819165+0000","last_fullsized":"2024-09-12T18:59:30.819165+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:28.079379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'4312","reported_seq":4925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:22.662701+0000","last_change":"2024-09-12T17:40:20.137536+0000","last_active":"2024-09-12T18:58:22.662701+0000","last_peered":"2024-09-12T18:58:22.662701+0000","last_clean":"2024-09-12T18:58:22.662701+0000","last_became_active":"2024-09-12T17:40:20.136595+0000","last_became_peered":"2024-09-12T17:40:20.136595+0000","last_unstale":"2024-09-12T18:58:22.662701+0000","last_undegraded":"2024-09-12T18:58:22.662701+0000","last_fullsized":"2024-09-12T18:58:22.662701+0000","mapping_epoch":25,"log_start":"264'4300","ondisk_log_start":"264'4300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:18.692389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17313,"num_read_kb":14480,"num_write":6459,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'265","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.452784+0000","last_change":"2024-09-12T17:40:18.792864+0000","last_active":"2024-09-12T18:57:07.452784+0000","last_peered":"2024-09-12T18:57:07.452784+0000","last_clean":"2024-09-12T18:57:07.452784+0000","last_became_active":"2024-09-12T17:40:18.792274+0000","last_became_peered":"2024-09-12T17:40:18.792274+0000","last_unstale":"2024-09-12T18:57:07.452784+0000","last_undegraded":"2024-09-12T18:57:07.452784+0000","last_fullsized":"2024-09-12T18:57:07.452784+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:56.734666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3754663,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":495,"num_read_kb":45932,"num_write":1030,"num_write_kb":27157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439724+0000","last_change":"2024-09-12T17:40:22.152894+0000","last_active":"2024-09-12T18:56:12.439724+0000","last_peered":"2024-09-12T18:56:12.439724+0000","last_clean":"2024-09-12T18:56:12.439724+0000","last_became_active":"2024-09-12T17:40:22.150553+0000","last_became_peered":"2024-09-12T17:40:22.150553+0000","last_unstale":"2024-09-12T18:56:12.439724+0000","last_undegraded":"2024-09-12T18:56:12.439724+0000","last_fullsized":"2024-09-12T18:56:12.439724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:24.942654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'407","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:42.667592+0000","last_change":"2024-09-12T17:40:24.333149+0000","last_active":"2024-09-12T18:58:42.667592+0000","last_peered":"2024-09-12T18:58:42.667592+0000","last_clean":"2024-09-12T18:58:42.667592+0000","last_became_active":"2024-09-12T17:40:24.332413+0000","last_became_peered":"2024-09-12T17:40:24.332413+0000","last_unstale":"2024-09-12T18:58:42.667592+0000","last_undegraded":"2024-09-12T18:58:42.667592+0000","last_fullsized":"2024-09-12T18:58:42.667592+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:54.765665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60683,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":634,"num_read_kb":1155,"num_write":496,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.457290+0000","last_change":"2024-09-12T17:40:26.197292+0000","last_active":"2024-09-12T18:56:57.457290+0000","last_peered":"2024-09-12T18:56:57.457290+0000","last_clean":"2024-09-12T18:56:57.457290+0000","last_became_active":"2024-09-12T17:40:26.180448+0000","last_became_peered":"2024-09-12T17:40:26.180448+0000","last_unstale":"2024-09-12T18:56:57.457290+0000","last_undegraded":"2024-09-12T18:56:57.457290+0000","last_fullsized":"2024-09-12T18:56:57.457290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:40.842285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'559","reported_seq":1375,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.758187+0000","last_change":"2024-09-12T17:40:28.190641+0000","last_active":"2024-09-12T18:59:27.758187+0000","last_peered":"2024-09-12T18:59:27.758187+0000","last_clean":"2024-09-12T18:59:27.758187+0000","last_became_active":"2024-09-12T17:40:28.189872+0000","last_became_peered":"2024-09-12T17:40:28.189872+0000","last_unstale":"2024-09-12T18:59:27.758187+0000","last_undegraded":"2024-09-12T18:59:27.758187+0000","last_fullsized":"2024-09-12T18:59:27.758187+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:20.487874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1323,"num_read_kb":1321,"num_write":1170,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'151","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.803902+0000","last_change":"2024-09-12T17:40:20.134586+0000","last_active":"2024-09-12T18:56:12.803902+0000","last_peered":"2024-09-12T18:56:12.803902+0000","last_clean":"2024-09-12T18:56:12.803902+0000","last_became_active":"2024-09-12T17:40:20.133890+0000","last_became_peered":"2024-09-12T17:40:20.133890+0000","last_unstale":"2024-09-12T18:56:12.803902+0000","last_undegraded":"2024-09-12T18:56:12.803902+0000","last_fullsized":"2024-09-12T18:56:12.803902+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:21.170793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":596,"num_write":262,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'316","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.022630+0000","last_change":"2024-09-12T17:40:18.779965+0000","last_active":"2024-09-12T18:57:47.022630+0000","last_peered":"2024-09-12T18:57:47.022630+0000","last_clean":"2024-09-12T18:57:47.022630+0000","last_became_active":"2024-09-12T17:40:18.779278+0000","last_became_peered":"2024-09-12T17:40:18.779278+0000","last_unstale":"2024-09-12T18:57:47.022630+0000","last_undegraded":"2024-09-12T18:57:47.022630+0000","last_fullsized":"2024-09-12T18:57:47.022630+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:40.197710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12165714,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":505,"num_read_kb":90798,"num_write":1100,"num_write_kb":50508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"35'5","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.367452+0000","last_change":"2024-09-12T17:40:22.133983+0000","last_active":"2024-09-12T18:59:27.367452+0000","last_peered":"2024-09-12T18:59:27.367452+0000","last_clean":"2024-09-12T18:59:27.367452+0000","last_became_active":"2024-09-12T17:40:22.133525+0000","last_became_peered":"2024-09-12T17:40:22.133525+0000","last_unstale":"2024-09-12T18:59:27.367452+0000","last_undegraded":"2024-09-12T18:59:27.367452+0000","last_fullsized":"2024-09-12T18:59:27.367452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:35.003569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'284","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:12.480635+0000","last_change":"2024-09-12T17:40:24.178387+0000","last_active":"2024-09-12T18:59:12.480635+0000","last_peered":"2024-09-12T18:59:12.480635+0000","last_clean":"2024-09-12T18:59:12.480635+0000","last_became_active":"2024-09-12T17:40:24.177609+0000","last_became_peered":"2024-09-12T17:40:24.177609+0000","last_unstale":"2024-09-12T18:59:12.480635+0000","last_undegraded":"2024-09-12T18:59:12.480635+0000","last_fullsized":"2024-09-12T18:59:12.480635+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.549312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55961,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":980,"num_write":382,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.445281+0000","last_change":"2024-09-12T17:40:26.203926+0000","last_active":"2024-09-12T18:56:37.445281+0000","last_peered":"2024-09-12T18:56:37.445281+0000","last_clean":"2024-09-12T18:56:37.445281+0000","last_became_active":"2024-09-12T17:40:26.203313+0000","last_became_peered":"2024-09-12T17:40:26.203313+0000","last_unstale":"2024-09-12T18:56:37.445281+0000","last_undegraded":"2024-09-12T18:56:37.445281+0000","last_fullsized":"2024-09-12T18:56:37.445281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:57.623918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2394","reported_seq":4223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:19.224714+0000","last_change":"2024-09-12T17:40:28.184253+0000","last_active":"2024-09-12T18:59:19.224714+0000","last_peered":"2024-09-12T18:59:19.224714+0000","last_clean":"2024-09-12T18:59:19.224714+0000","last_became_active":"2024-09-12T17:40:28.183181+0000","last_became_peered":"2024-09-12T17:40:28.183181+0000","last_unstale":"2024-09-12T18:59:19.224714+0000","last_undegraded":"2024-09-12T18:59:19.224714+0000","last_fullsized":"2024-09-12T18:59:19.224714+0000","mapping_epoch":33,"log_start":"264'2300","ondisk_log_start":"264'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:07.933119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6012,"num_read_kb":6017,"num_write":4828,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'261","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:32.431640+0000","last_change":"2024-09-12T17:40:20.138917+0000","last_active":"2024-09-12T18:56:32.431640+0000","last_peered":"2024-09-12T18:56:32.431640+0000","last_clean":"2024-09-12T18:56:32.431640+0000","last_became_active":"2024-09-12T17:40:20.133614+0000","last_became_peered":"2024-09-12T17:40:20.133614+0000","last_unstale":"2024-09-12T18:56:32.431640+0000","last_undegraded":"2024-09-12T18:56:32.431640+0000","last_fullsized":"2024-09-12T18:56:32.431640+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:17.955544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1175,"num_read_kb":965,"num_write":385,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'245","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.219980+0000","last_change":"2024-09-12T17:40:18.787022+0000","last_active":"2024-09-12T18:57:17.219980+0000","last_peered":"2024-09-12T18:57:17.219980+0000","last_clean":"2024-09-12T18:57:17.219980+0000","last_became_active":"2024-09-12T17:40:18.786288+0000","last_became_peered":"2024-09-12T17:40:18.786288+0000","last_unstale":"2024-09-12T18:57:17.219980+0000","last_undegraded":"2024-09-12T18:57:17.219980+0000","last_fullsized":"2024-09-12T18:57:17.219980+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:05.492643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10052947,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":337,"num_read_kb":29289,"num_write":868,"num_write_kb":24158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:54.443737+0000","last_change":"2024-09-12T17:40:22.132236+0000","last_active":"2024-09-12T18:56:54.443737+0000","last_peered":"2024-09-12T18:56:54.443737+0000","last_clean":"2024-09-12T18:56:54.443737+0000","last_became_active":"2024-09-12T17:40:22.131242+0000","last_became_peered":"2024-09-12T17:40:22.131242+0000","last_unstale":"2024-09-12T18:56:54.443737+0000","last_undegraded":"2024-09-12T18:56:54.443737+0000","last_fullsized":"2024-09-12T18:56:54.443737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:50.985889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'299","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:27.471824+0000","last_change":"2024-09-12T17:40:24.163379+0000","last_active":"2024-09-12T18:58:27.471824+0000","last_peered":"2024-09-12T18:58:27.471824+0000","last_clean":"2024-09-12T18:58:27.471824+0000","last_became_active":"2024-09-12T17:40:24.162722+0000","last_became_peered":"2024-09-12T17:40:24.162722+0000","last_unstale":"2024-09-12T18:58:27.471824+0000","last_undegraded":"2024-09-12T18:58:27.471824+0000","last_fullsized":"2024-09-12T18:58:27.471824+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:54.964194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52424,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":926,"num_write":376,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'757","reported_seq":2695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.803097+0000","last_change":"2024-09-12T17:40:26.182440+0000","last_active":"2024-09-12T18:59:30.803097+0000","last_peered":"2024-09-12T18:59:30.803097+0000","last_clean":"2024-09-12T18:59:30.803097+0000","last_became_active":"2024-09-12T17:40:26.181656+0000","last_became_peered":"2024-09-12T17:40:26.181656+0000","last_unstale":"2024-09-12T18:59:30.803097+0000","last_undegraded":"2024-09-12T18:59:30.803097+0000","last_fullsized":"2024-09-12T18:59:30.803097+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:17.173815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'117","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.441759+0000","last_change":"2024-09-12T17:40:28.187639+0000","last_active":"2024-09-12T18:59:26.441759+0000","last_peered":"2024-09-12T18:59:26.441759+0000","last_clean":"2024-09-12T18:59:26.441759+0000","last_became_active":"2024-09-12T17:40:28.185975+0000","last_became_peered":"2024-09-12T17:40:28.185975+0000","last_unstale":"2024-09-12T18:59:26.441759+0000","last_undegraded":"2024-09-12T18:59:26.441759+0000","last_fullsized":"2024-09-12T18:59:26.441759+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:59.724854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'268","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.465535+0000","last_change":"2024-09-12T17:40:20.125734+0000","last_active":"2024-09-12T18:56:52.465535+0000","last_peered":"2024-09-12T18:56:52.465535+0000","last_clean":"2024-09-12T18:56:52.465535+0000","last_became_active":"2024-09-12T17:40:20.125386+0000","last_became_peered":"2024-09-12T17:40:20.125386+0000","last_unstale":"2024-09-12T18:56:52.465535+0000","last_undegraded":"2024-09-12T18:56:52.465535+0000","last_fullsized":"2024-09-12T18:56:52.465535+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:49.257336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1147,"num_read_kb":967,"num_write":444,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'274","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.631617+0000","last_change":"2024-09-12T17:40:18.761857+0000","last_active":"2024-09-12T18:56:52.631617+0000","last_peered":"2024-09-12T18:56:52.631617+0000","last_clean":"2024-09-12T18:56:52.631617+0000","last_became_active":"2024-09-12T17:40:18.761052+0000","last_became_peered":"2024-09-12T17:40:18.761052+0000","last_unstale":"2024-09-12T18:56:52.631617+0000","last_undegraded":"2024-09-12T18:56:52.631617+0000","last_fullsized":"2024-09-12T18:56:52.631617+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:11.433675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20283170,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":416,"num_read_kb":20006,"num_write":993,"num_write_kb":43376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:34.440085+0000","last_change":"2024-09-12T17:40:22.134731+0000","last_active":"2024-09-12T18:56:34.440085+0000","last_peered":"2024-09-12T18:56:34.440085+0000","last_clean":"2024-09-12T18:56:34.440085+0000","last_became_active":"2024-09-12T17:40:22.134290+0000","last_became_peered":"2024-09-12T17:40:22.134290+0000","last_unstale":"2024-09-12T18:56:34.440085+0000","last_undegraded":"2024-09-12T18:56:34.440085+0000","last_fullsized":"2024-09-12T18:56:34.440085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:09.025873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'481","reported_seq":1124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.666304+0000","last_change":"2024-09-12T17:40:24.161967+0000","last_active":"2024-09-12T18:59:27.666304+0000","last_peered":"2024-09-12T18:59:27.666304+0000","last_clean":"2024-09-12T18:59:27.666304+0000","last_became_active":"2024-09-12T17:40:24.161322+0000","last_became_peered":"2024-09-12T17:40:24.161322+0000","last_unstale":"2024-09-12T18:59:27.666304+0000","last_undegraded":"2024-09-12T18:59:27.666304+0000","last_fullsized":"2024-09-12T18:59:27.666304+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.436434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107875,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":843,"num_read_kb":1880,"num_write":698,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:19.437407+0000","last_change":"2024-09-12T17:40:26.192044+0000","last_active":"2024-09-12T18:56:19.437407+0000","last_peered":"2024-09-12T18:56:19.437407+0000","last_clean":"2024-09-12T18:56:19.437407+0000","last_became_active":"2024-09-12T17:40:26.191395+0000","last_became_peered":"2024-09-12T17:40:26.191395+0000","last_unstale":"2024-09-12T18:56:19.437407+0000","last_undegraded":"2024-09-12T18:56:19.437407+0000","last_fullsized":"2024-09-12T18:56:19.437407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:01.918115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'146","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:33.286149+0000","last_change":"2024-09-12T17:40:28.205050+0000","last_active":"2024-09-12T18:56:33.286149+0000","last_peered":"2024-09-12T18:56:33.286149+0000","last_clean":"2024-09-12T18:56:33.286149+0000","last_became_active":"2024-09-12T17:40:28.204260+0000","last_became_peered":"2024-09-12T17:40:28.204260+0000","last_unstale":"2024-09-12T18:56:33.286149+0000","last_undegraded":"2024-09-12T18:56:33.286149+0000","last_fullsized":"2024-09-12T18:56:33.286149+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:03.489071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":166,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'137","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812393+0000","last_change":"2024-09-12T17:40:20.143727+0000","last_active":"2024-09-12T18:56:52.812393+0000","last_peered":"2024-09-12T18:56:52.812393+0000","last_clean":"2024-09-12T18:56:52.812393+0000","last_became_active":"2024-09-12T17:40:20.137143+0000","last_became_peered":"2024-09-12T17:40:20.137143+0000","last_unstale":"2024-09-12T18:56:52.812393+0000","last_undegraded":"2024-09-12T18:56:52.812393+0000","last_fullsized":"2024-09-12T18:56:52.812393+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:59.463752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":630,"num_read_kb":531,"num_write":209,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'296","reported_seq":1127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.449237+0000","last_change":"2024-09-12T17:40:18.759820+0000","last_active":"2024-09-12T18:56:52.449237+0000","last_peered":"2024-09-12T18:56:52.449237+0000","last_clean":"2024-09-12T18:56:52.449237+0000","last_became_active":"2024-09-12T17:40:18.759516+0000","last_became_peered":"2024-09-12T17:40:18.759516+0000","last_unstale":"2024-09-12T18:56:52.449237+0000","last_undegraded":"2024-09-12T18:56:52.449237+0000","last_fullsized":"2024-09-12T18:56:52.449237+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:00.153624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5998334,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":751,"num_read_kb":9130,"num_write":1059,"num_write_kb":40035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:54.443796+0000","last_change":"2024-09-12T17:40:22.152256+0000","last_active":"2024-09-12T18:56:54.443796+0000","last_peered":"2024-09-12T18:56:54.443796+0000","last_clean":"2024-09-12T18:56:54.443796+0000","last_became_active":"2024-09-12T17:40:22.151755+0000","last_became_peered":"2024-09-12T17:40:22.151755+0000","last_unstale":"2024-09-12T18:56:54.443796+0000","last_undegraded":"2024-09-12T18:56:54.443796+0000","last_fullsized":"2024-09-12T18:56:54.443796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:30.113972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'323","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:12.843855+0000","last_change":"2024-09-12T17:40:24.172818+0000","last_active":"2024-09-12T18:59:12.843855+0000","last_peered":"2024-09-12T18:59:12.843855+0000","last_clean":"2024-09-12T18:59:12.843855+0000","last_became_active":"2024-09-12T17:40:24.171973+0000","last_became_peered":"2024-09-12T17:40:24.171973+0000","last_unstale":"2024-09-12T18:59:12.843855+0000","last_undegraded":"2024-09-12T18:59:12.843855+0000","last_fullsized":"2024-09-12T18:59:12.843855+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:48.182083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":1037,"num_write":468,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.469988+0000","last_change":"2024-09-12T17:40:26.185794+0000","last_active":"2024-09-12T18:57:12.469988+0000","last_peered":"2024-09-12T18:57:12.469988+0000","last_clean":"2024-09-12T18:57:12.469988+0000","last_became_active":"2024-09-12T17:40:26.185070+0000","last_became_peered":"2024-09-12T17:40:26.185070+0000","last_unstale":"2024-09-12T18:57:12.469988+0000","last_undegraded":"2024-09-12T18:57:12.469988+0000","last_fullsized":"2024-09-12T18:57:12.469988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:50.080805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'139","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:47.476159+0000","last_change":"2024-09-12T17:40:28.195461+0000","last_active":"2024-09-12T18:58:47.476159+0000","last_peered":"2024-09-12T18:58:47.476159+0000","last_clean":"2024-09-12T18:58:47.476159+0000","last_became_active":"2024-09-12T17:40:28.194137+0000","last_became_peered":"2024-09-12T17:40:28.194137+0000","last_unstale":"2024-09-12T18:58:47.476159+0000","last_undegraded":"2024-09-12T18:58:47.476159+0000","last_fullsized":"2024-09-12T18:58:47.476159+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:02.040950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":145,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'125","reported_seq":703,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812491+0000","last_change":"2024-09-12T17:40:20.132955+0000","last_active":"2024-09-12T18:56:52.812491+0000","last_peered":"2024-09-12T18:56:52.812491+0000","last_clean":"2024-09-12T18:56:52.812491+0000","last_became_active":"2024-09-12T17:40:20.132115+0000","last_became_peered":"2024-09-12T17:40:20.132115+0000","last_unstale":"2024-09-12T18:56:52.812491+0000","last_undegraded":"2024-09-12T18:56:52.812491+0000","last_fullsized":"2024-09-12T18:56:52.812491+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:35.227492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":428,"num_write":212,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'276","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:14.416472+0000","last_change":"2024-09-12T17:40:18.774103+0000","last_active":"2024-09-12T18:57:14.416472+0000","last_peered":"2024-09-12T18:57:14.416472+0000","last_clean":"2024-09-12T18:57:14.416472+0000","last_became_active":"2024-09-12T17:40:18.773579+0000","last_became_peered":"2024-09-12T17:40:18.773579+0000","last_unstale":"2024-09-12T18:57:14.416472+0000","last_undegraded":"2024-09-12T18:57:14.416472+0000","last_fullsized":"2024-09-12T18:57:14.416472+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:15.108347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6979127,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":440,"num_read_kb":44851,"num_write":964,"num_write_kb":35490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.456281+0000","last_change":"2024-09-12T17:40:22.143512+0000","last_active":"2024-09-12T18:56:52.456281+0000","last_peered":"2024-09-12T18:56:52.456281+0000","last_clean":"2024-09-12T18:56:52.456281+0000","last_became_active":"2024-09-12T17:40:22.142112+0000","last_became_peered":"2024-09-12T17:40:22.142112+0000","last_unstale":"2024-09-12T18:56:52.456281+0000","last_undegraded":"2024-09-12T18:56:52.456281+0000","last_fullsized":"2024-09-12T18:56:52.456281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:23.695955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'332","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.741657+0000","last_change":"2024-09-12T17:40:24.182665+0000","last_active":"2024-09-12T18:59:27.741657+0000","last_peered":"2024-09-12T18:59:27.741657+0000","last_clean":"2024-09-12T18:59:27.741657+0000","last_became_active":"2024-09-12T17:40:24.181982+0000","last_became_peered":"2024-09-12T17:40:24.181982+0000","last_unstale":"2024-09-12T18:59:27.741657+0000","last_undegraded":"2024-09-12T18:59:27.741657+0000","last_fullsized":"2024-09-12T18:59:27.741657+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:55.908753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62664,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":1091,"num_write":438,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'721","reported_seq":2531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.805991+0000","last_change":"2024-09-12T17:40:26.187935+0000","last_active":"2024-09-12T18:59:30.805991+0000","last_peered":"2024-09-12T18:59:30.805991+0000","last_clean":"2024-09-12T18:59:30.805991+0000","last_became_active":"2024-09-12T17:40:26.187269+0000","last_became_peered":"2024-09-12T17:40:26.187269+0000","last_unstale":"2024-09-12T18:59:30.805991+0000","last_undegraded":"2024-09-12T18:59:30.805991+0000","last_fullsized":"2024-09-12T18:59:30.805991+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:57.828902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'139","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.277441+0000","last_change":"2024-09-12T17:40:28.192959+0000","last_active":"2024-09-12T18:58:02.277441+0000","last_peered":"2024-09-12T18:58:02.277441+0000","last_clean":"2024-09-12T18:58:02.277441+0000","last_became_active":"2024-09-12T17:40:28.192211+0000","last_became_peered":"2024-09-12T17:40:28.192211+0000","last_unstale":"2024-09-12T18:58:02.277441+0000","last_undegraded":"2024-09-12T18:58:02.277441+0000","last_fullsized":"2024-09-12T18:58:02.277441+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:29.331632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":224,"num_write":356,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'4139","reported_seq":4785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812556+0000","last_change":"2024-09-12T17:40:20.137018+0000","last_active":"2024-09-12T18:56:52.812556+0000","last_peered":"2024-09-12T18:56:52.812556+0000","last_clean":"2024-09-12T18:56:52.812556+0000","last_became_active":"2024-09-12T17:40:20.136148+0000","last_became_peered":"2024-09-12T17:40:20.136148+0000","last_unstale":"2024-09-12T18:56:52.812556+0000","last_undegraded":"2024-09-12T18:56:52.812556+0000","last_fullsized":"2024-09-12T18:56:52.812556+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":3000,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:28.267156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16638,"num_read_kb":13967,"num_write":6216,"num_write_kb":3097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'239","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:14.426006+0000","last_change":"2024-09-12T17:40:18.774322+0000","last_active":"2024-09-12T18:56:14.426006+0000","last_peered":"2024-09-12T18:56:14.426006+0000","last_clean":"2024-09-12T18:56:14.426006+0000","last_became_active":"2024-09-12T17:40:18.773552+0000","last_became_peered":"2024-09-12T17:40:18.773552+0000","last_unstale":"2024-09-12T18:56:14.426006+0000","last_undegraded":"2024-09-12T18:56:14.426006+0000","last_fullsized":"2024-09-12T18:56:14.426006+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:46.449493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10461028,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":414,"num_read_kb":17946,"num_write":865,"num_write_kb":45991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.378738+0000","last_change":"2024-09-12T17:40:22.144205+0000","last_active":"2024-09-12T18:59:27.378738+0000","last_peered":"2024-09-12T18:59:27.378738+0000","last_clean":"2024-09-12T18:59:27.378738+0000","last_became_active":"2024-09-12T17:40:22.143463+0000","last_became_peered":"2024-09-12T17:40:22.143463+0000","last_unstale":"2024-09-12T18:59:27.378738+0000","last_undegraded":"2024-09-12T18:59:27.378738+0000","last_fullsized":"2024-09-12T18:59:27.378738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:11.027627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":949,"num_read_kb":949,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'110","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450877+0000","last_change":"2024-09-12T17:40:24.330084+0000","last_active":"2024-09-12T18:56:57.450877+0000","last_peered":"2024-09-12T18:56:57.450877+0000","last_clean":"2024-09-12T18:56:57.450877+0000","last_became_active":"2024-09-12T17:40:24.329452+0000","last_became_peered":"2024-09-12T17:40:24.329452+0000","last_unstale":"2024-09-12T18:56:57.450877+0000","last_undegraded":"2024-09-12T18:56:57.450877+0000","last_fullsized":"2024-09-12T18:56:57.450877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:41.298862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'750","reported_seq":2622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.822927+0000","last_change":"2024-09-12T17:40:26.183775+0000","last_active":"2024-09-12T18:59:30.822927+0000","last_peered":"2024-09-12T18:59:30.822927+0000","last_clean":"2024-09-12T18:59:30.822927+0000","last_became_active":"2024-09-12T17:40:26.183016+0000","last_became_peered":"2024-09-12T17:40:26.183016+0000","last_unstale":"2024-09-12T18:59:30.822927+0000","last_undegraded":"2024-09-12T18:59:30.822927+0000","last_fullsized":"2024-09-12T18:59:30.822927+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:45.838846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'112","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821328+0000","last_change":"2024-09-12T17:40:28.180920+0000","last_active":"2024-09-12T18:57:32.821328+0000","last_peered":"2024-09-12T18:57:32.821328+0000","last_clean":"2024-09-12T18:57:32.821328+0000","last_became_active":"2024-09-12T17:40:28.180192+0000","last_became_peered":"2024-09-12T17:40:28.180192+0000","last_unstale":"2024-09-12T18:57:32.821328+0000","last_undegraded":"2024-09-12T18:57:32.821328+0000","last_fullsized":"2024-09-12T18:57:32.821328+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:20.350489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":167,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'272","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.460652+0000","last_change":"2024-09-12T17:40:20.126559+0000","last_active":"2024-09-12T18:57:12.460652+0000","last_peered":"2024-09-12T18:57:12.460652+0000","last_clean":"2024-09-12T18:57:12.460652+0000","last_became_active":"2024-09-12T17:40:20.125511+0000","last_became_peered":"2024-09-12T17:40:20.125511+0000","last_unstale":"2024-09-12T18:57:12.460652+0000","last_undegraded":"2024-09-12T18:57:12.460652+0000","last_fullsized":"2024-09-12T18:57:12.460652+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:21.984534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1212,"num_read_kb":1000,"num_write":434,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'234","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439056+0000","last_change":"2024-09-12T17:40:18.769294+0000","last_active":"2024-09-12T18:56:12.439056+0000","last_peered":"2024-09-12T18:56:12.439056+0000","last_clean":"2024-09-12T18:56:12.439056+0000","last_became_active":"2024-09-12T17:40:18.769054+0000","last_became_peered":"2024-09-12T17:40:18.769054+0000","last_unstale":"2024-09-12T18:56:12.439056+0000","last_undegraded":"2024-09-12T18:56:12.439056+0000","last_fullsized":"2024-09-12T18:56:12.439056+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:10.356128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4761001,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":352,"num_read_kb":78920,"num_write":837,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812532+0000","last_change":"2024-09-12T17:40:22.139642+0000","last_active":"2024-09-12T18:56:52.812532+0000","last_peered":"2024-09-12T18:56:52.812532+0000","last_clean":"2024-09-12T18:56:52.812532+0000","last_became_active":"2024-09-12T17:40:22.138875+0000","last_became_peered":"2024-09-12T17:40:22.138875+0000","last_unstale":"2024-09-12T18:56:52.812532+0000","last_undegraded":"2024-09-12T18:56:52.812532+0000","last_fullsized":"2024-09-12T18:56:52.812532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:04.385118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'392","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:12.674294+0000","last_change":"2024-09-12T17:40:24.174213+0000","last_active":"2024-09-12T18:59:12.674294+0000","last_peered":"2024-09-12T18:59:12.674294+0000","last_clean":"2024-09-12T18:59:12.674294+0000","last_became_active":"2024-09-12T17:40:24.173537+0000","last_became_peered":"2024-09-12T17:40:24.173537+0000","last_unstale":"2024-09-12T18:59:12.674294+0000","last_undegraded":"2024-09-12T18:59:12.674294+0000","last_fullsized":"2024-09-12T18:59:12.674294+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:35.315463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63339,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":637,"num_read_kb":1220,"num_write":502,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.436922+0000","last_change":"2024-09-12T17:40:26.184072+0000","last_active":"2024-09-12T18:56:57.436922+0000","last_peered":"2024-09-12T18:56:57.436922+0000","last_clean":"2024-09-12T18:56:57.436922+0000","last_became_active":"2024-09-12T17:40:26.183228+0000","last_became_peered":"2024-09-12T17:40:26.183228+0000","last_unstale":"2024-09-12T18:56:57.436922+0000","last_undegraded":"2024-09-12T18:56:57.436922+0000","last_fullsized":"2024-09-12T18:56:57.436922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.239515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'138","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.417590+0000","last_change":"2024-09-12T17:40:28.192535+0000","last_active":"2024-09-12T18:58:04.417590+0000","last_peered":"2024-09-12T18:58:04.417590+0000","last_clean":"2024-09-12T18:58:04.417590+0000","last_became_active":"2024-09-12T17:40:28.191461+0000","last_became_peered":"2024-09-12T17:40:28.191461+0000","last_unstale":"2024-09-12T18:58:04.417590+0000","last_undegraded":"2024-09-12T18:58:04.417590+0000","last_fullsized":"2024-09-12T18:58:04.417590+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:39.691469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":326,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'92","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.447236+0000","last_change":"2024-09-12T17:40:20.146944+0000","last_active":"2024-09-12T18:57:47.447236+0000","last_peered":"2024-09-12T18:57:47.447236+0000","last_clean":"2024-09-12T18:57:47.447236+0000","last_became_active":"2024-09-12T17:40:20.146160+0000","last_became_peered":"2024-09-12T17:40:20.146160+0000","last_unstale":"2024-09-12T18:57:47.447236+0000","last_undegraded":"2024-09-12T18:57:47.447236+0000","last_fullsized":"2024-09-12T18:57:47.447236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:10.252891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:22.442012+0000","last_change":"2024-09-12T17:40:03.638745+0000","last_active":"2024-09-12T18:56:22.442012+0000","last_peered":"2024-09-12T18:56:22.442012+0000","last_clean":"2024-09-12T18:56:22.442012+0000","last_became_active":"2024-09-12T17:40:03.636856+0000","last_became_peered":"2024-09-12T17:40:03.636856+0000","last_unstale":"2024-09-12T18:56:22.442012+0000","last_undegraded":"2024-09-12T18:56:22.442012+0000","last_fullsized":"2024-09-12T18:56:22.442012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_clean_scrub_stamp":"2024-09-12T17:40:02.615744+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:44.815912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637481+0000","last_change":"2024-09-12T17:40:11.694118+0000","last_active":"2024-09-12T18:57:17.637481+0000","last_peered":"2024-09-12T18:57:17.637481+0000","last_clean":"2024-09-12T18:57:17.637481+0000","last_became_active":"2024-09-12T17:40:09.670674+0000","last_became_peered":"2024-09-12T17:40:09.670674+0000","last_unstale":"2024-09-12T18:57:17.637481+0000","last_undegraded":"2024-09-12T18:57:17.637481+0000","last_fullsized":"2024-09-12T18:57:17.637481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:11.615670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001302742,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'313","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.458042+0000","last_change":"2024-09-12T17:40:18.774699+0000","last_active":"2024-09-12T18:57:27.458042+0000","last_peered":"2024-09-12T18:57:27.458042+0000","last_clean":"2024-09-12T18:57:27.458042+0000","last_became_active":"2024-09-12T17:40:18.774164+0000","last_became_peered":"2024-09-12T17:40:18.774164+0000","last_unstale":"2024-09-12T18:57:27.458042+0000","last_undegraded":"2024-09-12T18:57:27.458042+0000","last_fullsized":"2024-09-12T18:57:27.458042+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:30.058615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10725583,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":669,"num_read_kb":41233,"num_write":1060,"num_write_kb":37796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457318+0000","last_change":"2024-09-12T17:40:22.150388+0000","last_active":"2024-09-12T18:57:27.457318+0000","last_peered":"2024-09-12T18:57:27.457318+0000","last_clean":"2024-09-12T18:57:27.457318+0000","last_became_active":"2024-09-12T17:40:22.148190+0000","last_became_peered":"2024-09-12T17:40:22.148190+0000","last_unstale":"2024-09-12T18:57:27.457318+0000","last_undegraded":"2024-09-12T18:57:27.457318+0000","last_fullsized":"2024-09-12T18:57:27.457318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:47.144440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'721","reported_seq":1423,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.706201+0000","last_change":"2024-09-12T17:40:24.177543+0000","last_active":"2024-09-12T18:59:27.706201+0000","last_peered":"2024-09-12T18:59:27.706201+0000","last_clean":"2024-09-12T18:59:27.706201+0000","last_became_active":"2024-09-12T17:40:24.176757+0000","last_became_peered":"2024-09-12T17:40:24.176757+0000","last_unstale":"2024-09-12T18:59:27.706201+0000","last_undegraded":"2024-09-12T18:59:27.706201+0000","last_fullsized":"2024-09-12T18:59:27.706201+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.566492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172295,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1398,"num_read_kb":2961,"num_write":1334,"num_write_kb":1179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.458091+0000","last_change":"2024-09-12T17:40:26.191218+0000","last_active":"2024-09-12T18:56:17.458091+0000","last_peered":"2024-09-12T18:56:17.458091+0000","last_clean":"2024-09-12T18:56:17.458091+0000","last_became_active":"2024-09-12T17:40:26.190522+0000","last_became_peered":"2024-09-12T17:40:26.190522+0000","last_unstale":"2024-09-12T18:56:17.458091+0000","last_undegraded":"2024-09-12T18:56:17.458091+0000","last_fullsized":"2024-09-12T18:56:17.458091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:36.917179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'197","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.131600+0000","last_change":"2024-09-12T17:40:28.194274+0000","last_active":"2024-09-12T18:58:06.131600+0000","last_peered":"2024-09-12T18:58:06.131600+0000","last_clean":"2024-09-12T18:58:06.131600+0000","last_became_active":"2024-09-12T17:40:28.193456+0000","last_became_peered":"2024-09-12T17:40:28.193456+0000","last_unstale":"2024-09-12T18:58:06.131600+0000","last_undegraded":"2024-09-12T18:58:06.131600+0000","last_fullsized":"2024-09-12T18:58:06.131600+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:18.966712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":530,"num_write":424,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'121","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456780+0000","last_change":"2024-09-12T17:40:20.131034+0000","last_active":"2024-09-12T18:56:12.456780+0000","last_peered":"2024-09-12T18:56:12.456780+0000","last_clean":"2024-09-12T18:56:12.456780+0000","last_became_active":"2024-09-12T17:40:20.130774+0000","last_became_peered":"2024-09-12T17:40:20.130774+0000","last_unstale":"2024-09-12T18:56:12.456780+0000","last_undegraded":"2024-09-12T18:56:12.456780+0000","last_fullsized":"2024-09-12T18:56:12.456780+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:27.582751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":441,"num_write":172,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.443272+0000","last_change":"2024-09-12T17:40:11.747849+0000","last_active":"2024-09-12T18:56:27.443272+0000","last_peered":"2024-09-12T18:56:27.443272+0000","last_clean":"2024-09-12T18:56:27.443272+0000","last_became_active":"2024-09-12T17:40:09.666272+0000","last_became_peered":"2024-09-12T17:40:09.666272+0000","last_unstale":"2024-09-12T18:56:27.443272+0000","last_undegraded":"2024-09-12T18:56:27.443272+0000","last_fullsized":"2024-09-12T18:56:27.443272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:15.707497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001052545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'301","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473202+0000","last_change":"2024-09-12T17:40:18.775027+0000","last_active":"2024-09-12T18:57:27.473202+0000","last_peered":"2024-09-12T18:57:27.473202+0000","last_clean":"2024-09-12T18:57:27.473202+0000","last_became_active":"2024-09-12T17:40:18.774751+0000","last_became_peered":"2024-09-12T17:40:18.774751+0000","last_unstale":"2024-09-12T18:57:27.473202+0000","last_undegraded":"2024-09-12T18:57:27.473202+0000","last_fullsized":"2024-09-12T18:57:27.473202+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.877317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":708879,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":444,"num_read_kb":728,"num_write":1139,"num_write_kb":17029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.622557+0000","last_change":"2024-09-12T17:40:22.147871+0000","last_active":"2024-09-12T18:56:12.622557+0000","last_peered":"2024-09-12T18:56:12.622557+0000","last_clean":"2024-09-12T18:56:12.622557+0000","last_became_active":"2024-09-12T17:40:22.147184+0000","last_became_peered":"2024-09-12T17:40:22.147184+0000","last_unstale":"2024-09-12T18:56:12.622557+0000","last_undegraded":"2024-09-12T18:56:12.622557+0000","last_fullsized":"2024-09-12T18:56:12.622557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:31.847917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1331","reported_seq":3223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:31.357353+0000","last_change":"2024-09-12T17:40:24.169842+0000","last_active":"2024-09-12T18:59:31.357353+0000","last_peered":"2024-09-12T18:59:31.357353+0000","last_clean":"2024-09-12T18:59:31.357353+0000","last_became_active":"2024-09-12T17:40:24.169050+0000","last_became_peered":"2024-09-12T17:40:24.169050+0000","last_unstale":"2024-09-12T18:59:31.357353+0000","last_undegraded":"2024-09-12T18:59:31.357353+0000","last_fullsized":"2024-09-12T18:59:31.357353+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":1300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:15.887934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177592,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2117,"num_read_kb":3763,"num_write":1248,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.462335+0000","last_change":"2024-09-12T17:40:26.203093+0000","last_active":"2024-09-12T18:57:47.462335+0000","last_peered":"2024-09-12T18:57:47.462335+0000","last_clean":"2024-09-12T18:57:47.462335+0000","last_became_active":"2024-09-12T17:40:26.202360+0000","last_became_peered":"2024-09-12T17:40:26.202360+0000","last_unstale":"2024-09-12T18:57:47.462335+0000","last_undegraded":"2024-09-12T18:57:47.462335+0000","last_fullsized":"2024-09-12T18:57:47.462335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:51.977257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'190","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.452907+0000","last_change":"2024-09-12T17:40:28.190152+0000","last_active":"2024-09-12T18:56:37.452907+0000","last_peered":"2024-09-12T18:56:37.452907+0000","last_clean":"2024-09-12T18:56:37.452907+0000","last_became_active":"2024-09-12T17:40:28.189387+0000","last_became_peered":"2024-09-12T17:40:28.189387+0000","last_unstale":"2024-09-12T18:56:37.452907+0000","last_undegraded":"2024-09-12T18:56:37.452907+0000","last_fullsized":"2024-09-12T18:56:37.452907+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:39.878519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":364,"num_write":413,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'193","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447713+0000","last_change":"2024-09-12T17:40:20.129924+0000","last_active":"2024-09-12T18:56:12.447713+0000","last_peered":"2024-09-12T18:56:12.447713+0000","last_clean":"2024-09-12T18:56:12.447713+0000","last_became_active":"2024-09-12T17:40:20.129646+0000","last_became_peered":"2024-09-12T17:40:20.129646+0000","last_unstale":"2024-09-12T18:56:12.447713+0000","last_undegraded":"2024-09-12T18:56:12.447713+0000","last_fullsized":"2024-09-12T18:56:12.447713+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:01.198659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":706,"num_write":294,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:14.447959+0000","last_change":"2024-09-12T17:40:11.749016+0000","last_active":"2024-09-12T18:57:14.447959+0000","last_peered":"2024-09-12T18:57:14.447959+0000","last_clean":"2024-09-12T18:57:14.447959+0000","last_became_active":"2024-09-12T17:40:09.771196+0000","last_became_peered":"2024-09-12T17:40:09.771196+0000","last_unstale":"2024-09-12T18:57:14.447959+0000","last_undegraded":"2024-09-12T18:57:14.447959+0000","last_fullsized":"2024-09-12T18:57:14.447959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:48.611278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010655720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'263","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:16.016475+0000","last_change":"2024-09-12T17:40:18.766281+0000","last_active":"2024-09-12T18:59:16.016475+0000","last_peered":"2024-09-12T18:59:16.016475+0000","last_clean":"2024-09-12T18:59:16.016475+0000","last_became_active":"2024-09-12T17:40:18.759514+0000","last_became_peered":"2024-09-12T17:40:18.759514+0000","last_unstale":"2024-09-12T18:59:16.016475+0000","last_undegraded":"2024-09-12T18:59:16.016475+0000","last_fullsized":"2024-09-12T18:59:16.016475+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:37.907891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14413366,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":506,"num_read_kb":20357,"num_write":968,"num_write_kb":29003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:14.436342+0000","last_change":"2024-09-12T17:40:22.139338+0000","last_active":"2024-09-12T18:56:14.436342+0000","last_peered":"2024-09-12T18:56:14.436342+0000","last_clean":"2024-09-12T18:56:14.436342+0000","last_became_active":"2024-09-12T17:40:22.138606+0000","last_became_peered":"2024-09-12T17:40:22.138606+0000","last_unstale":"2024-09-12T18:56:14.436342+0000","last_undegraded":"2024-09-12T18:56:14.436342+0000","last_fullsized":"2024-09-12T18:56:14.436342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:11.361933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'294","reported_seq":1802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.983546+0000","last_change":"2024-09-12T17:40:24.330435+0000","last_active":"2024-09-12T18:59:27.983546+0000","last_peered":"2024-09-12T18:59:27.983546+0000","last_clean":"2024-09-12T18:59:27.983546+0000","last_became_active":"2024-09-12T17:40:24.329425+0000","last_became_peered":"2024-09-12T17:40:24.329425+0000","last_unstale":"2024-09-12T18:59:27.983546+0000","last_undegraded":"2024-09-12T18:59:27.983546+0000","last_fullsized":"2024-09-12T18:59:27.983546+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:18.922243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":264,"num_read_kb":256,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.474435+0000","last_change":"2024-09-12T17:40:26.190790+0000","last_active":"2024-09-12T18:57:32.474435+0000","last_peered":"2024-09-12T18:57:32.474435+0000","last_clean":"2024-09-12T18:57:32.474435+0000","last_became_active":"2024-09-12T17:40:26.188740+0000","last_became_peered":"2024-09-12T17:40:26.188740+0000","last_unstale":"2024-09-12T18:57:32.474435+0000","last_undegraded":"2024-09-12T18:57:32.474435+0000","last_fullsized":"2024-09-12T18:57:32.474435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:41.526051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'269","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.609250+0000","last_change":"2024-09-12T17:40:28.202892+0000","last_active":"2024-09-12T18:58:06.609250+0000","last_peered":"2024-09-12T18:58:06.609250+0000","last_clean":"2024-09-12T18:58:06.609250+0000","last_became_active":"2024-09-12T17:40:28.202238+0000","last_became_peered":"2024-09-12T17:40:28.202238+0000","last_unstale":"2024-09-12T18:58:06.609250+0000","last_undegraded":"2024-09-12T18:58:06.609250+0000","last_fullsized":"2024-09-12T18:58:06.609250+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:40.299625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":592,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'387","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464045+0000","last_change":"2024-09-12T17:40:20.128374+0000","last_active":"2024-09-12T18:57:27.464045+0000","last_peered":"2024-09-12T18:57:27.464045+0000","last_clean":"2024-09-12T18:57:27.464045+0000","last_became_active":"2024-09-12T17:40:20.127774+0000","last_became_peered":"2024-09-12T17:40:20.127774+0000","last_unstale":"2024-09-12T18:57:27.464045+0000","last_undegraded":"2024-09-12T18:57:27.464045+0000","last_fullsized":"2024-09-12T18:57:27.464045+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:30.582322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1689,"num_read_kb":1329,"num_write":647,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637396+0000","last_change":"2024-09-12T17:40:11.695547+0000","last_active":"2024-09-12T18:57:17.637396+0000","last_peered":"2024-09-12T18:57:17.637396+0000","last_clean":"2024-09-12T18:57:17.637396+0000","last_became_active":"2024-09-12T17:40:09.672745+0000","last_became_peered":"2024-09-12T17:40:09.672745+0000","last_unstale":"2024-09-12T18:57:17.637396+0000","last_undegraded":"2024-09-12T18:57:17.637396+0000","last_fullsized":"2024-09-12T18:57:17.637396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:10.363335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002775694,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'316","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820175+0000","last_change":"2024-09-12T17:40:18.770896+0000","last_active":"2024-09-12T18:57:27.820175+0000","last_peered":"2024-09-12T18:57:27.820175+0000","last_clean":"2024-09-12T18:57:27.820175+0000","last_became_active":"2024-09-12T17:40:18.769909+0000","last_became_peered":"2024-09-12T17:40:18.769909+0000","last_unstale":"2024-09-12T18:57:27.820175+0000","last_undegraded":"2024-09-12T18:57:27.820175+0000","last_fullsized":"2024-09-12T18:57:27.820175+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:26.327437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3465362,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":506,"num_read_kb":12377,"num_write":1241,"num_write_kb":22203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.476785+0000","last_change":"2024-09-12T17:40:22.145902+0000","last_active":"2024-09-12T18:57:42.476785+0000","last_peered":"2024-09-12T18:57:42.476785+0000","last_clean":"2024-09-12T18:57:42.476785+0000","last_became_active":"2024-09-12T17:40:22.145410+0000","last_became_peered":"2024-09-12T17:40:22.145410+0000","last_unstale":"2024-09-12T18:57:42.476785+0000","last_undegraded":"2024-09-12T18:57:42.476785+0000","last_fullsized":"2024-09-12T18:57:42.476785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:20.122905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'162","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:25.961675+0000","last_change":"2024-09-12T17:40:24.170740+0000","last_active":"2024-09-12T18:59:25.961675+0000","last_peered":"2024-09-12T18:59:25.961675+0000","last_clean":"2024-09-12T18:59:25.961675+0000","last_became_active":"2024-09-12T17:40:24.169937+0000","last_became_peered":"2024-09-12T17:40:24.169937+0000","last_unstale":"2024-09-12T18:59:25.961675+0000","last_undegraded":"2024-09-12T18:59:25.961675+0000","last_fullsized":"2024-09-12T18:59:25.961675+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:52.608977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":193,"num_write":146,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.428609+0000","last_change":"2024-09-12T17:40:26.172468+0000","last_active":"2024-09-12T18:56:17.428609+0000","last_peered":"2024-09-12T18:56:17.428609+0000","last_clean":"2024-09-12T18:56:17.428609+0000","last_became_active":"2024-09-12T17:40:26.171660+0000","last_became_peered":"2024-09-12T17:40:26.171660+0000","last_unstale":"2024-09-12T18:56:17.428609+0000","last_undegraded":"2024-09-12T18:56:17.428609+0000","last_fullsized":"2024-09-12T18:56:17.428609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:42.338225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'122","reported_seq":672,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.623502+0000","last_change":"2024-09-12T17:40:28.202494+0000","last_active":"2024-09-12T18:56:17.623502+0000","last_peered":"2024-09-12T18:56:17.623502+0000","last_clean":"2024-09-12T18:56:17.623502+0000","last_became_active":"2024-09-12T17:40:28.201694+0000","last_became_peered":"2024-09-12T17:40:28.201694+0000","last_unstale":"2024-09-12T18:56:17.623502+0000","last_undegraded":"2024-09-12T18:56:17.623502+0000","last_fullsized":"2024-09-12T18:56:17.623502+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:49.909677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":250,"num_write":312,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'144","reported_seq":749,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.463949+0000","last_change":"2024-09-12T17:40:20.128037+0000","last_active":"2024-09-12T18:57:27.463949+0000","last_peered":"2024-09-12T18:57:27.463949+0000","last_clean":"2024-09-12T18:57:27.463949+0000","last_became_active":"2024-09-12T17:40:20.127727+0000","last_became_peered":"2024-09-12T17:40:20.127727+0000","last_unstale":"2024-09-12T18:57:27.463949+0000","last_undegraded":"2024-09-12T18:57:27.463949+0000","last_fullsized":"2024-09-12T18:57:27.463949+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:36.420192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":625,"num_read_kb":513,"num_write":241,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'245","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.653908+0000","last_change":"2024-09-12T17:40:18.769528+0000","last_active":"2024-09-12T18:57:42.653908+0000","last_peered":"2024-09-12T18:57:42.653908+0000","last_clean":"2024-09-12T18:57:42.653908+0000","last_became_active":"2024-09-12T17:40:18.768544+0000","last_became_peered":"2024-09-12T17:40:18.768544+0000","last_unstale":"2024-09-12T18:57:42.653908+0000","last_undegraded":"2024-09-12T18:57:42.653908+0000","last_fullsized":"2024-09-12T18:57:42.653908+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:48.979420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23471,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":360,"num_read_kb":64899,"num_write":862,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.461730+0000","last_change":"2024-09-12T17:40:11.682969+0000","last_active":"2024-09-12T18:57:17.461730+0000","last_peered":"2024-09-12T18:57:17.461730+0000","last_clean":"2024-09-12T18:57:17.461730+0000","last_became_active":"2024-09-12T17:40:09.770645+0000","last_became_peered":"2024-09-12T17:40:09.770645+0000","last_unstale":"2024-09-12T18:57:17.461730+0000","last_undegraded":"2024-09-12T18:57:17.461730+0000","last_fullsized":"2024-09-12T18:57:17.461730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:00.566138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091158000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473305+0000","last_change":"2024-09-12T17:40:22.136717+0000","last_active":"2024-09-12T18:57:27.473305+0000","last_peered":"2024-09-12T18:57:27.473305+0000","last_clean":"2024-09-12T18:57:27.473305+0000","last_became_active":"2024-09-12T17:40:22.136155+0000","last_became_peered":"2024-09-12T17:40:22.136155+0000","last_unstale":"2024-09-12T18:57:27.473305+0000","last_undegraded":"2024-09-12T18:57:27.473305+0000","last_fullsized":"2024-09-12T18:57:27.473305+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:23.121643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'641","reported_seq":1327,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.688030+0000","last_change":"2024-09-12T17:40:24.174815+0000","last_active":"2024-09-12T18:59:27.688030+0000","last_peered":"2024-09-12T18:59:27.688030+0000","last_clean":"2024-09-12T18:59:27.688030+0000","last_became_active":"2024-09-12T17:40:24.173380+0000","last_became_peered":"2024-09-12T17:40:24.173380+0000","last_unstale":"2024-09-12T18:59:27.688030+0000","last_undegraded":"2024-09-12T18:59:27.688030+0000","last_fullsized":"2024-09-12T18:59:27.688030+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:43.915482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128155,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1676,"num_read_kb":2774,"num_write":2188,"num_write_kb":2016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821238+0000","last_change":"2024-09-12T17:40:26.192118+0000","last_active":"2024-09-12T18:57:32.821238+0000","last_peered":"2024-09-12T18:57:32.821238+0000","last_clean":"2024-09-12T18:57:32.821238+0000","last_became_active":"2024-09-12T17:40:26.191417+0000","last_became_peered":"2024-09-12T17:40:26.191417+0000","last_unstale":"2024-09-12T18:57:32.821238+0000","last_undegraded":"2024-09-12T18:57:32.821238+0000","last_fullsized":"2024-09-12T18:57:32.821238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:38.892952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'174","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.340189+0000","last_change":"2024-09-12T17:40:28.187802+0000","last_active":"2024-09-12T18:58:06.340189+0000","last_peered":"2024-09-12T18:58:06.340189+0000","last_clean":"2024-09-12T18:58:06.340189+0000","last_became_active":"2024-09-12T17:40:28.186922+0000","last_became_peered":"2024-09-12T17:40:28.186922+0000","last_unstale":"2024-09-12T18:58:06.340189+0000","last_undegraded":"2024-09-12T18:58:06.340189+0000","last_fullsized":"2024-09-12T18:58:06.340189+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.041023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'143","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473328+0000","last_change":"2024-09-12T17:40:20.112762+0000","last_active":"2024-09-12T18:57:27.473328+0000","last_peered":"2024-09-12T18:57:27.473328+0000","last_clean":"2024-09-12T18:57:27.473328+0000","last_became_active":"2024-09-12T17:40:20.112490+0000","last_became_peered":"2024-09-12T17:40:20.112490+0000","last_unstale":"2024-09-12T18:57:27.473328+0000","last_undegraded":"2024-09-12T18:57:27.473328+0000","last_fullsized":"2024-09-12T18:57:27.473328+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:36.390829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":606,"num_read_kb":504,"num_write":208,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'243","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464086+0000","last_change":"2024-09-12T17:40:18.760773+0000","last_active":"2024-09-12T18:57:27.464086+0000","last_peered":"2024-09-12T18:57:27.464086+0000","last_clean":"2024-09-12T18:57:27.464086+0000","last_became_active":"2024-09-12T17:40:18.760130+0000","last_became_peered":"2024-09-12T17:40:18.760130+0000","last_unstale":"2024-09-12T18:57:27.464086+0000","last_undegraded":"2024-09-12T18:57:27.464086+0000","last_fullsized":"2024-09-12T18:57:27.464086+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:54.991344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2431354,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":360,"num_read_kb":2116,"num_write":864,"num_write_kb":13193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.458586+0000","last_change":"2024-09-12T17:40:11.747892+0000","last_active":"2024-09-12T18:57:32.458586+0000","last_peered":"2024-09-12T18:57:32.458586+0000","last_clean":"2024-09-12T18:57:32.458586+0000","last_became_active":"2024-09-12T17:40:09.770504+0000","last_became_peered":"2024-09-12T17:40:09.770504+0000","last_unstale":"2024-09-12T18:57:32.458586+0000","last_undegraded":"2024-09-12T18:57:32.458586+0000","last_fullsized":"2024-09-12T18:57:32.458586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:45.742830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001093257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443134+0000","last_change":"2024-09-12T17:40:22.136820+0000","last_active":"2024-09-12T18:57:27.443134+0000","last_peered":"2024-09-12T18:57:27.443134+0000","last_clean":"2024-09-12T18:57:27.443134+0000","last_became_active":"2024-09-12T17:40:22.136095+0000","last_became_peered":"2024-09-12T17:40:22.136095+0000","last_unstale":"2024-09-12T18:57:27.443134+0000","last_undegraded":"2024-09-12T18:57:27.443134+0000","last_fullsized":"2024-09-12T18:57:27.443134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:59.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'255","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:25.949567+0000","last_change":"2024-09-12T17:40:24.333148+0000","last_active":"2024-09-12T18:58:25.949567+0000","last_peered":"2024-09-12T18:58:25.949567+0000","last_clean":"2024-09-12T18:58:25.949567+0000","last_became_active":"2024-09-12T17:40:24.332477+0000","last_became_peered":"2024-09-12T17:40:24.332477+0000","last_unstale":"2024-09-12T18:58:25.949567+0000","last_undegraded":"2024-09-12T18:58:25.949567+0000","last_fullsized":"2024-09-12T18:58:25.949567+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:09.053613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":296,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'755","reported_seq":3092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.818273+0000","last_change":"2024-09-12T17:40:26.180479+0000","last_active":"2024-09-12T18:59:30.818273+0000","last_peered":"2024-09-12T18:59:30.818273+0000","last_clean":"2024-09-12T18:59:30.818273+0000","last_became_active":"2024-09-12T17:40:26.179728+0000","last_became_peered":"2024-09-12T17:40:26.179728+0000","last_unstale":"2024-09-12T18:59:30.818273+0000","last_undegraded":"2024-09-12T18:59:30.818273+0000","last_fullsized":"2024-09-12T18:59:30.818273+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:15.964800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'144","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.754378+0000","last_change":"2024-09-12T17:40:28.202506+0000","last_active":"2024-09-12T18:59:27.754378+0000","last_peered":"2024-09-12T18:59:27.754378+0000","last_clean":"2024-09-12T18:59:27.754378+0000","last_became_active":"2024-09-12T17:40:28.201571+0000","last_became_peered":"2024-09-12T17:40:28.201571+0000","last_unstale":"2024-09-12T18:59:27.754378+0000","last_undegraded":"2024-09-12T18:59:27.754378+0000","last_fullsized":"2024-09-12T18:59:27.754378+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:40.742392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":253,"num_write":364,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'450","reported_seq":1163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446531+0000","last_change":"2024-09-12T17:40:20.136291+0000","last_active":"2024-09-12T18:56:42.446531+0000","last_peered":"2024-09-12T18:56:42.446531+0000","last_clean":"2024-09-12T18:56:42.446531+0000","last_became_active":"2024-09-12T17:40:20.135950+0000","last_became_peered":"2024-09-12T17:40:20.135950+0000","last_unstale":"2024-09-12T18:56:42.446531+0000","last_undegraded":"2024-09-12T18:56:42.446531+0000","last_fullsized":"2024-09-12T18:56:42.446531+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:02.260304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1875,"num_read_kb":1500,"num_write":660,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'263","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439422+0000","last_change":"2024-09-12T17:40:18.762841+0000","last_active":"2024-09-12T18:56:12.439422+0000","last_peered":"2024-09-12T18:56:12.439422+0000","last_clean":"2024-09-12T18:56:12.439422+0000","last_became_active":"2024-09-12T17:40:18.762324+0000","last_became_peered":"2024-09-12T17:40:18.762324+0000","last_unstale":"2024-09-12T18:56:12.439422+0000","last_undegraded":"2024-09-12T18:56:12.439422+0000","last_fullsized":"2024-09-12T18:56:12.439422+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:21.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13971098,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":434,"num_read_kb":85957,"num_write":956,"num_write_kb":37704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.445258+0000","last_change":"2024-09-12T17:40:11.683217+0000","last_active":"2024-09-12T18:56:02.445258+0000","last_peered":"2024-09-12T18:56:02.445258+0000","last_clean":"2024-09-12T18:56:02.445258+0000","last_became_active":"2024-09-12T17:40:09.671019+0000","last_became_peered":"2024-09-12T17:40:09.671019+0000","last_unstale":"2024-09-12T18:56:02.445258+0000","last_undegraded":"2024-09-12T18:56:02.445258+0000","last_fullsized":"2024-09-12T18:56:02.445258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:29.653884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096571,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820072+0000","last_change":"2024-09-12T17:40:22.146908+0000","last_active":"2024-09-12T18:57:27.820072+0000","last_peered":"2024-09-12T18:57:27.820072+0000","last_clean":"2024-09-12T18:57:27.820072+0000","last_became_active":"2024-09-12T17:40:22.146131+0000","last_became_peered":"2024-09-12T17:40:22.146131+0000","last_unstale":"2024-09-12T18:57:27.820072+0000","last_undegraded":"2024-09-12T18:57:27.820072+0000","last_fullsized":"2024-09-12T18:57:27.820072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:43.916632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'135","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821299+0000","last_change":"2024-09-12T17:40:24.165118+0000","last_active":"2024-09-12T18:57:32.821299+0000","last_peered":"2024-09-12T18:57:32.821299+0000","last_clean":"2024-09-12T18:57:32.821299+0000","last_became_active":"2024-09-12T17:40:24.163566+0000","last_became_peered":"2024-09-12T17:40:24.163566+0000","last_unstale":"2024-09-12T18:57:32.821299+0000","last_undegraded":"2024-09-12T18:57:32.821299+0000","last_fullsized":"2024-09-12T18:57:32.821299+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.865870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'783","reported_seq":2820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:31.415589+0000","last_change":"2024-09-12T17:40:26.195048+0000","last_active":"2024-09-12T18:59:31.415589+0000","last_peered":"2024-09-12T18:59:31.415589+0000","last_clean":"2024-09-12T18:59:31.415589+0000","last_became_active":"2024-09-12T17:40:26.194293+0000","last_became_peered":"2024-09-12T17:40:26.194293+0000","last_unstale":"2024-09-12T18:59:31.415589+0000","last_undegraded":"2024-09-12T18:59:31.415589+0000","last_fullsized":"2024-09-12T18:59:31.415589+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:29.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'199","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.466585+0000","last_change":"2024-09-12T17:40:28.207712+0000","last_active":"2024-09-12T18:56:57.466585+0000","last_peered":"2024-09-12T18:56:57.466585+0000","last_clean":"2024-09-12T18:56:57.466585+0000","last_became_active":"2024-09-12T17:40:28.207048+0000","last_became_peered":"2024-09-12T17:40:28.207048+0000","last_unstale":"2024-09-12T18:56:57.466585+0000","last_undegraded":"2024-09-12T18:56:57.466585+0000","last_fullsized":"2024-09-12T18:56:57.466585+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:43.200882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":318,"num_write":457,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'86","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820038+0000","last_change":"2024-09-12T17:40:20.143011+0000","last_active":"2024-09-12T18:57:27.820038+0000","last_peered":"2024-09-12T18:57:27.820038+0000","last_clean":"2024-09-12T18:57:27.820038+0000","last_became_active":"2024-09-12T17:40:20.142323+0000","last_became_peered":"2024-09-12T17:40:20.142323+0000","last_unstale":"2024-09-12T18:57:27.820038+0000","last_undegraded":"2024-09-12T18:57:27.820038+0000","last_fullsized":"2024-09-12T18:57:27.820038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:05.353429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":391,"num_read_kb":327,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'354","reported_seq":1135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:41.610134+0000","last_change":"2024-09-12T17:40:18.767413+0000","last_active":"2024-09-12T18:56:41.610134+0000","last_peered":"2024-09-12T18:56:41.610134+0000","last_clean":"2024-09-12T18:56:41.610134+0000","last_became_active":"2024-09-12T17:40:18.766817+0000","last_became_peered":"2024-09-12T17:40:18.766817+0000","last_unstale":"2024-09-12T18:56:41.610134+0000","last_undegraded":"2024-09-12T18:56:41.610134+0000","last_fullsized":"2024-09-12T18:56:41.610134+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:50.259112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11303299,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":878,"num_read_kb":8527,"num_write":1293,"num_write_kb":43864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.425422+0000","last_change":"2024-09-12T17:40:11.748529+0000","last_active":"2024-09-12T18:56:02.425422+0000","last_peered":"2024-09-12T18:56:02.425422+0000","last_clean":"2024-09-12T18:56:02.425422+0000","last_became_active":"2024-09-12T17:40:09.674331+0000","last_became_peered":"2024-09-12T17:40:09.674331+0000","last_unstale":"2024-09-12T18:56:02.425422+0000","last_undegraded":"2024-09-12T18:56:02.425422+0000","last_fullsized":"2024-09-12T18:56:02.425422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:20.063434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446575+0000","last_change":"2024-09-12T17:40:22.147841+0000","last_active":"2024-09-12T18:56:42.446575+0000","last_peered":"2024-09-12T18:56:42.446575+0000","last_clean":"2024-09-12T18:56:42.446575+0000","last_became_active":"2024-09-12T17:40:22.147341+0000","last_became_peered":"2024-09-12T17:40:22.147341+0000","last_unstale":"2024-09-12T18:56:42.446575+0000","last_undegraded":"2024-09-12T18:56:42.446575+0000","last_fullsized":"2024-09-12T18:56:42.446575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:33.825775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'774","reported_seq":1504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.694672+0000","last_change":"2024-09-12T17:40:24.330059+0000","last_active":"2024-09-12T18:59:27.694672+0000","last_peered":"2024-09-12T18:59:27.694672+0000","last_clean":"2024-09-12T18:59:27.694672+0000","last_became_active":"2024-09-12T17:40:24.329314+0000","last_became_peered":"2024-09-12T17:40:24.329314+0000","last_unstale":"2024-09-12T18:59:27.694672+0000","last_undegraded":"2024-09-12T18:59:27.694672+0000","last_fullsized":"2024-09-12T18:59:27.694672+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:42.536254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178451,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1364,"num_read_kb":2999,"num_write":1126,"num_write_kb":919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.458785+0000","last_change":"2024-09-12T17:40:26.199233+0000","last_active":"2024-09-12T18:57:32.458785+0000","last_peered":"2024-09-12T18:57:32.458785+0000","last_clean":"2024-09-12T18:57:32.458785+0000","last_became_active":"2024-09-12T17:40:26.197718+0000","last_became_peered":"2024-09-12T17:40:26.197718+0000","last_unstale":"2024-09-12T18:57:32.458785+0000","last_undegraded":"2024-09-12T18:57:32.458785+0000","last_fullsized":"2024-09-12T18:57:32.458785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:57.822527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'117","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.632901+0000","last_change":"2024-09-12T17:40:28.199911+0000","last_active":"2024-09-12T18:56:57.632901+0000","last_peered":"2024-09-12T18:56:57.632901+0000","last_clean":"2024-09-12T18:56:57.632901+0000","last_became_active":"2024-09-12T17:40:28.199295+0000","last_became_peered":"2024-09-12T17:40:28.199295+0000","last_unstale":"2024-09-12T18:56:57.632901+0000","last_undegraded":"2024-09-12T18:56:57.632901+0000","last_fullsized":"2024-09-12T18:56:57.632901+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:22.472810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":147,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'106","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.518640+0000","last_change":"2024-09-12T17:40:28.192741+0000","last_active":"2024-09-12T18:58:06.518640+0000","last_peered":"2024-09-12T18:58:06.518640+0000","last_clean":"2024-09-12T18:58:06.518640+0000","last_became_active":"2024-09-12T17:40:28.192019+0000","last_became_peered":"2024-09-12T17:40:28.192019+0000","last_unstale":"2024-09-12T18:58:06.518640+0000","last_undegraded":"2024-09-12T18:58:06.518640+0000","last_fullsized":"2024-09-12T18:58:06.518640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:03.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":192,"num_write":225,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'111","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.818982+0000","last_change":"2024-09-12T17:40:20.136571+0000","last_active":"2024-09-12T18:57:22.818982+0000","last_peered":"2024-09-12T18:57:22.818982+0000","last_clean":"2024-09-12T18:57:22.818982+0000","last_became_active":"2024-09-12T17:40:20.135868+0000","last_became_peered":"2024-09-12T17:40:20.135868+0000","last_unstale":"2024-09-12T18:57:22.818982+0000","last_undegraded":"2024-09-12T18:57:22.818982+0000","last_fullsized":"2024-09-12T18:57:22.818982+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:37.134752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":445,"num_write":160,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'223","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821377+0000","last_change":"2024-09-12T17:40:18.789847+0000","last_active":"2024-09-12T18:57:32.821377+0000","last_peered":"2024-09-12T18:57:32.821377+0000","last_clean":"2024-09-12T18:57:32.821377+0000","last_became_active":"2024-09-12T17:40:18.788674+0000","last_became_peered":"2024-09-12T17:40:18.788674+0000","last_unstale":"2024-09-12T18:57:32.821377+0000","last_undegraded":"2024-09-12T18:57:32.821377+0000","last_fullsized":"2024-09-12T18:57:32.821377+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:37.689644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6387521,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":354,"num_read_kb":10615,"num_write":846,"num_write_kb":14901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.462809+0000","last_change":"2024-09-12T17:40:22.141831+0000","last_active":"2024-09-12T18:57:22.462809+0000","last_peered":"2024-09-12T18:57:22.462809+0000","last_clean":"2024-09-12T18:57:22.462809+0000","last_became_active":"2024-09-12T17:40:22.141326+0000","last_became_peered":"2024-09-12T17:40:22.141326+0000","last_unstale":"2024-09-12T18:57:22.462809+0000","last_undegraded":"2024-09-12T18:57:22.462809+0000","last_fullsized":"2024-09-12T18:57:22.462809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:09.004014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'299","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.713756+0000","last_change":"2024-09-12T17:40:24.171008+0000","last_active":"2024-09-12T18:59:27.713756+0000","last_peered":"2024-09-12T18:59:27.713756+0000","last_clean":"2024-09-12T18:59:27.713756+0000","last_became_active":"2024-09-12T17:40:24.169248+0000","last_became_peered":"2024-09-12T17:40:24.169248+0000","last_unstale":"2024-09-12T18:59:27.713756+0000","last_undegraded":"2024-09-12T18:59:27.713756+0000","last_fullsized":"2024-09-12T18:59:27.713756+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:18.401232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60948,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":1072,"num_write":414,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457958+0000","last_change":"2024-09-12T17:40:26.204596+0000","last_active":"2024-09-12T18:57:27.457958+0000","last_peered":"2024-09-12T18:57:27.457958+0000","last_clean":"2024-09-12T18:57:27.457958+0000","last_became_active":"2024-09-12T17:40:26.203855+0000","last_became_peered":"2024-09-12T17:40:26.203855+0000","last_unstale":"2024-09-12T18:57:27.457958+0000","last_undegraded":"2024-09-12T18:57:27.457958+0000","last_fullsized":"2024-09-12T18:57:27.457958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:26.029987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.597637+0000","last_change":"2024-09-12T17:40:28.205116+0000","last_active":"2024-09-12T18:57:32.597637+0000","last_peered":"2024-09-12T18:57:32.597637+0000","last_clean":"2024-09-12T18:57:32.597637+0000","last_became_active":"2024-09-12T17:40:28.204204+0000","last_became_peered":"2024-09-12T17:40:28.204204+0000","last_unstale":"2024-09-12T18:57:32.597637+0000","last_undegraded":"2024-09-12T18:57:32.597637+0000","last_fullsized":"2024-09-12T18:57:32.597637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:13.281028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":252,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'238","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.462857+0000","last_change":"2024-09-12T17:40:20.128888+0000","last_active":"2024-09-12T18:57:22.462857+0000","last_peered":"2024-09-12T18:57:22.462857+0000","last_clean":"2024-09-12T18:57:22.462857+0000","last_became_active":"2024-09-12T17:40:20.128532+0000","last_became_peered":"2024-09-12T17:40:20.128532+0000","last_unstale":"2024-09-12T18:57:22.462857+0000","last_undegraded":"2024-09-12T18:57:22.462857+0000","last_fullsized":"2024-09-12T18:57:22.462857+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:10.062006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":846,"num_write":360,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'325","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:23.456540+0000","last_change":"2024-09-12T17:40:55.306539+0000","last_active":"2024-09-12T18:57:23.456540+0000","last_peered":"2024-09-12T18:57:23.456540+0000","last_clean":"2024-09-12T18:57:23.456540+0000","last_became_active":"2024-09-12T17:40:55.305689+0000","last_became_peered":"2024-09-12T17:40:55.305689+0000","last_unstale":"2024-09-12T18:57:23.456540+0000","last_undegraded":"2024-09-12T18:57:23.456540+0000","last_fullsized":"2024-09-12T18:57:23.456540+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:55.468206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17849249,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":566,"num_read_kb":44915,"num_write":1234,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.457130+0000","last_change":"2024-09-12T17:40:22.143900+0000","last_active":"2024-09-12T18:57:22.457130+0000","last_peered":"2024-09-12T18:57:22.457130+0000","last_clean":"2024-09-12T18:57:22.457130+0000","last_became_active":"2024-09-12T17:40:22.143466+0000","last_became_peered":"2024-09-12T17:40:22.143466+0000","last_unstale":"2024-09-12T18:57:22.457130+0000","last_undegraded":"2024-09-12T18:57:22.457130+0000","last_fullsized":"2024-09-12T18:57:22.457130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:12.032718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'61","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473152+0000","last_change":"2024-09-12T17:40:24.152265+0000","last_active":"2024-09-12T18:57:27.473152+0000","last_peered":"2024-09-12T18:57:27.473152+0000","last_clean":"2024-09-12T18:57:27.473152+0000","last_became_active":"2024-09-12T17:40:24.151530+0000","last_became_peered":"2024-09-12T17:40:24.151530+0000","last_unstale":"2024-09-12T18:57:27.473152+0000","last_undegraded":"2024-09-12T18:57:27.473152+0000","last_fullsized":"2024-09-12T18:57:27.473152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:13.980036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457196+0000","last_change":"2024-09-12T17:40:26.187903+0000","last_active":"2024-09-12T18:57:27.457196+0000","last_peered":"2024-09-12T18:57:27.457196+0000","last_clean":"2024-09-12T18:57:27.457196+0000","last_became_active":"2024-09-12T17:40:26.187122+0000","last_became_peered":"2024-09-12T17:40:26.187122+0000","last_unstale":"2024-09-12T18:57:27.457196+0000","last_undegraded":"2024-09-12T18:57:27.457196+0000","last_fullsized":"2024-09-12T18:57:27.457196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:36.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'248","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.372703+0000","last_change":"2024-09-12T17:40:28.194923+0000","last_active":"2024-09-12T18:58:04.372703+0000","last_peered":"2024-09-12T18:58:04.372703+0000","last_clean":"2024-09-12T18:58:04.372703+0000","last_became_active":"2024-09-12T17:40:28.194047+0000","last_became_peered":"2024-09-12T17:40:28.194047+0000","last_unstale":"2024-09-12T18:58:04.372703+0000","last_undegraded":"2024-09-12T18:58:04.372703+0000","last_fullsized":"2024-09-12T18:58:04.372703+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:44.148991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":352,"num_write":540,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'120","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.457021+0000","last_change":"2024-09-12T17:40:20.130891+0000","last_active":"2024-09-12T18:57:22.457021+0000","last_peered":"2024-09-12T18:57:22.457021+0000","last_clean":"2024-09-12T18:57:22.457021+0000","last_became_active":"2024-09-12T17:40:20.130567+0000","last_became_peered":"2024-09-12T17:40:20.130567+0000","last_unstale":"2024-09-12T18:57:22.457021+0000","last_undegraded":"2024-09-12T18:57:22.457021+0000","last_fullsized":"2024-09-12T18:57:22.457021+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:59.283457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":440,"num_write":198,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'320","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:18.554738+0000","last_change":"2024-09-12T17:40:18.781889+0000","last_active":"2024-09-12T18:56:18.554738+0000","last_peered":"2024-09-12T18:56:18.554738+0000","last_clean":"2024-09-12T18:56:18.554738+0000","last_became_active":"2024-09-12T17:40:18.781135+0000","last_became_peered":"2024-09-12T17:40:18.781135+0000","last_unstale":"2024-09-12T18:56:18.554738+0000","last_undegraded":"2024-09-12T18:56:18.554738+0000","last_fullsized":"2024-09-12T18:56:18.554738+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:39.897090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10870011,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":603,"num_read_kb":11926,"num_write":1125,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456026+0000","last_change":"2024-09-12T17:40:22.151655+0000","last_active":"2024-09-12T18:57:22.456026+0000","last_peered":"2024-09-12T18:57:22.456026+0000","last_clean":"2024-09-12T18:57:22.456026+0000","last_became_active":"2024-09-12T17:40:22.150912+0000","last_became_peered":"2024-09-12T17:40:22.150912+0000","last_unstale":"2024-09-12T18:57:22.456026+0000","last_undegraded":"2024-09-12T18:57:22.456026+0000","last_fullsized":"2024-09-12T18:57:22.456026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:49.335095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'337","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.682727+0000","last_change":"2024-09-12T17:40:24.177728+0000","last_active":"2024-09-12T18:59:27.682727+0000","last_peered":"2024-09-12T18:59:27.682727+0000","last_clean":"2024-09-12T18:59:27.682727+0000","last_became_active":"2024-09-12T17:40:24.176722+0000","last_became_peered":"2024-09-12T17:40:24.176722+0000","last_unstale":"2024-09-12T18:59:27.682727+0000","last_undegraded":"2024-09-12T18:59:27.682727+0000","last_fullsized":"2024-09-12T18:59:27.682727+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.865870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62937,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1095,"num_write":436,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443157+0000","last_change":"2024-09-12T17:40:26.168192+0000","last_active":"2024-09-12T18:57:27.443157+0000","last_peered":"2024-09-12T18:57:27.443157+0000","last_clean":"2024-09-12T18:57:27.443157+0000","last_became_active":"2024-09-12T17:40:26.167280+0000","last_became_peered":"2024-09-12T17:40:26.167280+0000","last_unstale":"2024-09-12T18:57:27.443157+0000","last_undegraded":"2024-09-12T18:57:27.443157+0000","last_fullsized":"2024-09-12T18:57:27.443157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:03.370653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'106","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.559076+0000","last_change":"2024-09-12T17:40:28.194951+0000","last_active":"2024-09-12T18:58:04.559076+0000","last_peered":"2024-09-12T18:58:04.559076+0000","last_clean":"2024-09-12T18:58:04.559076+0000","last_became_active":"2024-09-12T17:40:28.192629+0000","last_became_peered":"2024-09-12T17:40:28.192629+0000","last_unstale":"2024-09-12T18:58:04.559076+0000","last_undegraded":"2024-09-12T18:58:04.559076+0000","last_fullsized":"2024-09-12T18:58:04.559076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:40.252151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456946+0000","last_change":"2024-09-12T17:40:55.302689+0000","last_active":"2024-09-12T18:57:22.456946+0000","last_peered":"2024-09-12T18:57:22.456946+0000","last_clean":"2024-09-12T18:57:22.456946+0000","last_became_active":"2024-09-12T17:40:55.301950+0000","last_became_peered":"2024-09-12T17:40:55.301950+0000","last_unstale":"2024-09-12T18:57:22.456946+0000","last_undegraded":"2024-09-12T18:57:22.456946+0000","last_fullsized":"2024-09-12T18:57:22.456946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.652662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":400,"num_write":158,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'323","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:19.308683+0000","last_change":"2024-09-12T17:40:18.755957+0000","last_active":"2024-09-12T18:59:19.308683+0000","last_peered":"2024-09-12T18:59:19.308683+0000","last_clean":"2024-09-12T18:59:19.308683+0000","last_became_active":"2024-09-12T17:40:18.755694+0000","last_became_peered":"2024-09-12T17:40:18.755694+0000","last_unstale":"2024-09-12T18:59:19.308683+0000","last_undegraded":"2024-09-12T18:59:19.308683+0000","last_fullsized":"2024-09-12T18:59:19.308683+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:08.561309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14056521,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":484,"num_read_kb":35553,"num_write":1195,"num_write_kb":53517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.442028+0000","last_change":"2024-09-12T17:40:22.136120+0000","last_active":"2024-09-12T18:57:22.442028+0000","last_peered":"2024-09-12T18:57:22.442028+0000","last_clean":"2024-09-12T18:57:22.442028+0000","last_became_active":"2024-09-12T17:40:22.135547+0000","last_became_peered":"2024-09-12T17:40:22.135547+0000","last_unstale":"2024-09-12T18:57:22.442028+0000","last_undegraded":"2024-09-12T18:57:22.442028+0000","last_fullsized":"2024-09-12T18:57:22.442028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:28.203301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'304","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.672666+0000","last_change":"2024-09-12T17:40:24.163735+0000","last_active":"2024-09-12T18:59:27.672666+0000","last_peered":"2024-09-12T18:59:27.672666+0000","last_clean":"2024-09-12T18:59:27.672666+0000","last_became_active":"2024-09-12T17:40:24.162901+0000","last_became_peered":"2024-09-12T17:40:24.162901+0000","last_unstale":"2024-09-12T18:59:27.672666+0000","last_undegraded":"2024-09-12T18:59:27.672666+0000","last_fullsized":"2024-09-12T18:59:27.672666+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:08.268660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66249,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":495,"num_read_kb":1080,"num_write":410,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473259+0000","last_change":"2024-09-12T17:40:26.191520+0000","last_active":"2024-09-12T18:57:27.473259+0000","last_peered":"2024-09-12T18:57:27.473259+0000","last_clean":"2024-09-12T18:57:27.473259+0000","last_became_active":"2024-09-12T17:40:26.190755+0000","last_became_peered":"2024-09-12T17:40:26.190755+0000","last_unstale":"2024-09-12T18:57:27.473259+0000","last_undegraded":"2024-09-12T18:57:27.473259+0000","last_fullsized":"2024-09-12T18:57:27.473259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:00.734100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'428","reported_seq":1192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443251+0000","last_change":"2024-09-12T17:40:20.128385+0000","last_active":"2024-09-12T18:57:27.443251+0000","last_peered":"2024-09-12T18:57:27.443251+0000","last_clean":"2024-09-12T18:57:27.443251+0000","last_became_active":"2024-09-12T17:40:20.127413+0000","last_became_peered":"2024-09-12T17:40:20.127413+0000","last_unstale":"2024-09-12T18:57:27.443251+0000","last_undegraded":"2024-09-12T18:57:27.443251+0000","last_fullsized":"2024-09-12T18:57:27.443251+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:36.669281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2096,"num_read_kb":1807,"num_write":754,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'282","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:34.458382+0000","last_change":"2024-09-12T17:40:18.759774+0000","last_active":"2024-09-12T18:55:34.458382+0000","last_peered":"2024-09-12T18:55:34.458382+0000","last_clean":"2024-09-12T18:55:34.458382+0000","last_became_active":"2024-09-12T17:40:18.759467+0000","last_became_peered":"2024-09-12T17:40:18.759467+0000","last_unstale":"2024-09-12T18:55:34.458382+0000","last_undegraded":"2024-09-12T18:55:34.458382+0000","last_fullsized":"2024-09-12T18:55:34.458382+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:33.483800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8811196,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":453,"num_read_kb":67738,"num_write":1036,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.462225+0000","last_change":"2024-09-12T17:40:22.144503+0000","last_active":"2024-09-12T18:56:37.462225+0000","last_peered":"2024-09-12T18:56:37.462225+0000","last_clean":"2024-09-12T18:56:37.462225+0000","last_became_active":"2024-09-12T17:40:22.143764+0000","last_became_peered":"2024-09-12T17:40:22.143764+0000","last_unstale":"2024-09-12T18:56:37.462225+0000","last_undegraded":"2024-09-12T18:56:37.462225+0000","last_fullsized":"2024-09-12T18:56:37.462225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:07.658407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'529","reported_seq":1166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.671468+0000","last_change":"2024-09-12T17:40:24.179162+0000","last_active":"2024-09-12T18:59:27.671468+0000","last_peered":"2024-09-12T18:59:27.671468+0000","last_clean":"2024-09-12T18:59:27.671468+0000","last_became_active":"2024-09-12T17:40:24.178354+0000","last_became_peered":"2024-09-12T17:40:24.178354+0000","last_unstale":"2024-09-12T18:59:27.671468+0000","last_undegraded":"2024-09-12T18:59:27.671468+0000","last_fullsized":"2024-09-12T18:59:27.671468+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:39.728053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138484,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":927,"num_read_kb":2071,"num_write":814,"num_write_kb":738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.612487+0000","last_change":"2024-09-12T17:40:26.185364+0000","last_active":"2024-09-12T18:55:27.612487+0000","last_peered":"2024-09-12T18:55:27.612487+0000","last_clean":"2024-09-12T18:55:27.612487+0000","last_became_active":"2024-09-12T17:40:26.184572+0000","last_became_peered":"2024-09-12T17:40:26.184572+0000","last_unstale":"2024-09-12T18:55:27.612487+0000","last_undegraded":"2024-09-12T18:55:27.612487+0000","last_fullsized":"2024-09-12T18:55:27.612487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:35.867018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'243","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:05.971764+0000","last_change":"2024-09-12T17:40:28.201022+0000","last_active":"2024-09-12T18:58:05.971764+0000","last_peered":"2024-09-12T18:58:05.971764+0000","last_clean":"2024-09-12T18:58:05.971764+0000","last_became_active":"2024-09-12T17:40:28.200289+0000","last_became_peered":"2024-09-12T17:40:28.200289+0000","last_unstale":"2024-09-12T18:58:05.971764+0000","last_undegraded":"2024-09-12T18:58:05.971764+0000","last_fullsized":"2024-09-12T18:58:05.971764+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:57.750960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":402,"num_read_kb":380,"num_write":484,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'278","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.462201+0000","last_change":"2024-09-12T17:40:20.129095+0000","last_active":"2024-09-12T18:56:37.462201+0000","last_peered":"2024-09-12T18:56:37.462201+0000","last_clean":"2024-09-12T18:56:37.462201+0000","last_became_active":"2024-09-12T17:40:20.128840+0000","last_became_peered":"2024-09-12T17:40:20.128840+0000","last_unstale":"2024-09-12T18:56:37.462201+0000","last_undegraded":"2024-09-12T18:56:37.462201+0000","last_fullsized":"2024-09-12T18:56:37.462201+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:40.313847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1419,"num_read_kb":1187,"num_write":525,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'241","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.108435+0000","last_change":"2024-09-12T17:40:18.763123+0000","last_active":"2024-09-12T18:57:45.108435+0000","last_peered":"2024-09-12T18:57:45.108435+0000","last_clean":"2024-09-12T18:57:45.108435+0000","last_became_active":"2024-09-12T17:40:18.762421+0000","last_became_peered":"2024-09-12T17:40:18.762421+0000","last_unstale":"2024-09-12T18:57:45.108435+0000","last_undegraded":"2024-09-12T18:57:45.108435+0000","last_fullsized":"2024-09-12T18:57:45.108435+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:57.212684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4246739,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":369,"num_read_kb":9963,"num_write":906,"num_write_kb":16756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443274+0000","last_change":"2024-09-12T17:40:22.134660+0000","last_active":"2024-09-12T18:57:27.443274+0000","last_peered":"2024-09-12T18:57:27.443274+0000","last_clean":"2024-09-12T18:57:27.443274+0000","last_became_active":"2024-09-12T17:40:22.133919+0000","last_became_peered":"2024-09-12T17:40:22.133919+0000","last_unstale":"2024-09-12T18:57:27.443274+0000","last_undegraded":"2024-09-12T18:57:27.443274+0000","last_fullsized":"2024-09-12T18:57:27.443274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:06.193287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'308","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464883+0000","last_change":"2024-09-12T17:40:24.168575+0000","last_active":"2024-09-12T18:57:57.464883+0000","last_peered":"2024-09-12T18:57:57.464883+0000","last_clean":"2024-09-12T18:57:57.464883+0000","last_became_active":"2024-09-12T17:40:24.167870+0000","last_became_peered":"2024-09-12T17:40:24.167870+0000","last_unstale":"2024-09-12T18:57:57.464883+0000","last_undegraded":"2024-09-12T18:57:57.464883+0000","last_fullsized":"2024-09-12T18:57:57.464883+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:06.921434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52491,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":980,"num_write":420,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.438227+0000","last_change":"2024-09-12T17:40:26.199740+0000","last_active":"2024-09-12T18:55:27.438227+0000","last_peered":"2024-09-12T18:55:27.438227+0000","last_clean":"2024-09-12T18:55:27.438227+0000","last_became_active":"2024-09-12T17:40:26.199065+0000","last_became_peered":"2024-09-12T17:40:26.199065+0000","last_unstale":"2024-09-12T18:55:27.438227+0000","last_undegraded":"2024-09-12T18:55:27.438227+0000","last_fullsized":"2024-09-12T18:55:27.438227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:29.279788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'184","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:00.492872+0000","last_change":"2024-09-12T17:40:28.193740+0000","last_active":"2024-09-12T18:58:00.492872+0000","last_peered":"2024-09-12T18:58:00.492872+0000","last_clean":"2024-09-12T18:58:00.492872+0000","last_became_active":"2024-09-12T17:40:28.192588+0000","last_became_peered":"2024-09-12T17:40:28.192588+0000","last_unstale":"2024-09-12T18:58:00.492872+0000","last_undegraded":"2024-09-12T18:58:00.492872+0000","last_fullsized":"2024-09-12T18:58:00.492872+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:35.257214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":737,"num_read_kb":706,"num_write":515,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'254","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:55.231898+0000","last_change":"2024-09-12T17:40:20.133443+0000","last_active":"2024-09-12T18:56:55.231898+0000","last_peered":"2024-09-12T18:56:55.231898+0000","last_clean":"2024-09-12T18:56:55.231898+0000","last_became_active":"2024-09-12T17:40:20.133067+0000","last_became_peered":"2024-09-12T17:40:20.133067+0000","last_unstale":"2024-09-12T18:56:55.231898+0000","last_undegraded":"2024-09-12T18:56:55.231898+0000","last_fullsized":"2024-09-12T18:56:55.231898+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:22.211007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1200,"num_read_kb":1015,"num_write":444,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'268","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.792878+0000","last_change":"2024-09-12T17:40:18.773839+0000","last_active":"2024-09-12T18:55:22.792878+0000","last_peered":"2024-09-12T18:55:22.792878+0000","last_clean":"2024-09-12T18:55:22.792878+0000","last_became_active":"2024-09-12T17:40:18.773029+0000","last_became_peered":"2024-09-12T17:40:18.773029+0000","last_unstale":"2024-09-12T18:55:22.792878+0000","last_undegraded":"2024-09-12T18:55:22.792878+0000","last_fullsized":"2024-09-12T18:55:22.792878+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:13.992637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10005600,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":353,"num_read_kb":38404,"num_write":1013,"num_write_kb":31393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793065+0000","last_change":"2024-09-12T17:40:22.146616+0000","last_active":"2024-09-12T18:55:22.793065+0000","last_peered":"2024-09-12T18:55:22.793065+0000","last_clean":"2024-09-12T18:55:22.793065+0000","last_became_active":"2024-09-12T17:40:22.145871+0000","last_became_peered":"2024-09-12T17:40:22.145871+0000","last_unstale":"2024-09-12T18:55:22.793065+0000","last_undegraded":"2024-09-12T18:55:22.793065+0000","last_fullsized":"2024-09-12T18:55:22.793065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:17.363777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'303","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.725748+0000","last_change":"2024-09-12T17:40:24.330122+0000","last_active":"2024-09-12T18:59:27.725748+0000","last_peered":"2024-09-12T18:59:27.725748+0000","last_clean":"2024-09-12T18:59:27.725748+0000","last_became_active":"2024-09-12T17:40:24.329413+0000","last_became_peered":"2024-09-12T17:40:24.329413+0000","last_unstale":"2024-09-12T18:59:27.725748+0000","last_undegraded":"2024-09-12T18:59:27.725748+0000","last_fullsized":"2024-09-12T18:59:27.725748+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:11.778689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60142,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":1065,"num_write":414,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.455205+0000","last_change":"2024-09-12T17:40:26.199588+0000","last_active":"2024-09-12T18:56:47.455205+0000","last_peered":"2024-09-12T18:56:47.455205+0000","last_clean":"2024-09-12T18:56:47.455205+0000","last_became_active":"2024-09-12T17:40:26.198930+0000","last_became_peered":"2024-09-12T17:40:26.198930+0000","last_unstale":"2024-09-12T18:56:47.455205+0000","last_undegraded":"2024-09-12T18:56:47.455205+0000","last_fullsized":"2024-09-12T18:56:47.455205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:48.763531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'117","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.763203+0000","last_change":"2024-09-12T17:40:28.194240+0000","last_active":"2024-09-12T18:59:27.763203+0000","last_peered":"2024-09-12T18:59:27.763203+0000","last_clean":"2024-09-12T18:59:27.763203+0000","last_became_active":"2024-09-12T17:40:28.192689+0000","last_became_peered":"2024-09-12T17:40:28.192689+0000","last_unstale":"2024-09-12T18:59:27.763203+0000","last_undegraded":"2024-09-12T18:59:27.763203+0000","last_fullsized":"2024-09-12T18:59:27.763203+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:53.085665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":258,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'197","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:19.424791+0000","last_change":"2024-09-12T17:40:20.133429+0000","last_active":"2024-09-12T18:55:19.424791+0000","last_peered":"2024-09-12T18:55:19.424791+0000","last_clean":"2024-09-12T18:55:19.424791+0000","last_became_active":"2024-09-12T17:40:20.132998+0000","last_became_peered":"2024-09-12T17:40:20.132998+0000","last_unstale":"2024-09-12T18:55:19.424791+0000","last_undegraded":"2024-09-12T18:55:19.424791+0000","last_fullsized":"2024-09-12T18:55:19.424791+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:53.514892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":791,"num_read_kb":641,"num_write":284,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'361","reported_seq":1104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.445890+0000","last_change":"2024-09-12T17:40:18.775765+0000","last_active":"2024-09-12T18:55:22.445890+0000","last_peered":"2024-09-12T18:55:22.445890+0000","last_clean":"2024-09-12T18:55:22.445890+0000","last_became_active":"2024-09-12T17:40:18.774892+0000","last_became_peered":"2024-09-12T17:40:18.774892+0000","last_unstale":"2024-09-12T18:55:22.445890+0000","last_undegraded":"2024-09-12T18:55:22.445890+0000","last_fullsized":"2024-09-12T18:55:22.445890+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:12.027391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15589393,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":658,"num_read_kb":87832,"num_write":1341,"num_write_kb":30285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.437110+0000","last_change":"2024-09-12T17:40:22.142115+0000","last_active":"2024-09-12T18:55:22.437110+0000","last_peered":"2024-09-12T18:55:22.437110+0000","last_clean":"2024-09-12T18:55:22.437110+0000","last_became_active":"2024-09-12T17:40:22.141670+0000","last_became_peered":"2024-09-12T17:40:22.141670+0000","last_unstale":"2024-09-12T18:55:22.437110+0000","last_undegraded":"2024-09-12T18:55:22.437110+0000","last_fullsized":"2024-09-12T18:55:22.437110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:01.417527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'131","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.809263+0000","last_change":"2024-09-12T17:40:24.330200+0000","last_active":"2024-09-12T18:56:37.809263+0000","last_peered":"2024-09-12T18:56:37.809263+0000","last_clean":"2024-09-12T18:56:37.809263+0000","last_became_active":"2024-09-12T17:40:24.329446+0000","last_became_peered":"2024-09-12T17:40:24.329446+0000","last_unstale":"2024-09-12T18:56:37.809263+0000","last_undegraded":"2024-09-12T18:56:37.809263+0000","last_fullsized":"2024-09-12T18:56:37.809263+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:39.604725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'750","reported_seq":4493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:31.363117+0000","last_change":"2024-09-12T17:40:26.193089+0000","last_active":"2024-09-12T18:59:31.363117+0000","last_peered":"2024-09-12T18:59:31.363117+0000","last_clean":"2024-09-12T18:59:31.363117+0000","last_became_active":"2024-09-12T17:40:26.192341+0000","last_became_peered":"2024-09-12T17:40:26.192341+0000","last_unstale":"2024-09-12T18:59:31.363117+0000","last_undegraded":"2024-09-12T18:59:31.363117+0000","last_fullsized":"2024-09-12T18:59:31.363117+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:04.649327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'116","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457136+0000","last_change":"2024-09-12T17:40:28.187817+0000","last_active":"2024-09-12T18:57:27.457136+0000","last_peered":"2024-09-12T18:57:27.457136+0000","last_clean":"2024-09-12T18:57:27.457136+0000","last_became_active":"2024-09-12T17:40:28.187089+0000","last_became_peered":"2024-09-12T17:40:28.187089+0000","last_unstale":"2024-09-12T18:57:27.457136+0000","last_undegraded":"2024-09-12T18:57:27.457136+0000","last_fullsized":"2024-09-12T18:57:27.457136+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:39.669386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'387","reported_seq":1131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.792997+0000","last_change":"2024-09-12T17:40:20.143118+0000","last_active":"2024-09-12T18:55:22.792997+0000","last_peered":"2024-09-12T18:55:22.792997+0000","last_clean":"2024-09-12T18:55:22.792997+0000","last_became_active":"2024-09-12T17:40:20.142478+0000","last_became_peered":"2024-09-12T17:40:20.142478+0000","last_unstale":"2024-09-12T18:55:22.792997+0000","last_undegraded":"2024-09-12T18:55:22.792997+0000","last_fullsized":"2024-09-12T18:55:22.792997+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:38.246221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1845,"num_read_kb":1583,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'277","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:59.433256+0000","last_change":"2024-09-12T17:40:55.331083+0000","last_active":"2024-09-12T18:55:59.433256+0000","last_peered":"2024-09-12T18:55:59.433256+0000","last_clean":"2024-09-12T18:55:59.433256+0000","last_became_active":"2024-09-12T17:40:55.330696+0000","last_became_peered":"2024-09-12T17:40:55.330696+0000","last_unstale":"2024-09-12T18:55:59.433256+0000","last_undegraded":"2024-09-12T18:55:59.433256+0000","last_fullsized":"2024-09-12T18:55:59.433256+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:46.573367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5332400,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":853,"num_read_kb":9625,"num_write":1128,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427131+0000","last_change":"2024-09-12T17:40:22.152165+0000","last_active":"2024-09-12T18:55:22.427131+0000","last_peered":"2024-09-12T18:55:22.427131+0000","last_clean":"2024-09-12T18:55:22.427131+0000","last_became_active":"2024-09-12T17:40:22.151083+0000","last_became_peered":"2024-09-12T17:40:22.151083+0000","last_unstale":"2024-09-12T18:55:22.427131+0000","last_undegraded":"2024-09-12T18:55:22.427131+0000","last_fullsized":"2024-09-12T18:55:22.427131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:28.338986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'330","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.658405+0000","last_change":"2024-09-12T17:40:24.174149+0000","last_active":"2024-09-12T18:58:02.658405+0000","last_peered":"2024-09-12T18:58:02.658405+0000","last_clean":"2024-09-12T18:58:02.658405+0000","last_became_active":"2024-09-12T17:40:24.173360+0000","last_became_peered":"2024-09-12T17:40:24.173360+0000","last_unstale":"2024-09-12T18:58:02.658405+0000","last_undegraded":"2024-09-12T18:58:02.658405+0000","last_fullsized":"2024-09-12T18:58:02.658405+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:01.318365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70298,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":548,"num_read_kb":1110,"num_write":440,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.445804+0000","last_change":"2024-09-12T17:40:26.164532+0000","last_active":"2024-09-12T18:55:22.445804+0000","last_peered":"2024-09-12T18:55:22.445804+0000","last_clean":"2024-09-12T18:55:22.445804+0000","last_became_active":"2024-09-12T17:40:26.163773+0000","last_became_peered":"2024-09-12T17:40:26.163773+0000","last_unstale":"2024-09-12T18:55:22.445804+0000","last_undegraded":"2024-09-12T18:55:22.445804+0000","last_fullsized":"2024-09-12T18:55:22.445804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:29.445382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'102","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.270680+0000","last_change":"2024-09-12T17:40:28.199692+0000","last_active":"2024-09-12T18:58:02.270680+0000","last_peered":"2024-09-12T18:58:02.270680+0000","last_clean":"2024-09-12T18:58:02.270680+0000","last_became_active":"2024-09-12T17:40:28.198792+0000","last_became_peered":"2024-09-12T17:40:28.198792+0000","last_unstale":"2024-09-12T18:58:02.270680+0000","last_undegraded":"2024-09-12T18:58:02.270680+0000","last_fullsized":"2024-09-12T18:58:02.270680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:10.816115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":239,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'185","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.792933+0000","last_change":"2024-09-12T17:40:20.147084+0000","last_active":"2024-09-12T18:55:22.792933+0000","last_peered":"2024-09-12T18:55:22.792933+0000","last_clean":"2024-09-12T18:55:22.792933+0000","last_became_active":"2024-09-12T17:40:20.136564+0000","last_became_peered":"2024-09-12T17:40:20.136564+0000","last_unstale":"2024-09-12T18:55:22.792933+0000","last_undegraded":"2024-09-12T18:55:22.792933+0000","last_fullsized":"2024-09-12T18:55:22.792933+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:10.062006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":640,"num_write":266,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'353","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.083750+0000","last_change":"2024-09-12T17:40:18.782734+0000","last_active":"2024-09-12T18:57:45.083750+0000","last_peered":"2024-09-12T18:57:45.083750+0000","last_clean":"2024-09-12T18:57:45.083750+0000","last_became_active":"2024-09-12T17:40:18.779946+0000","last_became_peered":"2024-09-12T17:40:18.779946+0000","last_unstale":"2024-09-12T18:57:45.083750+0000","last_undegraded":"2024-09-12T18:57:45.083750+0000","last_fullsized":"2024-09-12T18:57:45.083750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:48.387265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12103370,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":646,"num_read_kb":21189,"num_write":1128,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.611277+0000","last_change":"2024-09-12T17:40:22.138047+0000","last_active":"2024-09-12T18:55:22.611277+0000","last_peered":"2024-09-12T18:55:22.611277+0000","last_clean":"2024-09-12T18:55:22.611277+0000","last_became_active":"2024-09-12T17:40:22.137291+0000","last_became_peered":"2024-09-12T17:40:22.137291+0000","last_unstale":"2024-09-12T18:55:22.611277+0000","last_undegraded":"2024-09-12T18:55:22.611277+0000","last_fullsized":"2024-09-12T18:55:22.611277+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:51.771726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'259","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.477834+0000","last_change":"2024-09-12T17:40:24.175430+0000","last_active":"2024-09-12T18:57:47.477834+0000","last_peered":"2024-09-12T18:57:47.477834+0000","last_clean":"2024-09-12T18:57:47.477834+0000","last_became_active":"2024-09-12T17:40:24.174681+0000","last_became_peered":"2024-09-12T17:40:24.174681+0000","last_unstale":"2024-09-12T18:57:47.477834+0000","last_undegraded":"2024-09-12T18:57:47.477834+0000","last_fullsized":"2024-09-12T18:57:47.477834+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:33.406641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":890,"num_write":338,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421121+0000","last_change":"2024-09-12T17:40:26.188512+0000","last_active":"2024-09-12T18:55:42.421121+0000","last_peered":"2024-09-12T18:55:42.421121+0000","last_clean":"2024-09-12T18:55:42.421121+0000","last_became_active":"2024-09-12T17:40:26.187438+0000","last_became_peered":"2024-09-12T17:40:26.187438+0000","last_unstale":"2024-09-12T18:55:42.421121+0000","last_undegraded":"2024-09-12T18:55:42.421121+0000","last_fullsized":"2024-09-12T18:55:42.421121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:20.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'124","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427909+0000","last_change":"2024-09-12T17:40:28.202550+0000","last_active":"2024-09-12T18:55:22.427909+0000","last_peered":"2024-09-12T18:55:22.427909+0000","last_clean":"2024-09-12T18:55:22.427909+0000","last_became_active":"2024-09-12T17:40:28.201534+0000","last_became_peered":"2024-09-12T17:40:28.201534+0000","last_unstale":"2024-09-12T18:55:22.427909+0000","last_undegraded":"2024-09-12T18:55:22.427909+0000","last_fullsized":"2024-09-12T18:55:22.427909+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:43.430181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":291,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'52","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:37.431358+0000","last_change":"2024-09-12T17:40:20.117919+0000","last_active":"2024-09-12T18:55:37.431358+0000","last_peered":"2024-09-12T18:55:37.431358+0000","last_clean":"2024-09-12T18:55:37.431358+0000","last_became_active":"2024-09-12T17:40:20.117604+0000","last_became_peered":"2024-09-12T17:40:20.117604+0000","last_unstale":"2024-09-12T18:55:37.431358+0000","last_undegraded":"2024-09-12T18:55:37.431358+0000","last_fullsized":"2024-09-12T18:55:37.431358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:01.530409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":67,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'272","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446902+0000","last_change":"2024-09-12T17:40:18.767654+0000","last_active":"2024-09-12T18:56:42.446902+0000","last_peered":"2024-09-12T18:56:42.446902+0000","last_clean":"2024-09-12T18:56:42.446902+0000","last_became_active":"2024-09-12T17:40:18.767103+0000","last_became_peered":"2024-09-12T17:40:18.767103+0000","last_unstale":"2024-09-12T18:56:42.446902+0000","last_undegraded":"2024-09-12T18:56:42.446902+0000","last_fullsized":"2024-09-12T18:56:42.446902+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:13.247336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15730389,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":384,"num_read_kb":34280,"num_write":1016,"num_write_kb":41945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.791546+0000","last_change":"2024-09-12T17:40:22.135061+0000","last_active":"2024-09-12T18:55:17.791546+0000","last_peered":"2024-09-12T18:55:17.791546+0000","last_clean":"2024-09-12T18:55:17.791546+0000","last_became_active":"2024-09-12T17:40:22.134242+0000","last_became_peered":"2024-09-12T17:40:22.134242+0000","last_unstale":"2024-09-12T18:55:17.791546+0000","last_undegraded":"2024-09-12T18:55:17.791546+0000","last_fullsized":"2024-09-12T18:55:17.791546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:19.741434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'234","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464348+0000","last_change":"2024-09-12T17:40:24.183504+0000","last_active":"2024-09-12T18:57:57.464348+0000","last_peered":"2024-09-12T18:57:57.464348+0000","last_clean":"2024-09-12T18:57:57.464348+0000","last_became_active":"2024-09-12T17:40:24.181581+0000","last_became_peered":"2024-09-12T17:40:24.181581+0000","last_unstale":"2024-09-12T18:57:57.464348+0000","last_undegraded":"2024-09-12T18:57:57.464348+0000","last_fullsized":"2024-09-12T18:57:57.464348+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:34.205562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54177,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":858,"num_write":310,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.794291+0000","last_change":"2024-09-12T17:40:26.196580+0000","last_active":"2024-09-12T18:55:27.794291+0000","last_peered":"2024-09-12T18:55:27.794291+0000","last_clean":"2024-09-12T18:55:27.794291+0000","last_became_active":"2024-09-12T17:40:26.195603+0000","last_became_peered":"2024-09-12T17:40:26.195603+0000","last_unstale":"2024-09-12T18:55:27.794291+0000","last_undegraded":"2024-09-12T18:55:27.794291+0000","last_fullsized":"2024-09-12T18:55:27.794291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:00.612716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'168","reported_seq":1281,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:00.089777+0000","last_change":"2024-09-12T17:40:28.200915+0000","last_active":"2024-09-12T18:58:00.089777+0000","last_peered":"2024-09-12T18:58:00.089777+0000","last_clean":"2024-09-12T18:58:00.089777+0000","last_became_active":"2024-09-12T17:40:28.200126+0000","last_became_peered":"2024-09-12T17:40:28.200126+0000","last_unstale":"2024-09-12T18:58:00.089777+0000","last_undegraded":"2024-09-12T18:58:00.089777+0000","last_fullsized":"2024-09-12T18:58:00.089777+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:27.740825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":872,"num_read_kb":859,"num_write":427,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'166","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:30.310895+0000","last_change":"2024-09-12T17:40:20.135214+0000","last_active":"2024-09-12T18:55:30.310895+0000","last_peered":"2024-09-12T18:55:30.310895+0000","last_clean":"2024-09-12T18:55:30.310895+0000","last_became_active":"2024-09-12T17:40:20.131459+0000","last_became_peered":"2024-09-12T17:40:20.131459+0000","last_unstale":"2024-09-12T18:55:30.310895+0000","last_undegraded":"2024-09-12T18:55:30.310895+0000","last_fullsized":"2024-09-12T18:55:30.310895+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:02.260304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":677,"num_write":293,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'274","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473486+0000","last_change":"2024-09-12T17:40:18.773986+0000","last_active":"2024-09-12T18:57:27.473486+0000","last_peered":"2024-09-12T18:57:27.473486+0000","last_clean":"2024-09-12T18:57:27.473486+0000","last_became_active":"2024-09-12T17:40:18.773667+0000","last_became_peered":"2024-09-12T17:40:18.773667+0000","last_unstale":"2024-09-12T18:57:27.473486+0000","last_undegraded":"2024-09-12T18:57:27.473486+0000","last_fullsized":"2024-09-12T18:57:27.473486+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:09.724574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1313045,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":494,"num_read_kb":8712,"num_write":1019,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"35'4","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.368401+0000","last_change":"2024-09-12T17:40:22.141628+0000","last_active":"2024-09-12T18:59:27.368401+0000","last_peered":"2024-09-12T18:59:27.368401+0000","last_clean":"2024-09-12T18:59:27.368401+0000","last_became_active":"2024-09-12T17:40:22.141182+0000","last_became_peered":"2024-09-12T17:40:22.141182+0000","last_unstale":"2024-09-12T18:59:27.368401+0000","last_undegraded":"2024-09-12T18:59:27.368401+0000","last_fullsized":"2024-09-12T18:59:27.368401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:38.121269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'301","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.595019+0000","last_change":"2024-09-12T17:40:24.167135+0000","last_active":"2024-09-12T18:59:26.595019+0000","last_peered":"2024-09-12T18:59:26.595019+0000","last_clean":"2024-09-12T18:59:26.595019+0000","last_became_active":"2024-09-12T17:40:24.166330+0000","last_became_peered":"2024-09-12T17:40:24.166330+0000","last_unstale":"2024-09-12T18:59:26.595019+0000","last_undegraded":"2024-09-12T18:59:26.595019+0000","last_fullsized":"2024-09-12T18:59:26.595019+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.549312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58768,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":495,"num_read_kb":1011,"num_write":394,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.447210+0000","last_change":"2024-09-12T17:40:26.189177+0000","last_active":"2024-09-12T18:55:27.447210+0000","last_peered":"2024-09-12T18:55:27.447210+0000","last_clean":"2024-09-12T18:55:27.447210+0000","last_became_active":"2024-09-12T17:40:26.188351+0000","last_became_peered":"2024-09-12T17:40:26.188351+0000","last_unstale":"2024-09-12T18:55:27.447210+0000","last_undegraded":"2024-09-12T18:55:27.447210+0000","last_fullsized":"2024-09-12T18:55:27.447210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:14.730369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'136","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.548505+0000","last_change":"2024-09-12T17:40:28.180850+0000","last_active":"2024-09-12T18:59:26.548505+0000","last_peered":"2024-09-12T18:59:26.548505+0000","last_clean":"2024-09-12T18:59:26.548505+0000","last_became_active":"2024-09-12T17:40:28.180148+0000","last_became_peered":"2024-09-12T17:40:28.180148+0000","last_unstale":"2024-09-12T18:59:26.548505+0000","last_undegraded":"2024-09-12T18:59:26.548505+0000","last_fullsized":"2024-09-12T18:59:26.548505+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:56.213405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":171,"num_read_kb":158,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'174","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447667+0000","last_change":"2024-09-12T17:40:20.127371+0000","last_active":"2024-09-12T18:56:12.447667+0000","last_peered":"2024-09-12T18:56:12.447667+0000","last_clean":"2024-09-12T18:56:12.447667+0000","last_became_active":"2024-09-12T17:40:20.127006+0000","last_became_peered":"2024-09-12T17:40:20.127006+0000","last_unstale":"2024-09-12T18:56:12.447667+0000","last_undegraded":"2024-09-12T18:56:12.447667+0000","last_fullsized":"2024-09-12T18:56:12.447667+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:28.267156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":779,"num_read_kb":649,"num_write":260,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'262","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443019+0000","last_change":"2024-09-12T17:40:18.759600+0000","last_active":"2024-09-12T18:57:27.443019+0000","last_peered":"2024-09-12T18:57:27.443019+0000","last_clean":"2024-09-12T18:57:27.443019+0000","last_became_active":"2024-09-12T17:40:18.757444+0000","last_became_peered":"2024-09-12T17:40:18.757444+0000","last_unstale":"2024-09-12T18:57:27.443019+0000","last_undegraded":"2024-09-12T18:57:27.443019+0000","last_fullsized":"2024-09-12T18:57:27.443019+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:50.933887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20999376,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":435,"num_read_kb":91614,"num_write":1023,"num_write_kb":46187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'4205","reported_seq":4819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447609+0000","last_change":"2024-09-12T17:40:20.125927+0000","last_active":"2024-09-12T18:56:12.447609+0000","last_peered":"2024-09-12T18:56:12.447609+0000","last_clean":"2024-09-12T18:56:12.447609+0000","last_became_active":"2024-09-12T17:40:20.125586+0000","last_became_peered":"2024-09-12T17:40:20.125586+0000","last_unstale":"2024-09-12T18:56:12.447609+0000","last_undegraded":"2024-09-12T18:56:12.447609+0000","last_fullsized":"2024-09-12T18:56:12.447609+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":3000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:28.284212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16904,"num_read_kb":14161,"num_write":6332,"num_write_kb":3161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'261","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:24.449879+0000","last_change":"2024-09-12T17:40:18.754599+0000","last_active":"2024-09-12T18:57:24.449879+0000","last_peered":"2024-09-12T18:57:24.449879+0000","last_clean":"2024-09-12T18:57:24.449879+0000","last_became_active":"2024-09-12T17:40:18.754335+0000","last_became_peered":"2024-09-12T17:40:18.754335+0000","last_unstale":"2024-09-12T18:57:24.449879+0000","last_undegraded":"2024-09-12T18:57:24.449879+0000","last_fullsized":"2024-09-12T18:57:24.449879+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:31.973695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293678,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":373,"num_read_kb":13727,"num_write":944,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'413","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.622495+0000","last_change":"2024-09-12T17:40:20.137604+0000","last_active":"2024-09-12T18:56:12.622495+0000","last_peered":"2024-09-12T18:56:12.622495+0000","last_clean":"2024-09-12T18:56:12.622495+0000","last_became_active":"2024-09-12T17:40:20.136831+0000","last_became_peered":"2024-09-12T17:40:20.136831+0000","last_unstale":"2024-09-12T18:56:12.622495+0000","last_undegraded":"2024-09-12T18:56:12.622495+0000","last_fullsized":"2024-09-12T18:56:12.622495+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:14.463672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1812,"num_read_kb":1536,"num_write":694,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'262","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639914+0000","last_change":"2024-09-12T17:40:18.754536+0000","last_active":"2024-09-12T18:57:27.639914+0000","last_peered":"2024-09-12T18:57:27.639914+0000","last_clean":"2024-09-12T18:57:27.639914+0000","last_became_active":"2024-09-12T17:40:18.753576+0000","last_became_peered":"2024-09-12T17:40:18.753576+0000","last_unstale":"2024-09-12T18:57:27.639914+0000","last_undegraded":"2024-09-12T18:57:27.639914+0000","last_fullsized":"2024-09-12T18:57:27.639914+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:25.780872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9213402,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":377,"num_read_kb":36529,"num_write":945,"num_write_kb":32314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'363","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:18.053251+0000","last_change":"2024-09-12T17:40:20.133110+0000","last_active":"2024-09-12T18:57:18.053251+0000","last_peered":"2024-09-12T18:57:18.053251+0000","last_clean":"2024-09-12T18:57:18.053251+0000","last_became_active":"2024-09-12T17:40:20.132826+0000","last_became_peered":"2024-09-12T17:40:20.132826+0000","last_unstale":"2024-09-12T18:57:18.053251+0000","last_undegraded":"2024-09-12T18:57:18.053251+0000","last_fullsized":"2024-09-12T18:57:18.053251+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:07.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1596,"num_read_kb":1285,"num_write":598,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'283","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.476688+0000","last_change":"2024-09-12T17:40:18.755673+0000","last_active":"2024-09-12T18:57:42.476688+0000","last_peered":"2024-09-12T18:57:42.476688+0000","last_clean":"2024-09-12T18:57:42.476688+0000","last_became_active":"2024-09-12T17:40:18.754933+0000","last_became_peered":"2024-09-12T17:40:18.754933+0000","last_unstale":"2024-09-12T18:57:42.476688+0000","last_undegraded":"2024-09-12T18:57:42.476688+0000","last_fullsized":"2024-09-12T18:57:42.476688+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:43.716617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6326374,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":393,"num_read_kb":46825,"num_write":979,"num_write_kb":45673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'114","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.066485+0000","last_change":"2024-09-12T17:40:20.130446+0000","last_active":"2024-09-12T18:58:06.066485+0000","last_peered":"2024-09-12T18:58:06.066485+0000","last_clean":"2024-09-12T18:58:06.066485+0000","last_became_active":"2024-09-12T17:40:20.129769+0000","last_became_peered":"2024-09-12T17:40:20.129769+0000","last_unstale":"2024-09-12T18:58:06.066485+0000","last_undegraded":"2024-09-12T18:58:06.066485+0000","last_fullsized":"2024-09-12T18:58:06.066485+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:07.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":414,"num_write":175,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'279","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:22.471039+0000","last_change":"2024-09-12T17:40:18.773850+0000","last_active":"2024-09-12T18:58:22.471039+0000","last_peered":"2024-09-12T18:58:22.471039+0000","last_clean":"2024-09-12T18:58:22.471039+0000","last_became_active":"2024-09-12T17:40:18.773052+0000","last_became_peered":"2024-09-12T17:40:18.773052+0000","last_unstale":"2024-09-12T18:58:22.471039+0000","last_undegraded":"2024-09-12T18:58:22.471039+0000","last_fullsized":"2024-09-12T18:58:22.471039+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:03.999190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10012785,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":551,"num_read_kb":23542,"num_write":991,"num_write_kb":26208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'141","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820110+0000","last_change":"2024-09-12T17:40:20.149013+0000","last_active":"2024-09-12T18:57:27.820110+0000","last_peered":"2024-09-12T18:57:27.820110+0000","last_clean":"2024-09-12T18:57:27.820110+0000","last_became_active":"2024-09-12T17:40:20.146835+0000","last_became_peered":"2024-09-12T17:40:20.146835+0000","last_unstale":"2024-09-12T18:57:27.820110+0000","last_undegraded":"2024-09-12T18:57:27.820110+0000","last_fullsized":"2024-09-12T18:57:27.820110+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:22.211007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":516,"num_write":222,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'373","reported_seq":1147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447567+0000","last_change":"2024-09-12T17:40:18.765218+0000","last_active":"2024-09-12T18:56:12.447567+0000","last_peered":"2024-09-12T18:56:12.447567+0000","last_clean":"2024-09-12T18:56:12.447567+0000","last_became_active":"2024-09-12T17:40:18.764545+0000","last_became_peered":"2024-09-12T17:40:18.764545+0000","last_unstale":"2024-09-12T18:56:12.447567+0000","last_undegraded":"2024-09-12T18:56:12.447567+0000","last_fullsized":"2024-09-12T18:56:12.447567+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:46.840426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6336635,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":841,"num_read_kb":25412,"num_write":1299,"num_write_kb":29284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'206","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457994+0000","last_change":"2024-09-12T17:40:20.133394+0000","last_active":"2024-09-12T18:57:27.457994+0000","last_peered":"2024-09-12T18:57:27.457994+0000","last_clean":"2024-09-12T18:57:27.457994+0000","last_became_active":"2024-09-12T17:40:20.133055+0000","last_became_peered":"2024-09-12T17:40:20.133055+0000","last_unstale":"2024-09-12T18:57:27.457994+0000","last_undegraded":"2024-09-12T18:57:27.457994+0000","last_fullsized":"2024-09-12T18:57:27.457994+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:30.582322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":974,"num_read_kb":794,"num_write":355,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'267","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:23.476089+0000","last_change":"2024-09-12T17:40:18.765505+0000","last_active":"2024-09-12T18:57:23.476089+0000","last_peered":"2024-09-12T18:57:23.476089+0000","last_clean":"2024-09-12T18:57:23.476089+0000","last_became_active":"2024-09-12T17:40:18.764658+0000","last_became_peered":"2024-09-12T17:40:18.764658+0000","last_unstale":"2024-09-12T18:57:23.476089+0000","last_undegraded":"2024-09-12T18:57:23.476089+0000","last_fullsized":"2024-09-12T18:57:23.476089+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:18.339542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10154406,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":421,"num_read_kb":14116,"num_write":1003,"num_write_kb":26720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'195","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443066+0000","last_change":"2024-09-12T17:40:20.125114+0000","last_active":"2024-09-12T18:57:27.443066+0000","last_peered":"2024-09-12T18:57:27.443066+0000","last_clean":"2024-09-12T18:57:27.443066+0000","last_became_active":"2024-09-12T17:40:20.124247+0000","last_became_peered":"2024-09-12T17:40:20.124247+0000","last_unstale":"2024-09-12T18:57:27.443066+0000","last_undegraded":"2024-09-12T18:57:27.443066+0000","last_fullsized":"2024-09-12T18:57:27.443066+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:39.697115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":903,"num_read_kb":737,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'307","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:16.668519+0000","last_change":"2024-09-12T17:40:18.774283+0000","last_active":"2024-09-12T18:56:16.668519+0000","last_peered":"2024-09-12T18:56:16.668519+0000","last_clean":"2024-09-12T18:56:16.668519+0000","last_became_active":"2024-09-12T17:40:18.772776+0000","last_became_peered":"2024-09-12T17:40:18.772776+0000","last_unstale":"2024-09-12T18:56:16.668519+0000","last_undegraded":"2024-09-12T18:56:16.668519+0000","last_fullsized":"2024-09-12T18:56:16.668519+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:23.569697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5280730,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":563,"num_read_kb":25353,"num_write":1083,"num_write_kb":19697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'233","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.472184+0000","last_change":"2024-09-12T17:40:20.116396+0000","last_active":"2024-09-12T18:57:22.472184+0000","last_peered":"2024-09-12T18:57:22.472184+0000","last_clean":"2024-09-12T18:57:22.472184+0000","last_became_active":"2024-09-12T17:40:20.116064+0000","last_became_peered":"2024-09-12T17:40:20.116064+0000","last_unstale":"2024-09-12T18:57:22.472184+0000","last_undegraded":"2024-09-12T18:57:22.472184+0000","last_fullsized":"2024-09-12T18:57:22.472184+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:07.387378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1004,"num_read_kb":824,"num_write":355,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'283","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:45.741790+0000","last_change":"2024-09-12T17:40:18.760207+0000","last_active":"2024-09-12T18:56:45.741790+0000","last_peered":"2024-09-12T18:56:45.741790+0000","last_clean":"2024-09-12T18:56:45.741790+0000","last_became_active":"2024-09-12T17:40:18.753693+0000","last_became_peered":"2024-09-12T17:40:18.753693+0000","last_unstale":"2024-09-12T18:56:45.741790+0000","last_undegraded":"2024-09-12T18:56:45.741790+0000","last_fullsized":"2024-09-12T18:56:45.741790+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:50.968987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21644128,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":404,"num_read_kb":12118,"num_write":1027,"num_write_kb":50446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'82","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.819071+0000","last_change":"2024-09-12T17:40:20.130558+0000","last_active":"2024-09-12T18:57:22.819071+0000","last_peered":"2024-09-12T18:57:22.819071+0000","last_clean":"2024-09-12T18:57:22.819071+0000","last_became_active":"2024-09-12T17:40:20.129687+0000","last_became_peered":"2024-09-12T17:40:20.129687+0000","last_unstale":"2024-09-12T18:57:22.819071+0000","last_undegraded":"2024-09-12T18:57:22.819071+0000","last_fullsized":"2024-09-12T18:57:22.819071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:16.096110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":302,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'316","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:20.524908+0000","last_change":"2024-09-12T17:40:18.773313+0000","last_active":"2024-09-12T18:57:20.524908+0000","last_peered":"2024-09-12T18:57:20.524908+0000","last_clean":"2024-09-12T18:57:20.524908+0000","last_became_active":"2024-09-12T17:40:18.772969+0000","last_became_peered":"2024-09-12T17:40:18.772969+0000","last_unstale":"2024-09-12T18:57:20.524908+0000","last_undegraded":"2024-09-12T18:57:20.524908+0000","last_fullsized":"2024-09-12T18:57:20.524908+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:42.889939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10553500,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":405,"num_read_kb":13353,"num_write":1040,"num_write_kb":30519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'211","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:09.446951+0000","last_change":"2024-09-12T17:40:20.130883+0000","last_active":"2024-09-12T18:57:09.446951+0000","last_peered":"2024-09-12T18:57:09.446951+0000","last_clean":"2024-09-12T18:57:09.446951+0000","last_became_active":"2024-09-12T17:40:20.130606+0000","last_became_peered":"2024-09-12T17:40:20.130606+0000","last_unstale":"2024-09-12T18:57:09.446951+0000","last_undegraded":"2024-09-12T18:57:09.446951+0000","last_fullsized":"2024-09-12T18:57:09.446951+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:31.071071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":765,"num_write":331,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'294","reported_seq":1068,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:54.040487+0000","last_change":"2024-09-12T17:40:18.781646+0000","last_active":"2024-09-12T18:56:54.040487+0000","last_peered":"2024-09-12T18:56:54.040487+0000","last_clean":"2024-09-12T18:56:54.040487+0000","last_became_active":"2024-09-12T17:40:18.780861+0000","last_became_peered":"2024-09-12T17:40:18.780861+0000","last_unstale":"2024-09-12T18:56:54.040487+0000","last_undegraded":"2024-09-12T18:56:54.040487+0000","last_fullsized":"2024-09-12T18:56:54.040487+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:37.689644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10210687,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":822,"num_read_kb":18824,"num_write":1122,"num_write_kb":42628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'422","reported_seq":1180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812440+0000","last_change":"2024-09-12T17:40:20.149871+0000","last_active":"2024-09-12T18:56:52.812440+0000","last_peered":"2024-09-12T18:56:52.812440+0000","last_clean":"2024-09-12T18:56:52.812440+0000","last_became_active":"2024-09-12T17:40:20.149176+0000","last_became_peered":"2024-09-12T17:40:20.149176+0000","last_unstale":"2024-09-12T18:56:52.812440+0000","last_undegraded":"2024-09-12T18:56:52.812440+0000","last_fullsized":"2024-09-12T18:56:52.812440+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.618043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2034,"num_read_kb":1768,"num_write":658,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'275","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.108916+0000","last_change":"2024-09-12T17:40:18.781947+0000","last_active":"2024-09-12T18:57:45.108916+0000","last_peered":"2024-09-12T18:57:45.108916+0000","last_clean":"2024-09-12T18:57:45.108916+0000","last_became_active":"2024-09-12T17:40:18.781543+0000","last_became_peered":"2024-09-12T17:40:18.781543+0000","last_unstale":"2024-09-12T18:57:45.108916+0000","last_undegraded":"2024-09-12T18:57:45.108916+0000","last_fullsized":"2024-09-12T18:57:45.108916+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:45.216097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8657378,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":490,"num_read_kb":27146,"num_write":1057,"num_write_kb":17169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'186","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.449104+0000","last_change":"2024-09-12T17:40:20.133684+0000","last_active":"2024-09-12T18:56:52.449104+0000","last_peered":"2024-09-12T18:56:52.449104+0000","last_clean":"2024-09-12T18:56:52.449104+0000","last_became_active":"2024-09-12T17:40:20.132914+0000","last_became_peered":"2024-09-12T17:40:20.132914+0000","last_unstale":"2024-09-12T18:56:52.449104+0000","last_undegraded":"2024-09-12T18:56:52.449104+0000","last_fullsized":"2024-09-12T18:56:52.449104+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:10.481286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":685,"num_write":286,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'352","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.435866+0000","last_change":"2024-09-12T17:40:18.774804+0000","last_active":"2024-09-12T18:56:52.435866+0000","last_peered":"2024-09-12T18:56:52.435866+0000","last_clean":"2024-09-12T18:56:52.435866+0000","last_became_active":"2024-09-12T17:40:18.773572+0000","last_became_peered":"2024-09-12T17:40:18.773572+0000","last_unstale":"2024-09-12T18:56:52.435866+0000","last_undegraded":"2024-09-12T18:56:52.435866+0000","last_fullsized":"2024-09-12T18:56:52.435866+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:04.216779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23394053,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":735,"num_read_kb":27791,"num_write":1348,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'106","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.465444+0000","last_change":"2024-09-12T17:40:20.125236+0000","last_active":"2024-09-12T18:56:52.465444+0000","last_peered":"2024-09-12T18:56:52.465444+0000","last_clean":"2024-09-12T18:56:52.465444+0000","last_became_active":"2024-09-12T17:40:20.124905+0000","last_became_peered":"2024-09-12T17:40:20.124905+0000","last_unstale":"2024-09-12T18:56:52.465444+0000","last_undegraded":"2024-09-12T18:56:52.465444+0000","last_fullsized":"2024-09-12T18:56:52.465444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:52.008144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":441,"num_write":144,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'330","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.452697+0000","last_change":"2024-09-12T17:40:18.777519+0000","last_active":"2024-09-12T18:57:07.452697+0000","last_peered":"2024-09-12T18:57:07.452697+0000","last_clean":"2024-09-12T18:57:07.452697+0000","last_became_active":"2024-09-12T17:40:18.776865+0000","last_became_peered":"2024-09-12T17:40:18.776865+0000","last_unstale":"2024-09-12T18:57:07.452697+0000","last_undegraded":"2024-09-12T18:57:07.452697+0000","last_fullsized":"2024-09-12T18:57:07.452697+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:29.028273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1370996,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":654,"num_read_kb":1992,"num_write":1192,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'104","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.554319+0000","last_change":"2024-09-12T17:40:20.119380+0000","last_active":"2024-09-12T18:59:26.554319+0000","last_peered":"2024-09-12T18:59:26.554319+0000","last_clean":"2024-09-12T18:59:26.554319+0000","last_became_active":"2024-09-12T17:40:20.119036+0000","last_became_peered":"2024-09-12T17:40:20.119036+0000","last_unstale":"2024-09-12T18:59:26.554319+0000","last_undegraded":"2024-09-12T18:59:26.554319+0000","last_fullsized":"2024-09-12T18:59:26.554319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:31.564674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":455,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'417","reported_seq":1121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:19.448994+0000","last_change":"2024-09-12T17:40:18.770214+0000","last_active":"2024-09-12T18:57:19.448994+0000","last_peered":"2024-09-12T18:57:19.448994+0000","last_clean":"2024-09-12T18:57:19.448994+0000","last_became_active":"2024-09-12T17:40:18.768688+0000","last_became_peered":"2024-09-12T17:40:18.768688+0000","last_unstale":"2024-09-12T18:57:19.448994+0000","last_undegraded":"2024-09-12T18:57:19.448994+0000","last_fullsized":"2024-09-12T18:57:19.448994+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:46.076255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12351575,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":796,"num_read_kb":49767,"num_write":1329,"num_write_kb":26119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'159","reported_seq":736,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.443217+0000","last_change":"2024-09-12T17:40:20.133523+0000","last_active":"2024-09-12T18:56:27.443217+0000","last_peered":"2024-09-12T18:56:27.443217+0000","last_clean":"2024-09-12T18:56:27.443217+0000","last_became_active":"2024-09-12T17:40:20.132698+0000","last_became_peered":"2024-09-12T17:40:20.132698+0000","last_unstale":"2024-09-12T18:56:27.443217+0000","last_undegraded":"2024-09-12T18:56:27.443217+0000","last_fullsized":"2024-09-12T18:56:27.443217+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:07.059934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":512,"num_write":259,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'289","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.638758+0000","last_change":"2024-09-12T17:40:18.784825+0000","last_active":"2024-09-12T18:57:22.638758+0000","last_peered":"2024-09-12T18:57:22.638758+0000","last_clean":"2024-09-12T18:57:22.638758+0000","last_became_active":"2024-09-12T17:40:18.784024+0000","last_became_peered":"2024-09-12T17:40:18.784024+0000","last_unstale":"2024-09-12T18:57:22.638758+0000","last_undegraded":"2024-09-12T18:57:22.638758+0000","last_fullsized":"2024-09-12T18:57:22.638758+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:14.215607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5753437,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":409,"num_read_kb":13538,"num_write":1052,"num_write_kb":25363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'303","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:39.428993+0000","last_change":"2024-09-12T17:40:55.332141+0000","last_active":"2024-09-12T18:55:39.428993+0000","last_peered":"2024-09-12T18:55:39.428993+0000","last_clean":"2024-09-12T18:55:39.428993+0000","last_became_active":"2024-09-12T17:40:55.331839+0000","last_became_peered":"2024-09-12T17:40:55.331839+0000","last_unstale":"2024-09-12T18:55:39.428993+0000","last_undegraded":"2024-09-12T18:55:39.428993+0000","last_fullsized":"2024-09-12T18:55:39.428993+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.377874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18979519,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":458,"num_read_kb":31466,"num_write":997,"num_write_kb":39606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'70","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:32.448457+0000","last_change":"2024-09-12T17:40:20.116528+0000","last_active":"2024-09-12T18:55:32.448457+0000","last_peered":"2024-09-12T18:55:32.448457+0000","last_clean":"2024-09-12T18:55:32.448457+0000","last_became_active":"2024-09-12T17:40:20.116230+0000","last_became_peered":"2024-09-12T17:40:20.116230+0000","last_unstale":"2024-09-12T18:55:32.448457+0000","last_undegraded":"2024-09-12T18:55:32.448457+0000","last_fullsized":"2024-09-12T18:55:32.448457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:18.767693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":294,"num_write":113,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'328","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.462720+0000","last_change":"2024-09-12T17:40:18.774940+0000","last_active":"2024-09-12T18:57:22.462720+0000","last_peered":"2024-09-12T18:57:22.462720+0000","last_clean":"2024-09-12T18:57:22.462720+0000","last_became_active":"2024-09-12T17:40:18.774332+0000","last_became_peered":"2024-09-12T17:40:18.774332+0000","last_unstale":"2024-09-12T18:57:22.462720+0000","last_undegraded":"2024-09-12T18:57:22.462720+0000","last_fullsized":"2024-09-12T18:57:22.462720+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:36.078701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11573126,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":588,"num_read_kb":8119,"num_write":1403,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'266","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.610008+0000","last_change":"2024-09-12T17:40:20.113318+0000","last_active":"2024-09-12T18:55:17.610008+0000","last_peered":"2024-09-12T18:55:17.610008+0000","last_clean":"2024-09-12T18:55:17.610008+0000","last_became_active":"2024-09-12T17:40:20.112521+0000","last_became_peered":"2024-09-12T17:40:20.112521+0000","last_unstale":"2024-09-12T18:55:17.610008+0000","last_undegraded":"2024-09-12T18:55:17.610008+0000","last_fullsized":"2024-09-12T18:55:17.610008+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:29.322254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1090,"num_read_kb":887,"num_write":395,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5850,"num_read_kb":4138,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16272,"num_read_kb":15940,"num_write":16723,"num_write_kb":4884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1758,"ondisk_log_size":1758,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":457,"ondisk_log_size":457,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1915679,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":18614,"num_read_kb":35597,"num_write":15741,"num_write_kb":11986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":2795574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2091,"ondisk_log_size":2091,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2852,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103249,"num_read_kb":86122,"num_write":37396,"num_write_kb":18900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3947,"ondisk_log_size":3947,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":642493580,"num_objects":4513,"num_object_clones":0,"num_object_copies":9026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4513,"num_whiteouts":0,"num_read":32284,"num_read_kb":1876573,"num_write":68075,"num_write_kb":2152272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1317863424,"data_stored":1284987160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3736,"ondisk_log_size":3736,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":75130115,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":143,"num_read_kb":197405,"num_write":158,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":150265856,"data_stored":150260230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":75130115,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":139,"num_read_kb":186093,"num_write":158,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":150265856,"data_stored":150260230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510404,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451440,"kb_used_data":203680,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93920400,"statfs":{"total":96636764160,"available":96174489600,"internally_reserved":0,"allocated":208568320,"data_stored":202396353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":253688266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510404,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":425536,"kb_used_data":195824,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93946304,"statfs":{"total":96636764160,"available":96201015296,"internally_reserved":0,"allocated":200523776,"data_stored":196040359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510403,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343480,"kb_used_data":231848,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94028360,"statfs":{"total":96636764160,"available":96285040640,"internally_reserved":0,"allocated":237412352,"data_stored":230936096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510404,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276480,"kb_used_data":209200,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94095360,"statfs":{"total":96636764160,"available":96353648640,"internally_reserved":0,"allocated":214220800,"data_stored":207815616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510402,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":497148,"kb_used_data":253548,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":93874692,"statfs":{"total":96636764160,"available":96127684608,"internally_reserved":0,"allocated":259633152,"data_stored":253357114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510402,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245736,"kb_used_data":146584,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94126104,"statfs":{"total":96636764160,"available":96385130496,"internally_reserved":0,"allocated":150102016,"data_stored":145754399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510404,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434708,"kb_used_data":223044,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":93937132,"statfs":{"total":96636764160,"available":96191623168,"internally_reserved":0,"allocated":228397056,"data_stored":221677622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575810,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224936,"kb_used_data":149400,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94146904,"statfs":{"total":96636764160,"available":96406429696,"internally_reserved":0,"allocated":152985600,"data_stored":148655937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77330888},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":187408384,"data_stored":182261511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":99299328,"data_stored":96490580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114515968,"data_stored":111678165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":195018752,"data_stored":190317682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":185356288,"data_stored":180424589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":207863808,"data_stored":203004921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":148754432,"data_stored":145771761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":179646464,"data_stored":175037951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":347978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":475136,"data_stored":399372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":132861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":492975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":82687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":684032,"data_stored":573019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":258551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":508131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18458586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13680640,"data_stored":13679919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29409280,"data_stored":29408553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17874944,"data_stored":17874217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":21019951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34189312,"data_stored":34187226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18458580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:00:00.880 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T19:00:00.880 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:00:01.218 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T19:00:01.232 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-09-12T19:00:01.242 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":2656,"stamp":"2024-09-12T18:59:59.321639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":795277064,"num_objects":4897,"num_object_clones":0,"num_object_copies":9794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4897,"num_whiteouts":0,"num_read":179022,"num_read_kb":2404787,"num_write":140334,"num_write_kb":2445958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13289,"ondisk_log_size":13289,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2899464,"kb_used_data":1613128,"kb_used_omap":12,"kb_used_meta":1286195,"kb_avail":752075256,"statfs":{"total":773094113280,"available":770125062144,"internally_reserved":0,"allocated":1651843072,"data_stored":1606633496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1317064243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007647"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639884+0000","last_change":"2024-09-12T18:19:57.854037+0000","last_active":"2024-09-12T18:57:27.639884+0000","last_peered":"2024-09-12T18:57:27.639884+0000","last_clean":"2024-09-12T18:57:27.639884+0000","last_became_active":"2024-09-12T18:19:57.853375+0000","last_became_peered":"2024-09-12T18:19:57.853375+0000","last_unstale":"2024-09-12T18:57:27.639884+0000","last_undegraded":"2024-09-12T18:57:27.639884+0000","last_fullsized":"2024-09-12T18:57:27.639884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:39.334575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'1","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.636250+0000","last_change":"2024-09-12T17:59:43.011642+0000","last_active":"2024-09-12T18:57:12.636250+0000","last_peered":"2024-09-12T18:57:12.636250+0000","last_clean":"2024-09-12T18:57:12.636250+0000","last_became_active":"2024-09-12T17:59:43.010854+0000","last_became_peered":"2024-09-12T17:59:43.010854+0000","last_unstale":"2024-09-12T18:57:12.636250+0000","last_undegraded":"2024-09-12T18:57:12.636250+0000","last_fullsized":"2024-09-12T18:57:12.636250+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:05.224690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454697+0000","last_change":"2024-09-12T17:59:38.988698+0000","last_active":"2024-09-12T18:57:12.454697+0000","last_peered":"2024-09-12T18:57:12.454697+0000","last_clean":"2024-09-12T18:57:12.454697+0000","last_became_active":"2024-09-12T17:59:38.987739+0000","last_became_peered":"2024-09-12T17:59:38.987739+0000","last_unstale":"2024-09-12T18:57:12.454697+0000","last_undegraded":"2024-09-12T18:57:12.454697+0000","last_fullsized":"2024-09-12T18:57:12.454697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:32.330775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'44","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.460341+0000","last_change":"2024-09-12T17:55:59.359070+0000","last_active":"2024-09-12T18:56:27.460341+0000","last_peered":"2024-09-12T18:56:27.460341+0000","last_clean":"2024-09-12T18:56:27.460341+0000","last_became_active":"2024-09-12T17:55:59.358302+0000","last_became_peered":"2024-09-12T17:55:59.358302+0000","last_unstale":"2024-09-12T18:56:27.460341+0000","last_undegraded":"2024-09-12T18:56:27.460341+0000","last_fullsized":"2024-09-12T18:56:27.460341+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:31.219330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":154,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:54:59.420325+0000","last_change":"2024-09-12T18:19:57.839639+0000","last_active":"2024-09-12T18:54:59.420325+0000","last_peered":"2024-09-12T18:54:59.420325+0000","last_clean":"2024-09-12T18:54:59.420325+0000","last_became_active":"2024-09-12T18:19:57.838918+0000","last_became_peered":"2024-09-12T18:19:57.838918+0000","last_unstale":"2024-09-12T18:54:59.420325+0000","last_undegraded":"2024-09-12T18:54:59.420325+0000","last_fullsized":"2024-09-12T18:54:59.420325+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:14.062322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'1","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.816864+0000","last_change":"2024-09-12T17:59:43.018636+0000","last_active":"2024-09-12T18:57:12.816864+0000","last_peered":"2024-09-12T18:57:12.816864+0000","last_clean":"2024-09-12T18:57:12.816864+0000","last_became_active":"2024-09-12T17:59:43.005733+0000","last_became_peered":"2024-09-12T17:59:43.005733+0000","last_unstale":"2024-09-12T18:57:12.816864+0000","last_undegraded":"2024-09-12T18:57:12.816864+0000","last_fullsized":"2024-09-12T18:57:12.816864+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.942784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.460544+0000","last_change":"2024-09-12T17:59:38.990543+0000","last_active":"2024-09-12T18:57:12.460544+0000","last_peered":"2024-09-12T18:57:12.460544+0000","last_clean":"2024-09-12T18:57:12.460544+0000","last_became_active":"2024-09-12T17:59:38.989854+0000","last_became_peered":"2024-09-12T17:59:38.989854+0000","last_unstale":"2024-09-12T18:57:12.460544+0000","last_undegraded":"2024-09-12T18:57:12.460544+0000","last_fullsized":"2024-09-12T18:57:12.460544+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:58.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7924395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":8763,"num_write":5,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'34","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:14.436391+0000","last_change":"2024-09-12T17:55:59.368156+0000","last_active":"2024-09-12T18:56:14.436391+0000","last_peered":"2024-09-12T18:56:14.436391+0000","last_clean":"2024-09-12T18:56:14.436391+0000","last_became_active":"2024-09-12T17:55:59.367426+0000","last_became_peered":"2024-09-12T17:55:59.367426+0000","last_unstale":"2024-09-12T18:56:14.436391+0000","last_undegraded":"2024-09-12T18:56:14.436391+0000","last_fullsized":"2024-09-12T18:56:14.436391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:37.601556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":114,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.427354+0000","last_change":"2024-09-12T18:19:57.849468+0000","last_active":"2024-09-12T18:56:12.427354+0000","last_peered":"2024-09-12T18:56:12.427354+0000","last_clean":"2024-09-12T18:56:12.427354+0000","last_became_active":"2024-09-12T18:19:57.848735+0000","last_became_peered":"2024-09-12T18:19:57.848735+0000","last_unstale":"2024-09-12T18:56:12.427354+0000","last_undegraded":"2024-09-12T18:56:12.427354+0000","last_fullsized":"2024-09-12T18:56:12.427354+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:59.827170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453948+0000","last_change":"2024-09-12T17:59:43.012346+0000","last_active":"2024-09-12T18:55:57.453948+0000","last_peered":"2024-09-12T18:55:57.453948+0000","last_clean":"2024-09-12T18:55:57.453948+0000","last_became_active":"2024-09-12T17:59:43.011603+0000","last_became_peered":"2024-09-12T17:59:43.011603+0000","last_unstale":"2024-09-12T18:55:57.453948+0000","last_undegraded":"2024-09-12T18:55:57.453948+0000","last_fullsized":"2024-09-12T18:55:57.453948+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:19.770482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":9,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:54.456240+0000","last_change":"2024-09-12T17:59:38.985703+0000","last_active":"2024-09-12T18:57:54.456240+0000","last_peered":"2024-09-12T18:57:54.456240+0000","last_clean":"2024-09-12T18:57:54.456240+0000","last_became_active":"2024-09-12T17:59:38.984980+0000","last_became_peered":"2024-09-12T17:59:38.984980+0000","last_unstale":"2024-09-12T18:57:54.456240+0000","last_undegraded":"2024-09-12T18:57:54.456240+0000","last_fullsized":"2024-09-12T18:57:54.456240+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:03.988908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'15","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.454640+0000","last_change":"2024-09-12T17:55:59.357028+0000","last_active":"2024-09-12T18:56:02.454640+0000","last_peered":"2024-09-12T18:56:02.454640+0000","last_clean":"2024-09-12T18:56:02.454640+0000","last_became_active":"2024-09-12T17:55:59.356144+0000","last_became_peered":"2024-09-12T17:55:59.356144+0000","last_unstale":"2024-09-12T18:56:02.454640+0000","last_undegraded":"2024-09-12T18:56:02.454640+0000","last_fullsized":"2024-09-12T18:56:02.454640+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:40.644103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442648+0000","last_change":"2024-09-12T18:19:57.861119+0000","last_active":"2024-09-12T18:56:27.442648+0000","last_peered":"2024-09-12T18:56:27.442648+0000","last_clean":"2024-09-12T18:56:27.442648+0000","last_became_active":"2024-09-12T18:19:57.860464+0000","last_became_peered":"2024-09-12T18:19:57.860464+0000","last_unstale":"2024-09-12T18:56:27.442648+0000","last_undegraded":"2024-09-12T18:56:27.442648+0000","last_fullsized":"2024-09-12T18:56:27.442648+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:37.217624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'3","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437344+0000","last_change":"2024-09-12T17:59:43.031327+0000","last_active":"2024-09-12T18:56:02.437344+0000","last_peered":"2024-09-12T18:56:02.437344+0000","last_clean":"2024-09-12T18:56:02.437344+0000","last_became_active":"2024-09-12T17:59:43.030545+0000","last_became_peered":"2024-09-12T17:59:43.030545+0000","last_unstale":"2024-09-12T18:56:02.437344+0000","last_undegraded":"2024-09-12T18:56:02.437344+0000","last_fullsized":"2024-09-12T18:56:02.437344+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:11.859283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48431,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4192,"num_write":3,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800776+0000","last_change":"2024-09-12T17:59:38.946186+0000","last_active":"2024-09-12T18:55:57.800776+0000","last_peered":"2024-09-12T18:55:57.800776+0000","last_clean":"2024-09-12T18:55:57.800776+0000","last_became_active":"2024-09-12T17:59:38.945373+0000","last_became_peered":"2024-09-12T17:59:38.945373+0000","last_unstale":"2024-09-12T18:55:57.800776+0000","last_undegraded":"2024-09-12T18:55:57.800776+0000","last_fullsized":"2024-09-12T18:55:57.800776+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:18.147516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'6","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437289+0000","last_change":"2024-09-12T17:55:59.340661+0000","last_active":"2024-09-12T18:56:02.437289+0000","last_peered":"2024-09-12T18:56:02.437289+0000","last_clean":"2024-09-12T18:56:02.437289+0000","last_became_active":"2024-09-12T17:55:59.338550+0000","last_became_peered":"2024-09-12T17:55:59.338550+0000","last_unstale":"2024-09-12T18:56:02.437289+0000","last_undegraded":"2024-09-12T18:56:02.437289+0000","last_fullsized":"2024-09-12T18:56:02.437289+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:44.861905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439345+0000","last_change":"2024-09-12T18:19:57.871984+0000","last_active":"2024-09-12T18:56:12.439345+0000","last_peered":"2024-09-12T18:56:12.439345+0000","last_clean":"2024-09-12T18:56:12.439345+0000","last_became_active":"2024-09-12T18:19:57.871345+0000","last_became_peered":"2024-09-12T18:19:57.871345+0000","last_unstale":"2024-09-12T18:56:12.439345+0000","last_undegraded":"2024-09-12T18:56:12.439345+0000","last_fullsized":"2024-09-12T18:56:12.439345+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:45.284109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.612304+0000","last_change":"2024-09-12T17:59:43.034960+0000","last_active":"2024-09-12T18:55:27.612304+0000","last_peered":"2024-09-12T18:55:27.612304+0000","last_clean":"2024-09-12T18:55:27.612304+0000","last_became_active":"2024-09-12T17:59:43.034299+0000","last_became_peered":"2024-09-12T17:59:43.034299+0000","last_unstale":"2024-09-12T18:55:27.612304+0000","last_undegraded":"2024-09-12T18:55:27.612304+0000","last_fullsized":"2024-09-12T18:55:27.612304+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:55.095948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.444546+0000","last_change":"2024-09-12T17:59:38.981877+0000","last_active":"2024-09-12T18:55:17.444546+0000","last_peered":"2024-09-12T18:55:17.444546+0000","last_clean":"2024-09-12T18:55:17.444546+0000","last_became_active":"2024-09-12T17:59:38.976348+0000","last_became_peered":"2024-09-12T17:59:38.976348+0000","last_unstale":"2024-09-12T18:55:17.444546+0000","last_undegraded":"2024-09-12T18:55:17.444546+0000","last_fullsized":"2024-09-12T18:55:17.444546+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:41.558530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'16","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437226+0000","last_change":"2024-09-12T17:55:59.357701+0000","last_active":"2024-09-12T18:56:02.437226+0000","last_peered":"2024-09-12T18:56:02.437226+0000","last_clean":"2024-09-12T18:56:02.437226+0000","last_became_active":"2024-09-12T17:55:59.356970+0000","last_became_peered":"2024-09-12T17:55:59.356970+0000","last_unstale":"2024-09-12T18:56:02.437226+0000","last_undegraded":"2024-09-12T18:56:02.437226+0000","last_fullsized":"2024-09-12T18:56:02.437226+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:46.362725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":58,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464203+0000","last_change":"2024-09-12T18:19:57.867587+0000","last_active":"2024-09-12T18:57:27.464203+0000","last_peered":"2024-09-12T18:57:27.464203+0000","last_clean":"2024-09-12T18:57:27.464203+0000","last_became_active":"2024-09-12T18:19:57.865319+0000","last_became_peered":"2024-09-12T18:19:57.865319+0000","last_unstale":"2024-09-12T18:57:27.464203+0000","last_undegraded":"2024-09-12T18:57:27.464203+0000","last_fullsized":"2024-09-12T18:57:27.464203+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:03.710006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'1","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.415707+0000","last_change":"2024-09-12T17:59:56.386718+0000","last_active":"2024-09-12T18:55:17.415707+0000","last_peered":"2024-09-12T18:55:17.415707+0000","last_clean":"2024-09-12T18:55:17.415707+0000","last_became_active":"2024-09-12T17:59:56.386194+0000","last_became_peered":"2024-09-12T17:59:56.386194+0000","last_unstale":"2024-09-12T18:55:17.415707+0000","last_undegraded":"2024-09-12T18:55:17.415707+0000","last_fullsized":"2024-09-12T18:55:17.415707+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:16.043399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'7","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.794094+0000","last_change":"2024-09-12T17:59:38.978120+0000","last_active":"2024-09-12T18:55:27.794094+0000","last_peered":"2024-09-12T18:55:27.794094+0000","last_clean":"2024-09-12T18:55:27.794094+0000","last_became_active":"2024-09-12T17:59:38.977316+0000","last_became_peered":"2024-09-12T17:59:38.977316+0000","last_unstale":"2024-09-12T18:55:27.794094+0000","last_undegraded":"2024-09-12T18:55:27.794094+0000","last_fullsized":"2024-09-12T18:55:27.794094+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:26.707491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":16386,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'37","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.425307+0000","last_change":"2024-09-12T17:55:59.366994+0000","last_active":"2024-09-12T18:56:02.425307+0000","last_peered":"2024-09-12T18:56:02.425307+0000","last_clean":"2024-09-12T18:56:02.425307+0000","last_became_active":"2024-09-12T17:55:59.366177+0000","last_became_peered":"2024-09-12T17:55:59.366177+0000","last_unstale":"2024-09-12T18:56:02.425307+0000","last_undegraded":"2024-09-12T18:56:02.425307+0000","last_fullsized":"2024-09-12T18:56:02.425307+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:03.524473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":133,"num_write":64,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457338+0000","last_change":"2024-09-12T18:19:57.844732+0000","last_active":"2024-09-12T18:57:27.457338+0000","last_peered":"2024-09-12T18:57:27.457338+0000","last_clean":"2024-09-12T18:57:27.457338+0000","last_became_active":"2024-09-12T18:19:57.843946+0000","last_became_peered":"2024-09-12T18:19:57.843946+0000","last_unstale":"2024-09-12T18:57:27.457338+0000","last_undegraded":"2024-09-12T18:57:27.457338+0000","last_fullsized":"2024-09-12T18:57:27.457338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:48.999189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.440013+0000","last_change":"2024-09-12T17:59:43.014049+0000","last_active":"2024-09-12T18:57:12.440013+0000","last_peered":"2024-09-12T18:57:12.440013+0000","last_clean":"2024-09-12T18:57:12.440013+0000","last_became_active":"2024-09-12T17:59:43.013293+0000","last_became_peered":"2024-09-12T17:59:43.013293+0000","last_unstale":"2024-09-12T18:57:12.440013+0000","last_undegraded":"2024-09-12T18:57:12.440013+0000","last_fullsized":"2024-09-12T18:57:12.440013+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:47.290570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.816755+0000","last_change":"2024-09-12T17:59:38.984819+0000","last_active":"2024-09-12T18:57:12.816755+0000","last_peered":"2024-09-12T18:57:12.816755+0000","last_clean":"2024-09-12T18:57:12.816755+0000","last_became_active":"2024-09-12T17:59:38.984004+0000","last_became_peered":"2024-09-12T17:59:38.984004+0000","last_unstale":"2024-09-12T18:57:12.816755+0000","last_undegraded":"2024-09-12T18:57:12.816755+0000","last_fullsized":"2024-09-12T18:57:12.816755+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:47.953455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'21","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463100+0000","last_change":"2024-09-12T17:55:59.367890+0000","last_active":"2024-09-12T18:56:42.463100+0000","last_peered":"2024-09-12T18:56:42.463100+0000","last_clean":"2024-09-12T18:56:42.463100+0000","last_became_active":"2024-09-12T17:55:59.366968+0000","last_became_peered":"2024-09-12T17:55:59.366968+0000","last_unstale":"2024-09-12T18:56:42.463100+0000","last_undegraded":"2024-09-12T18:56:42.463100+0000","last_fullsized":"2024-09-12T18:56:42.463100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:25.297113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457398+0000","last_change":"2024-09-12T18:19:57.871547+0000","last_active":"2024-09-12T18:57:27.457398+0000","last_peered":"2024-09-12T18:57:27.457398+0000","last_clean":"2024-09-12T18:57:27.457398+0000","last_became_active":"2024-09-12T18:19:57.870750+0000","last_became_peered":"2024-09-12T18:19:57.870750+0000","last_unstale":"2024-09-12T18:57:27.457398+0000","last_undegraded":"2024-09-12T18:57:27.457398+0000","last_fullsized":"2024-09-12T18:57:27.457398+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:27.428422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454597+0000","last_change":"2024-09-12T17:59:43.027485+0000","last_active":"2024-09-12T18:57:12.454597+0000","last_peered":"2024-09-12T18:57:12.454597+0000","last_clean":"2024-09-12T18:57:12.454597+0000","last_became_active":"2024-09-12T17:59:43.021777+0000","last_became_peered":"2024-09-12T17:59:43.021777+0000","last_unstale":"2024-09-12T18:57:12.454597+0000","last_undegraded":"2024-09-12T18:57:12.454597+0000","last_fullsized":"2024-09-12T18:57:12.454597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:26.307507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.469779+0000","last_change":"2024-09-12T17:59:38.990405+0000","last_active":"2024-09-12T18:57:12.469779+0000","last_peered":"2024-09-12T18:57:12.469779+0000","last_clean":"2024-09-12T18:57:12.469779+0000","last_became_active":"2024-09-12T17:59:38.989753+0000","last_became_peered":"2024-09-12T17:59:38.989753+0000","last_unstale":"2024-09-12T18:57:12.469779+0000","last_undegraded":"2024-09-12T18:57:12.469779+0000","last_fullsized":"2024-09-12T18:57:12.469779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:31.519684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'22","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.450554+0000","last_change":"2024-09-12T17:55:59.330535+0000","last_active":"2024-09-12T18:56:27.450554+0000","last_peered":"2024-09-12T18:56:27.450554+0000","last_clean":"2024-09-12T18:56:27.450554+0000","last_became_active":"2024-09-12T17:55:59.329792+0000","last_became_peered":"2024-09-12T17:55:59.329792+0000","last_unstale":"2024-09-12T18:56:27.450554+0000","last_undegraded":"2024-09-12T18:56:27.450554+0000","last_fullsized":"2024-09-12T18:56:27.450554+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:50.850228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.461644+0000","last_change":"2024-09-12T18:19:57.868119+0000","last_active":"2024-09-12T18:57:17.461644+0000","last_peered":"2024-09-12T18:57:17.461644+0000","last_clean":"2024-09-12T18:57:17.461644+0000","last_became_active":"2024-09-12T18:19:57.863600+0000","last_became_peered":"2024-09-12T18:19:57.863600+0000","last_unstale":"2024-09-12T18:57:17.461644+0000","last_undegraded":"2024-09-12T18:57:17.461644+0000","last_fullsized":"2024-09-12T18:57:17.461644+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.347599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426455+0000","last_change":"2024-09-12T17:59:43.033456+0000","last_active":"2024-09-12T18:55:17.426455+0000","last_peered":"2024-09-12T18:55:17.426455+0000","last_clean":"2024-09-12T18:55:17.426455+0000","last_became_active":"2024-09-12T17:59:43.031016+0000","last_became_peered":"2024-09-12T17:59:43.031016+0000","last_unstale":"2024-09-12T18:55:17.426455+0000","last_undegraded":"2024-09-12T18:55:17.426455+0000","last_fullsized":"2024-09-12T18:55:17.426455+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:41.898618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:52.618126+0000","last_change":"2024-09-12T17:59:38.966961+0000","last_active":"2024-09-12T18:55:52.618126+0000","last_peered":"2024-09-12T18:55:52.618126+0000","last_clean":"2024-09-12T18:55:52.618126+0000","last_became_active":"2024-09-12T17:59:38.966158+0000","last_became_peered":"2024-09-12T17:59:38.966158+0000","last_unstale":"2024-09-12T18:55:52.618126+0000","last_undegraded":"2024-09-12T18:55:52.618126+0000","last_fullsized":"2024-09-12T18:55:52.618126+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:05.792036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'26","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.460293+0000","last_change":"2024-09-12T17:55:59.367819+0000","last_active":"2024-09-12T18:56:27.460293+0000","last_peered":"2024-09-12T18:56:27.460293+0000","last_clean":"2024-09-12T18:56:27.460293+0000","last_became_active":"2024-09-12T17:55:59.366803+0000","last_became_peered":"2024-09-12T17:55:59.366803+0000","last_unstale":"2024-09-12T18:56:27.460293+0000","last_undegraded":"2024-09-12T18:56:27.460293+0000","last_fullsized":"2024-09-12T18:56:27.460293+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:11.044959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:19.448910+0000","last_change":"2024-09-12T18:19:57.846272+0000","last_active":"2024-09-12T18:57:19.448910+0000","last_peered":"2024-09-12T18:57:19.448910+0000","last_clean":"2024-09-12T18:57:19.448910+0000","last_became_active":"2024-09-12T18:19:57.845474+0000","last_became_peered":"2024-09-12T18:19:57.845474+0000","last_unstale":"2024-09-12T18:57:19.448910+0000","last_undegraded":"2024-09-12T18:57:19.448910+0000","last_fullsized":"2024-09-12T18:57:19.448910+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:36.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437270+0000","last_change":"2024-09-12T17:59:43.034867+0000","last_active":"2024-09-12T18:56:02.437270+0000","last_peered":"2024-09-12T18:56:02.437270+0000","last_clean":"2024-09-12T18:56:02.437270+0000","last_became_active":"2024-09-12T17:59:43.034159+0000","last_became_peered":"2024-09-12T17:59:43.034159+0000","last_unstale":"2024-09-12T18:56:02.437270+0000","last_undegraded":"2024-09-12T18:56:02.437270+0000","last_fullsized":"2024-09-12T18:56:02.437270+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:55.391915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426051+0000","last_change":"2024-09-12T17:59:38.981580+0000","last_active":"2024-09-12T18:55:17.426051+0000","last_peered":"2024-09-12T18:55:17.426051+0000","last_clean":"2024-09-12T18:55:17.426051+0000","last_became_active":"2024-09-12T17:59:38.980797+0000","last_became_peered":"2024-09-12T17:59:38.980797+0000","last_unstale":"2024-09-12T18:55:17.426051+0000","last_undegraded":"2024-09-12T18:55:17.426051+0000","last_fullsized":"2024-09-12T18:55:17.426051+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:47.982971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'6","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442893+0000","last_change":"2024-09-12T17:55:59.367443+0000","last_active":"2024-09-12T18:56:27.442893+0000","last_peered":"2024-09-12T18:56:27.442893+0000","last_clean":"2024-09-12T18:56:27.442893+0000","last_became_active":"2024-09-12T17:55:59.366679+0000","last_became_peered":"2024-09-12T17:55:59.366679+0000","last_unstale":"2024-09-12T18:56:27.442893+0000","last_undegraded":"2024-09-12T18:56:27.442893+0000","last_fullsized":"2024-09-12T18:56:27.442893+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.004334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.454894+0000","last_change":"2024-09-12T18:19:57.841634+0000","last_active":"2024-09-12T18:57:17.454894+0000","last_peered":"2024-09-12T18:57:17.454894+0000","last_clean":"2024-09-12T18:57:17.454894+0000","last_became_active":"2024-09-12T18:19:57.840855+0000","last_became_peered":"2024-09-12T18:19:57.840855+0000","last_unstale":"2024-09-12T18:57:17.454894+0000","last_undegraded":"2024-09-12T18:57:17.454894+0000","last_fullsized":"2024-09-12T18:57:17.454894+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:43.276958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426540+0000","last_change":"2024-09-12T17:59:43.029670+0000","last_active":"2024-09-12T18:55:17.426540+0000","last_peered":"2024-09-12T18:55:17.426540+0000","last_clean":"2024-09-12T18:55:17.426540+0000","last_became_active":"2024-09-12T17:59:43.021538+0000","last_became_peered":"2024-09-12T17:59:43.021538+0000","last_unstale":"2024-09-12T18:55:17.426540+0000","last_undegraded":"2024-09-12T18:55:17.426540+0000","last_fullsized":"2024-09-12T18:55:17.426540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:19.134601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:14.423842+0000","last_change":"2024-09-12T17:59:38.980849+0000","last_active":"2024-09-12T18:55:14.423842+0000","last_peered":"2024-09-12T18:55:14.423842+0000","last_clean":"2024-09-12T18:55:14.423842+0000","last_became_active":"2024-09-12T17:59:38.979939+0000","last_became_peered":"2024-09-12T17:59:38.979939+0000","last_unstale":"2024-09-12T18:55:14.423842+0000","last_undegraded":"2024-09-12T18:55:14.423842+0000","last_fullsized":"2024-09-12T18:55:14.423842+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:42.205852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'36","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:24.438322+0000","last_change":"2024-09-12T17:55:59.331420+0000","last_active":"2024-09-12T18:56:24.438322+0000","last_peered":"2024-09-12T18:56:24.438322+0000","last_clean":"2024-09-12T18:56:24.438322+0000","last_became_active":"2024-09-12T17:55:59.330570+0000","last_became_peered":"2024-09-12T17:55:59.330570+0000","last_unstale":"2024-09-12T18:56:24.438322+0000","last_undegraded":"2024-09-12T18:56:24.438322+0000","last_fullsized":"2024-09-12T18:56:24.438322+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:37.462782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":139,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637308+0000","last_change":"2024-09-12T18:19:57.854199+0000","last_active":"2024-09-12T18:57:17.637308+0000","last_peered":"2024-09-12T18:57:17.637308+0000","last_clean":"2024-09-12T18:57:17.637308+0000","last_became_active":"2024-09-12T18:19:57.853269+0000","last_became_peered":"2024-09-12T18:19:57.853269+0000","last_unstale":"2024-09-12T18:57:17.637308+0000","last_undegraded":"2024-09-12T18:57:17.637308+0000","last_fullsized":"2024-09-12T18:57:17.637308+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:58.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.791801+0000","last_change":"2024-09-12T17:59:43.022601+0000","last_active":"2024-09-12T18:55:17.791801+0000","last_peered":"2024-09-12T18:55:17.791801+0000","last_clean":"2024-09-12T18:55:17.791801+0000","last_became_active":"2024-09-12T17:59:43.020450+0000","last_became_peered":"2024-09-12T17:59:43.020450+0000","last_unstale":"2024-09-12T18:55:17.791801+0000","last_undegraded":"2024-09-12T18:55:17.791801+0000","last_fullsized":"2024-09-12T18:55:17.791801+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:53.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'5","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.444851+0000","last_change":"2024-09-12T17:59:38.983301+0000","last_active":"2024-09-12T18:55:17.444851+0000","last_peered":"2024-09-12T18:55:17.444851+0000","last_clean":"2024-09-12T18:55:17.444851+0000","last_became_active":"2024-09-12T17:59:38.982556+0000","last_became_peered":"2024-09-12T17:59:38.982556+0000","last_unstale":"2024-09-12T18:55:17.444851+0000","last_undegraded":"2024-09-12T18:55:17.444851+0000","last_fullsized":"2024-09-12T18:55:17.444851+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:24.195379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'83","reported_seq":293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450356+0000","last_change":"2024-09-12T17:55:59.364021+0000","last_active":"2024-09-12T18:56:57.450356+0000","last_peered":"2024-09-12T18:56:57.450356+0000","last_clean":"2024-09-12T18:56:57.450356+0000","last_became_active":"2024-09-12T17:55:59.363431+0000","last_became_peered":"2024-09-12T17:55:59.363431+0000","last_unstale":"2024-09-12T18:56:57.450356+0000","last_undegraded":"2024-09-12T18:56:57.450356+0000","last_fullsized":"2024-09-12T18:56:57.450356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.240236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":321,"num_write":127,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439374+0000","last_change":"2024-09-12T18:19:57.836599+0000","last_active":"2024-09-12T18:56:12.439374+0000","last_peered":"2024-09-12T18:56:12.439374+0000","last_clean":"2024-09-12T18:56:12.439374+0000","last_became_active":"2024-09-12T18:19:57.835852+0000","last_became_peered":"2024-09-12T18:19:57.835852+0000","last_unstale":"2024-09-12T18:56:12.439374+0000","last_undegraded":"2024-09-12T18:56:12.439374+0000","last_fullsized":"2024-09-12T18:56:12.439374+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:03.387557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'1","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.441459+0000","last_change":"2024-09-12T17:59:43.024923+0000","last_active":"2024-09-12T18:55:42.441459+0000","last_peered":"2024-09-12T18:55:42.441459+0000","last_clean":"2024-09-12T18:55:42.441459+0000","last_became_active":"2024-09-12T17:59:43.024103+0000","last_became_peered":"2024-09-12T17:59:43.024103+0000","last_unstale":"2024-09-12T18:55:42.441459+0000","last_undegraded":"2024-09-12T18:55:42.441459+0000","last_fullsized":"2024-09-12T18:55:42.441459+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:49.895418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.797325+0000","last_change":"2024-09-12T17:59:38.978753+0000","last_active":"2024-09-12T18:55:42.797325+0000","last_peered":"2024-09-12T18:55:42.797325+0000","last_clean":"2024-09-12T18:55:42.797325+0000","last_became_active":"2024-09-12T17:59:38.978126+0000","last_became_peered":"2024-09-12T17:59:38.978126+0000","last_unstale":"2024-09-12T18:55:42.797325+0000","last_undegraded":"2024-09-12T18:55:42.797325+0000","last_fullsized":"2024-09-12T18:55:42.797325+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:24.186587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'82","reported_seq":334,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446848+0000","last_change":"2024-09-12T17:55:59.364464+0000","last_active":"2024-09-12T18:56:42.446848+0000","last_peered":"2024-09-12T18:56:42.446848+0000","last_clean":"2024-09-12T18:56:42.446848+0000","last_became_active":"2024-09-12T17:55:59.363574+0000","last_became_peered":"2024-09-12T17:55:59.363574+0000","last_unstale":"2024-09-12T18:56:42.446848+0000","last_undegraded":"2024-09-12T18:56:42.446848+0000","last_fullsized":"2024-09-12T18:56:42.446848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:45.008706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":530,"num_read_kb":371,"num_write":118,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456819+0000","last_change":"2024-09-12T18:19:57.847909+0000","last_active":"2024-09-12T18:56:12.456819+0000","last_peered":"2024-09-12T18:56:12.456819+0000","last_clean":"2024-09-12T18:56:12.456819+0000","last_became_active":"2024-09-12T18:19:57.847092+0000","last_became_peered":"2024-09-12T18:19:57.847092+0000","last_unstale":"2024-09-12T18:56:12.456819+0000","last_undegraded":"2024-09-12T18:56:12.456819+0000","last_fullsized":"2024-09-12T18:56:12.456819+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:58.160509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.441383+0000","last_change":"2024-09-12T17:59:43.034884+0000","last_active":"2024-09-12T18:55:42.441383+0000","last_peered":"2024-09-12T18:55:42.441383+0000","last_clean":"2024-09-12T18:55:42.441383+0000","last_became_active":"2024-09-12T17:59:43.034180+0000","last_became_peered":"2024-09-12T17:59:43.034180+0000","last_unstale":"2024-09-12T18:55:42.441383+0000","last_undegraded":"2024-09-12T18:55:42.441383+0000","last_fullsized":"2024-09-12T18:55:42.441383+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:28.291989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.432566+0000","last_change":"2024-09-12T17:59:38.976298+0000","last_active":"2024-09-12T18:55:42.432566+0000","last_peered":"2024-09-12T18:55:42.432566+0000","last_clean":"2024-09-12T18:55:42.432566+0000","last_became_active":"2024-09-12T17:59:38.969338+0000","last_became_peered":"2024-09-12T17:59:38.969338+0000","last_unstale":"2024-09-12T18:55:42.432566+0000","last_undegraded":"2024-09-12T18:55:42.432566+0000","last_fullsized":"2024-09-12T18:55:42.432566+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:06.102519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'36","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463141+0000","last_change":"2024-09-12T17:55:59.357946+0000","last_active":"2024-09-12T18:56:42.463141+0000","last_peered":"2024-09-12T18:56:42.463141+0000","last_clean":"2024-09-12T18:56:42.463141+0000","last_became_active":"2024-09-12T17:55:59.357330+0000","last_became_peered":"2024-09-12T17:55:59.357330+0000","last_unstale":"2024-09-12T18:56:42.463141+0000","last_undegraded":"2024-09-12T18:56:42.463141+0000","last_fullsized":"2024-09-12T18:56:42.463141+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.691647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":130,"num_write":63,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473367+0000","last_change":"2024-09-12T18:19:57.840998+0000","last_active":"2024-09-12T18:57:27.473367+0000","last_peered":"2024-09-12T18:57:27.473367+0000","last_clean":"2024-09-12T18:57:27.473367+0000","last_became_active":"2024-09-12T18:19:57.839696+0000","last_became_peered":"2024-09-12T18:19:57.839696+0000","last_unstale":"2024-09-12T18:57:27.473367+0000","last_undegraded":"2024-09-12T18:57:27.473367+0000","last_fullsized":"2024-09-12T18:57:27.473367+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:36.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.432690+0000","last_change":"2024-09-12T17:59:43.031197+0000","last_active":"2024-09-12T18:55:42.432690+0000","last_peered":"2024-09-12T18:55:42.432690+0000","last_clean":"2024-09-12T18:55:42.432690+0000","last_became_active":"2024-09-12T17:59:43.030490+0000","last_became_peered":"2024-09-12T17:59:43.030490+0000","last_unstale":"2024-09-12T18:55:42.432690+0000","last_undegraded":"2024-09-12T18:55:42.432690+0000","last_fullsized":"2024-09-12T18:55:42.432690+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:07.847587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8972971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":16955,"num_write":3,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"261'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421218+0000","last_change":"2024-09-12T17:59:38.990771+0000","last_active":"2024-09-12T18:55:42.421218+0000","last_peered":"2024-09-12T18:55:42.421218+0000","last_clean":"2024-09-12T18:55:42.421218+0000","last_became_active":"2024-09-12T17:59:38.990212+0000","last_became_peered":"2024-09-12T17:59:38.990212+0000","last_unstale":"2024-09-12T18:55:42.421218+0000","last_undegraded":"2024-09-12T18:55:42.421218+0000","last_fullsized":"2024-09-12T18:55:42.421218+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:13.467525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'28","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.810172+0000","last_change":"2024-09-12T17:55:59.357645+0000","last_active":"2024-09-12T18:56:42.810172+0000","last_peered":"2024-09-12T18:56:42.810172+0000","last_clean":"2024-09-12T18:56:42.810172+0000","last_became_active":"2024-09-12T17:55:59.356838+0000","last_became_peered":"2024-09-12T17:55:59.356838+0000","last_unstale":"2024-09-12T18:56:42.810172+0000","last_undegraded":"2024-09-12T18:56:42.810172+0000","last_fullsized":"2024-09-12T18:56:42.810172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:09.388925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":96,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439310+0000","last_change":"2024-09-12T18:19:57.837873+0000","last_active":"2024-09-12T18:56:12.439310+0000","last_peered":"2024-09-12T18:56:12.439310+0000","last_clean":"2024-09-12T18:56:12.439310+0000","last_became_active":"2024-09-12T18:19:57.837079+0000","last_became_peered":"2024-09-12T18:19:57.837079+0000","last_unstale":"2024-09-12T18:56:12.439310+0000","last_undegraded":"2024-09-12T18:56:12.439310+0000","last_fullsized":"2024-09-12T18:56:12.439310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:28.254760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421187+0000","last_change":"2024-09-12T17:59:43.033009+0000","last_active":"2024-09-12T18:55:42.421187+0000","last_peered":"2024-09-12T18:55:42.421187+0000","last_clean":"2024-09-12T18:55:42.421187+0000","last_became_active":"2024-09-12T17:59:43.032008+0000","last_became_peered":"2024-09-12T17:59:43.032008+0000","last_unstale":"2024-09-12T18:55:42.421187+0000","last_undegraded":"2024-09-12T18:55:42.421187+0000","last_fullsized":"2024-09-12T18:55:42.421187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:48.490537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'4","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.615900+0000","last_change":"2024-09-12T17:59:38.982851+0000","last_active":"2024-09-12T18:55:42.615900+0000","last_peered":"2024-09-12T18:55:42.615900+0000","last_clean":"2024-09-12T18:55:42.615900+0000","last_became_active":"2024-09-12T17:59:38.982037+0000","last_became_peered":"2024-09-12T17:59:38.982037+0000","last_unstale":"2024-09-12T18:55:42.615900+0000","last_undegraded":"2024-09-12T18:55:42.615900+0000","last_fullsized":"2024-09-12T18:55:42.615900+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:27.861115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446599+0000","last_change":"2024-09-12T17:55:59.358325+0000","last_active":"2024-09-12T18:56:42.446599+0000","last_peered":"2024-09-12T18:56:42.446599+0000","last_clean":"2024-09-12T18:56:42.446599+0000","last_became_active":"2024-09-12T17:55:59.357659+0000","last_became_peered":"2024-09-12T17:55:59.357659+0000","last_unstale":"2024-09-12T18:56:42.446599+0000","last_undegraded":"2024-09-12T18:56:42.446599+0000","last_fullsized":"2024-09-12T18:56:42.446599+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:47.942214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":69,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:59.444670+0000","last_change":"2024-09-12T18:19:57.850425+0000","last_active":"2024-09-12T18:56:59.444670+0000","last_peered":"2024-09-12T18:56:59.444670+0000","last_clean":"2024-09-12T18:56:59.444670+0000","last_became_active":"2024-09-12T18:19:57.849682+0000","last_became_peered":"2024-09-12T18:19:57.849682+0000","last_unstale":"2024-09-12T18:56:59.444670+0000","last_undegraded":"2024-09-12T18:56:59.444670+0000","last_fullsized":"2024-09-12T18:56:59.444670+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:20.403776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'1","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436381+0000","last_change":"2024-09-12T17:59:43.027722+0000","last_active":"2024-09-12T18:55:57.436381+0000","last_peered":"2024-09-12T18:55:57.436381+0000","last_clean":"2024-09-12T18:55:57.436381+0000","last_became_active":"2024-09-12T17:59:43.026619+0000","last_became_peered":"2024-09-12T17:59:43.026619+0000","last_unstale":"2024-09-12T18:55:57.436381+0000","last_undegraded":"2024-09-12T18:55:57.436381+0000","last_fullsized":"2024-09-12T18:55:57.436381+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:14.706171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436215+0000","last_change":"2024-09-12T17:59:38.988617+0000","last_active":"2024-09-12T18:55:57.436215+0000","last_peered":"2024-09-12T18:55:57.436215+0000","last_clean":"2024-09-12T18:55:57.436215+0000","last_became_active":"2024-09-12T17:59:38.988028+0000","last_became_peered":"2024-09-12T17:59:38.988028+0000","last_unstale":"2024-09-12T18:55:57.436215+0000","last_undegraded":"2024-09-12T18:55:57.436215+0000","last_fullsized":"2024-09-12T18:55:57.436215+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:44.387070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'56","reported_seq":214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.453486+0000","last_change":"2024-09-12T17:55:59.361430+0000","last_active":"2024-09-12T18:57:07.453486+0000","last_peered":"2024-09-12T18:57:07.453486+0000","last_clean":"2024-09-12T18:57:07.453486+0000","last_became_active":"2024-09-12T17:55:59.360197+0000","last_became_peered":"2024-09-12T17:55:59.360197+0000","last_unstale":"2024-09-12T18:57:07.453486+0000","last_undegraded":"2024-09-12T18:57:07.453486+0000","last_fullsized":"2024-09-12T18:57:07.453486+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:56.611826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":199,"num_write":102,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436067+0000","last_change":"2024-09-12T18:19:57.869950+0000","last_active":"2024-09-12T18:55:57.436067+0000","last_peered":"2024-09-12T18:55:57.436067+0000","last_clean":"2024-09-12T18:55:57.436067+0000","last_became_active":"2024-09-12T18:19:57.869302+0000","last_became_peered":"2024-09-12T18:19:57.869302+0000","last_unstale":"2024-09-12T18:55:57.436067+0000","last_undegraded":"2024-09-12T18:55:57.436067+0000","last_fullsized":"2024-09-12T18:55:57.436067+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:38.615499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436275+0000","last_change":"2024-09-12T17:59:43.034683+0000","last_active":"2024-09-12T18:55:57.436275+0000","last_peered":"2024-09-12T18:55:57.436275+0000","last_clean":"2024-09-12T18:55:57.436275+0000","last_became_active":"2024-09-12T17:59:43.030846+0000","last_became_peered":"2024-09-12T17:59:43.030846+0000","last_unstale":"2024-09-12T18:55:57.436275+0000","last_undegraded":"2024-09-12T18:55:57.436275+0000","last_fullsized":"2024-09-12T18:55:57.436275+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:40.165184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:54.432260+0000","last_change":"2024-09-12T17:59:38.969547+0000","last_active":"2024-09-12T18:55:54.432260+0000","last_peered":"2024-09-12T18:55:54.432260+0000","last_clean":"2024-09-12T18:55:54.432260+0000","last_became_active":"2024-09-12T17:59:38.968775+0000","last_became_peered":"2024-09-12T17:59:38.968775+0000","last_unstale":"2024-09-12T18:55:54.432260+0000","last_undegraded":"2024-09-12T18:55:54.432260+0000","last_fullsized":"2024-09-12T18:55:54.432260+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:07.669336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48431,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":5,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.630374+0000","last_change":"2024-09-12T17:55:59.362984+0000","last_active":"2024-09-12T18:56:47.630374+0000","last_peered":"2024-09-12T18:56:47.630374+0000","last_clean":"2024-09-12T18:56:47.630374+0000","last_became_active":"2024-09-12T17:55:59.358747+0000","last_became_peered":"2024-09-12T17:55:59.358747+0000","last_unstale":"2024-09-12T18:56:47.630374+0000","last_undegraded":"2024-09-12T18:56:47.630374+0000","last_fullsized":"2024-09-12T18:56:47.630374+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:28.675045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.434729+0000","last_change":"2024-09-12T18:19:57.823688+0000","last_active":"2024-09-12T18:56:47.434729+0000","last_peered":"2024-09-12T18:56:47.434729+0000","last_clean":"2024-09-12T18:56:47.434729+0000","last_became_active":"2024-09-12T18:19:57.822958+0000","last_became_peered":"2024-09-12T18:19:57.822958+0000","last_unstale":"2024-09-12T18:56:47.434729+0000","last_undegraded":"2024-09-12T18:56:47.434729+0000","last_fullsized":"2024-09-12T18:56:47.434729+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:54.471704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'4","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447688+0000","last_change":"2024-09-12T17:59:43.007833+0000","last_active":"2024-09-12T18:56:12.447688+0000","last_peered":"2024-09-12T18:56:12.447688+0000","last_clean":"2024-09-12T18:56:12.447688+0000","last_became_active":"2024-09-12T17:59:43.006748+0000","last_became_peered":"2024-09-12T17:59:43.006748+0000","last_unstale":"2024-09-12T18:56:12.447688+0000","last_undegraded":"2024-09-12T18:56:12.447688+0000","last_fullsized":"2024-09-12T18:56:12.447688+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:10.151387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453872+0000","last_change":"2024-09-12T17:59:38.963724+0000","last_active":"2024-09-12T18:55:57.453872+0000","last_peered":"2024-09-12T18:55:57.453872+0000","last_clean":"2024-09-12T18:55:57.453872+0000","last_became_active":"2024-09-12T17:59:38.962944+0000","last_became_peered":"2024-09-12T17:59:38.962944+0000","last_unstale":"2024-09-12T18:55:57.453872+0000","last_undegraded":"2024-09-12T18:55:57.453872+0000","last_fullsized":"2024-09-12T18:55:57.453872+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:57.731165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'30","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.434839+0000","last_change":"2024-09-12T17:55:59.347093+0000","last_active":"2024-09-12T18:56:47.434839+0000","last_peered":"2024-09-12T18:56:47.434839+0000","last_clean":"2024-09-12T18:56:47.434839+0000","last_became_active":"2024-09-12T17:55:59.345735+0000","last_became_peered":"2024-09-12T17:55:59.345735+0000","last_unstale":"2024-09-12T18:56:47.434839+0000","last_undegraded":"2024-09-12T18:56:47.434839+0000","last_fullsized":"2024-09-12T18:56:47.434839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:02.647291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.447954+0000","last_change":"2024-09-12T18:19:57.856472+0000","last_active":"2024-09-12T18:56:47.447954+0000","last_peered":"2024-09-12T18:56:47.447954+0000","last_clean":"2024-09-12T18:56:47.447954+0000","last_became_active":"2024-09-12T18:19:57.855728+0000","last_became_peered":"2024-09-12T18:19:57.855728+0000","last_unstale":"2024-09-12T18:56:47.447954+0000","last_undegraded":"2024-09-12T18:56:47.447954+0000","last_fullsized":"2024-09-12T18:56:47.447954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:06.104974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'1","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436433+0000","last_change":"2024-09-12T17:59:43.020154+0000","last_active":"2024-09-12T18:55:57.436433+0000","last_peered":"2024-09-12T18:55:57.436433+0000","last_clean":"2024-09-12T18:55:57.436433+0000","last_became_active":"2024-09-12T17:59:43.019325+0000","last_became_peered":"2024-09-12T17:59:43.019325+0000","last_unstale":"2024-09-12T18:55:57.436433+0000","last_undegraded":"2024-09-12T18:55:57.436433+0000","last_fullsized":"2024-09-12T18:55:57.436433+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.764700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447641+0000","last_change":"2024-09-12T17:59:38.978392+0000","last_active":"2024-09-12T18:56:12.447641+0000","last_peered":"2024-09-12T18:56:12.447641+0000","last_clean":"2024-09-12T18:56:12.447641+0000","last_became_active":"2024-09-12T17:59:38.977733+0000","last_became_peered":"2024-09-12T17:59:38.977733+0000","last_unstale":"2024-09-12T18:56:12.447641+0000","last_undegraded":"2024-09-12T18:56:12.447641+0000","last_fullsized":"2024-09-12T18:56:12.447641+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:10.294635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'50","reported_seq":197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:44.441874+0000","last_change":"2024-09-12T17:55:59.341871+0000","last_active":"2024-09-12T18:56:44.441874+0000","last_peered":"2024-09-12T18:56:44.441874+0000","last_clean":"2024-09-12T18:56:44.441874+0000","last_became_active":"2024-09-12T17:55:59.341145+0000","last_became_peered":"2024-09-12T17:55:59.341145+0000","last_unstale":"2024-09-12T18:56:44.441874+0000","last_undegraded":"2024-09-12T18:56:44.441874+0000","last_fullsized":"2024-09-12T18:56:44.441874+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:36.782820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":177,"num_write":99,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436472+0000","last_change":"2024-09-12T18:19:57.865840+0000","last_active":"2024-09-12T18:55:57.436472+0000","last_peered":"2024-09-12T18:55:57.436472+0000","last_clean":"2024-09-12T18:55:57.436472+0000","last_became_active":"2024-09-12T18:19:57.865311+0000","last_became_peered":"2024-09-12T18:19:57.865311+0000","last_unstale":"2024-09-12T18:55:57.436472+0000","last_undegraded":"2024-09-12T18:55:57.436472+0000","last_fullsized":"2024-09-12T18:55:57.436472+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:05.947872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'7","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.801680+0000","last_change":"2024-09-12T17:59:43.030010+0000","last_active":"2024-09-12T18:56:02.801680+0000","last_peered":"2024-09-12T18:56:02.801680+0000","last_clean":"2024-09-12T18:56:02.801680+0000","last_became_active":"2024-09-12T17:59:43.029489+0000","last_became_peered":"2024-09-12T17:59:43.029489+0000","last_unstale":"2024-09-12T18:56:02.801680+0000","last_undegraded":"2024-09-12T18:56:02.801680+0000","last_fullsized":"2024-09-12T18:56:02.801680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:49.435494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.454562+0000","last_change":"2024-09-12T17:59:38.976141+0000","last_active":"2024-09-12T18:56:02.454562+0000","last_peered":"2024-09-12T18:56:02.454562+0000","last_clean":"2024-09-12T18:56:02.454562+0000","last_became_active":"2024-09-12T17:59:38.965185+0000","last_became_peered":"2024-09-12T17:59:38.965185+0000","last_unstale":"2024-09-12T18:56:02.454562+0000","last_undegraded":"2024-09-12T18:56:02.454562+0000","last_fullsized":"2024-09-12T18:56:02.454562+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:28.251671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'20","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464249+0000","last_change":"2024-09-12T17:55:59.360413+0000","last_active":"2024-09-12T18:56:47.464249+0000","last_peered":"2024-09-12T18:56:47.464249+0000","last_clean":"2024-09-12T18:56:47.464249+0000","last_became_active":"2024-09-12T17:55:59.359849+0000","last_became_peered":"2024-09-12T17:55:59.359849+0000","last_unstale":"2024-09-12T18:56:47.464249+0000","last_undegraded":"2024-09-12T18:56:47.464249+0000","last_fullsized":"2024-09-12T18:56:47.464249+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:05.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:07.438710+0000","last_change":"2024-09-12T18:19:57.855820+0000","last_active":"2024-09-12T18:56:07.438710+0000","last_peered":"2024-09-12T18:56:07.438710+0000","last_clean":"2024-09-12T18:56:07.438710+0000","last_became_active":"2024-09-12T18:19:57.855140+0000","last_became_peered":"2024-09-12T18:19:57.855140+0000","last_unstale":"2024-09-12T18:56:07.438710+0000","last_undegraded":"2024-09-12T18:56:07.438710+0000","last_fullsized":"2024-09-12T18:56:07.438710+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:19.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437282+0000","last_change":"2024-09-12T17:59:43.016545+0000","last_active":"2024-09-12T18:56:02.437282+0000","last_peered":"2024-09-12T18:56:02.437282+0000","last_clean":"2024-09-12T18:56:02.437282+0000","last_became_active":"2024-09-12T17:59:43.015273+0000","last_became_peered":"2024-09-12T17:59:43.015273+0000","last_unstale":"2024-09-12T18:56:02.437282+0000","last_undegraded":"2024-09-12T18:56:02.437282+0000","last_fullsized":"2024-09-12T18:56:02.437282+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:00.852160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'6","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.445112+0000","last_change":"2024-09-12T17:59:38.985394+0000","last_active":"2024-09-12T18:56:02.445112+0000","last_peered":"2024-09-12T18:56:02.445112+0000","last_clean":"2024-09-12T18:56:02.445112+0000","last_became_active":"2024-09-12T17:59:38.984684+0000","last_became_peered":"2024-09-12T17:59:38.984684+0000","last_unstale":"2024-09-12T18:56:02.445112+0000","last_undegraded":"2024-09-12T18:56:02.445112+0000","last_fullsized":"2024-09-12T18:56:02.445112+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:33.698538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'48","reported_seq":197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450249+0000","last_change":"2024-09-12T17:55:59.346860+0000","last_active":"2024-09-12T18:56:57.450249+0000","last_peered":"2024-09-12T18:56:57.450249+0000","last_clean":"2024-09-12T18:56:57.450249+0000","last_became_active":"2024-09-12T17:55:59.346128+0000","last_became_peered":"2024-09-12T17:55:59.346128+0000","last_unstale":"2024-09-12T18:56:57.450249+0000","last_undegraded":"2024-09-12T18:56:57.450249+0000","last_fullsized":"2024-09-12T18:56:57.450249+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:20.618591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":194,"num_write":71,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436169+0000","last_change":"2024-09-12T18:19:57.851475+0000","last_active":"2024-09-12T18:55:57.436169+0000","last_peered":"2024-09-12T18:55:57.436169+0000","last_clean":"2024-09-12T18:55:57.436169+0000","last_became_active":"2024-09-12T18:19:57.848892+0000","last_became_peered":"2024-09-12T18:19:57.848892+0000","last_unstale":"2024-09-12T18:55:57.436169+0000","last_undegraded":"2024-09-12T18:55:57.436169+0000","last_fullsized":"2024-09-12T18:55:57.436169+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:29.052912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'5","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.444266+0000","last_change":"2024-09-12T17:59:43.038219+0000","last_active":"2024-09-12T18:55:57.444266+0000","last_peered":"2024-09-12T18:55:57.444266+0000","last_clean":"2024-09-12T18:55:57.444266+0000","last_became_active":"2024-09-12T17:59:43.034558+0000","last_became_peered":"2024-09-12T17:59:43.034558+0000","last_unstale":"2024-09-12T18:55:57.444266+0000","last_undegraded":"2024-09-12T18:55:57.444266+0000","last_fullsized":"2024-09-12T18:55:57.444266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:16.222044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.457891+0000","last_change":"2024-09-12T17:59:38.981757+0000","last_active":"2024-09-12T18:56:17.457891+0000","last_peered":"2024-09-12T18:56:17.457891+0000","last_clean":"2024-09-12T18:56:17.457891+0000","last_became_active":"2024-09-12T17:59:38.973403+0000","last_became_peered":"2024-09-12T17:59:38.973403+0000","last_unstale":"2024-09-12T18:56:17.457891+0000","last_undegraded":"2024-09-12T18:56:17.457891+0000","last_fullsized":"2024-09-12T18:56:17.457891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:16.251811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'38","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446643+0000","last_change":"2024-09-12T17:55:59.346585+0000","last_active":"2024-09-12T18:56:42.446643+0000","last_peered":"2024-09-12T18:56:42.446643+0000","last_clean":"2024-09-12T18:56:42.446643+0000","last_became_active":"2024-09-12T17:55:59.345382+0000","last_became_peered":"2024-09-12T17:55:59.345382+0000","last_unstale":"2024-09-12T18:56:42.446643+0000","last_undegraded":"2024-09-12T18:56:42.446643+0000","last_fullsized":"2024-09-12T18:56:42.446643+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:18.100800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":134,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453836+0000","last_change":"2024-09-12T18:19:57.844298+0000","last_active":"2024-09-12T18:55:57.453836+0000","last_peered":"2024-09-12T18:55:57.453836+0000","last_clean":"2024-09-12T18:55:57.453836+0000","last_became_active":"2024-09-12T18:19:57.843489+0000","last_became_peered":"2024-09-12T18:19:57.843489+0000","last_unstale":"2024-09-12T18:55:57.453836+0000","last_undegraded":"2024-09-12T18:55:57.453836+0000","last_fullsized":"2024-09-12T18:55:57.453836+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:30.667507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.440945+0000","last_change":"2024-09-12T17:59:43.023323+0000","last_active":"2024-09-12T18:56:17.440945+0000","last_peered":"2024-09-12T18:56:17.440945+0000","last_clean":"2024-09-12T18:56:17.440945+0000","last_became_active":"2024-09-12T17:59:43.022592+0000","last_became_peered":"2024-09-12T17:59:43.022592+0000","last_unstale":"2024-09-12T18:56:17.440945+0000","last_undegraded":"2024-09-12T18:56:17.440945+0000","last_fullsized":"2024-09-12T18:56:17.440945+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:49.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'3","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800656+0000","last_change":"2024-09-12T17:59:38.976388+0000","last_active":"2024-09-12T18:55:57.800656+0000","last_peered":"2024-09-12T18:55:57.800656+0000","last_clean":"2024-09-12T18:55:57.800656+0000","last_became_active":"2024-09-12T17:59:38.975635+0000","last_became_peered":"2024-09-12T17:59:38.975635+0000","last_unstale":"2024-09-12T18:55:57.800656+0000","last_undegraded":"2024-09-12T18:55:57.800656+0000","last_fullsized":"2024-09-12T18:55:57.800656+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:08.497281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'44","reported_seq":180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433653+0000","last_change":"2024-09-12T17:55:59.352208+0000","last_active":"2024-09-12T18:56:42.433653+0000","last_peered":"2024-09-12T18:56:42.433653+0000","last_clean":"2024-09-12T18:56:42.433653+0000","last_became_active":"2024-09-12T17:55:59.351492+0000","last_became_peered":"2024-09-12T17:55:59.351492+0000","last_unstale":"2024-09-12T18:56:42.433653+0000","last_undegraded":"2024-09-12T18:56:42.433653+0000","last_fullsized":"2024-09-12T18:56:42.433653+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:59.997737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":151,"num_write":82,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457255+0000","last_change":"2024-09-12T18:19:57.856229+0000","last_active":"2024-09-12T18:57:27.457255+0000","last_peered":"2024-09-12T18:57:27.457255+0000","last_clean":"2024-09-12T18:57:27.457255+0000","last_became_active":"2024-09-12T18:19:57.855547+0000","last_became_peered":"2024-09-12T18:19:57.855547+0000","last_unstale":"2024-09-12T18:57:27.457255+0000","last_undegraded":"2024-09-12T18:57:27.457255+0000","last_fullsized":"2024-09-12T18:57:27.457255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:07.356723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'9","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456706+0000","last_change":"2024-09-12T17:59:43.010558+0000","last_active":"2024-09-12T18:56:12.456706+0000","last_peered":"2024-09-12T18:56:12.456706+0000","last_clean":"2024-09-12T18:56:12.456706+0000","last_became_active":"2024-09-12T17:59:43.009629+0000","last_became_peered":"2024-09-12T17:59:43.009629+0000","last_unstale":"2024-09-12T18:56:12.456706+0000","last_undegraded":"2024-09-12T18:56:12.456706+0000","last_fullsized":"2024-09-12T18:56:12.456706+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:57.722700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":19,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436134+0000","last_change":"2024-09-12T17:59:38.980397+0000","last_active":"2024-09-12T18:55:57.436134+0000","last_peered":"2024-09-12T18:55:57.436134+0000","last_clean":"2024-09-12T18:55:57.436134+0000","last_became_active":"2024-09-12T17:59:38.979704+0000","last_became_peered":"2024-09-12T17:59:38.979704+0000","last_unstale":"2024-09-12T18:55:57.436134+0000","last_undegraded":"2024-09-12T18:55:57.436134+0000","last_fullsized":"2024-09-12T18:55:57.436134+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:15.520490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463327+0000","last_change":"2024-09-12T17:55:59.357098+0000","last_active":"2024-09-12T18:56:42.463327+0000","last_peered":"2024-09-12T18:56:42.463327+0000","last_clean":"2024-09-12T18:56:42.463327+0000","last_became_active":"2024-09-12T17:55:59.356402+0000","last_became_peered":"2024-09-12T17:55:59.356402+0000","last_unstale":"2024-09-12T18:56:42.463327+0000","last_undegraded":"2024-09-12T18:56:42.463327+0000","last_fullsized":"2024-09-12T18:56:42.463327+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:21.680579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639954+0000","last_change":"2024-09-12T18:19:57.860245+0000","last_active":"2024-09-12T18:57:27.639954+0000","last_peered":"2024-09-12T18:57:27.639954+0000","last_clean":"2024-09-12T18:57:27.639954+0000","last_became_active":"2024-09-12T18:19:57.859591+0000","last_became_peered":"2024-09-12T18:19:57.859591+0000","last_unstale":"2024-09-12T18:57:27.639954+0000","last_undegraded":"2024-09-12T18:57:27.639954+0000","last_fullsized":"2024-09-12T18:57:27.639954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:28.131141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453794+0000","last_change":"2024-09-12T17:59:43.009259+0000","last_active":"2024-09-12T18:55:57.453794+0000","last_peered":"2024-09-12T18:55:57.453794+0000","last_clean":"2024-09-12T18:55:57.453794+0000","last_became_active":"2024-09-12T17:59:43.008547+0000","last_became_peered":"2024-09-12T17:59:43.008547+0000","last_unstale":"2024-09-12T18:55:57.453794+0000","last_undegraded":"2024-09-12T18:55:57.453794+0000","last_fullsized":"2024-09-12T18:55:57.453794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:53.908690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:09.435251+0000","last_change":"2024-09-12T17:59:38.969392+0000","last_active":"2024-09-12T18:56:09.435251+0000","last_peered":"2024-09-12T18:56:09.435251+0000","last_clean":"2024-09-12T18:56:09.435251+0000","last_became_active":"2024-09-12T17:59:38.968249+0000","last_became_peered":"2024-09-12T17:59:38.968249+0000","last_unstale":"2024-09-12T18:56:09.435251+0000","last_undegraded":"2024-09-12T18:56:09.435251+0000","last_fullsized":"2024-09-12T18:56:09.435251+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.740724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'17","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433857+0000","last_change":"2024-09-12T17:55:59.355112+0000","last_active":"2024-09-12T18:56:42.433857+0000","last_peered":"2024-09-12T18:56:42.433857+0000","last_clean":"2024-09-12T18:56:42.433857+0000","last_became_active":"2024-09-12T17:55:59.354383+0000","last_became_peered":"2024-09-12T17:55:59.354383+0000","last_unstale":"2024-09-12T18:56:42.433857+0000","last_undegraded":"2024-09-12T18:56:42.433857+0000","last_fullsized":"2024-09-12T18:56:42.433857+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:12.015628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:07.446185+0000","last_change":"2024-09-12T18:19:57.864592+0000","last_active":"2024-09-12T18:56:07.446185+0000","last_peered":"2024-09-12T18:56:07.446185+0000","last_clean":"2024-09-12T18:56:07.446185+0000","last_became_active":"2024-09-12T18:19:57.858987+0000","last_became_peered":"2024-09-12T18:19:57.858987+0000","last_unstale":"2024-09-12T18:56:07.446185+0000","last_undegraded":"2024-09-12T18:56:07.446185+0000","last_fullsized":"2024-09-12T18:56:07.446185+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:30.509797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437573+0000","last_change":"2024-09-12T17:59:43.023426+0000","last_active":"2024-09-12T18:56:02.437573+0000","last_peered":"2024-09-12T18:56:02.437573+0000","last_clean":"2024-09-12T18:56:02.437573+0000","last_became_active":"2024-09-12T17:59:43.022405+0000","last_became_peered":"2024-09-12T17:59:43.022405+0000","last_unstale":"2024-09-12T18:56:02.437573+0000","last_undegraded":"2024-09-12T18:56:02.437573+0000","last_fullsized":"2024-09-12T18:56:02.437573+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:15.217520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":12356,"num_write":7,"num_write_kb":8260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.620294+0000","last_change":"2024-09-12T17:59:38.966348+0000","last_active":"2024-09-12T18:56:02.620294+0000","last_peered":"2024-09-12T18:56:02.620294+0000","last_clean":"2024-09-12T18:56:02.620294+0000","last_became_active":"2024-09-12T17:59:38.964439+0000","last_became_peered":"2024-09-12T17:59:38.964439+0000","last_unstale":"2024-09-12T18:56:02.620294+0000","last_undegraded":"2024-09-12T18:56:02.620294+0000","last_fullsized":"2024-09-12T18:56:02.620294+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:16.500555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1069,"num_write":3,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'113","reported_seq":414,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446927+0000","last_change":"2024-09-12T17:55:59.361437+0000","last_active":"2024-09-12T18:56:42.446927+0000","last_peered":"2024-09-12T18:56:42.446927+0000","last_clean":"2024-09-12T18:56:42.446927+0000","last_became_active":"2024-09-12T17:55:59.360296+0000","last_became_peered":"2024-09-12T17:55:59.360296+0000","last_unstale":"2024-09-12T18:56:42.446927+0000","last_undegraded":"2024-09-12T18:56:42.446927+0000","last_fullsized":"2024-09-12T18:56:42.446927+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:54.893983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":493,"num_write":148,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.819989+0000","last_change":"2024-09-12T18:19:57.871333+0000","last_active":"2024-09-12T18:57:27.819989+0000","last_peered":"2024-09-12T18:57:27.819989+0000","last_clean":"2024-09-12T18:57:27.819989+0000","last_became_active":"2024-09-12T18:19:57.870563+0000","last_became_peered":"2024-09-12T18:19:57.870563+0000","last_unstale":"2024-09-12T18:57:27.819989+0000","last_undegraded":"2024-09-12T18:57:27.819989+0000","last_fullsized":"2024-09-12T18:57:27.819989+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:12.142130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.801846+0000","last_change":"2024-09-12T17:59:43.019692+0000","last_active":"2024-09-12T18:56:02.801846+0000","last_peered":"2024-09-12T18:56:02.801846+0000","last_clean":"2024-09-12T18:56:02.801846+0000","last_became_active":"2024-09-12T17:59:43.018869+0000","last_became_peered":"2024-09-12T17:59:43.018869+0000","last_unstale":"2024-09-12T18:56:02.801846+0000","last_undegraded":"2024-09-12T18:56:02.801846+0000","last_fullsized":"2024-09-12T18:56:02.801846+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:27.333833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'1","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437605+0000","last_change":"2024-09-12T17:59:38.989030+0000","last_active":"2024-09-12T18:56:02.437605+0000","last_peered":"2024-09-12T18:56:02.437605+0000","last_clean":"2024-09-12T18:56:02.437605+0000","last_became_active":"2024-09-12T17:59:38.988237+0000","last_became_peered":"2024-09-12T17:59:38.988237+0000","last_unstale":"2024-09-12T18:56:02.437605+0000","last_undegraded":"2024-09-12T18:56:02.437605+0000","last_fullsized":"2024-09-12T18:56:02.437605+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:13.770105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'6","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.450666+0000","last_change":"2024-09-12T17:55:59.354590+0000","last_active":"2024-09-12T18:56:27.450666+0000","last_peered":"2024-09-12T18:56:27.450666+0000","last_clean":"2024-09-12T18:56:27.450666+0000","last_became_active":"2024-09-12T17:55:59.353823+0000","last_became_peered":"2024-09-12T17:55:59.353823+0000","last_unstale":"2024-09-12T18:56:27.450666+0000","last_undegraded":"2024-09-12T18:56:27.450666+0000","last_fullsized":"2024-09-12T18:56:27.450666+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:54.453586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:49.442825+0000","last_change":"2024-09-12T18:19:57.840515+0000","last_active":"2024-09-12T18:56:49.442825+0000","last_peered":"2024-09-12T18:56:49.442825+0000","last_clean":"2024-09-12T18:56:49.442825+0000","last_became_active":"2024-09-12T18:19:57.839756+0000","last_became_peered":"2024-09-12T18:19:57.839756+0000","last_unstale":"2024-09-12T18:56:49.442825+0000","last_undegraded":"2024-09-12T18:56:49.442825+0000","last_fullsized":"2024-09-12T18:56:49.442825+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:01.658644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.444196+0000","last_change":"2024-09-12T17:59:43.038905+0000","last_active":"2024-09-12T18:55:57.444196+0000","last_peered":"2024-09-12T18:55:57.444196+0000","last_clean":"2024-09-12T18:55:57.444196+0000","last_became_active":"2024-09-12T17:59:43.033049+0000","last_became_peered":"2024-09-12T17:59:43.033049+0000","last_unstale":"2024-09-12T18:55:57.444196+0000","last_undegraded":"2024-09-12T18:55:57.444196+0000","last_fullsized":"2024-09-12T18:55:57.444196+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:33.443562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'9","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464697+0000","last_change":"2024-09-12T17:59:38.986578+0000","last_active":"2024-09-12T18:57:57.464697+0000","last_peered":"2024-09-12T18:57:57.464697+0000","last_clean":"2024-09-12T18:57:57.464697+0000","last_became_active":"2024-09-12T17:59:38.985971+0000","last_became_peered":"2024-09-12T17:59:38.985971+0000","last_unstale":"2024-09-12T18:57:57.464697+0000","last_undegraded":"2024-09-12T18:57:57.464697+0000","last_fullsized":"2024-09-12T18:57:57.464697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:41.717343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'13","reported_seq":101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.625796+0000","last_change":"2024-09-12T17:55:59.358658+0000","last_active":"2024-09-12T18:56:27.625796+0000","last_peered":"2024-09-12T18:56:27.625796+0000","last_clean":"2024-09-12T18:56:27.625796+0000","last_became_active":"2024-09-12T17:55:59.352474+0000","last_became_peered":"2024-09-12T17:55:59.352474+0000","last_unstale":"2024-09-12T18:56:27.625796+0000","last_undegraded":"2024-09-12T18:56:27.625796+0000","last_fullsized":"2024-09-12T18:56:27.625796+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:54.466534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464409+0000","last_change":"2024-09-12T18:19:57.847713+0000","last_active":"2024-09-12T18:56:47.464409+0000","last_peered":"2024-09-12T18:56:47.464409+0000","last_clean":"2024-09-12T18:56:47.464409+0000","last_became_active":"2024-09-12T18:19:57.846907+0000","last_became_peered":"2024-09-12T18:19:57.846907+0000","last_unstale":"2024-09-12T18:56:47.464409+0000","last_undegraded":"2024-09-12T18:56:47.464409+0000","last_fullsized":"2024-09-12T18:56:47.464409+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:30.600770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'11","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:52.656029+0000","last_change":"2024-09-12T17:59:43.023811+0000","last_active":"2024-09-12T18:57:52.656029+0000","last_peered":"2024-09-12T18:57:52.656029+0000","last_clean":"2024-09-12T18:57:52.656029+0000","last_became_active":"2024-09-12T17:59:43.022991+0000","last_became_peered":"2024-09-12T17:59:43.022991+0000","last_unstale":"2024-09-12T18:57:52.656029+0000","last_undegraded":"2024-09-12T18:57:52.656029+0000","last_fullsized":"2024-09-12T18:57:52.656029+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:41.803212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20482,"num_write":21,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'1","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.435949+0000","last_change":"2024-09-12T17:59:38.990278+0000","last_active":"2024-09-12T18:55:57.435949+0000","last_peered":"2024-09-12T18:55:57.435949+0000","last_clean":"2024-09-12T18:55:57.435949+0000","last_became_active":"2024-09-12T17:59:38.989530+0000","last_became_peered":"2024-09-12T17:59:38.989530+0000","last_unstale":"2024-09-12T18:55:57.435949+0000","last_undegraded":"2024-09-12T18:55:57.435949+0000","last_fullsized":"2024-09-12T18:55:57.435949+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:27.646889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'9","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.807160+0000","last_change":"2024-09-12T17:55:59.345043+0000","last_active":"2024-09-12T18:56:27.807160+0000","last_peered":"2024-09-12T18:56:27.807160+0000","last_clean":"2024-09-12T18:56:27.807160+0000","last_became_active":"2024-09-12T17:55:59.344251+0000","last_became_peered":"2024-09-12T17:55:59.344251+0000","last_unstale":"2024-09-12T18:56:27.807160+0000","last_undegraded":"2024-09-12T18:56:27.807160+0000","last_fullsized":"2024-09-12T18:56:27.807160+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:29.508189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473350+0000","last_change":"2024-09-12T18:19:57.848079+0000","last_active":"2024-09-12T18:57:27.473350+0000","last_peered":"2024-09-12T18:57:27.473350+0000","last_clean":"2024-09-12T18:57:27.473350+0000","last_became_active":"2024-09-12T18:19:57.847330+0000","last_became_peered":"2024-09-12T18:19:57.847330+0000","last_unstale":"2024-09-12T18:57:27.473350+0000","last_undegraded":"2024-09-12T18:57:27.473350+0000","last_fullsized":"2024-09-12T18:57:27.473350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:06.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'3","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.424284+0000","last_change":"2024-09-12T17:59:43.028989+0000","last_active":"2024-09-12T18:55:57.424284+0000","last_peered":"2024-09-12T18:55:57.424284+0000","last_clean":"2024-09-12T18:55:57.424284+0000","last_became_active":"2024-09-12T17:59:43.028305+0000","last_became_peered":"2024-09-12T17:59:43.028305+0000","last_unstale":"2024-09-12T18:55:57.424284+0000","last_undegraded":"2024-09-12T18:55:57.424284+0000","last_fullsized":"2024-09-12T18:55:57.424284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:37.271016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.444237+0000","last_change":"2024-09-12T17:59:38.987789+0000","last_active":"2024-09-12T18:55:57.444237+0000","last_peered":"2024-09-12T18:55:57.444237+0000","last_clean":"2024-09-12T18:55:57.444237+0000","last_became_active":"2024-09-12T17:59:38.986062+0000","last_became_peered":"2024-09-12T17:59:38.986062+0000","last_unstale":"2024-09-12T18:55:57.444237+0000","last_undegraded":"2024-09-12T18:55:57.444237+0000","last_fullsized":"2024-09-12T18:55:57.444237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:17.162069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'31","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.430557+0000","last_change":"2024-09-12T17:55:59.346330+0000","last_active":"2024-09-12T18:56:27.430557+0000","last_peered":"2024-09-12T18:56:27.430557+0000","last_clean":"2024-09-12T18:56:27.430557+0000","last_became_active":"2024-09-12T17:55:59.345469+0000","last_became_peered":"2024-09-12T17:55:59.345469+0000","last_unstale":"2024-09-12T18:56:27.430557+0000","last_undegraded":"2024-09-12T18:56:27.430557+0000","last_fullsized":"2024-09-12T18:56:27.430557+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:40.512299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":47,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.459721+0000","last_change":"2024-09-12T18:19:57.845031+0000","last_active":"2024-09-12T18:57:37.459721+0000","last_peered":"2024-09-12T18:57:37.459721+0000","last_clean":"2024-09-12T18:57:37.459721+0000","last_became_active":"2024-09-12T18:19:57.844161+0000","last_became_peered":"2024-09-12T18:19:57.844161+0000","last_unstale":"2024-09-12T18:57:37.459721+0000","last_undegraded":"2024-09-12T18:57:37.459721+0000","last_fullsized":"2024-09-12T18:57:37.459721+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:42.398579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800569+0000","last_change":"2024-09-12T17:59:43.020614+0000","last_active":"2024-09-12T18:55:57.800569+0000","last_peered":"2024-09-12T18:55:57.800569+0000","last_clean":"2024-09-12T18:55:57.800569+0000","last_became_active":"2024-09-12T17:59:43.019274+0000","last_became_peered":"2024-09-12T17:59:43.019274+0000","last_unstale":"2024-09-12T18:55:57.800569+0000","last_undegraded":"2024-09-12T18:55:57.800569+0000","last_fullsized":"2024-09-12T18:55:57.800569+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:20.608735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'6","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.424329+0000","last_change":"2024-09-12T17:59:38.969202+0000","last_active":"2024-09-12T18:55:57.424329+0000","last_peered":"2024-09-12T18:55:57.424329+0000","last_clean":"2024-09-12T18:55:57.424329+0000","last_became_active":"2024-09-12T17:59:38.968500+0000","last_became_peered":"2024-09-12T17:59:38.968500+0000","last_unstale":"2024-09-12T18:55:57.424329+0000","last_undegraded":"2024-09-12T18:55:57.424329+0000","last_fullsized":"2024-09-12T18:55:57.424329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:19.956318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4242729,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":16,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.440783+0000","last_change":"2024-09-12T17:55:59.355326+0000","last_active":"2024-09-12T18:56:17.440783+0000","last_peered":"2024-09-12T18:56:17.440783+0000","last_clean":"2024-09-12T18:56:17.440783+0000","last_became_active":"2024-09-12T17:55:59.354620+0000","last_became_peered":"2024-09-12T17:55:59.354620+0000","last_unstale":"2024-09-12T18:56:17.440783+0000","last_undegraded":"2024-09-12T18:56:17.440783+0000","last_fullsized":"2024-09-12T18:56:17.440783+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:05.701171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":145,"num_write":78,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'318","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457452+0000","last_change":"2024-09-12T17:40:18.786112+0000","last_active":"2024-09-12T18:57:27.457452+0000","last_peered":"2024-09-12T18:57:27.457452+0000","last_clean":"2024-09-12T18:57:27.457452+0000","last_became_active":"2024-09-12T17:40:18.784159+0000","last_became_peered":"2024-09-12T17:40:18.784159+0000","last_unstale":"2024-09-12T18:57:27.457452+0000","last_undegraded":"2024-09-12T18:57:27.457452+0000","last_fullsized":"2024-09-12T18:57:27.457452+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:09.077635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13398493,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":458,"num_read_kb":37913,"num_write":1138,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'93","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.611092+0000","last_change":"2024-09-12T17:40:20.139437+0000","last_active":"2024-09-12T18:55:22.611092+0000","last_peered":"2024-09-12T18:55:22.611092+0000","last_clean":"2024-09-12T18:55:22.611092+0000","last_became_active":"2024-09-12T17:40:20.138680+0000","last_became_peered":"2024-09-12T17:40:20.138680+0000","last_unstale":"2024-09-12T18:55:22.611092+0000","last_undegraded":"2024-09-12T18:55:22.611092+0000","last_fullsized":"2024-09-12T18:55:22.611092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:20.357774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'253","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:21.882505+0000","last_change":"2024-09-12T17:40:18.761793+0000","last_active":"2024-09-12T18:59:21.882505+0000","last_peered":"2024-09-12T18:59:21.882505+0000","last_clean":"2024-09-12T18:59:21.882505+0000","last_became_active":"2024-09-12T17:40:18.761214+0000","last_became_peered":"2024-09-12T17:40:18.761214+0000","last_unstale":"2024-09-12T18:59:21.882505+0000","last_undegraded":"2024-09-12T18:59:21.882505+0000","last_fullsized":"2024-09-12T18:59:21.882505+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:52.345302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9324513,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":409,"num_read_kb":37090,"num_write":889,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'255","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:19.678404+0000","last_change":"2024-09-12T17:40:20.134527+0000","last_active":"2024-09-12T18:56:19.678404+0000","last_peered":"2024-09-12T18:56:19.678404+0000","last_clean":"2024-09-12T18:56:19.678404+0000","last_became_active":"2024-09-12T17:40:20.133791+0000","last_became_peered":"2024-09-12T17:40:20.133791+0000","last_unstale":"2024-09-12T18:56:19.678404+0000","last_undegraded":"2024-09-12T18:56:19.678404+0000","last_fullsized":"2024-09-12T18:56:19.678404+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:41.729662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1087,"num_read_kb":867,"num_write":420,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'326","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:25.636751+0000","last_change":"2024-09-12T17:40:18.757584+0000","last_active":"2024-09-12T18:59:25.636751+0000","last_peered":"2024-09-12T18:59:25.636751+0000","last_clean":"2024-09-12T18:59:25.636751+0000","last_became_active":"2024-09-12T17:40:18.755606+0000","last_became_peered":"2024-09-12T17:40:18.755606+0000","last_unstale":"2024-09-12T18:59:25.636751+0000","last_undegraded":"2024-09-12T18:59:25.636751+0000","last_fullsized":"2024-09-12T18:59:25.636751+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:15.359537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17736649,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":495,"num_read_kb":26527,"num_write":1202,"num_write_kb":46376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'130","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.375203+0000","last_change":"2024-09-12T17:40:20.130876+0000","last_active":"2024-09-12T18:58:04.375203+0000","last_peered":"2024-09-12T18:58:04.375203+0000","last_clean":"2024-09-12T18:58:04.375203+0000","last_became_active":"2024-09-12T17:40:20.130123+0000","last_became_peered":"2024-09-12T17:40:20.130123+0000","last_unstale":"2024-09-12T18:58:04.375203+0000","last_undegraded":"2024-09-12T18:58:04.375203+0000","last_fullsized":"2024-09-12T18:58:04.375203+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:31.564674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":589,"num_read_kb":499,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'285","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.106105+0000","last_change":"2024-09-12T17:40:18.768963+0000","last_active":"2024-09-12T18:57:45.106105+0000","last_peered":"2024-09-12T18:57:45.106105+0000","last_clean":"2024-09-12T18:57:45.106105+0000","last_became_active":"2024-09-12T17:40:18.768170+0000","last_became_peered":"2024-09-12T17:40:18.768170+0000","last_unstale":"2024-09-12T18:57:45.106105+0000","last_undegraded":"2024-09-12T18:57:45.106105+0000","last_fullsized":"2024-09-12T18:57:45.106105+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:12.117915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19926609,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":485,"num_read_kb":59190,"num_write":1153,"num_write_kb":44467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'100","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.445911+0000","last_change":"2024-09-12T17:40:20.115278+0000","last_active":"2024-09-12T18:55:22.445911+0000","last_peered":"2024-09-12T18:55:22.445911+0000","last_clean":"2024-09-12T18:55:22.445911+0000","last_became_active":"2024-09-12T17:40:20.114923+0000","last_became_peered":"2024-09-12T17:40:20.114923+0000","last_unstale":"2024-09-12T18:55:22.445911+0000","last_undegraded":"2024-09-12T18:55:22.445911+0000","last_fullsized":"2024-09-12T18:55:22.445911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:28.492838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":408,"num_write":151,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'251","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427198+0000","last_change":"2024-09-12T17:40:18.779851+0000","last_active":"2024-09-12T18:55:22.427198+0000","last_peered":"2024-09-12T18:55:22.427198+0000","last_clean":"2024-09-12T18:55:22.427198+0000","last_became_active":"2024-09-12T17:40:18.778991+0000","last_became_peered":"2024-09-12T17:40:18.778991+0000","last_unstale":"2024-09-12T18:55:22.427198+0000","last_undegraded":"2024-09-12T18:55:22.427198+0000","last_fullsized":"2024-09-12T18:55:22.427198+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:35.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4458351,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":389,"num_read_kb":19943,"num_write":925,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'100","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433806+0000","last_change":"2024-09-12T17:40:20.128328+0000","last_active":"2024-09-12T18:56:42.433806+0000","last_peered":"2024-09-12T18:56:42.433806+0000","last_clean":"2024-09-12T18:56:42.433806+0000","last_became_active":"2024-09-12T17:40:20.127556+0000","last_became_peered":"2024-09-12T17:40:20.127556+0000","last_unstale":"2024-09-12T18:56:42.433806+0000","last_undegraded":"2024-09-12T18:56:42.433806+0000","last_fullsized":"2024-09-12T18:56:42.433806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:12.259064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":458,"num_read_kb":378,"num_write":157,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'305","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.611191+0000","last_change":"2024-09-12T17:40:18.761760+0000","last_active":"2024-09-12T18:55:22.611191+0000","last_peered":"2024-09-12T18:55:22.611191+0000","last_clean":"2024-09-12T18:55:22.611191+0000","last_became_active":"2024-09-12T17:40:18.760958+0000","last_became_peered":"2024-09-12T17:40:18.760958+0000","last_unstale":"2024-09-12T18:55:22.611191+0000","last_undegraded":"2024-09-12T18:55:22.611191+0000","last_fullsized":"2024-09-12T18:55:22.611191+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:50.452114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4848723,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":425,"num_read_kb":8660,"num_write":1143,"num_write_kb":27182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'123","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820225+0000","last_change":"2024-09-12T17:40:20.136587+0000","last_active":"2024-09-12T18:57:27.820225+0000","last_peered":"2024-09-12T18:57:27.820225+0000","last_clean":"2024-09-12T18:57:27.820225+0000","last_became_active":"2024-09-12T17:40:20.132985+0000","last_became_peered":"2024-09-12T17:40:20.132985+0000","last_unstale":"2024-09-12T18:57:27.820225+0000","last_undegraded":"2024-09-12T18:57:27.820225+0000","last_fullsized":"2024-09-12T18:57:27.820225+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:46.649354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":462,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'332","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.238876+0000","last_change":"2024-09-12T17:40:18.761925+0000","last_active":"2024-09-12T18:57:17.238876+0000","last_peered":"2024-09-12T18:57:17.238876+0000","last_clean":"2024-09-12T18:57:17.238876+0000","last_became_active":"2024-09-12T17:40:18.761056+0000","last_became_peered":"2024-09-12T17:40:18.761056+0000","last_unstale":"2024-09-12T18:57:17.238876+0000","last_undegraded":"2024-09-12T18:57:17.238876+0000","last_fullsized":"2024-09-12T18:57:17.238876+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:43.265328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7453140,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":564,"num_read_kb":74800,"num_write":1167,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'208","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.640055+0000","last_change":"2024-09-12T17:40:20.135326+0000","last_active":"2024-09-12T18:57:27.640055+0000","last_peered":"2024-09-12T18:57:27.640055+0000","last_clean":"2024-09-12T18:57:27.640055+0000","last_became_active":"2024-09-12T17:40:20.134441+0000","last_became_peered":"2024-09-12T17:40:20.134441+0000","last_unstale":"2024-09-12T18:57:27.640055+0000","last_undegraded":"2024-09-12T18:57:27.640055+0000","last_fullsized":"2024-09-12T18:57:27.640055+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:29.851316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":897,"num_read_kb":734,"num_write":311,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'303","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:20.928833+0000","last_change":"2024-09-12T17:40:18.774112+0000","last_active":"2024-09-12T18:59:20.928833+0000","last_peered":"2024-09-12T18:59:20.928833+0000","last_clean":"2024-09-12T18:59:20.928833+0000","last_became_active":"2024-09-12T17:40:18.773843+0000","last_became_peered":"2024-09-12T17:40:18.773843+0000","last_unstale":"2024-09-12T18:59:20.928833+0000","last_undegraded":"2024-09-12T18:59:20.928833+0000","last_fullsized":"2024-09-12T18:59:20.928833+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:24.163598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9058338,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":567,"num_read_kb":30255,"num_write":1096,"num_write_kb":52642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'233","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:24.450044+0000","last_change":"2024-09-12T17:40:20.122021+0000","last_active":"2024-09-12T18:57:24.450044+0000","last_peered":"2024-09-12T18:57:24.450044+0000","last_clean":"2024-09-12T18:57:24.450044+0000","last_became_active":"2024-09-12T17:40:20.120891+0000","last_became_peered":"2024-09-12T17:40:20.120891+0000","last_unstale":"2024-09-12T18:57:24.450044+0000","last_undegraded":"2024-09-12T18:57:24.450044+0000","last_fullsized":"2024-09-12T18:57:24.450044+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:49.408719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":858,"num_write":384,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'192","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.818850+0000","last_change":"2024-09-12T17:40:20.135279+0000","last_active":"2024-09-12T18:57:22.818850+0000","last_peered":"2024-09-12T18:57:22.818850+0000","last_clean":"2024-09-12T18:57:22.818850+0000","last_became_active":"2024-09-12T17:40:20.132466+0000","last_became_peered":"2024-09-12T17:40:20.132466+0000","last_unstale":"2024-09-12T18:57:22.818850+0000","last_undegraded":"2024-09-12T18:57:22.818850+0000","last_fullsized":"2024-09-12T18:57:22.818850+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:47.393866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":674,"num_write":287,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'262","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:32.430208+0000","last_change":"2024-09-12T17:40:18.784241+0000","last_active":"2024-09-12T18:55:32.430208+0000","last_peered":"2024-09-12T18:55:32.430208+0000","last_clean":"2024-09-12T18:55:32.430208+0000","last_became_active":"2024-09-12T17:40:18.783282+0000","last_became_peered":"2024-09-12T17:40:18.783282+0000","last_unstale":"2024-09-12T18:55:32.430208+0000","last_undegraded":"2024-09-12T18:55:32.430208+0000","last_fullsized":"2024-09-12T18:55:32.430208+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:11.061277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14708958,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":334,"num_read_kb":17792,"num_write":943,"num_write_kb":32630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'128","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456078+0000","last_change":"2024-09-12T17:40:20.144162+0000","last_active":"2024-09-12T18:57:22.456078+0000","last_peered":"2024-09-12T18:57:22.456078+0000","last_clean":"2024-09-12T18:57:22.456078+0000","last_became_active":"2024-09-12T17:40:20.143471+0000","last_became_peered":"2024-09-12T17:40:20.143471+0000","last_unstale":"2024-09-12T18:57:22.456078+0000","last_undegraded":"2024-09-12T18:57:22.456078+0000","last_fullsized":"2024-09-12T18:57:22.456078+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:17.136156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":544,"num_read_kb":441,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'246","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.415871+0000","last_change":"2024-09-12T17:40:18.758730+0000","last_active":"2024-09-12T18:55:17.415871+0000","last_peered":"2024-09-12T18:55:17.415871+0000","last_clean":"2024-09-12T18:55:17.415871+0000","last_became_active":"2024-09-12T17:40:18.756814+0000","last_became_peered":"2024-09-12T17:40:18.756814+0000","last_unstale":"2024-09-12T18:55:17.415871+0000","last_undegraded":"2024-09-12T18:55:17.415871+0000","last_fullsized":"2024-09-12T18:55:17.415871+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:55.503868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486581,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":345,"num_read_kb":9609,"num_write":926,"num_write_kb":28982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'86","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.642204+0000","last_change":"2024-09-12T17:40:20.124840+0000","last_active":"2024-09-12T18:57:37.642204+0000","last_peered":"2024-09-12T18:57:37.642204+0000","last_clean":"2024-09-12T18:57:37.642204+0000","last_became_active":"2024-09-12T17:40:20.124104+0000","last_became_peered":"2024-09-12T17:40:20.124104+0000","last_unstale":"2024-09-12T18:57:37.642204+0000","last_undegraded":"2024-09-12T18:57:37.642204+0000","last_fullsized":"2024-09-12T18:57:37.642204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:12.896981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":294,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'334","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:47.914801+0000","last_change":"2024-09-12T17:40:18.774434+0000","last_active":"2024-09-12T18:55:47.914801+0000","last_peered":"2024-09-12T18:55:47.914801+0000","last_clean":"2024-09-12T18:55:47.914801+0000","last_became_active":"2024-09-12T17:40:18.773787+0000","last_became_peered":"2024-09-12T17:40:18.773787+0000","last_unstale":"2024-09-12T18:55:47.914801+0000","last_undegraded":"2024-09-12T18:55:47.914801+0000","last_fullsized":"2024-09-12T18:55:47.914801+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:11.321051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11432262,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":578,"num_read_kb":7582,"num_write":1158,"num_write_kb":45057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'153","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.591660+0000","last_change":"2024-09-12T17:40:20.121404+0000","last_active":"2024-09-12T18:57:32.591660+0000","last_peered":"2024-09-12T18:57:32.591660+0000","last_clean":"2024-09-12T18:57:32.591660+0000","last_became_active":"2024-09-12T17:40:20.120803+0000","last_became_peered":"2024-09-12T17:40:20.120803+0000","last_unstale":"2024-09-12T18:57:32.591660+0000","last_undegraded":"2024-09-12T18:57:32.591660+0000","last_fullsized":"2024-09-12T18:57:32.591660+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:19.129000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":714,"num_read_kb":606,"num_write":221,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'257","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.791708+0000","last_change":"2024-09-12T17:40:18.770515+0000","last_active":"2024-09-12T18:55:17.791708+0000","last_peered":"2024-09-12T18:55:17.791708+0000","last_clean":"2024-09-12T18:55:17.791708+0000","last_became_active":"2024-09-12T17:40:18.769867+0000","last_became_peered":"2024-09-12T17:40:18.769867+0000","last_unstale":"2024-09-12T18:55:17.791708+0000","last_undegraded":"2024-09-12T18:55:17.791708+0000","last_fullsized":"2024-09-12T18:55:17.791708+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:27.168781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9822617,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":413,"num_read_kb":25356,"num_write":1031,"num_write_kb":19597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'166","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:14.423789+0000","last_change":"2024-09-12T17:40:20.132059+0000","last_active":"2024-09-12T18:55:14.423789+0000","last_peered":"2024-09-12T18:55:14.423789+0000","last_clean":"2024-09-12T18:55:14.423789+0000","last_became_active":"2024-09-12T17:40:20.131603+0000","last_became_peered":"2024-09-12T17:40:20.131603+0000","last_unstale":"2024-09-12T18:55:14.423789+0000","last_undegraded":"2024-09-12T18:55:14.423789+0000","last_fullsized":"2024-09-12T18:55:14.423789+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:41.698653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":647,"num_write":268,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'271","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426374+0000","last_change":"2024-09-12T17:40:18.766165+0000","last_active":"2024-09-12T18:55:17.426374+0000","last_peered":"2024-09-12T18:55:17.426374+0000","last_clean":"2024-09-12T18:55:17.426374+0000","last_became_active":"2024-09-12T17:40:18.765584+0000","last_became_peered":"2024-09-12T17:40:18.765584+0000","last_unstale":"2024-09-12T18:55:17.426374+0000","last_undegraded":"2024-09-12T18:55:17.426374+0000","last_fullsized":"2024-09-12T18:55:17.426374+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:22.295131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7414200,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":441,"num_read_kb":14371,"num_write":1035,"num_write_kb":24714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'218","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:28.107651+0000","last_change":"2024-09-12T17:40:20.134311+0000","last_active":"2024-09-12T18:56:28.107651+0000","last_peered":"2024-09-12T18:56:28.107651+0000","last_clean":"2024-09-12T18:56:28.107651+0000","last_became_active":"2024-09-12T17:40:20.132166+0000","last_became_peered":"2024-09-12T17:40:20.132166+0000","last_unstale":"2024-09-12T18:56:28.107651+0000","last_undegraded":"2024-09-12T18:56:28.107651+0000","last_fullsized":"2024-09-12T18:56:28.107651+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:01.198659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":801,"num_write":328,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'254","reported_seq":898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.475534+0000","last_change":"2024-09-12T17:40:18.754672+0000","last_active":"2024-09-12T18:57:37.475534+0000","last_peered":"2024-09-12T18:57:37.475534+0000","last_clean":"2024-09-12T18:57:37.475534+0000","last_became_active":"2024-09-12T17:40:18.753673+0000","last_became_peered":"2024-09-12T17:40:18.753673+0000","last_unstale":"2024-09-12T18:57:37.475534+0000","last_undegraded":"2024-09-12T18:57:37.475534+0000","last_fullsized":"2024-09-12T18:57:37.475534+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:52.046955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7819696,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":407,"num_read_kb":9306,"num_write":950,"num_write_kb":26120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'143","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.275130+0000","last_change":"2024-09-12T17:40:28.202080+0000","last_active":"2024-09-12T18:58:06.275130+0000","last_peered":"2024-09-12T18:58:06.275130+0000","last_clean":"2024-09-12T18:58:06.275130+0000","last_became_active":"2024-09-12T17:40:28.201205+0000","last_became_peered":"2024-09-12T17:40:28.201205+0000","last_unstale":"2024-09-12T18:58:06.275130+0000","last_undegraded":"2024-09-12T18:58:06.275130+0000","last_fullsized":"2024-09-12T18:58:06.275130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:51.763724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'257","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427749+0000","last_change":"2024-09-12T17:40:20.133338+0000","last_active":"2024-09-12T18:55:22.427749+0000","last_peered":"2024-09-12T18:55:22.427749+0000","last_clean":"2024-09-12T18:55:22.427749+0000","last_became_active":"2024-09-12T17:40:20.132930+0000","last_became_peered":"2024-09-12T17:40:20.132930+0000","last_unstale":"2024-09-12T18:55:22.427749+0000","last_undegraded":"2024-09-12T18:55:22.427749+0000","last_fullsized":"2024-09-12T18:55:22.427749+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:26.732786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1081,"num_read_kb":890,"num_write":398,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'267","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456141+0000","last_change":"2024-09-12T17:40:18.786389+0000","last_active":"2024-09-12T18:57:22.456141+0000","last_peered":"2024-09-12T18:57:22.456141+0000","last_clean":"2024-09-12T18:57:22.456141+0000","last_became_active":"2024-09-12T17:40:18.785762+0000","last_became_peered":"2024-09-12T17:40:18.785762+0000","last_unstale":"2024-09-12T18:57:22.456141+0000","last_undegraded":"2024-09-12T18:57:22.456141+0000","last_fullsized":"2024-09-12T18:57:22.456141+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.306882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8559470,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":591,"num_read_kb":5513,"num_write":1061,"num_write_kb":17948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.609904+0000","last_change":"2024-09-12T17:40:22.146973+0000","last_active":"2024-09-12T18:55:17.609904+0000","last_peered":"2024-09-12T18:55:17.609904+0000","last_clean":"2024-09-12T18:55:17.609904+0000","last_became_active":"2024-09-12T17:40:22.146112+0000","last_became_peered":"2024-09-12T17:40:22.146112+0000","last_unstale":"2024-09-12T18:55:17.609904+0000","last_undegraded":"2024-09-12T18:55:17.609904+0000","last_fullsized":"2024-09-12T18:55:17.609904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:09.636474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'334","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.478019+0000","last_change":"2024-09-12T17:40:24.162348+0000","last_active":"2024-09-12T18:57:47.478019+0000","last_peered":"2024-09-12T18:57:47.478019+0000","last_clean":"2024-09-12T18:57:47.478019+0000","last_became_active":"2024-09-12T17:40:24.161536+0000","last_became_peered":"2024-09-12T17:40:24.161536+0000","last_unstale":"2024-09-12T18:57:47.478019+0000","last_undegraded":"2024-09-12T18:57:47.478019+0000","last_fullsized":"2024-09-12T18:57:47.478019+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:26.371603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60324,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":1078,"num_write":434,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427469+0000","last_change":"2024-09-12T17:40:26.189627+0000","last_active":"2024-09-12T18:55:22.427469+0000","last_peered":"2024-09-12T18:55:22.427469+0000","last_clean":"2024-09-12T18:55:22.427469+0000","last_became_active":"2024-09-12T17:40:26.188831+0000","last_became_peered":"2024-09-12T17:40:26.188831+0000","last_unstale":"2024-09-12T18:55:22.427469+0000","last_undegraded":"2024-09-12T18:55:22.427469+0000","last_fullsized":"2024-09-12T18:55:22.427469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:08.240916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'158","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.658358+0000","last_change":"2024-09-12T17:40:28.190678+0000","last_active":"2024-09-12T18:58:02.658358+0000","last_peered":"2024-09-12T18:58:02.658358+0000","last_clean":"2024-09-12T18:58:02.658358+0000","last_became_active":"2024-09-12T17:40:28.189899+0000","last_became_peered":"2024-09-12T17:40:28.189899+0000","last_unstale":"2024-09-12T18:58:02.658358+0000","last_undegraded":"2024-09-12T18:58:02.658358+0000","last_fullsized":"2024-09-12T18:58:02.658358+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:37.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":230,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'92","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:35.155067+0000","last_change":"2024-09-12T17:40:20.137996+0000","last_active":"2024-09-12T18:55:35.155067+0000","last_peered":"2024-09-12T18:55:35.155067+0000","last_clean":"2024-09-12T18:55:35.155067+0000","last_became_active":"2024-09-12T17:40:20.137252+0000","last_became_peered":"2024-09-12T17:40:20.137252+0000","last_unstale":"2024-09-12T18:55:35.155067+0000","last_undegraded":"2024-09-12T18:55:35.155067+0000","last_fullsized":"2024-09-12T18:55:35.155067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:53.184648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":356,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'271","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.471998+0000","last_change":"2024-09-12T17:40:18.758093+0000","last_active":"2024-09-12T18:57:22.471998+0000","last_peered":"2024-09-12T18:57:22.471998+0000","last_clean":"2024-09-12T18:57:22.471998+0000","last_became_active":"2024-09-12T17:40:18.756518+0000","last_became_peered":"2024-09-12T17:40:18.756518+0000","last_unstale":"2024-09-12T18:57:22.471998+0000","last_undegraded":"2024-09-12T18:57:22.471998+0000","last_fullsized":"2024-09-12T18:57:22.471998+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:19.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15261432,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":398,"num_read_kb":2590,"num_write":955,"num_write_kb":33023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427791+0000","last_change":"2024-09-12T17:40:22.153805+0000","last_active":"2024-09-12T18:55:22.427791+0000","last_peered":"2024-09-12T18:55:22.427791+0000","last_clean":"2024-09-12T18:55:22.427791+0000","last_became_active":"2024-09-12T17:40:22.153074+0000","last_became_peered":"2024-09-12T17:40:22.153074+0000","last_unstale":"2024-09-12T18:55:22.427791+0000","last_undegraded":"2024-09-12T18:55:22.427791+0000","last_fullsized":"2024-09-12T18:55:22.427791+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:18.398925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'102","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793167+0000","last_change":"2024-09-12T17:40:24.170127+0000","last_active":"2024-09-12T18:55:22.793167+0000","last_peered":"2024-09-12T18:55:22.793167+0000","last_clean":"2024-09-12T18:55:22.793167+0000","last_became_active":"2024-09-12T17:40:24.169431+0000","last_became_peered":"2024-09-12T17:40:24.169431+0000","last_unstale":"2024-09-12T18:55:22.793167+0000","last_undegraded":"2024-09-12T18:55:22.793167+0000","last_fullsized":"2024-09-12T18:55:22.793167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:42.784293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793126+0000","last_change":"2024-09-12T17:40:26.189218+0000","last_active":"2024-09-12T18:55:22.793126+0000","last_peered":"2024-09-12T18:55:22.793126+0000","last_clean":"2024-09-12T18:55:22.793126+0000","last_became_active":"2024-09-12T17:40:26.188501+0000","last_became_peered":"2024-09-12T17:40:26.188501+0000","last_unstale":"2024-09-12T18:55:22.793126+0000","last_undegraded":"2024-09-12T18:55:22.793126+0000","last_fullsized":"2024-09-12T18:55:22.793126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.657079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'131","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:20.748031+0000","last_change":"2024-09-12T17:40:28.186974+0000","last_active":"2024-09-12T18:56:20.748031+0000","last_peered":"2024-09-12T18:56:20.748031+0000","last_clean":"2024-09-12T18:56:20.748031+0000","last_became_active":"2024-09-12T17:40:28.186224+0000","last_became_peered":"2024-09-12T17:40:28.186224+0000","last_unstale":"2024-09-12T18:56:20.748031+0000","last_undegraded":"2024-09-12T18:56:20.748031+0000","last_fullsized":"2024-09-12T18:56:20.748031+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:16.871107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":201,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'278","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.444792+0000","last_change":"2024-09-12T17:40:20.116147+0000","last_active":"2024-09-12T18:55:17.444792+0000","last_peered":"2024-09-12T18:55:17.444792+0000","last_clean":"2024-09-12T18:55:17.444792+0000","last_became_active":"2024-09-12T17:40:20.115862+0000","last_became_peered":"2024-09-12T17:40:20.115862+0000","last_unstale":"2024-09-12T18:55:17.444792+0000","last_undegraded":"2024-09-12T18:55:17.444792+0000","last_fullsized":"2024-09-12T18:55:17.444792+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:27.732090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1211,"num_read_kb":988,"num_write":419,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'309","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:18.375060+0000","last_change":"2024-09-12T17:40:55.329992+0000","last_active":"2024-09-12T18:59:18.375060+0000","last_peered":"2024-09-12T18:59:18.375060+0000","last_clean":"2024-09-12T18:59:18.375060+0000","last_became_active":"2024-09-12T17:40:55.329597+0000","last_became_peered":"2024-09-12T17:40:55.329597+0000","last_unstale":"2024-09-12T18:59:18.375060+0000","last_undegraded":"2024-09-12T18:59:18.375060+0000","last_fullsized":"2024-09-12T18:59:18.375060+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:13.339944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14275251,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":491,"num_read_kb":44050,"num_write":1183,"num_write_kb":40700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426595+0000","last_change":"2024-09-12T17:40:22.146475+0000","last_active":"2024-09-12T18:55:17.426595+0000","last_peered":"2024-09-12T18:55:17.426595+0000","last_clean":"2024-09-12T18:55:17.426595+0000","last_became_active":"2024-09-12T17:40:22.145769+0000","last_became_peered":"2024-09-12T17:40:22.145769+0000","last_unstale":"2024-09-12T18:55:17.426595+0000","last_undegraded":"2024-09-12T18:55:17.426595+0000","last_fullsized":"2024-09-12T18:55:17.426595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:33.677268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'144","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:24.425893+0000","last_change":"2024-09-12T17:40:24.164714+0000","last_active":"2024-09-12T18:55:24.425893+0000","last_peered":"2024-09-12T18:55:24.425893+0000","last_clean":"2024-09-12T18:55:24.425893+0000","last_became_active":"2024-09-12T17:40:24.163809+0000","last_became_peered":"2024-09-12T17:40:24.163809+0000","last_unstale":"2024-09-12T18:55:24.425893+0000","last_undegraded":"2024-09-12T18:55:24.425893+0000","last_fullsized":"2024-09-12T18:55:24.425893+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:13.691022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":124,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'760","reported_seq":2940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.828883+0000","last_change":"2024-09-12T17:40:26.201403+0000","last_active":"2024-09-12T18:59:30.828883+0000","last_peered":"2024-09-12T18:59:30.828883+0000","last_clean":"2024-09-12T18:59:30.828883+0000","last_became_active":"2024-09-12T17:40:26.200567+0000","last_became_peered":"2024-09-12T17:40:26.200567+0000","last_unstale":"2024-09-12T18:59:30.828883+0000","last_undegraded":"2024-09-12T18:59:30.828883+0000","last_fullsized":"2024-09-12T18:59:30.828883+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":701,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:56.480672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'215","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.683461+0000","last_change":"2024-09-12T17:40:28.172338+0000","last_active":"2024-09-12T18:58:04.683461+0000","last_peered":"2024-09-12T18:58:04.683461+0000","last_clean":"2024-09-12T18:58:04.683461+0000","last_became_active":"2024-09-12T17:40:28.171602+0000","last_became_peered":"2024-09-12T17:40:28.171602+0000","last_unstale":"2024-09-12T18:58:04.683461+0000","last_undegraded":"2024-09-12T18:58:04.683461+0000","last_fullsized":"2024-09-12T18:58:04.683461+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:30.488801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":670,"num_read_kb":661,"num_write":473,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'82","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:20.741811+0000","last_change":"2024-09-12T17:40:55.305375+0000","last_active":"2024-09-12T18:56:20.741811+0000","last_peered":"2024-09-12T18:56:20.741811+0000","last_clean":"2024-09-12T18:56:20.741811+0000","last_became_active":"2024-09-12T17:40:55.305123+0000","last_became_peered":"2024-09-12T17:40:55.305123+0000","last_unstale":"2024-09-12T18:56:20.741811+0000","last_undegraded":"2024-09-12T18:56:20.741811+0000","last_fullsized":"2024-09-12T18:56:20.741811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:09.120196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":316,"num_write":118,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"264'349","reported_seq":1098,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.441952+0000","last_change":"2024-09-12T17:40:18.757642+0000","last_active":"2024-09-12T18:57:22.441952+0000","last_peered":"2024-09-12T18:57:22.441952+0000","last_clean":"2024-09-12T18:57:22.441952+0000","last_became_active":"2024-09-12T17:40:18.755758+0000","last_became_peered":"2024-09-12T17:40:18.755758+0000","last_unstale":"2024-09-12T18:57:22.441952+0000","last_undegraded":"2024-09-12T18:57:22.441952+0000","last_fullsized":"2024-09-12T18:57:22.441952+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:52.135911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3608682,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":695,"num_read_kb":10976,"num_write":1200,"num_write_kb":39454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.610050+0000","last_change":"2024-09-12T17:40:22.145057+0000","last_active":"2024-09-12T18:55:17.610050+0000","last_peered":"2024-09-12T18:55:17.610050+0000","last_clean":"2024-09-12T18:55:17.610050+0000","last_became_active":"2024-09-12T17:40:22.144266+0000","last_became_peered":"2024-09-12T17:40:22.144266+0000","last_unstale":"2024-09-12T18:55:17.610050+0000","last_undegraded":"2024-09-12T18:55:17.610050+0000","last_fullsized":"2024-09-12T18:55:17.610050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:51.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'274","reported_seq":852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.462287+0000","last_change":"2024-09-12T17:40:24.333448+0000","last_active":"2024-09-12T18:57:47.462287+0000","last_peered":"2024-09-12T18:57:47.462287+0000","last_clean":"2024-09-12T18:57:47.462287+0000","last_became_active":"2024-09-12T17:40:24.332623+0000","last_became_peered":"2024-09-12T17:40:24.332623+0000","last_unstale":"2024-09-12T18:57:47.462287+0000","last_undegraded":"2024-09-12T18:57:47.462287+0000","last_fullsized":"2024-09-12T18:57:47.462287+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:26.074531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56611,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":973,"num_write":370,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'782","reported_seq":4955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.819165+0000","last_change":"2024-09-12T17:40:26.195115+0000","last_active":"2024-09-12T18:59:30.819165+0000","last_peered":"2024-09-12T18:59:30.819165+0000","last_clean":"2024-09-12T18:59:30.819165+0000","last_became_active":"2024-09-12T17:40:26.194264+0000","last_became_peered":"2024-09-12T17:40:26.194264+0000","last_unstale":"2024-09-12T18:59:30.819165+0000","last_undegraded":"2024-09-12T18:59:30.819165+0000","last_fullsized":"2024-09-12T18:59:30.819165+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:28.079379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'4312","reported_seq":4925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:22.662701+0000","last_change":"2024-09-12T17:40:20.137536+0000","last_active":"2024-09-12T18:58:22.662701+0000","last_peered":"2024-09-12T18:58:22.662701+0000","last_clean":"2024-09-12T18:58:22.662701+0000","last_became_active":"2024-09-12T17:40:20.136595+0000","last_became_peered":"2024-09-12T17:40:20.136595+0000","last_unstale":"2024-09-12T18:58:22.662701+0000","last_undegraded":"2024-09-12T18:58:22.662701+0000","last_fullsized":"2024-09-12T18:58:22.662701+0000","mapping_epoch":25,"log_start":"264'4300","ondisk_log_start":"264'4300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:18.692389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17313,"num_read_kb":14480,"num_write":6459,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'265","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.452784+0000","last_change":"2024-09-12T17:40:18.792864+0000","last_active":"2024-09-12T18:57:07.452784+0000","last_peered":"2024-09-12T18:57:07.452784+0000","last_clean":"2024-09-12T18:57:07.452784+0000","last_became_active":"2024-09-12T17:40:18.792274+0000","last_became_peered":"2024-09-12T17:40:18.792274+0000","last_unstale":"2024-09-12T18:57:07.452784+0000","last_undegraded":"2024-09-12T18:57:07.452784+0000","last_fullsized":"2024-09-12T18:57:07.452784+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:56.734666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3754663,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":495,"num_read_kb":45932,"num_write":1030,"num_write_kb":27157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439724+0000","last_change":"2024-09-12T17:40:22.152894+0000","last_active":"2024-09-12T18:56:12.439724+0000","last_peered":"2024-09-12T18:56:12.439724+0000","last_clean":"2024-09-12T18:56:12.439724+0000","last_became_active":"2024-09-12T17:40:22.150553+0000","last_became_peered":"2024-09-12T17:40:22.150553+0000","last_unstale":"2024-09-12T18:56:12.439724+0000","last_undegraded":"2024-09-12T18:56:12.439724+0000","last_fullsized":"2024-09-12T18:56:12.439724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:24.942654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'407","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:42.667592+0000","last_change":"2024-09-12T17:40:24.333149+0000","last_active":"2024-09-12T18:58:42.667592+0000","last_peered":"2024-09-12T18:58:42.667592+0000","last_clean":"2024-09-12T18:58:42.667592+0000","last_became_active":"2024-09-12T17:40:24.332413+0000","last_became_peered":"2024-09-12T17:40:24.332413+0000","last_unstale":"2024-09-12T18:58:42.667592+0000","last_undegraded":"2024-09-12T18:58:42.667592+0000","last_fullsized":"2024-09-12T18:58:42.667592+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:54.765665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60683,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":634,"num_read_kb":1155,"num_write":496,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.457290+0000","last_change":"2024-09-12T17:40:26.197292+0000","last_active":"2024-09-12T18:56:57.457290+0000","last_peered":"2024-09-12T18:56:57.457290+0000","last_clean":"2024-09-12T18:56:57.457290+0000","last_became_active":"2024-09-12T17:40:26.180448+0000","last_became_peered":"2024-09-12T17:40:26.180448+0000","last_unstale":"2024-09-12T18:56:57.457290+0000","last_undegraded":"2024-09-12T18:56:57.457290+0000","last_fullsized":"2024-09-12T18:56:57.457290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:40.842285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'559","reported_seq":1375,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.758187+0000","last_change":"2024-09-12T17:40:28.190641+0000","last_active":"2024-09-12T18:59:27.758187+0000","last_peered":"2024-09-12T18:59:27.758187+0000","last_clean":"2024-09-12T18:59:27.758187+0000","last_became_active":"2024-09-12T17:40:28.189872+0000","last_became_peered":"2024-09-12T17:40:28.189872+0000","last_unstale":"2024-09-12T18:59:27.758187+0000","last_undegraded":"2024-09-12T18:59:27.758187+0000","last_fullsized":"2024-09-12T18:59:27.758187+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:20.487874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1323,"num_read_kb":1321,"num_write":1170,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'151","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.803902+0000","last_change":"2024-09-12T17:40:20.134586+0000","last_active":"2024-09-12T18:56:12.803902+0000","last_peered":"2024-09-12T18:56:12.803902+0000","last_clean":"2024-09-12T18:56:12.803902+0000","last_became_active":"2024-09-12T17:40:20.133890+0000","last_became_peered":"2024-09-12T17:40:20.133890+0000","last_unstale":"2024-09-12T18:56:12.803902+0000","last_undegraded":"2024-09-12T18:56:12.803902+0000","last_fullsized":"2024-09-12T18:56:12.803902+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:21.170793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":596,"num_write":262,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'316","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.022630+0000","last_change":"2024-09-12T17:40:18.779965+0000","last_active":"2024-09-12T18:57:47.022630+0000","last_peered":"2024-09-12T18:57:47.022630+0000","last_clean":"2024-09-12T18:57:47.022630+0000","last_became_active":"2024-09-12T17:40:18.779278+0000","last_became_peered":"2024-09-12T17:40:18.779278+0000","last_unstale":"2024-09-12T18:57:47.022630+0000","last_undegraded":"2024-09-12T18:57:47.022630+0000","last_fullsized":"2024-09-12T18:57:47.022630+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:40.197710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12165714,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":505,"num_read_kb":90798,"num_write":1100,"num_write_kb":50508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"35'5","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.367452+0000","last_change":"2024-09-12T17:40:22.133983+0000","last_active":"2024-09-12T18:59:27.367452+0000","last_peered":"2024-09-12T18:59:27.367452+0000","last_clean":"2024-09-12T18:59:27.367452+0000","last_became_active":"2024-09-12T17:40:22.133525+0000","last_became_peered":"2024-09-12T17:40:22.133525+0000","last_unstale":"2024-09-12T18:59:27.367452+0000","last_undegraded":"2024-09-12T18:59:27.367452+0000","last_fullsized":"2024-09-12T18:59:27.367452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:35.003569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'284","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:12.480635+0000","last_change":"2024-09-12T17:40:24.178387+0000","last_active":"2024-09-12T18:59:12.480635+0000","last_peered":"2024-09-12T18:59:12.480635+0000","last_clean":"2024-09-12T18:59:12.480635+0000","last_became_active":"2024-09-12T17:40:24.177609+0000","last_became_peered":"2024-09-12T17:40:24.177609+0000","last_unstale":"2024-09-12T18:59:12.480635+0000","last_undegraded":"2024-09-12T18:59:12.480635+0000","last_fullsized":"2024-09-12T18:59:12.480635+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.549312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55961,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":980,"num_write":382,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.445281+0000","last_change":"2024-09-12T17:40:26.203926+0000","last_active":"2024-09-12T18:56:37.445281+0000","last_peered":"2024-09-12T18:56:37.445281+0000","last_clean":"2024-09-12T18:56:37.445281+0000","last_became_active":"2024-09-12T17:40:26.203313+0000","last_became_peered":"2024-09-12T17:40:26.203313+0000","last_unstale":"2024-09-12T18:56:37.445281+0000","last_undegraded":"2024-09-12T18:56:37.445281+0000","last_fullsized":"2024-09-12T18:56:37.445281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:57.623918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2394","reported_seq":4223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:19.224714+0000","last_change":"2024-09-12T17:40:28.184253+0000","last_active":"2024-09-12T18:59:19.224714+0000","last_peered":"2024-09-12T18:59:19.224714+0000","last_clean":"2024-09-12T18:59:19.224714+0000","last_became_active":"2024-09-12T17:40:28.183181+0000","last_became_peered":"2024-09-12T17:40:28.183181+0000","last_unstale":"2024-09-12T18:59:19.224714+0000","last_undegraded":"2024-09-12T18:59:19.224714+0000","last_fullsized":"2024-09-12T18:59:19.224714+0000","mapping_epoch":33,"log_start":"264'2300","ondisk_log_start":"264'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:07.933119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6012,"num_read_kb":6017,"num_write":4828,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'261","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:32.431640+0000","last_change":"2024-09-12T17:40:20.138917+0000","last_active":"2024-09-12T18:56:32.431640+0000","last_peered":"2024-09-12T18:56:32.431640+0000","last_clean":"2024-09-12T18:56:32.431640+0000","last_became_active":"2024-09-12T17:40:20.133614+0000","last_became_peered":"2024-09-12T17:40:20.133614+0000","last_unstale":"2024-09-12T18:56:32.431640+0000","last_undegraded":"2024-09-12T18:56:32.431640+0000","last_fullsized":"2024-09-12T18:56:32.431640+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:17.955544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1175,"num_read_kb":965,"num_write":385,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'245","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.219980+0000","last_change":"2024-09-12T17:40:18.787022+0000","last_active":"2024-09-12T18:57:17.219980+0000","last_peered":"2024-09-12T18:57:17.219980+0000","last_clean":"2024-09-12T18:57:17.219980+0000","last_became_active":"2024-09-12T17:40:18.786288+0000","last_became_peered":"2024-09-12T17:40:18.786288+0000","last_unstale":"2024-09-12T18:57:17.219980+0000","last_undegraded":"2024-09-12T18:57:17.219980+0000","last_fullsized":"2024-09-12T18:57:17.219980+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:05.492643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10052947,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":337,"num_read_kb":29289,"num_write":868,"num_write_kb":24158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:54.443737+0000","last_change":"2024-09-12T17:40:22.132236+0000","last_active":"2024-09-12T18:56:54.443737+0000","last_peered":"2024-09-12T18:56:54.443737+0000","last_clean":"2024-09-12T18:56:54.443737+0000","last_became_active":"2024-09-12T17:40:22.131242+0000","last_became_peered":"2024-09-12T17:40:22.131242+0000","last_unstale":"2024-09-12T18:56:54.443737+0000","last_undegraded":"2024-09-12T18:56:54.443737+0000","last_fullsized":"2024-09-12T18:56:54.443737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:50.985889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'299","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:27.471824+0000","last_change":"2024-09-12T17:40:24.163379+0000","last_active":"2024-09-12T18:58:27.471824+0000","last_peered":"2024-09-12T18:58:27.471824+0000","last_clean":"2024-09-12T18:58:27.471824+0000","last_became_active":"2024-09-12T17:40:24.162722+0000","last_became_peered":"2024-09-12T17:40:24.162722+0000","last_unstale":"2024-09-12T18:58:27.471824+0000","last_undegraded":"2024-09-12T18:58:27.471824+0000","last_fullsized":"2024-09-12T18:58:27.471824+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:54.964194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52424,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":926,"num_write":376,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'757","reported_seq":2695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.803097+0000","last_change":"2024-09-12T17:40:26.182440+0000","last_active":"2024-09-12T18:59:30.803097+0000","last_peered":"2024-09-12T18:59:30.803097+0000","last_clean":"2024-09-12T18:59:30.803097+0000","last_became_active":"2024-09-12T17:40:26.181656+0000","last_became_peered":"2024-09-12T17:40:26.181656+0000","last_unstale":"2024-09-12T18:59:30.803097+0000","last_undegraded":"2024-09-12T18:59:30.803097+0000","last_fullsized":"2024-09-12T18:59:30.803097+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:17.173815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'117","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.441759+0000","last_change":"2024-09-12T17:40:28.187639+0000","last_active":"2024-09-12T18:59:26.441759+0000","last_peered":"2024-09-12T18:59:26.441759+0000","last_clean":"2024-09-12T18:59:26.441759+0000","last_became_active":"2024-09-12T17:40:28.185975+0000","last_became_peered":"2024-09-12T17:40:28.185975+0000","last_unstale":"2024-09-12T18:59:26.441759+0000","last_undegraded":"2024-09-12T18:59:26.441759+0000","last_fullsized":"2024-09-12T18:59:26.441759+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:59.724854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'268","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.465535+0000","last_change":"2024-09-12T17:40:20.125734+0000","last_active":"2024-09-12T18:56:52.465535+0000","last_peered":"2024-09-12T18:56:52.465535+0000","last_clean":"2024-09-12T18:56:52.465535+0000","last_became_active":"2024-09-12T17:40:20.125386+0000","last_became_peered":"2024-09-12T17:40:20.125386+0000","last_unstale":"2024-09-12T18:56:52.465535+0000","last_undegraded":"2024-09-12T18:56:52.465535+0000","last_fullsized":"2024-09-12T18:56:52.465535+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:49.257336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1147,"num_read_kb":967,"num_write":444,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'274","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.631617+0000","last_change":"2024-09-12T17:40:18.761857+0000","last_active":"2024-09-12T18:56:52.631617+0000","last_peered":"2024-09-12T18:56:52.631617+0000","last_clean":"2024-09-12T18:56:52.631617+0000","last_became_active":"2024-09-12T17:40:18.761052+0000","last_became_peered":"2024-09-12T17:40:18.761052+0000","last_unstale":"2024-09-12T18:56:52.631617+0000","last_undegraded":"2024-09-12T18:56:52.631617+0000","last_fullsized":"2024-09-12T18:56:52.631617+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:11.433675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20283170,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":416,"num_read_kb":20006,"num_write":993,"num_write_kb":43376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:34.440085+0000","last_change":"2024-09-12T17:40:22.134731+0000","last_active":"2024-09-12T18:56:34.440085+0000","last_peered":"2024-09-12T18:56:34.440085+0000","last_clean":"2024-09-12T18:56:34.440085+0000","last_became_active":"2024-09-12T17:40:22.134290+0000","last_became_peered":"2024-09-12T17:40:22.134290+0000","last_unstale":"2024-09-12T18:56:34.440085+0000","last_undegraded":"2024-09-12T18:56:34.440085+0000","last_fullsized":"2024-09-12T18:56:34.440085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:09.025873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'481","reported_seq":1124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.666304+0000","last_change":"2024-09-12T17:40:24.161967+0000","last_active":"2024-09-12T18:59:27.666304+0000","last_peered":"2024-09-12T18:59:27.666304+0000","last_clean":"2024-09-12T18:59:27.666304+0000","last_became_active":"2024-09-12T17:40:24.161322+0000","last_became_peered":"2024-09-12T17:40:24.161322+0000","last_unstale":"2024-09-12T18:59:27.666304+0000","last_undegraded":"2024-09-12T18:59:27.666304+0000","last_fullsized":"2024-09-12T18:59:27.666304+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.436434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107875,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":843,"num_read_kb":1880,"num_write":698,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:19.437407+0000","last_change":"2024-09-12T17:40:26.192044+0000","last_active":"2024-09-12T18:56:19.437407+0000","last_peered":"2024-09-12T18:56:19.437407+0000","last_clean":"2024-09-12T18:56:19.437407+0000","last_became_active":"2024-09-12T17:40:26.191395+0000","last_became_peered":"2024-09-12T17:40:26.191395+0000","last_unstale":"2024-09-12T18:56:19.437407+0000","last_undegraded":"2024-09-12T18:56:19.437407+0000","last_fullsized":"2024-09-12T18:56:19.437407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:01.918115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'146","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:33.286149+0000","last_change":"2024-09-12T17:40:28.205050+0000","last_active":"2024-09-12T18:56:33.286149+0000","last_peered":"2024-09-12T18:56:33.286149+0000","last_clean":"2024-09-12T18:56:33.286149+0000","last_became_active":"2024-09-12T17:40:28.204260+0000","last_became_peered":"2024-09-12T17:40:28.204260+0000","last_unstale":"2024-09-12T18:56:33.286149+0000","last_undegraded":"2024-09-12T18:56:33.286149+0000","last_fullsized":"2024-09-12T18:56:33.286149+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:03.489071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":166,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'137","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812393+0000","last_change":"2024-09-12T17:40:20.143727+0000","last_active":"2024-09-12T18:56:52.812393+0000","last_peered":"2024-09-12T18:56:52.812393+0000","last_clean":"2024-09-12T18:56:52.812393+0000","last_became_active":"2024-09-12T17:40:20.137143+0000","last_became_peered":"2024-09-12T17:40:20.137143+0000","last_unstale":"2024-09-12T18:56:52.812393+0000","last_undegraded":"2024-09-12T18:56:52.812393+0000","last_fullsized":"2024-09-12T18:56:52.812393+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:59.463752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":630,"num_read_kb":531,"num_write":209,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'296","reported_seq":1127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.449237+0000","last_change":"2024-09-12T17:40:18.759820+0000","last_active":"2024-09-12T18:56:52.449237+0000","last_peered":"2024-09-12T18:56:52.449237+0000","last_clean":"2024-09-12T18:56:52.449237+0000","last_became_active":"2024-09-12T17:40:18.759516+0000","last_became_peered":"2024-09-12T17:40:18.759516+0000","last_unstale":"2024-09-12T18:56:52.449237+0000","last_undegraded":"2024-09-12T18:56:52.449237+0000","last_fullsized":"2024-09-12T18:56:52.449237+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:00.153624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5998334,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":751,"num_read_kb":9130,"num_write":1059,"num_write_kb":40035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:54.443796+0000","last_change":"2024-09-12T17:40:22.152256+0000","last_active":"2024-09-12T18:56:54.443796+0000","last_peered":"2024-09-12T18:56:54.443796+0000","last_clean":"2024-09-12T18:56:54.443796+0000","last_became_active":"2024-09-12T17:40:22.151755+0000","last_became_peered":"2024-09-12T17:40:22.151755+0000","last_unstale":"2024-09-12T18:56:54.443796+0000","last_undegraded":"2024-09-12T18:56:54.443796+0000","last_fullsized":"2024-09-12T18:56:54.443796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:30.113972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'323","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:12.843855+0000","last_change":"2024-09-12T17:40:24.172818+0000","last_active":"2024-09-12T18:59:12.843855+0000","last_peered":"2024-09-12T18:59:12.843855+0000","last_clean":"2024-09-12T18:59:12.843855+0000","last_became_active":"2024-09-12T17:40:24.171973+0000","last_became_peered":"2024-09-12T17:40:24.171973+0000","last_unstale":"2024-09-12T18:59:12.843855+0000","last_undegraded":"2024-09-12T18:59:12.843855+0000","last_fullsized":"2024-09-12T18:59:12.843855+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:48.182083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":1037,"num_write":468,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.469988+0000","last_change":"2024-09-12T17:40:26.185794+0000","last_active":"2024-09-12T18:57:12.469988+0000","last_peered":"2024-09-12T18:57:12.469988+0000","last_clean":"2024-09-12T18:57:12.469988+0000","last_became_active":"2024-09-12T17:40:26.185070+0000","last_became_peered":"2024-09-12T17:40:26.185070+0000","last_unstale":"2024-09-12T18:57:12.469988+0000","last_undegraded":"2024-09-12T18:57:12.469988+0000","last_fullsized":"2024-09-12T18:57:12.469988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:50.080805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'139","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:47.476159+0000","last_change":"2024-09-12T17:40:28.195461+0000","last_active":"2024-09-12T18:58:47.476159+0000","last_peered":"2024-09-12T18:58:47.476159+0000","last_clean":"2024-09-12T18:58:47.476159+0000","last_became_active":"2024-09-12T17:40:28.194137+0000","last_became_peered":"2024-09-12T17:40:28.194137+0000","last_unstale":"2024-09-12T18:58:47.476159+0000","last_undegraded":"2024-09-12T18:58:47.476159+0000","last_fullsized":"2024-09-12T18:58:47.476159+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:02.040950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":145,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'125","reported_seq":703,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812491+0000","last_change":"2024-09-12T17:40:20.132955+0000","last_active":"2024-09-12T18:56:52.812491+0000","last_peered":"2024-09-12T18:56:52.812491+0000","last_clean":"2024-09-12T18:56:52.812491+0000","last_became_active":"2024-09-12T17:40:20.132115+0000","last_became_peered":"2024-09-12T17:40:20.132115+0000","last_unstale":"2024-09-12T18:56:52.812491+0000","last_undegraded":"2024-09-12T18:56:52.812491+0000","last_fullsized":"2024-09-12T18:56:52.812491+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:35.227492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":428,"num_write":212,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'276","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:14.416472+0000","last_change":"2024-09-12T17:40:18.774103+0000","last_active":"2024-09-12T18:57:14.416472+0000","last_peered":"2024-09-12T18:57:14.416472+0000","last_clean":"2024-09-12T18:57:14.416472+0000","last_became_active":"2024-09-12T17:40:18.773579+0000","last_became_peered":"2024-09-12T17:40:18.773579+0000","last_unstale":"2024-09-12T18:57:14.416472+0000","last_undegraded":"2024-09-12T18:57:14.416472+0000","last_fullsized":"2024-09-12T18:57:14.416472+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:15.108347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6979127,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":440,"num_read_kb":44851,"num_write":964,"num_write_kb":35490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.456281+0000","last_change":"2024-09-12T17:40:22.143512+0000","last_active":"2024-09-12T18:56:52.456281+0000","last_peered":"2024-09-12T18:56:52.456281+0000","last_clean":"2024-09-12T18:56:52.456281+0000","last_became_active":"2024-09-12T17:40:22.142112+0000","last_became_peered":"2024-09-12T17:40:22.142112+0000","last_unstale":"2024-09-12T18:56:52.456281+0000","last_undegraded":"2024-09-12T18:56:52.456281+0000","last_fullsized":"2024-09-12T18:56:52.456281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:23.695955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'332","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.741657+0000","last_change":"2024-09-12T17:40:24.182665+0000","last_active":"2024-09-12T18:59:27.741657+0000","last_peered":"2024-09-12T18:59:27.741657+0000","last_clean":"2024-09-12T18:59:27.741657+0000","last_became_active":"2024-09-12T17:40:24.181982+0000","last_became_peered":"2024-09-12T17:40:24.181982+0000","last_unstale":"2024-09-12T18:59:27.741657+0000","last_undegraded":"2024-09-12T18:59:27.741657+0000","last_fullsized":"2024-09-12T18:59:27.741657+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:55.908753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62664,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":1091,"num_write":438,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'721","reported_seq":2531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.805991+0000","last_change":"2024-09-12T17:40:26.187935+0000","last_active":"2024-09-12T18:59:30.805991+0000","last_peered":"2024-09-12T18:59:30.805991+0000","last_clean":"2024-09-12T18:59:30.805991+0000","last_became_active":"2024-09-12T17:40:26.187269+0000","last_became_peered":"2024-09-12T17:40:26.187269+0000","last_unstale":"2024-09-12T18:59:30.805991+0000","last_undegraded":"2024-09-12T18:59:30.805991+0000","last_fullsized":"2024-09-12T18:59:30.805991+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:57.828902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'139","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.277441+0000","last_change":"2024-09-12T17:40:28.192959+0000","last_active":"2024-09-12T18:58:02.277441+0000","last_peered":"2024-09-12T18:58:02.277441+0000","last_clean":"2024-09-12T18:58:02.277441+0000","last_became_active":"2024-09-12T17:40:28.192211+0000","last_became_peered":"2024-09-12T17:40:28.192211+0000","last_unstale":"2024-09-12T18:58:02.277441+0000","last_undegraded":"2024-09-12T18:58:02.277441+0000","last_fullsized":"2024-09-12T18:58:02.277441+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:29.331632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":224,"num_write":356,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'4139","reported_seq":4785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812556+0000","last_change":"2024-09-12T17:40:20.137018+0000","last_active":"2024-09-12T18:56:52.812556+0000","last_peered":"2024-09-12T18:56:52.812556+0000","last_clean":"2024-09-12T18:56:52.812556+0000","last_became_active":"2024-09-12T17:40:20.136148+0000","last_became_peered":"2024-09-12T17:40:20.136148+0000","last_unstale":"2024-09-12T18:56:52.812556+0000","last_undegraded":"2024-09-12T18:56:52.812556+0000","last_fullsized":"2024-09-12T18:56:52.812556+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":3000,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:28.267156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16638,"num_read_kb":13967,"num_write":6216,"num_write_kb":3097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'239","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:14.426006+0000","last_change":"2024-09-12T17:40:18.774322+0000","last_active":"2024-09-12T18:56:14.426006+0000","last_peered":"2024-09-12T18:56:14.426006+0000","last_clean":"2024-09-12T18:56:14.426006+0000","last_became_active":"2024-09-12T17:40:18.773552+0000","last_became_peered":"2024-09-12T17:40:18.773552+0000","last_unstale":"2024-09-12T18:56:14.426006+0000","last_undegraded":"2024-09-12T18:56:14.426006+0000","last_fullsized":"2024-09-12T18:56:14.426006+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:46.449493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10461028,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":414,"num_read_kb":17946,"num_write":865,"num_write_kb":45991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.378738+0000","last_change":"2024-09-12T17:40:22.144205+0000","last_active":"2024-09-12T18:59:27.378738+0000","last_peered":"2024-09-12T18:59:27.378738+0000","last_clean":"2024-09-12T18:59:27.378738+0000","last_became_active":"2024-09-12T17:40:22.143463+0000","last_became_peered":"2024-09-12T17:40:22.143463+0000","last_unstale":"2024-09-12T18:59:27.378738+0000","last_undegraded":"2024-09-12T18:59:27.378738+0000","last_fullsized":"2024-09-12T18:59:27.378738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:11.027627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":949,"num_read_kb":949,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'110","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450877+0000","last_change":"2024-09-12T17:40:24.330084+0000","last_active":"2024-09-12T18:56:57.450877+0000","last_peered":"2024-09-12T18:56:57.450877+0000","last_clean":"2024-09-12T18:56:57.450877+0000","last_became_active":"2024-09-12T17:40:24.329452+0000","last_became_peered":"2024-09-12T17:40:24.329452+0000","last_unstale":"2024-09-12T18:56:57.450877+0000","last_undegraded":"2024-09-12T18:56:57.450877+0000","last_fullsized":"2024-09-12T18:56:57.450877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:41.298862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'750","reported_seq":2622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.822927+0000","last_change":"2024-09-12T17:40:26.183775+0000","last_active":"2024-09-12T18:59:30.822927+0000","last_peered":"2024-09-12T18:59:30.822927+0000","last_clean":"2024-09-12T18:59:30.822927+0000","last_became_active":"2024-09-12T17:40:26.183016+0000","last_became_peered":"2024-09-12T17:40:26.183016+0000","last_unstale":"2024-09-12T18:59:30.822927+0000","last_undegraded":"2024-09-12T18:59:30.822927+0000","last_fullsized":"2024-09-12T18:59:30.822927+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:45.838846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'112","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821328+0000","last_change":"2024-09-12T17:40:28.180920+0000","last_active":"2024-09-12T18:57:32.821328+0000","last_peered":"2024-09-12T18:57:32.821328+0000","last_clean":"2024-09-12T18:57:32.821328+0000","last_became_active":"2024-09-12T17:40:28.180192+0000","last_became_peered":"2024-09-12T17:40:28.180192+0000","last_unstale":"2024-09-12T18:57:32.821328+0000","last_undegraded":"2024-09-12T18:57:32.821328+0000","last_fullsized":"2024-09-12T18:57:32.821328+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:20.350489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":167,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'272","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.460652+0000","last_change":"2024-09-12T17:40:20.126559+0000","last_active":"2024-09-12T18:57:12.460652+0000","last_peered":"2024-09-12T18:57:12.460652+0000","last_clean":"2024-09-12T18:57:12.460652+0000","last_became_active":"2024-09-12T17:40:20.125511+0000","last_became_peered":"2024-09-12T17:40:20.125511+0000","last_unstale":"2024-09-12T18:57:12.460652+0000","last_undegraded":"2024-09-12T18:57:12.460652+0000","last_fullsized":"2024-09-12T18:57:12.460652+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:21.984534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1212,"num_read_kb":1000,"num_write":434,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'234","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439056+0000","last_change":"2024-09-12T17:40:18.769294+0000","last_active":"2024-09-12T18:56:12.439056+0000","last_peered":"2024-09-12T18:56:12.439056+0000","last_clean":"2024-09-12T18:56:12.439056+0000","last_became_active":"2024-09-12T17:40:18.769054+0000","last_became_peered":"2024-09-12T17:40:18.769054+0000","last_unstale":"2024-09-12T18:56:12.439056+0000","last_undegraded":"2024-09-12T18:56:12.439056+0000","last_fullsized":"2024-09-12T18:56:12.439056+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:10.356128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4761001,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":352,"num_read_kb":78920,"num_write":837,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812532+0000","last_change":"2024-09-12T17:40:22.139642+0000","last_active":"2024-09-12T18:56:52.812532+0000","last_peered":"2024-09-12T18:56:52.812532+0000","last_clean":"2024-09-12T18:56:52.812532+0000","last_became_active":"2024-09-12T17:40:22.138875+0000","last_became_peered":"2024-09-12T17:40:22.138875+0000","last_unstale":"2024-09-12T18:56:52.812532+0000","last_undegraded":"2024-09-12T18:56:52.812532+0000","last_fullsized":"2024-09-12T18:56:52.812532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:04.385118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'392","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:12.674294+0000","last_change":"2024-09-12T17:40:24.174213+0000","last_active":"2024-09-12T18:59:12.674294+0000","last_peered":"2024-09-12T18:59:12.674294+0000","last_clean":"2024-09-12T18:59:12.674294+0000","last_became_active":"2024-09-12T17:40:24.173537+0000","last_became_peered":"2024-09-12T17:40:24.173537+0000","last_unstale":"2024-09-12T18:59:12.674294+0000","last_undegraded":"2024-09-12T18:59:12.674294+0000","last_fullsized":"2024-09-12T18:59:12.674294+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:35.315463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63339,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":637,"num_read_kb":1220,"num_write":502,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.436922+0000","last_change":"2024-09-12T17:40:26.184072+0000","last_active":"2024-09-12T18:56:57.436922+0000","last_peered":"2024-09-12T18:56:57.436922+0000","last_clean":"2024-09-12T18:56:57.436922+0000","last_became_active":"2024-09-12T17:40:26.183228+0000","last_became_peered":"2024-09-12T17:40:26.183228+0000","last_unstale":"2024-09-12T18:56:57.436922+0000","last_undegraded":"2024-09-12T18:56:57.436922+0000","last_fullsized":"2024-09-12T18:56:57.436922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.239515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'138","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.417590+0000","last_change":"2024-09-12T17:40:28.192535+0000","last_active":"2024-09-12T18:58:04.417590+0000","last_peered":"2024-09-12T18:58:04.417590+0000","last_clean":"2024-09-12T18:58:04.417590+0000","last_became_active":"2024-09-12T17:40:28.191461+0000","last_became_peered":"2024-09-12T17:40:28.191461+0000","last_unstale":"2024-09-12T18:58:04.417590+0000","last_undegraded":"2024-09-12T18:58:04.417590+0000","last_fullsized":"2024-09-12T18:58:04.417590+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:39.691469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":326,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'92","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.447236+0000","last_change":"2024-09-12T17:40:20.146944+0000","last_active":"2024-09-12T18:57:47.447236+0000","last_peered":"2024-09-12T18:57:47.447236+0000","last_clean":"2024-09-12T18:57:47.447236+0000","last_became_active":"2024-09-12T17:40:20.146160+0000","last_became_peered":"2024-09-12T17:40:20.146160+0000","last_unstale":"2024-09-12T18:57:47.447236+0000","last_undegraded":"2024-09-12T18:57:47.447236+0000","last_fullsized":"2024-09-12T18:57:47.447236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:10.252891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:22.442012+0000","last_change":"2024-09-12T17:40:03.638745+0000","last_active":"2024-09-12T18:56:22.442012+0000","last_peered":"2024-09-12T18:56:22.442012+0000","last_clean":"2024-09-12T18:56:22.442012+0000","last_became_active":"2024-09-12T17:40:03.636856+0000","last_became_peered":"2024-09-12T17:40:03.636856+0000","last_unstale":"2024-09-12T18:56:22.442012+0000","last_undegraded":"2024-09-12T18:56:22.442012+0000","last_fullsized":"2024-09-12T18:56:22.442012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_clean_scrub_stamp":"2024-09-12T17:40:02.615744+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:44.815912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637481+0000","last_change":"2024-09-12T17:40:11.694118+0000","last_active":"2024-09-12T18:57:17.637481+0000","last_peered":"2024-09-12T18:57:17.637481+0000","last_clean":"2024-09-12T18:57:17.637481+0000","last_became_active":"2024-09-12T17:40:09.670674+0000","last_became_peered":"2024-09-12T17:40:09.670674+0000","last_unstale":"2024-09-12T18:57:17.637481+0000","last_undegraded":"2024-09-12T18:57:17.637481+0000","last_fullsized":"2024-09-12T18:57:17.637481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:11.615670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001302742,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'313","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.458042+0000","last_change":"2024-09-12T17:40:18.774699+0000","last_active":"2024-09-12T18:57:27.458042+0000","last_peered":"2024-09-12T18:57:27.458042+0000","last_clean":"2024-09-12T18:57:27.458042+0000","last_became_active":"2024-09-12T17:40:18.774164+0000","last_became_peered":"2024-09-12T17:40:18.774164+0000","last_unstale":"2024-09-12T18:57:27.458042+0000","last_undegraded":"2024-09-12T18:57:27.458042+0000","last_fullsized":"2024-09-12T18:57:27.458042+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:30.058615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10725583,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":669,"num_read_kb":41233,"num_write":1060,"num_write_kb":37796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457318+0000","last_change":"2024-09-12T17:40:22.150388+0000","last_active":"2024-09-12T18:57:27.457318+0000","last_peered":"2024-09-12T18:57:27.457318+0000","last_clean":"2024-09-12T18:57:27.457318+0000","last_became_active":"2024-09-12T17:40:22.148190+0000","last_became_peered":"2024-09-12T17:40:22.148190+0000","last_unstale":"2024-09-12T18:57:27.457318+0000","last_undegraded":"2024-09-12T18:57:27.457318+0000","last_fullsized":"2024-09-12T18:57:27.457318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:47.144440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'721","reported_seq":1423,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.706201+0000","last_change":"2024-09-12T17:40:24.177543+0000","last_active":"2024-09-12T18:59:27.706201+0000","last_peered":"2024-09-12T18:59:27.706201+0000","last_clean":"2024-09-12T18:59:27.706201+0000","last_became_active":"2024-09-12T17:40:24.176757+0000","last_became_peered":"2024-09-12T17:40:24.176757+0000","last_unstale":"2024-09-12T18:59:27.706201+0000","last_undegraded":"2024-09-12T18:59:27.706201+0000","last_fullsized":"2024-09-12T18:59:27.706201+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.566492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172295,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1398,"num_read_kb":2961,"num_write":1334,"num_write_kb":1179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.458091+0000","last_change":"2024-09-12T17:40:26.191218+0000","last_active":"2024-09-12T18:56:17.458091+0000","last_peered":"2024-09-12T18:56:17.458091+0000","last_clean":"2024-09-12T18:56:17.458091+0000","last_became_active":"2024-09-12T17:40:26.190522+0000","last_became_peered":"2024-09-12T17:40:26.190522+0000","last_unstale":"2024-09-12T18:56:17.458091+0000","last_undegraded":"2024-09-12T18:56:17.458091+0000","last_fullsized":"2024-09-12T18:56:17.458091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:36.917179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'197","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.131600+0000","last_change":"2024-09-12T17:40:28.194274+0000","last_active":"2024-09-12T18:58:06.131600+0000","last_peered":"2024-09-12T18:58:06.131600+0000","last_clean":"2024-09-12T18:58:06.131600+0000","last_became_active":"2024-09-12T17:40:28.193456+0000","last_became_peered":"2024-09-12T17:40:28.193456+0000","last_unstale":"2024-09-12T18:58:06.131600+0000","last_undegraded":"2024-09-12T18:58:06.131600+0000","last_fullsized":"2024-09-12T18:58:06.131600+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:18.966712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":530,"num_write":424,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'121","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456780+0000","last_change":"2024-09-12T17:40:20.131034+0000","last_active":"2024-09-12T18:56:12.456780+0000","last_peered":"2024-09-12T18:56:12.456780+0000","last_clean":"2024-09-12T18:56:12.456780+0000","last_became_active":"2024-09-12T17:40:20.130774+0000","last_became_peered":"2024-09-12T17:40:20.130774+0000","last_unstale":"2024-09-12T18:56:12.456780+0000","last_undegraded":"2024-09-12T18:56:12.456780+0000","last_fullsized":"2024-09-12T18:56:12.456780+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:27.582751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":441,"num_write":172,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.443272+0000","last_change":"2024-09-12T17:40:11.747849+0000","last_active":"2024-09-12T18:56:27.443272+0000","last_peered":"2024-09-12T18:56:27.443272+0000","last_clean":"2024-09-12T18:56:27.443272+0000","last_became_active":"2024-09-12T17:40:09.666272+0000","last_became_peered":"2024-09-12T17:40:09.666272+0000","last_unstale":"2024-09-12T18:56:27.443272+0000","last_undegraded":"2024-09-12T18:56:27.443272+0000","last_fullsized":"2024-09-12T18:56:27.443272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:15.707497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001052545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'301","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473202+0000","last_change":"2024-09-12T17:40:18.775027+0000","last_active":"2024-09-12T18:57:27.473202+0000","last_peered":"2024-09-12T18:57:27.473202+0000","last_clean":"2024-09-12T18:57:27.473202+0000","last_became_active":"2024-09-12T17:40:18.774751+0000","last_became_peered":"2024-09-12T17:40:18.774751+0000","last_unstale":"2024-09-12T18:57:27.473202+0000","last_undegraded":"2024-09-12T18:57:27.473202+0000","last_fullsized":"2024-09-12T18:57:27.473202+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.877317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":708879,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":444,"num_read_kb":728,"num_write":1139,"num_write_kb":17029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.622557+0000","last_change":"2024-09-12T17:40:22.147871+0000","last_active":"2024-09-12T18:56:12.622557+0000","last_peered":"2024-09-12T18:56:12.622557+0000","last_clean":"2024-09-12T18:56:12.622557+0000","last_became_active":"2024-09-12T17:40:22.147184+0000","last_became_peered":"2024-09-12T17:40:22.147184+0000","last_unstale":"2024-09-12T18:56:12.622557+0000","last_undegraded":"2024-09-12T18:56:12.622557+0000","last_fullsized":"2024-09-12T18:56:12.622557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:31.847917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1331","reported_seq":3223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:31.357353+0000","last_change":"2024-09-12T17:40:24.169842+0000","last_active":"2024-09-12T18:59:31.357353+0000","last_peered":"2024-09-12T18:59:31.357353+0000","last_clean":"2024-09-12T18:59:31.357353+0000","last_became_active":"2024-09-12T17:40:24.169050+0000","last_became_peered":"2024-09-12T17:40:24.169050+0000","last_unstale":"2024-09-12T18:59:31.357353+0000","last_undegraded":"2024-09-12T18:59:31.357353+0000","last_fullsized":"2024-09-12T18:59:31.357353+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":1300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:15.887934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177592,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2117,"num_read_kb":3763,"num_write":1248,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.462335+0000","last_change":"2024-09-12T17:40:26.203093+0000","last_active":"2024-09-12T18:57:47.462335+0000","last_peered":"2024-09-12T18:57:47.462335+0000","last_clean":"2024-09-12T18:57:47.462335+0000","last_became_active":"2024-09-12T17:40:26.202360+0000","last_became_peered":"2024-09-12T17:40:26.202360+0000","last_unstale":"2024-09-12T18:57:47.462335+0000","last_undegraded":"2024-09-12T18:57:47.462335+0000","last_fullsized":"2024-09-12T18:57:47.462335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:51.977257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'190","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.452907+0000","last_change":"2024-09-12T17:40:28.190152+0000","last_active":"2024-09-12T18:56:37.452907+0000","last_peered":"2024-09-12T18:56:37.452907+0000","last_clean":"2024-09-12T18:56:37.452907+0000","last_became_active":"2024-09-12T17:40:28.189387+0000","last_became_peered":"2024-09-12T17:40:28.189387+0000","last_unstale":"2024-09-12T18:56:37.452907+0000","last_undegraded":"2024-09-12T18:56:37.452907+0000","last_fullsized":"2024-09-12T18:56:37.452907+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:39.878519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":364,"num_write":413,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'193","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447713+0000","last_change":"2024-09-12T17:40:20.129924+0000","last_active":"2024-09-12T18:56:12.447713+0000","last_peered":"2024-09-12T18:56:12.447713+0000","last_clean":"2024-09-12T18:56:12.447713+0000","last_became_active":"2024-09-12T17:40:20.129646+0000","last_became_peered":"2024-09-12T17:40:20.129646+0000","last_unstale":"2024-09-12T18:56:12.447713+0000","last_undegraded":"2024-09-12T18:56:12.447713+0000","last_fullsized":"2024-09-12T18:56:12.447713+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:01.198659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":706,"num_write":294,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:14.447959+0000","last_change":"2024-09-12T17:40:11.749016+0000","last_active":"2024-09-12T18:57:14.447959+0000","last_peered":"2024-09-12T18:57:14.447959+0000","last_clean":"2024-09-12T18:57:14.447959+0000","last_became_active":"2024-09-12T17:40:09.771196+0000","last_became_peered":"2024-09-12T17:40:09.771196+0000","last_unstale":"2024-09-12T18:57:14.447959+0000","last_undegraded":"2024-09-12T18:57:14.447959+0000","last_fullsized":"2024-09-12T18:57:14.447959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:48.611278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010655720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'263","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:16.016475+0000","last_change":"2024-09-12T17:40:18.766281+0000","last_active":"2024-09-12T18:59:16.016475+0000","last_peered":"2024-09-12T18:59:16.016475+0000","last_clean":"2024-09-12T18:59:16.016475+0000","last_became_active":"2024-09-12T17:40:18.759514+0000","last_became_peered":"2024-09-12T17:40:18.759514+0000","last_unstale":"2024-09-12T18:59:16.016475+0000","last_undegraded":"2024-09-12T18:59:16.016475+0000","last_fullsized":"2024-09-12T18:59:16.016475+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:37.907891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14413366,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":506,"num_read_kb":20357,"num_write":968,"num_write_kb":29003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:14.436342+0000","last_change":"2024-09-12T17:40:22.139338+0000","last_active":"2024-09-12T18:56:14.436342+0000","last_peered":"2024-09-12T18:56:14.436342+0000","last_clean":"2024-09-12T18:56:14.436342+0000","last_became_active":"2024-09-12T17:40:22.138606+0000","last_became_peered":"2024-09-12T17:40:22.138606+0000","last_unstale":"2024-09-12T18:56:14.436342+0000","last_undegraded":"2024-09-12T18:56:14.436342+0000","last_fullsized":"2024-09-12T18:56:14.436342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:11.361933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'294","reported_seq":1802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.983546+0000","last_change":"2024-09-12T17:40:24.330435+0000","last_active":"2024-09-12T18:59:27.983546+0000","last_peered":"2024-09-12T18:59:27.983546+0000","last_clean":"2024-09-12T18:59:27.983546+0000","last_became_active":"2024-09-12T17:40:24.329425+0000","last_became_peered":"2024-09-12T17:40:24.329425+0000","last_unstale":"2024-09-12T18:59:27.983546+0000","last_undegraded":"2024-09-12T18:59:27.983546+0000","last_fullsized":"2024-09-12T18:59:27.983546+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:18.922243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":264,"num_read_kb":256,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.474435+0000","last_change":"2024-09-12T17:40:26.190790+0000","last_active":"2024-09-12T18:57:32.474435+0000","last_peered":"2024-09-12T18:57:32.474435+0000","last_clean":"2024-09-12T18:57:32.474435+0000","last_became_active":"2024-09-12T17:40:26.188740+0000","last_became_peered":"2024-09-12T17:40:26.188740+0000","last_unstale":"2024-09-12T18:57:32.474435+0000","last_undegraded":"2024-09-12T18:57:32.474435+0000","last_fullsized":"2024-09-12T18:57:32.474435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:41.526051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'269","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.609250+0000","last_change":"2024-09-12T17:40:28.202892+0000","last_active":"2024-09-12T18:58:06.609250+0000","last_peered":"2024-09-12T18:58:06.609250+0000","last_clean":"2024-09-12T18:58:06.609250+0000","last_became_active":"2024-09-12T17:40:28.202238+0000","last_became_peered":"2024-09-12T17:40:28.202238+0000","last_unstale":"2024-09-12T18:58:06.609250+0000","last_undegraded":"2024-09-12T18:58:06.609250+0000","last_fullsized":"2024-09-12T18:58:06.609250+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:40.299625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":592,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'387","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464045+0000","last_change":"2024-09-12T17:40:20.128374+0000","last_active":"2024-09-12T18:57:27.464045+0000","last_peered":"2024-09-12T18:57:27.464045+0000","last_clean":"2024-09-12T18:57:27.464045+0000","last_became_active":"2024-09-12T17:40:20.127774+0000","last_became_peered":"2024-09-12T17:40:20.127774+0000","last_unstale":"2024-09-12T18:57:27.464045+0000","last_undegraded":"2024-09-12T18:57:27.464045+0000","last_fullsized":"2024-09-12T18:57:27.464045+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:30.582322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1689,"num_read_kb":1329,"num_write":647,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637396+0000","last_change":"2024-09-12T17:40:11.695547+0000","last_active":"2024-09-12T18:57:17.637396+0000","last_peered":"2024-09-12T18:57:17.637396+0000","last_clean":"2024-09-12T18:57:17.637396+0000","last_became_active":"2024-09-12T17:40:09.672745+0000","last_became_peered":"2024-09-12T17:40:09.672745+0000","last_unstale":"2024-09-12T18:57:17.637396+0000","last_undegraded":"2024-09-12T18:57:17.637396+0000","last_fullsized":"2024-09-12T18:57:17.637396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:10.363335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002775694,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'316","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820175+0000","last_change":"2024-09-12T17:40:18.770896+0000","last_active":"2024-09-12T18:57:27.820175+0000","last_peered":"2024-09-12T18:57:27.820175+0000","last_clean":"2024-09-12T18:57:27.820175+0000","last_became_active":"2024-09-12T17:40:18.769909+0000","last_became_peered":"2024-09-12T17:40:18.769909+0000","last_unstale":"2024-09-12T18:57:27.820175+0000","last_undegraded":"2024-09-12T18:57:27.820175+0000","last_fullsized":"2024-09-12T18:57:27.820175+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:26.327437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3465362,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":506,"num_read_kb":12377,"num_write":1241,"num_write_kb":22203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.476785+0000","last_change":"2024-09-12T17:40:22.145902+0000","last_active":"2024-09-12T18:57:42.476785+0000","last_peered":"2024-09-12T18:57:42.476785+0000","last_clean":"2024-09-12T18:57:42.476785+0000","last_became_active":"2024-09-12T17:40:22.145410+0000","last_became_peered":"2024-09-12T17:40:22.145410+0000","last_unstale":"2024-09-12T18:57:42.476785+0000","last_undegraded":"2024-09-12T18:57:42.476785+0000","last_fullsized":"2024-09-12T18:57:42.476785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:20.122905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'162","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:25.961675+0000","last_change":"2024-09-12T17:40:24.170740+0000","last_active":"2024-09-12T18:59:25.961675+0000","last_peered":"2024-09-12T18:59:25.961675+0000","last_clean":"2024-09-12T18:59:25.961675+0000","last_became_active":"2024-09-12T17:40:24.169937+0000","last_became_peered":"2024-09-12T17:40:24.169937+0000","last_unstale":"2024-09-12T18:59:25.961675+0000","last_undegraded":"2024-09-12T18:59:25.961675+0000","last_fullsized":"2024-09-12T18:59:25.961675+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:52.608977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":193,"num_write":146,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.428609+0000","last_change":"2024-09-12T17:40:26.172468+0000","last_active":"2024-09-12T18:56:17.428609+0000","last_peered":"2024-09-12T18:56:17.428609+0000","last_clean":"2024-09-12T18:56:17.428609+0000","last_became_active":"2024-09-12T17:40:26.171660+0000","last_became_peered":"2024-09-12T17:40:26.171660+0000","last_unstale":"2024-09-12T18:56:17.428609+0000","last_undegraded":"2024-09-12T18:56:17.428609+0000","last_fullsized":"2024-09-12T18:56:17.428609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:42.338225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'122","reported_seq":672,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.623502+0000","last_change":"2024-09-12T17:40:28.202494+0000","last_active":"2024-09-12T18:56:17.623502+0000","last_peered":"2024-09-12T18:56:17.623502+0000","last_clean":"2024-09-12T18:56:17.623502+0000","last_became_active":"2024-09-12T17:40:28.201694+0000","last_became_peered":"2024-09-12T17:40:28.201694+0000","last_unstale":"2024-09-12T18:56:17.623502+0000","last_undegraded":"2024-09-12T18:56:17.623502+0000","last_fullsized":"2024-09-12T18:56:17.623502+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:49.909677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":250,"num_write":312,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'144","reported_seq":749,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.463949+0000","last_change":"2024-09-12T17:40:20.128037+0000","last_active":"2024-09-12T18:57:27.463949+0000","last_peered":"2024-09-12T18:57:27.463949+0000","last_clean":"2024-09-12T18:57:27.463949+0000","last_became_active":"2024-09-12T17:40:20.127727+0000","last_became_peered":"2024-09-12T17:40:20.127727+0000","last_unstale":"2024-09-12T18:57:27.463949+0000","last_undegraded":"2024-09-12T18:57:27.463949+0000","last_fullsized":"2024-09-12T18:57:27.463949+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:36.420192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":625,"num_read_kb":513,"num_write":241,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'245","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.653908+0000","last_change":"2024-09-12T17:40:18.769528+0000","last_active":"2024-09-12T18:57:42.653908+0000","last_peered":"2024-09-12T18:57:42.653908+0000","last_clean":"2024-09-12T18:57:42.653908+0000","last_became_active":"2024-09-12T17:40:18.768544+0000","last_became_peered":"2024-09-12T17:40:18.768544+0000","last_unstale":"2024-09-12T18:57:42.653908+0000","last_undegraded":"2024-09-12T18:57:42.653908+0000","last_fullsized":"2024-09-12T18:57:42.653908+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:48.979420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23471,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":360,"num_read_kb":64899,"num_write":862,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.461730+0000","last_change":"2024-09-12T17:40:11.682969+0000","last_active":"2024-09-12T18:57:17.461730+0000","last_peered":"2024-09-12T18:57:17.461730+0000","last_clean":"2024-09-12T18:57:17.461730+0000","last_became_active":"2024-09-12T17:40:09.770645+0000","last_became_peered":"2024-09-12T17:40:09.770645+0000","last_unstale":"2024-09-12T18:57:17.461730+0000","last_undegraded":"2024-09-12T18:57:17.461730+0000","last_fullsized":"2024-09-12T18:57:17.461730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:00.566138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091158000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473305+0000","last_change":"2024-09-12T17:40:22.136717+0000","last_active":"2024-09-12T18:57:27.473305+0000","last_peered":"2024-09-12T18:57:27.473305+0000","last_clean":"2024-09-12T18:57:27.473305+0000","last_became_active":"2024-09-12T17:40:22.136155+0000","last_became_peered":"2024-09-12T17:40:22.136155+0000","last_unstale":"2024-09-12T18:57:27.473305+0000","last_undegraded":"2024-09-12T18:57:27.473305+0000","last_fullsized":"2024-09-12T18:57:27.473305+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:23.121643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'641","reported_seq":1327,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.688030+0000","last_change":"2024-09-12T17:40:24.174815+0000","last_active":"2024-09-12T18:59:27.688030+0000","last_peered":"2024-09-12T18:59:27.688030+0000","last_clean":"2024-09-12T18:59:27.688030+0000","last_became_active":"2024-09-12T17:40:24.173380+0000","last_became_peered":"2024-09-12T17:40:24.173380+0000","last_unstale":"2024-09-12T18:59:27.688030+0000","last_undegraded":"2024-09-12T18:59:27.688030+0000","last_fullsized":"2024-09-12T18:59:27.688030+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:43.915482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128155,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1676,"num_read_kb":2774,"num_write":2188,"num_write_kb":2016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821238+0000","last_change":"2024-09-12T17:40:26.192118+0000","last_active":"2024-09-12T18:57:32.821238+0000","last_peered":"2024-09-12T18:57:32.821238+0000","last_clean":"2024-09-12T18:57:32.821238+0000","last_became_active":"2024-09-12T17:40:26.191417+0000","last_became_peered":"2024-09-12T17:40:26.191417+0000","last_unstale":"2024-09-12T18:57:32.821238+0000","last_undegraded":"2024-09-12T18:57:32.821238+0000","last_fullsized":"2024-09-12T18:57:32.821238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:38.892952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'174","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.340189+0000","last_change":"2024-09-12T17:40:28.187802+0000","last_active":"2024-09-12T18:58:06.340189+0000","last_peered":"2024-09-12T18:58:06.340189+0000","last_clean":"2024-09-12T18:58:06.340189+0000","last_became_active":"2024-09-12T17:40:28.186922+0000","last_became_peered":"2024-09-12T17:40:28.186922+0000","last_unstale":"2024-09-12T18:58:06.340189+0000","last_undegraded":"2024-09-12T18:58:06.340189+0000","last_fullsized":"2024-09-12T18:58:06.340189+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.041023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'143","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473328+0000","last_change":"2024-09-12T17:40:20.112762+0000","last_active":"2024-09-12T18:57:27.473328+0000","last_peered":"2024-09-12T18:57:27.473328+0000","last_clean":"2024-09-12T18:57:27.473328+0000","last_became_active":"2024-09-12T17:40:20.112490+0000","last_became_peered":"2024-09-12T17:40:20.112490+0000","last_unstale":"2024-09-12T18:57:27.473328+0000","last_undegraded":"2024-09-12T18:57:27.473328+0000","last_fullsized":"2024-09-12T18:57:27.473328+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:36.390829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":606,"num_read_kb":504,"num_write":208,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'243","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464086+0000","last_change":"2024-09-12T17:40:18.760773+0000","last_active":"2024-09-12T18:57:27.464086+0000","last_peered":"2024-09-12T18:57:27.464086+0000","last_clean":"2024-09-12T18:57:27.464086+0000","last_became_active":"2024-09-12T17:40:18.760130+0000","last_became_peered":"2024-09-12T17:40:18.760130+0000","last_unstale":"2024-09-12T18:57:27.464086+0000","last_undegraded":"2024-09-12T18:57:27.464086+0000","last_fullsized":"2024-09-12T18:57:27.464086+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:54.991344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2431354,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":360,"num_read_kb":2116,"num_write":864,"num_write_kb":13193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.458586+0000","last_change":"2024-09-12T17:40:11.747892+0000","last_active":"2024-09-12T18:57:32.458586+0000","last_peered":"2024-09-12T18:57:32.458586+0000","last_clean":"2024-09-12T18:57:32.458586+0000","last_became_active":"2024-09-12T17:40:09.770504+0000","last_became_peered":"2024-09-12T17:40:09.770504+0000","last_unstale":"2024-09-12T18:57:32.458586+0000","last_undegraded":"2024-09-12T18:57:32.458586+0000","last_fullsized":"2024-09-12T18:57:32.458586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:45.742830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001093257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443134+0000","last_change":"2024-09-12T17:40:22.136820+0000","last_active":"2024-09-12T18:57:27.443134+0000","last_peered":"2024-09-12T18:57:27.443134+0000","last_clean":"2024-09-12T18:57:27.443134+0000","last_became_active":"2024-09-12T17:40:22.136095+0000","last_became_peered":"2024-09-12T17:40:22.136095+0000","last_unstale":"2024-09-12T18:57:27.443134+0000","last_undegraded":"2024-09-12T18:57:27.443134+0000","last_fullsized":"2024-09-12T18:57:27.443134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:59.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'255","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:25.949567+0000","last_change":"2024-09-12T17:40:24.333148+0000","last_active":"2024-09-12T18:58:25.949567+0000","last_peered":"2024-09-12T18:58:25.949567+0000","last_clean":"2024-09-12T18:58:25.949567+0000","last_became_active":"2024-09-12T17:40:24.332477+0000","last_became_peered":"2024-09-12T17:40:24.332477+0000","last_unstale":"2024-09-12T18:58:25.949567+0000","last_undegraded":"2024-09-12T18:58:25.949567+0000","last_fullsized":"2024-09-12T18:58:25.949567+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:09.053613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":296,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'755","reported_seq":3092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:30.818273+0000","last_change":"2024-09-12T17:40:26.180479+0000","last_active":"2024-09-12T18:59:30.818273+0000","last_peered":"2024-09-12T18:59:30.818273+0000","last_clean":"2024-09-12T18:59:30.818273+0000","last_became_active":"2024-09-12T17:40:26.179728+0000","last_became_peered":"2024-09-12T17:40:26.179728+0000","last_unstale":"2024-09-12T18:59:30.818273+0000","last_undegraded":"2024-09-12T18:59:30.818273+0000","last_fullsized":"2024-09-12T18:59:30.818273+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:15.964800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'144","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.754378+0000","last_change":"2024-09-12T17:40:28.202506+0000","last_active":"2024-09-12T18:59:27.754378+0000","last_peered":"2024-09-12T18:59:27.754378+0000","last_clean":"2024-09-12T18:59:27.754378+0000","last_became_active":"2024-09-12T17:40:28.201571+0000","last_became_peered":"2024-09-12T17:40:28.201571+0000","last_unstale":"2024-09-12T18:59:27.754378+0000","last_undegraded":"2024-09-12T18:59:27.754378+0000","last_fullsized":"2024-09-12T18:59:27.754378+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:40.742392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":253,"num_write":364,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'450","reported_seq":1163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446531+0000","last_change":"2024-09-12T17:40:20.136291+0000","last_active":"2024-09-12T18:56:42.446531+0000","last_peered":"2024-09-12T18:56:42.446531+0000","last_clean":"2024-09-12T18:56:42.446531+0000","last_became_active":"2024-09-12T17:40:20.135950+0000","last_became_peered":"2024-09-12T17:40:20.135950+0000","last_unstale":"2024-09-12T18:56:42.446531+0000","last_undegraded":"2024-09-12T18:56:42.446531+0000","last_fullsized":"2024-09-12T18:56:42.446531+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:02.260304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1875,"num_read_kb":1500,"num_write":660,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'263","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439422+0000","last_change":"2024-09-12T17:40:18.762841+0000","last_active":"2024-09-12T18:56:12.439422+0000","last_peered":"2024-09-12T18:56:12.439422+0000","last_clean":"2024-09-12T18:56:12.439422+0000","last_became_active":"2024-09-12T17:40:18.762324+0000","last_became_peered":"2024-09-12T17:40:18.762324+0000","last_unstale":"2024-09-12T18:56:12.439422+0000","last_undegraded":"2024-09-12T18:56:12.439422+0000","last_fullsized":"2024-09-12T18:56:12.439422+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:21.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13971098,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":434,"num_read_kb":85957,"num_write":956,"num_write_kb":37704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.445258+0000","last_change":"2024-09-12T17:40:11.683217+0000","last_active":"2024-09-12T18:56:02.445258+0000","last_peered":"2024-09-12T18:56:02.445258+0000","last_clean":"2024-09-12T18:56:02.445258+0000","last_became_active":"2024-09-12T17:40:09.671019+0000","last_became_peered":"2024-09-12T17:40:09.671019+0000","last_unstale":"2024-09-12T18:56:02.445258+0000","last_undegraded":"2024-09-12T18:56:02.445258+0000","last_fullsized":"2024-09-12T18:56:02.445258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:29.653884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096571,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820072+0000","last_change":"2024-09-12T17:40:22.146908+0000","last_active":"2024-09-12T18:57:27.820072+0000","last_peered":"2024-09-12T18:57:27.820072+0000","last_clean":"2024-09-12T18:57:27.820072+0000","last_became_active":"2024-09-12T17:40:22.146131+0000","last_became_peered":"2024-09-12T17:40:22.146131+0000","last_unstale":"2024-09-12T18:57:27.820072+0000","last_undegraded":"2024-09-12T18:57:27.820072+0000","last_fullsized":"2024-09-12T18:57:27.820072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:43.916632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'135","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821299+0000","last_change":"2024-09-12T17:40:24.165118+0000","last_active":"2024-09-12T18:57:32.821299+0000","last_peered":"2024-09-12T18:57:32.821299+0000","last_clean":"2024-09-12T18:57:32.821299+0000","last_became_active":"2024-09-12T17:40:24.163566+0000","last_became_peered":"2024-09-12T17:40:24.163566+0000","last_unstale":"2024-09-12T18:57:32.821299+0000","last_undegraded":"2024-09-12T18:57:32.821299+0000","last_fullsized":"2024-09-12T18:57:32.821299+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.865870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'783","reported_seq":2820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:31.415589+0000","last_change":"2024-09-12T17:40:26.195048+0000","last_active":"2024-09-12T18:59:31.415589+0000","last_peered":"2024-09-12T18:59:31.415589+0000","last_clean":"2024-09-12T18:59:31.415589+0000","last_became_active":"2024-09-12T17:40:26.194293+0000","last_became_peered":"2024-09-12T17:40:26.194293+0000","last_unstale":"2024-09-12T18:59:31.415589+0000","last_undegraded":"2024-09-12T18:59:31.415589+0000","last_fullsized":"2024-09-12T18:59:31.415589+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:29.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'199","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.466585+0000","last_change":"2024-09-12T17:40:28.207712+0000","last_active":"2024-09-12T18:56:57.466585+0000","last_peered":"2024-09-12T18:56:57.466585+0000","last_clean":"2024-09-12T18:56:57.466585+0000","last_became_active":"2024-09-12T17:40:28.207048+0000","last_became_peered":"2024-09-12T17:40:28.207048+0000","last_unstale":"2024-09-12T18:56:57.466585+0000","last_undegraded":"2024-09-12T18:56:57.466585+0000","last_fullsized":"2024-09-12T18:56:57.466585+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:43.200882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":318,"num_write":457,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'86","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820038+0000","last_change":"2024-09-12T17:40:20.143011+0000","last_active":"2024-09-12T18:57:27.820038+0000","last_peered":"2024-09-12T18:57:27.820038+0000","last_clean":"2024-09-12T18:57:27.820038+0000","last_became_active":"2024-09-12T17:40:20.142323+0000","last_became_peered":"2024-09-12T17:40:20.142323+0000","last_unstale":"2024-09-12T18:57:27.820038+0000","last_undegraded":"2024-09-12T18:57:27.820038+0000","last_fullsized":"2024-09-12T18:57:27.820038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:05.353429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":391,"num_read_kb":327,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'354","reported_seq":1135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:41.610134+0000","last_change":"2024-09-12T17:40:18.767413+0000","last_active":"2024-09-12T18:56:41.610134+0000","last_peered":"2024-09-12T18:56:41.610134+0000","last_clean":"2024-09-12T18:56:41.610134+0000","last_became_active":"2024-09-12T17:40:18.766817+0000","last_became_peered":"2024-09-12T17:40:18.766817+0000","last_unstale":"2024-09-12T18:56:41.610134+0000","last_undegraded":"2024-09-12T18:56:41.610134+0000","last_fullsized":"2024-09-12T18:56:41.610134+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:50.259112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11303299,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":878,"num_read_kb":8527,"num_write":1293,"num_write_kb":43864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.425422+0000","last_change":"2024-09-12T17:40:11.748529+0000","last_active":"2024-09-12T18:56:02.425422+0000","last_peered":"2024-09-12T18:56:02.425422+0000","last_clean":"2024-09-12T18:56:02.425422+0000","last_became_active":"2024-09-12T17:40:09.674331+0000","last_became_peered":"2024-09-12T17:40:09.674331+0000","last_unstale":"2024-09-12T18:56:02.425422+0000","last_undegraded":"2024-09-12T18:56:02.425422+0000","last_fullsized":"2024-09-12T18:56:02.425422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:20.063434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446575+0000","last_change":"2024-09-12T17:40:22.147841+0000","last_active":"2024-09-12T18:56:42.446575+0000","last_peered":"2024-09-12T18:56:42.446575+0000","last_clean":"2024-09-12T18:56:42.446575+0000","last_became_active":"2024-09-12T17:40:22.147341+0000","last_became_peered":"2024-09-12T17:40:22.147341+0000","last_unstale":"2024-09-12T18:56:42.446575+0000","last_undegraded":"2024-09-12T18:56:42.446575+0000","last_fullsized":"2024-09-12T18:56:42.446575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:33.825775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'774","reported_seq":1504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.694672+0000","last_change":"2024-09-12T17:40:24.330059+0000","last_active":"2024-09-12T18:59:27.694672+0000","last_peered":"2024-09-12T18:59:27.694672+0000","last_clean":"2024-09-12T18:59:27.694672+0000","last_became_active":"2024-09-12T17:40:24.329314+0000","last_became_peered":"2024-09-12T17:40:24.329314+0000","last_unstale":"2024-09-12T18:59:27.694672+0000","last_undegraded":"2024-09-12T18:59:27.694672+0000","last_fullsized":"2024-09-12T18:59:27.694672+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:42.536254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178451,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1364,"num_read_kb":2999,"num_write":1126,"num_write_kb":919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.458785+0000","last_change":"2024-09-12T17:40:26.199233+0000","last_active":"2024-09-12T18:57:32.458785+0000","last_peered":"2024-09-12T18:57:32.458785+0000","last_clean":"2024-09-12T18:57:32.458785+0000","last_became_active":"2024-09-12T17:40:26.197718+0000","last_became_peered":"2024-09-12T17:40:26.197718+0000","last_unstale":"2024-09-12T18:57:32.458785+0000","last_undegraded":"2024-09-12T18:57:32.458785+0000","last_fullsized":"2024-09-12T18:57:32.458785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:57.822527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'117","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.632901+0000","last_change":"2024-09-12T17:40:28.199911+0000","last_active":"2024-09-12T18:56:57.632901+0000","last_peered":"2024-09-12T18:56:57.632901+0000","last_clean":"2024-09-12T18:56:57.632901+0000","last_became_active":"2024-09-12T17:40:28.199295+0000","last_became_peered":"2024-09-12T17:40:28.199295+0000","last_unstale":"2024-09-12T18:56:57.632901+0000","last_undegraded":"2024-09-12T18:56:57.632901+0000","last_fullsized":"2024-09-12T18:56:57.632901+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:22.472810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":147,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'106","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.518640+0000","last_change":"2024-09-12T17:40:28.192741+0000","last_active":"2024-09-12T18:58:06.518640+0000","last_peered":"2024-09-12T18:58:06.518640+0000","last_clean":"2024-09-12T18:58:06.518640+0000","last_became_active":"2024-09-12T17:40:28.192019+0000","last_became_peered":"2024-09-12T17:40:28.192019+0000","last_unstale":"2024-09-12T18:58:06.518640+0000","last_undegraded":"2024-09-12T18:58:06.518640+0000","last_fullsized":"2024-09-12T18:58:06.518640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:03.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":192,"num_write":225,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'111","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.818982+0000","last_change":"2024-09-12T17:40:20.136571+0000","last_active":"2024-09-12T18:57:22.818982+0000","last_peered":"2024-09-12T18:57:22.818982+0000","last_clean":"2024-09-12T18:57:22.818982+0000","last_became_active":"2024-09-12T17:40:20.135868+0000","last_became_peered":"2024-09-12T17:40:20.135868+0000","last_unstale":"2024-09-12T18:57:22.818982+0000","last_undegraded":"2024-09-12T18:57:22.818982+0000","last_fullsized":"2024-09-12T18:57:22.818982+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:37.134752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":445,"num_write":160,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'223","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821377+0000","last_change":"2024-09-12T17:40:18.789847+0000","last_active":"2024-09-12T18:57:32.821377+0000","last_peered":"2024-09-12T18:57:32.821377+0000","last_clean":"2024-09-12T18:57:32.821377+0000","last_became_active":"2024-09-12T17:40:18.788674+0000","last_became_peered":"2024-09-12T17:40:18.788674+0000","last_unstale":"2024-09-12T18:57:32.821377+0000","last_undegraded":"2024-09-12T18:57:32.821377+0000","last_fullsized":"2024-09-12T18:57:32.821377+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:37.689644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6387521,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":354,"num_read_kb":10615,"num_write":846,"num_write_kb":14901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.462809+0000","last_change":"2024-09-12T17:40:22.141831+0000","last_active":"2024-09-12T18:57:22.462809+0000","last_peered":"2024-09-12T18:57:22.462809+0000","last_clean":"2024-09-12T18:57:22.462809+0000","last_became_active":"2024-09-12T17:40:22.141326+0000","last_became_peered":"2024-09-12T17:40:22.141326+0000","last_unstale":"2024-09-12T18:57:22.462809+0000","last_undegraded":"2024-09-12T18:57:22.462809+0000","last_fullsized":"2024-09-12T18:57:22.462809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:09.004014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'299","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.713756+0000","last_change":"2024-09-12T17:40:24.171008+0000","last_active":"2024-09-12T18:59:27.713756+0000","last_peered":"2024-09-12T18:59:27.713756+0000","last_clean":"2024-09-12T18:59:27.713756+0000","last_became_active":"2024-09-12T17:40:24.169248+0000","last_became_peered":"2024-09-12T17:40:24.169248+0000","last_unstale":"2024-09-12T18:59:27.713756+0000","last_undegraded":"2024-09-12T18:59:27.713756+0000","last_fullsized":"2024-09-12T18:59:27.713756+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:18.401232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60948,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":1072,"num_write":414,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457958+0000","last_change":"2024-09-12T17:40:26.204596+0000","last_active":"2024-09-12T18:57:27.457958+0000","last_peered":"2024-09-12T18:57:27.457958+0000","last_clean":"2024-09-12T18:57:27.457958+0000","last_became_active":"2024-09-12T17:40:26.203855+0000","last_became_peered":"2024-09-12T17:40:26.203855+0000","last_unstale":"2024-09-12T18:57:27.457958+0000","last_undegraded":"2024-09-12T18:57:27.457958+0000","last_fullsized":"2024-09-12T18:57:27.457958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:26.029987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.597637+0000","last_change":"2024-09-12T17:40:28.205116+0000","last_active":"2024-09-12T18:57:32.597637+0000","last_peered":"2024-09-12T18:57:32.597637+0000","last_clean":"2024-09-12T18:57:32.597637+0000","last_became_active":"2024-09-12T17:40:28.204204+0000","last_became_peered":"2024-09-12T17:40:28.204204+0000","last_unstale":"2024-09-12T18:57:32.597637+0000","last_undegraded":"2024-09-12T18:57:32.597637+0000","last_fullsized":"2024-09-12T18:57:32.597637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:13.281028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":252,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'238","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.462857+0000","last_change":"2024-09-12T17:40:20.128888+0000","last_active":"2024-09-12T18:57:22.462857+0000","last_peered":"2024-09-12T18:57:22.462857+0000","last_clean":"2024-09-12T18:57:22.462857+0000","last_became_active":"2024-09-12T17:40:20.128532+0000","last_became_peered":"2024-09-12T17:40:20.128532+0000","last_unstale":"2024-09-12T18:57:22.462857+0000","last_undegraded":"2024-09-12T18:57:22.462857+0000","last_fullsized":"2024-09-12T18:57:22.462857+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:10.062006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":846,"num_write":360,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'325","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:23.456540+0000","last_change":"2024-09-12T17:40:55.306539+0000","last_active":"2024-09-12T18:57:23.456540+0000","last_peered":"2024-09-12T18:57:23.456540+0000","last_clean":"2024-09-12T18:57:23.456540+0000","last_became_active":"2024-09-12T17:40:55.305689+0000","last_became_peered":"2024-09-12T17:40:55.305689+0000","last_unstale":"2024-09-12T18:57:23.456540+0000","last_undegraded":"2024-09-12T18:57:23.456540+0000","last_fullsized":"2024-09-12T18:57:23.456540+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:55.468206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17849249,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":566,"num_read_kb":44915,"num_write":1234,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.457130+0000","last_change":"2024-09-12T17:40:22.143900+0000","last_active":"2024-09-12T18:57:22.457130+0000","last_peered":"2024-09-12T18:57:22.457130+0000","last_clean":"2024-09-12T18:57:22.457130+0000","last_became_active":"2024-09-12T17:40:22.143466+0000","last_became_peered":"2024-09-12T17:40:22.143466+0000","last_unstale":"2024-09-12T18:57:22.457130+0000","last_undegraded":"2024-09-12T18:57:22.457130+0000","last_fullsized":"2024-09-12T18:57:22.457130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:12.032718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'61","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473152+0000","last_change":"2024-09-12T17:40:24.152265+0000","last_active":"2024-09-12T18:57:27.473152+0000","last_peered":"2024-09-12T18:57:27.473152+0000","last_clean":"2024-09-12T18:57:27.473152+0000","last_became_active":"2024-09-12T17:40:24.151530+0000","last_became_peered":"2024-09-12T17:40:24.151530+0000","last_unstale":"2024-09-12T18:57:27.473152+0000","last_undegraded":"2024-09-12T18:57:27.473152+0000","last_fullsized":"2024-09-12T18:57:27.473152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:13.980036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457196+0000","last_change":"2024-09-12T17:40:26.187903+0000","last_active":"2024-09-12T18:57:27.457196+0000","last_peered":"2024-09-12T18:57:27.457196+0000","last_clean":"2024-09-12T18:57:27.457196+0000","last_became_active":"2024-09-12T17:40:26.187122+0000","last_became_peered":"2024-09-12T17:40:26.187122+0000","last_unstale":"2024-09-12T18:57:27.457196+0000","last_undegraded":"2024-09-12T18:57:27.457196+0000","last_fullsized":"2024-09-12T18:57:27.457196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:36.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'248","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.372703+0000","last_change":"2024-09-12T17:40:28.194923+0000","last_active":"2024-09-12T18:58:04.372703+0000","last_peered":"2024-09-12T18:58:04.372703+0000","last_clean":"2024-09-12T18:58:04.372703+0000","last_became_active":"2024-09-12T17:40:28.194047+0000","last_became_peered":"2024-09-12T17:40:28.194047+0000","last_unstale":"2024-09-12T18:58:04.372703+0000","last_undegraded":"2024-09-12T18:58:04.372703+0000","last_fullsized":"2024-09-12T18:58:04.372703+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:44.148991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":352,"num_write":540,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'120","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.457021+0000","last_change":"2024-09-12T17:40:20.130891+0000","last_active":"2024-09-12T18:57:22.457021+0000","last_peered":"2024-09-12T18:57:22.457021+0000","last_clean":"2024-09-12T18:57:22.457021+0000","last_became_active":"2024-09-12T17:40:20.130567+0000","last_became_peered":"2024-09-12T17:40:20.130567+0000","last_unstale":"2024-09-12T18:57:22.457021+0000","last_undegraded":"2024-09-12T18:57:22.457021+0000","last_fullsized":"2024-09-12T18:57:22.457021+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:59.283457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":440,"num_write":198,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'320","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:18.554738+0000","last_change":"2024-09-12T17:40:18.781889+0000","last_active":"2024-09-12T18:56:18.554738+0000","last_peered":"2024-09-12T18:56:18.554738+0000","last_clean":"2024-09-12T18:56:18.554738+0000","last_became_active":"2024-09-12T17:40:18.781135+0000","last_became_peered":"2024-09-12T17:40:18.781135+0000","last_unstale":"2024-09-12T18:56:18.554738+0000","last_undegraded":"2024-09-12T18:56:18.554738+0000","last_fullsized":"2024-09-12T18:56:18.554738+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:39.897090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10870011,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":603,"num_read_kb":11926,"num_write":1125,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456026+0000","last_change":"2024-09-12T17:40:22.151655+0000","last_active":"2024-09-12T18:57:22.456026+0000","last_peered":"2024-09-12T18:57:22.456026+0000","last_clean":"2024-09-12T18:57:22.456026+0000","last_became_active":"2024-09-12T17:40:22.150912+0000","last_became_peered":"2024-09-12T17:40:22.150912+0000","last_unstale":"2024-09-12T18:57:22.456026+0000","last_undegraded":"2024-09-12T18:57:22.456026+0000","last_fullsized":"2024-09-12T18:57:22.456026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:49.335095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'337","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.682727+0000","last_change":"2024-09-12T17:40:24.177728+0000","last_active":"2024-09-12T18:59:27.682727+0000","last_peered":"2024-09-12T18:59:27.682727+0000","last_clean":"2024-09-12T18:59:27.682727+0000","last_became_active":"2024-09-12T17:40:24.176722+0000","last_became_peered":"2024-09-12T17:40:24.176722+0000","last_unstale":"2024-09-12T18:59:27.682727+0000","last_undegraded":"2024-09-12T18:59:27.682727+0000","last_fullsized":"2024-09-12T18:59:27.682727+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.865870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62937,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1095,"num_write":436,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443157+0000","last_change":"2024-09-12T17:40:26.168192+0000","last_active":"2024-09-12T18:57:27.443157+0000","last_peered":"2024-09-12T18:57:27.443157+0000","last_clean":"2024-09-12T18:57:27.443157+0000","last_became_active":"2024-09-12T17:40:26.167280+0000","last_became_peered":"2024-09-12T17:40:26.167280+0000","last_unstale":"2024-09-12T18:57:27.443157+0000","last_undegraded":"2024-09-12T18:57:27.443157+0000","last_fullsized":"2024-09-12T18:57:27.443157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:03.370653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'106","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.559076+0000","last_change":"2024-09-12T17:40:28.194951+0000","last_active":"2024-09-12T18:58:04.559076+0000","last_peered":"2024-09-12T18:58:04.559076+0000","last_clean":"2024-09-12T18:58:04.559076+0000","last_became_active":"2024-09-12T17:40:28.192629+0000","last_became_peered":"2024-09-12T17:40:28.192629+0000","last_unstale":"2024-09-12T18:58:04.559076+0000","last_undegraded":"2024-09-12T18:58:04.559076+0000","last_fullsized":"2024-09-12T18:58:04.559076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:40.252151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456946+0000","last_change":"2024-09-12T17:40:55.302689+0000","last_active":"2024-09-12T18:57:22.456946+0000","last_peered":"2024-09-12T18:57:22.456946+0000","last_clean":"2024-09-12T18:57:22.456946+0000","last_became_active":"2024-09-12T17:40:55.301950+0000","last_became_peered":"2024-09-12T17:40:55.301950+0000","last_unstale":"2024-09-12T18:57:22.456946+0000","last_undegraded":"2024-09-12T18:57:22.456946+0000","last_fullsized":"2024-09-12T18:57:22.456946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.652662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":400,"num_write":158,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'323","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:19.308683+0000","last_change":"2024-09-12T17:40:18.755957+0000","last_active":"2024-09-12T18:59:19.308683+0000","last_peered":"2024-09-12T18:59:19.308683+0000","last_clean":"2024-09-12T18:59:19.308683+0000","last_became_active":"2024-09-12T17:40:18.755694+0000","last_became_peered":"2024-09-12T17:40:18.755694+0000","last_unstale":"2024-09-12T18:59:19.308683+0000","last_undegraded":"2024-09-12T18:59:19.308683+0000","last_fullsized":"2024-09-12T18:59:19.308683+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:08.561309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14056521,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":484,"num_read_kb":35553,"num_write":1195,"num_write_kb":53517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.442028+0000","last_change":"2024-09-12T17:40:22.136120+0000","last_active":"2024-09-12T18:57:22.442028+0000","last_peered":"2024-09-12T18:57:22.442028+0000","last_clean":"2024-09-12T18:57:22.442028+0000","last_became_active":"2024-09-12T17:40:22.135547+0000","last_became_peered":"2024-09-12T17:40:22.135547+0000","last_unstale":"2024-09-12T18:57:22.442028+0000","last_undegraded":"2024-09-12T18:57:22.442028+0000","last_fullsized":"2024-09-12T18:57:22.442028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:28.203301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'304","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.672666+0000","last_change":"2024-09-12T17:40:24.163735+0000","last_active":"2024-09-12T18:59:27.672666+0000","last_peered":"2024-09-12T18:59:27.672666+0000","last_clean":"2024-09-12T18:59:27.672666+0000","last_became_active":"2024-09-12T17:40:24.162901+0000","last_became_peered":"2024-09-12T17:40:24.162901+0000","last_unstale":"2024-09-12T18:59:27.672666+0000","last_undegraded":"2024-09-12T18:59:27.672666+0000","last_fullsized":"2024-09-12T18:59:27.672666+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:08.268660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66249,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":495,"num_read_kb":1080,"num_write":410,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473259+0000","last_change":"2024-09-12T17:40:26.191520+0000","last_active":"2024-09-12T18:57:27.473259+0000","last_peered":"2024-09-12T18:57:27.473259+0000","last_clean":"2024-09-12T18:57:27.473259+0000","last_became_active":"2024-09-12T17:40:26.190755+0000","last_became_peered":"2024-09-12T17:40:26.190755+0000","last_unstale":"2024-09-12T18:57:27.473259+0000","last_undegraded":"2024-09-12T18:57:27.473259+0000","last_fullsized":"2024-09-12T18:57:27.473259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:00.734100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'428","reported_seq":1192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443251+0000","last_change":"2024-09-12T17:40:20.128385+0000","last_active":"2024-09-12T18:57:27.443251+0000","last_peered":"2024-09-12T18:57:27.443251+0000","last_clean":"2024-09-12T18:57:27.443251+0000","last_became_active":"2024-09-12T17:40:20.127413+0000","last_became_peered":"2024-09-12T17:40:20.127413+0000","last_unstale":"2024-09-12T18:57:27.443251+0000","last_undegraded":"2024-09-12T18:57:27.443251+0000","last_fullsized":"2024-09-12T18:57:27.443251+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:36.669281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2096,"num_read_kb":1807,"num_write":754,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'282","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:34.458382+0000","last_change":"2024-09-12T17:40:18.759774+0000","last_active":"2024-09-12T18:55:34.458382+0000","last_peered":"2024-09-12T18:55:34.458382+0000","last_clean":"2024-09-12T18:55:34.458382+0000","last_became_active":"2024-09-12T17:40:18.759467+0000","last_became_peered":"2024-09-12T17:40:18.759467+0000","last_unstale":"2024-09-12T18:55:34.458382+0000","last_undegraded":"2024-09-12T18:55:34.458382+0000","last_fullsized":"2024-09-12T18:55:34.458382+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:33.483800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8811196,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":453,"num_read_kb":67738,"num_write":1036,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.462225+0000","last_change":"2024-09-12T17:40:22.144503+0000","last_active":"2024-09-12T18:56:37.462225+0000","last_peered":"2024-09-12T18:56:37.462225+0000","last_clean":"2024-09-12T18:56:37.462225+0000","last_became_active":"2024-09-12T17:40:22.143764+0000","last_became_peered":"2024-09-12T17:40:22.143764+0000","last_unstale":"2024-09-12T18:56:37.462225+0000","last_undegraded":"2024-09-12T18:56:37.462225+0000","last_fullsized":"2024-09-12T18:56:37.462225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:07.658407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'529","reported_seq":1166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.671468+0000","last_change":"2024-09-12T17:40:24.179162+0000","last_active":"2024-09-12T18:59:27.671468+0000","last_peered":"2024-09-12T18:59:27.671468+0000","last_clean":"2024-09-12T18:59:27.671468+0000","last_became_active":"2024-09-12T17:40:24.178354+0000","last_became_peered":"2024-09-12T17:40:24.178354+0000","last_unstale":"2024-09-12T18:59:27.671468+0000","last_undegraded":"2024-09-12T18:59:27.671468+0000","last_fullsized":"2024-09-12T18:59:27.671468+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:39.728053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138484,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":927,"num_read_kb":2071,"num_write":814,"num_write_kb":738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.612487+0000","last_change":"2024-09-12T17:40:26.185364+0000","last_active":"2024-09-12T18:55:27.612487+0000","last_peered":"2024-09-12T18:55:27.612487+0000","last_clean":"2024-09-12T18:55:27.612487+0000","last_became_active":"2024-09-12T17:40:26.184572+0000","last_became_peered":"2024-09-12T17:40:26.184572+0000","last_unstale":"2024-09-12T18:55:27.612487+0000","last_undegraded":"2024-09-12T18:55:27.612487+0000","last_fullsized":"2024-09-12T18:55:27.612487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:35.867018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'243","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:05.971764+0000","last_change":"2024-09-12T17:40:28.201022+0000","last_active":"2024-09-12T18:58:05.971764+0000","last_peered":"2024-09-12T18:58:05.971764+0000","last_clean":"2024-09-12T18:58:05.971764+0000","last_became_active":"2024-09-12T17:40:28.200289+0000","last_became_peered":"2024-09-12T17:40:28.200289+0000","last_unstale":"2024-09-12T18:58:05.971764+0000","last_undegraded":"2024-09-12T18:58:05.971764+0000","last_fullsized":"2024-09-12T18:58:05.971764+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:57.750960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":402,"num_read_kb":380,"num_write":484,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'278","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.462201+0000","last_change":"2024-09-12T17:40:20.129095+0000","last_active":"2024-09-12T18:56:37.462201+0000","last_peered":"2024-09-12T18:56:37.462201+0000","last_clean":"2024-09-12T18:56:37.462201+0000","last_became_active":"2024-09-12T17:40:20.128840+0000","last_became_peered":"2024-09-12T17:40:20.128840+0000","last_unstale":"2024-09-12T18:56:37.462201+0000","last_undegraded":"2024-09-12T18:56:37.462201+0000","last_fullsized":"2024-09-12T18:56:37.462201+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:40.313847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1419,"num_read_kb":1187,"num_write":525,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'241","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.108435+0000","last_change":"2024-09-12T17:40:18.763123+0000","last_active":"2024-09-12T18:57:45.108435+0000","last_peered":"2024-09-12T18:57:45.108435+0000","last_clean":"2024-09-12T18:57:45.108435+0000","last_became_active":"2024-09-12T17:40:18.762421+0000","last_became_peered":"2024-09-12T17:40:18.762421+0000","last_unstale":"2024-09-12T18:57:45.108435+0000","last_undegraded":"2024-09-12T18:57:45.108435+0000","last_fullsized":"2024-09-12T18:57:45.108435+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:57.212684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4246739,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":369,"num_read_kb":9963,"num_write":906,"num_write_kb":16756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443274+0000","last_change":"2024-09-12T17:40:22.134660+0000","last_active":"2024-09-12T18:57:27.443274+0000","last_peered":"2024-09-12T18:57:27.443274+0000","last_clean":"2024-09-12T18:57:27.443274+0000","last_became_active":"2024-09-12T17:40:22.133919+0000","last_became_peered":"2024-09-12T17:40:22.133919+0000","last_unstale":"2024-09-12T18:57:27.443274+0000","last_undegraded":"2024-09-12T18:57:27.443274+0000","last_fullsized":"2024-09-12T18:57:27.443274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:06.193287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'308","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464883+0000","last_change":"2024-09-12T17:40:24.168575+0000","last_active":"2024-09-12T18:57:57.464883+0000","last_peered":"2024-09-12T18:57:57.464883+0000","last_clean":"2024-09-12T18:57:57.464883+0000","last_became_active":"2024-09-12T17:40:24.167870+0000","last_became_peered":"2024-09-12T17:40:24.167870+0000","last_unstale":"2024-09-12T18:57:57.464883+0000","last_undegraded":"2024-09-12T18:57:57.464883+0000","last_fullsized":"2024-09-12T18:57:57.464883+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:06.921434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52491,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":980,"num_write":420,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.438227+0000","last_change":"2024-09-12T17:40:26.199740+0000","last_active":"2024-09-12T18:55:27.438227+0000","last_peered":"2024-09-12T18:55:27.438227+0000","last_clean":"2024-09-12T18:55:27.438227+0000","last_became_active":"2024-09-12T17:40:26.199065+0000","last_became_peered":"2024-09-12T17:40:26.199065+0000","last_unstale":"2024-09-12T18:55:27.438227+0000","last_undegraded":"2024-09-12T18:55:27.438227+0000","last_fullsized":"2024-09-12T18:55:27.438227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:29.279788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'184","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:00.492872+0000","last_change":"2024-09-12T17:40:28.193740+0000","last_active":"2024-09-12T18:58:00.492872+0000","last_peered":"2024-09-12T18:58:00.492872+0000","last_clean":"2024-09-12T18:58:00.492872+0000","last_became_active":"2024-09-12T17:40:28.192588+0000","last_became_peered":"2024-09-12T17:40:28.192588+0000","last_unstale":"2024-09-12T18:58:00.492872+0000","last_undegraded":"2024-09-12T18:58:00.492872+0000","last_fullsized":"2024-09-12T18:58:00.492872+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:35.257214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":737,"num_read_kb":706,"num_write":515,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'254","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:55.231898+0000","last_change":"2024-09-12T17:40:20.133443+0000","last_active":"2024-09-12T18:56:55.231898+0000","last_peered":"2024-09-12T18:56:55.231898+0000","last_clean":"2024-09-12T18:56:55.231898+0000","last_became_active":"2024-09-12T17:40:20.133067+0000","last_became_peered":"2024-09-12T17:40:20.133067+0000","last_unstale":"2024-09-12T18:56:55.231898+0000","last_undegraded":"2024-09-12T18:56:55.231898+0000","last_fullsized":"2024-09-12T18:56:55.231898+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:22.211007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1200,"num_read_kb":1015,"num_write":444,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'268","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.792878+0000","last_change":"2024-09-12T17:40:18.773839+0000","last_active":"2024-09-12T18:55:22.792878+0000","last_peered":"2024-09-12T18:55:22.792878+0000","last_clean":"2024-09-12T18:55:22.792878+0000","last_became_active":"2024-09-12T17:40:18.773029+0000","last_became_peered":"2024-09-12T17:40:18.773029+0000","last_unstale":"2024-09-12T18:55:22.792878+0000","last_undegraded":"2024-09-12T18:55:22.792878+0000","last_fullsized":"2024-09-12T18:55:22.792878+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:13.992637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10005600,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":353,"num_read_kb":38404,"num_write":1013,"num_write_kb":31393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793065+0000","last_change":"2024-09-12T17:40:22.146616+0000","last_active":"2024-09-12T18:55:22.793065+0000","last_peered":"2024-09-12T18:55:22.793065+0000","last_clean":"2024-09-12T18:55:22.793065+0000","last_became_active":"2024-09-12T17:40:22.145871+0000","last_became_peered":"2024-09-12T17:40:22.145871+0000","last_unstale":"2024-09-12T18:55:22.793065+0000","last_undegraded":"2024-09-12T18:55:22.793065+0000","last_fullsized":"2024-09-12T18:55:22.793065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:17.363777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'303","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.725748+0000","last_change":"2024-09-12T17:40:24.330122+0000","last_active":"2024-09-12T18:59:27.725748+0000","last_peered":"2024-09-12T18:59:27.725748+0000","last_clean":"2024-09-12T18:59:27.725748+0000","last_became_active":"2024-09-12T17:40:24.329413+0000","last_became_peered":"2024-09-12T17:40:24.329413+0000","last_unstale":"2024-09-12T18:59:27.725748+0000","last_undegraded":"2024-09-12T18:59:27.725748+0000","last_fullsized":"2024-09-12T18:59:27.725748+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:11.778689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60142,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":1065,"num_write":414,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.455205+0000","last_change":"2024-09-12T17:40:26.199588+0000","last_active":"2024-09-12T18:56:47.455205+0000","last_peered":"2024-09-12T18:56:47.455205+0000","last_clean":"2024-09-12T18:56:47.455205+0000","last_became_active":"2024-09-12T17:40:26.198930+0000","last_became_peered":"2024-09-12T17:40:26.198930+0000","last_unstale":"2024-09-12T18:56:47.455205+0000","last_undegraded":"2024-09-12T18:56:47.455205+0000","last_fullsized":"2024-09-12T18:56:47.455205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:48.763531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'117","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.763203+0000","last_change":"2024-09-12T17:40:28.194240+0000","last_active":"2024-09-12T18:59:27.763203+0000","last_peered":"2024-09-12T18:59:27.763203+0000","last_clean":"2024-09-12T18:59:27.763203+0000","last_became_active":"2024-09-12T17:40:28.192689+0000","last_became_peered":"2024-09-12T17:40:28.192689+0000","last_unstale":"2024-09-12T18:59:27.763203+0000","last_undegraded":"2024-09-12T18:59:27.763203+0000","last_fullsized":"2024-09-12T18:59:27.763203+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:53.085665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":258,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'197","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:19.424791+0000","last_change":"2024-09-12T17:40:20.133429+0000","last_active":"2024-09-12T18:55:19.424791+0000","last_peered":"2024-09-12T18:55:19.424791+0000","last_clean":"2024-09-12T18:55:19.424791+0000","last_became_active":"2024-09-12T17:40:20.132998+0000","last_became_peered":"2024-09-12T17:40:20.132998+0000","last_unstale":"2024-09-12T18:55:19.424791+0000","last_undegraded":"2024-09-12T18:55:19.424791+0000","last_fullsized":"2024-09-12T18:55:19.424791+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:53.514892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":791,"num_read_kb":641,"num_write":284,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'361","reported_seq":1104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.445890+0000","last_change":"2024-09-12T17:40:18.775765+0000","last_active":"2024-09-12T18:55:22.445890+0000","last_peered":"2024-09-12T18:55:22.445890+0000","last_clean":"2024-09-12T18:55:22.445890+0000","last_became_active":"2024-09-12T17:40:18.774892+0000","last_became_peered":"2024-09-12T17:40:18.774892+0000","last_unstale":"2024-09-12T18:55:22.445890+0000","last_undegraded":"2024-09-12T18:55:22.445890+0000","last_fullsized":"2024-09-12T18:55:22.445890+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:12.027391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15589393,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":658,"num_read_kb":87832,"num_write":1341,"num_write_kb":30285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.437110+0000","last_change":"2024-09-12T17:40:22.142115+0000","last_active":"2024-09-12T18:55:22.437110+0000","last_peered":"2024-09-12T18:55:22.437110+0000","last_clean":"2024-09-12T18:55:22.437110+0000","last_became_active":"2024-09-12T17:40:22.141670+0000","last_became_peered":"2024-09-12T17:40:22.141670+0000","last_unstale":"2024-09-12T18:55:22.437110+0000","last_undegraded":"2024-09-12T18:55:22.437110+0000","last_fullsized":"2024-09-12T18:55:22.437110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:01.417527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'131","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.809263+0000","last_change":"2024-09-12T17:40:24.330200+0000","last_active":"2024-09-12T18:56:37.809263+0000","last_peered":"2024-09-12T18:56:37.809263+0000","last_clean":"2024-09-12T18:56:37.809263+0000","last_became_active":"2024-09-12T17:40:24.329446+0000","last_became_peered":"2024-09-12T17:40:24.329446+0000","last_unstale":"2024-09-12T18:56:37.809263+0000","last_undegraded":"2024-09-12T18:56:37.809263+0000","last_fullsized":"2024-09-12T18:56:37.809263+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:39.604725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'750","reported_seq":4493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:31.363117+0000","last_change":"2024-09-12T17:40:26.193089+0000","last_active":"2024-09-12T18:59:31.363117+0000","last_peered":"2024-09-12T18:59:31.363117+0000","last_clean":"2024-09-12T18:59:31.363117+0000","last_became_active":"2024-09-12T17:40:26.192341+0000","last_became_peered":"2024-09-12T17:40:26.192341+0000","last_unstale":"2024-09-12T18:59:31.363117+0000","last_undegraded":"2024-09-12T18:59:31.363117+0000","last_fullsized":"2024-09-12T18:59:31.363117+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:04.649327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'116","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457136+0000","last_change":"2024-09-12T17:40:28.187817+0000","last_active":"2024-09-12T18:57:27.457136+0000","last_peered":"2024-09-12T18:57:27.457136+0000","last_clean":"2024-09-12T18:57:27.457136+0000","last_became_active":"2024-09-12T17:40:28.187089+0000","last_became_peered":"2024-09-12T17:40:28.187089+0000","last_unstale":"2024-09-12T18:57:27.457136+0000","last_undegraded":"2024-09-12T18:57:27.457136+0000","last_fullsized":"2024-09-12T18:57:27.457136+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:39.669386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'387","reported_seq":1131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.792997+0000","last_change":"2024-09-12T17:40:20.143118+0000","last_active":"2024-09-12T18:55:22.792997+0000","last_peered":"2024-09-12T18:55:22.792997+0000","last_clean":"2024-09-12T18:55:22.792997+0000","last_became_active":"2024-09-12T17:40:20.142478+0000","last_became_peered":"2024-09-12T17:40:20.142478+0000","last_unstale":"2024-09-12T18:55:22.792997+0000","last_undegraded":"2024-09-12T18:55:22.792997+0000","last_fullsized":"2024-09-12T18:55:22.792997+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:38.246221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1845,"num_read_kb":1583,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'277","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:59.433256+0000","last_change":"2024-09-12T17:40:55.331083+0000","last_active":"2024-09-12T18:55:59.433256+0000","last_peered":"2024-09-12T18:55:59.433256+0000","last_clean":"2024-09-12T18:55:59.433256+0000","last_became_active":"2024-09-12T17:40:55.330696+0000","last_became_peered":"2024-09-12T17:40:55.330696+0000","last_unstale":"2024-09-12T18:55:59.433256+0000","last_undegraded":"2024-09-12T18:55:59.433256+0000","last_fullsized":"2024-09-12T18:55:59.433256+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:46.573367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5332400,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":853,"num_read_kb":9625,"num_write":1128,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427131+0000","last_change":"2024-09-12T17:40:22.152165+0000","last_active":"2024-09-12T18:55:22.427131+0000","last_peered":"2024-09-12T18:55:22.427131+0000","last_clean":"2024-09-12T18:55:22.427131+0000","last_became_active":"2024-09-12T17:40:22.151083+0000","last_became_peered":"2024-09-12T17:40:22.151083+0000","last_unstale":"2024-09-12T18:55:22.427131+0000","last_undegraded":"2024-09-12T18:55:22.427131+0000","last_fullsized":"2024-09-12T18:55:22.427131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:28.338986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'330","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.658405+0000","last_change":"2024-09-12T17:40:24.174149+0000","last_active":"2024-09-12T18:58:02.658405+0000","last_peered":"2024-09-12T18:58:02.658405+0000","last_clean":"2024-09-12T18:58:02.658405+0000","last_became_active":"2024-09-12T17:40:24.173360+0000","last_became_peered":"2024-09-12T17:40:24.173360+0000","last_unstale":"2024-09-12T18:58:02.658405+0000","last_undegraded":"2024-09-12T18:58:02.658405+0000","last_fullsized":"2024-09-12T18:58:02.658405+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:01.318365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70298,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":548,"num_read_kb":1110,"num_write":440,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.445804+0000","last_change":"2024-09-12T17:40:26.164532+0000","last_active":"2024-09-12T18:55:22.445804+0000","last_peered":"2024-09-12T18:55:22.445804+0000","last_clean":"2024-09-12T18:55:22.445804+0000","last_became_active":"2024-09-12T17:40:26.163773+0000","last_became_peered":"2024-09-12T17:40:26.163773+0000","last_unstale":"2024-09-12T18:55:22.445804+0000","last_undegraded":"2024-09-12T18:55:22.445804+0000","last_fullsized":"2024-09-12T18:55:22.445804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:29.445382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'102","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.270680+0000","last_change":"2024-09-12T17:40:28.199692+0000","last_active":"2024-09-12T18:58:02.270680+0000","last_peered":"2024-09-12T18:58:02.270680+0000","last_clean":"2024-09-12T18:58:02.270680+0000","last_became_active":"2024-09-12T17:40:28.198792+0000","last_became_peered":"2024-09-12T17:40:28.198792+0000","last_unstale":"2024-09-12T18:58:02.270680+0000","last_undegraded":"2024-09-12T18:58:02.270680+0000","last_fullsized":"2024-09-12T18:58:02.270680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:10.816115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":239,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'185","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.792933+0000","last_change":"2024-09-12T17:40:20.147084+0000","last_active":"2024-09-12T18:55:22.792933+0000","last_peered":"2024-09-12T18:55:22.792933+0000","last_clean":"2024-09-12T18:55:22.792933+0000","last_became_active":"2024-09-12T17:40:20.136564+0000","last_became_peered":"2024-09-12T17:40:20.136564+0000","last_unstale":"2024-09-12T18:55:22.792933+0000","last_undegraded":"2024-09-12T18:55:22.792933+0000","last_fullsized":"2024-09-12T18:55:22.792933+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:10.062006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":640,"num_write":266,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'353","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.083750+0000","last_change":"2024-09-12T17:40:18.782734+0000","last_active":"2024-09-12T18:57:45.083750+0000","last_peered":"2024-09-12T18:57:45.083750+0000","last_clean":"2024-09-12T18:57:45.083750+0000","last_became_active":"2024-09-12T17:40:18.779946+0000","last_became_peered":"2024-09-12T17:40:18.779946+0000","last_unstale":"2024-09-12T18:57:45.083750+0000","last_undegraded":"2024-09-12T18:57:45.083750+0000","last_fullsized":"2024-09-12T18:57:45.083750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:48.387265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12103370,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":646,"num_read_kb":21189,"num_write":1128,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.611277+0000","last_change":"2024-09-12T17:40:22.138047+0000","last_active":"2024-09-12T18:55:22.611277+0000","last_peered":"2024-09-12T18:55:22.611277+0000","last_clean":"2024-09-12T18:55:22.611277+0000","last_became_active":"2024-09-12T17:40:22.137291+0000","last_became_peered":"2024-09-12T17:40:22.137291+0000","last_unstale":"2024-09-12T18:55:22.611277+0000","last_undegraded":"2024-09-12T18:55:22.611277+0000","last_fullsized":"2024-09-12T18:55:22.611277+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:51.771726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'259","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.477834+0000","last_change":"2024-09-12T17:40:24.175430+0000","last_active":"2024-09-12T18:57:47.477834+0000","last_peered":"2024-09-12T18:57:47.477834+0000","last_clean":"2024-09-12T18:57:47.477834+0000","last_became_active":"2024-09-12T17:40:24.174681+0000","last_became_peered":"2024-09-12T17:40:24.174681+0000","last_unstale":"2024-09-12T18:57:47.477834+0000","last_undegraded":"2024-09-12T18:57:47.477834+0000","last_fullsized":"2024-09-12T18:57:47.477834+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:33.406641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":890,"num_write":338,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421121+0000","last_change":"2024-09-12T17:40:26.188512+0000","last_active":"2024-09-12T18:55:42.421121+0000","last_peered":"2024-09-12T18:55:42.421121+0000","last_clean":"2024-09-12T18:55:42.421121+0000","last_became_active":"2024-09-12T17:40:26.187438+0000","last_became_peered":"2024-09-12T17:40:26.187438+0000","last_unstale":"2024-09-12T18:55:42.421121+0000","last_undegraded":"2024-09-12T18:55:42.421121+0000","last_fullsized":"2024-09-12T18:55:42.421121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:20.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'124","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427909+0000","last_change":"2024-09-12T17:40:28.202550+0000","last_active":"2024-09-12T18:55:22.427909+0000","last_peered":"2024-09-12T18:55:22.427909+0000","last_clean":"2024-09-12T18:55:22.427909+0000","last_became_active":"2024-09-12T17:40:28.201534+0000","last_became_peered":"2024-09-12T17:40:28.201534+0000","last_unstale":"2024-09-12T18:55:22.427909+0000","last_undegraded":"2024-09-12T18:55:22.427909+0000","last_fullsized":"2024-09-12T18:55:22.427909+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:43.430181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":291,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'52","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:37.431358+0000","last_change":"2024-09-12T17:40:20.117919+0000","last_active":"2024-09-12T18:55:37.431358+0000","last_peered":"2024-09-12T18:55:37.431358+0000","last_clean":"2024-09-12T18:55:37.431358+0000","last_became_active":"2024-09-12T17:40:20.117604+0000","last_became_peered":"2024-09-12T17:40:20.117604+0000","last_unstale":"2024-09-12T18:55:37.431358+0000","last_undegraded":"2024-09-12T18:55:37.431358+0000","last_fullsized":"2024-09-12T18:55:37.431358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:01.530409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":67,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'272","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446902+0000","last_change":"2024-09-12T17:40:18.767654+0000","last_active":"2024-09-12T18:56:42.446902+0000","last_peered":"2024-09-12T18:56:42.446902+0000","last_clean":"2024-09-12T18:56:42.446902+0000","last_became_active":"2024-09-12T17:40:18.767103+0000","last_became_peered":"2024-09-12T17:40:18.767103+0000","last_unstale":"2024-09-12T18:56:42.446902+0000","last_undegraded":"2024-09-12T18:56:42.446902+0000","last_fullsized":"2024-09-12T18:56:42.446902+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:13.247336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15730389,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":384,"num_read_kb":34280,"num_write":1016,"num_write_kb":41945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.791546+0000","last_change":"2024-09-12T17:40:22.135061+0000","last_active":"2024-09-12T18:55:17.791546+0000","last_peered":"2024-09-12T18:55:17.791546+0000","last_clean":"2024-09-12T18:55:17.791546+0000","last_became_active":"2024-09-12T17:40:22.134242+0000","last_became_peered":"2024-09-12T17:40:22.134242+0000","last_unstale":"2024-09-12T18:55:17.791546+0000","last_undegraded":"2024-09-12T18:55:17.791546+0000","last_fullsized":"2024-09-12T18:55:17.791546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:19.741434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'234","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464348+0000","last_change":"2024-09-12T17:40:24.183504+0000","last_active":"2024-09-12T18:57:57.464348+0000","last_peered":"2024-09-12T18:57:57.464348+0000","last_clean":"2024-09-12T18:57:57.464348+0000","last_became_active":"2024-09-12T17:40:24.181581+0000","last_became_peered":"2024-09-12T17:40:24.181581+0000","last_unstale":"2024-09-12T18:57:57.464348+0000","last_undegraded":"2024-09-12T18:57:57.464348+0000","last_fullsized":"2024-09-12T18:57:57.464348+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:34.205562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54177,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":858,"num_write":310,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.794291+0000","last_change":"2024-09-12T17:40:26.196580+0000","last_active":"2024-09-12T18:55:27.794291+0000","last_peered":"2024-09-12T18:55:27.794291+0000","last_clean":"2024-09-12T18:55:27.794291+0000","last_became_active":"2024-09-12T17:40:26.195603+0000","last_became_peered":"2024-09-12T17:40:26.195603+0000","last_unstale":"2024-09-12T18:55:27.794291+0000","last_undegraded":"2024-09-12T18:55:27.794291+0000","last_fullsized":"2024-09-12T18:55:27.794291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:00.612716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'168","reported_seq":1281,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:00.089777+0000","last_change":"2024-09-12T17:40:28.200915+0000","last_active":"2024-09-12T18:58:00.089777+0000","last_peered":"2024-09-12T18:58:00.089777+0000","last_clean":"2024-09-12T18:58:00.089777+0000","last_became_active":"2024-09-12T17:40:28.200126+0000","last_became_peered":"2024-09-12T17:40:28.200126+0000","last_unstale":"2024-09-12T18:58:00.089777+0000","last_undegraded":"2024-09-12T18:58:00.089777+0000","last_fullsized":"2024-09-12T18:58:00.089777+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:27.740825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":872,"num_read_kb":859,"num_write":427,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'166","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:30.310895+0000","last_change":"2024-09-12T17:40:20.135214+0000","last_active":"2024-09-12T18:55:30.310895+0000","last_peered":"2024-09-12T18:55:30.310895+0000","last_clean":"2024-09-12T18:55:30.310895+0000","last_became_active":"2024-09-12T17:40:20.131459+0000","last_became_peered":"2024-09-12T17:40:20.131459+0000","last_unstale":"2024-09-12T18:55:30.310895+0000","last_undegraded":"2024-09-12T18:55:30.310895+0000","last_fullsized":"2024-09-12T18:55:30.310895+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:02.260304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":677,"num_write":293,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'274","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473486+0000","last_change":"2024-09-12T17:40:18.773986+0000","last_active":"2024-09-12T18:57:27.473486+0000","last_peered":"2024-09-12T18:57:27.473486+0000","last_clean":"2024-09-12T18:57:27.473486+0000","last_became_active":"2024-09-12T17:40:18.773667+0000","last_became_peered":"2024-09-12T17:40:18.773667+0000","last_unstale":"2024-09-12T18:57:27.473486+0000","last_undegraded":"2024-09-12T18:57:27.473486+0000","last_fullsized":"2024-09-12T18:57:27.473486+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:09.724574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1313045,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":494,"num_read_kb":8712,"num_write":1019,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"35'4","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.368401+0000","last_change":"2024-09-12T17:40:22.141628+0000","last_active":"2024-09-12T18:59:27.368401+0000","last_peered":"2024-09-12T18:59:27.368401+0000","last_clean":"2024-09-12T18:59:27.368401+0000","last_became_active":"2024-09-12T17:40:22.141182+0000","last_became_peered":"2024-09-12T17:40:22.141182+0000","last_unstale":"2024-09-12T18:59:27.368401+0000","last_undegraded":"2024-09-12T18:59:27.368401+0000","last_fullsized":"2024-09-12T18:59:27.368401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:38.121269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'301","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.595019+0000","last_change":"2024-09-12T17:40:24.167135+0000","last_active":"2024-09-12T18:59:26.595019+0000","last_peered":"2024-09-12T18:59:26.595019+0000","last_clean":"2024-09-12T18:59:26.595019+0000","last_became_active":"2024-09-12T17:40:24.166330+0000","last_became_peered":"2024-09-12T17:40:24.166330+0000","last_unstale":"2024-09-12T18:59:26.595019+0000","last_undegraded":"2024-09-12T18:59:26.595019+0000","last_fullsized":"2024-09-12T18:59:26.595019+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.549312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58768,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":495,"num_read_kb":1011,"num_write":394,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.447210+0000","last_change":"2024-09-12T17:40:26.189177+0000","last_active":"2024-09-12T18:55:27.447210+0000","last_peered":"2024-09-12T18:55:27.447210+0000","last_clean":"2024-09-12T18:55:27.447210+0000","last_became_active":"2024-09-12T17:40:26.188351+0000","last_became_peered":"2024-09-12T17:40:26.188351+0000","last_unstale":"2024-09-12T18:55:27.447210+0000","last_undegraded":"2024-09-12T18:55:27.447210+0000","last_fullsized":"2024-09-12T18:55:27.447210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:14.730369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'136","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.548505+0000","last_change":"2024-09-12T17:40:28.180850+0000","last_active":"2024-09-12T18:59:26.548505+0000","last_peered":"2024-09-12T18:59:26.548505+0000","last_clean":"2024-09-12T18:59:26.548505+0000","last_became_active":"2024-09-12T17:40:28.180148+0000","last_became_peered":"2024-09-12T17:40:28.180148+0000","last_unstale":"2024-09-12T18:59:26.548505+0000","last_undegraded":"2024-09-12T18:59:26.548505+0000","last_fullsized":"2024-09-12T18:59:26.548505+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:56.213405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":171,"num_read_kb":158,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'174","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447667+0000","last_change":"2024-09-12T17:40:20.127371+0000","last_active":"2024-09-12T18:56:12.447667+0000","last_peered":"2024-09-12T18:56:12.447667+0000","last_clean":"2024-09-12T18:56:12.447667+0000","last_became_active":"2024-09-12T17:40:20.127006+0000","last_became_peered":"2024-09-12T17:40:20.127006+0000","last_unstale":"2024-09-12T18:56:12.447667+0000","last_undegraded":"2024-09-12T18:56:12.447667+0000","last_fullsized":"2024-09-12T18:56:12.447667+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:28.267156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":779,"num_read_kb":649,"num_write":260,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'262","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443019+0000","last_change":"2024-09-12T17:40:18.759600+0000","last_active":"2024-09-12T18:57:27.443019+0000","last_peered":"2024-09-12T18:57:27.443019+0000","last_clean":"2024-09-12T18:57:27.443019+0000","last_became_active":"2024-09-12T17:40:18.757444+0000","last_became_peered":"2024-09-12T17:40:18.757444+0000","last_unstale":"2024-09-12T18:57:27.443019+0000","last_undegraded":"2024-09-12T18:57:27.443019+0000","last_fullsized":"2024-09-12T18:57:27.443019+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:50.933887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20999376,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":435,"num_read_kb":91614,"num_write":1023,"num_write_kb":46187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'4205","reported_seq":4819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447609+0000","last_change":"2024-09-12T17:40:20.125927+0000","last_active":"2024-09-12T18:56:12.447609+0000","last_peered":"2024-09-12T18:56:12.447609+0000","last_clean":"2024-09-12T18:56:12.447609+0000","last_became_active":"2024-09-12T17:40:20.125586+0000","last_became_peered":"2024-09-12T17:40:20.125586+0000","last_unstale":"2024-09-12T18:56:12.447609+0000","last_undegraded":"2024-09-12T18:56:12.447609+0000","last_fullsized":"2024-09-12T18:56:12.447609+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":3000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:28.284212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16904,"num_read_kb":14161,"num_write":6332,"num_write_kb":3161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'261","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:24.449879+0000","last_change":"2024-09-12T17:40:18.754599+0000","last_active":"2024-09-12T18:57:24.449879+0000","last_peered":"2024-09-12T18:57:24.449879+0000","last_clean":"2024-09-12T18:57:24.449879+0000","last_became_active":"2024-09-12T17:40:18.754335+0000","last_became_peered":"2024-09-12T17:40:18.754335+0000","last_unstale":"2024-09-12T18:57:24.449879+0000","last_undegraded":"2024-09-12T18:57:24.449879+0000","last_fullsized":"2024-09-12T18:57:24.449879+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:31.973695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293678,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":373,"num_read_kb":13727,"num_write":944,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'413","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.622495+0000","last_change":"2024-09-12T17:40:20.137604+0000","last_active":"2024-09-12T18:56:12.622495+0000","last_peered":"2024-09-12T18:56:12.622495+0000","last_clean":"2024-09-12T18:56:12.622495+0000","last_became_active":"2024-09-12T17:40:20.136831+0000","last_became_peered":"2024-09-12T17:40:20.136831+0000","last_unstale":"2024-09-12T18:56:12.622495+0000","last_undegraded":"2024-09-12T18:56:12.622495+0000","last_fullsized":"2024-09-12T18:56:12.622495+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:14.463672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1812,"num_read_kb":1536,"num_write":694,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'262","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639914+0000","last_change":"2024-09-12T17:40:18.754536+0000","last_active":"2024-09-12T18:57:27.639914+0000","last_peered":"2024-09-12T18:57:27.639914+0000","last_clean":"2024-09-12T18:57:27.639914+0000","last_became_active":"2024-09-12T17:40:18.753576+0000","last_became_peered":"2024-09-12T17:40:18.753576+0000","last_unstale":"2024-09-12T18:57:27.639914+0000","last_undegraded":"2024-09-12T18:57:27.639914+0000","last_fullsized":"2024-09-12T18:57:27.639914+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:25.780872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9213402,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":377,"num_read_kb":36529,"num_write":945,"num_write_kb":32314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'363","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:18.053251+0000","last_change":"2024-09-12T17:40:20.133110+0000","last_active":"2024-09-12T18:57:18.053251+0000","last_peered":"2024-09-12T18:57:18.053251+0000","last_clean":"2024-09-12T18:57:18.053251+0000","last_became_active":"2024-09-12T17:40:20.132826+0000","last_became_peered":"2024-09-12T17:40:20.132826+0000","last_unstale":"2024-09-12T18:57:18.053251+0000","last_undegraded":"2024-09-12T18:57:18.053251+0000","last_fullsized":"2024-09-12T18:57:18.053251+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:07.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1596,"num_read_kb":1285,"num_write":598,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'283","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.476688+0000","last_change":"2024-09-12T17:40:18.755673+0000","last_active":"2024-09-12T18:57:42.476688+0000","last_peered":"2024-09-12T18:57:42.476688+0000","last_clean":"2024-09-12T18:57:42.476688+0000","last_became_active":"2024-09-12T17:40:18.754933+0000","last_became_peered":"2024-09-12T17:40:18.754933+0000","last_unstale":"2024-09-12T18:57:42.476688+0000","last_undegraded":"2024-09-12T18:57:42.476688+0000","last_fullsized":"2024-09-12T18:57:42.476688+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:43.716617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6326374,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":393,"num_read_kb":46825,"num_write":979,"num_write_kb":45673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'114","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.066485+0000","last_change":"2024-09-12T17:40:20.130446+0000","last_active":"2024-09-12T18:58:06.066485+0000","last_peered":"2024-09-12T18:58:06.066485+0000","last_clean":"2024-09-12T18:58:06.066485+0000","last_became_active":"2024-09-12T17:40:20.129769+0000","last_became_peered":"2024-09-12T17:40:20.129769+0000","last_unstale":"2024-09-12T18:58:06.066485+0000","last_undegraded":"2024-09-12T18:58:06.066485+0000","last_fullsized":"2024-09-12T18:58:06.066485+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:07.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":414,"num_write":175,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'279","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:22.471039+0000","last_change":"2024-09-12T17:40:18.773850+0000","last_active":"2024-09-12T18:58:22.471039+0000","last_peered":"2024-09-12T18:58:22.471039+0000","last_clean":"2024-09-12T18:58:22.471039+0000","last_became_active":"2024-09-12T17:40:18.773052+0000","last_became_peered":"2024-09-12T17:40:18.773052+0000","last_unstale":"2024-09-12T18:58:22.471039+0000","last_undegraded":"2024-09-12T18:58:22.471039+0000","last_fullsized":"2024-09-12T18:58:22.471039+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:03.999190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10012785,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":551,"num_read_kb":23542,"num_write":991,"num_write_kb":26208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'141","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820110+0000","last_change":"2024-09-12T17:40:20.149013+0000","last_active":"2024-09-12T18:57:27.820110+0000","last_peered":"2024-09-12T18:57:27.820110+0000","last_clean":"2024-09-12T18:57:27.820110+0000","last_became_active":"2024-09-12T17:40:20.146835+0000","last_became_peered":"2024-09-12T17:40:20.146835+0000","last_unstale":"2024-09-12T18:57:27.820110+0000","last_undegraded":"2024-09-12T18:57:27.820110+0000","last_fullsized":"2024-09-12T18:57:27.820110+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:22.211007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":516,"num_write":222,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'373","reported_seq":1147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447567+0000","last_change":"2024-09-12T17:40:18.765218+0000","last_active":"2024-09-12T18:56:12.447567+0000","last_peered":"2024-09-12T18:56:12.447567+0000","last_clean":"2024-09-12T18:56:12.447567+0000","last_became_active":"2024-09-12T17:40:18.764545+0000","last_became_peered":"2024-09-12T17:40:18.764545+0000","last_unstale":"2024-09-12T18:56:12.447567+0000","last_undegraded":"2024-09-12T18:56:12.447567+0000","last_fullsized":"2024-09-12T18:56:12.447567+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:46.840426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6336635,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":841,"num_read_kb":25412,"num_write":1299,"num_write_kb":29284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'206","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457994+0000","last_change":"2024-09-12T17:40:20.133394+0000","last_active":"2024-09-12T18:57:27.457994+0000","last_peered":"2024-09-12T18:57:27.457994+0000","last_clean":"2024-09-12T18:57:27.457994+0000","last_became_active":"2024-09-12T17:40:20.133055+0000","last_became_peered":"2024-09-12T17:40:20.133055+0000","last_unstale":"2024-09-12T18:57:27.457994+0000","last_undegraded":"2024-09-12T18:57:27.457994+0000","last_fullsized":"2024-09-12T18:57:27.457994+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:30.582322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":974,"num_read_kb":794,"num_write":355,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'267","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:23.476089+0000","last_change":"2024-09-12T17:40:18.765505+0000","last_active":"2024-09-12T18:57:23.476089+0000","last_peered":"2024-09-12T18:57:23.476089+0000","last_clean":"2024-09-12T18:57:23.476089+0000","last_became_active":"2024-09-12T17:40:18.764658+0000","last_became_peered":"2024-09-12T17:40:18.764658+0000","last_unstale":"2024-09-12T18:57:23.476089+0000","last_undegraded":"2024-09-12T18:57:23.476089+0000","last_fullsized":"2024-09-12T18:57:23.476089+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:18.339542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10154406,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":421,"num_read_kb":14116,"num_write":1003,"num_write_kb":26720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'195","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443066+0000","last_change":"2024-09-12T17:40:20.125114+0000","last_active":"2024-09-12T18:57:27.443066+0000","last_peered":"2024-09-12T18:57:27.443066+0000","last_clean":"2024-09-12T18:57:27.443066+0000","last_became_active":"2024-09-12T17:40:20.124247+0000","last_became_peered":"2024-09-12T17:40:20.124247+0000","last_unstale":"2024-09-12T18:57:27.443066+0000","last_undegraded":"2024-09-12T18:57:27.443066+0000","last_fullsized":"2024-09-12T18:57:27.443066+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:39.697115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":903,"num_read_kb":737,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'307","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:16.668519+0000","last_change":"2024-09-12T17:40:18.774283+0000","last_active":"2024-09-12T18:56:16.668519+0000","last_peered":"2024-09-12T18:56:16.668519+0000","last_clean":"2024-09-12T18:56:16.668519+0000","last_became_active":"2024-09-12T17:40:18.772776+0000","last_became_peered":"2024-09-12T17:40:18.772776+0000","last_unstale":"2024-09-12T18:56:16.668519+0000","last_undegraded":"2024-09-12T18:56:16.668519+0000","last_fullsized":"2024-09-12T18:56:16.668519+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:23.569697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5280730,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":563,"num_read_kb":25353,"num_write":1083,"num_write_kb":19697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'233","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.472184+0000","last_change":"2024-09-12T17:40:20.116396+0000","last_active":"2024-09-12T18:57:22.472184+0000","last_peered":"2024-09-12T18:57:22.472184+0000","last_clean":"2024-09-12T18:57:22.472184+0000","last_became_active":"2024-09-12T17:40:20.116064+0000","last_became_peered":"2024-09-12T17:40:20.116064+0000","last_unstale":"2024-09-12T18:57:22.472184+0000","last_undegraded":"2024-09-12T18:57:22.472184+0000","last_fullsized":"2024-09-12T18:57:22.472184+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:07.387378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1004,"num_read_kb":824,"num_write":355,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'283","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:45.741790+0000","last_change":"2024-09-12T17:40:18.760207+0000","last_active":"2024-09-12T18:56:45.741790+0000","last_peered":"2024-09-12T18:56:45.741790+0000","last_clean":"2024-09-12T18:56:45.741790+0000","last_became_active":"2024-09-12T17:40:18.753693+0000","last_became_peered":"2024-09-12T17:40:18.753693+0000","last_unstale":"2024-09-12T18:56:45.741790+0000","last_undegraded":"2024-09-12T18:56:45.741790+0000","last_fullsized":"2024-09-12T18:56:45.741790+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:50.968987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21644128,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":404,"num_read_kb":12118,"num_write":1027,"num_write_kb":50446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'82","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.819071+0000","last_change":"2024-09-12T17:40:20.130558+0000","last_active":"2024-09-12T18:57:22.819071+0000","last_peered":"2024-09-12T18:57:22.819071+0000","last_clean":"2024-09-12T18:57:22.819071+0000","last_became_active":"2024-09-12T17:40:20.129687+0000","last_became_peered":"2024-09-12T17:40:20.129687+0000","last_unstale":"2024-09-12T18:57:22.819071+0000","last_undegraded":"2024-09-12T18:57:22.819071+0000","last_fullsized":"2024-09-12T18:57:22.819071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:16.096110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":302,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'316","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:20.524908+0000","last_change":"2024-09-12T17:40:18.773313+0000","last_active":"2024-09-12T18:57:20.524908+0000","last_peered":"2024-09-12T18:57:20.524908+0000","last_clean":"2024-09-12T18:57:20.524908+0000","last_became_active":"2024-09-12T17:40:18.772969+0000","last_became_peered":"2024-09-12T17:40:18.772969+0000","last_unstale":"2024-09-12T18:57:20.524908+0000","last_undegraded":"2024-09-12T18:57:20.524908+0000","last_fullsized":"2024-09-12T18:57:20.524908+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:42.889939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10553500,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":405,"num_read_kb":13353,"num_write":1040,"num_write_kb":30519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'211","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:09.446951+0000","last_change":"2024-09-12T17:40:20.130883+0000","last_active":"2024-09-12T18:57:09.446951+0000","last_peered":"2024-09-12T18:57:09.446951+0000","last_clean":"2024-09-12T18:57:09.446951+0000","last_became_active":"2024-09-12T17:40:20.130606+0000","last_became_peered":"2024-09-12T17:40:20.130606+0000","last_unstale":"2024-09-12T18:57:09.446951+0000","last_undegraded":"2024-09-12T18:57:09.446951+0000","last_fullsized":"2024-09-12T18:57:09.446951+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:31.071071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":765,"num_write":331,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'294","reported_seq":1068,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:54.040487+0000","last_change":"2024-09-12T17:40:18.781646+0000","last_active":"2024-09-12T18:56:54.040487+0000","last_peered":"2024-09-12T18:56:54.040487+0000","last_clean":"2024-09-12T18:56:54.040487+0000","last_became_active":"2024-09-12T17:40:18.780861+0000","last_became_peered":"2024-09-12T17:40:18.780861+0000","last_unstale":"2024-09-12T18:56:54.040487+0000","last_undegraded":"2024-09-12T18:56:54.040487+0000","last_fullsized":"2024-09-12T18:56:54.040487+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:37.689644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10210687,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":822,"num_read_kb":18824,"num_write":1122,"num_write_kb":42628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'422","reported_seq":1180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812440+0000","last_change":"2024-09-12T17:40:20.149871+0000","last_active":"2024-09-12T18:56:52.812440+0000","last_peered":"2024-09-12T18:56:52.812440+0000","last_clean":"2024-09-12T18:56:52.812440+0000","last_became_active":"2024-09-12T17:40:20.149176+0000","last_became_peered":"2024-09-12T17:40:20.149176+0000","last_unstale":"2024-09-12T18:56:52.812440+0000","last_undegraded":"2024-09-12T18:56:52.812440+0000","last_fullsized":"2024-09-12T18:56:52.812440+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.618043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2034,"num_read_kb":1768,"num_write":658,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'275","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:45.108916+0000","last_change":"2024-09-12T17:40:18.781947+0000","last_active":"2024-09-12T18:57:45.108916+0000","last_peered":"2024-09-12T18:57:45.108916+0000","last_clean":"2024-09-12T18:57:45.108916+0000","last_became_active":"2024-09-12T17:40:18.781543+0000","last_became_peered":"2024-09-12T17:40:18.781543+0000","last_unstale":"2024-09-12T18:57:45.108916+0000","last_undegraded":"2024-09-12T18:57:45.108916+0000","last_fullsized":"2024-09-12T18:57:45.108916+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:45.216097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8657378,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":490,"num_read_kb":27146,"num_write":1057,"num_write_kb":17169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'186","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.449104+0000","last_change":"2024-09-12T17:40:20.133684+0000","last_active":"2024-09-12T18:56:52.449104+0000","last_peered":"2024-09-12T18:56:52.449104+0000","last_clean":"2024-09-12T18:56:52.449104+0000","last_became_active":"2024-09-12T17:40:20.132914+0000","last_became_peered":"2024-09-12T17:40:20.132914+0000","last_unstale":"2024-09-12T18:56:52.449104+0000","last_undegraded":"2024-09-12T18:56:52.449104+0000","last_fullsized":"2024-09-12T18:56:52.449104+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:10.481286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":685,"num_write":286,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'352","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.435866+0000","last_change":"2024-09-12T17:40:18.774804+0000","last_active":"2024-09-12T18:56:52.435866+0000","last_peered":"2024-09-12T18:56:52.435866+0000","last_clean":"2024-09-12T18:56:52.435866+0000","last_became_active":"2024-09-12T17:40:18.773572+0000","last_became_peered":"2024-09-12T17:40:18.773572+0000","last_unstale":"2024-09-12T18:56:52.435866+0000","last_undegraded":"2024-09-12T18:56:52.435866+0000","last_fullsized":"2024-09-12T18:56:52.435866+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:04.216779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23394053,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":735,"num_read_kb":27791,"num_write":1348,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'106","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.465444+0000","last_change":"2024-09-12T17:40:20.125236+0000","last_active":"2024-09-12T18:56:52.465444+0000","last_peered":"2024-09-12T18:56:52.465444+0000","last_clean":"2024-09-12T18:56:52.465444+0000","last_became_active":"2024-09-12T17:40:20.124905+0000","last_became_peered":"2024-09-12T17:40:20.124905+0000","last_unstale":"2024-09-12T18:56:52.465444+0000","last_undegraded":"2024-09-12T18:56:52.465444+0000","last_fullsized":"2024-09-12T18:56:52.465444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:52.008144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":441,"num_write":144,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'330","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.452697+0000","last_change":"2024-09-12T17:40:18.777519+0000","last_active":"2024-09-12T18:57:07.452697+0000","last_peered":"2024-09-12T18:57:07.452697+0000","last_clean":"2024-09-12T18:57:07.452697+0000","last_became_active":"2024-09-12T17:40:18.776865+0000","last_became_peered":"2024-09-12T17:40:18.776865+0000","last_unstale":"2024-09-12T18:57:07.452697+0000","last_undegraded":"2024-09-12T18:57:07.452697+0000","last_fullsized":"2024-09-12T18:57:07.452697+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:29.028273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1370996,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":654,"num_read_kb":1992,"num_write":1192,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'104","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.554319+0000","last_change":"2024-09-12T17:40:20.119380+0000","last_active":"2024-09-12T18:59:26.554319+0000","last_peered":"2024-09-12T18:59:26.554319+0000","last_clean":"2024-09-12T18:59:26.554319+0000","last_became_active":"2024-09-12T17:40:20.119036+0000","last_became_peered":"2024-09-12T17:40:20.119036+0000","last_unstale":"2024-09-12T18:59:26.554319+0000","last_undegraded":"2024-09-12T18:59:26.554319+0000","last_fullsized":"2024-09-12T18:59:26.554319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:31.564674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":455,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'417","reported_seq":1121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:19.448994+0000","last_change":"2024-09-12T17:40:18.770214+0000","last_active":"2024-09-12T18:57:19.448994+0000","last_peered":"2024-09-12T18:57:19.448994+0000","last_clean":"2024-09-12T18:57:19.448994+0000","last_became_active":"2024-09-12T17:40:18.768688+0000","last_became_peered":"2024-09-12T17:40:18.768688+0000","last_unstale":"2024-09-12T18:57:19.448994+0000","last_undegraded":"2024-09-12T18:57:19.448994+0000","last_fullsized":"2024-09-12T18:57:19.448994+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:46.076255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12351575,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":796,"num_read_kb":49767,"num_write":1329,"num_write_kb":26119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'159","reported_seq":736,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.443217+0000","last_change":"2024-09-12T17:40:20.133523+0000","last_active":"2024-09-12T18:56:27.443217+0000","last_peered":"2024-09-12T18:56:27.443217+0000","last_clean":"2024-09-12T18:56:27.443217+0000","last_became_active":"2024-09-12T17:40:20.132698+0000","last_became_peered":"2024-09-12T17:40:20.132698+0000","last_unstale":"2024-09-12T18:56:27.443217+0000","last_undegraded":"2024-09-12T18:56:27.443217+0000","last_fullsized":"2024-09-12T18:56:27.443217+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:07.059934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":512,"num_write":259,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'289","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.638758+0000","last_change":"2024-09-12T17:40:18.784825+0000","last_active":"2024-09-12T18:57:22.638758+0000","last_peered":"2024-09-12T18:57:22.638758+0000","last_clean":"2024-09-12T18:57:22.638758+0000","last_became_active":"2024-09-12T17:40:18.784024+0000","last_became_peered":"2024-09-12T17:40:18.784024+0000","last_unstale":"2024-09-12T18:57:22.638758+0000","last_undegraded":"2024-09-12T18:57:22.638758+0000","last_fullsized":"2024-09-12T18:57:22.638758+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:14.215607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5753437,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":409,"num_read_kb":13538,"num_write":1052,"num_write_kb":25363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'303","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:39.428993+0000","last_change":"2024-09-12T17:40:55.332141+0000","last_active":"2024-09-12T18:55:39.428993+0000","last_peered":"2024-09-12T18:55:39.428993+0000","last_clean":"2024-09-12T18:55:39.428993+0000","last_became_active":"2024-09-12T17:40:55.331839+0000","last_became_peered":"2024-09-12T17:40:55.331839+0000","last_unstale":"2024-09-12T18:55:39.428993+0000","last_undegraded":"2024-09-12T18:55:39.428993+0000","last_fullsized":"2024-09-12T18:55:39.428993+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.377874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18979519,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":458,"num_read_kb":31466,"num_write":997,"num_write_kb":39606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'70","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:32.448457+0000","last_change":"2024-09-12T17:40:20.116528+0000","last_active":"2024-09-12T18:55:32.448457+0000","last_peered":"2024-09-12T18:55:32.448457+0000","last_clean":"2024-09-12T18:55:32.448457+0000","last_became_active":"2024-09-12T17:40:20.116230+0000","last_became_peered":"2024-09-12T17:40:20.116230+0000","last_unstale":"2024-09-12T18:55:32.448457+0000","last_undegraded":"2024-09-12T18:55:32.448457+0000","last_fullsized":"2024-09-12T18:55:32.448457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:18.767693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":294,"num_write":113,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'328","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.462720+0000","last_change":"2024-09-12T17:40:18.774940+0000","last_active":"2024-09-12T18:57:22.462720+0000","last_peered":"2024-09-12T18:57:22.462720+0000","last_clean":"2024-09-12T18:57:22.462720+0000","last_became_active":"2024-09-12T17:40:18.774332+0000","last_became_peered":"2024-09-12T17:40:18.774332+0000","last_unstale":"2024-09-12T18:57:22.462720+0000","last_undegraded":"2024-09-12T18:57:22.462720+0000","last_fullsized":"2024-09-12T18:57:22.462720+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:36.078701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11573126,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":588,"num_read_kb":8119,"num_write":1403,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'266","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.610008+0000","last_change":"2024-09-12T17:40:20.113318+0000","last_active":"2024-09-12T18:55:17.610008+0000","last_peered":"2024-09-12T18:55:17.610008+0000","last_clean":"2024-09-12T18:55:17.610008+0000","last_became_active":"2024-09-12T17:40:20.112521+0000","last_became_peered":"2024-09-12T17:40:20.112521+0000","last_unstale":"2024-09-12T18:55:17.610008+0000","last_undegraded":"2024-09-12T18:55:17.610008+0000","last_fullsized":"2024-09-12T18:55:17.610008+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:29.322254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1090,"num_read_kb":887,"num_write":395,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5850,"num_read_kb":4138,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16272,"num_read_kb":15940,"num_write":16723,"num_write_kb":4884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1758,"ondisk_log_size":1758,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":457,"ondisk_log_size":457,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1915679,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":18614,"num_read_kb":35597,"num_write":15741,"num_write_kb":11986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":2795574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2091,"ondisk_log_size":2091,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2852,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103249,"num_read_kb":86122,"num_write":37396,"num_write_kb":18900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3947,"ondisk_log_size":3947,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":642493580,"num_objects":4513,"num_object_clones":0,"num_object_copies":9026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4513,"num_whiteouts":0,"num_read":32284,"num_read_kb":1876573,"num_write":68075,"num_write_kb":2152272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1317863424,"data_stored":1284987160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3736,"ondisk_log_size":3736,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":75130115,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":143,"num_read_kb":197405,"num_write":158,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":150265856,"data_stored":150260230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":75130115,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":139,"num_read_kb":186093,"num_write":158,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":150265856,"data_stored":150260230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510404,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451440,"kb_used_data":203680,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93920400,"statfs":{"total":96636764160,"available":96174489600,"internally_reserved":0,"allocated":208568320,"data_stored":202396353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":253688266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510404,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":425536,"kb_used_data":195824,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93946304,"statfs":{"total":96636764160,"available":96201015296,"internally_reserved":0,"allocated":200523776,"data_stored":196040359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510403,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343480,"kb_used_data":231848,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94028360,"statfs":{"total":96636764160,"available":96285040640,"internally_reserved":0,"allocated":237412352,"data_stored":230936096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510404,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276480,"kb_used_data":209200,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94095360,"statfs":{"total":96636764160,"available":96353648640,"internally_reserved":0,"allocated":214220800,"data_stored":207815616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510402,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":497148,"kb_used_data":253548,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":93874692,"statfs":{"total":96636764160,"available":96127684608,"internally_reserved":0,"allocated":259633152,"data_stored":253357114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510402,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245736,"kb_used_data":146584,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94126104,"statfs":{"total":96636764160,"available":96385130496,"internally_reserved":0,"allocated":150102016,"data_stored":145754399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510404,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434708,"kb_used_data":223044,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":93937132,"statfs":{"total":96636764160,"available":96191623168,"internally_reserved":0,"allocated":228397056,"data_stored":221677622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575810,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224936,"kb_used_data":149400,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94146904,"statfs":{"total":96636764160,"available":96406429696,"internally_reserved":0,"allocated":152985600,"data_stored":148655937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77330888},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":187408384,"data_stored":182261511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":99299328,"data_stored":96490580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114515968,"data_stored":111678165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":195018752,"data_stored":190317682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":185356288,"data_stored":180424589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":207863808,"data_stored":203004921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":148754432,"data_stored":145771761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":179646464,"data_stored":175037951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":347978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":475136,"data_stored":399372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":132861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":492975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":82687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":684032,"data_stored":573019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":258551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":508131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18458586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13680640,"data_stored":13679919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29409280,"data_stored":29408553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17874944,"data_stored":17874217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":21019951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34189312,"data_stored":34187226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18458580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:00:01.255 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T19:00:01.569 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T19:00:01.569 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":264,"fsid":"634e9294-a45c-40c3-b542-a6fcc3acc794","created":"2024-09-12T17:39:49.371481+0000","modified":"2024-09-12T18:19:58.809513+0000","last_up_change":"2024-09-12T17:40:01.612523+0000","last_in_change":"2024-09-12T17:39:51.684991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:40:02.208651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:40:07.766549+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:40:16.857482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:40:19.086200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:40:20.231650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:40:22.455003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:40:24.184996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:40:26.319515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T17:55:57.462827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"253","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T17:59:37.448194+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T17:59:41.310504+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T18:19:56.218728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"264","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"127eba9c-71ee-4e56-ad38-41e33131d3bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6817","nonce":2202738069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6819","nonce":2202738069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6825","nonce":2202738069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2202738069},{"type":"v1","addr":"172.21.15.157:6822","nonce":2202738069}]},"public_addr":"172.21.15.157:6817/2202738069","cluster_addr":"172.21.15.157:6819/2202738069","heartbeat_back_addr":"172.21.15.157:6825/2202738069","heartbeat_front_addr":"172.21.15.157:6822/2202738069","state":["exists","up"]},{"osd":1,"uuid":"2614ac45-d4c7-4da5-9f21-da3980ec191e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6823","nonce":3908026248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6827","nonce":3908026248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6831","nonce":3908026248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3908026248},{"type":"v1","addr":"172.21.15.157:6829","nonce":3908026248}]},"public_addr":"172.21.15.157:6823/3908026248","cluster_addr":"172.21.15.157:6827/3908026248","heartbeat_back_addr":"172.21.15.157:6831/3908026248","heartbeat_front_addr":"172.21.15.157:6829/3908026248","state":["exists","up"]},{"osd":2,"uuid":"16bfeef6-4b24-4de6-ba35-92eb0fa56a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6801","nonce":2182114182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6803","nonce":2182114182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6807","nonce":2182114182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2182114182},{"type":"v1","addr":"172.21.15.157:6805","nonce":2182114182}]},"public_addr":"172.21.15.157:6801/2182114182","cluster_addr":"172.21.15.157:6803/2182114182","heartbeat_back_addr":"172.21.15.157:6807/2182114182","heartbeat_front_addr":"172.21.15.157:6805/2182114182","state":["exists","up"]},{"osd":3,"uuid":"da73acc4-b448-41f6-ab33-3a08c0ab7578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6809","nonce":3345787243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6811","nonce":3345787243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6815","nonce":3345787243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3345787243},{"type":"v1","addr":"172.21.15.157:6813","nonce":3345787243}]},"public_addr":"172.21.15.157:6809/3345787243","cluster_addr":"172.21.15.157:6811/3345787243","heartbeat_back_addr":"172.21.15.157:6815/3345787243","heartbeat_front_addr":"172.21.15.157:6813/3345787243","state":["exists","up"]},{"osd":4,"uuid":"081aabd0-3871-47e8-98da-8ded73a9cb8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6817","nonce":2884135430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6819","nonce":2884135430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6823","nonce":2884135430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2884135430},{"type":"v1","addr":"172.21.15.190:6821","nonce":2884135430}]},"public_addr":"172.21.15.190:6817/2884135430","cluster_addr":"172.21.15.190:6819/2884135430","heartbeat_back_addr":"172.21.15.190:6823/2884135430","heartbeat_front_addr":"172.21.15.190:6821/2884135430","state":["exists","up"]},{"osd":5,"uuid":"0e43cc8f-ab71-4ffd-b644-fd357c3c32e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6801","nonce":962816639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6803","nonce":962816639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6807","nonce":962816639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":962816639},{"type":"v1","addr":"172.21.15.190:6805","nonce":962816639}]},"public_addr":"172.21.15.190:6801/962816639","cluster_addr":"172.21.15.190:6803/962816639","heartbeat_back_addr":"172.21.15.190:6807/962816639","heartbeat_front_addr":"172.21.15.190:6805/962816639","state":["exists","up"]},{"osd":6,"uuid":"4abefff1-7456-497d-8d79-46f811031b1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6809","nonce":393781841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6811","nonce":393781841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6815","nonce":393781841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":393781841},{"type":"v1","addr":"172.21.15.190:6813","nonce":393781841}]},"public_addr":"172.21.15.190:6809/393781841","cluster_addr":"172.21.15.190:6811/393781841","heartbeat_back_addr":"172.21.15.190:6815/393781841","heartbeat_front_addr":"172.21.15.190:6813/393781841","state":["exists","up"]},{"osd":7,"uuid":"36eb1495-cee5-41b2-9342-ccd37000b85d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6825","nonce":996962901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6827","nonce":996962901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6831","nonce":996962901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":996962901},{"type":"v1","addr":"172.21.15.190:6829","nonce":996962901}]},"public_addr":"172.21.15.190:6825/996962901","cluster_addr":"172.21.15.190:6827/996962901","heartbeat_back_addr":"172.21.15.190:6831/996962901","heartbeat_front_addr":"172.21.15.190:6829/996962901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.286623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.589301+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:57.927099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.576386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.715561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.327247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.590599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:39:58.566532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"67.18","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T19:00:02.588 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T19:00:02.589 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:00:02.748 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T19:00:02.749 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:00:02.749 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T19:00:02.765 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T19:00:03.045 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T19:00:03.063 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T19:00:03.063 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:00:03.200 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T19:00:03.200 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:00:03.200 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T19:00:03.214 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T19:00:03.504 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T19:00:03.522 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T19:00:03.523 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:00:03.661 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T19:00:03.661 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:00:03.661 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T19:00:03.677 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T19:00:03.949 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T19:00:03.967 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T19:00:03.967 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:00:04.108 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T19:00:04.109 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:00:04.109 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T19:00:04.122 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T19:00:04.419 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T19:00:04.439 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T19:00:04.439 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:00:04.586 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T19:00:04.586 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:00:04.586 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T19:00:04.603 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T19:00:04.898 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T19:00:04.918 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T19:00:04.918 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:00:05.065 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T19:00:05.065 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:00:05.065 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T19:00:05.081 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T19:00:05.381 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T19:00:05.399 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T19:00:05.400 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:00:05.554 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T19:00:05.555 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:00:05.555 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T19:00:05.572 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T19:00:05.857 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T19:00:05.875 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T19:00:05.876 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:00:06.011 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-12T19:00:06.012 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:00:06.012 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-12T19:00:06.027 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T19:00:06.318 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T19:00:06.337 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:00:06.697 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T19:00:06.708 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-09-12T19:00:06.716 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":2659,"stamp":"2024-09-12T19:00:05.324613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158204416,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":183664,"num_read_kb":2408959,"num_write":144741,"num_write_kb":2446021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13100,"ondisk_log_size":13100,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1635652,"kb_used_data":335728,"kb_used_omap":12,"kb_used_meta":1298675,"kb_avail":753339068,"statfs":{"total":773094113280,"available":771419205632,"internally_reserved":0,"allocated":343785472,"data_stored":330396556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1329843763},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-637072648,"num_objects":-4155,"num_object_clones":0,"num_object_copies":-8310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4155,"num_whiteouts":0,"num_read":4642,"num_read_kb":4172,"num_write":4407,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006737"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639884+0000","last_change":"2024-09-12T18:19:57.854037+0000","last_active":"2024-09-12T18:57:27.639884+0000","last_peered":"2024-09-12T18:57:27.639884+0000","last_clean":"2024-09-12T18:57:27.639884+0000","last_became_active":"2024-09-12T18:19:57.853375+0000","last_became_peered":"2024-09-12T18:19:57.853375+0000","last_unstale":"2024-09-12T18:57:27.639884+0000","last_undegraded":"2024-09-12T18:57:27.639884+0000","last_fullsized":"2024-09-12T18:57:27.639884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:39.334575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:42.681464+0000","last_change":"2024-09-12T17:59:43.011642+0000","last_active":"2024-09-12T18:59:42.681464+0000","last_peered":"2024-09-12T18:59:42.681464+0000","last_clean":"2024-09-12T18:59:42.681464+0000","last_became_active":"2024-09-12T17:59:43.010854+0000","last_became_peered":"2024-09-12T17:59:43.010854+0000","last_unstale":"2024-09-12T18:59:42.681464+0000","last_undegraded":"2024-09-12T18:59:42.681464+0000","last_fullsized":"2024-09-12T18:59:42.681464+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:05.224690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454697+0000","last_change":"2024-09-12T17:59:38.988698+0000","last_active":"2024-09-12T18:57:12.454697+0000","last_peered":"2024-09-12T18:57:12.454697+0000","last_clean":"2024-09-12T18:57:12.454697+0000","last_became_active":"2024-09-12T17:59:38.987739+0000","last_became_peered":"2024-09-12T17:59:38.987739+0000","last_unstale":"2024-09-12T18:57:12.454697+0000","last_undegraded":"2024-09-12T18:57:12.454697+0000","last_fullsized":"2024-09-12T18:57:12.454697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:32.330775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'44","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.460341+0000","last_change":"2024-09-12T17:55:59.359070+0000","last_active":"2024-09-12T18:56:27.460341+0000","last_peered":"2024-09-12T18:56:27.460341+0000","last_clean":"2024-09-12T18:56:27.460341+0000","last_became_active":"2024-09-12T17:55:59.358302+0000","last_became_peered":"2024-09-12T17:55:59.358302+0000","last_unstale":"2024-09-12T18:56:27.460341+0000","last_undegraded":"2024-09-12T18:56:27.460341+0000","last_fullsized":"2024-09-12T18:56:27.460341+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:31.219330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":154,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:29.450940+0000","last_change":"2024-09-12T18:19:57.839639+0000","last_active":"2024-09-12T18:57:29.450940+0000","last_peered":"2024-09-12T18:57:29.450940+0000","last_clean":"2024-09-12T18:57:29.450940+0000","last_became_active":"2024-09-12T18:19:57.838918+0000","last_became_peered":"2024-09-12T18:19:57.838918+0000","last_unstale":"2024-09-12T18:57:29.450940+0000","last_undegraded":"2024-09-12T18:57:29.450940+0000","last_fullsized":"2024-09-12T18:57:29.450940+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:14.062322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:42.450552+0000","last_change":"2024-09-12T17:59:43.018636+0000","last_active":"2024-09-12T18:59:42.450552+0000","last_peered":"2024-09-12T18:59:42.450552+0000","last_clean":"2024-09-12T18:59:42.450552+0000","last_became_active":"2024-09-12T17:59:43.005733+0000","last_became_peered":"2024-09-12T17:59:43.005733+0000","last_unstale":"2024-09-12T18:59:42.450552+0000","last_undegraded":"2024-09-12T18:59:42.450552+0000","last_fullsized":"2024-09-12T18:59:42.450552+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.942784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'8","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.284189+0000","last_change":"2024-09-12T17:59:38.990543+0000","last_active":"2024-09-12T18:59:59.284189+0000","last_peered":"2024-09-12T18:59:59.284189+0000","last_clean":"2024-09-12T18:59:59.284189+0000","last_became_active":"2024-09-12T17:59:38.989854+0000","last_became_peered":"2024-09-12T17:59:38.989854+0000","last_unstale":"2024-09-12T18:59:59.284189+0000","last_undegraded":"2024-09-12T18:59:59.284189+0000","last_fullsized":"2024-09-12T18:59:59.284189+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:58.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8763,"num_write":8,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'34","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:14.436391+0000","last_change":"2024-09-12T17:55:59.368156+0000","last_active":"2024-09-12T18:56:14.436391+0000","last_peered":"2024-09-12T18:56:14.436391+0000","last_clean":"2024-09-12T18:56:14.436391+0000","last_became_active":"2024-09-12T17:55:59.367426+0000","last_became_peered":"2024-09-12T17:55:59.367426+0000","last_unstale":"2024-09-12T18:56:14.436391+0000","last_undegraded":"2024-09-12T18:56:14.436391+0000","last_fullsized":"2024-09-12T18:56:14.436391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:37.601556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":114,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.427354+0000","last_change":"2024-09-12T18:19:57.849468+0000","last_active":"2024-09-12T18:56:12.427354+0000","last_peered":"2024-09-12T18:56:12.427354+0000","last_clean":"2024-09-12T18:56:12.427354+0000","last_became_active":"2024-09-12T18:19:57.848735+0000","last_became_peered":"2024-09-12T18:19:57.848735+0000","last_unstale":"2024-09-12T18:56:12.427354+0000","last_undegraded":"2024-09-12T18:56:12.427354+0000","last_fullsized":"2024-09-12T18:56:12.427354+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:59.827170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.481349+0000","last_change":"2024-09-12T17:59:43.012346+0000","last_active":"2024-09-12T18:58:02.481349+0000","last_peered":"2024-09-12T18:58:02.481349+0000","last_clean":"2024-09-12T18:58:02.481349+0000","last_became_active":"2024-09-12T17:59:43.011603+0000","last_became_peered":"2024-09-12T17:59:43.011603+0000","last_unstale":"2024-09-12T18:58:02.481349+0000","last_undegraded":"2024-09-12T18:58:02.481349+0000","last_fullsized":"2024-09-12T18:58:02.481349+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:19.770482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:54.456240+0000","last_change":"2024-09-12T17:59:38.985703+0000","last_active":"2024-09-12T18:57:54.456240+0000","last_peered":"2024-09-12T18:57:54.456240+0000","last_clean":"2024-09-12T18:57:54.456240+0000","last_became_active":"2024-09-12T17:59:38.984980+0000","last_became_peered":"2024-09-12T17:59:38.984980+0000","last_unstale":"2024-09-12T18:57:54.456240+0000","last_undegraded":"2024-09-12T18:57:54.456240+0000","last_fullsized":"2024-09-12T18:57:54.456240+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:03.988908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'15","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.454640+0000","last_change":"2024-09-12T17:55:59.357028+0000","last_active":"2024-09-12T18:56:02.454640+0000","last_peered":"2024-09-12T18:56:02.454640+0000","last_clean":"2024-09-12T18:56:02.454640+0000","last_became_active":"2024-09-12T17:55:59.356144+0000","last_became_peered":"2024-09-12T17:55:59.356144+0000","last_unstale":"2024-09-12T18:56:02.454640+0000","last_undegraded":"2024-09-12T18:56:02.454640+0000","last_fullsized":"2024-09-12T18:56:02.454640+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:40.644103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442648+0000","last_change":"2024-09-12T18:19:57.861119+0000","last_active":"2024-09-12T18:56:27.442648+0000","last_peered":"2024-09-12T18:56:27.442648+0000","last_clean":"2024-09-12T18:56:27.442648+0000","last_became_active":"2024-09-12T18:19:57.860464+0000","last_became_peered":"2024-09-12T18:19:57.860464+0000","last_unstale":"2024-09-12T18:56:27.442648+0000","last_undegraded":"2024-09-12T18:56:27.442648+0000","last_fullsized":"2024-09-12T18:56:27.442648+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:37.217624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'4","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.129553+0000","last_change":"2024-09-12T17:59:43.031327+0000","last_active":"2024-09-12T18:59:59.129553+0000","last_peered":"2024-09-12T18:59:59.129553+0000","last_clean":"2024-09-12T18:59:59.129553+0000","last_became_active":"2024-09-12T17:59:43.030545+0000","last_became_peered":"2024-09-12T17:59:43.030545+0000","last_unstale":"2024-09-12T18:59:59.129553+0000","last_undegraded":"2024-09-12T18:59:59.129553+0000","last_fullsized":"2024-09-12T18:59:59.129553+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:11.859283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4192,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800776+0000","last_change":"2024-09-12T17:59:38.946186+0000","last_active":"2024-09-12T18:55:57.800776+0000","last_peered":"2024-09-12T18:55:57.800776+0000","last_clean":"2024-09-12T18:55:57.800776+0000","last_became_active":"2024-09-12T17:59:38.945373+0000","last_became_peered":"2024-09-12T17:59:38.945373+0000","last_unstale":"2024-09-12T18:55:57.800776+0000","last_undegraded":"2024-09-12T18:55:57.800776+0000","last_fullsized":"2024-09-12T18:55:57.800776+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:18.147516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'6","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437289+0000","last_change":"2024-09-12T17:55:59.340661+0000","last_active":"2024-09-12T18:56:02.437289+0000","last_peered":"2024-09-12T18:56:02.437289+0000","last_clean":"2024-09-12T18:56:02.437289+0000","last_became_active":"2024-09-12T17:55:59.338550+0000","last_became_peered":"2024-09-12T17:55:59.338550+0000","last_unstale":"2024-09-12T18:56:02.437289+0000","last_undegraded":"2024-09-12T18:56:02.437289+0000","last_fullsized":"2024-09-12T18:56:02.437289+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:44.861905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439345+0000","last_change":"2024-09-12T18:19:57.871984+0000","last_active":"2024-09-12T18:56:12.439345+0000","last_peered":"2024-09-12T18:56:12.439345+0000","last_clean":"2024-09-12T18:56:12.439345+0000","last_became_active":"2024-09-12T18:19:57.871345+0000","last_became_peered":"2024-09-12T18:19:57.871345+0000","last_unstale":"2024-09-12T18:56:12.439345+0000","last_undegraded":"2024-09-12T18:56:12.439345+0000","last_fullsized":"2024-09-12T18:56:12.439345+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:45.284109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.612304+0000","last_change":"2024-09-12T17:59:43.034960+0000","last_active":"2024-09-12T18:55:27.612304+0000","last_peered":"2024-09-12T18:55:27.612304+0000","last_clean":"2024-09-12T18:55:27.612304+0000","last_became_active":"2024-09-12T17:59:43.034299+0000","last_became_peered":"2024-09-12T17:59:43.034299+0000","last_unstale":"2024-09-12T18:55:27.612304+0000","last_undegraded":"2024-09-12T18:55:27.612304+0000","last_fullsized":"2024-09-12T18:55:27.612304+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:55.095948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.444546+0000","last_change":"2024-09-12T17:59:38.981877+0000","last_active":"2024-09-12T18:55:17.444546+0000","last_peered":"2024-09-12T18:55:17.444546+0000","last_clean":"2024-09-12T18:55:17.444546+0000","last_became_active":"2024-09-12T17:59:38.976348+0000","last_became_peered":"2024-09-12T17:59:38.976348+0000","last_unstale":"2024-09-12T18:55:17.444546+0000","last_undegraded":"2024-09-12T18:55:17.444546+0000","last_fullsized":"2024-09-12T18:55:17.444546+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:41.558530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'16","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437226+0000","last_change":"2024-09-12T17:55:59.357701+0000","last_active":"2024-09-12T18:56:02.437226+0000","last_peered":"2024-09-12T18:56:02.437226+0000","last_clean":"2024-09-12T18:56:02.437226+0000","last_became_active":"2024-09-12T17:55:59.356970+0000","last_became_peered":"2024-09-12T17:55:59.356970+0000","last_unstale":"2024-09-12T18:56:02.437226+0000","last_undegraded":"2024-09-12T18:56:02.437226+0000","last_fullsized":"2024-09-12T18:56:02.437226+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:46.362725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":58,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464203+0000","last_change":"2024-09-12T18:19:57.867587+0000","last_active":"2024-09-12T18:57:27.464203+0000","last_peered":"2024-09-12T18:57:27.464203+0000","last_clean":"2024-09-12T18:57:27.464203+0000","last_became_active":"2024-09-12T18:19:57.865319+0000","last_became_peered":"2024-09-12T18:19:57.865319+0000","last_unstale":"2024-09-12T18:57:27.464203+0000","last_undegraded":"2024-09-12T18:57:27.464203+0000","last_fullsized":"2024-09-12T18:57:27.464203+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:03.710006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.446126+0000","last_change":"2024-09-12T17:59:56.386718+0000","last_active":"2024-09-12T18:57:42.446126+0000","last_peered":"2024-09-12T18:57:42.446126+0000","last_clean":"2024-09-12T18:57:42.446126+0000","last_became_active":"2024-09-12T17:59:56.386194+0000","last_became_peered":"2024-09-12T17:59:56.386194+0000","last_unstale":"2024-09-12T18:57:42.446126+0000","last_undegraded":"2024-09-12T18:57:42.446126+0000","last_fullsized":"2024-09-12T18:57:42.446126+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:16.043399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'9","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.438136+0000","last_change":"2024-09-12T17:59:38.978120+0000","last_active":"2024-09-12T18:59:59.438136+0000","last_peered":"2024-09-12T18:59:59.438136+0000","last_clean":"2024-09-12T18:59:59.438136+0000","last_became_active":"2024-09-12T17:59:38.977316+0000","last_became_peered":"2024-09-12T17:59:38.977316+0000","last_unstale":"2024-09-12T18:59:59.438136+0000","last_undegraded":"2024-09-12T18:59:59.438136+0000","last_fullsized":"2024-09-12T18:59:59.438136+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:26.707491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16386,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'37","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.425307+0000","last_change":"2024-09-12T17:55:59.366994+0000","last_active":"2024-09-12T18:56:02.425307+0000","last_peered":"2024-09-12T18:56:02.425307+0000","last_clean":"2024-09-12T18:56:02.425307+0000","last_became_active":"2024-09-12T17:55:59.366177+0000","last_became_peered":"2024-09-12T17:55:59.366177+0000","last_unstale":"2024-09-12T18:56:02.425307+0000","last_undegraded":"2024-09-12T18:56:02.425307+0000","last_fullsized":"2024-09-12T18:56:02.425307+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:03.524473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":133,"num_write":64,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457338+0000","last_change":"2024-09-12T18:19:57.844732+0000","last_active":"2024-09-12T18:57:27.457338+0000","last_peered":"2024-09-12T18:57:27.457338+0000","last_clean":"2024-09-12T18:57:27.457338+0000","last_became_active":"2024-09-12T18:19:57.843946+0000","last_became_peered":"2024-09-12T18:19:57.843946+0000","last_unstale":"2024-09-12T18:57:27.457338+0000","last_undegraded":"2024-09-12T18:57:27.457338+0000","last_fullsized":"2024-09-12T18:57:27.457338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:48.999189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.440013+0000","last_change":"2024-09-12T17:59:43.014049+0000","last_active":"2024-09-12T18:57:12.440013+0000","last_peered":"2024-09-12T18:57:12.440013+0000","last_clean":"2024-09-12T18:57:12.440013+0000","last_became_active":"2024-09-12T17:59:43.013293+0000","last_became_peered":"2024-09-12T17:59:43.013293+0000","last_unstale":"2024-09-12T18:57:12.440013+0000","last_undegraded":"2024-09-12T18:57:12.440013+0000","last_fullsized":"2024-09-12T18:57:12.440013+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:47.290570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.816755+0000","last_change":"2024-09-12T17:59:38.984819+0000","last_active":"2024-09-12T18:57:12.816755+0000","last_peered":"2024-09-12T18:57:12.816755+0000","last_clean":"2024-09-12T18:57:12.816755+0000","last_became_active":"2024-09-12T17:59:38.984004+0000","last_became_peered":"2024-09-12T17:59:38.984004+0000","last_unstale":"2024-09-12T18:57:12.816755+0000","last_undegraded":"2024-09-12T18:57:12.816755+0000","last_fullsized":"2024-09-12T18:57:12.816755+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:47.953455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'21","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463100+0000","last_change":"2024-09-12T17:55:59.367890+0000","last_active":"2024-09-12T18:56:42.463100+0000","last_peered":"2024-09-12T18:56:42.463100+0000","last_clean":"2024-09-12T18:56:42.463100+0000","last_became_active":"2024-09-12T17:55:59.366968+0000","last_became_peered":"2024-09-12T17:55:59.366968+0000","last_unstale":"2024-09-12T18:56:42.463100+0000","last_undegraded":"2024-09-12T18:56:42.463100+0000","last_fullsized":"2024-09-12T18:56:42.463100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:25.297113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457398+0000","last_change":"2024-09-12T18:19:57.871547+0000","last_active":"2024-09-12T18:57:27.457398+0000","last_peered":"2024-09-12T18:57:27.457398+0000","last_clean":"2024-09-12T18:57:27.457398+0000","last_became_active":"2024-09-12T18:19:57.870750+0000","last_became_peered":"2024-09-12T18:19:57.870750+0000","last_unstale":"2024-09-12T18:57:27.457398+0000","last_undegraded":"2024-09-12T18:57:27.457398+0000","last_fullsized":"2024-09-12T18:57:27.457398+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:27.428422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454597+0000","last_change":"2024-09-12T17:59:43.027485+0000","last_active":"2024-09-12T18:57:12.454597+0000","last_peered":"2024-09-12T18:57:12.454597+0000","last_clean":"2024-09-12T18:57:12.454597+0000","last_became_active":"2024-09-12T17:59:43.021777+0000","last_became_peered":"2024-09-12T17:59:43.021777+0000","last_unstale":"2024-09-12T18:57:12.454597+0000","last_undegraded":"2024-09-12T18:57:12.454597+0000","last_fullsized":"2024-09-12T18:57:12.454597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:26.307507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.469779+0000","last_change":"2024-09-12T17:59:38.990405+0000","last_active":"2024-09-12T18:57:12.469779+0000","last_peered":"2024-09-12T18:57:12.469779+0000","last_clean":"2024-09-12T18:57:12.469779+0000","last_became_active":"2024-09-12T17:59:38.989753+0000","last_became_peered":"2024-09-12T17:59:38.989753+0000","last_unstale":"2024-09-12T18:57:12.469779+0000","last_undegraded":"2024-09-12T18:57:12.469779+0000","last_fullsized":"2024-09-12T18:57:12.469779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:31.519684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'22","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.450554+0000","last_change":"2024-09-12T17:55:59.330535+0000","last_active":"2024-09-12T18:56:27.450554+0000","last_peered":"2024-09-12T18:56:27.450554+0000","last_clean":"2024-09-12T18:56:27.450554+0000","last_became_active":"2024-09-12T17:55:59.329792+0000","last_became_peered":"2024-09-12T17:55:59.329792+0000","last_unstale":"2024-09-12T18:56:27.450554+0000","last_undegraded":"2024-09-12T18:56:27.450554+0000","last_fullsized":"2024-09-12T18:56:27.450554+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:50.850228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.461644+0000","last_change":"2024-09-12T18:19:57.868119+0000","last_active":"2024-09-12T18:57:17.461644+0000","last_peered":"2024-09-12T18:57:17.461644+0000","last_clean":"2024-09-12T18:57:17.461644+0000","last_became_active":"2024-09-12T18:19:57.863600+0000","last_became_peered":"2024-09-12T18:19:57.863600+0000","last_unstale":"2024-09-12T18:57:17.461644+0000","last_undegraded":"2024-09-12T18:57:17.461644+0000","last_fullsized":"2024-09-12T18:57:17.461644+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.347599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.439623+0000","last_change":"2024-09-12T17:59:43.033456+0000","last_active":"2024-09-12T18:59:59.439623+0000","last_peered":"2024-09-12T18:59:59.439623+0000","last_clean":"2024-09-12T18:59:59.439623+0000","last_became_active":"2024-09-12T17:59:43.031016+0000","last_became_peered":"2024-09-12T17:59:43.031016+0000","last_unstale":"2024-09-12T18:59:59.439623+0000","last_undegraded":"2024-09-12T18:59:59.439623+0000","last_fullsized":"2024-09-12T18:59:59.439623+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:41.898618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:52.618126+0000","last_change":"2024-09-12T17:59:38.966961+0000","last_active":"2024-09-12T18:55:52.618126+0000","last_peered":"2024-09-12T18:55:52.618126+0000","last_clean":"2024-09-12T18:55:52.618126+0000","last_became_active":"2024-09-12T17:59:38.966158+0000","last_became_peered":"2024-09-12T17:59:38.966158+0000","last_unstale":"2024-09-12T18:55:52.618126+0000","last_undegraded":"2024-09-12T18:55:52.618126+0000","last_fullsized":"2024-09-12T18:55:52.618126+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:05.792036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'26","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.460293+0000","last_change":"2024-09-12T17:55:59.367819+0000","last_active":"2024-09-12T18:56:27.460293+0000","last_peered":"2024-09-12T18:56:27.460293+0000","last_clean":"2024-09-12T18:56:27.460293+0000","last_became_active":"2024-09-12T17:55:59.366803+0000","last_became_peered":"2024-09-12T17:55:59.366803+0000","last_unstale":"2024-09-12T18:56:27.460293+0000","last_undegraded":"2024-09-12T18:56:27.460293+0000","last_fullsized":"2024-09-12T18:56:27.460293+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:11.044959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:19.448910+0000","last_change":"2024-09-12T18:19:57.846272+0000","last_active":"2024-09-12T18:57:19.448910+0000","last_peered":"2024-09-12T18:57:19.448910+0000","last_clean":"2024-09-12T18:57:19.448910+0000","last_became_active":"2024-09-12T18:19:57.845474+0000","last_became_peered":"2024-09-12T18:19:57.845474+0000","last_unstale":"2024-09-12T18:57:19.448910+0000","last_undegraded":"2024-09-12T18:57:19.448910+0000","last_fullsized":"2024-09-12T18:57:19.448910+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:36.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:22.470978+0000","last_change":"2024-09-12T17:59:43.034867+0000","last_active":"2024-09-12T18:58:22.470978+0000","last_peered":"2024-09-12T18:58:22.470978+0000","last_clean":"2024-09-12T18:58:22.470978+0000","last_became_active":"2024-09-12T17:59:43.034159+0000","last_became_peered":"2024-09-12T17:59:43.034159+0000","last_unstale":"2024-09-12T18:58:22.470978+0000","last_undegraded":"2024-09-12T18:58:22.470978+0000","last_fullsized":"2024-09-12T18:58:22.470978+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:55.391915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426051+0000","last_change":"2024-09-12T17:59:38.981580+0000","last_active":"2024-09-12T18:55:17.426051+0000","last_peered":"2024-09-12T18:55:17.426051+0000","last_clean":"2024-09-12T18:55:17.426051+0000","last_became_active":"2024-09-12T17:59:38.980797+0000","last_became_peered":"2024-09-12T17:59:38.980797+0000","last_unstale":"2024-09-12T18:55:17.426051+0000","last_undegraded":"2024-09-12T18:55:17.426051+0000","last_fullsized":"2024-09-12T18:55:17.426051+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:47.982971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'6","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442893+0000","last_change":"2024-09-12T17:55:59.367443+0000","last_active":"2024-09-12T18:56:27.442893+0000","last_peered":"2024-09-12T18:56:27.442893+0000","last_clean":"2024-09-12T18:56:27.442893+0000","last_became_active":"2024-09-12T17:55:59.366679+0000","last_became_peered":"2024-09-12T17:55:59.366679+0000","last_unstale":"2024-09-12T18:56:27.442893+0000","last_undegraded":"2024-09-12T18:56:27.442893+0000","last_fullsized":"2024-09-12T18:56:27.442893+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.004334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.454894+0000","last_change":"2024-09-12T18:19:57.841634+0000","last_active":"2024-09-12T18:57:17.454894+0000","last_peered":"2024-09-12T18:57:17.454894+0000","last_clean":"2024-09-12T18:57:17.454894+0000","last_became_active":"2024-09-12T18:19:57.840855+0000","last_became_peered":"2024-09-12T18:19:57.840855+0000","last_unstale":"2024-09-12T18:57:17.454894+0000","last_undegraded":"2024-09-12T18:57:17.454894+0000","last_fullsized":"2024-09-12T18:57:17.454894+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:43.276958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'4","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.461263+0000","last_change":"2024-09-12T17:59:43.029670+0000","last_active":"2024-09-12T18:57:42.461263+0000","last_peered":"2024-09-12T18:57:42.461263+0000","last_clean":"2024-09-12T18:57:42.461263+0000","last_became_active":"2024-09-12T17:59:43.021538+0000","last_became_peered":"2024-09-12T17:59:43.021538+0000","last_unstale":"2024-09-12T18:57:42.461263+0000","last_undegraded":"2024-09-12T18:57:42.461263+0000","last_fullsized":"2024-09-12T18:57:42.461263+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:19.134601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'6","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.604776+0000","last_change":"2024-09-12T17:59:38.980849+0000","last_active":"2024-09-12T18:59:59.604776+0000","last_peered":"2024-09-12T18:59:59.604776+0000","last_clean":"2024-09-12T18:59:59.604776+0000","last_became_active":"2024-09-12T17:59:38.979939+0000","last_became_peered":"2024-09-12T17:59:38.979939+0000","last_unstale":"2024-09-12T18:59:59.604776+0000","last_undegraded":"2024-09-12T18:59:59.604776+0000","last_fullsized":"2024-09-12T18:59:59.604776+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'36","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:24.438322+0000","last_change":"2024-09-12T17:55:59.331420+0000","last_active":"2024-09-12T18:56:24.438322+0000","last_peered":"2024-09-12T18:56:24.438322+0000","last_clean":"2024-09-12T18:56:24.438322+0000","last_became_active":"2024-09-12T17:55:59.330570+0000","last_became_peered":"2024-09-12T17:55:59.330570+0000","last_unstale":"2024-09-12T18:56:24.438322+0000","last_undegraded":"2024-09-12T18:56:24.438322+0000","last_fullsized":"2024-09-12T18:56:24.438322+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:37.462782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":139,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637308+0000","last_change":"2024-09-12T18:19:57.854199+0000","last_active":"2024-09-12T18:57:17.637308+0000","last_peered":"2024-09-12T18:57:17.637308+0000","last_clean":"2024-09-12T18:57:17.637308+0000","last_became_active":"2024-09-12T18:19:57.853269+0000","last_became_peered":"2024-09-12T18:19:57.853269+0000","last_unstale":"2024-09-12T18:57:17.637308+0000","last_undegraded":"2024-09-12T18:57:17.637308+0000","last_fullsized":"2024-09-12T18:57:17.637308+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:58.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.791801+0000","last_change":"2024-09-12T17:59:43.022601+0000","last_active":"2024-09-12T18:55:17.791801+0000","last_peered":"2024-09-12T18:55:17.791801+0000","last_clean":"2024-09-12T18:55:17.791801+0000","last_became_active":"2024-09-12T17:59:43.020450+0000","last_became_peered":"2024-09-12T17:59:43.020450+0000","last_unstale":"2024-09-12T18:55:17.791801+0000","last_undegraded":"2024-09-12T18:55:17.791801+0000","last_fullsized":"2024-09-12T18:55:17.791801+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:53.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'7","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.864604+0000","last_change":"2024-09-12T17:59:38.983301+0000","last_active":"2024-09-12T18:59:59.864604+0000","last_peered":"2024-09-12T18:59:59.864604+0000","last_clean":"2024-09-12T18:59:59.864604+0000","last_became_active":"2024-09-12T17:59:38.982556+0000","last_became_peered":"2024-09-12T17:59:38.982556+0000","last_unstale":"2024-09-12T18:59:59.864604+0000","last_undegraded":"2024-09-12T18:59:59.864604+0000","last_fullsized":"2024-09-12T18:59:59.864604+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:24.195379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'83","reported_seq":293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450356+0000","last_change":"2024-09-12T17:55:59.364021+0000","last_active":"2024-09-12T18:56:57.450356+0000","last_peered":"2024-09-12T18:56:57.450356+0000","last_clean":"2024-09-12T18:56:57.450356+0000","last_became_active":"2024-09-12T17:55:59.363431+0000","last_became_peered":"2024-09-12T17:55:59.363431+0000","last_unstale":"2024-09-12T18:56:57.450356+0000","last_undegraded":"2024-09-12T18:56:57.450356+0000","last_fullsized":"2024-09-12T18:56:57.450356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.240236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":321,"num_write":127,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439374+0000","last_change":"2024-09-12T18:19:57.836599+0000","last_active":"2024-09-12T18:56:12.439374+0000","last_peered":"2024-09-12T18:56:12.439374+0000","last_clean":"2024-09-12T18:56:12.439374+0000","last_became_active":"2024-09-12T18:19:57.835852+0000","last_became_peered":"2024-09-12T18:19:57.835852+0000","last_unstale":"2024-09-12T18:56:12.439374+0000","last_undegraded":"2024-09-12T18:56:12.439374+0000","last_fullsized":"2024-09-12T18:56:12.439374+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:03.387557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.471115+0000","last_change":"2024-09-12T17:59:43.024923+0000","last_active":"2024-09-12T18:58:02.471115+0000","last_peered":"2024-09-12T18:58:02.471115+0000","last_clean":"2024-09-12T18:58:02.471115+0000","last_became_active":"2024-09-12T17:59:43.024103+0000","last_became_peered":"2024-09-12T17:59:43.024103+0000","last_unstale":"2024-09-12T18:58:02.471115+0000","last_undegraded":"2024-09-12T18:58:02.471115+0000","last_fullsized":"2024-09-12T18:58:02.471115+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:49.895418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'3","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.828280+0000","last_change":"2024-09-12T17:59:38.978753+0000","last_active":"2024-09-12T18:58:02.828280+0000","last_peered":"2024-09-12T18:58:02.828280+0000","last_clean":"2024-09-12T18:58:02.828280+0000","last_became_active":"2024-09-12T17:59:38.978126+0000","last_became_peered":"2024-09-12T17:59:38.978126+0000","last_unstale":"2024-09-12T18:58:02.828280+0000","last_undegraded":"2024-09-12T18:58:02.828280+0000","last_fullsized":"2024-09-12T18:58:02.828280+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:24.186587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'82","reported_seq":334,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446848+0000","last_change":"2024-09-12T17:55:59.364464+0000","last_active":"2024-09-12T18:56:42.446848+0000","last_peered":"2024-09-12T18:56:42.446848+0000","last_clean":"2024-09-12T18:56:42.446848+0000","last_became_active":"2024-09-12T17:55:59.363574+0000","last_became_peered":"2024-09-12T17:55:59.363574+0000","last_unstale":"2024-09-12T18:56:42.446848+0000","last_undegraded":"2024-09-12T18:56:42.446848+0000","last_fullsized":"2024-09-12T18:56:42.446848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:45.008706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":530,"num_read_kb":371,"num_write":118,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456819+0000","last_change":"2024-09-12T18:19:57.847909+0000","last_active":"2024-09-12T18:56:12.456819+0000","last_peered":"2024-09-12T18:56:12.456819+0000","last_clean":"2024-09-12T18:56:12.456819+0000","last_became_active":"2024-09-12T18:19:57.847092+0000","last_became_peered":"2024-09-12T18:19:57.847092+0000","last_unstale":"2024-09-12T18:56:12.456819+0000","last_undegraded":"2024-09-12T18:56:12.456819+0000","last_fullsized":"2024-09-12T18:56:12.456819+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:58.160509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.441383+0000","last_change":"2024-09-12T17:59:43.034884+0000","last_active":"2024-09-12T18:55:42.441383+0000","last_peered":"2024-09-12T18:55:42.441383+0000","last_clean":"2024-09-12T18:55:42.441383+0000","last_became_active":"2024-09-12T17:59:43.034180+0000","last_became_peered":"2024-09-12T17:59:43.034180+0000","last_unstale":"2024-09-12T18:55:42.441383+0000","last_undegraded":"2024-09-12T18:55:42.441383+0000","last_fullsized":"2024-09-12T18:55:42.441383+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:28.291989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.465696+0000","last_change":"2024-09-12T17:59:38.976298+0000","last_active":"2024-09-12T18:58:02.465696+0000","last_peered":"2024-09-12T18:58:02.465696+0000","last_clean":"2024-09-12T18:58:02.465696+0000","last_became_active":"2024-09-12T17:59:38.969338+0000","last_became_peered":"2024-09-12T17:59:38.969338+0000","last_unstale":"2024-09-12T18:58:02.465696+0000","last_undegraded":"2024-09-12T18:58:02.465696+0000","last_fullsized":"2024-09-12T18:58:02.465696+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:06.102519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'36","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463141+0000","last_change":"2024-09-12T17:55:59.357946+0000","last_active":"2024-09-12T18:56:42.463141+0000","last_peered":"2024-09-12T18:56:42.463141+0000","last_clean":"2024-09-12T18:56:42.463141+0000","last_became_active":"2024-09-12T17:55:59.357330+0000","last_became_peered":"2024-09-12T17:55:59.357330+0000","last_unstale":"2024-09-12T18:56:42.463141+0000","last_undegraded":"2024-09-12T18:56:42.463141+0000","last_fullsized":"2024-09-12T18:56:42.463141+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.691647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":130,"num_write":63,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473367+0000","last_change":"2024-09-12T18:19:57.840998+0000","last_active":"2024-09-12T18:57:27.473367+0000","last_peered":"2024-09-12T18:57:27.473367+0000","last_clean":"2024-09-12T18:57:27.473367+0000","last_became_active":"2024-09-12T18:19:57.839696+0000","last_became_peered":"2024-09-12T18:19:57.839696+0000","last_unstale":"2024-09-12T18:57:27.473367+0000","last_undegraded":"2024-09-12T18:57:27.473367+0000","last_fullsized":"2024-09-12T18:57:27.473367+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:36.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.809700+0000","last_change":"2024-09-12T17:59:43.031197+0000","last_active":"2024-09-12T18:59:58.809700+0000","last_peered":"2024-09-12T18:59:58.809700+0000","last_clean":"2024-09-12T18:59:58.809700+0000","last_became_active":"2024-09-12T17:59:43.030490+0000","last_became_peered":"2024-09-12T17:59:43.030490+0000","last_unstale":"2024-09-12T18:59:58.809700+0000","last_undegraded":"2024-09-12T18:59:58.809700+0000","last_fullsized":"2024-09-12T18:59:58.809700+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:07.847587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16955,"num_write":6,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"261'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421218+0000","last_change":"2024-09-12T17:59:38.990771+0000","last_active":"2024-09-12T18:55:42.421218+0000","last_peered":"2024-09-12T18:55:42.421218+0000","last_clean":"2024-09-12T18:55:42.421218+0000","last_became_active":"2024-09-12T17:59:38.990212+0000","last_became_peered":"2024-09-12T17:59:38.990212+0000","last_unstale":"2024-09-12T18:55:42.421218+0000","last_undegraded":"2024-09-12T18:55:42.421218+0000","last_fullsized":"2024-09-12T18:55:42.421218+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:13.467525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'28","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.810172+0000","last_change":"2024-09-12T17:55:59.357645+0000","last_active":"2024-09-12T18:56:42.810172+0000","last_peered":"2024-09-12T18:56:42.810172+0000","last_clean":"2024-09-12T18:56:42.810172+0000","last_became_active":"2024-09-12T17:55:59.356838+0000","last_became_peered":"2024-09-12T17:55:59.356838+0000","last_unstale":"2024-09-12T18:56:42.810172+0000","last_undegraded":"2024-09-12T18:56:42.810172+0000","last_fullsized":"2024-09-12T18:56:42.810172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:09.388925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":96,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439310+0000","last_change":"2024-09-12T18:19:57.837873+0000","last_active":"2024-09-12T18:56:12.439310+0000","last_peered":"2024-09-12T18:56:12.439310+0000","last_clean":"2024-09-12T18:56:12.439310+0000","last_became_active":"2024-09-12T18:19:57.837079+0000","last_became_peered":"2024-09-12T18:19:57.837079+0000","last_unstale":"2024-09-12T18:56:12.439310+0000","last_undegraded":"2024-09-12T18:56:12.439310+0000","last_fullsized":"2024-09-12T18:56:12.439310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:28.254760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421187+0000","last_change":"2024-09-12T17:59:43.033009+0000","last_active":"2024-09-12T18:55:42.421187+0000","last_peered":"2024-09-12T18:55:42.421187+0000","last_clean":"2024-09-12T18:55:42.421187+0000","last_became_active":"2024-09-12T17:59:43.032008+0000","last_became_peered":"2024-09-12T17:59:43.032008+0000","last_unstale":"2024-09-12T18:55:42.421187+0000","last_undegraded":"2024-09-12T18:55:42.421187+0000","last_fullsized":"2024-09-12T18:55:42.421187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:48.490537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'5","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.658471+0000","last_change":"2024-09-12T17:59:38.982851+0000","last_active":"2024-09-12T18:58:02.658471+0000","last_peered":"2024-09-12T18:58:02.658471+0000","last_clean":"2024-09-12T18:58:02.658471+0000","last_became_active":"2024-09-12T17:59:38.982037+0000","last_became_peered":"2024-09-12T17:59:38.982037+0000","last_unstale":"2024-09-12T18:58:02.658471+0000","last_undegraded":"2024-09-12T18:58:02.658471+0000","last_fullsized":"2024-09-12T18:58:02.658471+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:27.861115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446599+0000","last_change":"2024-09-12T17:55:59.358325+0000","last_active":"2024-09-12T18:56:42.446599+0000","last_peered":"2024-09-12T18:56:42.446599+0000","last_clean":"2024-09-12T18:56:42.446599+0000","last_became_active":"2024-09-12T17:55:59.357659+0000","last_became_peered":"2024-09-12T17:55:59.357659+0000","last_unstale":"2024-09-12T18:56:42.446599+0000","last_undegraded":"2024-09-12T18:56:42.446599+0000","last_fullsized":"2024-09-12T18:56:42.446599+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:47.942214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":69,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:59.444670+0000","last_change":"2024-09-12T18:19:57.850425+0000","last_active":"2024-09-12T18:56:59.444670+0000","last_peered":"2024-09-12T18:56:59.444670+0000","last_clean":"2024-09-12T18:56:59.444670+0000","last_became_active":"2024-09-12T18:19:57.849682+0000","last_became_peered":"2024-09-12T18:19:57.849682+0000","last_unstale":"2024-09-12T18:56:59.444670+0000","last_undegraded":"2024-09-12T18:56:59.444670+0000","last_fullsized":"2024-09-12T18:56:59.444670+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:20.403776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468396+0000","last_change":"2024-09-12T17:59:43.027722+0000","last_active":"2024-09-12T18:58:12.468396+0000","last_peered":"2024-09-12T18:58:12.468396+0000","last_clean":"2024-09-12T18:58:12.468396+0000","last_became_active":"2024-09-12T17:59:43.026619+0000","last_became_peered":"2024-09-12T17:59:43.026619+0000","last_unstale":"2024-09-12T18:58:12.468396+0000","last_undegraded":"2024-09-12T18:58:12.468396+0000","last_fullsized":"2024-09-12T18:58:12.468396+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:14.706171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468440+0000","last_change":"2024-09-12T17:59:38.988617+0000","last_active":"2024-09-12T18:58:12.468440+0000","last_peered":"2024-09-12T18:58:12.468440+0000","last_clean":"2024-09-12T18:58:12.468440+0000","last_became_active":"2024-09-12T17:59:38.988028+0000","last_became_peered":"2024-09-12T17:59:38.988028+0000","last_unstale":"2024-09-12T18:58:12.468440+0000","last_undegraded":"2024-09-12T18:58:12.468440+0000","last_fullsized":"2024-09-12T18:58:12.468440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:44.387070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'56","reported_seq":214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.453486+0000","last_change":"2024-09-12T17:55:59.361430+0000","last_active":"2024-09-12T18:57:07.453486+0000","last_peered":"2024-09-12T18:57:07.453486+0000","last_clean":"2024-09-12T18:57:07.453486+0000","last_became_active":"2024-09-12T17:55:59.360197+0000","last_became_peered":"2024-09-12T17:55:59.360197+0000","last_unstale":"2024-09-12T18:57:07.453486+0000","last_undegraded":"2024-09-12T18:57:07.453486+0000","last_fullsized":"2024-09-12T18:57:07.453486+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:56.611826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":199,"num_write":102,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436067+0000","last_change":"2024-09-12T18:19:57.869950+0000","last_active":"2024-09-12T18:55:57.436067+0000","last_peered":"2024-09-12T18:55:57.436067+0000","last_clean":"2024-09-12T18:55:57.436067+0000","last_became_active":"2024-09-12T18:19:57.869302+0000","last_became_peered":"2024-09-12T18:19:57.869302+0000","last_unstale":"2024-09-12T18:55:57.436067+0000","last_undegraded":"2024-09-12T18:55:57.436067+0000","last_fullsized":"2024-09-12T18:55:57.436067+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:38.615499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468287+0000","last_change":"2024-09-12T17:59:43.034683+0000","last_active":"2024-09-12T18:58:12.468287+0000","last_peered":"2024-09-12T18:58:12.468287+0000","last_clean":"2024-09-12T18:58:12.468287+0000","last_became_active":"2024-09-12T17:59:43.030846+0000","last_became_peered":"2024-09-12T17:59:43.030846+0000","last_unstale":"2024-09-12T18:58:12.468287+0000","last_undegraded":"2024-09-12T18:58:12.468287+0000","last_fullsized":"2024-09-12T18:58:12.468287+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:40.165184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'6","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:09.459689+0000","last_change":"2024-09-12T17:59:38.969547+0000","last_active":"2024-09-12T18:58:09.459689+0000","last_peered":"2024-09-12T18:58:09.459689+0000","last_clean":"2024-09-12T18:58:09.459689+0000","last_became_active":"2024-09-12T17:59:38.968775+0000","last_became_peered":"2024-09-12T17:59:38.968775+0000","last_unstale":"2024-09-12T18:58:09.459689+0000","last_undegraded":"2024-09-12T18:58:09.459689+0000","last_fullsized":"2024-09-12T18:58:09.459689+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:07.669336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":6,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.630374+0000","last_change":"2024-09-12T17:55:59.362984+0000","last_active":"2024-09-12T18:56:47.630374+0000","last_peered":"2024-09-12T18:56:47.630374+0000","last_clean":"2024-09-12T18:56:47.630374+0000","last_became_active":"2024-09-12T17:55:59.358747+0000","last_became_peered":"2024-09-12T17:55:59.358747+0000","last_unstale":"2024-09-12T18:56:47.630374+0000","last_undegraded":"2024-09-12T18:56:47.630374+0000","last_fullsized":"2024-09-12T18:56:47.630374+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:28.675045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.434729+0000","last_change":"2024-09-12T18:19:57.823688+0000","last_active":"2024-09-12T18:56:47.434729+0000","last_peered":"2024-09-12T18:56:47.434729+0000","last_clean":"2024-09-12T18:56:47.434729+0000","last_became_active":"2024-09-12T18:19:57.822958+0000","last_became_peered":"2024-09-12T18:19:57.822958+0000","last_unstale":"2024-09-12T18:56:47.434729+0000","last_undegraded":"2024-09-12T18:56:47.434729+0000","last_fullsized":"2024-09-12T18:56:47.434729+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:54.471704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:27.476553+0000","last_change":"2024-09-12T17:59:43.007833+0000","last_active":"2024-09-12T18:58:27.476553+0000","last_peered":"2024-09-12T18:58:27.476553+0000","last_clean":"2024-09-12T18:58:27.476553+0000","last_became_active":"2024-09-12T17:59:43.006748+0000","last_became_peered":"2024-09-12T17:59:43.006748+0000","last_unstale":"2024-09-12T18:58:27.476553+0000","last_undegraded":"2024-09-12T18:58:27.476553+0000","last_fullsized":"2024-09-12T18:58:27.476553+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:10.151387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.483589+0000","last_change":"2024-09-12T17:59:38.963724+0000","last_active":"2024-09-12T18:58:12.483589+0000","last_peered":"2024-09-12T18:58:12.483589+0000","last_clean":"2024-09-12T18:58:12.483589+0000","last_became_active":"2024-09-12T17:59:38.962944+0000","last_became_peered":"2024-09-12T17:59:38.962944+0000","last_unstale":"2024-09-12T18:58:12.483589+0000","last_undegraded":"2024-09-12T18:58:12.483589+0000","last_fullsized":"2024-09-12T18:58:12.483589+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:57.731165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'30","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.434839+0000","last_change":"2024-09-12T17:55:59.347093+0000","last_active":"2024-09-12T18:56:47.434839+0000","last_peered":"2024-09-12T18:56:47.434839+0000","last_clean":"2024-09-12T18:56:47.434839+0000","last_became_active":"2024-09-12T17:55:59.345735+0000","last_became_peered":"2024-09-12T17:55:59.345735+0000","last_unstale":"2024-09-12T18:56:47.434839+0000","last_undegraded":"2024-09-12T18:56:47.434839+0000","last_fullsized":"2024-09-12T18:56:47.434839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:02.647291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.447954+0000","last_change":"2024-09-12T18:19:57.856472+0000","last_active":"2024-09-12T18:56:47.447954+0000","last_peered":"2024-09-12T18:56:47.447954+0000","last_clean":"2024-09-12T18:56:47.447954+0000","last_became_active":"2024-09-12T18:19:57.855728+0000","last_became_peered":"2024-09-12T18:19:57.855728+0000","last_unstale":"2024-09-12T18:56:47.447954+0000","last_undegraded":"2024-09-12T18:56:47.447954+0000","last_fullsized":"2024-09-12T18:56:47.447954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:06.104974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468483+0000","last_change":"2024-09-12T17:59:43.020154+0000","last_active":"2024-09-12T18:58:12.468483+0000","last_peered":"2024-09-12T18:58:12.468483+0000","last_clean":"2024-09-12T18:58:12.468483+0000","last_became_active":"2024-09-12T17:59:43.019325+0000","last_became_peered":"2024-09-12T17:59:43.019325+0000","last_unstale":"2024-09-12T18:58:12.468483+0000","last_undegraded":"2024-09-12T18:58:12.468483+0000","last_fullsized":"2024-09-12T18:58:12.468483+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.764700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447641+0000","last_change":"2024-09-12T17:59:38.978392+0000","last_active":"2024-09-12T18:56:12.447641+0000","last_peered":"2024-09-12T18:56:12.447641+0000","last_clean":"2024-09-12T18:56:12.447641+0000","last_became_active":"2024-09-12T17:59:38.977733+0000","last_became_peered":"2024-09-12T17:59:38.977733+0000","last_unstale":"2024-09-12T18:56:12.447641+0000","last_undegraded":"2024-09-12T18:56:12.447641+0000","last_fullsized":"2024-09-12T18:56:12.447641+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:10.294635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'50","reported_seq":197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:44.441874+0000","last_change":"2024-09-12T17:55:59.341871+0000","last_active":"2024-09-12T18:56:44.441874+0000","last_peered":"2024-09-12T18:56:44.441874+0000","last_clean":"2024-09-12T18:56:44.441874+0000","last_became_active":"2024-09-12T17:55:59.341145+0000","last_became_peered":"2024-09-12T17:55:59.341145+0000","last_unstale":"2024-09-12T18:56:44.441874+0000","last_undegraded":"2024-09-12T18:56:44.441874+0000","last_fullsized":"2024-09-12T18:56:44.441874+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:36.782820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":177,"num_write":99,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436472+0000","last_change":"2024-09-12T18:19:57.865840+0000","last_active":"2024-09-12T18:55:57.436472+0000","last_peered":"2024-09-12T18:55:57.436472+0000","last_clean":"2024-09-12T18:55:57.436472+0000","last_became_active":"2024-09-12T18:19:57.865311+0000","last_became_peered":"2024-09-12T18:19:57.865311+0000","last_unstale":"2024-09-12T18:55:57.436472+0000","last_undegraded":"2024-09-12T18:55:57.436472+0000","last_fullsized":"2024-09-12T18:55:57.436472+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:05.947872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'8","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.830550+0000","last_change":"2024-09-12T17:59:43.030010+0000","last_active":"2024-09-12T18:58:12.830550+0000","last_peered":"2024-09-12T18:58:12.830550+0000","last_clean":"2024-09-12T18:58:12.830550+0000","last_became_active":"2024-09-12T17:59:43.029489+0000","last_became_peered":"2024-09-12T17:59:43.029489+0000","last_unstale":"2024-09-12T18:58:12.830550+0000","last_undegraded":"2024-09-12T18:58:12.830550+0000","last_fullsized":"2024-09-12T18:58:12.830550+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:49.435494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'3","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.483373+0000","last_change":"2024-09-12T17:59:38.976141+0000","last_active":"2024-09-12T18:58:12.483373+0000","last_peered":"2024-09-12T18:58:12.483373+0000","last_clean":"2024-09-12T18:58:12.483373+0000","last_became_active":"2024-09-12T17:59:38.965185+0000","last_became_peered":"2024-09-12T17:59:38.965185+0000","last_unstale":"2024-09-12T18:58:12.483373+0000","last_undegraded":"2024-09-12T18:58:12.483373+0000","last_fullsized":"2024-09-12T18:58:12.483373+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:28.251671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'20","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464249+0000","last_change":"2024-09-12T17:55:59.360413+0000","last_active":"2024-09-12T18:56:47.464249+0000","last_peered":"2024-09-12T18:56:47.464249+0000","last_clean":"2024-09-12T18:56:47.464249+0000","last_became_active":"2024-09-12T17:55:59.359849+0000","last_became_peered":"2024-09-12T17:55:59.359849+0000","last_unstale":"2024-09-12T18:56:47.464249+0000","last_undegraded":"2024-09-12T18:56:47.464249+0000","last_fullsized":"2024-09-12T18:56:47.464249+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:05.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:07.438710+0000","last_change":"2024-09-12T18:19:57.855820+0000","last_active":"2024-09-12T18:56:07.438710+0000","last_peered":"2024-09-12T18:56:07.438710+0000","last_clean":"2024-09-12T18:56:07.438710+0000","last_became_active":"2024-09-12T18:19:57.855140+0000","last_became_peered":"2024-09-12T18:19:57.855140+0000","last_unstale":"2024-09-12T18:56:07.438710+0000","last_undegraded":"2024-09-12T18:56:07.438710+0000","last_fullsized":"2024-09-12T18:56:07.438710+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:19.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437282+0000","last_change":"2024-09-12T17:59:43.016545+0000","last_active":"2024-09-12T18:56:02.437282+0000","last_peered":"2024-09-12T18:56:02.437282+0000","last_clean":"2024-09-12T18:56:02.437282+0000","last_became_active":"2024-09-12T17:59:43.015273+0000","last_became_peered":"2024-09-12T17:59:43.015273+0000","last_unstale":"2024-09-12T18:56:02.437282+0000","last_undegraded":"2024-09-12T18:56:02.437282+0000","last_fullsized":"2024-09-12T18:56:02.437282+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:00.852160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'11","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.937698+0000","last_change":"2024-09-12T17:59:38.985394+0000","last_active":"2024-09-12T18:59:59.937698+0000","last_peered":"2024-09-12T18:59:59.937698+0000","last_clean":"2024-09-12T18:59:59.937698+0000","last_became_active":"2024-09-12T17:59:38.984684+0000","last_became_peered":"2024-09-12T17:59:38.984684+0000","last_unstale":"2024-09-12T18:59:59.937698+0000","last_undegraded":"2024-09-12T18:59:59.937698+0000","last_fullsized":"2024-09-12T18:59:59.937698+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:33.698538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6144,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'48","reported_seq":197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450249+0000","last_change":"2024-09-12T17:55:59.346860+0000","last_active":"2024-09-12T18:56:57.450249+0000","last_peered":"2024-09-12T18:56:57.450249+0000","last_clean":"2024-09-12T18:56:57.450249+0000","last_became_active":"2024-09-12T17:55:59.346128+0000","last_became_peered":"2024-09-12T17:55:59.346128+0000","last_unstale":"2024-09-12T18:56:57.450249+0000","last_undegraded":"2024-09-12T18:56:57.450249+0000","last_fullsized":"2024-09-12T18:56:57.450249+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:20.618591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":194,"num_write":71,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436169+0000","last_change":"2024-09-12T18:19:57.851475+0000","last_active":"2024-09-12T18:55:57.436169+0000","last_peered":"2024-09-12T18:55:57.436169+0000","last_clean":"2024-09-12T18:55:57.436169+0000","last_became_active":"2024-09-12T18:19:57.848892+0000","last_became_peered":"2024-09-12T18:19:57.848892+0000","last_unstale":"2024-09-12T18:55:57.436169+0000","last_undegraded":"2024-09-12T18:55:57.436169+0000","last_fullsized":"2024-09-12T18:55:57.436169+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:29.052912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.473096+0000","last_change":"2024-09-12T17:59:43.038219+0000","last_active":"2024-09-12T18:58:12.473096+0000","last_peered":"2024-09-12T18:58:12.473096+0000","last_clean":"2024-09-12T18:58:12.473096+0000","last_became_active":"2024-09-12T17:59:43.034558+0000","last_became_peered":"2024-09-12T17:59:43.034558+0000","last_unstale":"2024-09-12T18:58:12.473096+0000","last_undegraded":"2024-09-12T18:58:12.473096+0000","last_fullsized":"2024-09-12T18:58:12.473096+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:16.222044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:27.487022+0000","last_change":"2024-09-12T17:59:38.981757+0000","last_active":"2024-09-12T18:58:27.487022+0000","last_peered":"2024-09-12T18:58:27.487022+0000","last_clean":"2024-09-12T18:58:27.487022+0000","last_became_active":"2024-09-12T17:59:38.973403+0000","last_became_peered":"2024-09-12T17:59:38.973403+0000","last_unstale":"2024-09-12T18:58:27.487022+0000","last_undegraded":"2024-09-12T18:58:27.487022+0000","last_fullsized":"2024-09-12T18:58:27.487022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:16.251811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'38","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446643+0000","last_change":"2024-09-12T17:55:59.346585+0000","last_active":"2024-09-12T18:56:42.446643+0000","last_peered":"2024-09-12T18:56:42.446643+0000","last_clean":"2024-09-12T18:56:42.446643+0000","last_became_active":"2024-09-12T17:55:59.345382+0000","last_became_peered":"2024-09-12T17:55:59.345382+0000","last_unstale":"2024-09-12T18:56:42.446643+0000","last_undegraded":"2024-09-12T18:56:42.446643+0000","last_fullsized":"2024-09-12T18:56:42.446643+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:18.100800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":134,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453836+0000","last_change":"2024-09-12T18:19:57.844298+0000","last_active":"2024-09-12T18:55:57.453836+0000","last_peered":"2024-09-12T18:55:57.453836+0000","last_clean":"2024-09-12T18:55:57.453836+0000","last_became_active":"2024-09-12T18:19:57.843489+0000","last_became_peered":"2024-09-12T18:19:57.843489+0000","last_unstale":"2024-09-12T18:55:57.453836+0000","last_undegraded":"2024-09-12T18:55:57.453836+0000","last_fullsized":"2024-09-12T18:55:57.453836+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:30.667507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.440945+0000","last_change":"2024-09-12T17:59:43.023323+0000","last_active":"2024-09-12T18:56:17.440945+0000","last_peered":"2024-09-12T18:56:17.440945+0000","last_clean":"2024-09-12T18:56:17.440945+0000","last_became_active":"2024-09-12T17:59:43.022592+0000","last_became_peered":"2024-09-12T17:59:43.022592+0000","last_unstale":"2024-09-12T18:56:17.440945+0000","last_undegraded":"2024-09-12T18:56:17.440945+0000","last_fullsized":"2024-09-12T18:56:17.440945+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:49.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'3","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800656+0000","last_change":"2024-09-12T17:59:38.976388+0000","last_active":"2024-09-12T18:55:57.800656+0000","last_peered":"2024-09-12T18:55:57.800656+0000","last_clean":"2024-09-12T18:55:57.800656+0000","last_became_active":"2024-09-12T17:59:38.975635+0000","last_became_peered":"2024-09-12T17:59:38.975635+0000","last_unstale":"2024-09-12T18:55:57.800656+0000","last_undegraded":"2024-09-12T18:55:57.800656+0000","last_fullsized":"2024-09-12T18:55:57.800656+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:08.497281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'44","reported_seq":180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433653+0000","last_change":"2024-09-12T17:55:59.352208+0000","last_active":"2024-09-12T18:56:42.433653+0000","last_peered":"2024-09-12T18:56:42.433653+0000","last_clean":"2024-09-12T18:56:42.433653+0000","last_became_active":"2024-09-12T17:55:59.351492+0000","last_became_peered":"2024-09-12T17:55:59.351492+0000","last_unstale":"2024-09-12T18:56:42.433653+0000","last_undegraded":"2024-09-12T18:56:42.433653+0000","last_fullsized":"2024-09-12T18:56:42.433653+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:59.997737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":151,"num_write":82,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457255+0000","last_change":"2024-09-12T18:19:57.856229+0000","last_active":"2024-09-12T18:57:27.457255+0000","last_peered":"2024-09-12T18:57:27.457255+0000","last_clean":"2024-09-12T18:57:27.457255+0000","last_became_active":"2024-09-12T18:19:57.855547+0000","last_became_peered":"2024-09-12T18:19:57.855547+0000","last_unstale":"2024-09-12T18:57:27.457255+0000","last_undegraded":"2024-09-12T18:57:27.457255+0000","last_fullsized":"2024-09-12T18:57:27.457255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:07.356723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'12","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.440131+0000","last_change":"2024-09-12T17:59:43.010558+0000","last_active":"2024-09-12T18:59:59.440131+0000","last_peered":"2024-09-12T18:59:59.440131+0000","last_clean":"2024-09-12T18:59:59.440131+0000","last_became_active":"2024-09-12T17:59:43.009629+0000","last_became_peered":"2024-09-12T17:59:43.009629+0000","last_unstale":"2024-09-12T18:59:59.440131+0000","last_undegraded":"2024-09-12T18:59:59.440131+0000","last_fullsized":"2024-09-12T18:59:59.440131+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:57.722700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":22,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'3","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.466085+0000","last_change":"2024-09-12T17:59:38.980397+0000","last_active":"2024-09-12T18:58:02.466085+0000","last_peered":"2024-09-12T18:58:02.466085+0000","last_clean":"2024-09-12T18:58:02.466085+0000","last_became_active":"2024-09-12T17:59:38.979704+0000","last_became_peered":"2024-09-12T17:59:38.979704+0000","last_unstale":"2024-09-12T18:58:02.466085+0000","last_undegraded":"2024-09-12T18:58:02.466085+0000","last_fullsized":"2024-09-12T18:58:02.466085+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:15.520490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463327+0000","last_change":"2024-09-12T17:55:59.357098+0000","last_active":"2024-09-12T18:56:42.463327+0000","last_peered":"2024-09-12T18:56:42.463327+0000","last_clean":"2024-09-12T18:56:42.463327+0000","last_became_active":"2024-09-12T17:55:59.356402+0000","last_became_peered":"2024-09-12T17:55:59.356402+0000","last_unstale":"2024-09-12T18:56:42.463327+0000","last_undegraded":"2024-09-12T18:56:42.463327+0000","last_fullsized":"2024-09-12T18:56:42.463327+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:21.680579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639954+0000","last_change":"2024-09-12T18:19:57.860245+0000","last_active":"2024-09-12T18:57:27.639954+0000","last_peered":"2024-09-12T18:57:27.639954+0000","last_clean":"2024-09-12T18:57:27.639954+0000","last_became_active":"2024-09-12T18:19:57.859591+0000","last_became_peered":"2024-09-12T18:19:57.859591+0000","last_unstale":"2024-09-12T18:57:27.639954+0000","last_undegraded":"2024-09-12T18:57:27.639954+0000","last_fullsized":"2024-09-12T18:57:27.639954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:28.131141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453794+0000","last_change":"2024-09-12T17:59:43.009259+0000","last_active":"2024-09-12T18:55:57.453794+0000","last_peered":"2024-09-12T18:55:57.453794+0000","last_clean":"2024-09-12T18:55:57.453794+0000","last_became_active":"2024-09-12T17:59:43.008547+0000","last_became_peered":"2024-09-12T17:59:43.008547+0000","last_unstale":"2024-09-12T18:55:57.453794+0000","last_undegraded":"2024-09-12T18:55:57.453794+0000","last_fullsized":"2024-09-12T18:55:57.453794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:53.908690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:09.435251+0000","last_change":"2024-09-12T17:59:38.969392+0000","last_active":"2024-09-12T18:56:09.435251+0000","last_peered":"2024-09-12T18:56:09.435251+0000","last_clean":"2024-09-12T18:56:09.435251+0000","last_became_active":"2024-09-12T17:59:38.968249+0000","last_became_peered":"2024-09-12T17:59:38.968249+0000","last_unstale":"2024-09-12T18:56:09.435251+0000","last_undegraded":"2024-09-12T18:56:09.435251+0000","last_fullsized":"2024-09-12T18:56:09.435251+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.740724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'17","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433857+0000","last_change":"2024-09-12T17:55:59.355112+0000","last_active":"2024-09-12T18:56:42.433857+0000","last_peered":"2024-09-12T18:56:42.433857+0000","last_clean":"2024-09-12T18:56:42.433857+0000","last_became_active":"2024-09-12T17:55:59.354383+0000","last_became_peered":"2024-09-12T17:55:59.354383+0000","last_unstale":"2024-09-12T18:56:42.433857+0000","last_undegraded":"2024-09-12T18:56:42.433857+0000","last_fullsized":"2024-09-12T18:56:42.433857+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:12.015628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:07.446185+0000","last_change":"2024-09-12T18:19:57.864592+0000","last_active":"2024-09-12T18:56:07.446185+0000","last_peered":"2024-09-12T18:56:07.446185+0000","last_clean":"2024-09-12T18:56:07.446185+0000","last_became_active":"2024-09-12T18:19:57.858987+0000","last_became_peered":"2024-09-12T18:19:57.858987+0000","last_unstale":"2024-09-12T18:56:07.446185+0000","last_undegraded":"2024-09-12T18:56:07.446185+0000","last_fullsized":"2024-09-12T18:56:07.446185+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:30.509797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'10","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.127392+0000","last_change":"2024-09-12T17:59:43.023426+0000","last_active":"2024-09-12T18:59:59.127392+0000","last_peered":"2024-09-12T18:59:59.127392+0000","last_clean":"2024-09-12T18:59:59.127392+0000","last_became_active":"2024-09-12T17:59:43.022405+0000","last_became_peered":"2024-09-12T17:59:43.022405+0000","last_unstale":"2024-09-12T18:59:59.127392+0000","last_undegraded":"2024-09-12T18:59:59.127392+0000","last_fullsized":"2024-09-12T18:59:59.127392+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:15.217520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12356,"num_write":10,"num_write_kb":8260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.660699+0000","last_change":"2024-09-12T17:59:38.966348+0000","last_active":"2024-09-12T18:58:12.660699+0000","last_peered":"2024-09-12T18:58:12.660699+0000","last_clean":"2024-09-12T18:58:12.660699+0000","last_became_active":"2024-09-12T17:59:38.964439+0000","last_became_peered":"2024-09-12T17:59:38.964439+0000","last_unstale":"2024-09-12T18:58:12.660699+0000","last_undegraded":"2024-09-12T18:58:12.660699+0000","last_fullsized":"2024-09-12T18:58:12.660699+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:16.500555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'113","reported_seq":414,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446927+0000","last_change":"2024-09-12T17:55:59.361437+0000","last_active":"2024-09-12T18:56:42.446927+0000","last_peered":"2024-09-12T18:56:42.446927+0000","last_clean":"2024-09-12T18:56:42.446927+0000","last_became_active":"2024-09-12T17:55:59.360296+0000","last_became_peered":"2024-09-12T17:55:59.360296+0000","last_unstale":"2024-09-12T18:56:42.446927+0000","last_undegraded":"2024-09-12T18:56:42.446927+0000","last_fullsized":"2024-09-12T18:56:42.446927+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:54.893983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":493,"num_write":148,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.819989+0000","last_change":"2024-09-12T18:19:57.871333+0000","last_active":"2024-09-12T18:57:27.819989+0000","last_peered":"2024-09-12T18:57:27.819989+0000","last_clean":"2024-09-12T18:57:27.819989+0000","last_became_active":"2024-09-12T18:19:57.870563+0000","last_became_peered":"2024-09-12T18:19:57.870563+0000","last_unstale":"2024-09-12T18:57:27.819989+0000","last_undegraded":"2024-09-12T18:57:27.819989+0000","last_fullsized":"2024-09-12T18:57:27.819989+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:12.142130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.801846+0000","last_change":"2024-09-12T17:59:43.019692+0000","last_active":"2024-09-12T18:56:02.801846+0000","last_peered":"2024-09-12T18:56:02.801846+0000","last_clean":"2024-09-12T18:56:02.801846+0000","last_became_active":"2024-09-12T17:59:43.018869+0000","last_became_peered":"2024-09-12T17:59:43.018869+0000","last_unstale":"2024-09-12T18:56:02.801846+0000","last_undegraded":"2024-09-12T18:56:02.801846+0000","last_fullsized":"2024-09-12T18:56:02.801846+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:27.333833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468548+0000","last_change":"2024-09-12T17:59:38.989030+0000","last_active":"2024-09-12T18:58:12.468548+0000","last_peered":"2024-09-12T18:58:12.468548+0000","last_clean":"2024-09-12T18:58:12.468548+0000","last_became_active":"2024-09-12T17:59:38.988237+0000","last_became_peered":"2024-09-12T17:59:38.988237+0000","last_unstale":"2024-09-12T18:58:12.468548+0000","last_undegraded":"2024-09-12T18:58:12.468548+0000","last_fullsized":"2024-09-12T18:58:12.468548+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:13.770105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'6","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.450666+0000","last_change":"2024-09-12T17:55:59.354590+0000","last_active":"2024-09-12T18:56:27.450666+0000","last_peered":"2024-09-12T18:56:27.450666+0000","last_clean":"2024-09-12T18:56:27.450666+0000","last_became_active":"2024-09-12T17:55:59.353823+0000","last_became_peered":"2024-09-12T17:55:59.353823+0000","last_unstale":"2024-09-12T18:56:27.450666+0000","last_undegraded":"2024-09-12T18:56:27.450666+0000","last_fullsized":"2024-09-12T18:56:27.450666+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:54.453586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:49.442825+0000","last_change":"2024-09-12T18:19:57.840515+0000","last_active":"2024-09-12T18:56:49.442825+0000","last_peered":"2024-09-12T18:56:49.442825+0000","last_clean":"2024-09-12T18:56:49.442825+0000","last_became_active":"2024-09-12T18:19:57.839756+0000","last_became_peered":"2024-09-12T18:19:57.839756+0000","last_unstale":"2024-09-12T18:56:49.442825+0000","last_undegraded":"2024-09-12T18:56:49.442825+0000","last_fullsized":"2024-09-12T18:56:49.442825+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:01.658644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.444196+0000","last_change":"2024-09-12T17:59:43.038905+0000","last_active":"2024-09-12T18:55:57.444196+0000","last_peered":"2024-09-12T18:55:57.444196+0000","last_clean":"2024-09-12T18:55:57.444196+0000","last_became_active":"2024-09-12T17:59:43.033049+0000","last_became_peered":"2024-09-12T17:59:43.033049+0000","last_unstale":"2024-09-12T18:55:57.444196+0000","last_undegraded":"2024-09-12T18:55:57.444196+0000","last_fullsized":"2024-09-12T18:55:57.444196+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:33.443562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'9","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464697+0000","last_change":"2024-09-12T17:59:38.986578+0000","last_active":"2024-09-12T18:57:57.464697+0000","last_peered":"2024-09-12T18:57:57.464697+0000","last_clean":"2024-09-12T18:57:57.464697+0000","last_became_active":"2024-09-12T17:59:38.985971+0000","last_became_peered":"2024-09-12T17:59:38.985971+0000","last_unstale":"2024-09-12T18:57:57.464697+0000","last_undegraded":"2024-09-12T18:57:57.464697+0000","last_fullsized":"2024-09-12T18:57:57.464697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:41.717343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'13","reported_seq":101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.625796+0000","last_change":"2024-09-12T17:55:59.358658+0000","last_active":"2024-09-12T18:56:27.625796+0000","last_peered":"2024-09-12T18:56:27.625796+0000","last_clean":"2024-09-12T18:56:27.625796+0000","last_became_active":"2024-09-12T17:55:59.352474+0000","last_became_peered":"2024-09-12T17:55:59.352474+0000","last_unstale":"2024-09-12T18:56:27.625796+0000","last_undegraded":"2024-09-12T18:56:27.625796+0000","last_fullsized":"2024-09-12T18:56:27.625796+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:54.466534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464409+0000","last_change":"2024-09-12T18:19:57.847713+0000","last_active":"2024-09-12T18:56:47.464409+0000","last_peered":"2024-09-12T18:56:47.464409+0000","last_clean":"2024-09-12T18:56:47.464409+0000","last_became_active":"2024-09-12T18:19:57.846907+0000","last_became_peered":"2024-09-12T18:19:57.846907+0000","last_unstale":"2024-09-12T18:56:47.464409+0000","last_undegraded":"2024-09-12T18:56:47.464409+0000","last_fullsized":"2024-09-12T18:56:47.464409+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:30.600770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'12","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:52.683786+0000","last_change":"2024-09-12T17:59:43.023811+0000","last_active":"2024-09-12T18:59:52.683786+0000","last_peered":"2024-09-12T18:59:52.683786+0000","last_clean":"2024-09-12T18:59:52.683786+0000","last_became_active":"2024-09-12T17:59:43.022991+0000","last_became_peered":"2024-09-12T17:59:43.022991+0000","last_unstale":"2024-09-12T18:59:52.683786+0000","last_undegraded":"2024-09-12T18:59:52.683786+0000","last_fullsized":"2024-09-12T18:59:52.683786+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:41.803212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20482,"num_write":22,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.465964+0000","last_change":"2024-09-12T17:59:38.990278+0000","last_active":"2024-09-12T18:58:02.465964+0000","last_peered":"2024-09-12T18:58:02.465964+0000","last_clean":"2024-09-12T18:58:02.465964+0000","last_became_active":"2024-09-12T17:59:38.989530+0000","last_became_peered":"2024-09-12T17:59:38.989530+0000","last_unstale":"2024-09-12T18:58:02.465964+0000","last_undegraded":"2024-09-12T18:58:02.465964+0000","last_fullsized":"2024-09-12T18:58:02.465964+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:27.646889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'9","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.807160+0000","last_change":"2024-09-12T17:55:59.345043+0000","last_active":"2024-09-12T18:56:27.807160+0000","last_peered":"2024-09-12T18:56:27.807160+0000","last_clean":"2024-09-12T18:56:27.807160+0000","last_became_active":"2024-09-12T17:55:59.344251+0000","last_became_peered":"2024-09-12T17:55:59.344251+0000","last_unstale":"2024-09-12T18:56:27.807160+0000","last_undegraded":"2024-09-12T18:56:27.807160+0000","last_fullsized":"2024-09-12T18:56:27.807160+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:29.508189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473350+0000","last_change":"2024-09-12T18:19:57.848079+0000","last_active":"2024-09-12T18:57:27.473350+0000","last_peered":"2024-09-12T18:57:27.473350+0000","last_clean":"2024-09-12T18:57:27.473350+0000","last_became_active":"2024-09-12T18:19:57.847330+0000","last_became_peered":"2024-09-12T18:19:57.847330+0000","last_unstale":"2024-09-12T18:57:27.473350+0000","last_undegraded":"2024-09-12T18:57:27.473350+0000","last_fullsized":"2024-09-12T18:57:27.473350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:06.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.450480+0000","last_change":"2024-09-12T17:59:43.028989+0000","last_active":"2024-09-12T18:58:02.450480+0000","last_peered":"2024-09-12T18:58:02.450480+0000","last_clean":"2024-09-12T18:58:02.450480+0000","last_became_active":"2024-09-12T17:59:43.028305+0000","last_became_peered":"2024-09-12T17:59:43.028305+0000","last_unstale":"2024-09-12T18:58:02.450480+0000","last_undegraded":"2024-09-12T18:58:02.450480+0000","last_fullsized":"2024-09-12T18:58:02.450480+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:37.271016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.444237+0000","last_change":"2024-09-12T17:59:38.987789+0000","last_active":"2024-09-12T18:55:57.444237+0000","last_peered":"2024-09-12T18:55:57.444237+0000","last_clean":"2024-09-12T18:55:57.444237+0000","last_became_active":"2024-09-12T17:59:38.986062+0000","last_became_peered":"2024-09-12T17:59:38.986062+0000","last_unstale":"2024-09-12T18:55:57.444237+0000","last_undegraded":"2024-09-12T18:55:57.444237+0000","last_fullsized":"2024-09-12T18:55:57.444237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:17.162069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'31","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.430557+0000","last_change":"2024-09-12T17:55:59.346330+0000","last_active":"2024-09-12T18:56:27.430557+0000","last_peered":"2024-09-12T18:56:27.430557+0000","last_clean":"2024-09-12T18:56:27.430557+0000","last_became_active":"2024-09-12T17:55:59.345469+0000","last_became_peered":"2024-09-12T17:55:59.345469+0000","last_unstale":"2024-09-12T18:56:27.430557+0000","last_undegraded":"2024-09-12T18:56:27.430557+0000","last_fullsized":"2024-09-12T18:56:27.430557+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:40.512299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":47,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.459721+0000","last_change":"2024-09-12T18:19:57.845031+0000","last_active":"2024-09-12T18:57:37.459721+0000","last_peered":"2024-09-12T18:57:37.459721+0000","last_clean":"2024-09-12T18:57:37.459721+0000","last_became_active":"2024-09-12T18:19:57.844161+0000","last_became_peered":"2024-09-12T18:19:57.844161+0000","last_unstale":"2024-09-12T18:57:37.459721+0000","last_undegraded":"2024-09-12T18:57:37.459721+0000","last_fullsized":"2024-09-12T18:57:37.459721+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:42.398579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.828374+0000","last_change":"2024-09-12T17:59:43.020614+0000","last_active":"2024-09-12T18:58:02.828374+0000","last_peered":"2024-09-12T18:58:02.828374+0000","last_clean":"2024-09-12T18:58:02.828374+0000","last_became_active":"2024-09-12T17:59:43.019274+0000","last_became_peered":"2024-09-12T17:59:43.019274+0000","last_unstale":"2024-09-12T18:58:02.828374+0000","last_undegraded":"2024-09-12T18:58:02.828374+0000","last_fullsized":"2024-09-12T18:58:02.828374+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:20.608735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.485204+0000","last_change":"2024-09-12T17:59:38.969202+0000","last_active":"2024-09-12T18:59:59.485204+0000","last_peered":"2024-09-12T18:59:59.485204+0000","last_clean":"2024-09-12T18:59:59.485204+0000","last_became_active":"2024-09-12T17:59:38.968500+0000","last_became_peered":"2024-09-12T17:59:38.968500+0000","last_unstale":"2024-09-12T18:59:59.485204+0000","last_undegraded":"2024-09-12T18:59:59.485204+0000","last_fullsized":"2024-09-12T18:59:59.485204+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:19.956318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1072,"num_write":18,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.440783+0000","last_change":"2024-09-12T17:55:59.355326+0000","last_active":"2024-09-12T18:56:17.440783+0000","last_peered":"2024-09-12T18:56:17.440783+0000","last_clean":"2024-09-12T18:56:17.440783+0000","last_became_active":"2024-09-12T17:55:59.354620+0000","last_became_peered":"2024-09-12T17:55:59.354620+0000","last_unstale":"2024-09-12T18:56:17.440783+0000","last_undegraded":"2024-09-12T18:56:17.440783+0000","last_fullsized":"2024-09-12T18:56:17.440783+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:05.701171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":145,"num_write":78,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'387","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.068241+0000","last_change":"2024-09-12T17:40:18.786112+0000","last_active":"2024-09-12T19:00:00.068241+0000","last_peered":"2024-09-12T19:00:00.068241+0000","last_clean":"2024-09-12T19:00:00.068241+0000","last_became_active":"2024-09-12T17:40:18.784159+0000","last_became_peered":"2024-09-12T17:40:18.784159+0000","last_unstale":"2024-09-12T19:00:00.068241+0000","last_undegraded":"2024-09-12T19:00:00.068241+0000","last_fullsized":"2024-09-12T19:00:00.068241+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:09.077635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813897,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":527,"num_read_kb":37913,"num_write":1207,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'93","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.611092+0000","last_change":"2024-09-12T17:40:20.139437+0000","last_active":"2024-09-12T18:55:22.611092+0000","last_peered":"2024-09-12T18:55:22.611092+0000","last_clean":"2024-09-12T18:55:22.611092+0000","last_became_active":"2024-09-12T17:40:20.138680+0000","last_became_peered":"2024-09-12T17:40:20.138680+0000","last_unstale":"2024-09-12T18:55:22.611092+0000","last_undegraded":"2024-09-12T18:55:22.611092+0000","last_fullsized":"2024-09-12T18:55:22.611092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:20.357774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'322","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.073118+0000","last_change":"2024-09-12T17:40:18.761793+0000","last_active":"2024-09-12T19:00:00.073118+0000","last_peered":"2024-09-12T19:00:00.073118+0000","last_clean":"2024-09-12T19:00:00.073118+0000","last_became_active":"2024-09-12T17:40:18.761214+0000","last_became_peered":"2024-09-12T17:40:18.761214+0000","last_unstale":"2024-09-12T19:00:00.073118+0000","last_undegraded":"2024-09-12T19:00:00.073118+0000","last_fullsized":"2024-09-12T19:00:00.073118+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:52.345302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4802709,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":37097,"num_write":958,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'255","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:19.678404+0000","last_change":"2024-09-12T17:40:20.134527+0000","last_active":"2024-09-12T18:56:19.678404+0000","last_peered":"2024-09-12T18:56:19.678404+0000","last_clean":"2024-09-12T18:56:19.678404+0000","last_became_active":"2024-09-12T17:40:20.133791+0000","last_became_peered":"2024-09-12T17:40:20.133791+0000","last_unstale":"2024-09-12T18:56:19.678404+0000","last_undegraded":"2024-09-12T18:56:19.678404+0000","last_fullsized":"2024-09-12T18:56:19.678404+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:41.729662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1087,"num_read_kb":867,"num_write":420,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'401","reported_seq":1061,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.070671+0000","last_change":"2024-09-12T17:40:18.757584+0000","last_active":"2024-09-12T19:00:00.070671+0000","last_peered":"2024-09-12T19:00:00.070671+0000","last_clean":"2024-09-12T19:00:00.070671+0000","last_became_active":"2024-09-12T17:40:18.755606+0000","last_became_peered":"2024-09-12T17:40:18.755606+0000","last_unstale":"2024-09-12T19:00:00.070671+0000","last_undegraded":"2024-09-12T19:00:00.070671+0000","last_fullsized":"2024-09-12T19:00:00.070671+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:15.359537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457546,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":570,"num_read_kb":26533,"num_write":1277,"num_write_kb":46376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'130","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.375203+0000","last_change":"2024-09-12T17:40:20.130876+0000","last_active":"2024-09-12T18:58:04.375203+0000","last_peered":"2024-09-12T18:58:04.375203+0000","last_clean":"2024-09-12T18:58:04.375203+0000","last_became_active":"2024-09-12T17:40:20.130123+0000","last_became_peered":"2024-09-12T17:40:20.130123+0000","last_unstale":"2024-09-12T18:58:04.375203+0000","last_undegraded":"2024-09-12T18:58:04.375203+0000","last_fullsized":"2024-09-12T18:58:04.375203+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:31.564674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":589,"num_read_kb":499,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'339","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.059718+0000","last_change":"2024-09-12T17:40:18.768963+0000","last_active":"2024-09-12T19:00:00.059718+0000","last_peered":"2024-09-12T19:00:00.059718+0000","last_clean":"2024-09-12T19:00:00.059718+0000","last_became_active":"2024-09-12T17:40:18.768170+0000","last_became_peered":"2024-09-12T17:40:18.768170+0000","last_unstale":"2024-09-12T19:00:00.059718+0000","last_undegraded":"2024-09-12T19:00:00.059718+0000","last_fullsized":"2024-09-12T19:00:00.059718+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:12.117915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388668,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":59190,"num_write":1207,"num_write_kb":44467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'100","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.445911+0000","last_change":"2024-09-12T17:40:20.115278+0000","last_active":"2024-09-12T18:55:22.445911+0000","last_peered":"2024-09-12T18:55:22.445911+0000","last_clean":"2024-09-12T18:55:22.445911+0000","last_became_active":"2024-09-12T17:40:20.114923+0000","last_became_peered":"2024-09-12T17:40:20.114923+0000","last_unstale":"2024-09-12T18:55:22.445911+0000","last_undegraded":"2024-09-12T18:55:22.445911+0000","last_fullsized":"2024-09-12T18:55:22.445911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:28.492838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":408,"num_write":151,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'312","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.073002+0000","last_change":"2024-09-12T17:40:18.779851+0000","last_active":"2024-09-12T19:00:00.073002+0000","last_peered":"2024-09-12T19:00:00.073002+0000","last_clean":"2024-09-12T19:00:00.073002+0000","last_became_active":"2024-09-12T17:40:18.778991+0000","last_became_peered":"2024-09-12T17:40:18.778991+0000","last_unstale":"2024-09-12T19:00:00.073002+0000","last_undegraded":"2024-09-12T19:00:00.073002+0000","last_fullsized":"2024-09-12T19:00:00.073002+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:35.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311787,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":19945,"num_write":986,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'100","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433806+0000","last_change":"2024-09-12T17:40:20.128328+0000","last_active":"2024-09-12T18:56:42.433806+0000","last_peered":"2024-09-12T18:56:42.433806+0000","last_clean":"2024-09-12T18:56:42.433806+0000","last_became_active":"2024-09-12T17:40:20.127556+0000","last_became_peered":"2024-09-12T17:40:20.127556+0000","last_unstale":"2024-09-12T18:56:42.433806+0000","last_undegraded":"2024-09-12T18:56:42.433806+0000","last_fullsized":"2024-09-12T18:56:42.433806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:12.259064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":458,"num_read_kb":378,"num_write":157,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'377","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.069780+0000","last_change":"2024-09-12T17:40:18.761760+0000","last_active":"2024-09-12T19:00:00.069780+0000","last_peered":"2024-09-12T19:00:00.069780+0000","last_clean":"2024-09-12T19:00:00.069780+0000","last_became_active":"2024-09-12T17:40:18.760958+0000","last_became_peered":"2024-09-12T17:40:18.760958+0000","last_unstale":"2024-09-12T19:00:00.069780+0000","last_undegraded":"2024-09-12T19:00:00.069780+0000","last_fullsized":"2024-09-12T19:00:00.069780+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:50.452114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":8666,"num_write":1215,"num_write_kb":27182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'123","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820225+0000","last_change":"2024-09-12T17:40:20.136587+0000","last_active":"2024-09-12T18:57:27.820225+0000","last_peered":"2024-09-12T18:57:27.820225+0000","last_clean":"2024-09-12T18:57:27.820225+0000","last_became_active":"2024-09-12T17:40:20.132985+0000","last_became_peered":"2024-09-12T17:40:20.132985+0000","last_unstale":"2024-09-12T18:57:27.820225+0000","last_undegraded":"2024-09-12T18:57:27.820225+0000","last_fullsized":"2024-09-12T18:57:27.820225+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:46.649354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":462,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'398","reported_seq":1071,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.987775+0000","last_change":"2024-09-12T17:40:18.761925+0000","last_active":"2024-09-12T18:59:59.987775+0000","last_peered":"2024-09-12T18:59:59.987775+0000","last_clean":"2024-09-12T18:59:59.987775+0000","last_became_active":"2024-09-12T17:40:18.761056+0000","last_became_peered":"2024-09-12T17:40:18.761056+0000","last_unstale":"2024-09-12T18:59:59.987775+0000","last_undegraded":"2024-09-12T18:59:59.987775+0000","last_fullsized":"2024-09-12T18:59:59.987775+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:43.265328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":74800,"num_write":1233,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'208","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.640055+0000","last_change":"2024-09-12T17:40:20.135326+0000","last_active":"2024-09-12T18:57:27.640055+0000","last_peered":"2024-09-12T18:57:27.640055+0000","last_clean":"2024-09-12T18:57:27.640055+0000","last_became_active":"2024-09-12T17:40:20.134441+0000","last_became_peered":"2024-09-12T17:40:20.134441+0000","last_unstale":"2024-09-12T18:57:27.640055+0000","last_undegraded":"2024-09-12T18:57:27.640055+0000","last_fullsized":"2024-09-12T18:57:27.640055+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:29.851316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":897,"num_read_kb":734,"num_write":311,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'365","reported_seq":1068,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.071204+0000","last_change":"2024-09-12T17:40:18.774112+0000","last_active":"2024-09-12T19:00:00.071204+0000","last_peered":"2024-09-12T19:00:00.071204+0000","last_clean":"2024-09-12T19:00:00.071204+0000","last_became_active":"2024-09-12T17:40:18.773843+0000","last_became_peered":"2024-09-12T17:40:18.773843+0000","last_unstale":"2024-09-12T19:00:00.071204+0000","last_undegraded":"2024-09-12T19:00:00.071204+0000","last_fullsized":"2024-09-12T19:00:00.071204+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:24.163598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":629,"num_read_kb":30255,"num_write":1158,"num_write_kb":52642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'233","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:24.450044+0000","last_change":"2024-09-12T17:40:20.122021+0000","last_active":"2024-09-12T18:57:24.450044+0000","last_peered":"2024-09-12T18:57:24.450044+0000","last_clean":"2024-09-12T18:57:24.450044+0000","last_became_active":"2024-09-12T17:40:20.120891+0000","last_became_peered":"2024-09-12T17:40:20.120891+0000","last_unstale":"2024-09-12T18:57:24.450044+0000","last_undegraded":"2024-09-12T18:57:24.450044+0000","last_fullsized":"2024-09-12T18:57:24.450044+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:49.408719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":858,"num_write":384,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'192","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.818850+0000","last_change":"2024-09-12T17:40:20.135279+0000","last_active":"2024-09-12T18:57:22.818850+0000","last_peered":"2024-09-12T18:57:22.818850+0000","last_clean":"2024-09-12T18:57:22.818850+0000","last_became_active":"2024-09-12T17:40:20.132466+0000","last_became_peered":"2024-09-12T17:40:20.132466+0000","last_unstale":"2024-09-12T18:57:22.818850+0000","last_undegraded":"2024-09-12T18:57:22.818850+0000","last_fullsized":"2024-09-12T18:57:22.818850+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:47.393866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":674,"num_write":287,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'338","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.002370+0000","last_change":"2024-09-12T17:40:18.784241+0000","last_active":"2024-09-12T19:00:00.002370+0000","last_peered":"2024-09-12T19:00:00.002370+0000","last_clean":"2024-09-12T19:00:00.002370+0000","last_became_active":"2024-09-12T17:40:18.783282+0000","last_became_peered":"2024-09-12T17:40:18.783282+0000","last_unstale":"2024-09-12T19:00:00.002370+0000","last_undegraded":"2024-09-12T19:00:00.002370+0000","last_fullsized":"2024-09-12T19:00:00.002370+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:11.061277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":17792,"num_write":1019,"num_write_kb":32630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'128","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456078+0000","last_change":"2024-09-12T17:40:20.144162+0000","last_active":"2024-09-12T18:57:22.456078+0000","last_peered":"2024-09-12T18:57:22.456078+0000","last_clean":"2024-09-12T18:57:22.456078+0000","last_became_active":"2024-09-12T17:40:20.143471+0000","last_became_peered":"2024-09-12T17:40:20.143471+0000","last_unstale":"2024-09-12T18:57:22.456078+0000","last_undegraded":"2024-09-12T18:57:22.456078+0000","last_fullsized":"2024-09-12T18:57:22.456078+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:17.136156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":544,"num_read_kb":441,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'311","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.072656+0000","last_change":"2024-09-12T17:40:18.758730+0000","last_active":"2024-09-12T19:00:00.072656+0000","last_peered":"2024-09-12T19:00:00.072656+0000","last_clean":"2024-09-12T19:00:00.072656+0000","last_became_active":"2024-09-12T17:40:18.756814+0000","last_became_peered":"2024-09-12T17:40:18.756814+0000","last_unstale":"2024-09-12T19:00:00.072656+0000","last_undegraded":"2024-09-12T19:00:00.072656+0000","last_fullsized":"2024-09-12T19:00:00.072656+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:55.503868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048617,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":410,"num_read_kb":9611,"num_write":991,"num_write_kb":28982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'86","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.642204+0000","last_change":"2024-09-12T17:40:20.124840+0000","last_active":"2024-09-12T18:57:37.642204+0000","last_peered":"2024-09-12T18:57:37.642204+0000","last_clean":"2024-09-12T18:57:37.642204+0000","last_became_active":"2024-09-12T17:40:20.124104+0000","last_became_peered":"2024-09-12T17:40:20.124104+0000","last_unstale":"2024-09-12T18:57:37.642204+0000","last_undegraded":"2024-09-12T18:57:37.642204+0000","last_fullsized":"2024-09-12T18:57:37.642204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:12.896981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":294,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'404","reported_seq":1094,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.011550+0000","last_change":"2024-09-12T17:40:18.774434+0000","last_active":"2024-09-12T19:00:00.011550+0000","last_peered":"2024-09-12T19:00:00.011550+0000","last_clean":"2024-09-12T19:00:00.011550+0000","last_became_active":"2024-09-12T17:40:18.773787+0000","last_became_peered":"2024-09-12T17:40:18.773787+0000","last_unstale":"2024-09-12T19:00:00.011550+0000","last_undegraded":"2024-09-12T19:00:00.011550+0000","last_fullsized":"2024-09-12T19:00:00.011550+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:11.321051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1575003,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":648,"num_read_kb":7584,"num_write":1228,"num_write_kb":45057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'153","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:39.452989+0000","last_change":"2024-09-12T17:40:20.121404+0000","last_active":"2024-09-12T18:57:39.452989+0000","last_peered":"2024-09-12T18:57:39.452989+0000","last_clean":"2024-09-12T18:57:39.452989+0000","last_became_active":"2024-09-12T17:40:20.120803+0000","last_became_peered":"2024-09-12T17:40:20.120803+0000","last_unstale":"2024-09-12T18:57:39.452989+0000","last_undegraded":"2024-09-12T18:57:39.452989+0000","last_fullsized":"2024-09-12T18:57:39.452989+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":714,"num_read_kb":606,"num_write":221,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'312","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.053631+0000","last_change":"2024-09-12T17:40:18.770515+0000","last_active":"2024-09-12T19:00:00.053631+0000","last_peered":"2024-09-12T19:00:00.053631+0000","last_clean":"2024-09-12T19:00:00.053631+0000","last_became_active":"2024-09-12T17:40:18.769867+0000","last_became_peered":"2024-09-12T17:40:18.769867+0000","last_unstale":"2024-09-12T19:00:00.053631+0000","last_undegraded":"2024-09-12T19:00:00.053631+0000","last_fullsized":"2024-09-12T19:00:00.053631+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:27.168781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":25356,"num_write":1086,"num_write_kb":19597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'166","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:39.453048+0000","last_change":"2024-09-12T17:40:20.132059+0000","last_active":"2024-09-12T18:57:39.453048+0000","last_peered":"2024-09-12T18:57:39.453048+0000","last_clean":"2024-09-12T18:57:39.453048+0000","last_became_active":"2024-09-12T17:40:20.131603+0000","last_became_peered":"2024-09-12T17:40:20.131603+0000","last_unstale":"2024-09-12T18:57:39.453048+0000","last_undegraded":"2024-09-12T18:57:39.453048+0000","last_fullsized":"2024-09-12T18:57:39.453048+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":647,"num_write":268,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'324","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.045982+0000","last_change":"2024-09-12T17:40:18.766165+0000","last_active":"2024-09-12T19:00:00.045982+0000","last_peered":"2024-09-12T19:00:00.045982+0000","last_clean":"2024-09-12T19:00:00.045982+0000","last_became_active":"2024-09-12T17:40:18.765584+0000","last_became_peered":"2024-09-12T17:40:18.765584+0000","last_unstale":"2024-09-12T19:00:00.045982+0000","last_undegraded":"2024-09-12T19:00:00.045982+0000","last_fullsized":"2024-09-12T19:00:00.045982+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:22.295131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":14373,"num_write":1088,"num_write_kb":24714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'218","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:28.107651+0000","last_change":"2024-09-12T17:40:20.134311+0000","last_active":"2024-09-12T18:56:28.107651+0000","last_peered":"2024-09-12T18:56:28.107651+0000","last_clean":"2024-09-12T18:56:28.107651+0000","last_became_active":"2024-09-12T17:40:20.132166+0000","last_became_peered":"2024-09-12T17:40:20.132166+0000","last_unstale":"2024-09-12T18:56:28.107651+0000","last_undegraded":"2024-09-12T18:56:28.107651+0000","last_fullsized":"2024-09-12T18:56:28.107651+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:01.198659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":801,"num_write":328,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'317","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.061069+0000","last_change":"2024-09-12T17:40:18.754672+0000","last_active":"2024-09-12T19:00:00.061069+0000","last_peered":"2024-09-12T19:00:00.061069+0000","last_clean":"2024-09-12T19:00:00.061069+0000","last_became_active":"2024-09-12T17:40:18.753673+0000","last_became_peered":"2024-09-12T17:40:18.753673+0000","last_unstale":"2024-09-12T19:00:00.061069+0000","last_undegraded":"2024-09-12T19:00:00.061069+0000","last_fullsized":"2024-09-12T19:00:00.061069+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:52.046955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602146,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":9306,"num_write":1013,"num_write_kb":26120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'143","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.275130+0000","last_change":"2024-09-12T17:40:28.202080+0000","last_active":"2024-09-12T18:58:06.275130+0000","last_peered":"2024-09-12T18:58:06.275130+0000","last_clean":"2024-09-12T18:58:06.275130+0000","last_became_active":"2024-09-12T17:40:28.201205+0000","last_became_peered":"2024-09-12T17:40:28.201205+0000","last_unstale":"2024-09-12T18:58:06.275130+0000","last_undegraded":"2024-09-12T18:58:06.275130+0000","last_fullsized":"2024-09-12T18:58:06.275130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:51.763724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'257","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.461074+0000","last_change":"2024-09-12T17:40:20.133338+0000","last_active":"2024-09-12T18:57:42.461074+0000","last_peered":"2024-09-12T18:57:42.461074+0000","last_clean":"2024-09-12T18:57:42.461074+0000","last_became_active":"2024-09-12T17:40:20.132930+0000","last_became_peered":"2024-09-12T17:40:20.132930+0000","last_unstale":"2024-09-12T18:57:42.461074+0000","last_undegraded":"2024-09-12T18:57:42.461074+0000","last_fullsized":"2024-09-12T18:57:42.461074+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:26.732786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1081,"num_read_kb":890,"num_write":398,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'327","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.984185+0000","last_change":"2024-09-12T17:40:18.786389+0000","last_active":"2024-09-12T18:59:59.984185+0000","last_peered":"2024-09-12T18:59:59.984185+0000","last_clean":"2024-09-12T18:59:59.984185+0000","last_became_active":"2024-09-12T17:40:18.785762+0000","last_became_peered":"2024-09-12T17:40:18.785762+0000","last_unstale":"2024-09-12T18:59:59.984185+0000","last_undegraded":"2024-09-12T18:59:59.984185+0000","last_fullsized":"2024-09-12T18:59:59.984185+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.306882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364400,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":651,"num_read_kb":5513,"num_write":1121,"num_write_kb":17948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.609904+0000","last_change":"2024-09-12T17:40:22.146973+0000","last_active":"2024-09-12T18:55:17.609904+0000","last_peered":"2024-09-12T18:55:17.609904+0000","last_clean":"2024-09-12T18:55:17.609904+0000","last_became_active":"2024-09-12T17:40:22.146112+0000","last_became_peered":"2024-09-12T17:40:22.146112+0000","last_unstale":"2024-09-12T18:55:17.609904+0000","last_undegraded":"2024-09-12T18:55:17.609904+0000","last_fullsized":"2024-09-12T18:55:17.609904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:09.636474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'339","reported_seq":960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.556075+0000","last_change":"2024-09-12T17:40:24.162348+0000","last_active":"2024-09-12T18:59:59.556075+0000","last_peered":"2024-09-12T18:59:59.556075+0000","last_clean":"2024-09-12T18:59:59.556075+0000","last_became_active":"2024-09-12T17:40:24.161536+0000","last_became_peered":"2024-09-12T17:40:24.161536+0000","last_unstale":"2024-09-12T18:59:59.556075+0000","last_undegraded":"2024-09-12T18:59:59.556075+0000","last_fullsized":"2024-09-12T18:59:59.556075+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:26.371603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50345,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":1205,"num_write":440,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427469+0000","last_change":"2024-09-12T17:40:26.189627+0000","last_active":"2024-09-12T18:55:22.427469+0000","last_peered":"2024-09-12T18:55:22.427469+0000","last_clean":"2024-09-12T18:55:22.427469+0000","last_became_active":"2024-09-12T17:40:26.188831+0000","last_became_peered":"2024-09-12T17:40:26.188831+0000","last_unstale":"2024-09-12T18:55:22.427469+0000","last_undegraded":"2024-09-12T18:55:22.427469+0000","last_fullsized":"2024-09-12T18:55:22.427469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:08.240916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'158","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.658358+0000","last_change":"2024-09-12T17:40:28.190678+0000","last_active":"2024-09-12T18:58:02.658358+0000","last_peered":"2024-09-12T18:58:02.658358+0000","last_clean":"2024-09-12T18:58:02.658358+0000","last_became_active":"2024-09-12T17:40:28.189899+0000","last_became_peered":"2024-09-12T17:40:28.189899+0000","last_unstale":"2024-09-12T18:58:02.658358+0000","last_undegraded":"2024-09-12T18:58:02.658358+0000","last_fullsized":"2024-09-12T18:58:02.658358+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:37.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":230,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'92","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:35.155067+0000","last_change":"2024-09-12T17:40:20.137996+0000","last_active":"2024-09-12T18:55:35.155067+0000","last_peered":"2024-09-12T18:55:35.155067+0000","last_clean":"2024-09-12T18:55:35.155067+0000","last_became_active":"2024-09-12T17:40:20.137252+0000","last_became_peered":"2024-09-12T17:40:20.137252+0000","last_unstale":"2024-09-12T18:55:35.155067+0000","last_undegraded":"2024-09-12T18:55:35.155067+0000","last_fullsized":"2024-09-12T18:55:35.155067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:53.184648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":356,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'339","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.043920+0000","last_change":"2024-09-12T17:40:18.758093+0000","last_active":"2024-09-12T19:00:00.043920+0000","last_peered":"2024-09-12T19:00:00.043920+0000","last_clean":"2024-09-12T19:00:00.043920+0000","last_became_active":"2024-09-12T17:40:18.756518+0000","last_became_peered":"2024-09-12T17:40:18.756518+0000","last_unstale":"2024-09-12T19:00:00.043920+0000","last_undegraded":"2024-09-12T19:00:00.043920+0000","last_fullsized":"2024-09-12T19:00:00.043920+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:19.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272857,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":466,"num_read_kb":2596,"num_write":1023,"num_write_kb":33023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.461115+0000","last_change":"2024-09-12T17:40:22.153805+0000","last_active":"2024-09-12T18:57:42.461115+0000","last_peered":"2024-09-12T18:57:42.461115+0000","last_clean":"2024-09-12T18:57:42.461115+0000","last_became_active":"2024-09-12T17:40:22.153074+0000","last_became_peered":"2024-09-12T17:40:22.153074+0000","last_unstale":"2024-09-12T18:57:42.461115+0000","last_undegraded":"2024-09-12T18:57:42.461115+0000","last_fullsized":"2024-09-12T18:57:42.461115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:18.398925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'102","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793167+0000","last_change":"2024-09-12T17:40:24.170127+0000","last_active":"2024-09-12T18:55:22.793167+0000","last_peered":"2024-09-12T18:55:22.793167+0000","last_clean":"2024-09-12T18:55:22.793167+0000","last_became_active":"2024-09-12T17:40:24.169431+0000","last_became_peered":"2024-09-12T17:40:24.169431+0000","last_unstale":"2024-09-12T18:55:22.793167+0000","last_undegraded":"2024-09-12T18:55:22.793167+0000","last_fullsized":"2024-09-12T18:55:22.793167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:42.784293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793126+0000","last_change":"2024-09-12T17:40:26.189218+0000","last_active":"2024-09-12T18:55:22.793126+0000","last_peered":"2024-09-12T18:55:22.793126+0000","last_clean":"2024-09-12T18:55:22.793126+0000","last_became_active":"2024-09-12T17:40:26.188501+0000","last_became_peered":"2024-09-12T17:40:26.188501+0000","last_unstale":"2024-09-12T18:55:22.793126+0000","last_undegraded":"2024-09-12T18:55:22.793126+0000","last_fullsized":"2024-09-12T18:55:22.793126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.657079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'131","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:20.748031+0000","last_change":"2024-09-12T17:40:28.186974+0000","last_active":"2024-09-12T18:56:20.748031+0000","last_peered":"2024-09-12T18:56:20.748031+0000","last_clean":"2024-09-12T18:56:20.748031+0000","last_became_active":"2024-09-12T17:40:28.186224+0000","last_became_peered":"2024-09-12T17:40:28.186224+0000","last_unstale":"2024-09-12T18:56:20.748031+0000","last_undegraded":"2024-09-12T18:56:20.748031+0000","last_fullsized":"2024-09-12T18:56:20.748031+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:16.871107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":201,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'278","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.444792+0000","last_change":"2024-09-12T17:40:20.116147+0000","last_active":"2024-09-12T18:55:17.444792+0000","last_peered":"2024-09-12T18:55:17.444792+0000","last_clean":"2024-09-12T18:55:17.444792+0000","last_became_active":"2024-09-12T17:40:20.115862+0000","last_became_peered":"2024-09-12T17:40:20.115862+0000","last_unstale":"2024-09-12T18:55:17.444792+0000","last_undegraded":"2024-09-12T18:55:17.444792+0000","last_fullsized":"2024-09-12T18:55:17.444792+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:27.732090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1211,"num_read_kb":988,"num_write":419,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'370","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.032857+0000","last_change":"2024-09-12T17:40:55.329992+0000","last_active":"2024-09-12T19:00:00.032857+0000","last_peered":"2024-09-12T19:00:00.032857+0000","last_clean":"2024-09-12T19:00:00.032857+0000","last_became_active":"2024-09-12T17:40:55.329597+0000","last_became_peered":"2024-09-12T17:40:55.329597+0000","last_unstale":"2024-09-12T19:00:00.032857+0000","last_undegraded":"2024-09-12T19:00:00.032857+0000","last_fullsized":"2024-09-12T19:00:00.032857+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:13.339944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263284,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":44050,"num_write":1244,"num_write_kb":40700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.426595+0000","last_change":"2024-09-12T17:40:22.146475+0000","last_active":"2024-09-12T18:55:17.426595+0000","last_peered":"2024-09-12T18:55:17.426595+0000","last_clean":"2024-09-12T18:55:17.426595+0000","last_became_active":"2024-09-12T17:40:22.145769+0000","last_became_peered":"2024-09-12T17:40:22.145769+0000","last_unstale":"2024-09-12T18:55:17.426595+0000","last_undegraded":"2024-09-12T18:55:17.426595+0000","last_fullsized":"2024-09-12T18:55:17.426595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:33.677268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'144","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:44.454028+0000","last_change":"2024-09-12T17:40:24.164714+0000","last_active":"2024-09-12T18:57:44.454028+0000","last_peered":"2024-09-12T18:57:44.454028+0000","last_clean":"2024-09-12T18:57:44.454028+0000","last_became_active":"2024-09-12T17:40:24.163809+0000","last_became_peered":"2024-09-12T17:40:24.163809+0000","last_unstale":"2024-09-12T18:57:44.454028+0000","last_undegraded":"2024-09-12T18:57:44.454028+0000","last_fullsized":"2024-09-12T18:57:44.454028+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":124,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'764","reported_seq":2944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.813445+0000","last_change":"2024-09-12T17:40:26.201403+0000","last_active":"2024-09-12T18:59:59.813445+0000","last_peered":"2024-09-12T18:59:59.813445+0000","last_clean":"2024-09-12T18:59:59.813445+0000","last_became_active":"2024-09-12T17:40:26.200567+0000","last_became_peered":"2024-09-12T17:40:26.200567+0000","last_unstale":"2024-09-12T18:59:59.813445+0000","last_undegraded":"2024-09-12T18:59:59.813445+0000","last_fullsized":"2024-09-12T18:59:59.813445+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":701,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:56.480672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'215","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.683461+0000","last_change":"2024-09-12T17:40:28.172338+0000","last_active":"2024-09-12T18:58:04.683461+0000","last_peered":"2024-09-12T18:58:04.683461+0000","last_clean":"2024-09-12T18:58:04.683461+0000","last_became_active":"2024-09-12T17:40:28.171602+0000","last_became_peered":"2024-09-12T17:40:28.171602+0000","last_unstale":"2024-09-12T18:58:04.683461+0000","last_undegraded":"2024-09-12T18:58:04.683461+0000","last_fullsized":"2024-09-12T18:58:04.683461+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:30.488801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":670,"num_read_kb":661,"num_write":473,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'82","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:20.741811+0000","last_change":"2024-09-12T17:40:55.305375+0000","last_active":"2024-09-12T18:56:20.741811+0000","last_peered":"2024-09-12T18:56:20.741811+0000","last_clean":"2024-09-12T18:56:20.741811+0000","last_became_active":"2024-09-12T17:40:55.305123+0000","last_became_peered":"2024-09-12T17:40:55.305123+0000","last_unstale":"2024-09-12T18:56:20.741811+0000","last_undegraded":"2024-09-12T18:56:20.741811+0000","last_fullsized":"2024-09-12T18:56:20.741811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:09.120196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":316,"num_write":118,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"264'422","reported_seq":1171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.051903+0000","last_change":"2024-09-12T17:40:18.757642+0000","last_active":"2024-09-12T19:00:00.051903+0000","last_peered":"2024-09-12T19:00:00.051903+0000","last_clean":"2024-09-12T19:00:00.051903+0000","last_became_active":"2024-09-12T17:40:18.755758+0000","last_became_peered":"2024-09-12T17:40:18.755758+0000","last_unstale":"2024-09-12T19:00:00.051903+0000","last_undegraded":"2024-09-12T19:00:00.051903+0000","last_fullsized":"2024-09-12T19:00:00.051903+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:52.135911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":768,"num_read_kb":10976,"num_write":1273,"num_write_kb":39454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.610050+0000","last_change":"2024-09-12T17:40:22.145057+0000","last_active":"2024-09-12T18:55:17.610050+0000","last_peered":"2024-09-12T18:55:17.610050+0000","last_clean":"2024-09-12T18:55:17.610050+0000","last_became_active":"2024-09-12T17:40:22.144266+0000","last_became_peered":"2024-09-12T17:40:22.144266+0000","last_unstale":"2024-09-12T18:55:17.610050+0000","last_undegraded":"2024-09-12T18:55:17.610050+0000","last_fullsized":"2024-09-12T18:55:17.610050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:51.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'279","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.352850+0000","last_change":"2024-09-12T17:40:24.333448+0000","last_active":"2024-09-12T18:59:59.352850+0000","last_peered":"2024-09-12T18:59:59.352850+0000","last_clean":"2024-09-12T18:59:59.352850+0000","last_became_active":"2024-09-12T17:40:24.332623+0000","last_became_peered":"2024-09-12T17:40:24.332623+0000","last_unstale":"2024-09-12T18:59:59.352850+0000","last_undegraded":"2024-09-12T18:59:59.352850+0000","last_fullsized":"2024-09-12T18:59:59.352850+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:26.074531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50618,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1084,"num_write":376,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'786","reported_seq":4959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.715166+0000","last_change":"2024-09-12T17:40:26.195115+0000","last_active":"2024-09-12T18:59:59.715166+0000","last_peered":"2024-09-12T18:59:59.715166+0000","last_clean":"2024-09-12T18:59:59.715166+0000","last_became_active":"2024-09-12T17:40:26.194264+0000","last_became_peered":"2024-09-12T17:40:26.194264+0000","last_unstale":"2024-09-12T18:59:59.715166+0000","last_undegraded":"2024-09-12T18:59:59.715166+0000","last_fullsized":"2024-09-12T18:59:59.715166+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:28.079379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'4312","reported_seq":4925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:22.662701+0000","last_change":"2024-09-12T17:40:20.137536+0000","last_active":"2024-09-12T18:58:22.662701+0000","last_peered":"2024-09-12T18:58:22.662701+0000","last_clean":"2024-09-12T18:58:22.662701+0000","last_became_active":"2024-09-12T17:40:20.136595+0000","last_became_peered":"2024-09-12T17:40:20.136595+0000","last_unstale":"2024-09-12T18:58:22.662701+0000","last_undegraded":"2024-09-12T18:58:22.662701+0000","last_fullsized":"2024-09-12T18:58:22.662701+0000","mapping_epoch":25,"log_start":"264'4300","ondisk_log_start":"264'4300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:18.692389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17313,"num_read_kb":14480,"num_write":6459,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'321","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.035634+0000","last_change":"2024-09-12T17:40:18.792864+0000","last_active":"2024-09-12T19:00:00.035634+0000","last_peered":"2024-09-12T19:00:00.035634+0000","last_clean":"2024-09-12T19:00:00.035634+0000","last_became_active":"2024-09-12T17:40:18.792274+0000","last_became_peered":"2024-09-12T17:40:18.792274+0000","last_unstale":"2024-09-12T19:00:00.035634+0000","last_undegraded":"2024-09-12T19:00:00.035634+0000","last_fullsized":"2024-09-12T19:00:00.035634+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:56.734666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":45936,"num_write":1086,"num_write_kb":27157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439724+0000","last_change":"2024-09-12T17:40:22.152894+0000","last_active":"2024-09-12T18:56:12.439724+0000","last_peered":"2024-09-12T18:56:12.439724+0000","last_clean":"2024-09-12T18:56:12.439724+0000","last_became_active":"2024-09-12T17:40:22.150553+0000","last_became_peered":"2024-09-12T17:40:22.150553+0000","last_unstale":"2024-09-12T18:56:12.439724+0000","last_undegraded":"2024-09-12T18:56:12.439724+0000","last_fullsized":"2024-09-12T18:56:12.439724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:24.942654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'412","reported_seq":1053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.704432+0000","last_change":"2024-09-12T17:40:24.333149+0000","last_active":"2024-09-12T18:59:59.704432+0000","last_peered":"2024-09-12T18:59:59.704432+0000","last_clean":"2024-09-12T18:59:59.704432+0000","last_became_active":"2024-09-12T17:40:24.332413+0000","last_became_peered":"2024-09-12T17:40:24.332413+0000","last_unstale":"2024-09-12T18:59:59.704432+0000","last_undegraded":"2024-09-12T18:59:59.704432+0000","last_fullsized":"2024-09-12T18:59:59.704432+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:54.765665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52951,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":647,"num_read_kb":1274,"num_write":502,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.457290+0000","last_change":"2024-09-12T17:40:26.197292+0000","last_active":"2024-09-12T18:56:57.457290+0000","last_peered":"2024-09-12T18:56:57.457290+0000","last_clean":"2024-09-12T18:56:57.457290+0000","last_became_active":"2024-09-12T17:40:26.180448+0000","last_became_peered":"2024-09-12T17:40:26.180448+0000","last_unstale":"2024-09-12T18:56:57.457290+0000","last_undegraded":"2024-09-12T18:56:57.457290+0000","last_fullsized":"2024-09-12T18:56:57.457290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:40.842285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'559","reported_seq":1375,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.758187+0000","last_change":"2024-09-12T17:40:28.190641+0000","last_active":"2024-09-12T18:59:27.758187+0000","last_peered":"2024-09-12T18:59:27.758187+0000","last_clean":"2024-09-12T18:59:27.758187+0000","last_became_active":"2024-09-12T17:40:28.189872+0000","last_became_peered":"2024-09-12T17:40:28.189872+0000","last_unstale":"2024-09-12T18:59:27.758187+0000","last_undegraded":"2024-09-12T18:59:27.758187+0000","last_fullsized":"2024-09-12T18:59:27.758187+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:20.487874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1323,"num_read_kb":1321,"num_write":1170,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'151","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.803902+0000","last_change":"2024-09-12T17:40:20.134586+0000","last_active":"2024-09-12T18:56:12.803902+0000","last_peered":"2024-09-12T18:56:12.803902+0000","last_clean":"2024-09-12T18:56:12.803902+0000","last_became_active":"2024-09-12T17:40:20.133890+0000","last_became_peered":"2024-09-12T17:40:20.133890+0000","last_unstale":"2024-09-12T18:56:12.803902+0000","last_undegraded":"2024-09-12T18:56:12.803902+0000","last_fullsized":"2024-09-12T18:56:12.803902+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:21.170793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":596,"num_write":262,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'392","reported_seq":1068,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.022830+0000","last_change":"2024-09-12T17:40:18.779965+0000","last_active":"2024-09-12T19:00:00.022830+0000","last_peered":"2024-09-12T19:00:00.022830+0000","last_clean":"2024-09-12T19:00:00.022830+0000","last_became_active":"2024-09-12T17:40:18.779278+0000","last_became_peered":"2024-09-12T17:40:18.779278+0000","last_unstale":"2024-09-12T19:00:00.022830+0000","last_undegraded":"2024-09-12T19:00:00.022830+0000","last_fullsized":"2024-09-12T19:00:00.022830+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:40.197710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4801217,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":581,"num_read_kb":90800,"num_write":1176,"num_write_kb":50508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"35'5","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.672675+0000","last_change":"2024-09-12T17:40:22.133983+0000","last_active":"2024-09-12T18:59:58.672675+0000","last_peered":"2024-09-12T18:59:58.672675+0000","last_clean":"2024-09-12T18:59:58.672675+0000","last_became_active":"2024-09-12T17:40:22.133525+0000","last_became_peered":"2024-09-12T17:40:22.133525+0000","last_unstale":"2024-09-12T18:59:58.672675+0000","last_undegraded":"2024-09-12T18:59:58.672675+0000","last_fullsized":"2024-09-12T18:59:58.672675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:35.003569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'289","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.966921+0000","last_change":"2024-09-12T17:40:24.178387+0000","last_active":"2024-09-12T18:59:58.966921+0000","last_peered":"2024-09-12T18:59:58.966921+0000","last_clean":"2024-09-12T18:59:58.966921+0000","last_became_active":"2024-09-12T17:40:24.177609+0000","last_became_peered":"2024-09-12T17:40:24.177609+0000","last_unstale":"2024-09-12T18:59:58.966921+0000","last_undegraded":"2024-09-12T18:59:58.966921+0000","last_fullsized":"2024-09-12T18:59:58.966921+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.549312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1115,"num_write":388,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.445281+0000","last_change":"2024-09-12T17:40:26.203926+0000","last_active":"2024-09-12T18:56:37.445281+0000","last_peered":"2024-09-12T18:56:37.445281+0000","last_clean":"2024-09-12T18:56:37.445281+0000","last_became_active":"2024-09-12T17:40:26.203313+0000","last_became_peered":"2024-09-12T17:40:26.203313+0000","last_unstale":"2024-09-12T18:56:37.445281+0000","last_undegraded":"2024-09-12T18:56:37.445281+0000","last_fullsized":"2024-09-12T18:56:37.445281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:57.623918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2394","reported_seq":4223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:19.224714+0000","last_change":"2024-09-12T17:40:28.184253+0000","last_active":"2024-09-12T18:59:19.224714+0000","last_peered":"2024-09-12T18:59:19.224714+0000","last_clean":"2024-09-12T18:59:19.224714+0000","last_became_active":"2024-09-12T17:40:28.183181+0000","last_became_peered":"2024-09-12T17:40:28.183181+0000","last_unstale":"2024-09-12T18:59:19.224714+0000","last_undegraded":"2024-09-12T18:59:19.224714+0000","last_fullsized":"2024-09-12T18:59:19.224714+0000","mapping_epoch":33,"log_start":"264'2300","ondisk_log_start":"264'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:07.933119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6012,"num_read_kb":6017,"num_write":4828,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'261","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:32.431640+0000","last_change":"2024-09-12T17:40:20.138917+0000","last_active":"2024-09-12T18:56:32.431640+0000","last_peered":"2024-09-12T18:56:32.431640+0000","last_clean":"2024-09-12T18:56:32.431640+0000","last_became_active":"2024-09-12T17:40:20.133614+0000","last_became_peered":"2024-09-12T17:40:20.133614+0000","last_unstale":"2024-09-12T18:56:32.431640+0000","last_undegraded":"2024-09-12T18:56:32.431640+0000","last_fullsized":"2024-09-12T18:56:32.431640+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:17.955544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1175,"num_read_kb":965,"num_write":385,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'303","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.003486+0000","last_change":"2024-09-12T17:40:18.787022+0000","last_active":"2024-09-12T19:00:00.003486+0000","last_peered":"2024-09-12T19:00:00.003486+0000","last_clean":"2024-09-12T19:00:00.003486+0000","last_became_active":"2024-09-12T17:40:18.786288+0000","last_became_peered":"2024-09-12T17:40:18.786288+0000","last_unstale":"2024-09-12T19:00:00.003486+0000","last_undegraded":"2024-09-12T19:00:00.003486+0000","last_fullsized":"2024-09-12T19:00:00.003486+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:05.492643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263265,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":395,"num_read_kb":29289,"num_write":926,"num_write_kb":24158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:54.443737+0000","last_change":"2024-09-12T17:40:22.132236+0000","last_active":"2024-09-12T18:56:54.443737+0000","last_peered":"2024-09-12T18:56:54.443737+0000","last_clean":"2024-09-12T18:56:54.443737+0000","last_became_active":"2024-09-12T17:40:22.131242+0000","last_became_peered":"2024-09-12T17:40:22.131242+0000","last_unstale":"2024-09-12T18:56:54.443737+0000","last_undegraded":"2024-09-12T18:56:54.443737+0000","last_fullsized":"2024-09-12T18:56:54.443737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:50.985889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'304","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.787146+0000","last_change":"2024-09-12T17:40:24.163379+0000","last_active":"2024-09-12T18:59:59.787146+0000","last_peered":"2024-09-12T18:59:59.787146+0000","last_clean":"2024-09-12T18:59:59.787146+0000","last_became_active":"2024-09-12T17:40:24.162722+0000","last_became_peered":"2024-09-12T17:40:24.162722+0000","last_unstale":"2024-09-12T18:59:59.787146+0000","last_undegraded":"2024-09-12T18:59:59.787146+0000","last_fullsized":"2024-09-12T18:59:59.787146+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:54.964194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":1041,"num_write":382,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'762","reported_seq":2700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.947346+0000","last_change":"2024-09-12T17:40:26.182440+0000","last_active":"2024-09-12T18:59:59.947346+0000","last_peered":"2024-09-12T18:59:59.947346+0000","last_clean":"2024-09-12T18:59:59.947346+0000","last_became_active":"2024-09-12T17:40:26.181656+0000","last_became_peered":"2024-09-12T17:40:26.181656+0000","last_unstale":"2024-09-12T18:59:59.947346+0000","last_undegraded":"2024-09-12T18:59:59.947346+0000","last_fullsized":"2024-09-12T18:59:59.947346+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:17.173815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'117","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.441759+0000","last_change":"2024-09-12T17:40:28.187639+0000","last_active":"2024-09-12T18:59:26.441759+0000","last_peered":"2024-09-12T18:59:26.441759+0000","last_clean":"2024-09-12T18:59:26.441759+0000","last_became_active":"2024-09-12T17:40:28.185975+0000","last_became_peered":"2024-09-12T17:40:28.185975+0000","last_unstale":"2024-09-12T18:59:26.441759+0000","last_undegraded":"2024-09-12T18:59:26.441759+0000","last_fullsized":"2024-09-12T18:59:26.441759+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:59.724854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'268","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.465535+0000","last_change":"2024-09-12T17:40:20.125734+0000","last_active":"2024-09-12T18:56:52.465535+0000","last_peered":"2024-09-12T18:56:52.465535+0000","last_clean":"2024-09-12T18:56:52.465535+0000","last_became_active":"2024-09-12T17:40:20.125386+0000","last_became_peered":"2024-09-12T17:40:20.125386+0000","last_unstale":"2024-09-12T18:56:52.465535+0000","last_undegraded":"2024-09-12T18:56:52.465535+0000","last_fullsized":"2024-09-12T18:56:52.465535+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:49.257336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1147,"num_read_kb":967,"num_write":444,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'342","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.054130+0000","last_change":"2024-09-12T17:40:18.761857+0000","last_active":"2024-09-12T19:00:00.054130+0000","last_peered":"2024-09-12T19:00:00.054130+0000","last_clean":"2024-09-12T19:00:00.054130+0000","last_became_active":"2024-09-12T17:40:18.761052+0000","last_became_peered":"2024-09-12T17:40:18.761052+0000","last_unstale":"2024-09-12T19:00:00.054130+0000","last_undegraded":"2024-09-12T19:00:00.054130+0000","last_fullsized":"2024-09-12T19:00:00.054130+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:11.433675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":20006,"num_write":1061,"num_write_kb":43376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:34.440085+0000","last_change":"2024-09-12T17:40:22.134731+0000","last_active":"2024-09-12T18:56:34.440085+0000","last_peered":"2024-09-12T18:56:34.440085+0000","last_clean":"2024-09-12T18:56:34.440085+0000","last_became_active":"2024-09-12T17:40:22.134290+0000","last_became_peered":"2024-09-12T17:40:22.134290+0000","last_unstale":"2024-09-12T18:56:34.440085+0000","last_undegraded":"2024-09-12T18:56:34.440085+0000","last_fullsized":"2024-09-12T18:56:34.440085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:09.025873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'491","reported_seq":1144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.859649+0000","last_change":"2024-09-12T17:40:24.161967+0000","last_active":"2024-09-12T18:59:59.859649+0000","last_peered":"2024-09-12T18:59:59.859649+0000","last_clean":"2024-09-12T18:59:59.859649+0000","last_became_active":"2024-09-12T17:40:24.161322+0000","last_became_peered":"2024-09-12T17:40:24.161322+0000","last_unstale":"2024-09-12T18:59:59.859649+0000","last_undegraded":"2024-09-12T18:59:59.859649+0000","last_fullsized":"2024-09-12T18:59:59.859649+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.436434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92212,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2116,"num_write":710,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:19.437407+0000","last_change":"2024-09-12T17:40:26.192044+0000","last_active":"2024-09-12T18:56:19.437407+0000","last_peered":"2024-09-12T18:56:19.437407+0000","last_clean":"2024-09-12T18:56:19.437407+0000","last_became_active":"2024-09-12T17:40:26.191395+0000","last_became_peered":"2024-09-12T17:40:26.191395+0000","last_unstale":"2024-09-12T18:56:19.437407+0000","last_undegraded":"2024-09-12T18:56:19.437407+0000","last_fullsized":"2024-09-12T18:56:19.437407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:01.918115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'146","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:33.286149+0000","last_change":"2024-09-12T17:40:28.205050+0000","last_active":"2024-09-12T18:56:33.286149+0000","last_peered":"2024-09-12T18:56:33.286149+0000","last_clean":"2024-09-12T18:56:33.286149+0000","last_became_active":"2024-09-12T17:40:28.204260+0000","last_became_peered":"2024-09-12T17:40:28.204260+0000","last_unstale":"2024-09-12T18:56:33.286149+0000","last_undegraded":"2024-09-12T18:56:33.286149+0000","last_fullsized":"2024-09-12T18:56:33.286149+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:03.489071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":166,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'137","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812393+0000","last_change":"2024-09-12T17:40:20.143727+0000","last_active":"2024-09-12T18:56:52.812393+0000","last_peered":"2024-09-12T18:56:52.812393+0000","last_clean":"2024-09-12T18:56:52.812393+0000","last_became_active":"2024-09-12T17:40:20.137143+0000","last_became_peered":"2024-09-12T17:40:20.137143+0000","last_unstale":"2024-09-12T18:56:52.812393+0000","last_undegraded":"2024-09-12T18:56:52.812393+0000","last_fullsized":"2024-09-12T18:56:52.812393+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:59.463752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":630,"num_read_kb":531,"num_write":209,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'368","reported_seq":1199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.071261+0000","last_change":"2024-09-12T17:40:18.759820+0000","last_active":"2024-09-12T19:00:00.071261+0000","last_peered":"2024-09-12T19:00:00.071261+0000","last_clean":"2024-09-12T19:00:00.071261+0000","last_became_active":"2024-09-12T17:40:18.759516+0000","last_became_peered":"2024-09-12T17:40:18.759516+0000","last_unstale":"2024-09-12T19:00:00.071261+0000","last_undegraded":"2024-09-12T19:00:00.071261+0000","last_fullsized":"2024-09-12T19:00:00.071261+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:00.153624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457548,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":9130,"num_write":1131,"num_write_kb":40035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:54.443796+0000","last_change":"2024-09-12T17:40:22.152256+0000","last_active":"2024-09-12T18:56:54.443796+0000","last_peered":"2024-09-12T18:56:54.443796+0000","last_clean":"2024-09-12T18:56:54.443796+0000","last_became_active":"2024-09-12T17:40:22.151755+0000","last_became_peered":"2024-09-12T17:40:22.151755+0000","last_unstale":"2024-09-12T18:56:54.443796+0000","last_undegraded":"2024-09-12T18:56:54.443796+0000","last_fullsized":"2024-09-12T18:56:54.443796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:30.113972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'328","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.121445+0000","last_change":"2024-09-12T17:40:24.172818+0000","last_active":"2024-09-12T18:59:59.121445+0000","last_peered":"2024-09-12T18:59:59.121445+0000","last_clean":"2024-09-12T18:59:59.121445+0000","last_became_active":"2024-09-12T17:40:24.171973+0000","last_became_peered":"2024-09-12T17:40:24.171973+0000","last_unstale":"2024-09-12T18:59:59.121445+0000","last_undegraded":"2024-09-12T18:59:59.121445+0000","last_fullsized":"2024-09-12T18:59:59.121445+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:48.182083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50887,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":1156,"num_write":474,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.469988+0000","last_change":"2024-09-12T17:40:26.185794+0000","last_active":"2024-09-12T18:57:12.469988+0000","last_peered":"2024-09-12T18:57:12.469988+0000","last_clean":"2024-09-12T18:57:12.469988+0000","last_became_active":"2024-09-12T17:40:26.185070+0000","last_became_peered":"2024-09-12T17:40:26.185070+0000","last_unstale":"2024-09-12T18:57:12.469988+0000","last_undegraded":"2024-09-12T18:57:12.469988+0000","last_fullsized":"2024-09-12T18:57:12.469988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:50.080805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'139","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:47.476159+0000","last_change":"2024-09-12T17:40:28.195461+0000","last_active":"2024-09-12T18:58:47.476159+0000","last_peered":"2024-09-12T18:58:47.476159+0000","last_clean":"2024-09-12T18:58:47.476159+0000","last_became_active":"2024-09-12T17:40:28.194137+0000","last_became_peered":"2024-09-12T17:40:28.194137+0000","last_unstale":"2024-09-12T18:58:47.476159+0000","last_undegraded":"2024-09-12T18:58:47.476159+0000","last_fullsized":"2024-09-12T18:58:47.476159+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:02.040950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":145,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'125","reported_seq":703,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812491+0000","last_change":"2024-09-12T17:40:20.132955+0000","last_active":"2024-09-12T18:56:52.812491+0000","last_peered":"2024-09-12T18:56:52.812491+0000","last_clean":"2024-09-12T18:56:52.812491+0000","last_became_active":"2024-09-12T17:40:20.132115+0000","last_became_peered":"2024-09-12T17:40:20.132115+0000","last_unstale":"2024-09-12T18:56:52.812491+0000","last_undegraded":"2024-09-12T18:56:52.812491+0000","last_fullsized":"2024-09-12T18:56:52.812491+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:35.227492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":428,"num_write":212,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'343","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.040165+0000","last_change":"2024-09-12T17:40:18.774103+0000","last_active":"2024-09-12T19:00:00.040165+0000","last_peered":"2024-09-12T19:00:00.040165+0000","last_clean":"2024-09-12T19:00:00.040165+0000","last_became_active":"2024-09-12T17:40:18.773579+0000","last_became_peered":"2024-09-12T17:40:18.773579+0000","last_unstale":"2024-09-12T19:00:00.040165+0000","last_undegraded":"2024-09-12T19:00:00.040165+0000","last_fullsized":"2024-09-12T19:00:00.040165+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:15.108347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4506445,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":44851,"num_write":1031,"num_write_kb":35490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.456281+0000","last_change":"2024-09-12T17:40:22.143512+0000","last_active":"2024-09-12T18:56:52.456281+0000","last_peered":"2024-09-12T18:56:52.456281+0000","last_clean":"2024-09-12T18:56:52.456281+0000","last_became_active":"2024-09-12T17:40:22.142112+0000","last_became_peered":"2024-09-12T17:40:22.142112+0000","last_unstale":"2024-09-12T18:56:52.456281+0000","last_undegraded":"2024-09-12T18:56:52.456281+0000","last_fullsized":"2024-09-12T18:56:52.456281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:23.695955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'337","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.087831+0000","last_change":"2024-09-12T17:40:24.182665+0000","last_active":"2024-09-12T19:00:00.087831+0000","last_peered":"2024-09-12T19:00:00.087831+0000","last_clean":"2024-09-12T19:00:00.087831+0000","last_became_active":"2024-09-12T17:40:24.181982+0000","last_became_peered":"2024-09-12T17:40:24.181982+0000","last_unstale":"2024-09-12T19:00:00.087831+0000","last_undegraded":"2024-09-12T19:00:00.087831+0000","last_fullsized":"2024-09-12T19:00:00.087831+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:55.908753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52587,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1218,"num_write":444,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'725","reported_seq":2535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.721975+0000","last_change":"2024-09-12T17:40:26.187935+0000","last_active":"2024-09-12T18:59:59.721975+0000","last_peered":"2024-09-12T18:59:59.721975+0000","last_clean":"2024-09-12T18:59:59.721975+0000","last_became_active":"2024-09-12T17:40:26.187269+0000","last_became_peered":"2024-09-12T17:40:26.187269+0000","last_unstale":"2024-09-12T18:59:59.721975+0000","last_undegraded":"2024-09-12T18:59:59.721975+0000","last_fullsized":"2024-09-12T18:59:59.721975+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:57.828902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'139","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.277441+0000","last_change":"2024-09-12T17:40:28.192959+0000","last_active":"2024-09-12T18:58:02.277441+0000","last_peered":"2024-09-12T18:58:02.277441+0000","last_clean":"2024-09-12T18:58:02.277441+0000","last_became_active":"2024-09-12T17:40:28.192211+0000","last_became_peered":"2024-09-12T17:40:28.192211+0000","last_unstale":"2024-09-12T18:58:02.277441+0000","last_undegraded":"2024-09-12T18:58:02.277441+0000","last_fullsized":"2024-09-12T18:58:02.277441+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:29.331632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":224,"num_write":356,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'4139","reported_seq":4785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812556+0000","last_change":"2024-09-12T17:40:20.137018+0000","last_active":"2024-09-12T18:56:52.812556+0000","last_peered":"2024-09-12T18:56:52.812556+0000","last_clean":"2024-09-12T18:56:52.812556+0000","last_became_active":"2024-09-12T17:40:20.136148+0000","last_became_peered":"2024-09-12T17:40:20.136148+0000","last_unstale":"2024-09-12T18:56:52.812556+0000","last_undegraded":"2024-09-12T18:56:52.812556+0000","last_fullsized":"2024-09-12T18:56:52.812556+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":3000,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:28.267156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16638,"num_read_kb":13967,"num_write":6216,"num_write_kb":3097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'300","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.064399+0000","last_change":"2024-09-12T17:40:18.774322+0000","last_active":"2024-09-12T19:00:00.064399+0000","last_peered":"2024-09-12T19:00:00.064399+0000","last_clean":"2024-09-12T19:00:00.064399+0000","last_became_active":"2024-09-12T17:40:18.773552+0000","last_became_peered":"2024-09-12T17:40:18.773552+0000","last_unstale":"2024-09-12T19:00:00.064399+0000","last_undegraded":"2024-09-12T19:00:00.064399+0000","last_fullsized":"2024-09-12T19:00:00.064399+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:46.449493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5770401,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":475,"num_read_kb":17949,"num_write":926,"num_write_kb":45991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1457,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.684126+0000","last_change":"2024-09-12T17:40:22.144205+0000","last_active":"2024-09-12T18:59:58.684126+0000","last_peered":"2024-09-12T18:59:58.684126+0000","last_clean":"2024-09-12T18:59:58.684126+0000","last_became_active":"2024-09-12T17:40:22.143463+0000","last_became_peered":"2024-09-12T17:40:22.143463+0000","last_unstale":"2024-09-12T18:59:58.684126+0000","last_undegraded":"2024-09-12T18:59:58.684126+0000","last_fullsized":"2024-09-12T18:59:58.684126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:11.027627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'110","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450877+0000","last_change":"2024-09-12T17:40:24.330084+0000","last_active":"2024-09-12T18:56:57.450877+0000","last_peered":"2024-09-12T18:56:57.450877+0000","last_clean":"2024-09-12T18:56:57.450877+0000","last_became_active":"2024-09-12T17:40:24.329452+0000","last_became_peered":"2024-09-12T17:40:24.329452+0000","last_unstale":"2024-09-12T18:56:57.450877+0000","last_undegraded":"2024-09-12T18:56:57.450877+0000","last_fullsized":"2024-09-12T18:56:57.450877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:41.298862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'753","reported_seq":2625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.719270+0000","last_change":"2024-09-12T17:40:26.183775+0000","last_active":"2024-09-12T18:59:58.719270+0000","last_peered":"2024-09-12T18:59:58.719270+0000","last_clean":"2024-09-12T18:59:58.719270+0000","last_became_active":"2024-09-12T17:40:26.183016+0000","last_became_peered":"2024-09-12T17:40:26.183016+0000","last_unstale":"2024-09-12T18:59:58.719270+0000","last_undegraded":"2024-09-12T18:59:58.719270+0000","last_fullsized":"2024-09-12T18:59:58.719270+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:45.838846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'112","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821328+0000","last_change":"2024-09-12T17:40:28.180920+0000","last_active":"2024-09-12T18:57:32.821328+0000","last_peered":"2024-09-12T18:57:32.821328+0000","last_clean":"2024-09-12T18:57:32.821328+0000","last_became_active":"2024-09-12T17:40:28.180192+0000","last_became_peered":"2024-09-12T17:40:28.180192+0000","last_unstale":"2024-09-12T18:57:32.821328+0000","last_undegraded":"2024-09-12T18:57:32.821328+0000","last_fullsized":"2024-09-12T18:57:32.821328+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:20.350489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":167,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'272","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.460652+0000","last_change":"2024-09-12T17:40:20.126559+0000","last_active":"2024-09-12T18:57:12.460652+0000","last_peered":"2024-09-12T18:57:12.460652+0000","last_clean":"2024-09-12T18:57:12.460652+0000","last_became_active":"2024-09-12T17:40:20.125511+0000","last_became_peered":"2024-09-12T17:40:20.125511+0000","last_unstale":"2024-09-12T18:57:12.460652+0000","last_undegraded":"2024-09-12T18:57:12.460652+0000","last_fullsized":"2024-09-12T18:57:12.460652+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:21.984534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1212,"num_read_kb":1000,"num_write":434,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'286","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.074963+0000","last_change":"2024-09-12T17:40:18.769294+0000","last_active":"2024-09-12T19:00:00.074963+0000","last_peered":"2024-09-12T19:00:00.074963+0000","last_clean":"2024-09-12T19:00:00.074963+0000","last_became_active":"2024-09-12T17:40:18.769054+0000","last_became_peered":"2024-09-12T17:40:18.769054+0000","last_unstale":"2024-09-12T19:00:00.074963+0000","last_undegraded":"2024-09-12T19:00:00.074963+0000","last_fullsized":"2024-09-12T19:00:00.074963+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:10.356128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526370,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":78920,"num_write":889,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812532+0000","last_change":"2024-09-12T17:40:22.139642+0000","last_active":"2024-09-12T18:56:52.812532+0000","last_peered":"2024-09-12T18:56:52.812532+0000","last_clean":"2024-09-12T18:56:52.812532+0000","last_became_active":"2024-09-12T17:40:22.138875+0000","last_became_peered":"2024-09-12T17:40:22.138875+0000","last_unstale":"2024-09-12T18:56:52.812532+0000","last_undegraded":"2024-09-12T18:56:52.812532+0000","last_fullsized":"2024-09-12T18:56:52.812532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:04.385118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'397","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.596183+0000","last_change":"2024-09-12T17:40:24.174213+0000","last_active":"2024-09-12T18:59:59.596183+0000","last_peered":"2024-09-12T18:59:59.596183+0000","last_clean":"2024-09-12T18:59:59.596183+0000","last_became_active":"2024-09-12T17:40:24.173537+0000","last_became_peered":"2024-09-12T17:40:24.173537+0000","last_unstale":"2024-09-12T18:59:59.596183+0000","last_undegraded":"2024-09-12T18:59:59.596183+0000","last_fullsized":"2024-09-12T18:59:59.596183+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:35.315463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47427,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":650,"num_read_kb":1371,"num_write":508,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.436922+0000","last_change":"2024-09-12T17:40:26.184072+0000","last_active":"2024-09-12T18:56:57.436922+0000","last_peered":"2024-09-12T18:56:57.436922+0000","last_clean":"2024-09-12T18:56:57.436922+0000","last_became_active":"2024-09-12T17:40:26.183228+0000","last_became_peered":"2024-09-12T17:40:26.183228+0000","last_unstale":"2024-09-12T18:56:57.436922+0000","last_undegraded":"2024-09-12T18:56:57.436922+0000","last_fullsized":"2024-09-12T18:56:57.436922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.239515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'138","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.417590+0000","last_change":"2024-09-12T17:40:28.192535+0000","last_active":"2024-09-12T18:58:04.417590+0000","last_peered":"2024-09-12T18:58:04.417590+0000","last_clean":"2024-09-12T18:58:04.417590+0000","last_became_active":"2024-09-12T17:40:28.191461+0000","last_became_peered":"2024-09-12T17:40:28.191461+0000","last_unstale":"2024-09-12T18:58:04.417590+0000","last_undegraded":"2024-09-12T18:58:04.417590+0000","last_fullsized":"2024-09-12T18:58:04.417590+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:39.691469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":326,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'92","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.447236+0000","last_change":"2024-09-12T17:40:20.146944+0000","last_active":"2024-09-12T18:57:47.447236+0000","last_peered":"2024-09-12T18:57:47.447236+0000","last_clean":"2024-09-12T18:57:47.447236+0000","last_became_active":"2024-09-12T17:40:20.146160+0000","last_became_peered":"2024-09-12T17:40:20.146160+0000","last_unstale":"2024-09-12T18:57:47.447236+0000","last_undegraded":"2024-09-12T18:57:47.447236+0000","last_fullsized":"2024-09-12T18:57:47.447236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:10.252891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:22.442012+0000","last_change":"2024-09-12T17:40:03.638745+0000","last_active":"2024-09-12T18:56:22.442012+0000","last_peered":"2024-09-12T18:56:22.442012+0000","last_clean":"2024-09-12T18:56:22.442012+0000","last_became_active":"2024-09-12T17:40:03.636856+0000","last_became_peered":"2024-09-12T17:40:03.636856+0000","last_unstale":"2024-09-12T18:56:22.442012+0000","last_undegraded":"2024-09-12T18:56:22.442012+0000","last_fullsized":"2024-09-12T18:56:22.442012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:02.615744+0000","last_clean_scrub_stamp":"2024-09-12T17:40:02.615744+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:44.815912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637481+0000","last_change":"2024-09-12T17:40:11.694118+0000","last_active":"2024-09-12T18:57:17.637481+0000","last_peered":"2024-09-12T18:57:17.637481+0000","last_clean":"2024-09-12T18:57:17.637481+0000","last_became_active":"2024-09-12T17:40:09.670674+0000","last_became_peered":"2024-09-12T17:40:09.670674+0000","last_unstale":"2024-09-12T18:57:17.637481+0000","last_undegraded":"2024-09-12T18:57:17.637481+0000","last_fullsized":"2024-09-12T18:57:17.637481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:11.615670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001302742,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'376","reported_seq":1126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.074924+0000","last_change":"2024-09-12T17:40:18.774699+0000","last_active":"2024-09-12T19:00:00.074924+0000","last_peered":"2024-09-12T19:00:00.074924+0000","last_clean":"2024-09-12T19:00:00.074924+0000","last_became_active":"2024-09-12T17:40:18.774164+0000","last_became_peered":"2024-09-12T17:40:18.774164+0000","last_unstale":"2024-09-12T19:00:00.074924+0000","last_undegraded":"2024-09-12T19:00:00.074924+0000","last_fullsized":"2024-09-12T19:00:00.074924+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:30.058615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1557056,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":732,"num_read_kb":41235,"num_write":1123,"num_write_kb":37796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457318+0000","last_change":"2024-09-12T17:40:22.150388+0000","last_active":"2024-09-12T18:57:27.457318+0000","last_peered":"2024-09-12T18:57:27.457318+0000","last_clean":"2024-09-12T18:57:27.457318+0000","last_became_active":"2024-09-12T17:40:22.148190+0000","last_became_peered":"2024-09-12T17:40:22.148190+0000","last_unstale":"2024-09-12T18:57:27.457318+0000","last_undegraded":"2024-09-12T18:57:27.457318+0000","last_fullsized":"2024-09-12T18:57:27.457318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:47.144440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'735","reported_seq":1451,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.005992+0000","last_change":"2024-09-12T17:40:24.177543+0000","last_active":"2024-09-12T19:00:00.005992+0000","last_peered":"2024-09-12T19:00:00.005992+0000","last_clean":"2024-09-12T19:00:00.005992+0000","last_became_active":"2024-09-12T17:40:24.176757+0000","last_became_peered":"2024-09-12T17:40:24.176757+0000","last_unstale":"2024-09-12T19:00:00.005992+0000","last_undegraded":"2024-09-12T19:00:00.005992+0000","last_fullsized":"2024-09-12T19:00:00.005992+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.566492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107902,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1433,"num_read_kb":3342,"num_write":1350,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.458091+0000","last_change":"2024-09-12T17:40:26.191218+0000","last_active":"2024-09-12T18:56:17.458091+0000","last_peered":"2024-09-12T18:56:17.458091+0000","last_clean":"2024-09-12T18:56:17.458091+0000","last_became_active":"2024-09-12T17:40:26.190522+0000","last_became_peered":"2024-09-12T17:40:26.190522+0000","last_unstale":"2024-09-12T18:56:17.458091+0000","last_undegraded":"2024-09-12T18:56:17.458091+0000","last_fullsized":"2024-09-12T18:56:17.458091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:36.917179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'197","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.131600+0000","last_change":"2024-09-12T17:40:28.194274+0000","last_active":"2024-09-12T18:58:06.131600+0000","last_peered":"2024-09-12T18:58:06.131600+0000","last_clean":"2024-09-12T18:58:06.131600+0000","last_became_active":"2024-09-12T17:40:28.193456+0000","last_became_peered":"2024-09-12T17:40:28.193456+0000","last_unstale":"2024-09-12T18:58:06.131600+0000","last_undegraded":"2024-09-12T18:58:06.131600+0000","last_fullsized":"2024-09-12T18:58:06.131600+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:18.966712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":530,"num_write":424,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'121","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456780+0000","last_change":"2024-09-12T17:40:20.131034+0000","last_active":"2024-09-12T18:56:12.456780+0000","last_peered":"2024-09-12T18:56:12.456780+0000","last_clean":"2024-09-12T18:56:12.456780+0000","last_became_active":"2024-09-12T17:40:20.130774+0000","last_became_peered":"2024-09-12T17:40:20.130774+0000","last_unstale":"2024-09-12T18:56:12.456780+0000","last_undegraded":"2024-09-12T18:56:12.456780+0000","last_fullsized":"2024-09-12T18:56:12.456780+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:27.582751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":441,"num_write":172,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.443272+0000","last_change":"2024-09-12T17:40:11.747849+0000","last_active":"2024-09-12T18:56:27.443272+0000","last_peered":"2024-09-12T18:56:27.443272+0000","last_clean":"2024-09-12T18:56:27.443272+0000","last_became_active":"2024-09-12T17:40:09.666272+0000","last_became_peered":"2024-09-12T17:40:09.666272+0000","last_unstale":"2024-09-12T18:56:27.443272+0000","last_undegraded":"2024-09-12T18:56:27.443272+0000","last_fullsized":"2024-09-12T18:56:27.443272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:15.707497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001052545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'377","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.082699+0000","last_change":"2024-09-12T17:40:18.775027+0000","last_active":"2024-09-12T19:00:00.082699+0000","last_peered":"2024-09-12T19:00:00.082699+0000","last_clean":"2024-09-12T19:00:00.082699+0000","last_became_active":"2024-09-12T17:40:18.774751+0000","last_became_peered":"2024-09-12T17:40:18.774751+0000","last_unstale":"2024-09-12T19:00:00.082699+0000","last_undegraded":"2024-09-12T19:00:00.082699+0000","last_fullsized":"2024-09-12T19:00:00.082699+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.877317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":730,"num_write":1215,"num_write_kb":17029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.622557+0000","last_change":"2024-09-12T17:40:22.147871+0000","last_active":"2024-09-12T18:56:12.622557+0000","last_peered":"2024-09-12T18:56:12.622557+0000","last_clean":"2024-09-12T18:56:12.622557+0000","last_became_active":"2024-09-12T17:40:22.147184+0000","last_became_peered":"2024-09-12T17:40:22.147184+0000","last_unstale":"2024-09-12T18:56:12.622557+0000","last_undegraded":"2024-09-12T18:56:12.622557+0000","last_fullsized":"2024-09-12T18:56:12.622557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:31.847917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1349","reported_seq":3257,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.639681+0000","last_change":"2024-09-12T17:40:24.169842+0000","last_active":"2024-09-12T18:59:59.639681+0000","last_peered":"2024-09-12T18:59:59.639681+0000","last_clean":"2024-09-12T18:59:59.639681+0000","last_became_active":"2024-09-12T17:40:24.169050+0000","last_became_peered":"2024-09-12T17:40:24.169050+0000","last_unstale":"2024-09-12T18:59:59.639681+0000","last_undegraded":"2024-09-12T18:59:59.639681+0000","last_fullsized":"2024-09-12T18:59:59.639681+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":1300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:15.887934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147644,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2159,"num_read_kb":4153,"num_write":1266,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.462335+0000","last_change":"2024-09-12T17:40:26.203093+0000","last_active":"2024-09-12T18:57:47.462335+0000","last_peered":"2024-09-12T18:57:47.462335+0000","last_clean":"2024-09-12T18:57:47.462335+0000","last_became_active":"2024-09-12T17:40:26.202360+0000","last_became_peered":"2024-09-12T17:40:26.202360+0000","last_unstale":"2024-09-12T18:57:47.462335+0000","last_undegraded":"2024-09-12T18:57:47.462335+0000","last_fullsized":"2024-09-12T18:57:47.462335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:51.977257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'190","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.452907+0000","last_change":"2024-09-12T17:40:28.190152+0000","last_active":"2024-09-12T18:56:37.452907+0000","last_peered":"2024-09-12T18:56:37.452907+0000","last_clean":"2024-09-12T18:56:37.452907+0000","last_became_active":"2024-09-12T17:40:28.189387+0000","last_became_peered":"2024-09-12T17:40:28.189387+0000","last_unstale":"2024-09-12T18:56:37.452907+0000","last_undegraded":"2024-09-12T18:56:37.452907+0000","last_fullsized":"2024-09-12T18:56:37.452907+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:39.878519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":364,"num_write":413,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'193","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447713+0000","last_change":"2024-09-12T17:40:20.129924+0000","last_active":"2024-09-12T18:56:12.447713+0000","last_peered":"2024-09-12T18:56:12.447713+0000","last_clean":"2024-09-12T18:56:12.447713+0000","last_became_active":"2024-09-12T17:40:20.129646+0000","last_became_peered":"2024-09-12T17:40:20.129646+0000","last_unstale":"2024-09-12T18:56:12.447713+0000","last_undegraded":"2024-09-12T18:56:12.447713+0000","last_fullsized":"2024-09-12T18:56:12.447713+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:01.198659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":706,"num_write":294,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:14.447959+0000","last_change":"2024-09-12T17:40:11.749016+0000","last_active":"2024-09-12T18:57:14.447959+0000","last_peered":"2024-09-12T18:57:14.447959+0000","last_clean":"2024-09-12T18:57:14.447959+0000","last_became_active":"2024-09-12T17:40:09.771196+0000","last_became_peered":"2024-09-12T17:40:09.771196+0000","last_unstale":"2024-09-12T18:57:14.447959+0000","last_undegraded":"2024-09-12T18:57:14.447959+0000","last_fullsized":"2024-09-12T18:57:14.447959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:48.611278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010655720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'324","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.070648+0000","last_change":"2024-09-12T17:40:18.766281+0000","last_active":"2024-09-12T19:00:00.070648+0000","last_peered":"2024-09-12T19:00:00.070648+0000","last_clean":"2024-09-12T19:00:00.070648+0000","last_became_active":"2024-09-12T17:40:18.759514+0000","last_became_peered":"2024-09-12T17:40:18.759514+0000","last_unstale":"2024-09-12T19:00:00.070648+0000","last_undegraded":"2024-09-12T19:00:00.070648+0000","last_fullsized":"2024-09-12T19:00:00.070648+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:37.907891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1491790,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":20357,"num_write":1029,"num_write_kb":29003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:14.436342+0000","last_change":"2024-09-12T17:40:22.139338+0000","last_active":"2024-09-12T18:56:14.436342+0000","last_peered":"2024-09-12T18:56:14.436342+0000","last_clean":"2024-09-12T18:56:14.436342+0000","last_became_active":"2024-09-12T17:40:22.138606+0000","last_became_peered":"2024-09-12T17:40:22.138606+0000","last_unstale":"2024-09-12T18:56:14.436342+0000","last_undegraded":"2024-09-12T18:56:14.436342+0000","last_fullsized":"2024-09-12T18:56:14.436342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:11.361933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'294","reported_seq":1802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.983546+0000","last_change":"2024-09-12T17:40:24.330435+0000","last_active":"2024-09-12T18:59:27.983546+0000","last_peered":"2024-09-12T18:59:27.983546+0000","last_clean":"2024-09-12T18:59:27.983546+0000","last_became_active":"2024-09-12T17:40:24.329425+0000","last_became_peered":"2024-09-12T17:40:24.329425+0000","last_unstale":"2024-09-12T18:59:27.983546+0000","last_undegraded":"2024-09-12T18:59:27.983546+0000","last_fullsized":"2024-09-12T18:59:27.983546+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:18.922243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":264,"num_read_kb":256,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.474435+0000","last_change":"2024-09-12T17:40:26.190790+0000","last_active":"2024-09-12T18:57:32.474435+0000","last_peered":"2024-09-12T18:57:32.474435+0000","last_clean":"2024-09-12T18:57:32.474435+0000","last_became_active":"2024-09-12T17:40:26.188740+0000","last_became_peered":"2024-09-12T17:40:26.188740+0000","last_unstale":"2024-09-12T18:57:32.474435+0000","last_undegraded":"2024-09-12T18:57:32.474435+0000","last_fullsized":"2024-09-12T18:57:32.474435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:41.526051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'269","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.609250+0000","last_change":"2024-09-12T17:40:28.202892+0000","last_active":"2024-09-12T18:58:06.609250+0000","last_peered":"2024-09-12T18:58:06.609250+0000","last_clean":"2024-09-12T18:58:06.609250+0000","last_became_active":"2024-09-12T17:40:28.202238+0000","last_became_peered":"2024-09-12T17:40:28.202238+0000","last_unstale":"2024-09-12T18:58:06.609250+0000","last_undegraded":"2024-09-12T18:58:06.609250+0000","last_fullsized":"2024-09-12T18:58:06.609250+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:40.299625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":592,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'387","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464045+0000","last_change":"2024-09-12T17:40:20.128374+0000","last_active":"2024-09-12T18:57:27.464045+0000","last_peered":"2024-09-12T18:57:27.464045+0000","last_clean":"2024-09-12T18:57:27.464045+0000","last_became_active":"2024-09-12T17:40:20.127774+0000","last_became_peered":"2024-09-12T17:40:20.127774+0000","last_unstale":"2024-09-12T18:57:27.464045+0000","last_undegraded":"2024-09-12T18:57:27.464045+0000","last_fullsized":"2024-09-12T18:57:27.464045+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:30.582322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1689,"num_read_kb":1329,"num_write":647,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637396+0000","last_change":"2024-09-12T17:40:11.695547+0000","last_active":"2024-09-12T18:57:17.637396+0000","last_peered":"2024-09-12T18:57:17.637396+0000","last_clean":"2024-09-12T18:57:17.637396+0000","last_became_active":"2024-09-12T17:40:09.672745+0000","last_became_peered":"2024-09-12T17:40:09.672745+0000","last_unstale":"2024-09-12T18:57:17.637396+0000","last_undegraded":"2024-09-12T18:57:17.637396+0000","last_fullsized":"2024-09-12T18:57:17.637396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:10.363335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002775694,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'381","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.038035+0000","last_change":"2024-09-12T17:40:18.770896+0000","last_active":"2024-09-12T19:00:00.038035+0000","last_peered":"2024-09-12T19:00:00.038035+0000","last_clean":"2024-09-12T19:00:00.038035+0000","last_became_active":"2024-09-12T17:40:18.769909+0000","last_became_peered":"2024-09-12T17:40:18.769909+0000","last_unstale":"2024-09-12T19:00:00.038035+0000","last_undegraded":"2024-09-12T19:00:00.038035+0000","last_fullsized":"2024-09-12T19:00:00.038035+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:26.327437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":740079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":12377,"num_write":1306,"num_write_kb":22203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.476785+0000","last_change":"2024-09-12T17:40:22.145902+0000","last_active":"2024-09-12T18:57:42.476785+0000","last_peered":"2024-09-12T18:57:42.476785+0000","last_clean":"2024-09-12T18:57:42.476785+0000","last_became_active":"2024-09-12T17:40:22.145410+0000","last_became_peered":"2024-09-12T17:40:22.145410+0000","last_unstale":"2024-09-12T18:57:42.476785+0000","last_undegraded":"2024-09-12T18:57:42.476785+0000","last_fullsized":"2024-09-12T18:57:42.476785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:20.122905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'162","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:25.961675+0000","last_change":"2024-09-12T17:40:24.170740+0000","last_active":"2024-09-12T18:59:25.961675+0000","last_peered":"2024-09-12T18:59:25.961675+0000","last_clean":"2024-09-12T18:59:25.961675+0000","last_became_active":"2024-09-12T17:40:24.169937+0000","last_became_peered":"2024-09-12T17:40:24.169937+0000","last_unstale":"2024-09-12T18:59:25.961675+0000","last_undegraded":"2024-09-12T18:59:25.961675+0000","last_fullsized":"2024-09-12T18:59:25.961675+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:52.608977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":193,"num_write":146,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.428609+0000","last_change":"2024-09-12T17:40:26.172468+0000","last_active":"2024-09-12T18:56:17.428609+0000","last_peered":"2024-09-12T18:56:17.428609+0000","last_clean":"2024-09-12T18:56:17.428609+0000","last_became_active":"2024-09-12T17:40:26.171660+0000","last_became_peered":"2024-09-12T17:40:26.171660+0000","last_unstale":"2024-09-12T18:56:17.428609+0000","last_undegraded":"2024-09-12T18:56:17.428609+0000","last_fullsized":"2024-09-12T18:56:17.428609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:42.338225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'122","reported_seq":672,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.623502+0000","last_change":"2024-09-12T17:40:28.202494+0000","last_active":"2024-09-12T18:56:17.623502+0000","last_peered":"2024-09-12T18:56:17.623502+0000","last_clean":"2024-09-12T18:56:17.623502+0000","last_became_active":"2024-09-12T17:40:28.201694+0000","last_became_peered":"2024-09-12T17:40:28.201694+0000","last_unstale":"2024-09-12T18:56:17.623502+0000","last_undegraded":"2024-09-12T18:56:17.623502+0000","last_fullsized":"2024-09-12T18:56:17.623502+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:49.909677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":250,"num_write":312,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'144","reported_seq":749,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.463949+0000","last_change":"2024-09-12T17:40:20.128037+0000","last_active":"2024-09-12T18:57:27.463949+0000","last_peered":"2024-09-12T18:57:27.463949+0000","last_clean":"2024-09-12T18:57:27.463949+0000","last_became_active":"2024-09-12T17:40:20.127727+0000","last_became_peered":"2024-09-12T17:40:20.127727+0000","last_unstale":"2024-09-12T18:57:27.463949+0000","last_undegraded":"2024-09-12T18:57:27.463949+0000","last_fullsized":"2024-09-12T18:57:27.463949+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:36.420192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":625,"num_read_kb":513,"num_write":241,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'310","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.069163+0000","last_change":"2024-09-12T17:40:18.769528+0000","last_active":"2024-09-12T19:00:00.069163+0000","last_peered":"2024-09-12T19:00:00.069163+0000","last_clean":"2024-09-12T19:00:00.069163+0000","last_became_active":"2024-09-12T17:40:18.768544+0000","last_became_peered":"2024-09-12T17:40:18.768544+0000","last_unstale":"2024-09-12T19:00:00.069163+0000","last_undegraded":"2024-09-12T19:00:00.069163+0000","last_fullsized":"2024-09-12T19:00:00.069163+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:48.979420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":425,"num_read_kb":64899,"num_write":927,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.461730+0000","last_change":"2024-09-12T17:40:11.682969+0000","last_active":"2024-09-12T18:57:17.461730+0000","last_peered":"2024-09-12T18:57:17.461730+0000","last_clean":"2024-09-12T18:57:17.461730+0000","last_became_active":"2024-09-12T17:40:09.770645+0000","last_became_peered":"2024-09-12T17:40:09.770645+0000","last_unstale":"2024-09-12T18:57:17.461730+0000","last_undegraded":"2024-09-12T18:57:17.461730+0000","last_fullsized":"2024-09-12T18:57:17.461730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:00.566138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091158000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473305+0000","last_change":"2024-09-12T17:40:22.136717+0000","last_active":"2024-09-12T18:57:27.473305+0000","last_peered":"2024-09-12T18:57:27.473305+0000","last_clean":"2024-09-12T18:57:27.473305+0000","last_became_active":"2024-09-12T17:40:22.136155+0000","last_became_peered":"2024-09-12T17:40:22.136155+0000","last_unstale":"2024-09-12T18:57:27.473305+0000","last_undegraded":"2024-09-12T18:57:27.473305+0000","last_fullsized":"2024-09-12T18:57:27.473305+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:23.121643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'651","reported_seq":1347,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.047995+0000","last_change":"2024-09-12T17:40:24.174815+0000","last_active":"2024-09-12T19:00:00.047995+0000","last_peered":"2024-09-12T19:00:00.047995+0000","last_clean":"2024-09-12T19:00:00.047995+0000","last_became_active":"2024-09-12T17:40:24.173380+0000","last_became_peered":"2024-09-12T17:40:24.173380+0000","last_unstale":"2024-09-12T19:00:00.047995+0000","last_undegraded":"2024-09-12T19:00:00.047995+0000","last_fullsized":"2024-09-12T19:00:00.047995+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:43.915482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106768,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":3034,"num_write":2200,"num_write_kb":2020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821238+0000","last_change":"2024-09-12T17:40:26.192118+0000","last_active":"2024-09-12T18:57:32.821238+0000","last_peered":"2024-09-12T18:57:32.821238+0000","last_clean":"2024-09-12T18:57:32.821238+0000","last_became_active":"2024-09-12T17:40:26.191417+0000","last_became_peered":"2024-09-12T17:40:26.191417+0000","last_unstale":"2024-09-12T18:57:32.821238+0000","last_undegraded":"2024-09-12T18:57:32.821238+0000","last_fullsized":"2024-09-12T18:57:32.821238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:38.892952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'174","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.340189+0000","last_change":"2024-09-12T17:40:28.187802+0000","last_active":"2024-09-12T18:58:06.340189+0000","last_peered":"2024-09-12T18:58:06.340189+0000","last_clean":"2024-09-12T18:58:06.340189+0000","last_became_active":"2024-09-12T17:40:28.186922+0000","last_became_peered":"2024-09-12T17:40:28.186922+0000","last_unstale":"2024-09-12T18:58:06.340189+0000","last_undegraded":"2024-09-12T18:58:06.340189+0000","last_fullsized":"2024-09-12T18:58:06.340189+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.041023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'143","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473328+0000","last_change":"2024-09-12T17:40:20.112762+0000","last_active":"2024-09-12T18:57:27.473328+0000","last_peered":"2024-09-12T18:57:27.473328+0000","last_clean":"2024-09-12T18:57:27.473328+0000","last_became_active":"2024-09-12T17:40:20.112490+0000","last_became_peered":"2024-09-12T17:40:20.112490+0000","last_unstale":"2024-09-12T18:57:27.473328+0000","last_undegraded":"2024-09-12T18:57:27.473328+0000","last_fullsized":"2024-09-12T18:57:27.473328+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:36.390829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":606,"num_read_kb":504,"num_write":208,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'311","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.068143+0000","last_change":"2024-09-12T17:40:18.760773+0000","last_active":"2024-09-12T19:00:00.068143+0000","last_peered":"2024-09-12T19:00:00.068143+0000","last_clean":"2024-09-12T19:00:00.068143+0000","last_became_active":"2024-09-12T17:40:18.760130+0000","last_became_peered":"2024-09-12T17:40:18.760130+0000","last_unstale":"2024-09-12T19:00:00.068143+0000","last_undegraded":"2024-09-12T19:00:00.068143+0000","last_fullsized":"2024-09-12T19:00:00.068143+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:54.991344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359201,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":428,"num_read_kb":2118,"num_write":932,"num_write_kb":13193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.458586+0000","last_change":"2024-09-12T17:40:11.747892+0000","last_active":"2024-09-12T18:57:32.458586+0000","last_peered":"2024-09-12T18:57:32.458586+0000","last_clean":"2024-09-12T18:57:32.458586+0000","last_became_active":"2024-09-12T17:40:09.770504+0000","last_became_peered":"2024-09-12T17:40:09.770504+0000","last_unstale":"2024-09-12T18:57:32.458586+0000","last_undegraded":"2024-09-12T18:57:32.458586+0000","last_fullsized":"2024-09-12T18:57:32.458586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:45.742830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001093257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443134+0000","last_change":"2024-09-12T17:40:22.136820+0000","last_active":"2024-09-12T18:57:27.443134+0000","last_peered":"2024-09-12T18:57:27.443134+0000","last_clean":"2024-09-12T18:57:27.443134+0000","last_became_active":"2024-09-12T17:40:22.136095+0000","last_became_peered":"2024-09-12T17:40:22.136095+0000","last_unstale":"2024-09-12T18:57:27.443134+0000","last_undegraded":"2024-09-12T18:57:27.443134+0000","last_fullsized":"2024-09-12T18:57:27.443134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:59.114168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'255","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:25.949567+0000","last_change":"2024-09-12T17:40:24.333148+0000","last_active":"2024-09-12T18:58:25.949567+0000","last_peered":"2024-09-12T18:58:25.949567+0000","last_clean":"2024-09-12T18:58:25.949567+0000","last_became_active":"2024-09-12T17:40:24.332477+0000","last_became_peered":"2024-09-12T17:40:24.332477+0000","last_unstale":"2024-09-12T18:58:25.949567+0000","last_undegraded":"2024-09-12T18:58:25.949567+0000","last_fullsized":"2024-09-12T18:58:25.949567+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:09.053613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":296,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'759","reported_seq":3096,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.374040+0000","last_change":"2024-09-12T17:40:26.180479+0000","last_active":"2024-09-12T18:59:59.374040+0000","last_peered":"2024-09-12T18:59:59.374040+0000","last_clean":"2024-09-12T18:59:59.374040+0000","last_became_active":"2024-09-12T17:40:26.179728+0000","last_became_peered":"2024-09-12T17:40:26.179728+0000","last_unstale":"2024-09-12T18:59:59.374040+0000","last_undegraded":"2024-09-12T18:59:59.374040+0000","last_fullsized":"2024-09-12T18:59:59.374040+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:15.964800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'144","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.754378+0000","last_change":"2024-09-12T17:40:28.202506+0000","last_active":"2024-09-12T18:59:27.754378+0000","last_peered":"2024-09-12T18:59:27.754378+0000","last_clean":"2024-09-12T18:59:27.754378+0000","last_became_active":"2024-09-12T17:40:28.201571+0000","last_became_peered":"2024-09-12T17:40:28.201571+0000","last_unstale":"2024-09-12T18:59:27.754378+0000","last_undegraded":"2024-09-12T18:59:27.754378+0000","last_fullsized":"2024-09-12T18:59:27.754378+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:40.742392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":253,"num_write":364,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'450","reported_seq":1163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446531+0000","last_change":"2024-09-12T17:40:20.136291+0000","last_active":"2024-09-12T18:56:42.446531+0000","last_peered":"2024-09-12T18:56:42.446531+0000","last_clean":"2024-09-12T18:56:42.446531+0000","last_became_active":"2024-09-12T17:40:20.135950+0000","last_became_peered":"2024-09-12T17:40:20.135950+0000","last_unstale":"2024-09-12T18:56:42.446531+0000","last_undegraded":"2024-09-12T18:56:42.446531+0000","last_fullsized":"2024-09-12T18:56:42.446531+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:02.260304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1875,"num_read_kb":1500,"num_write":660,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'325","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.028721+0000","last_change":"2024-09-12T17:40:18.762841+0000","last_active":"2024-09-12T19:00:00.028721+0000","last_peered":"2024-09-12T19:00:00.028721+0000","last_clean":"2024-09-12T19:00:00.028721+0000","last_became_active":"2024-09-12T17:40:18.762324+0000","last_became_peered":"2024-09-12T17:40:18.762324+0000","last_unstale":"2024-09-12T19:00:00.028721+0000","last_undegraded":"2024-09-12T19:00:00.028721+0000","last_fullsized":"2024-09-12T19:00:00.028721+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:21.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651838,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":496,"num_read_kb":85957,"num_write":1018,"num_write_kb":37704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.445258+0000","last_change":"2024-09-12T17:40:11.683217+0000","last_active":"2024-09-12T18:56:02.445258+0000","last_peered":"2024-09-12T18:56:02.445258+0000","last_clean":"2024-09-12T18:56:02.445258+0000","last_became_active":"2024-09-12T17:40:09.671019+0000","last_became_peered":"2024-09-12T17:40:09.671019+0000","last_unstale":"2024-09-12T18:56:02.445258+0000","last_undegraded":"2024-09-12T18:56:02.445258+0000","last_fullsized":"2024-09-12T18:56:02.445258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:29.653884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096571,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820072+0000","last_change":"2024-09-12T17:40:22.146908+0000","last_active":"2024-09-12T18:57:27.820072+0000","last_peered":"2024-09-12T18:57:27.820072+0000","last_clean":"2024-09-12T18:57:27.820072+0000","last_became_active":"2024-09-12T17:40:22.146131+0000","last_became_peered":"2024-09-12T17:40:22.146131+0000","last_unstale":"2024-09-12T18:57:27.820072+0000","last_undegraded":"2024-09-12T18:57:27.820072+0000","last_fullsized":"2024-09-12T18:57:27.820072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:43.916632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'135","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821299+0000","last_change":"2024-09-12T17:40:24.165118+0000","last_active":"2024-09-12T18:57:32.821299+0000","last_peered":"2024-09-12T18:57:32.821299+0000","last_clean":"2024-09-12T18:57:32.821299+0000","last_became_active":"2024-09-12T17:40:24.163566+0000","last_became_peered":"2024-09-12T17:40:24.163566+0000","last_unstale":"2024-09-12T18:57:32.821299+0000","last_undegraded":"2024-09-12T18:57:32.821299+0000","last_fullsized":"2024-09-12T18:57:32.821299+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.865870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'787","reported_seq":2824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.714907+0000","last_change":"2024-09-12T17:40:26.195048+0000","last_active":"2024-09-12T18:59:59.714907+0000","last_peered":"2024-09-12T18:59:59.714907+0000","last_clean":"2024-09-12T18:59:59.714907+0000","last_became_active":"2024-09-12T17:40:26.194293+0000","last_became_peered":"2024-09-12T17:40:26.194293+0000","last_unstale":"2024-09-12T18:59:59.714907+0000","last_undegraded":"2024-09-12T18:59:59.714907+0000","last_fullsized":"2024-09-12T18:59:59.714907+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:29.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'199","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.466585+0000","last_change":"2024-09-12T17:40:28.207712+0000","last_active":"2024-09-12T18:56:57.466585+0000","last_peered":"2024-09-12T18:56:57.466585+0000","last_clean":"2024-09-12T18:56:57.466585+0000","last_became_active":"2024-09-12T17:40:28.207048+0000","last_became_peered":"2024-09-12T17:40:28.207048+0000","last_unstale":"2024-09-12T18:56:57.466585+0000","last_undegraded":"2024-09-12T18:56:57.466585+0000","last_fullsized":"2024-09-12T18:56:57.466585+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:43.200882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":318,"num_write":457,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'86","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820038+0000","last_change":"2024-09-12T17:40:20.143011+0000","last_active":"2024-09-12T18:57:27.820038+0000","last_peered":"2024-09-12T18:57:27.820038+0000","last_clean":"2024-09-12T18:57:27.820038+0000","last_became_active":"2024-09-12T17:40:20.142323+0000","last_became_peered":"2024-09-12T17:40:20.142323+0000","last_unstale":"2024-09-12T18:57:27.820038+0000","last_undegraded":"2024-09-12T18:57:27.820038+0000","last_fullsized":"2024-09-12T18:57:27.820038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:05.353429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":391,"num_read_kb":327,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'418","reported_seq":1199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.057196+0000","last_change":"2024-09-12T17:40:18.767413+0000","last_active":"2024-09-12T19:00:00.057196+0000","last_peered":"2024-09-12T19:00:00.057196+0000","last_clean":"2024-09-12T19:00:00.057196+0000","last_became_active":"2024-09-12T17:40:18.766817+0000","last_became_peered":"2024-09-12T17:40:18.766817+0000","last_unstale":"2024-09-12T19:00:00.057196+0000","last_undegraded":"2024-09-12T19:00:00.057196+0000","last_fullsized":"2024-09-12T19:00:00.057196+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:50.259112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4983875,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":942,"num_read_kb":8527,"num_write":1357,"num_write_kb":43864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.425422+0000","last_change":"2024-09-12T17:40:11.748529+0000","last_active":"2024-09-12T18:56:02.425422+0000","last_peered":"2024-09-12T18:56:02.425422+0000","last_clean":"2024-09-12T18:56:02.425422+0000","last_became_active":"2024-09-12T17:40:09.674331+0000","last_became_peered":"2024-09-12T17:40:09.674331+0000","last_unstale":"2024-09-12T18:56:02.425422+0000","last_undegraded":"2024-09-12T18:56:02.425422+0000","last_fullsized":"2024-09-12T18:56:02.425422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:08.647611+0000","last_clean_scrub_stamp":"2024-09-12T17:40:08.647611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:20.063434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446575+0000","last_change":"2024-09-12T17:40:22.147841+0000","last_active":"2024-09-12T18:56:42.446575+0000","last_peered":"2024-09-12T18:56:42.446575+0000","last_clean":"2024-09-12T18:56:42.446575+0000","last_became_active":"2024-09-12T17:40:22.147341+0000","last_became_peered":"2024-09-12T17:40:22.147341+0000","last_unstale":"2024-09-12T18:56:42.446575+0000","last_undegraded":"2024-09-12T18:56:42.446575+0000","last_fullsized":"2024-09-12T18:56:42.446575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:33.825775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'789","reported_seq":1534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.515751+0000","last_change":"2024-09-12T17:40:24.330059+0000","last_active":"2024-09-12T18:59:59.515751+0000","last_peered":"2024-09-12T18:59:59.515751+0000","last_clean":"2024-09-12T18:59:59.515751+0000","last_became_active":"2024-09-12T17:40:24.329314+0000","last_became_peered":"2024-09-12T17:40:24.329314+0000","last_unstale":"2024-09-12T18:59:59.515751+0000","last_undegraded":"2024-09-12T18:59:59.515751+0000","last_fullsized":"2024-09-12T18:59:59.515751+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:42.536254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1403,"num_read_kb":3378,"num_write":1144,"num_write_kb":925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.458785+0000","last_change":"2024-09-12T17:40:26.199233+0000","last_active":"2024-09-12T18:57:32.458785+0000","last_peered":"2024-09-12T18:57:32.458785+0000","last_clean":"2024-09-12T18:57:32.458785+0000","last_became_active":"2024-09-12T17:40:26.197718+0000","last_became_peered":"2024-09-12T17:40:26.197718+0000","last_unstale":"2024-09-12T18:57:32.458785+0000","last_undegraded":"2024-09-12T18:57:32.458785+0000","last_fullsized":"2024-09-12T18:57:32.458785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:57.822527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'117","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.632901+0000","last_change":"2024-09-12T17:40:28.199911+0000","last_active":"2024-09-12T18:56:57.632901+0000","last_peered":"2024-09-12T18:56:57.632901+0000","last_clean":"2024-09-12T18:56:57.632901+0000","last_became_active":"2024-09-12T17:40:28.199295+0000","last_became_peered":"2024-09-12T17:40:28.199295+0000","last_unstale":"2024-09-12T18:56:57.632901+0000","last_undegraded":"2024-09-12T18:56:57.632901+0000","last_fullsized":"2024-09-12T18:56:57.632901+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:22.472810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":147,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'106","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.518640+0000","last_change":"2024-09-12T17:40:28.192741+0000","last_active":"2024-09-12T18:58:06.518640+0000","last_peered":"2024-09-12T18:58:06.518640+0000","last_clean":"2024-09-12T18:58:06.518640+0000","last_became_active":"2024-09-12T17:40:28.192019+0000","last_became_peered":"2024-09-12T17:40:28.192019+0000","last_unstale":"2024-09-12T18:58:06.518640+0000","last_undegraded":"2024-09-12T18:58:06.518640+0000","last_fullsized":"2024-09-12T18:58:06.518640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:03.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":192,"num_write":225,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'111","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.818982+0000","last_change":"2024-09-12T17:40:20.136571+0000","last_active":"2024-09-12T18:57:22.818982+0000","last_peered":"2024-09-12T18:57:22.818982+0000","last_clean":"2024-09-12T18:57:22.818982+0000","last_became_active":"2024-09-12T17:40:20.135868+0000","last_became_peered":"2024-09-12T17:40:20.135868+0000","last_unstale":"2024-09-12T18:57:22.818982+0000","last_undegraded":"2024-09-12T18:57:22.818982+0000","last_fullsized":"2024-09-12T18:57:22.818982+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:37.134752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":445,"num_write":160,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'281","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.028969+0000","last_change":"2024-09-12T17:40:18.789847+0000","last_active":"2024-09-12T19:00:00.028969+0000","last_peered":"2024-09-12T19:00:00.028969+0000","last_clean":"2024-09-12T19:00:00.028969+0000","last_became_active":"2024-09-12T17:40:18.788674+0000","last_became_peered":"2024-09-12T17:40:18.788674+0000","last_unstale":"2024-09-12T19:00:00.028969+0000","last_undegraded":"2024-09-12T19:00:00.028969+0000","last_fullsized":"2024-09-12T19:00:00.028969+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:37.689644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117782,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":10615,"num_write":904,"num_write_kb":14901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.462809+0000","last_change":"2024-09-12T17:40:22.141831+0000","last_active":"2024-09-12T18:57:22.462809+0000","last_peered":"2024-09-12T18:57:22.462809+0000","last_clean":"2024-09-12T18:57:22.462809+0000","last_became_active":"2024-09-12T17:40:22.141326+0000","last_became_peered":"2024-09-12T17:40:22.141326+0000","last_unstale":"2024-09-12T18:57:22.462809+0000","last_undegraded":"2024-09-12T18:57:22.462809+0000","last_fullsized":"2024-09-12T18:57:22.462809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:09.004014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'304","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.748241+0000","last_change":"2024-09-12T17:40:24.171008+0000","last_active":"2024-09-12T18:59:59.748241+0000","last_peered":"2024-09-12T18:59:59.748241+0000","last_clean":"2024-09-12T18:59:59.748241+0000","last_became_active":"2024-09-12T17:40:24.169248+0000","last_became_peered":"2024-09-12T17:40:24.169248+0000","last_unstale":"2024-09-12T18:59:59.748241+0000","last_undegraded":"2024-09-12T18:59:59.748241+0000","last_fullsized":"2024-09-12T18:59:59.748241+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:18.401232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1219,"num_write":420,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457958+0000","last_change":"2024-09-12T17:40:26.204596+0000","last_active":"2024-09-12T18:57:27.457958+0000","last_peered":"2024-09-12T18:57:27.457958+0000","last_clean":"2024-09-12T18:57:27.457958+0000","last_became_active":"2024-09-12T17:40:26.203855+0000","last_became_peered":"2024-09-12T17:40:26.203855+0000","last_unstale":"2024-09-12T18:57:27.457958+0000","last_undegraded":"2024-09-12T18:57:27.457958+0000","last_fullsized":"2024-09-12T18:57:27.457958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:26.029987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.597637+0000","last_change":"2024-09-12T17:40:28.205116+0000","last_active":"2024-09-12T18:57:32.597637+0000","last_peered":"2024-09-12T18:57:32.597637+0000","last_clean":"2024-09-12T18:57:32.597637+0000","last_became_active":"2024-09-12T17:40:28.204204+0000","last_became_peered":"2024-09-12T17:40:28.204204+0000","last_unstale":"2024-09-12T18:57:32.597637+0000","last_undegraded":"2024-09-12T18:57:32.597637+0000","last_fullsized":"2024-09-12T18:57:32.597637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:13.281028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":252,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'238","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.462857+0000","last_change":"2024-09-12T17:40:20.128888+0000","last_active":"2024-09-12T18:57:22.462857+0000","last_peered":"2024-09-12T18:57:22.462857+0000","last_clean":"2024-09-12T18:57:22.462857+0000","last_became_active":"2024-09-12T17:40:20.128532+0000","last_became_peered":"2024-09-12T17:40:20.128532+0000","last_unstale":"2024-09-12T18:57:22.462857+0000","last_undegraded":"2024-09-12T18:57:22.462857+0000","last_fullsized":"2024-09-12T18:57:22.462857+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:10.062006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":846,"num_write":360,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'395","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.055370+0000","last_change":"2024-09-12T17:40:55.306539+0000","last_active":"2024-09-12T19:00:00.055370+0000","last_peered":"2024-09-12T19:00:00.055370+0000","last_clean":"2024-09-12T19:00:00.055370+0000","last_became_active":"2024-09-12T17:40:55.305689+0000","last_became_peered":"2024-09-12T17:40:55.305689+0000","last_unstale":"2024-09-12T19:00:00.055370+0000","last_undegraded":"2024-09-12T19:00:00.055370+0000","last_fullsized":"2024-09-12T19:00:00.055370+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:55.468206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":44917,"num_write":1304,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.457130+0000","last_change":"2024-09-12T17:40:22.143900+0000","last_active":"2024-09-12T18:57:22.457130+0000","last_peered":"2024-09-12T18:57:22.457130+0000","last_clean":"2024-09-12T18:57:22.457130+0000","last_became_active":"2024-09-12T17:40:22.143466+0000","last_became_peered":"2024-09-12T17:40:22.143466+0000","last_unstale":"2024-09-12T18:57:22.457130+0000","last_undegraded":"2024-09-12T18:57:22.457130+0000","last_fullsized":"2024-09-12T18:57:22.457130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:12.032718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'61","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473152+0000","last_change":"2024-09-12T17:40:24.152265+0000","last_active":"2024-09-12T18:57:27.473152+0000","last_peered":"2024-09-12T18:57:27.473152+0000","last_clean":"2024-09-12T18:57:27.473152+0000","last_became_active":"2024-09-12T17:40:24.151530+0000","last_became_peered":"2024-09-12T17:40:24.151530+0000","last_unstale":"2024-09-12T18:57:27.473152+0000","last_undegraded":"2024-09-12T18:57:27.473152+0000","last_fullsized":"2024-09-12T18:57:27.473152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:13.980036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457196+0000","last_change":"2024-09-12T17:40:26.187903+0000","last_active":"2024-09-12T18:57:27.457196+0000","last_peered":"2024-09-12T18:57:27.457196+0000","last_clean":"2024-09-12T18:57:27.457196+0000","last_became_active":"2024-09-12T17:40:26.187122+0000","last_became_peered":"2024-09-12T17:40:26.187122+0000","last_unstale":"2024-09-12T18:57:27.457196+0000","last_undegraded":"2024-09-12T18:57:27.457196+0000","last_fullsized":"2024-09-12T18:57:27.457196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:36.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'248","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.372703+0000","last_change":"2024-09-12T17:40:28.194923+0000","last_active":"2024-09-12T18:58:04.372703+0000","last_peered":"2024-09-12T18:58:04.372703+0000","last_clean":"2024-09-12T18:58:04.372703+0000","last_became_active":"2024-09-12T17:40:28.194047+0000","last_became_peered":"2024-09-12T17:40:28.194047+0000","last_unstale":"2024-09-12T18:58:04.372703+0000","last_undegraded":"2024-09-12T18:58:04.372703+0000","last_fullsized":"2024-09-12T18:58:04.372703+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:44.148991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":352,"num_write":540,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'120","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.457021+0000","last_change":"2024-09-12T17:40:20.130891+0000","last_active":"2024-09-12T18:57:22.457021+0000","last_peered":"2024-09-12T18:57:22.457021+0000","last_clean":"2024-09-12T18:57:22.457021+0000","last_became_active":"2024-09-12T17:40:20.130567+0000","last_became_peered":"2024-09-12T17:40:20.130567+0000","last_unstale":"2024-09-12T18:57:22.457021+0000","last_undegraded":"2024-09-12T18:57:22.457021+0000","last_fullsized":"2024-09-12T18:57:22.457021+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:59.283457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":440,"num_write":198,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'393","reported_seq":1069,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.063497+0000","last_change":"2024-09-12T17:40:18.781889+0000","last_active":"2024-09-12T19:00:00.063497+0000","last_peered":"2024-09-12T19:00:00.063497+0000","last_clean":"2024-09-12T19:00:00.063497+0000","last_became_active":"2024-09-12T17:40:18.781135+0000","last_became_peered":"2024-09-12T17:40:18.781135+0000","last_unstale":"2024-09-12T19:00:00.063497+0000","last_undegraded":"2024-09-12T19:00:00.063497+0000","last_fullsized":"2024-09-12T19:00:00.063497+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:39.897090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306781,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":11928,"num_write":1198,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456026+0000","last_change":"2024-09-12T17:40:22.151655+0000","last_active":"2024-09-12T18:57:22.456026+0000","last_peered":"2024-09-12T18:57:22.456026+0000","last_clean":"2024-09-12T18:57:22.456026+0000","last_became_active":"2024-09-12T17:40:22.150912+0000","last_became_peered":"2024-09-12T17:40:22.150912+0000","last_unstale":"2024-09-12T18:57:22.456026+0000","last_undegraded":"2024-09-12T18:57:22.456026+0000","last_fullsized":"2024-09-12T18:57:22.456026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:49.335095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'342","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.319988+0000","last_change":"2024-09-12T17:40:24.177728+0000","last_active":"2024-09-12T18:59:59.319988+0000","last_peered":"2024-09-12T18:59:59.319988+0000","last_clean":"2024-09-12T18:59:59.319988+0000","last_became_active":"2024-09-12T17:40:24.176722+0000","last_became_peered":"2024-09-12T17:40:24.176722+0000","last_unstale":"2024-09-12T18:59:59.319988+0000","last_undegraded":"2024-09-12T18:59:59.319988+0000","last_fullsized":"2024-09-12T18:59:59.319988+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.865870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48896,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":559,"num_read_kb":1238,"num_write":442,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443157+0000","last_change":"2024-09-12T17:40:26.168192+0000","last_active":"2024-09-12T18:57:27.443157+0000","last_peered":"2024-09-12T18:57:27.443157+0000","last_clean":"2024-09-12T18:57:27.443157+0000","last_became_active":"2024-09-12T17:40:26.167280+0000","last_became_peered":"2024-09-12T17:40:26.167280+0000","last_unstale":"2024-09-12T18:57:27.443157+0000","last_undegraded":"2024-09-12T18:57:27.443157+0000","last_fullsized":"2024-09-12T18:57:27.443157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:03.370653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'106","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.559076+0000","last_change":"2024-09-12T17:40:28.194951+0000","last_active":"2024-09-12T18:58:04.559076+0000","last_peered":"2024-09-12T18:58:04.559076+0000","last_clean":"2024-09-12T18:58:04.559076+0000","last_became_active":"2024-09-12T17:40:28.192629+0000","last_became_peered":"2024-09-12T17:40:28.192629+0000","last_unstale":"2024-09-12T18:58:04.559076+0000","last_undegraded":"2024-09-12T18:58:04.559076+0000","last_fullsized":"2024-09-12T18:58:04.559076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:40.252151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456946+0000","last_change":"2024-09-12T17:40:55.302689+0000","last_active":"2024-09-12T18:57:22.456946+0000","last_peered":"2024-09-12T18:57:22.456946+0000","last_clean":"2024-09-12T18:57:22.456946+0000","last_became_active":"2024-09-12T17:40:55.301950+0000","last_became_peered":"2024-09-12T17:40:55.301950+0000","last_unstale":"2024-09-12T18:57:22.456946+0000","last_undegraded":"2024-09-12T18:57:22.456946+0000","last_fullsized":"2024-09-12T18:57:22.456946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.652662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":400,"num_write":158,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'401","reported_seq":1066,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.063158+0000","last_change":"2024-09-12T17:40:18.755957+0000","last_active":"2024-09-12T19:00:00.063158+0000","last_peered":"2024-09-12T19:00:00.063158+0000","last_clean":"2024-09-12T19:00:00.063158+0000","last_became_active":"2024-09-12T17:40:18.755694+0000","last_became_peered":"2024-09-12T17:40:18.755694+0000","last_unstale":"2024-09-12T19:00:00.063158+0000","last_undegraded":"2024-09-12T19:00:00.063158+0000","last_fullsized":"2024-09-12T19:00:00.063158+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:08.561309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194332,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":35553,"num_write":1273,"num_write_kb":53517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.442028+0000","last_change":"2024-09-12T17:40:22.136120+0000","last_active":"2024-09-12T18:57:22.442028+0000","last_peered":"2024-09-12T18:57:22.442028+0000","last_clean":"2024-09-12T18:57:22.442028+0000","last_became_active":"2024-09-12T17:40:22.135547+0000","last_became_peered":"2024-09-12T17:40:22.135547+0000","last_unstale":"2024-09-12T18:57:22.442028+0000","last_undegraded":"2024-09-12T18:57:22.442028+0000","last_fullsized":"2024-09-12T18:57:22.442028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:28.203301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'309","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.205374+0000","last_change":"2024-09-12T17:40:24.163735+0000","last_active":"2024-09-12T18:59:59.205374+0000","last_peered":"2024-09-12T18:59:59.205374+0000","last_clean":"2024-09-12T18:59:59.205374+0000","last_became_active":"2024-09-12T17:40:24.162901+0000","last_became_peered":"2024-09-12T17:40:24.162901+0000","last_unstale":"2024-09-12T18:59:59.205374+0000","last_undegraded":"2024-09-12T18:59:59.205374+0000","last_fullsized":"2024-09-12T18:59:59.205374+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:08.268660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51001,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1227,"num_write":416,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473259+0000","last_change":"2024-09-12T17:40:26.191520+0000","last_active":"2024-09-12T18:57:27.473259+0000","last_peered":"2024-09-12T18:57:27.473259+0000","last_clean":"2024-09-12T18:57:27.473259+0000","last_became_active":"2024-09-12T17:40:26.190755+0000","last_became_peered":"2024-09-12T17:40:26.190755+0000","last_unstale":"2024-09-12T18:57:27.473259+0000","last_undegraded":"2024-09-12T18:57:27.473259+0000","last_fullsized":"2024-09-12T18:57:27.473259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:00.734100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'428","reported_seq":1192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443251+0000","last_change":"2024-09-12T17:40:20.128385+0000","last_active":"2024-09-12T18:57:27.443251+0000","last_peered":"2024-09-12T18:57:27.443251+0000","last_clean":"2024-09-12T18:57:27.443251+0000","last_became_active":"2024-09-12T17:40:20.127413+0000","last_became_peered":"2024-09-12T17:40:20.127413+0000","last_unstale":"2024-09-12T18:57:27.443251+0000","last_undegraded":"2024-09-12T18:57:27.443251+0000","last_fullsized":"2024-09-12T18:57:27.443251+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:36.669281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2096,"num_read_kb":1807,"num_write":754,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'338","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.066006+0000","last_change":"2024-09-12T17:40:18.759774+0000","last_active":"2024-09-12T19:00:00.066006+0000","last_peered":"2024-09-12T19:00:00.066006+0000","last_clean":"2024-09-12T19:00:00.066006+0000","last_became_active":"2024-09-12T17:40:18.759467+0000","last_became_peered":"2024-09-12T17:40:18.759467+0000","last_unstale":"2024-09-12T19:00:00.066006+0000","last_undegraded":"2024-09-12T19:00:00.066006+0000","last_fullsized":"2024-09-12T19:00:00.066006+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:33.483800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399269,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":67738,"num_write":1092,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.462225+0000","last_change":"2024-09-12T17:40:22.144503+0000","last_active":"2024-09-12T18:56:37.462225+0000","last_peered":"2024-09-12T18:56:37.462225+0000","last_clean":"2024-09-12T18:56:37.462225+0000","last_became_active":"2024-09-12T17:40:22.143764+0000","last_became_peered":"2024-09-12T17:40:22.143764+0000","last_unstale":"2024-09-12T18:56:37.462225+0000","last_undegraded":"2024-09-12T18:56:37.462225+0000","last_fullsized":"2024-09-12T18:56:37.462225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:07.658407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'539","reported_seq":1186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.971899+0000","last_change":"2024-09-12T17:40:24.179162+0000","last_active":"2024-09-12T18:59:59.971899+0000","last_peered":"2024-09-12T18:59:59.971899+0000","last_clean":"2024-09-12T18:59:59.971899+0000","last_became_active":"2024-09-12T17:40:24.178354+0000","last_became_peered":"2024-09-12T17:40:24.178354+0000","last_unstale":"2024-09-12T18:59:59.971899+0000","last_undegraded":"2024-09-12T18:59:59.971899+0000","last_fullsized":"2024-09-12T18:59:59.971899+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:39.728053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110471,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":953,"num_read_kb":2361,"num_write":826,"num_write_kb":742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.612487+0000","last_change":"2024-09-12T17:40:26.185364+0000","last_active":"2024-09-12T18:55:27.612487+0000","last_peered":"2024-09-12T18:55:27.612487+0000","last_clean":"2024-09-12T18:55:27.612487+0000","last_became_active":"2024-09-12T17:40:26.184572+0000","last_became_peered":"2024-09-12T17:40:26.184572+0000","last_unstale":"2024-09-12T18:55:27.612487+0000","last_undegraded":"2024-09-12T18:55:27.612487+0000","last_fullsized":"2024-09-12T18:55:27.612487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:35.867018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'243","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:05.971764+0000","last_change":"2024-09-12T17:40:28.201022+0000","last_active":"2024-09-12T18:58:05.971764+0000","last_peered":"2024-09-12T18:58:05.971764+0000","last_clean":"2024-09-12T18:58:05.971764+0000","last_became_active":"2024-09-12T17:40:28.200289+0000","last_became_peered":"2024-09-12T17:40:28.200289+0000","last_unstale":"2024-09-12T18:58:05.971764+0000","last_undegraded":"2024-09-12T18:58:05.971764+0000","last_fullsized":"2024-09-12T18:58:05.971764+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:57.750960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":402,"num_read_kb":380,"num_write":484,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'278","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.462201+0000","last_change":"2024-09-12T17:40:20.129095+0000","last_active":"2024-09-12T18:56:37.462201+0000","last_peered":"2024-09-12T18:56:37.462201+0000","last_clean":"2024-09-12T18:56:37.462201+0000","last_became_active":"2024-09-12T17:40:20.128840+0000","last_became_peered":"2024-09-12T17:40:20.128840+0000","last_unstale":"2024-09-12T18:56:37.462201+0000","last_undegraded":"2024-09-12T18:56:37.462201+0000","last_fullsized":"2024-09-12T18:56:37.462201+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:40.313847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1419,"num_read_kb":1187,"num_write":525,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'300","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.046194+0000","last_change":"2024-09-12T17:40:18.763123+0000","last_active":"2024-09-12T19:00:00.046194+0000","last_peered":"2024-09-12T19:00:00.046194+0000","last_clean":"2024-09-12T19:00:00.046194+0000","last_became_active":"2024-09-12T17:40:18.762421+0000","last_became_peered":"2024-09-12T17:40:18.762421+0000","last_unstale":"2024-09-12T19:00:00.046194+0000","last_undegraded":"2024-09-12T19:00:00.046194+0000","last_fullsized":"2024-09-12T19:00:00.046194+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:57.212684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":428,"num_read_kb":9963,"num_write":965,"num_write_kb":16756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443274+0000","last_change":"2024-09-12T17:40:22.134660+0000","last_active":"2024-09-12T18:57:27.443274+0000","last_peered":"2024-09-12T18:57:27.443274+0000","last_clean":"2024-09-12T18:57:27.443274+0000","last_became_active":"2024-09-12T17:40:22.133919+0000","last_became_peered":"2024-09-12T17:40:22.133919+0000","last_unstale":"2024-09-12T18:57:27.443274+0000","last_undegraded":"2024-09-12T18:57:27.443274+0000","last_fullsized":"2024-09-12T18:57:27.443274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:06.193287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'313","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.240235+0000","last_change":"2024-09-12T17:40:24.168575+0000","last_active":"2024-09-12T18:59:59.240235+0000","last_peered":"2024-09-12T18:59:59.240235+0000","last_clean":"2024-09-12T18:59:59.240235+0000","last_became_active":"2024-09-12T17:40:24.167870+0000","last_became_peered":"2024-09-12T17:40:24.167870+0000","last_unstale":"2024-09-12T18:59:59.240235+0000","last_undegraded":"2024-09-12T18:59:59.240235+0000","last_fullsized":"2024-09-12T18:59:59.240235+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:06.921434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50431,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":1079,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.438227+0000","last_change":"2024-09-12T17:40:26.199740+0000","last_active":"2024-09-12T18:55:27.438227+0000","last_peered":"2024-09-12T18:55:27.438227+0000","last_clean":"2024-09-12T18:55:27.438227+0000","last_became_active":"2024-09-12T17:40:26.199065+0000","last_became_peered":"2024-09-12T17:40:26.199065+0000","last_unstale":"2024-09-12T18:55:27.438227+0000","last_undegraded":"2024-09-12T18:55:27.438227+0000","last_fullsized":"2024-09-12T18:55:27.438227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:29.279788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'184","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:00.492872+0000","last_change":"2024-09-12T17:40:28.193740+0000","last_active":"2024-09-12T18:58:00.492872+0000","last_peered":"2024-09-12T18:58:00.492872+0000","last_clean":"2024-09-12T18:58:00.492872+0000","last_became_active":"2024-09-12T17:40:28.192588+0000","last_became_peered":"2024-09-12T17:40:28.192588+0000","last_unstale":"2024-09-12T18:58:00.492872+0000","last_undegraded":"2024-09-12T18:58:00.492872+0000","last_fullsized":"2024-09-12T18:58:00.492872+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:35.257214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":737,"num_read_kb":706,"num_write":515,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'254","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:55.231898+0000","last_change":"2024-09-12T17:40:20.133443+0000","last_active":"2024-09-12T18:56:55.231898+0000","last_peered":"2024-09-12T18:56:55.231898+0000","last_clean":"2024-09-12T18:56:55.231898+0000","last_became_active":"2024-09-12T17:40:20.133067+0000","last_became_peered":"2024-09-12T17:40:20.133067+0000","last_unstale":"2024-09-12T18:56:55.231898+0000","last_undegraded":"2024-09-12T18:56:55.231898+0000","last_fullsized":"2024-09-12T18:56:55.231898+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:22.211007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1200,"num_read_kb":1015,"num_write":444,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'341","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.062342+0000","last_change":"2024-09-12T17:40:18.773839+0000","last_active":"2024-09-12T19:00:00.062342+0000","last_peered":"2024-09-12T19:00:00.062342+0000","last_clean":"2024-09-12T19:00:00.062342+0000","last_became_active":"2024-09-12T17:40:18.773029+0000","last_became_peered":"2024-09-12T17:40:18.773029+0000","last_unstale":"2024-09-12T19:00:00.062342+0000","last_undegraded":"2024-09-12T19:00:00.062342+0000","last_fullsized":"2024-09-12T19:00:00.062342+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:13.992637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5769265,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":426,"num_read_kb":38404,"num_write":1086,"num_write_kb":31393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.793065+0000","last_change":"2024-09-12T17:40:22.146616+0000","last_active":"2024-09-12T18:55:22.793065+0000","last_peered":"2024-09-12T18:55:22.793065+0000","last_clean":"2024-09-12T18:55:22.793065+0000","last_became_active":"2024-09-12T17:40:22.145871+0000","last_became_peered":"2024-09-12T17:40:22.145871+0000","last_unstale":"2024-09-12T18:55:22.793065+0000","last_undegraded":"2024-09-12T18:55:22.793065+0000","last_fullsized":"2024-09-12T18:55:22.793065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:17.363777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'308","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.897217+0000","last_change":"2024-09-12T17:40:24.330122+0000","last_active":"2024-09-12T18:59:59.897217+0000","last_peered":"2024-09-12T18:59:59.897217+0000","last_clean":"2024-09-12T18:59:59.897217+0000","last_became_active":"2024-09-12T17:40:24.329413+0000","last_became_peered":"2024-09-12T17:40:24.329413+0000","last_unstale":"2024-09-12T18:59:59.897217+0000","last_undegraded":"2024-09-12T18:59:59.897217+0000","last_fullsized":"2024-09-12T18:59:59.897217+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:11.778689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47334,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1206,"num_write":420,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.455205+0000","last_change":"2024-09-12T17:40:26.199588+0000","last_active":"2024-09-12T18:56:47.455205+0000","last_peered":"2024-09-12T18:56:47.455205+0000","last_clean":"2024-09-12T18:56:47.455205+0000","last_became_active":"2024-09-12T17:40:26.198930+0000","last_became_peered":"2024-09-12T17:40:26.198930+0000","last_unstale":"2024-09-12T18:56:47.455205+0000","last_undegraded":"2024-09-12T18:56:47.455205+0000","last_fullsized":"2024-09-12T18:56:47.455205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:48.763531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'117","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.763203+0000","last_change":"2024-09-12T17:40:28.194240+0000","last_active":"2024-09-12T18:59:27.763203+0000","last_peered":"2024-09-12T18:59:27.763203+0000","last_clean":"2024-09-12T18:59:27.763203+0000","last_became_active":"2024-09-12T17:40:28.192689+0000","last_became_peered":"2024-09-12T17:40:28.192689+0000","last_unstale":"2024-09-12T18:59:27.763203+0000","last_undegraded":"2024-09-12T18:59:27.763203+0000","last_fullsized":"2024-09-12T18:59:27.763203+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:53.085665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":258,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'197","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:19.424791+0000","last_change":"2024-09-12T17:40:20.133429+0000","last_active":"2024-09-12T18:55:19.424791+0000","last_peered":"2024-09-12T18:55:19.424791+0000","last_clean":"2024-09-12T18:55:19.424791+0000","last_became_active":"2024-09-12T17:40:20.132998+0000","last_became_peered":"2024-09-12T17:40:20.132998+0000","last_unstale":"2024-09-12T18:55:19.424791+0000","last_undegraded":"2024-09-12T18:55:19.424791+0000","last_fullsized":"2024-09-12T18:55:19.424791+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:53.514892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":791,"num_read_kb":641,"num_write":284,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'444","reported_seq":1187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.078955+0000","last_change":"2024-09-12T17:40:18.775765+0000","last_active":"2024-09-12T19:00:00.078955+0000","last_peered":"2024-09-12T19:00:00.078955+0000","last_clean":"2024-09-12T19:00:00.078955+0000","last_became_active":"2024-09-12T17:40:18.774892+0000","last_became_peered":"2024-09-12T17:40:18.774892+0000","last_unstale":"2024-09-12T19:00:00.078955+0000","last_undegraded":"2024-09-12T19:00:00.078955+0000","last_fullsized":"2024-09-12T19:00:00.078955+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:12.027391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":517958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":741,"num_read_kb":87834,"num_write":1424,"num_write_kb":30285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.437110+0000","last_change":"2024-09-12T17:40:22.142115+0000","last_active":"2024-09-12T18:55:22.437110+0000","last_peered":"2024-09-12T18:55:22.437110+0000","last_clean":"2024-09-12T18:55:22.437110+0000","last_became_active":"2024-09-12T17:40:22.141670+0000","last_became_peered":"2024-09-12T17:40:22.141670+0000","last_unstale":"2024-09-12T18:55:22.437110+0000","last_undegraded":"2024-09-12T18:55:22.437110+0000","last_fullsized":"2024-09-12T18:55:22.437110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:01.417527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'131","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.809263+0000","last_change":"2024-09-12T17:40:24.330200+0000","last_active":"2024-09-12T18:56:37.809263+0000","last_peered":"2024-09-12T18:56:37.809263+0000","last_clean":"2024-09-12T18:56:37.809263+0000","last_became_active":"2024-09-12T17:40:24.329446+0000","last_became_peered":"2024-09-12T17:40:24.329446+0000","last_unstale":"2024-09-12T18:56:37.809263+0000","last_undegraded":"2024-09-12T18:56:37.809263+0000","last_fullsized":"2024-09-12T18:56:37.809263+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:39.604725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'753","reported_seq":4496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.711806+0000","last_change":"2024-09-12T17:40:26.193089+0000","last_active":"2024-09-12T18:59:58.711806+0000","last_peered":"2024-09-12T18:59:58.711806+0000","last_clean":"2024-09-12T18:59:58.711806+0000","last_became_active":"2024-09-12T17:40:26.192341+0000","last_became_peered":"2024-09-12T17:40:26.192341+0000","last_unstale":"2024-09-12T18:59:58.711806+0000","last_undegraded":"2024-09-12T18:59:58.711806+0000","last_fullsized":"2024-09-12T18:59:58.711806+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:04.649327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'116","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457136+0000","last_change":"2024-09-12T17:40:28.187817+0000","last_active":"2024-09-12T18:57:27.457136+0000","last_peered":"2024-09-12T18:57:27.457136+0000","last_clean":"2024-09-12T18:57:27.457136+0000","last_became_active":"2024-09-12T17:40:28.187089+0000","last_became_peered":"2024-09-12T17:40:28.187089+0000","last_unstale":"2024-09-12T18:57:27.457136+0000","last_undegraded":"2024-09-12T18:57:27.457136+0000","last_fullsized":"2024-09-12T18:57:27.457136+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:39.669386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'387","reported_seq":1131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.792997+0000","last_change":"2024-09-12T17:40:20.143118+0000","last_active":"2024-09-12T18:55:22.792997+0000","last_peered":"2024-09-12T18:55:22.792997+0000","last_clean":"2024-09-12T18:55:22.792997+0000","last_became_active":"2024-09-12T17:40:20.142478+0000","last_became_peered":"2024-09-12T17:40:20.142478+0000","last_unstale":"2024-09-12T18:55:22.792997+0000","last_undegraded":"2024-09-12T18:55:22.792997+0000","last_fullsized":"2024-09-12T18:55:22.792997+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:38.246221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1845,"num_read_kb":1583,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'339","reported_seq":1164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.030474+0000","last_change":"2024-09-12T17:40:55.331083+0000","last_active":"2024-09-12T19:00:00.030474+0000","last_peered":"2024-09-12T19:00:00.030474+0000","last_clean":"2024-09-12T19:00:00.030474+0000","last_became_active":"2024-09-12T17:40:55.330696+0000","last_became_peered":"2024-09-12T17:40:55.330696+0000","last_unstale":"2024-09-12T19:00:00.030474+0000","last_undegraded":"2024-09-12T19:00:00.030474+0000","last_fullsized":"2024-09-12T19:00:00.030474+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:46.573367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35759,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":915,"num_read_kb":9625,"num_write":1190,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427131+0000","last_change":"2024-09-12T17:40:22.152165+0000","last_active":"2024-09-12T18:55:22.427131+0000","last_peered":"2024-09-12T18:55:22.427131+0000","last_clean":"2024-09-12T18:55:22.427131+0000","last_became_active":"2024-09-12T17:40:22.151083+0000","last_became_peered":"2024-09-12T17:40:22.151083+0000","last_unstale":"2024-09-12T18:55:22.427131+0000","last_undegraded":"2024-09-12T18:55:22.427131+0000","last_fullsized":"2024-09-12T18:55:22.427131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:28.338986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'335","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.865580+0000","last_change":"2024-09-12T17:40:24.174149+0000","last_active":"2024-09-12T18:59:58.865580+0000","last_peered":"2024-09-12T18:59:58.865580+0000","last_clean":"2024-09-12T18:59:58.865580+0000","last_became_active":"2024-09-12T17:40:24.173360+0000","last_became_peered":"2024-09-12T17:40:24.173360+0000","last_unstale":"2024-09-12T18:59:58.865580+0000","last_undegraded":"2024-09-12T18:59:58.865580+0000","last_fullsized":"2024-09-12T18:59:58.865580+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:01.318365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61671,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":561,"num_read_kb":1233,"num_write":446,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.445804+0000","last_change":"2024-09-12T17:40:26.164532+0000","last_active":"2024-09-12T18:55:22.445804+0000","last_peered":"2024-09-12T18:55:22.445804+0000","last_clean":"2024-09-12T18:55:22.445804+0000","last_became_active":"2024-09-12T17:40:26.163773+0000","last_became_peered":"2024-09-12T17:40:26.163773+0000","last_unstale":"2024-09-12T18:55:22.445804+0000","last_undegraded":"2024-09-12T18:55:22.445804+0000","last_fullsized":"2024-09-12T18:55:22.445804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:29.445382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'102","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.270680+0000","last_change":"2024-09-12T17:40:28.199692+0000","last_active":"2024-09-12T18:58:02.270680+0000","last_peered":"2024-09-12T18:58:02.270680+0000","last_clean":"2024-09-12T18:58:02.270680+0000","last_became_active":"2024-09-12T17:40:28.198792+0000","last_became_peered":"2024-09-12T17:40:28.198792+0000","last_unstale":"2024-09-12T18:58:02.270680+0000","last_undegraded":"2024-09-12T18:58:02.270680+0000","last_fullsized":"2024-09-12T18:58:02.270680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:10.816115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":239,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'185","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.792933+0000","last_change":"2024-09-12T17:40:20.147084+0000","last_active":"2024-09-12T18:55:22.792933+0000","last_peered":"2024-09-12T18:55:22.792933+0000","last_clean":"2024-09-12T18:55:22.792933+0000","last_became_active":"2024-09-12T17:40:20.136564+0000","last_became_peered":"2024-09-12T17:40:20.136564+0000","last_unstale":"2024-09-12T18:55:22.792933+0000","last_undegraded":"2024-09-12T18:55:22.792933+0000","last_fullsized":"2024-09-12T18:55:22.792933+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:10.062006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":640,"num_write":266,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'418","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.065536+0000","last_change":"2024-09-12T17:40:18.782734+0000","last_active":"2024-09-12T19:00:00.065536+0000","last_peered":"2024-09-12T19:00:00.065536+0000","last_clean":"2024-09-12T19:00:00.065536+0000","last_became_active":"2024-09-12T17:40:18.779946+0000","last_became_peered":"2024-09-12T17:40:18.779946+0000","last_unstale":"2024-09-12T19:00:00.065536+0000","last_undegraded":"2024-09-12T19:00:00.065536+0000","last_fullsized":"2024-09-12T19:00:00.065536+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:48.387265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1239867,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":711,"num_read_kb":21197,"num_write":1193,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.611277+0000","last_change":"2024-09-12T17:40:22.138047+0000","last_active":"2024-09-12T18:55:22.611277+0000","last_peered":"2024-09-12T18:55:22.611277+0000","last_clean":"2024-09-12T18:55:22.611277+0000","last_became_active":"2024-09-12T17:40:22.137291+0000","last_became_peered":"2024-09-12T17:40:22.137291+0000","last_unstale":"2024-09-12T18:55:22.611277+0000","last_undegraded":"2024-09-12T18:55:22.611277+0000","last_fullsized":"2024-09-12T18:55:22.611277+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:51.771726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'264","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.918563+0000","last_change":"2024-09-12T17:40:24.175430+0000","last_active":"2024-09-12T18:59:58.918563+0000","last_peered":"2024-09-12T18:59:58.918563+0000","last_clean":"2024-09-12T18:59:58.918563+0000","last_became_active":"2024-09-12T17:40:24.174681+0000","last_became_peered":"2024-09-12T17:40:24.174681+0000","last_unstale":"2024-09-12T18:59:58.918563+0000","last_undegraded":"2024-09-12T18:59:58.918563+0000","last_fullsized":"2024-09-12T18:59:58.918563+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:33.406641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51960,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":993,"num_write":344,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421121+0000","last_change":"2024-09-12T17:40:26.188512+0000","last_active":"2024-09-12T18:55:42.421121+0000","last_peered":"2024-09-12T18:55:42.421121+0000","last_clean":"2024-09-12T18:55:42.421121+0000","last_became_active":"2024-09-12T17:40:26.187438+0000","last_became_peered":"2024-09-12T17:40:26.187438+0000","last_unstale":"2024-09-12T18:55:42.421121+0000","last_undegraded":"2024-09-12T18:55:42.421121+0000","last_fullsized":"2024-09-12T18:55:42.421121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:20.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'124","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:22.427909+0000","last_change":"2024-09-12T17:40:28.202550+0000","last_active":"2024-09-12T18:55:22.427909+0000","last_peered":"2024-09-12T18:55:22.427909+0000","last_clean":"2024-09-12T18:55:22.427909+0000","last_became_active":"2024-09-12T17:40:28.201534+0000","last_became_peered":"2024-09-12T17:40:28.201534+0000","last_unstale":"2024-09-12T18:55:22.427909+0000","last_undegraded":"2024-09-12T18:55:22.427909+0000","last_fullsized":"2024-09-12T18:55:22.427909+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:43.430181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":291,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'52","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:37.431358+0000","last_change":"2024-09-12T17:40:20.117919+0000","last_active":"2024-09-12T18:55:37.431358+0000","last_peered":"2024-09-12T18:55:37.431358+0000","last_clean":"2024-09-12T18:55:37.431358+0000","last_became_active":"2024-09-12T17:40:20.117604+0000","last_became_peered":"2024-09-12T17:40:20.117604+0000","last_unstale":"2024-09-12T18:55:37.431358+0000","last_undegraded":"2024-09-12T18:55:37.431358+0000","last_fullsized":"2024-09-12T18:55:37.431358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:01.530409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":67,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'324","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.061121+0000","last_change":"2024-09-12T17:40:18.767654+0000","last_active":"2024-09-12T19:00:00.061121+0000","last_peered":"2024-09-12T19:00:00.061121+0000","last_clean":"2024-09-12T19:00:00.061121+0000","last_became_active":"2024-09-12T17:40:18.767103+0000","last_became_peered":"2024-09-12T17:40:18.767103+0000","last_unstale":"2024-09-12T19:00:00.061121+0000","last_undegraded":"2024-09-12T19:00:00.061121+0000","last_fullsized":"2024-09-12T19:00:00.061121+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:13.247336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097225,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":436,"num_read_kb":34280,"num_write":1068,"num_write_kb":41945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.791546+0000","last_change":"2024-09-12T17:40:22.135061+0000","last_active":"2024-09-12T18:55:17.791546+0000","last_peered":"2024-09-12T18:55:17.791546+0000","last_clean":"2024-09-12T18:55:17.791546+0000","last_became_active":"2024-09-12T17:40:22.134242+0000","last_became_peered":"2024-09-12T17:40:22.134242+0000","last_unstale":"2024-09-12T18:55:17.791546+0000","last_undegraded":"2024-09-12T18:55:17.791546+0000","last_fullsized":"2024-09-12T18:55:17.791546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:19.741434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'239","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.826054+0000","last_change":"2024-09-12T17:40:24.183504+0000","last_active":"2024-09-12T18:59:59.826054+0000","last_peered":"2024-09-12T18:59:59.826054+0000","last_clean":"2024-09-12T18:59:59.826054+0000","last_became_active":"2024-09-12T17:40:24.181581+0000","last_became_peered":"2024-09-12T17:40:24.181581+0000","last_unstale":"2024-09-12T18:59:59.826054+0000","last_undegraded":"2024-09-12T18:59:59.826054+0000","last_fullsized":"2024-09-12T18:59:59.826054+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:34.205562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":967,"num_write":316,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.794291+0000","last_change":"2024-09-12T17:40:26.196580+0000","last_active":"2024-09-12T18:55:27.794291+0000","last_peered":"2024-09-12T18:55:27.794291+0000","last_clean":"2024-09-12T18:55:27.794291+0000","last_became_active":"2024-09-12T17:40:26.195603+0000","last_became_peered":"2024-09-12T17:40:26.195603+0000","last_unstale":"2024-09-12T18:55:27.794291+0000","last_undegraded":"2024-09-12T18:55:27.794291+0000","last_fullsized":"2024-09-12T18:55:27.794291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:00.612716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'168","reported_seq":1281,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:00.089777+0000","last_change":"2024-09-12T17:40:28.200915+0000","last_active":"2024-09-12T18:58:00.089777+0000","last_peered":"2024-09-12T18:58:00.089777+0000","last_clean":"2024-09-12T18:58:00.089777+0000","last_became_active":"2024-09-12T17:40:28.200126+0000","last_became_peered":"2024-09-12T17:40:28.200126+0000","last_unstale":"2024-09-12T18:58:00.089777+0000","last_undegraded":"2024-09-12T18:58:00.089777+0000","last_fullsized":"2024-09-12T18:58:00.089777+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:27.740825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":872,"num_read_kb":859,"num_write":427,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'166","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:30.310895+0000","last_change":"2024-09-12T17:40:20.135214+0000","last_active":"2024-09-12T18:55:30.310895+0000","last_peered":"2024-09-12T18:55:30.310895+0000","last_clean":"2024-09-12T18:55:30.310895+0000","last_became_active":"2024-09-12T17:40:20.131459+0000","last_became_peered":"2024-09-12T17:40:20.131459+0000","last_unstale":"2024-09-12T18:55:30.310895+0000","last_undegraded":"2024-09-12T18:55:30.310895+0000","last_fullsized":"2024-09-12T18:55:30.310895+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:02.260304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":677,"num_write":293,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'334","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.070619+0000","last_change":"2024-09-12T17:40:18.773986+0000","last_active":"2024-09-12T19:00:00.070619+0000","last_peered":"2024-09-12T19:00:00.070619+0000","last_clean":"2024-09-12T19:00:00.070619+0000","last_became_active":"2024-09-12T17:40:18.773667+0000","last_became_peered":"2024-09-12T17:40:18.773667+0000","last_unstale":"2024-09-12T19:00:00.070619+0000","last_undegraded":"2024-09-12T19:00:00.070619+0000","last_fullsized":"2024-09-12T19:00:00.070619+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:09.724574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263633,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":554,"num_read_kb":8714,"num_write":1079,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"35'4","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.673801+0000","last_change":"2024-09-12T17:40:22.141628+0000","last_active":"2024-09-12T18:59:58.673801+0000","last_peered":"2024-09-12T18:59:58.673801+0000","last_clean":"2024-09-12T18:59:58.673801+0000","last_became_active":"2024-09-12T17:40:22.141182+0000","last_became_peered":"2024-09-12T17:40:22.141182+0000","last_unstale":"2024-09-12T18:59:58.673801+0000","last_undegraded":"2024-09-12T18:59:58.673801+0000","last_fullsized":"2024-09-12T18:59:58.673801+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:38.121269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'306","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.929903+0000","last_change":"2024-09-12T17:40:24.167135+0000","last_active":"2024-09-12T18:59:59.929903+0000","last_peered":"2024-09-12T18:59:59.929903+0000","last_clean":"2024-09-12T18:59:59.929903+0000","last_became_active":"2024-09-12T17:40:24.166330+0000","last_became_peered":"2024-09-12T17:40:24.166330+0000","last_unstale":"2024-09-12T18:59:59.929903+0000","last_undegraded":"2024-09-12T18:59:59.929903+0000","last_fullsized":"2024-09-12T18:59:59.929903+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.549312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51905,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1128,"num_write":400,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.447210+0000","last_change":"2024-09-12T17:40:26.189177+0000","last_active":"2024-09-12T18:55:27.447210+0000","last_peered":"2024-09-12T18:55:27.447210+0000","last_clean":"2024-09-12T18:55:27.447210+0000","last_became_active":"2024-09-12T17:40:26.188351+0000","last_became_peered":"2024-09-12T17:40:26.188351+0000","last_unstale":"2024-09-12T18:55:27.447210+0000","last_undegraded":"2024-09-12T18:55:27.447210+0000","last_fullsized":"2024-09-12T18:55:27.447210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:14.730369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'136","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.601050+0000","last_change":"2024-09-12T17:40:28.180850+0000","last_active":"2024-09-12T18:59:26.601050+0000","last_peered":"2024-09-12T18:59:26.601050+0000","last_clean":"2024-09-12T18:59:26.601050+0000","last_became_active":"2024-09-12T17:40:28.180148+0000","last_became_peered":"2024-09-12T17:40:28.180148+0000","last_unstale":"2024-09-12T18:59:26.601050+0000","last_undegraded":"2024-09-12T18:59:26.601050+0000","last_fullsized":"2024-09-12T18:59:26.601050+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:56.213405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":171,"num_read_kb":158,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'174","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447667+0000","last_change":"2024-09-12T17:40:20.127371+0000","last_active":"2024-09-12T18:56:12.447667+0000","last_peered":"2024-09-12T18:56:12.447667+0000","last_clean":"2024-09-12T18:56:12.447667+0000","last_became_active":"2024-09-12T17:40:20.127006+0000","last_became_peered":"2024-09-12T17:40:20.127006+0000","last_unstale":"2024-09-12T18:56:12.447667+0000","last_undegraded":"2024-09-12T18:56:12.447667+0000","last_fullsized":"2024-09-12T18:56:12.447667+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:28.267156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":779,"num_read_kb":649,"num_write":260,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'319","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.066964+0000","last_change":"2024-09-12T17:40:18.759600+0000","last_active":"2024-09-12T19:00:00.066964+0000","last_peered":"2024-09-12T19:00:00.066964+0000","last_clean":"2024-09-12T19:00:00.066964+0000","last_became_active":"2024-09-12T17:40:18.757444+0000","last_became_peered":"2024-09-12T17:40:18.757444+0000","last_unstale":"2024-09-12T19:00:00.066964+0000","last_undegraded":"2024-09-12T19:00:00.066964+0000","last_fullsized":"2024-09-12T19:00:00.066964+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:50.933887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194355,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":91614,"num_write":1080,"num_write_kb":46187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'4205","reported_seq":4819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447609+0000","last_change":"2024-09-12T17:40:20.125927+0000","last_active":"2024-09-12T18:56:12.447609+0000","last_peered":"2024-09-12T18:56:12.447609+0000","last_clean":"2024-09-12T18:56:12.447609+0000","last_became_active":"2024-09-12T17:40:20.125586+0000","last_became_peered":"2024-09-12T17:40:20.125586+0000","last_unstale":"2024-09-12T18:56:12.447609+0000","last_undegraded":"2024-09-12T18:56:12.447609+0000","last_fullsized":"2024-09-12T18:56:12.447609+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":3000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:28.284212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16904,"num_read_kb":14161,"num_write":6332,"num_write_kb":3161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'321","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.080586+0000","last_change":"2024-09-12T17:40:18.754599+0000","last_active":"2024-09-12T19:00:00.080586+0000","last_peered":"2024-09-12T19:00:00.080586+0000","last_clean":"2024-09-12T19:00:00.080586+0000","last_became_active":"2024-09-12T17:40:18.754335+0000","last_became_peered":"2024-09-12T17:40:18.754335+0000","last_unstale":"2024-09-12T19:00:00.080586+0000","last_undegraded":"2024-09-12T19:00:00.080586+0000","last_fullsized":"2024-09-12T19:00:00.080586+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:31.973695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":433,"num_read_kb":13730,"num_write":1004,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'413","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.622495+0000","last_change":"2024-09-12T17:40:20.137604+0000","last_active":"2024-09-12T18:56:12.622495+0000","last_peered":"2024-09-12T18:56:12.622495+0000","last_clean":"2024-09-12T18:56:12.622495+0000","last_became_active":"2024-09-12T17:40:20.136831+0000","last_became_peered":"2024-09-12T17:40:20.136831+0000","last_unstale":"2024-09-12T18:56:12.622495+0000","last_undegraded":"2024-09-12T18:56:12.622495+0000","last_fullsized":"2024-09-12T18:56:12.622495+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:14.463672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1812,"num_read_kb":1536,"num_write":694,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'334","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.031263+0000","last_change":"2024-09-12T17:40:18.754536+0000","last_active":"2024-09-12T19:00:00.031263+0000","last_peered":"2024-09-12T19:00:00.031263+0000","last_clean":"2024-09-12T19:00:00.031263+0000","last_became_active":"2024-09-12T17:40:18.753576+0000","last_became_peered":"2024-09-12T17:40:18.753576+0000","last_unstale":"2024-09-12T19:00:00.031263+0000","last_undegraded":"2024-09-12T19:00:00.031263+0000","last_fullsized":"2024-09-12T19:00:00.031263+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:25.780872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":449,"num_read_kb":36529,"num_write":1017,"num_write_kb":32314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'363","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:18.053251+0000","last_change":"2024-09-12T17:40:20.133110+0000","last_active":"2024-09-12T18:57:18.053251+0000","last_peered":"2024-09-12T18:57:18.053251+0000","last_clean":"2024-09-12T18:57:18.053251+0000","last_became_active":"2024-09-12T17:40:20.132826+0000","last_became_peered":"2024-09-12T17:40:20.132826+0000","last_unstale":"2024-09-12T18:57:18.053251+0000","last_undegraded":"2024-09-12T18:57:18.053251+0000","last_fullsized":"2024-09-12T18:57:18.053251+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:07.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1596,"num_read_kb":1285,"num_write":598,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'344","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.060445+0000","last_change":"2024-09-12T17:40:18.755673+0000","last_active":"2024-09-12T19:00:00.060445+0000","last_peered":"2024-09-12T19:00:00.060445+0000","last_clean":"2024-09-12T19:00:00.060445+0000","last_became_active":"2024-09-12T17:40:18.754933+0000","last_became_peered":"2024-09-12T17:40:18.754933+0000","last_unstale":"2024-09-12T19:00:00.060445+0000","last_undegraded":"2024-09-12T19:00:00.060445+0000","last_fullsized":"2024-09-12T19:00:00.060445+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:43.716617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081897,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":46825,"num_write":1040,"num_write_kb":45673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'114","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.066485+0000","last_change":"2024-09-12T17:40:20.130446+0000","last_active":"2024-09-12T18:58:06.066485+0000","last_peered":"2024-09-12T18:58:06.066485+0000","last_clean":"2024-09-12T18:58:06.066485+0000","last_became_active":"2024-09-12T17:40:20.129769+0000","last_became_peered":"2024-09-12T17:40:20.129769+0000","last_unstale":"2024-09-12T18:58:06.066485+0000","last_undegraded":"2024-09-12T18:58:06.066485+0000","last_fullsized":"2024-09-12T18:58:06.066485+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:07.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":414,"num_write":175,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'348","reported_seq":1068,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.057237+0000","last_change":"2024-09-12T17:40:18.773850+0000","last_active":"2024-09-12T19:00:00.057237+0000","last_peered":"2024-09-12T19:00:00.057237+0000","last_clean":"2024-09-12T19:00:00.057237+0000","last_became_active":"2024-09-12T17:40:18.773052+0000","last_became_peered":"2024-09-12T17:40:18.773052+0000","last_unstale":"2024-09-12T19:00:00.057237+0000","last_undegraded":"2024-09-12T19:00:00.057237+0000","last_fullsized":"2024-09-12T19:00:00.057237+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:03.999190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2648214,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":619,"num_read_kb":23542,"num_write":1059,"num_write_kb":26208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'141","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820110+0000","last_change":"2024-09-12T17:40:20.149013+0000","last_active":"2024-09-12T18:57:27.820110+0000","last_peered":"2024-09-12T18:57:27.820110+0000","last_clean":"2024-09-12T18:57:27.820110+0000","last_became_active":"2024-09-12T17:40:20.146835+0000","last_became_peered":"2024-09-12T17:40:20.146835+0000","last_unstale":"2024-09-12T18:57:27.820110+0000","last_undegraded":"2024-09-12T18:57:27.820110+0000","last_fullsized":"2024-09-12T18:57:27.820110+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:22.211007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":516,"num_write":222,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'445","reported_seq":1219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.020912+0000","last_change":"2024-09-12T17:40:18.765218+0000","last_active":"2024-09-12T19:00:00.020912+0000","last_peered":"2024-09-12T19:00:00.020912+0000","last_clean":"2024-09-12T19:00:00.020912+0000","last_became_active":"2024-09-12T17:40:18.764545+0000","last_became_peered":"2024-09-12T17:40:18.764545+0000","last_unstale":"2024-09-12T19:00:00.020912+0000","last_undegraded":"2024-09-12T19:00:00.020912+0000","last_fullsized":"2024-09-12T19:00:00.020912+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:46.840426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263245,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":913,"num_read_kb":25412,"num_write":1371,"num_write_kb":29284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'206","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457994+0000","last_change":"2024-09-12T17:40:20.133394+0000","last_active":"2024-09-12T18:57:27.457994+0000","last_peered":"2024-09-12T18:57:27.457994+0000","last_clean":"2024-09-12T18:57:27.457994+0000","last_became_active":"2024-09-12T17:40:20.133055+0000","last_became_peered":"2024-09-12T17:40:20.133055+0000","last_unstale":"2024-09-12T18:57:27.457994+0000","last_undegraded":"2024-09-12T18:57:27.457994+0000","last_fullsized":"2024-09-12T18:57:27.457994+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:30.582322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":974,"num_read_kb":794,"num_write":355,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'329","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.002187+0000","last_change":"2024-09-12T17:40:18.765505+0000","last_active":"2024-09-12T19:00:00.002187+0000","last_peered":"2024-09-12T19:00:00.002187+0000","last_clean":"2024-09-12T19:00:00.002187+0000","last_became_active":"2024-09-12T17:40:18.764658+0000","last_became_peered":"2024-09-12T17:40:18.764658+0000","last_unstale":"2024-09-12T19:00:00.002187+0000","last_undegraded":"2024-09-12T19:00:00.002187+0000","last_fullsized":"2024-09-12T19:00:00.002187+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:18.339542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4856534,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":14122,"num_write":1065,"num_write_kb":26720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'195","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443066+0000","last_change":"2024-09-12T17:40:20.125114+0000","last_active":"2024-09-12T18:57:27.443066+0000","last_peered":"2024-09-12T18:57:27.443066+0000","last_clean":"2024-09-12T18:57:27.443066+0000","last_became_active":"2024-09-12T17:40:20.124247+0000","last_became_peered":"2024-09-12T17:40:20.124247+0000","last_unstale":"2024-09-12T18:57:27.443066+0000","last_undegraded":"2024-09-12T18:57:27.443066+0000","last_fullsized":"2024-09-12T18:57:27.443066+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:39.697115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":903,"num_read_kb":737,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'368","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.042325+0000","last_change":"2024-09-12T17:40:18.774283+0000","last_active":"2024-09-12T19:00:00.042325+0000","last_peered":"2024-09-12T19:00:00.042325+0000","last_clean":"2024-09-12T19:00:00.042325+0000","last_became_active":"2024-09-12T17:40:18.772776+0000","last_became_peered":"2024-09-12T17:40:18.772776+0000","last_unstale":"2024-09-12T19:00:00.042325+0000","last_undegraded":"2024-09-12T19:00:00.042325+0000","last_fullsized":"2024-09-12T19:00:00.042325+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:23.569697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":25353,"num_write":1144,"num_write_kb":19697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'233","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.472184+0000","last_change":"2024-09-12T17:40:20.116396+0000","last_active":"2024-09-12T18:57:22.472184+0000","last_peered":"2024-09-12T18:57:22.472184+0000","last_clean":"2024-09-12T18:57:22.472184+0000","last_became_active":"2024-09-12T17:40:20.116064+0000","last_became_peered":"2024-09-12T17:40:20.116064+0000","last_unstale":"2024-09-12T18:57:22.472184+0000","last_undegraded":"2024-09-12T18:57:22.472184+0000","last_fullsized":"2024-09-12T18:57:22.472184+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:07.387378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1004,"num_read_kb":824,"num_write":355,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'338","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.040586+0000","last_change":"2024-09-12T17:40:18.760207+0000","last_active":"2024-09-12T19:00:00.040586+0000","last_peered":"2024-09-12T19:00:00.040586+0000","last_clean":"2024-09-12T19:00:00.040586+0000","last_became_active":"2024-09-12T17:40:18.753693+0000","last_became_peered":"2024-09-12T17:40:18.753693+0000","last_unstale":"2024-09-12T19:00:00.040586+0000","last_undegraded":"2024-09-12T19:00:00.040586+0000","last_fullsized":"2024-09-12T19:00:00.040586+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:50.968987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194334,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":459,"num_read_kb":12118,"num_write":1082,"num_write_kb":50446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'82","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.819071+0000","last_change":"2024-09-12T17:40:20.130558+0000","last_active":"2024-09-12T18:57:22.819071+0000","last_peered":"2024-09-12T18:57:22.819071+0000","last_clean":"2024-09-12T18:57:22.819071+0000","last_became_active":"2024-09-12T17:40:20.129687+0000","last_became_peered":"2024-09-12T17:40:20.129687+0000","last_unstale":"2024-09-12T18:57:22.819071+0000","last_undegraded":"2024-09-12T18:57:22.819071+0000","last_fullsized":"2024-09-12T18:57:22.819071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:16.096110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":302,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'389","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.030244+0000","last_change":"2024-09-12T17:40:18.773313+0000","last_active":"2024-09-12T19:00:00.030244+0000","last_peered":"2024-09-12T19:00:00.030244+0000","last_clean":"2024-09-12T19:00:00.030244+0000","last_became_active":"2024-09-12T17:40:18.772969+0000","last_became_peered":"2024-09-12T17:40:18.772969+0000","last_unstale":"2024-09-12T19:00:00.030244+0000","last_undegraded":"2024-09-12T19:00:00.030244+0000","last_fullsized":"2024-09-12T19:00:00.030244+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:42.889939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242937,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":478,"num_read_kb":13353,"num_write":1113,"num_write_kb":30519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'211","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:09.446951+0000","last_change":"2024-09-12T17:40:20.130883+0000","last_active":"2024-09-12T18:57:09.446951+0000","last_peered":"2024-09-12T18:57:09.446951+0000","last_clean":"2024-09-12T18:57:09.446951+0000","last_became_active":"2024-09-12T17:40:20.130606+0000","last_became_peered":"2024-09-12T17:40:20.130606+0000","last_unstale":"2024-09-12T18:57:09.446951+0000","last_undegraded":"2024-09-12T18:57:09.446951+0000","last_fullsized":"2024-09-12T18:57:09.446951+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:31.071071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":765,"num_write":331,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'355","reported_seq":1129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.062859+0000","last_change":"2024-09-12T17:40:18.781646+0000","last_active":"2024-09-12T19:00:00.062859+0000","last_peered":"2024-09-12T19:00:00.062859+0000","last_clean":"2024-09-12T19:00:00.062859+0000","last_became_active":"2024-09-12T17:40:18.780861+0000","last_became_peered":"2024-09-12T17:40:18.780861+0000","last_unstale":"2024-09-12T19:00:00.062859+0000","last_undegraded":"2024-09-12T19:00:00.062859+0000","last_fullsized":"2024-09-12T19:00:00.062859+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:37.689644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747960,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":883,"num_read_kb":18830,"num_write":1183,"num_write_kb":42628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'422","reported_seq":1180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812440+0000","last_change":"2024-09-12T17:40:20.149871+0000","last_active":"2024-09-12T18:56:52.812440+0000","last_peered":"2024-09-12T18:56:52.812440+0000","last_clean":"2024-09-12T18:56:52.812440+0000","last_became_active":"2024-09-12T17:40:20.149176+0000","last_became_peered":"2024-09-12T17:40:20.149176+0000","last_unstale":"2024-09-12T18:56:52.812440+0000","last_undegraded":"2024-09-12T18:56:52.812440+0000","last_fullsized":"2024-09-12T18:56:52.812440+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.618043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2034,"num_read_kb":1768,"num_write":658,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'338","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.032715+0000","last_change":"2024-09-12T17:40:18.781947+0000","last_active":"2024-09-12T19:00:00.032715+0000","last_peered":"2024-09-12T19:00:00.032715+0000","last_clean":"2024-09-12T19:00:00.032715+0000","last_became_active":"2024-09-12T17:40:18.781543+0000","last_became_peered":"2024-09-12T17:40:18.781543+0000","last_unstale":"2024-09-12T19:00:00.032715+0000","last_undegraded":"2024-09-12T19:00:00.032715+0000","last_fullsized":"2024-09-12T19:00:00.032715+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:45.216097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457569,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":553,"num_read_kb":27146,"num_write":1120,"num_write_kb":17169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'186","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.449104+0000","last_change":"2024-09-12T17:40:20.133684+0000","last_active":"2024-09-12T18:56:52.449104+0000","last_peered":"2024-09-12T18:56:52.449104+0000","last_clean":"2024-09-12T18:56:52.449104+0000","last_became_active":"2024-09-12T17:40:20.132914+0000","last_became_peered":"2024-09-12T17:40:20.132914+0000","last_unstale":"2024-09-12T18:56:52.449104+0000","last_undegraded":"2024-09-12T18:56:52.449104+0000","last_fullsized":"2024-09-12T18:56:52.449104+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:10.481286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":685,"num_write":286,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'417","reported_seq":1132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.071286+0000","last_change":"2024-09-12T17:40:18.774804+0000","last_active":"2024-09-12T19:00:00.071286+0000","last_peered":"2024-09-12T19:00:00.071286+0000","last_clean":"2024-09-12T19:00:00.071286+0000","last_became_active":"2024-09-12T17:40:18.773572+0000","last_became_peered":"2024-09-12T17:40:18.773572+0000","last_unstale":"2024-09-12T19:00:00.071286+0000","last_undegraded":"2024-09-12T19:00:00.071286+0000","last_fullsized":"2024-09-12T19:00:00.071286+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:04.216779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":27791,"num_write":1413,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'106","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.465444+0000","last_change":"2024-09-12T17:40:20.125236+0000","last_active":"2024-09-12T18:56:52.465444+0000","last_peered":"2024-09-12T18:56:52.465444+0000","last_clean":"2024-09-12T18:56:52.465444+0000","last_became_active":"2024-09-12T17:40:20.124905+0000","last_became_peered":"2024-09-12T17:40:20.124905+0000","last_unstale":"2024-09-12T18:56:52.465444+0000","last_undegraded":"2024-09-12T18:56:52.465444+0000","last_fullsized":"2024-09-12T18:56:52.465444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:52.008144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":441,"num_write":144,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'395","reported_seq":1105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.038135+0000","last_change":"2024-09-12T17:40:18.777519+0000","last_active":"2024-09-12T19:00:00.038135+0000","last_peered":"2024-09-12T19:00:00.038135+0000","last_clean":"2024-09-12T19:00:00.038135+0000","last_became_active":"2024-09-12T17:40:18.776865+0000","last_became_peered":"2024-09-12T17:40:18.776865+0000","last_unstale":"2024-09-12T19:00:00.038135+0000","last_undegraded":"2024-09-12T19:00:00.038135+0000","last_fullsized":"2024-09-12T19:00:00.038135+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:29.028273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":2000,"num_write":1257,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'104","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.554319+0000","last_change":"2024-09-12T17:40:20.119380+0000","last_active":"2024-09-12T18:59:26.554319+0000","last_peered":"2024-09-12T18:59:26.554319+0000","last_clean":"2024-09-12T18:59:26.554319+0000","last_became_active":"2024-09-12T17:40:20.119036+0000","last_became_peered":"2024-09-12T17:40:20.119036+0000","last_unstale":"2024-09-12T18:59:26.554319+0000","last_undegraded":"2024-09-12T18:59:26.554319+0000","last_fullsized":"2024-09-12T18:59:26.554319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:31.564674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":455,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'488","reported_seq":1192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.041895+0000","last_change":"2024-09-12T17:40:18.770214+0000","last_active":"2024-09-12T19:00:00.041895+0000","last_peered":"2024-09-12T19:00:00.041895+0000","last_clean":"2024-09-12T19:00:00.041895+0000","last_became_active":"2024-09-12T17:40:18.768688+0000","last_became_peered":"2024-09-12T17:40:18.768688+0000","last_unstale":"2024-09-12T19:00:00.041895+0000","last_undegraded":"2024-09-12T19:00:00.041895+0000","last_fullsized":"2024-09-12T19:00:00.041895+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:46.076255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1574987,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":867,"num_read_kb":49769,"num_write":1400,"num_write_kb":26119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'159","reported_seq":736,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.443217+0000","last_change":"2024-09-12T17:40:20.133523+0000","last_active":"2024-09-12T18:56:27.443217+0000","last_peered":"2024-09-12T18:56:27.443217+0000","last_clean":"2024-09-12T18:56:27.443217+0000","last_became_active":"2024-09-12T17:40:20.132698+0000","last_became_peered":"2024-09-12T17:40:20.132698+0000","last_unstale":"2024-09-12T18:56:27.443217+0000","last_undegraded":"2024-09-12T18:56:27.443217+0000","last_fullsized":"2024-09-12T18:56:27.443217+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:07.059934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":512,"num_write":259,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'355","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.070910+0000","last_change":"2024-09-12T17:40:18.784825+0000","last_active":"2024-09-12T19:00:00.070910+0000","last_peered":"2024-09-12T19:00:00.070910+0000","last_clean":"2024-09-12T19:00:00.070910+0000","last_became_active":"2024-09-12T17:40:18.784024+0000","last_became_peered":"2024-09-12T17:40:18.784024+0000","last_unstale":"2024-09-12T19:00:00.070910+0000","last_undegraded":"2024-09-12T19:00:00.070910+0000","last_fullsized":"2024-09-12T19:00:00.070910+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:14.215607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506065,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":13540,"num_write":1118,"num_write_kb":25363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'379","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.053329+0000","last_change":"2024-09-12T17:40:55.332141+0000","last_active":"2024-09-12T19:00:00.053329+0000","last_peered":"2024-09-12T19:00:00.053329+0000","last_clean":"2024-09-12T19:00:00.053329+0000","last_became_active":"2024-09-12T17:40:55.331839+0000","last_became_peered":"2024-09-12T17:40:55.331839+0000","last_unstale":"2024-09-12T19:00:00.053329+0000","last_undegraded":"2024-09-12T19:00:00.053329+0000","last_fullsized":"2024-09-12T19:00:00.053329+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.377874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":31466,"num_write":1073,"num_write_kb":39606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'70","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:32.448457+0000","last_change":"2024-09-12T17:40:20.116528+0000","last_active":"2024-09-12T18:55:32.448457+0000","last_peered":"2024-09-12T18:55:32.448457+0000","last_clean":"2024-09-12T18:55:32.448457+0000","last_became_active":"2024-09-12T17:40:20.116230+0000","last_became_peered":"2024-09-12T17:40:20.116230+0000","last_unstale":"2024-09-12T18:55:32.448457+0000","last_undegraded":"2024-09-12T18:55:32.448457+0000","last_fullsized":"2024-09-12T18:55:32.448457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:18.767693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":294,"num_write":113,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'386","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.063778+0000","last_change":"2024-09-12T17:40:18.774940+0000","last_active":"2024-09-12T19:00:00.063778+0000","last_peered":"2024-09-12T19:00:00.063778+0000","last_clean":"2024-09-12T19:00:00.063778+0000","last_became_active":"2024-09-12T17:40:18.774332+0000","last_became_peered":"2024-09-12T17:40:18.774332+0000","last_unstale":"2024-09-12T19:00:00.063778+0000","last_undegraded":"2024-09-12T19:00:00.063778+0000","last_fullsized":"2024-09-12T19:00:00.063778+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:36.078701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482012,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":8119,"num_write":1461,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'266","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:17.610008+0000","last_change":"2024-09-12T17:40:20.113318+0000","last_active":"2024-09-12T18:55:17.610008+0000","last_peered":"2024-09-12T18:55:17.610008+0000","last_clean":"2024-09-12T18:55:17.610008+0000","last_became_active":"2024-09-12T17:40:20.112521+0000","last_became_peered":"2024-09-12T17:40:20.112521+0000","last_unstale":"2024-09-12T18:55:17.610008+0000","last_undegraded":"2024-09-12T18:55:17.610008+0000","last_fullsized":"2024-09-12T18:55:17.610008+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:29.322254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1090,"num_read_kb":887,"num_write":395,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5850,"num_read_kb":4138,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16272,"num_read_kb":15940,"num_write":16723,"num_write_kb":4884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1758,"ondisk_log_size":1758,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":488,"ondisk_log_size":488,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1567416,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":19029,"num_read_kb":39666,"num_write":15931,"num_write_kb":12049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2053,"ondisk_log_size":2053,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103249,"num_read_kb":86122,"num_write":37396,"num_write_kb":18900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3947,"ondisk_log_size":3947,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":156029425,"num_objects":414,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":414,"num_whiteouts":0,"num_read":36445,"num_read_kb":1876664,"num_write":72236,"num_write_kb":2152272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":313376768,"data_stored":312058850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3498,"ondisk_log_size":3498,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":197405,"num_write":186,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":186093,"num_write":186,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510405,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304836,"kb_used_data":52740,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94067004,"statfs":{"total":96636764160,"available":96324612096,"internally_reserved":0,"allocated":54005760,"data_stored":52302612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":257948106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510405,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257948,"kb_used_data":27968,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94113892,"statfs":{"total":96636764160,"available":96372625408,"internally_reserved":0,"allocated":28639232,"data_stored":27005259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510404,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140604,"kb_used_data":41228,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94231236,"statfs":{"total":96636764160,"available":96492785664,"internally_reserved":0,"allocated":42217472,"data_stored":40481962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510405,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117916,"kb_used_data":46388,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94253924,"statfs":{"total":96636764160,"available":96516018176,"internally_reserved":0,"allocated":47501312,"data_stored":45836760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510403,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299060,"kb_used_data":51184,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94072780,"statfs":{"total":96636764160,"available":96330526720,"internally_reserved":0,"allocated":52412416,"data_stored":50705649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510403,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133148,"kb_used_data":29788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94238692,"statfs":{"total":96636764160,"available":96500420608,"internally_reserved":0,"allocated":30502912,"data_stored":28881998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510405,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272596,"kb_used_data":56676,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94099244,"statfs":{"total":96636764160,"available":96357625856,"internally_reserved":0,"allocated":58036224,"data_stored":56286500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575812,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109544,"kb_used_data":29756,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94262296,"statfs":{"total":96636764160,"available":96524591104,"internally_reserved":0,"allocated":30470144,"data_stored":28895816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":81590728},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53760000,"data_stored":53550290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26857472,"data_stored":26738240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26849280,"data_stored":26750445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48742400,"data_stored":48559608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":43892736,"data_stored":43694024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":38510592,"data_stored":38336597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25014272,"data_stored":24861531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49750016,"data_stored":49568115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:00:06.733 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.733 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.733 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.733 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.734 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.734 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.734 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.734 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.734 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.734 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.734 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.734 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.734 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.735 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.735 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.735 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.735 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.735 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.735 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.735 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.735 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.736 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.736 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.736 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.736 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.736 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.736 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.736 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.736 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.736 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.737 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.737 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.737 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.737 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.737 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.737 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.737 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.737 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.737 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.738 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.738 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.738 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.738 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.738 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.738 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.738 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.738 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.738 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.739 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.739 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.739 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.739 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.739 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.739 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.739 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.739 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.740 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.740 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.740 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.740 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.740 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.740 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.740 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.740 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.741 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.741 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.741 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.741 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.741 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.741 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.741 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.741 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.741 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.742 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.742 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.742 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.742 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.742 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.742 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.742 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.742 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.742 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.743 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.743 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.743 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.743 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.743 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.743 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.743 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.743 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.743 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.744 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.744 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.744 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.744 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.744 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.744 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.744 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.744 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.744 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.745 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.745 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.745 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.745 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.745 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.745 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.745 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.745 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.746 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.746 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.746 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.746 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.746 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.746 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.746 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.746 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.746 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.747 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.747 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.747 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.747 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.747 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.747 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.747 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.747 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.747 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.748 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.748 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.748 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.748 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.748 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.748 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.748 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.748 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.748 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.749 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.749 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.749 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.749 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.749 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.749 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.749 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.749 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.749 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.750 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.750 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.750 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.750 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.750 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.750 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.750 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.750 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.751 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.751 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.751 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.751 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.751 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.751 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.751 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.751 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.751 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.752 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.752 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.752 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.752 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.752 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.752 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.752 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.752 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.753 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.753 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.753 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.753 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.753 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.753 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.753 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.753 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.753 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.754 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.754 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.754 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.754 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.754 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.754 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.754 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.754 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.754 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.755 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.755 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.755 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.755 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.755 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.755 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.755 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.755 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.756 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.756 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.756 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.756 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.756 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.756 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.756 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.756 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.756 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.757 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.757 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.757 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.757 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.757 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.757 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.757 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.757 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.757 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.758 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.758 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.758 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.758 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.758 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.758 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.758 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.758 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.758 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.759 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.759 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.759 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.759 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.759 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.759 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.759 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.759 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:40:02.615744+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.760 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:40:08.647611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.760 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.760 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.760 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.760 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.760 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.760 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.760 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:40:08.647611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.761 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.761 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.761 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.761 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.761 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.761 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.761 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:40:08.647611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.761 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.761 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.761 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.762 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.762 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.762 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.762 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:40:08.647611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.762 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.762 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.762 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.762 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.762 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.763 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.763 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.763 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T17:40:08.647611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.763 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.763 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.763 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.763 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.763 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.764 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.764 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:40:08.647611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.764 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.764 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.764 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.764 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.764 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.764 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.764 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T17:40:08.647611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.765 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.765 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.765 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.765 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.765 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.765 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.765 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:40:08.647611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.765 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.765 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.766 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.766 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.766 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.766 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.766 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.766 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.766 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.766 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.766 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.767 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.767 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.767 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.767 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.767 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.767 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.767 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.767 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.767 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.768 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.768 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.768 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.768 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.768 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.768 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.768 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.768 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.768 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.769 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.769 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.769 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.769 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.769 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.769 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.769 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.769 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.769 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.770 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.770 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.770 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.770 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.770 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.770 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.770 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.770 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.771 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.771 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.771 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.771 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.771 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.771 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.771 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.771 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.771 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.771 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.772 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.772 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.772 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.772 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.772 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.772 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.772 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.772 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.773 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.773 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.773 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.773 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.773 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.773 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.773 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.773 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.773 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.774 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.774 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.774 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.774 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.774 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.774 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.774 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.774 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.774 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.775 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.775 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.775 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.775 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.775 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.775 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.775 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.775 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.775 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.776 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.776 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.776 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.776 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.776 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.776 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.776 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.776 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.776 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.777 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.777 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.777 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.777 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.777 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.777 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.777 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.777 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.777 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.778 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.778 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.778 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:06.778 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:00:26.779 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:00:27.151 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T19:00:27.163 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-09-12T19:00:27.179 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":2669,"stamp":"2024-09-12T19:00:25.339112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158204416,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":183664,"num_read_kb":2408959,"num_write":144741,"num_write_kb":2446021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":41238,"num_omap_keys":166,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13227,"ondisk_log_size":13227,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1626224,"kb_used_data":335728,"kb_used_omap":12,"kb_used_meta":1290355,"kb_avail":753348496,"statfs":{"total":773094113280,"available":771428859904,"internally_reserved":0,"allocated":343785472,"data_stored":330396556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1321324083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":41238,"num_omap_keys":166,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009707"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639884+0000","last_change":"2024-09-12T18:19:57.854037+0000","last_active":"2024-09-12T18:57:27.639884+0000","last_peered":"2024-09-12T18:57:27.639884+0000","last_clean":"2024-09-12T18:57:27.639884+0000","last_became_active":"2024-09-12T18:19:57.853375+0000","last_became_peered":"2024-09-12T18:19:57.853375+0000","last_unstale":"2024-09-12T18:57:27.639884+0000","last_undegraded":"2024-09-12T18:57:27.639884+0000","last_fullsized":"2024-09-12T18:57:27.639884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:39.334575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:42.681464+0000","last_change":"2024-09-12T17:59:43.011642+0000","last_active":"2024-09-12T18:59:42.681464+0000","last_peered":"2024-09-12T18:59:42.681464+0000","last_clean":"2024-09-12T18:59:42.681464+0000","last_became_active":"2024-09-12T17:59:43.010854+0000","last_became_peered":"2024-09-12T17:59:43.010854+0000","last_unstale":"2024-09-12T18:59:42.681464+0000","last_undegraded":"2024-09-12T18:59:42.681464+0000","last_fullsized":"2024-09-12T18:59:42.681464+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:05.224690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454697+0000","last_change":"2024-09-12T17:59:38.988698+0000","last_active":"2024-09-12T18:57:12.454697+0000","last_peered":"2024-09-12T18:57:12.454697+0000","last_clean":"2024-09-12T18:57:12.454697+0000","last_became_active":"2024-09-12T17:59:38.987739+0000","last_became_peered":"2024-09-12T17:59:38.987739+0000","last_unstale":"2024-09-12T18:57:12.454697+0000","last_undegraded":"2024-09-12T18:57:12.454697+0000","last_fullsized":"2024-09-12T18:57:12.454697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:32.330775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'44","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.460341+0000","last_change":"2024-09-12T17:55:59.359070+0000","last_active":"2024-09-12T18:56:27.460341+0000","last_peered":"2024-09-12T18:56:27.460341+0000","last_clean":"2024-09-12T18:56:27.460341+0000","last_became_active":"2024-09-12T17:55:59.358302+0000","last_became_peered":"2024-09-12T17:55:59.358302+0000","last_unstale":"2024-09-12T18:56:27.460341+0000","last_undegraded":"2024-09-12T18:56:27.460341+0000","last_fullsized":"2024-09-12T18:56:27.460341+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:31.219330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":154,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:29.450940+0000","last_change":"2024-09-12T18:19:57.839639+0000","last_active":"2024-09-12T18:57:29.450940+0000","last_peered":"2024-09-12T18:57:29.450940+0000","last_clean":"2024-09-12T18:57:29.450940+0000","last_became_active":"2024-09-12T18:19:57.838918+0000","last_became_peered":"2024-09-12T18:19:57.838918+0000","last_unstale":"2024-09-12T18:57:29.450940+0000","last_undegraded":"2024-09-12T18:57:29.450940+0000","last_fullsized":"2024-09-12T18:57:29.450940+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:14.062322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:42.450552+0000","last_change":"2024-09-12T17:59:43.018636+0000","last_active":"2024-09-12T18:59:42.450552+0000","last_peered":"2024-09-12T18:59:42.450552+0000","last_clean":"2024-09-12T18:59:42.450552+0000","last_became_active":"2024-09-12T17:59:43.005733+0000","last_became_peered":"2024-09-12T17:59:43.005733+0000","last_unstale":"2024-09-12T18:59:42.450552+0000","last_undegraded":"2024-09-12T18:59:42.450552+0000","last_fullsized":"2024-09-12T18:59:42.450552+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.942784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'8","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.284189+0000","last_change":"2024-09-12T17:59:38.990543+0000","last_active":"2024-09-12T18:59:59.284189+0000","last_peered":"2024-09-12T18:59:59.284189+0000","last_clean":"2024-09-12T18:59:59.284189+0000","last_became_active":"2024-09-12T17:59:38.989854+0000","last_became_peered":"2024-09-12T17:59:38.989854+0000","last_unstale":"2024-09-12T18:59:59.284189+0000","last_undegraded":"2024-09-12T18:59:59.284189+0000","last_fullsized":"2024-09-12T18:59:59.284189+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:58.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8763,"num_write":8,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'34","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:14.460808+0000","last_change":"2024-09-12T17:55:59.368156+0000","last_active":"2024-09-12T18:58:14.460808+0000","last_peered":"2024-09-12T18:58:14.460808+0000","last_clean":"2024-09-12T18:58:14.460808+0000","last_became_active":"2024-09-12T17:55:59.367426+0000","last_became_peered":"2024-09-12T17:55:59.367426+0000","last_unstale":"2024-09-12T18:58:14.460808+0000","last_undegraded":"2024-09-12T18:58:14.460808+0000","last_fullsized":"2024-09-12T18:58:14.460808+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":114,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.427354+0000","last_change":"2024-09-12T18:19:57.849468+0000","last_active":"2024-09-12T18:56:12.427354+0000","last_peered":"2024-09-12T18:56:12.427354+0000","last_clean":"2024-09-12T18:56:12.427354+0000","last_became_active":"2024-09-12T18:19:57.848735+0000","last_became_peered":"2024-09-12T18:19:57.848735+0000","last_unstale":"2024-09-12T18:56:12.427354+0000","last_undegraded":"2024-09-12T18:56:12.427354+0000","last_fullsized":"2024-09-12T18:56:12.427354+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:59.827170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.440489+0000","last_change":"2024-09-12T17:59:43.012346+0000","last_active":"2024-09-12T18:59:59.440489+0000","last_peered":"2024-09-12T18:59:59.440489+0000","last_clean":"2024-09-12T18:59:59.440489+0000","last_became_active":"2024-09-12T17:59:43.011603+0000","last_became_peered":"2024-09-12T17:59:43.011603+0000","last_unstale":"2024-09-12T18:59:59.440489+0000","last_undegraded":"2024-09-12T18:59:59.440489+0000","last_fullsized":"2024-09-12T18:59:59.440489+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:54.456240+0000","last_change":"2024-09-12T17:59:38.985703+0000","last_active":"2024-09-12T18:57:54.456240+0000","last_peered":"2024-09-12T18:57:54.456240+0000","last_clean":"2024-09-12T18:57:54.456240+0000","last_became_active":"2024-09-12T17:59:38.984980+0000","last_became_peered":"2024-09-12T17:59:38.984980+0000","last_unstale":"2024-09-12T18:57:54.456240+0000","last_undegraded":"2024-09-12T18:57:54.456240+0000","last_fullsized":"2024-09-12T18:57:54.456240+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:03.988908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'15","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.454640+0000","last_change":"2024-09-12T17:55:59.357028+0000","last_active":"2024-09-12T18:56:02.454640+0000","last_peered":"2024-09-12T18:56:02.454640+0000","last_clean":"2024-09-12T18:56:02.454640+0000","last_became_active":"2024-09-12T17:55:59.356144+0000","last_became_peered":"2024-09-12T17:55:59.356144+0000","last_unstale":"2024-09-12T18:56:02.454640+0000","last_undegraded":"2024-09-12T18:56:02.454640+0000","last_fullsized":"2024-09-12T18:56:02.454640+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:40.644103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442648+0000","last_change":"2024-09-12T18:19:57.861119+0000","last_active":"2024-09-12T18:56:27.442648+0000","last_peered":"2024-09-12T18:56:27.442648+0000","last_clean":"2024-09-12T18:56:27.442648+0000","last_became_active":"2024-09-12T18:19:57.860464+0000","last_became_peered":"2024-09-12T18:19:57.860464+0000","last_unstale":"2024-09-12T18:56:27.442648+0000","last_undegraded":"2024-09-12T18:56:27.442648+0000","last_fullsized":"2024-09-12T18:56:27.442648+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:37.217624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'4","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.129553+0000","last_change":"2024-09-12T17:59:43.031327+0000","last_active":"2024-09-12T18:59:59.129553+0000","last_peered":"2024-09-12T18:59:59.129553+0000","last_clean":"2024-09-12T18:59:59.129553+0000","last_became_active":"2024-09-12T17:59:43.030545+0000","last_became_peered":"2024-09-12T17:59:43.030545+0000","last_unstale":"2024-09-12T18:59:59.129553+0000","last_undegraded":"2024-09-12T18:59:59.129553+0000","last_fullsized":"2024-09-12T18:59:59.129553+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:11.859283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4192,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.828538+0000","last_change":"2024-09-12T17:59:38.946186+0000","last_active":"2024-09-12T18:58:02.828538+0000","last_peered":"2024-09-12T18:58:02.828538+0000","last_clean":"2024-09-12T18:58:02.828538+0000","last_became_active":"2024-09-12T17:59:38.945373+0000","last_became_peered":"2024-09-12T17:59:38.945373+0000","last_unstale":"2024-09-12T18:58:02.828538+0000","last_undegraded":"2024-09-12T18:58:02.828538+0000","last_fullsized":"2024-09-12T18:58:02.828538+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'6","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437289+0000","last_change":"2024-09-12T17:55:59.340661+0000","last_active":"2024-09-12T18:56:02.437289+0000","last_peered":"2024-09-12T18:56:02.437289+0000","last_clean":"2024-09-12T18:56:02.437289+0000","last_became_active":"2024-09-12T17:55:59.338550+0000","last_became_peered":"2024-09-12T17:55:59.338550+0000","last_unstale":"2024-09-12T18:56:02.437289+0000","last_undegraded":"2024-09-12T18:56:02.437289+0000","last_fullsized":"2024-09-12T18:56:02.437289+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:44.861905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468443+0000","last_change":"2024-09-12T18:19:57.871984+0000","last_active":"2024-09-12T18:58:12.468443+0000","last_peered":"2024-09-12T18:58:12.468443+0000","last_clean":"2024-09-12T18:58:12.468443+0000","last_became_active":"2024-09-12T18:19:57.871345+0000","last_became_peered":"2024-09-12T18:19:57.871345+0000","last_unstale":"2024-09-12T18:58:12.468443+0000","last_undegraded":"2024-09-12T18:58:12.468443+0000","last_fullsized":"2024-09-12T18:58:12.468443+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:52.656125+0000","last_change":"2024-09-12T17:59:43.034960+0000","last_active":"2024-09-12T18:57:52.656125+0000","last_peered":"2024-09-12T18:57:52.656125+0000","last_clean":"2024-09-12T18:57:52.656125+0000","last_became_active":"2024-09-12T17:59:43.034299+0000","last_became_peered":"2024-09-12T17:59:43.034299+0000","last_unstale":"2024-09-12T18:57:52.656125+0000","last_undegraded":"2024-09-12T18:57:52.656125+0000","last_fullsized":"2024-09-12T18:57:52.656125+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'6","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.476565+0000","last_change":"2024-09-12T17:59:38.981877+0000","last_active":"2024-09-12T18:57:42.476565+0000","last_peered":"2024-09-12T18:57:42.476565+0000","last_clean":"2024-09-12T18:57:42.476565+0000","last_became_active":"2024-09-12T17:59:38.976348+0000","last_became_peered":"2024-09-12T17:59:38.976348+0000","last_unstale":"2024-09-12T18:57:42.476565+0000","last_undegraded":"2024-09-12T18:57:42.476565+0000","last_fullsized":"2024-09-12T18:57:42.476565+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'16","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437226+0000","last_change":"2024-09-12T17:55:59.357701+0000","last_active":"2024-09-12T18:56:02.437226+0000","last_peered":"2024-09-12T18:56:02.437226+0000","last_clean":"2024-09-12T18:56:02.437226+0000","last_became_active":"2024-09-12T17:55:59.356970+0000","last_became_peered":"2024-09-12T17:55:59.356970+0000","last_unstale":"2024-09-12T18:56:02.437226+0000","last_undegraded":"2024-09-12T18:56:02.437226+0000","last_fullsized":"2024-09-12T18:56:02.437226+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:46.362725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":58,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464203+0000","last_change":"2024-09-12T18:19:57.867587+0000","last_active":"2024-09-12T18:57:27.464203+0000","last_peered":"2024-09-12T18:57:27.464203+0000","last_clean":"2024-09-12T18:57:27.464203+0000","last_became_active":"2024-09-12T18:19:57.865319+0000","last_became_peered":"2024-09-12T18:19:57.865319+0000","last_unstale":"2024-09-12T18:57:27.464203+0000","last_undegraded":"2024-09-12T18:57:27.464203+0000","last_fullsized":"2024-09-12T18:57:27.464203+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:03.710006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.934926+0000","last_change":"2024-09-12T17:59:56.386718+0000","last_active":"2024-09-12T18:59:59.934926+0000","last_peered":"2024-09-12T18:59:59.934926+0000","last_clean":"2024-09-12T18:59:59.934926+0000","last_became_active":"2024-09-12T17:59:56.386194+0000","last_became_peered":"2024-09-12T17:59:56.386194+0000","last_unstale":"2024-09-12T18:59:59.934926+0000","last_undegraded":"2024-09-12T18:59:59.934926+0000","last_fullsized":"2024-09-12T18:59:59.934926+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'9","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.793177+0000","last_change":"2024-09-12T17:59:38.978120+0000","last_active":"2024-09-12T18:59:59.793177+0000","last_peered":"2024-09-12T18:59:59.793177+0000","last_clean":"2024-09-12T18:59:59.793177+0000","last_became_active":"2024-09-12T17:59:38.977316+0000","last_became_peered":"2024-09-12T17:59:38.977316+0000","last_unstale":"2024-09-12T18:59:59.793177+0000","last_undegraded":"2024-09-12T18:59:59.793177+0000","last_fullsized":"2024-09-12T18:59:59.793177+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16386,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'37","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.425307+0000","last_change":"2024-09-12T17:55:59.366994+0000","last_active":"2024-09-12T18:56:02.425307+0000","last_peered":"2024-09-12T18:56:02.425307+0000","last_clean":"2024-09-12T18:56:02.425307+0000","last_became_active":"2024-09-12T17:55:59.366177+0000","last_became_peered":"2024-09-12T17:55:59.366177+0000","last_unstale":"2024-09-12T18:56:02.425307+0000","last_undegraded":"2024-09-12T18:56:02.425307+0000","last_fullsized":"2024-09-12T18:56:02.425307+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:03.524473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":133,"num_write":64,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457338+0000","last_change":"2024-09-12T18:19:57.844732+0000","last_active":"2024-09-12T18:57:27.457338+0000","last_peered":"2024-09-12T18:57:27.457338+0000","last_clean":"2024-09-12T18:57:27.457338+0000","last_became_active":"2024-09-12T18:19:57.843946+0000","last_became_peered":"2024-09-12T18:19:57.843946+0000","last_unstale":"2024-09-12T18:57:27.457338+0000","last_undegraded":"2024-09-12T18:57:27.457338+0000","last_fullsized":"2024-09-12T18:57:27.457338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:48.999189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.440013+0000","last_change":"2024-09-12T17:59:43.014049+0000","last_active":"2024-09-12T18:57:12.440013+0000","last_peered":"2024-09-12T18:57:12.440013+0000","last_clean":"2024-09-12T18:57:12.440013+0000","last_became_active":"2024-09-12T17:59:43.013293+0000","last_became_peered":"2024-09-12T17:59:43.013293+0000","last_unstale":"2024-09-12T18:57:12.440013+0000","last_undegraded":"2024-09-12T18:57:12.440013+0000","last_fullsized":"2024-09-12T18:57:12.440013+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:47.290570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.816755+0000","last_change":"2024-09-12T17:59:38.984819+0000","last_active":"2024-09-12T18:57:12.816755+0000","last_peered":"2024-09-12T18:57:12.816755+0000","last_clean":"2024-09-12T18:57:12.816755+0000","last_became_active":"2024-09-12T17:59:38.984004+0000","last_became_peered":"2024-09-12T17:59:38.984004+0000","last_unstale":"2024-09-12T18:57:12.816755+0000","last_undegraded":"2024-09-12T18:57:12.816755+0000","last_fullsized":"2024-09-12T18:57:12.816755+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:47.953455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'21","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463100+0000","last_change":"2024-09-12T17:55:59.367890+0000","last_active":"2024-09-12T18:56:42.463100+0000","last_peered":"2024-09-12T18:56:42.463100+0000","last_clean":"2024-09-12T18:56:42.463100+0000","last_became_active":"2024-09-12T17:55:59.366968+0000","last_became_peered":"2024-09-12T17:55:59.366968+0000","last_unstale":"2024-09-12T18:56:42.463100+0000","last_undegraded":"2024-09-12T18:56:42.463100+0000","last_fullsized":"2024-09-12T18:56:42.463100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:25.297113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457398+0000","last_change":"2024-09-12T18:19:57.871547+0000","last_active":"2024-09-12T18:57:27.457398+0000","last_peered":"2024-09-12T18:57:27.457398+0000","last_clean":"2024-09-12T18:57:27.457398+0000","last_became_active":"2024-09-12T18:19:57.870750+0000","last_became_peered":"2024-09-12T18:19:57.870750+0000","last_unstale":"2024-09-12T18:57:27.457398+0000","last_undegraded":"2024-09-12T18:57:27.457398+0000","last_fullsized":"2024-09-12T18:57:27.457398+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:27.428422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454597+0000","last_change":"2024-09-12T17:59:43.027485+0000","last_active":"2024-09-12T18:57:12.454597+0000","last_peered":"2024-09-12T18:57:12.454597+0000","last_clean":"2024-09-12T18:57:12.454597+0000","last_became_active":"2024-09-12T17:59:43.021777+0000","last_became_peered":"2024-09-12T17:59:43.021777+0000","last_unstale":"2024-09-12T18:57:12.454597+0000","last_undegraded":"2024-09-12T18:57:12.454597+0000","last_fullsized":"2024-09-12T18:57:12.454597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:26.307507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.469779+0000","last_change":"2024-09-12T17:59:38.990405+0000","last_active":"2024-09-12T18:57:12.469779+0000","last_peered":"2024-09-12T18:57:12.469779+0000","last_clean":"2024-09-12T18:57:12.469779+0000","last_became_active":"2024-09-12T17:59:38.989753+0000","last_became_peered":"2024-09-12T17:59:38.989753+0000","last_unstale":"2024-09-12T18:57:12.469779+0000","last_undegraded":"2024-09-12T18:57:12.469779+0000","last_fullsized":"2024-09-12T18:57:12.469779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:31.519684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'22","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.450554+0000","last_change":"2024-09-12T17:55:59.330535+0000","last_active":"2024-09-12T18:56:27.450554+0000","last_peered":"2024-09-12T18:56:27.450554+0000","last_clean":"2024-09-12T18:56:27.450554+0000","last_became_active":"2024-09-12T17:55:59.329792+0000","last_became_peered":"2024-09-12T17:55:59.329792+0000","last_unstale":"2024-09-12T18:56:27.450554+0000","last_undegraded":"2024-09-12T18:56:27.450554+0000","last_fullsized":"2024-09-12T18:56:27.450554+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:50.850228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.461644+0000","last_change":"2024-09-12T18:19:57.868119+0000","last_active":"2024-09-12T18:57:17.461644+0000","last_peered":"2024-09-12T18:57:17.461644+0000","last_clean":"2024-09-12T18:57:17.461644+0000","last_became_active":"2024-09-12T18:19:57.863600+0000","last_became_peered":"2024-09-12T18:19:57.863600+0000","last_unstale":"2024-09-12T18:57:17.461644+0000","last_undegraded":"2024-09-12T18:57:17.461644+0000","last_fullsized":"2024-09-12T18:57:17.461644+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.347599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.903652+0000","last_change":"2024-09-12T17:59:43.033456+0000","last_active":"2024-09-12T18:59:59.903652+0000","last_peered":"2024-09-12T18:59:59.903652+0000","last_clean":"2024-09-12T18:59:59.903652+0000","last_became_active":"2024-09-12T17:59:43.031016+0000","last_became_peered":"2024-09-12T17:59:43.031016+0000","last_unstale":"2024-09-12T18:59:59.903652+0000","last_undegraded":"2024-09-12T18:59:59.903652+0000","last_fullsized":"2024-09-12T18:59:59.903652+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:52.618126+0000","last_change":"2024-09-12T17:59:38.966961+0000","last_active":"2024-09-12T18:55:52.618126+0000","last_peered":"2024-09-12T18:55:52.618126+0000","last_clean":"2024-09-12T18:55:52.618126+0000","last_became_active":"2024-09-12T17:59:38.966158+0000","last_became_peered":"2024-09-12T17:59:38.966158+0000","last_unstale":"2024-09-12T18:55:52.618126+0000","last_undegraded":"2024-09-12T18:55:52.618126+0000","last_fullsized":"2024-09-12T18:55:52.618126+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:05.792036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'26","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.460293+0000","last_change":"2024-09-12T17:55:59.367819+0000","last_active":"2024-09-12T18:56:27.460293+0000","last_peered":"2024-09-12T18:56:27.460293+0000","last_clean":"2024-09-12T18:56:27.460293+0000","last_became_active":"2024-09-12T17:55:59.366803+0000","last_became_peered":"2024-09-12T17:55:59.366803+0000","last_unstale":"2024-09-12T18:56:27.460293+0000","last_undegraded":"2024-09-12T18:56:27.460293+0000","last_fullsized":"2024-09-12T18:56:27.460293+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:11.044959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:19.448910+0000","last_change":"2024-09-12T18:19:57.846272+0000","last_active":"2024-09-12T18:57:19.448910+0000","last_peered":"2024-09-12T18:57:19.448910+0000","last_clean":"2024-09-12T18:57:19.448910+0000","last_became_active":"2024-09-12T18:19:57.845474+0000","last_became_peered":"2024-09-12T18:19:57.845474+0000","last_unstale":"2024-09-12T18:57:19.448910+0000","last_undegraded":"2024-09-12T18:57:19.448910+0000","last_fullsized":"2024-09-12T18:57:19.448910+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:36.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:22.470978+0000","last_change":"2024-09-12T17:59:43.034867+0000","last_active":"2024-09-12T18:58:22.470978+0000","last_peered":"2024-09-12T18:58:22.470978+0000","last_clean":"2024-09-12T18:58:22.470978+0000","last_became_active":"2024-09-12T17:59:43.034159+0000","last_became_peered":"2024-09-12T17:59:43.034159+0000","last_unstale":"2024-09-12T18:58:22.470978+0000","last_undegraded":"2024-09-12T18:58:22.470978+0000","last_fullsized":"2024-09-12T18:58:22.470978+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:55.391915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.461041+0000","last_change":"2024-09-12T17:59:38.981580+0000","last_active":"2024-09-12T18:57:42.461041+0000","last_peered":"2024-09-12T18:57:42.461041+0000","last_clean":"2024-09-12T18:57:42.461041+0000","last_became_active":"2024-09-12T17:59:38.980797+0000","last_became_peered":"2024-09-12T17:59:38.980797+0000","last_unstale":"2024-09-12T18:57:42.461041+0000","last_undegraded":"2024-09-12T18:57:42.461041+0000","last_fullsized":"2024-09-12T18:57:42.461041+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'6","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442893+0000","last_change":"2024-09-12T17:55:59.367443+0000","last_active":"2024-09-12T18:56:27.442893+0000","last_peered":"2024-09-12T18:56:27.442893+0000","last_clean":"2024-09-12T18:56:27.442893+0000","last_became_active":"2024-09-12T17:55:59.366679+0000","last_became_peered":"2024-09-12T17:55:59.366679+0000","last_unstale":"2024-09-12T18:56:27.442893+0000","last_undegraded":"2024-09-12T18:56:27.442893+0000","last_fullsized":"2024-09-12T18:56:27.442893+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.004334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.454894+0000","last_change":"2024-09-12T18:19:57.841634+0000","last_active":"2024-09-12T18:57:17.454894+0000","last_peered":"2024-09-12T18:57:17.454894+0000","last_clean":"2024-09-12T18:57:17.454894+0000","last_became_active":"2024-09-12T18:19:57.840855+0000","last_became_peered":"2024-09-12T18:19:57.840855+0000","last_unstale":"2024-09-12T18:57:17.454894+0000","last_undegraded":"2024-09-12T18:57:17.454894+0000","last_fullsized":"2024-09-12T18:57:17.454894+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:43.276958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'4","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.805921+0000","last_change":"2024-09-12T17:59:43.029670+0000","last_active":"2024-09-12T18:59:58.805921+0000","last_peered":"2024-09-12T18:59:58.805921+0000","last_clean":"2024-09-12T18:59:58.805921+0000","last_became_active":"2024-09-12T17:59:43.021538+0000","last_became_peered":"2024-09-12T17:59:43.021538+0000","last_unstale":"2024-09-12T18:59:58.805921+0000","last_undegraded":"2024-09-12T18:59:58.805921+0000","last_fullsized":"2024-09-12T18:59:58.805921+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'6","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.604776+0000","last_change":"2024-09-12T17:59:38.980849+0000","last_active":"2024-09-12T18:59:59.604776+0000","last_peered":"2024-09-12T18:59:59.604776+0000","last_clean":"2024-09-12T18:59:59.604776+0000","last_became_active":"2024-09-12T17:59:38.979939+0000","last_became_peered":"2024-09-12T17:59:38.979939+0000","last_unstale":"2024-09-12T18:59:59.604776+0000","last_undegraded":"2024-09-12T18:59:59.604776+0000","last_fullsized":"2024-09-12T18:59:59.604776+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'36","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:24.438322+0000","last_change":"2024-09-12T17:55:59.331420+0000","last_active":"2024-09-12T18:56:24.438322+0000","last_peered":"2024-09-12T18:56:24.438322+0000","last_clean":"2024-09-12T18:56:24.438322+0000","last_became_active":"2024-09-12T17:55:59.330570+0000","last_became_peered":"2024-09-12T17:55:59.330570+0000","last_unstale":"2024-09-12T18:56:24.438322+0000","last_undegraded":"2024-09-12T18:56:24.438322+0000","last_fullsized":"2024-09-12T18:56:24.438322+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:37.462782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":139,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637308+0000","last_change":"2024-09-12T18:19:57.854199+0000","last_active":"2024-09-12T18:57:17.637308+0000","last_peered":"2024-09-12T18:57:17.637308+0000","last_clean":"2024-09-12T18:57:17.637308+0000","last_became_active":"2024-09-12T18:19:57.853269+0000","last_became_peered":"2024-09-12T18:19:57.853269+0000","last_unstale":"2024-09-12T18:57:17.637308+0000","last_undegraded":"2024-09-12T18:57:17.637308+0000","last_fullsized":"2024-09-12T18:57:17.637308+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:58.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.823815+0000","last_change":"2024-09-12T17:59:43.022601+0000","last_active":"2024-09-12T18:57:42.823815+0000","last_peered":"2024-09-12T18:57:42.823815+0000","last_clean":"2024-09-12T18:57:42.823815+0000","last_became_active":"2024-09-12T17:59:43.020450+0000","last_became_peered":"2024-09-12T17:59:43.020450+0000","last_unstale":"2024-09-12T18:57:42.823815+0000","last_undegraded":"2024-09-12T18:57:42.823815+0000","last_fullsized":"2024-09-12T18:57:42.823815+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'7","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.865358+0000","last_change":"2024-09-12T17:59:38.983301+0000","last_active":"2024-09-12T18:59:59.865358+0000","last_peered":"2024-09-12T18:59:59.865358+0000","last_clean":"2024-09-12T18:59:59.865358+0000","last_became_active":"2024-09-12T17:59:38.982556+0000","last_became_peered":"2024-09-12T17:59:38.982556+0000","last_unstale":"2024-09-12T18:59:59.865358+0000","last_undegraded":"2024-09-12T18:59:59.865358+0000","last_fullsized":"2024-09-12T18:59:59.865358+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'83","reported_seq":293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450356+0000","last_change":"2024-09-12T17:55:59.364021+0000","last_active":"2024-09-12T18:56:57.450356+0000","last_peered":"2024-09-12T18:56:57.450356+0000","last_clean":"2024-09-12T18:56:57.450356+0000","last_became_active":"2024-09-12T17:55:59.363431+0000","last_became_peered":"2024-09-12T17:55:59.363431+0000","last_unstale":"2024-09-12T18:56:57.450356+0000","last_undegraded":"2024-09-12T18:56:57.450356+0000","last_fullsized":"2024-09-12T18:56:57.450356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.240236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":321,"num_write":127,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439374+0000","last_change":"2024-09-12T18:19:57.836599+0000","last_active":"2024-09-12T18:56:12.439374+0000","last_peered":"2024-09-12T18:56:12.439374+0000","last_clean":"2024-09-12T18:56:12.439374+0000","last_became_active":"2024-09-12T18:19:57.835852+0000","last_became_peered":"2024-09-12T18:19:57.835852+0000","last_unstale":"2024-09-12T18:56:12.439374+0000","last_undegraded":"2024-09-12T18:56:12.439374+0000","last_fullsized":"2024-09-12T18:56:12.439374+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:03.387557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.056766+0000","last_change":"2024-09-12T17:59:43.024923+0000","last_active":"2024-09-12T18:59:59.056766+0000","last_peered":"2024-09-12T18:59:59.056766+0000","last_clean":"2024-09-12T18:59:59.056766+0000","last_became_active":"2024-09-12T17:59:43.024103+0000","last_became_peered":"2024-09-12T17:59:43.024103+0000","last_unstale":"2024-09-12T18:59:59.056766+0000","last_undegraded":"2024-09-12T18:59:59.056766+0000","last_fullsized":"2024-09-12T18:59:59.056766+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'3","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.863370+0000","last_change":"2024-09-12T17:59:38.978753+0000","last_active":"2024-09-12T18:59:59.863370+0000","last_peered":"2024-09-12T18:59:59.863370+0000","last_clean":"2024-09-12T18:59:59.863370+0000","last_became_active":"2024-09-12T17:59:38.978126+0000","last_became_peered":"2024-09-12T17:59:38.978126+0000","last_unstale":"2024-09-12T18:59:59.863370+0000","last_undegraded":"2024-09-12T18:59:59.863370+0000","last_fullsized":"2024-09-12T18:59:59.863370+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'82","reported_seq":334,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446848+0000","last_change":"2024-09-12T17:55:59.364464+0000","last_active":"2024-09-12T18:56:42.446848+0000","last_peered":"2024-09-12T18:56:42.446848+0000","last_clean":"2024-09-12T18:56:42.446848+0000","last_became_active":"2024-09-12T17:55:59.363574+0000","last_became_peered":"2024-09-12T17:55:59.363574+0000","last_unstale":"2024-09-12T18:56:42.446848+0000","last_undegraded":"2024-09-12T18:56:42.446848+0000","last_fullsized":"2024-09-12T18:56:42.446848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:45.008706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":530,"num_read_kb":371,"num_write":118,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456819+0000","last_change":"2024-09-12T18:19:57.847909+0000","last_active":"2024-09-12T18:56:12.456819+0000","last_peered":"2024-09-12T18:56:12.456819+0000","last_clean":"2024-09-12T18:56:12.456819+0000","last_became_active":"2024-09-12T18:19:57.847092+0000","last_became_peered":"2024-09-12T18:19:57.847092+0000","last_unstale":"2024-09-12T18:56:12.456819+0000","last_undegraded":"2024-09-12T18:56:12.456819+0000","last_fullsized":"2024-09-12T18:56:12.456819+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:58.160509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.470997+0000","last_change":"2024-09-12T17:59:43.034884+0000","last_active":"2024-09-12T18:58:02.470997+0000","last_peered":"2024-09-12T18:58:02.470997+0000","last_clean":"2024-09-12T18:58:02.470997+0000","last_became_active":"2024-09-12T17:59:43.034180+0000","last_became_peered":"2024-09-12T17:59:43.034180+0000","last_unstale":"2024-09-12T18:58:02.470997+0000","last_undegraded":"2024-09-12T18:58:02.470997+0000","last_fullsized":"2024-09-12T18:58:02.470997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.440264+0000","last_change":"2024-09-12T17:59:38.976298+0000","last_active":"2024-09-12T18:59:59.440264+0000","last_peered":"2024-09-12T18:59:59.440264+0000","last_clean":"2024-09-12T18:59:59.440264+0000","last_became_active":"2024-09-12T17:59:38.969338+0000","last_became_peered":"2024-09-12T17:59:38.969338+0000","last_unstale":"2024-09-12T18:59:59.440264+0000","last_undegraded":"2024-09-12T18:59:59.440264+0000","last_fullsized":"2024-09-12T18:59:59.440264+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'36","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463141+0000","last_change":"2024-09-12T17:55:59.357946+0000","last_active":"2024-09-12T18:56:42.463141+0000","last_peered":"2024-09-12T18:56:42.463141+0000","last_clean":"2024-09-12T18:56:42.463141+0000","last_became_active":"2024-09-12T17:55:59.357330+0000","last_became_peered":"2024-09-12T17:55:59.357330+0000","last_unstale":"2024-09-12T18:56:42.463141+0000","last_undegraded":"2024-09-12T18:56:42.463141+0000","last_fullsized":"2024-09-12T18:56:42.463141+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.691647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":130,"num_write":63,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473367+0000","last_change":"2024-09-12T18:19:57.840998+0000","last_active":"2024-09-12T18:57:27.473367+0000","last_peered":"2024-09-12T18:57:27.473367+0000","last_clean":"2024-09-12T18:57:27.473367+0000","last_became_active":"2024-09-12T18:19:57.839696+0000","last_became_peered":"2024-09-12T18:19:57.839696+0000","last_unstale":"2024-09-12T18:57:27.473367+0000","last_undegraded":"2024-09-12T18:57:27.473367+0000","last_fullsized":"2024-09-12T18:57:27.473367+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:36.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.056564+0000","last_change":"2024-09-12T17:59:43.031197+0000","last_active":"2024-09-12T18:59:59.056564+0000","last_peered":"2024-09-12T18:59:59.056564+0000","last_clean":"2024-09-12T18:59:59.056564+0000","last_became_active":"2024-09-12T17:59:43.030490+0000","last_became_peered":"2024-09-12T17:59:43.030490+0000","last_unstale":"2024-09-12T18:59:59.056564+0000","last_undegraded":"2024-09-12T18:59:59.056564+0000","last_fullsized":"2024-09-12T18:59:59.056564+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16955,"num_write":6,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"261'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.450436+0000","last_change":"2024-09-12T17:59:38.990771+0000","last_active":"2024-09-12T18:58:02.450436+0000","last_peered":"2024-09-12T18:58:02.450436+0000","last_clean":"2024-09-12T18:58:02.450436+0000","last_became_active":"2024-09-12T17:59:38.990212+0000","last_became_peered":"2024-09-12T17:59:38.990212+0000","last_unstale":"2024-09-12T18:58:02.450436+0000","last_undegraded":"2024-09-12T18:58:02.450436+0000","last_fullsized":"2024-09-12T18:58:02.450436+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'28","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.810172+0000","last_change":"2024-09-12T17:55:59.357645+0000","last_active":"2024-09-12T18:56:42.810172+0000","last_peered":"2024-09-12T18:56:42.810172+0000","last_clean":"2024-09-12T18:56:42.810172+0000","last_became_active":"2024-09-12T17:55:59.356838+0000","last_became_peered":"2024-09-12T17:55:59.356838+0000","last_unstale":"2024-09-12T18:56:42.810172+0000","last_undegraded":"2024-09-12T18:56:42.810172+0000","last_fullsized":"2024-09-12T18:56:42.810172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:09.388925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":96,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439310+0000","last_change":"2024-09-12T18:19:57.837873+0000","last_active":"2024-09-12T18:56:12.439310+0000","last_peered":"2024-09-12T18:56:12.439310+0000","last_clean":"2024-09-12T18:56:12.439310+0000","last_became_active":"2024-09-12T18:19:57.837079+0000","last_became_peered":"2024-09-12T18:19:57.837079+0000","last_unstale":"2024-09-12T18:56:12.439310+0000","last_undegraded":"2024-09-12T18:56:12.439310+0000","last_fullsized":"2024-09-12T18:56:12.439310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:28.254760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.450392+0000","last_change":"2024-09-12T17:59:43.033009+0000","last_active":"2024-09-12T18:58:02.450392+0000","last_peered":"2024-09-12T18:58:02.450392+0000","last_clean":"2024-09-12T18:58:02.450392+0000","last_became_active":"2024-09-12T17:59:43.032008+0000","last_became_peered":"2024-09-12T17:59:43.032008+0000","last_unstale":"2024-09-12T18:58:02.450392+0000","last_undegraded":"2024-09-12T18:58:02.450392+0000","last_fullsized":"2024-09-12T18:58:02.450392+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'5","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.010992+0000","last_change":"2024-09-12T17:59:38.982851+0000","last_active":"2024-09-12T18:59:59.010992+0000","last_peered":"2024-09-12T18:59:59.010992+0000","last_clean":"2024-09-12T18:59:59.010992+0000","last_became_active":"2024-09-12T17:59:38.982037+0000","last_became_peered":"2024-09-12T17:59:38.982037+0000","last_unstale":"2024-09-12T18:59:59.010992+0000","last_undegraded":"2024-09-12T18:59:59.010992+0000","last_fullsized":"2024-09-12T18:59:59.010992+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446599+0000","last_change":"2024-09-12T17:55:59.358325+0000","last_active":"2024-09-12T18:56:42.446599+0000","last_peered":"2024-09-12T18:56:42.446599+0000","last_clean":"2024-09-12T18:56:42.446599+0000","last_became_active":"2024-09-12T17:55:59.357659+0000","last_became_peered":"2024-09-12T17:55:59.357659+0000","last_unstale":"2024-09-12T18:56:42.446599+0000","last_undegraded":"2024-09-12T18:56:42.446599+0000","last_fullsized":"2024-09-12T18:56:42.446599+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:47.942214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":69,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:59.444670+0000","last_change":"2024-09-12T18:19:57.850425+0000","last_active":"2024-09-12T18:56:59.444670+0000","last_peered":"2024-09-12T18:56:59.444670+0000","last_clean":"2024-09-12T18:56:59.444670+0000","last_became_active":"2024-09-12T18:19:57.849682+0000","last_became_peered":"2024-09-12T18:19:57.849682+0000","last_unstale":"2024-09-12T18:56:59.444670+0000","last_undegraded":"2024-09-12T18:56:59.444670+0000","last_fullsized":"2024-09-12T18:56:59.444670+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:20.403776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468396+0000","last_change":"2024-09-12T17:59:43.027722+0000","last_active":"2024-09-12T18:58:12.468396+0000","last_peered":"2024-09-12T18:58:12.468396+0000","last_clean":"2024-09-12T18:58:12.468396+0000","last_became_active":"2024-09-12T17:59:43.026619+0000","last_became_peered":"2024-09-12T17:59:43.026619+0000","last_unstale":"2024-09-12T18:58:12.468396+0000","last_undegraded":"2024-09-12T18:58:12.468396+0000","last_fullsized":"2024-09-12T18:58:12.468396+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:14.706171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468440+0000","last_change":"2024-09-12T17:59:38.988617+0000","last_active":"2024-09-12T18:58:12.468440+0000","last_peered":"2024-09-12T18:58:12.468440+0000","last_clean":"2024-09-12T18:58:12.468440+0000","last_became_active":"2024-09-12T17:59:38.988028+0000","last_became_peered":"2024-09-12T17:59:38.988028+0000","last_unstale":"2024-09-12T18:58:12.468440+0000","last_undegraded":"2024-09-12T18:58:12.468440+0000","last_fullsized":"2024-09-12T18:58:12.468440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:44.387070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'56","reported_seq":214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.453486+0000","last_change":"2024-09-12T17:55:59.361430+0000","last_active":"2024-09-12T18:57:07.453486+0000","last_peered":"2024-09-12T18:57:07.453486+0000","last_clean":"2024-09-12T18:57:07.453486+0000","last_became_active":"2024-09-12T17:55:59.360197+0000","last_became_peered":"2024-09-12T17:55:59.360197+0000","last_unstale":"2024-09-12T18:57:07.453486+0000","last_undegraded":"2024-09-12T18:57:07.453486+0000","last_fullsized":"2024-09-12T18:57:07.453486+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:56.611826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":199,"num_write":102,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436067+0000","last_change":"2024-09-12T18:19:57.869950+0000","last_active":"2024-09-12T18:55:57.436067+0000","last_peered":"2024-09-12T18:55:57.436067+0000","last_clean":"2024-09-12T18:55:57.436067+0000","last_became_active":"2024-09-12T18:19:57.869302+0000","last_became_peered":"2024-09-12T18:19:57.869302+0000","last_unstale":"2024-09-12T18:55:57.436067+0000","last_undegraded":"2024-09-12T18:55:57.436067+0000","last_fullsized":"2024-09-12T18:55:57.436067+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:38.615499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468287+0000","last_change":"2024-09-12T17:59:43.034683+0000","last_active":"2024-09-12T18:58:12.468287+0000","last_peered":"2024-09-12T18:58:12.468287+0000","last_clean":"2024-09-12T18:58:12.468287+0000","last_became_active":"2024-09-12T17:59:43.030846+0000","last_became_peered":"2024-09-12T17:59:43.030846+0000","last_unstale":"2024-09-12T18:58:12.468287+0000","last_undegraded":"2024-09-12T18:58:12.468287+0000","last_fullsized":"2024-09-12T18:58:12.468287+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:40.165184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.486836+0000","last_change":"2024-09-12T17:59:38.969547+0000","last_active":"2024-09-12T18:59:59.486836+0000","last_peered":"2024-09-12T18:59:59.486836+0000","last_clean":"2024-09-12T18:59:59.486836+0000","last_became_active":"2024-09-12T17:59:38.968775+0000","last_became_peered":"2024-09-12T17:59:38.968775+0000","last_unstale":"2024-09-12T18:59:59.486836+0000","last_undegraded":"2024-09-12T18:59:59.486836+0000","last_fullsized":"2024-09-12T18:59:59.486836+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":6,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.630374+0000","last_change":"2024-09-12T17:55:59.362984+0000","last_active":"2024-09-12T18:56:47.630374+0000","last_peered":"2024-09-12T18:56:47.630374+0000","last_clean":"2024-09-12T18:56:47.630374+0000","last_became_active":"2024-09-12T17:55:59.358747+0000","last_became_peered":"2024-09-12T17:55:59.358747+0000","last_unstale":"2024-09-12T18:56:47.630374+0000","last_undegraded":"2024-09-12T18:56:47.630374+0000","last_fullsized":"2024-09-12T18:56:47.630374+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:28.675045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.434729+0000","last_change":"2024-09-12T18:19:57.823688+0000","last_active":"2024-09-12T18:56:47.434729+0000","last_peered":"2024-09-12T18:56:47.434729+0000","last_clean":"2024-09-12T18:56:47.434729+0000","last_became_active":"2024-09-12T18:19:57.822958+0000","last_became_peered":"2024-09-12T18:19:57.822958+0000","last_unstale":"2024-09-12T18:56:47.434729+0000","last_undegraded":"2024-09-12T18:56:47.434729+0000","last_fullsized":"2024-09-12T18:56:47.434729+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:54.471704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:27.476553+0000","last_change":"2024-09-12T17:59:43.007833+0000","last_active":"2024-09-12T18:58:27.476553+0000","last_peered":"2024-09-12T18:58:27.476553+0000","last_clean":"2024-09-12T18:58:27.476553+0000","last_became_active":"2024-09-12T17:59:43.006748+0000","last_became_peered":"2024-09-12T17:59:43.006748+0000","last_unstale":"2024-09-12T18:58:27.476553+0000","last_undegraded":"2024-09-12T18:58:27.476553+0000","last_fullsized":"2024-09-12T18:58:27.476553+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:10.151387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.483589+0000","last_change":"2024-09-12T17:59:38.963724+0000","last_active":"2024-09-12T18:58:12.483589+0000","last_peered":"2024-09-12T18:58:12.483589+0000","last_clean":"2024-09-12T18:58:12.483589+0000","last_became_active":"2024-09-12T17:59:38.962944+0000","last_became_peered":"2024-09-12T17:59:38.962944+0000","last_unstale":"2024-09-12T18:58:12.483589+0000","last_undegraded":"2024-09-12T18:58:12.483589+0000","last_fullsized":"2024-09-12T18:58:12.483589+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:57.731165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'30","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.434839+0000","last_change":"2024-09-12T17:55:59.347093+0000","last_active":"2024-09-12T18:56:47.434839+0000","last_peered":"2024-09-12T18:56:47.434839+0000","last_clean":"2024-09-12T18:56:47.434839+0000","last_became_active":"2024-09-12T17:55:59.345735+0000","last_became_peered":"2024-09-12T17:55:59.345735+0000","last_unstale":"2024-09-12T18:56:47.434839+0000","last_undegraded":"2024-09-12T18:56:47.434839+0000","last_fullsized":"2024-09-12T18:56:47.434839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:02.647291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.447954+0000","last_change":"2024-09-12T18:19:57.856472+0000","last_active":"2024-09-12T18:56:47.447954+0000","last_peered":"2024-09-12T18:56:47.447954+0000","last_clean":"2024-09-12T18:56:47.447954+0000","last_became_active":"2024-09-12T18:19:57.855728+0000","last_became_peered":"2024-09-12T18:19:57.855728+0000","last_unstale":"2024-09-12T18:56:47.447954+0000","last_undegraded":"2024-09-12T18:56:47.447954+0000","last_fullsized":"2024-09-12T18:56:47.447954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:06.104974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468483+0000","last_change":"2024-09-12T17:59:43.020154+0000","last_active":"2024-09-12T18:58:12.468483+0000","last_peered":"2024-09-12T18:58:12.468483+0000","last_clean":"2024-09-12T18:58:12.468483+0000","last_became_active":"2024-09-12T17:59:43.019325+0000","last_became_peered":"2024-09-12T17:59:43.019325+0000","last_unstale":"2024-09-12T18:58:12.468483+0000","last_undegraded":"2024-09-12T18:58:12.468483+0000","last_fullsized":"2024-09-12T18:58:12.468483+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.764700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.447641+0000","last_change":"2024-09-12T17:59:38.978392+0000","last_active":"2024-09-12T18:56:12.447641+0000","last_peered":"2024-09-12T18:56:12.447641+0000","last_clean":"2024-09-12T18:56:12.447641+0000","last_became_active":"2024-09-12T17:59:38.977733+0000","last_became_peered":"2024-09-12T17:59:38.977733+0000","last_unstale":"2024-09-12T18:56:12.447641+0000","last_undegraded":"2024-09-12T18:56:12.447641+0000","last_fullsized":"2024-09-12T18:56:12.447641+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:10.294635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'50","reported_seq":205,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.648328+0000","last_change":"2024-09-12T19:00:23.648328+0000","last_active":"2024-09-12T19:00:23.648328+0000","last_peered":"2024-09-12T19:00:23.648328+0000","last_clean":"2024-09-12T19:00:23.648328+0000","last_became_active":"2024-09-12T17:55:59.341145+0000","last_became_peered":"2024-09-12T17:55:59.341145+0000","last_unstale":"2024-09-12T19:00:23.648328+0000","last_undegraded":"2024-09-12T19:00:23.648328+0000","last_fullsized":"2024-09-12T19:00:23.648328+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-12T19:00:23.648148+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-12T19:00:23.648148+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.648148+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:09.004260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":177,"num_write":99,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436472+0000","last_change":"2024-09-12T18:19:57.865840+0000","last_active":"2024-09-12T18:55:57.436472+0000","last_peered":"2024-09-12T18:55:57.436472+0000","last_clean":"2024-09-12T18:55:57.436472+0000","last_became_active":"2024-09-12T18:19:57.865311+0000","last_became_peered":"2024-09-12T18:19:57.865311+0000","last_unstale":"2024-09-12T18:55:57.436472+0000","last_undegraded":"2024-09-12T18:55:57.436472+0000","last_fullsized":"2024-09-12T18:55:57.436472+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:05.947872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.397700+0000","last_change":"2024-09-12T17:59:43.030010+0000","last_active":"2024-09-12T18:59:59.397700+0000","last_peered":"2024-09-12T18:59:59.397700+0000","last_clean":"2024-09-12T18:59:59.397700+0000","last_became_active":"2024-09-12T17:59:43.029489+0000","last_became_peered":"2024-09-12T17:59:43.029489+0000","last_unstale":"2024-09-12T18:59:59.397700+0000","last_undegraded":"2024-09-12T18:59:59.397700+0000","last_fullsized":"2024-09-12T18:59:59.397700+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.865506+0000","last_change":"2024-09-12T17:59:38.976141+0000","last_active":"2024-09-12T18:59:59.865506+0000","last_peered":"2024-09-12T18:59:59.865506+0000","last_clean":"2024-09-12T18:59:59.865506+0000","last_became_active":"2024-09-12T17:59:38.965185+0000","last_became_peered":"2024-09-12T17:59:38.965185+0000","last_unstale":"2024-09-12T18:59:59.865506+0000","last_undegraded":"2024-09-12T18:59:59.865506+0000","last_fullsized":"2024-09-12T18:59:59.865506+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'20","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464249+0000","last_change":"2024-09-12T17:55:59.360413+0000","last_active":"2024-09-12T18:56:47.464249+0000","last_peered":"2024-09-12T18:56:47.464249+0000","last_clean":"2024-09-12T18:56:47.464249+0000","last_became_active":"2024-09-12T17:55:59.359849+0000","last_became_peered":"2024-09-12T17:55:59.359849+0000","last_unstale":"2024-09-12T18:56:47.464249+0000","last_undegraded":"2024-09-12T18:56:47.464249+0000","last_fullsized":"2024-09-12T18:56:47.464249+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:05.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:07.438710+0000","last_change":"2024-09-12T18:19:57.855820+0000","last_active":"2024-09-12T18:56:07.438710+0000","last_peered":"2024-09-12T18:56:07.438710+0000","last_clean":"2024-09-12T18:56:07.438710+0000","last_became_active":"2024-09-12T18:19:57.855140+0000","last_became_peered":"2024-09-12T18:19:57.855140+0000","last_unstale":"2024-09-12T18:56:07.438710+0000","last_undegraded":"2024-09-12T18:56:07.438710+0000","last_fullsized":"2024-09-12T18:56:07.438710+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:19.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468253+0000","last_change":"2024-09-12T17:59:43.016545+0000","last_active":"2024-09-12T18:58:12.468253+0000","last_peered":"2024-09-12T18:58:12.468253+0000","last_clean":"2024-09-12T18:58:12.468253+0000","last_became_active":"2024-09-12T17:59:43.015273+0000","last_became_peered":"2024-09-12T17:59:43.015273+0000","last_unstale":"2024-09-12T18:58:12.468253+0000","last_undegraded":"2024-09-12T18:58:12.468253+0000","last_fullsized":"2024-09-12T18:58:12.468253+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'11","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.937941+0000","last_change":"2024-09-12T17:59:38.985394+0000","last_active":"2024-09-12T18:59:59.937941+0000","last_peered":"2024-09-12T18:59:59.937941+0000","last_clean":"2024-09-12T18:59:59.937941+0000","last_became_active":"2024-09-12T17:59:38.984684+0000","last_became_peered":"2024-09-12T17:59:38.984684+0000","last_unstale":"2024-09-12T18:59:59.937941+0000","last_undegraded":"2024-09-12T18:59:59.937941+0000","last_fullsized":"2024-09-12T18:59:59.937941+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6144,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'48","reported_seq":197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450249+0000","last_change":"2024-09-12T17:55:59.346860+0000","last_active":"2024-09-12T18:56:57.450249+0000","last_peered":"2024-09-12T18:56:57.450249+0000","last_clean":"2024-09-12T18:56:57.450249+0000","last_became_active":"2024-09-12T17:55:59.346128+0000","last_became_peered":"2024-09-12T17:55:59.346128+0000","last_unstale":"2024-09-12T18:56:57.450249+0000","last_undegraded":"2024-09-12T18:56:57.450249+0000","last_fullsized":"2024-09-12T18:56:57.450249+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:20.618591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":194,"num_write":71,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.436169+0000","last_change":"2024-09-12T18:19:57.851475+0000","last_active":"2024-09-12T18:55:57.436169+0000","last_peered":"2024-09-12T18:55:57.436169+0000","last_clean":"2024-09-12T18:55:57.436169+0000","last_became_active":"2024-09-12T18:19:57.848892+0000","last_became_peered":"2024-09-12T18:19:57.848892+0000","last_unstale":"2024-09-12T18:55:57.436169+0000","last_undegraded":"2024-09-12T18:55:57.436169+0000","last_fullsized":"2024-09-12T18:55:57.436169+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:29.052912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.473096+0000","last_change":"2024-09-12T17:59:43.038219+0000","last_active":"2024-09-12T18:58:12.473096+0000","last_peered":"2024-09-12T18:58:12.473096+0000","last_clean":"2024-09-12T18:58:12.473096+0000","last_became_active":"2024-09-12T17:59:43.034558+0000","last_became_peered":"2024-09-12T17:59:43.034558+0000","last_unstale":"2024-09-12T18:58:12.473096+0000","last_undegraded":"2024-09-12T18:58:12.473096+0000","last_fullsized":"2024-09-12T18:58:12.473096+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:16.222044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:27.487022+0000","last_change":"2024-09-12T17:59:38.981757+0000","last_active":"2024-09-12T18:58:27.487022+0000","last_peered":"2024-09-12T18:58:27.487022+0000","last_clean":"2024-09-12T18:58:27.487022+0000","last_became_active":"2024-09-12T17:59:38.973403+0000","last_became_peered":"2024-09-12T17:59:38.973403+0000","last_unstale":"2024-09-12T18:58:27.487022+0000","last_undegraded":"2024-09-12T18:58:27.487022+0000","last_fullsized":"2024-09-12T18:58:27.487022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:16.251811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'38","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446643+0000","last_change":"2024-09-12T17:55:59.346585+0000","last_active":"2024-09-12T18:56:42.446643+0000","last_peered":"2024-09-12T18:56:42.446643+0000","last_clean":"2024-09-12T18:56:42.446643+0000","last_became_active":"2024-09-12T17:55:59.345382+0000","last_became_peered":"2024-09-12T17:55:59.345382+0000","last_unstale":"2024-09-12T18:56:42.446643+0000","last_undegraded":"2024-09-12T18:56:42.446643+0000","last_fullsized":"2024-09-12T18:56:42.446643+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:18.100800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":134,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.453836+0000","last_change":"2024-09-12T18:19:57.844298+0000","last_active":"2024-09-12T18:55:57.453836+0000","last_peered":"2024-09-12T18:55:57.453836+0000","last_clean":"2024-09-12T18:55:57.453836+0000","last_became_active":"2024-09-12T18:19:57.843489+0000","last_became_peered":"2024-09-12T18:19:57.843489+0000","last_unstale":"2024-09-12T18:55:57.453836+0000","last_undegraded":"2024-09-12T18:55:57.453836+0000","last_fullsized":"2024-09-12T18:55:57.453836+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:30.667507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.440945+0000","last_change":"2024-09-12T17:59:43.023323+0000","last_active":"2024-09-12T18:56:17.440945+0000","last_peered":"2024-09-12T18:56:17.440945+0000","last_clean":"2024-09-12T18:56:17.440945+0000","last_became_active":"2024-09-12T17:59:43.022592+0000","last_became_peered":"2024-09-12T17:59:43.022592+0000","last_unstale":"2024-09-12T18:56:17.440945+0000","last_undegraded":"2024-09-12T18:56:17.440945+0000","last_fullsized":"2024-09-12T18:56:17.440945+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:49.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'3","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:57.800656+0000","last_change":"2024-09-12T17:59:38.976388+0000","last_active":"2024-09-12T18:55:57.800656+0000","last_peered":"2024-09-12T18:55:57.800656+0000","last_clean":"2024-09-12T18:55:57.800656+0000","last_became_active":"2024-09-12T17:59:38.975635+0000","last_became_peered":"2024-09-12T17:59:38.975635+0000","last_unstale":"2024-09-12T18:55:57.800656+0000","last_undegraded":"2024-09-12T18:55:57.800656+0000","last_fullsized":"2024-09-12T18:55:57.800656+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:08.497281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'44","reported_seq":180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433653+0000","last_change":"2024-09-12T17:55:59.352208+0000","last_active":"2024-09-12T18:56:42.433653+0000","last_peered":"2024-09-12T18:56:42.433653+0000","last_clean":"2024-09-12T18:56:42.433653+0000","last_became_active":"2024-09-12T17:55:59.351492+0000","last_became_peered":"2024-09-12T17:55:59.351492+0000","last_unstale":"2024-09-12T18:56:42.433653+0000","last_undegraded":"2024-09-12T18:56:42.433653+0000","last_fullsized":"2024-09-12T18:56:42.433653+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:59.997737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":151,"num_write":82,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457255+0000","last_change":"2024-09-12T18:19:57.856229+0000","last_active":"2024-09-12T18:57:27.457255+0000","last_peered":"2024-09-12T18:57:27.457255+0000","last_clean":"2024-09-12T18:57:27.457255+0000","last_became_active":"2024-09-12T18:19:57.855547+0000","last_became_peered":"2024-09-12T18:19:57.855547+0000","last_unstale":"2024-09-12T18:57:27.457255+0000","last_undegraded":"2024-09-12T18:57:27.457255+0000","last_fullsized":"2024-09-12T18:57:27.457255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:07.356723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'12","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.903652+0000","last_change":"2024-09-12T17:59:43.010558+0000","last_active":"2024-09-12T18:59:59.903652+0000","last_peered":"2024-09-12T18:59:59.903652+0000","last_clean":"2024-09-12T18:59:59.903652+0000","last_became_active":"2024-09-12T17:59:43.009629+0000","last_became_peered":"2024-09-12T17:59:43.009629+0000","last_unstale":"2024-09-12T18:59:59.903652+0000","last_undegraded":"2024-09-12T18:59:59.903652+0000","last_fullsized":"2024-09-12T18:59:59.903652+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":22,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'3","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.935682+0000","last_change":"2024-09-12T17:59:38.980397+0000","last_active":"2024-09-12T18:59:59.935682+0000","last_peered":"2024-09-12T18:59:59.935682+0000","last_clean":"2024-09-12T18:59:59.935682+0000","last_became_active":"2024-09-12T17:59:38.979704+0000","last_became_peered":"2024-09-12T17:59:38.979704+0000","last_unstale":"2024-09-12T18:59:59.935682+0000","last_undegraded":"2024-09-12T18:59:59.935682+0000","last_fullsized":"2024-09-12T18:59:59.935682+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463327+0000","last_change":"2024-09-12T17:55:59.357098+0000","last_active":"2024-09-12T18:56:42.463327+0000","last_peered":"2024-09-12T18:56:42.463327+0000","last_clean":"2024-09-12T18:56:42.463327+0000","last_became_active":"2024-09-12T17:55:59.356402+0000","last_became_peered":"2024-09-12T17:55:59.356402+0000","last_unstale":"2024-09-12T18:56:42.463327+0000","last_undegraded":"2024-09-12T18:56:42.463327+0000","last_fullsized":"2024-09-12T18:56:42.463327+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:21.680579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639954+0000","last_change":"2024-09-12T18:19:57.860245+0000","last_active":"2024-09-12T18:57:27.639954+0000","last_peered":"2024-09-12T18:57:27.639954+0000","last_clean":"2024-09-12T18:57:27.639954+0000","last_became_active":"2024-09-12T18:19:57.859591+0000","last_became_peered":"2024-09-12T18:19:57.859591+0000","last_unstale":"2024-09-12T18:57:27.639954+0000","last_undegraded":"2024-09-12T18:57:27.639954+0000","last_fullsized":"2024-09-12T18:57:27.639954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:28.131141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.481246+0000","last_change":"2024-09-12T17:59:43.009259+0000","last_active":"2024-09-12T18:58:02.481246+0000","last_peered":"2024-09-12T18:58:02.481246+0000","last_clean":"2024-09-12T18:58:02.481246+0000","last_became_active":"2024-09-12T17:59:43.008547+0000","last_became_peered":"2024-09-12T17:59:43.008547+0000","last_unstale":"2024-09-12T18:58:02.481246+0000","last_undegraded":"2024-09-12T18:58:02.481246+0000","last_fullsized":"2024-09-12T18:58:02.481246+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:14.460734+0000","last_change":"2024-09-12T17:59:38.969392+0000","last_active":"2024-09-12T18:58:14.460734+0000","last_peered":"2024-09-12T18:58:14.460734+0000","last_clean":"2024-09-12T18:58:14.460734+0000","last_became_active":"2024-09-12T17:59:38.968249+0000","last_became_peered":"2024-09-12T17:59:38.968249+0000","last_unstale":"2024-09-12T18:58:14.460734+0000","last_undegraded":"2024-09-12T18:58:14.460734+0000","last_fullsized":"2024-09-12T18:58:14.460734+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'17","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.433857+0000","last_change":"2024-09-12T17:55:59.355112+0000","last_active":"2024-09-12T18:56:42.433857+0000","last_peered":"2024-09-12T18:56:42.433857+0000","last_clean":"2024-09-12T18:56:42.433857+0000","last_became_active":"2024-09-12T17:55:59.354383+0000","last_became_peered":"2024-09-12T17:55:59.354383+0000","last_unstale":"2024-09-12T18:56:42.433857+0000","last_undegraded":"2024-09-12T18:56:42.433857+0000","last_fullsized":"2024-09-12T18:56:42.433857+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:12.015628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:07.472021+0000","last_change":"2024-09-12T18:19:57.864592+0000","last_active":"2024-09-12T18:58:07.472021+0000","last_peered":"2024-09-12T18:58:07.472021+0000","last_clean":"2024-09-12T18:58:07.472021+0000","last_became_active":"2024-09-12T18:19:57.858987+0000","last_became_peered":"2024-09-12T18:19:57.858987+0000","last_unstale":"2024-09-12T18:58:07.472021+0000","last_undegraded":"2024-09-12T18:58:07.472021+0000","last_fullsized":"2024-09-12T18:58:07.472021+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'10","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.710130+0000","last_change":"2024-09-12T17:59:43.023426+0000","last_active":"2024-09-12T18:59:59.710130+0000","last_peered":"2024-09-12T18:59:59.710130+0000","last_clean":"2024-09-12T18:59:59.710130+0000","last_became_active":"2024-09-12T17:59:43.022405+0000","last_became_peered":"2024-09-12T17:59:43.022405+0000","last_unstale":"2024-09-12T18:59:59.710130+0000","last_undegraded":"2024-09-12T18:59:59.710130+0000","last_fullsized":"2024-09-12T18:59:59.710130+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12356,"num_write":10,"num_write_kb":8260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.603488+0000","last_change":"2024-09-12T17:59:38.966348+0000","last_active":"2024-09-12T18:59:59.603488+0000","last_peered":"2024-09-12T18:59:59.603488+0000","last_clean":"2024-09-12T18:59:59.603488+0000","last_became_active":"2024-09-12T17:59:38.964439+0000","last_became_peered":"2024-09-12T17:59:38.964439+0000","last_unstale":"2024-09-12T18:59:59.603488+0000","last_undegraded":"2024-09-12T18:59:59.603488+0000","last_fullsized":"2024-09-12T18:59:59.603488+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'113","reported_seq":414,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446927+0000","last_change":"2024-09-12T17:55:59.361437+0000","last_active":"2024-09-12T18:56:42.446927+0000","last_peered":"2024-09-12T18:56:42.446927+0000","last_clean":"2024-09-12T18:56:42.446927+0000","last_became_active":"2024-09-12T17:55:59.360296+0000","last_became_peered":"2024-09-12T17:55:59.360296+0000","last_unstale":"2024-09-12T18:56:42.446927+0000","last_undegraded":"2024-09-12T18:56:42.446927+0000","last_fullsized":"2024-09-12T18:56:42.446927+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:54.893983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":493,"num_write":148,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.819989+0000","last_change":"2024-09-12T18:19:57.871333+0000","last_active":"2024-09-12T18:57:27.819989+0000","last_peered":"2024-09-12T18:57:27.819989+0000","last_clean":"2024-09-12T18:57:27.819989+0000","last_became_active":"2024-09-12T18:19:57.870563+0000","last_became_peered":"2024-09-12T18:19:57.870563+0000","last_unstale":"2024-09-12T18:57:27.819989+0000","last_undegraded":"2024-09-12T18:57:27.819989+0000","last_fullsized":"2024-09-12T18:57:27.819989+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:12.142130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.830788+0000","last_change":"2024-09-12T17:59:43.019692+0000","last_active":"2024-09-12T18:58:12.830788+0000","last_peered":"2024-09-12T18:58:12.830788+0000","last_clean":"2024-09-12T18:58:12.830788+0000","last_became_active":"2024-09-12T17:59:43.018869+0000","last_became_peered":"2024-09-12T17:59:43.018869+0000","last_unstale":"2024-09-12T18:58:12.830788+0000","last_undegraded":"2024-09-12T18:58:12.830788+0000","last_fullsized":"2024-09-12T18:58:12.830788+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.212567+0000","last_change":"2024-09-12T17:59:38.989030+0000","last_active":"2024-09-12T18:59:59.212567+0000","last_peered":"2024-09-12T18:59:59.212567+0000","last_clean":"2024-09-12T18:59:59.212567+0000","last_became_active":"2024-09-12T17:59:38.988237+0000","last_became_peered":"2024-09-12T17:59:38.988237+0000","last_unstale":"2024-09-12T18:59:59.212567+0000","last_undegraded":"2024-09-12T18:59:59.212567+0000","last_fullsized":"2024-09-12T18:59:59.212567+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'6","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.450666+0000","last_change":"2024-09-12T17:55:59.354590+0000","last_active":"2024-09-12T18:56:27.450666+0000","last_peered":"2024-09-12T18:56:27.450666+0000","last_clean":"2024-09-12T18:56:27.450666+0000","last_became_active":"2024-09-12T17:55:59.353823+0000","last_became_peered":"2024-09-12T17:55:59.353823+0000","last_unstale":"2024-09-12T18:56:27.450666+0000","last_undegraded":"2024-09-12T18:56:27.450666+0000","last_fullsized":"2024-09-12T18:56:27.450666+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:54.453586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:49.442825+0000","last_change":"2024-09-12T18:19:57.840515+0000","last_active":"2024-09-12T18:56:49.442825+0000","last_peered":"2024-09-12T18:56:49.442825+0000","last_clean":"2024-09-12T18:56:49.442825+0000","last_became_active":"2024-09-12T18:19:57.839756+0000","last_became_peered":"2024-09-12T18:19:57.839756+0000","last_unstale":"2024-09-12T18:56:49.442825+0000","last_undegraded":"2024-09-12T18:56:49.442825+0000","last_fullsized":"2024-09-12T18:56:49.442825+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:01.658644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.471089+0000","last_change":"2024-09-12T17:59:43.038905+0000","last_active":"2024-09-12T18:58:02.471089+0000","last_peered":"2024-09-12T18:58:02.471089+0000","last_clean":"2024-09-12T18:58:02.471089+0000","last_became_active":"2024-09-12T17:59:43.033049+0000","last_became_peered":"2024-09-12T17:59:43.033049+0000","last_unstale":"2024-09-12T18:58:02.471089+0000","last_undegraded":"2024-09-12T18:58:02.471089+0000","last_fullsized":"2024-09-12T18:58:02.471089+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'9","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464697+0000","last_change":"2024-09-12T17:59:38.986578+0000","last_active":"2024-09-12T18:57:57.464697+0000","last_peered":"2024-09-12T18:57:57.464697+0000","last_clean":"2024-09-12T18:57:57.464697+0000","last_became_active":"2024-09-12T17:59:38.985971+0000","last_became_peered":"2024-09-12T17:59:38.985971+0000","last_unstale":"2024-09-12T18:57:57.464697+0000","last_undegraded":"2024-09-12T18:57:57.464697+0000","last_fullsized":"2024-09-12T18:57:57.464697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:41.717343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'13","reported_seq":101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.625796+0000","last_change":"2024-09-12T17:55:59.358658+0000","last_active":"2024-09-12T18:56:27.625796+0000","last_peered":"2024-09-12T18:56:27.625796+0000","last_clean":"2024-09-12T18:56:27.625796+0000","last_became_active":"2024-09-12T17:55:59.352474+0000","last_became_peered":"2024-09-12T17:55:59.352474+0000","last_unstale":"2024-09-12T18:56:27.625796+0000","last_undegraded":"2024-09-12T18:56:27.625796+0000","last_fullsized":"2024-09-12T18:56:27.625796+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:54.466534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464409+0000","last_change":"2024-09-12T18:19:57.847713+0000","last_active":"2024-09-12T18:56:47.464409+0000","last_peered":"2024-09-12T18:56:47.464409+0000","last_clean":"2024-09-12T18:56:47.464409+0000","last_became_active":"2024-09-12T18:19:57.846907+0000","last_became_peered":"2024-09-12T18:19:57.846907+0000","last_unstale":"2024-09-12T18:56:47.464409+0000","last_undegraded":"2024-09-12T18:56:47.464409+0000","last_fullsized":"2024-09-12T18:56:47.464409+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:30.600770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'12","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:52.683786+0000","last_change":"2024-09-12T17:59:43.023811+0000","last_active":"2024-09-12T18:59:52.683786+0000","last_peered":"2024-09-12T18:59:52.683786+0000","last_clean":"2024-09-12T18:59:52.683786+0000","last_became_active":"2024-09-12T17:59:43.022991+0000","last_became_peered":"2024-09-12T17:59:43.022991+0000","last_unstale":"2024-09-12T18:59:52.683786+0000","last_undegraded":"2024-09-12T18:59:52.683786+0000","last_fullsized":"2024-09-12T18:59:52.683786+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:41.803212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20482,"num_write":22,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.863323+0000","last_change":"2024-09-12T17:59:38.990278+0000","last_active":"2024-09-12T18:59:59.863323+0000","last_peered":"2024-09-12T18:59:59.863323+0000","last_clean":"2024-09-12T18:59:59.863323+0000","last_became_active":"2024-09-12T17:59:38.989530+0000","last_became_peered":"2024-09-12T17:59:38.989530+0000","last_unstale":"2024-09-12T18:59:59.863323+0000","last_undegraded":"2024-09-12T18:59:59.863323+0000","last_fullsized":"2024-09-12T18:59:59.863323+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'9","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.807160+0000","last_change":"2024-09-12T17:55:59.345043+0000","last_active":"2024-09-12T18:56:27.807160+0000","last_peered":"2024-09-12T18:56:27.807160+0000","last_clean":"2024-09-12T18:56:27.807160+0000","last_became_active":"2024-09-12T17:55:59.344251+0000","last_became_peered":"2024-09-12T17:55:59.344251+0000","last_unstale":"2024-09-12T18:56:27.807160+0000","last_undegraded":"2024-09-12T18:56:27.807160+0000","last_fullsized":"2024-09-12T18:56:27.807160+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:29.508189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473350+0000","last_change":"2024-09-12T18:19:57.848079+0000","last_active":"2024-09-12T18:57:27.473350+0000","last_peered":"2024-09-12T18:57:27.473350+0000","last_clean":"2024-09-12T18:57:27.473350+0000","last_became_active":"2024-09-12T18:19:57.847330+0000","last_became_peered":"2024-09-12T18:19:57.847330+0000","last_unstale":"2024-09-12T18:57:27.473350+0000","last_undegraded":"2024-09-12T18:57:27.473350+0000","last_fullsized":"2024-09-12T18:57:27.473350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:06.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.711100+0000","last_change":"2024-09-12T17:59:43.028989+0000","last_active":"2024-09-12T18:59:59.711100+0000","last_peered":"2024-09-12T18:59:59.711100+0000","last_clean":"2024-09-12T18:59:59.711100+0000","last_became_active":"2024-09-12T17:59:43.028305+0000","last_became_peered":"2024-09-12T17:59:43.028305+0000","last_unstale":"2024-09-12T18:59:59.711100+0000","last_undegraded":"2024-09-12T18:59:59.711100+0000","last_fullsized":"2024-09-12T18:59:59.711100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.471175+0000","last_change":"2024-09-12T17:59:38.987789+0000","last_active":"2024-09-12T18:58:02.471175+0000","last_peered":"2024-09-12T18:58:02.471175+0000","last_clean":"2024-09-12T18:58:02.471175+0000","last_became_active":"2024-09-12T17:59:38.986062+0000","last_became_peered":"2024-09-12T17:59:38.986062+0000","last_unstale":"2024-09-12T18:58:02.471175+0000","last_undegraded":"2024-09-12T18:58:02.471175+0000","last_fullsized":"2024-09-12T18:58:02.471175+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'31","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.430557+0000","last_change":"2024-09-12T17:55:59.346330+0000","last_active":"2024-09-12T18:56:27.430557+0000","last_peered":"2024-09-12T18:56:27.430557+0000","last_clean":"2024-09-12T18:56:27.430557+0000","last_became_active":"2024-09-12T17:55:59.345469+0000","last_became_peered":"2024-09-12T17:55:59.345469+0000","last_unstale":"2024-09-12T18:56:27.430557+0000","last_undegraded":"2024-09-12T18:56:27.430557+0000","last_fullsized":"2024-09-12T18:56:27.430557+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:40.512299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":47,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.459721+0000","last_change":"2024-09-12T18:19:57.845031+0000","last_active":"2024-09-12T18:57:37.459721+0000","last_peered":"2024-09-12T18:57:37.459721+0000","last_clean":"2024-09-12T18:57:37.459721+0000","last_became_active":"2024-09-12T18:19:57.844161+0000","last_became_peered":"2024-09-12T18:19:57.844161+0000","last_unstale":"2024-09-12T18:57:37.459721+0000","last_undegraded":"2024-09-12T18:57:37.459721+0000","last_fullsized":"2024-09-12T18:57:37.459721+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:42.398579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.710565+0000","last_change":"2024-09-12T17:59:43.020614+0000","last_active":"2024-09-12T18:59:59.710565+0000","last_peered":"2024-09-12T18:59:59.710565+0000","last_clean":"2024-09-12T18:59:59.710565+0000","last_became_active":"2024-09-12T17:59:43.019274+0000","last_became_peered":"2024-09-12T17:59:43.019274+0000","last_unstale":"2024-09-12T18:59:59.710565+0000","last_undegraded":"2024-09-12T18:59:59.710565+0000","last_fullsized":"2024-09-12T18:59:59.710565+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.935682+0000","last_change":"2024-09-12T17:59:38.969202+0000","last_active":"2024-09-12T18:59:59.935682+0000","last_peered":"2024-09-12T18:59:59.935682+0000","last_clean":"2024-09-12T18:59:59.935682+0000","last_became_active":"2024-09-12T17:59:38.968500+0000","last_became_peered":"2024-09-12T17:59:38.968500+0000","last_unstale":"2024-09-12T18:59:59.935682+0000","last_undegraded":"2024-09-12T18:59:59.935682+0000","last_fullsized":"2024-09-12T18:59:59.935682+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1072,"num_write":18,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:17.469489+0000","last_change":"2024-09-12T17:55:59.355326+0000","last_active":"2024-09-12T18:58:17.469489+0000","last_peered":"2024-09-12T18:58:17.469489+0000","last_clean":"2024-09-12T18:58:17.469489+0000","last_became_active":"2024-09-12T17:55:59.354620+0000","last_became_peered":"2024-09-12T17:55:59.354620+0000","last_unstale":"2024-09-12T18:58:17.469489+0000","last_undegraded":"2024-09-12T18:58:17.469489+0000","last_fullsized":"2024-09-12T18:58:17.469489+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":145,"num_write":78,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'397","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.897784+0000","last_change":"2024-09-12T19:00:18.897784+0000","last_active":"2024-09-12T19:00:18.897784+0000","last_peered":"2024-09-12T19:00:18.897784+0000","last_clean":"2024-09-12T19:00:18.897784+0000","last_became_active":"2024-09-12T17:40:18.784159+0000","last_became_peered":"2024-09-12T17:40:18.784159+0000","last_unstale":"2024-09-12T19:00:18.897784+0000","last_undegraded":"2024-09-12T19:00:18.897784+0000","last_fullsized":"2024-09-12T19:00:18.897784+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:18.897555+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:18.897555+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.897555+0000","objects_scrubbed":10,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:40.787061+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813897,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":527,"num_read_kb":37913,"num_write":1207,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'93","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.361475+0000","last_change":"2024-09-12T19:00:22.361348+0000","last_active":"2024-09-12T19:00:22.361475+0000","last_peered":"2024-09-12T19:00:22.361475+0000","last_clean":"2024-09-12T19:00:22.361475+0000","last_became_active":"2024-09-12T17:40:20.138680+0000","last_became_peered":"2024-09-12T17:40:20.138680+0000","last_unstale":"2024-09-12T19:00:22.361475+0000","last_undegraded":"2024-09-12T19:00:22.361475+0000","last_fullsized":"2024-09-12T19:00:22.361475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-12T19:00:22.361173+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-12T19:00:22.361173+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.361173+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:49.691123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'329","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.454755+0000","last_change":"2024-09-12T19:00:12.454755+0000","last_active":"2024-09-12T19:00:12.454755+0000","last_peered":"2024-09-12T19:00:12.454755+0000","last_clean":"2024-09-12T19:00:12.454755+0000","last_became_active":"2024-09-12T17:40:18.761214+0000","last_became_peered":"2024-09-12T17:40:18.761214+0000","last_unstale":"2024-09-12T19:00:12.454755+0000","last_undegraded":"2024-09-12T19:00:12.454755+0000","last_fullsized":"2024-09-12T19:00:12.454755+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T19:00:12.454463+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T19:00:12.454463+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.454463+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:45.994067+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4802709,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":37097,"num_write":958,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'255","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:52.463559+0000","last_change":"2024-09-12T17:40:20.134527+0000","last_active":"2024-09-12T18:57:52.463559+0000","last_peered":"2024-09-12T18:57:52.463559+0000","last_clean":"2024-09-12T18:57:52.463559+0000","last_became_active":"2024-09-12T17:40:20.133791+0000","last_became_peered":"2024-09-12T17:40:20.133791+0000","last_unstale":"2024-09-12T18:57:52.463559+0000","last_undegraded":"2024-09-12T18:57:52.463559+0000","last_fullsized":"2024-09-12T18:57:52.463559+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1087,"num_read_kb":867,"num_write":420,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'407","reported_seq":1075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.350302+0000","last_change":"2024-09-12T19:00:12.350302+0000","last_active":"2024-09-12T19:00:12.350302+0000","last_peered":"2024-09-12T19:00:12.350302+0000","last_clean":"2024-09-12T19:00:12.350302+0000","last_became_active":"2024-09-12T17:40:18.755606+0000","last_became_peered":"2024-09-12T17:40:18.755606+0000","last_unstale":"2024-09-12T19:00:12.350302+0000","last_undegraded":"2024-09-12T19:00:12.350302+0000","last_fullsized":"2024-09-12T19:00:12.350302+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T19:00:12.350095+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T19:00:12.350095+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.350095+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:10.932589+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457546,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":570,"num_read_kb":26533,"num_write":1277,"num_write_kb":46376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'130","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.431641+0000","last_change":"2024-09-12T17:40:20.130876+0000","last_active":"2024-09-12T18:58:04.431641+0000","last_peered":"2024-09-12T18:58:04.431641+0000","last_clean":"2024-09-12T18:58:04.431641+0000","last_became_active":"2024-09-12T17:40:20.130123+0000","last_became_peered":"2024-09-12T17:40:20.130123+0000","last_unstale":"2024-09-12T18:58:04.431641+0000","last_undegraded":"2024-09-12T18:58:04.431641+0000","last_fullsized":"2024-09-12T18:58:04.431641+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":589,"num_read_kb":499,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'345","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.350905+0000","last_change":"2024-09-12T19:00:17.350905+0000","last_active":"2024-09-12T19:00:17.350905+0000","last_peered":"2024-09-12T19:00:17.350905+0000","last_clean":"2024-09-12T19:00:17.350905+0000","last_became_active":"2024-09-12T17:40:18.768170+0000","last_became_peered":"2024-09-12T17:40:18.768170+0000","last_unstale":"2024-09-12T19:00:17.350905+0000","last_undegraded":"2024-09-12T19:00:17.350905+0000","last_fullsized":"2024-09-12T19:00:17.350905+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-12T19:00:17.350715+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-12T19:00:17.350715+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.350715+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.875766+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388668,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":59190,"num_write":1207,"num_write_kb":44467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'100","reported_seq":709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.333064+0000","last_change":"2024-09-12T19:00:21.332900+0000","last_active":"2024-09-12T19:00:21.333064+0000","last_peered":"2024-09-12T19:00:21.333064+0000","last_clean":"2024-09-12T19:00:21.333064+0000","last_became_active":"2024-09-12T17:40:20.114923+0000","last_became_peered":"2024-09-12T17:40:20.114923+0000","last_unstale":"2024-09-12T19:00:21.333064+0000","last_undegraded":"2024-09-12T19:00:21.333064+0000","last_fullsized":"2024-09-12T19:00:21.333064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T19:00:21.332717+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T19:00:21.332717+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.332717+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:04.580548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":408,"num_write":151,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'318","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.885850+0000","last_change":"2024-09-12T19:00:14.885692+0000","last_active":"2024-09-12T19:00:14.885850+0000","last_peered":"2024-09-12T19:00:14.885850+0000","last_clean":"2024-09-12T19:00:14.885850+0000","last_became_active":"2024-09-12T17:40:18.778991+0000","last_became_peered":"2024-09-12T17:40:18.778991+0000","last_unstale":"2024-09-12T19:00:14.885850+0000","last_undegraded":"2024-09-12T19:00:14.885850+0000","last_fullsized":"2024-09-12T19:00:14.885850+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-12T19:00:14.885480+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-12T19:00:14.885480+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.885480+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:10.907616+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311787,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":19945,"num_write":986,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'100","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.464796+0000","last_change":"2024-09-12T19:00:18.464796+0000","last_active":"2024-09-12T19:00:18.464796+0000","last_peered":"2024-09-12T19:00:18.464796+0000","last_clean":"2024-09-12T19:00:18.464796+0000","last_became_active":"2024-09-12T17:40:20.127556+0000","last_became_peered":"2024-09-12T17:40:20.127556+0000","last_unstale":"2024-09-12T19:00:18.464796+0000","last_undegraded":"2024-09-12T19:00:18.464796+0000","last_fullsized":"2024-09-12T19:00:18.464796+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T19:00:18.464562+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T19:00:18.464562+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.464562+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:00.473679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":458,"num_read_kb":378,"num_write":157,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'384","reported_seq":1012,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.311697+0000","last_change":"2024-09-12T19:00:16.311566+0000","last_active":"2024-09-12T19:00:16.311697+0000","last_peered":"2024-09-12T19:00:16.311697+0000","last_clean":"2024-09-12T19:00:16.311697+0000","last_became_active":"2024-09-12T17:40:18.760958+0000","last_became_peered":"2024-09-12T17:40:18.760958+0000","last_unstale":"2024-09-12T19:00:16.311697+0000","last_undegraded":"2024-09-12T19:00:16.311697+0000","last_fullsized":"2024-09-12T19:00:16.311697+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-12T19:00:16.311345+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-12T19:00:16.311345+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.311345+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:52.751993+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":8666,"num_write":1215,"num_write_kb":27182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'123","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820225+0000","last_change":"2024-09-12T17:40:20.136587+0000","last_active":"2024-09-12T18:57:27.820225+0000","last_peered":"2024-09-12T18:57:27.820225+0000","last_clean":"2024-09-12T18:57:27.820225+0000","last_became_active":"2024-09-12T17:40:20.132985+0000","last_became_peered":"2024-09-12T17:40:20.132985+0000","last_unstale":"2024-09-12T18:57:27.820225+0000","last_undegraded":"2024-09-12T18:57:27.820225+0000","last_fullsized":"2024-09-12T18:57:27.820225+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:46.649354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":462,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'403","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.903729+0000","last_change":"2024-09-12T19:00:17.903504+0000","last_active":"2024-09-12T19:00:17.903729+0000","last_peered":"2024-09-12T19:00:17.903729+0000","last_clean":"2024-09-12T19:00:17.903729+0000","last_became_active":"2024-09-12T17:40:18.761056+0000","last_became_peered":"2024-09-12T17:40:18.761056+0000","last_unstale":"2024-09-12T19:00:17.903729+0000","last_undegraded":"2024-09-12T19:00:17.903729+0000","last_fullsized":"2024-09-12T19:00:17.903729+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'403","last_scrub_stamp":"2024-09-12T19:00:17.903214+0000","last_deep_scrub":"264'403","last_deep_scrub_stamp":"2024-09-12T19:00:17.903214+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.903214+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:06.436732+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":74800,"num_write":1233,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'208","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.640055+0000","last_change":"2024-09-12T17:40:20.135326+0000","last_active":"2024-09-12T18:57:27.640055+0000","last_peered":"2024-09-12T18:57:27.640055+0000","last_clean":"2024-09-12T18:57:27.640055+0000","last_became_active":"2024-09-12T17:40:20.134441+0000","last_became_peered":"2024-09-12T17:40:20.134441+0000","last_unstale":"2024-09-12T18:57:27.640055+0000","last_undegraded":"2024-09-12T18:57:27.640055+0000","last_fullsized":"2024-09-12T18:57:27.640055+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:29.851316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":897,"num_read_kb":734,"num_write":311,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'373","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.647147+0000","last_change":"2024-09-12T19:00:11.647011+0000","last_active":"2024-09-12T19:00:11.647147+0000","last_peered":"2024-09-12T19:00:11.647147+0000","last_clean":"2024-09-12T19:00:11.647147+0000","last_became_active":"2024-09-12T17:40:18.773843+0000","last_became_peered":"2024-09-12T17:40:18.773843+0000","last_unstale":"2024-09-12T19:00:11.647147+0000","last_undegraded":"2024-09-12T19:00:11.647147+0000","last_fullsized":"2024-09-12T19:00:11.647147+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T19:00:11.646768+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T19:00:11.646768+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.646768+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:20.752287+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":629,"num_read_kb":30255,"num_write":1158,"num_write_kb":52642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'233","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.570316+0000","last_change":"2024-09-12T19:00:15.570316+0000","last_active":"2024-09-12T19:00:15.570316+0000","last_peered":"2024-09-12T19:00:15.570316+0000","last_clean":"2024-09-12T19:00:15.570316+0000","last_became_active":"2024-09-12T17:40:20.120891+0000","last_became_peered":"2024-09-12T17:40:20.120891+0000","last_unstale":"2024-09-12T19:00:15.570316+0000","last_undegraded":"2024-09-12T19:00:15.570316+0000","last_fullsized":"2024-09-12T19:00:15.570316+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-12T19:00:15.570121+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-12T19:00:15.570121+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.570121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:40.079950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":858,"num_write":384,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'192","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.818850+0000","last_change":"2024-09-12T17:40:20.135279+0000","last_active":"2024-09-12T18:57:22.818850+0000","last_peered":"2024-09-12T18:57:22.818850+0000","last_clean":"2024-09-12T18:57:22.818850+0000","last_became_active":"2024-09-12T17:40:20.132466+0000","last_became_peered":"2024-09-12T17:40:20.132466+0000","last_unstale":"2024-09-12T18:57:22.818850+0000","last_undegraded":"2024-09-12T18:57:22.818850+0000","last_fullsized":"2024-09-12T18:57:22.818850+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:47.393866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":674,"num_write":287,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'340","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.947779+0000","last_change":"2024-09-12T19:00:12.947508+0000","last_active":"2024-09-12T19:00:12.947779+0000","last_peered":"2024-09-12T19:00:12.947779+0000","last_clean":"2024-09-12T19:00:12.947779+0000","last_became_active":"2024-09-12T17:40:18.783282+0000","last_became_peered":"2024-09-12T17:40:18.783282+0000","last_unstale":"2024-09-12T19:00:12.947779+0000","last_undegraded":"2024-09-12T19:00:12.947779+0000","last_fullsized":"2024-09-12T19:00:12.947779+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-12T19:00:12.947254+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-12T19:00:12.947254+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.947254+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:14.588512+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":17792,"num_write":1019,"num_write_kb":32630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'129","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.953874+0000","last_change":"2024-09-12T19:00:20.953874+0000","last_active":"2024-09-12T19:00:20.953874+0000","last_peered":"2024-09-12T19:00:20.953874+0000","last_clean":"2024-09-12T19:00:20.953874+0000","last_became_active":"2024-09-12T17:40:20.143471+0000","last_became_peered":"2024-09-12T17:40:20.143471+0000","last_unstale":"2024-09-12T19:00:20.953874+0000","last_undegraded":"2024-09-12T19:00:20.953874+0000","last_fullsized":"2024-09-12T19:00:20.953874+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T19:00:20.953686+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T19:00:20.953686+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.953686+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:56.936299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":544,"num_read_kb":441,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'314","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.428631+0000","last_change":"2024-09-12T19:00:13.428631+0000","last_active":"2024-09-12T19:00:13.428631+0000","last_peered":"2024-09-12T19:00:13.428631+0000","last_clean":"2024-09-12T19:00:13.428631+0000","last_became_active":"2024-09-12T17:40:18.756814+0000","last_became_peered":"2024-09-12T17:40:18.756814+0000","last_unstale":"2024-09-12T19:00:13.428631+0000","last_undegraded":"2024-09-12T19:00:13.428631+0000","last_fullsized":"2024-09-12T19:00:13.428631+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T19:00:13.428455+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T19:00:13.428455+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.428455+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:27.159173+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048617,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":410,"num_read_kb":9611,"num_write":991,"num_write_kb":28982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'86","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.320660+0000","last_change":"2024-09-12T19:00:20.320660+0000","last_active":"2024-09-12T19:00:20.320660+0000","last_peered":"2024-09-12T19:00:20.320660+0000","last_clean":"2024-09-12T19:00:20.320660+0000","last_became_active":"2024-09-12T17:40:20.124104+0000","last_became_peered":"2024-09-12T17:40:20.124104+0000","last_unstale":"2024-09-12T19:00:20.320660+0000","last_undegraded":"2024-09-12T19:00:20.320660+0000","last_fullsized":"2024-09-12T19:00:20.320660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T19:00:20.320383+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T19:00:20.320383+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.320383+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:50.248150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":294,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'414","reported_seq":1113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.412693+0000","last_change":"2024-09-12T19:00:11.412693+0000","last_active":"2024-09-12T19:00:11.412693+0000","last_peered":"2024-09-12T19:00:11.412693+0000","last_clean":"2024-09-12T19:00:11.412693+0000","last_became_active":"2024-09-12T17:40:18.773787+0000","last_became_peered":"2024-09-12T17:40:18.773787+0000","last_unstale":"2024-09-12T19:00:11.412693+0000","last_undegraded":"2024-09-12T19:00:11.412693+0000","last_fullsized":"2024-09-12T19:00:11.412693+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-12T19:00:11.412318+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-12T19:00:11.412318+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.412318+0000","objects_scrubbed":10,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:40.943987+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1575003,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":648,"num_read_kb":7584,"num_write":1228,"num_write_kb":45057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'154","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.627859+0000","last_change":"2024-09-12T19:00:11.627859+0000","last_active":"2024-09-12T19:00:11.627859+0000","last_peered":"2024-09-12T19:00:11.627859+0000","last_clean":"2024-09-12T19:00:11.627859+0000","last_became_active":"2024-09-12T17:40:20.120803+0000","last_became_peered":"2024-09-12T17:40:20.120803+0000","last_unstale":"2024-09-12T19:00:11.627859+0000","last_undegraded":"2024-09-12T19:00:11.627859+0000","last_fullsized":"2024-09-12T19:00:11.627859+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-12T19:00:11.627566+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-12T19:00:11.627566+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.627566+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:32.581707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":714,"num_read_kb":606,"num_write":221,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'317","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.802687+0000","last_change":"2024-09-12T19:00:10.802687+0000","last_active":"2024-09-12T19:00:10.802687+0000","last_peered":"2024-09-12T19:00:10.802687+0000","last_clean":"2024-09-12T19:00:10.802687+0000","last_became_active":"2024-09-12T17:40:18.769867+0000","last_became_peered":"2024-09-12T17:40:18.769867+0000","last_unstale":"2024-09-12T19:00:10.802687+0000","last_undegraded":"2024-09-12T19:00:10.802687+0000","last_fullsized":"2024-09-12T19:00:10.802687+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T19:00:10.802484+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T19:00:10.802484+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.802484+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:37.820292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":25356,"num_write":1086,"num_write_kb":19597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'166","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.599974+0000","last_change":"2024-09-12T19:00:14.599974+0000","last_active":"2024-09-12T19:00:14.599974+0000","last_peered":"2024-09-12T19:00:14.599974+0000","last_clean":"2024-09-12T19:00:14.599974+0000","last_became_active":"2024-09-12T17:40:20.131603+0000","last_became_peered":"2024-09-12T17:40:20.131603+0000","last_unstale":"2024-09-12T19:00:14.599974+0000","last_undegraded":"2024-09-12T19:00:14.599974+0000","last_fullsized":"2024-09-12T19:00:14.599974+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T19:00:14.599795+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T19:00:14.599795+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.599795+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:11.205160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":647,"num_write":268,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'329","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.651668+0000","last_change":"2024-09-12T19:00:12.651668+0000","last_active":"2024-09-12T19:00:12.651668+0000","last_peered":"2024-09-12T19:00:12.651668+0000","last_clean":"2024-09-12T19:00:12.651668+0000","last_became_active":"2024-09-12T17:40:18.765584+0000","last_became_peered":"2024-09-12T17:40:18.765584+0000","last_unstale":"2024-09-12T19:00:12.651668+0000","last_undegraded":"2024-09-12T19:00:12.651668+0000","last_fullsized":"2024-09-12T19:00:12.651668+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T19:00:12.651452+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T19:00:12.651452+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.651452+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:48.653995+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":14373,"num_write":1088,"num_write_kb":24714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'218","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.823787+0000","last_change":"2024-09-12T17:40:20.134311+0000","last_active":"2024-09-12T18:57:42.823787+0000","last_peered":"2024-09-12T18:57:42.823787+0000","last_clean":"2024-09-12T18:57:42.823787+0000","last_became_active":"2024-09-12T17:40:20.132166+0000","last_became_peered":"2024-09-12T17:40:20.132166+0000","last_unstale":"2024-09-12T18:57:42.823787+0000","last_undegraded":"2024-09-12T18:57:42.823787+0000","last_fullsized":"2024-09-12T18:57:42.823787+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":801,"num_write":328,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'324","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.305986+0000","last_change":"2024-09-12T19:00:11.305986+0000","last_active":"2024-09-12T19:00:11.305986+0000","last_peered":"2024-09-12T19:00:11.305986+0000","last_clean":"2024-09-12T19:00:11.305986+0000","last_became_active":"2024-09-12T17:40:18.753673+0000","last_became_peered":"2024-09-12T17:40:18.753673+0000","last_unstale":"2024-09-12T19:00:11.305986+0000","last_undegraded":"2024-09-12T19:00:11.305986+0000","last_fullsized":"2024-09-12T19:00:11.305986+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-12T19:00:11.305739+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-12T19:00:11.305739+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.305739+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:02.108364+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602146,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":9306,"num_write":1013,"num_write_kb":26120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'143","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.369750+0000","last_change":"2024-09-12T17:40:28.202080+0000","last_active":"2024-09-12T18:58:06.369750+0000","last_peered":"2024-09-12T18:58:06.369750+0000","last_clean":"2024-09-12T18:58:06.369750+0000","last_became_active":"2024-09-12T17:40:28.201205+0000","last_became_peered":"2024-09-12T17:40:28.201205+0000","last_unstale":"2024-09-12T18:58:06.369750+0000","last_undegraded":"2024-09-12T18:58:06.369750+0000","last_fullsized":"2024-09-12T18:58:06.369750+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'257","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.617677+0000","last_change":"2024-09-12T19:00:14.617677+0000","last_active":"2024-09-12T19:00:14.617677+0000","last_peered":"2024-09-12T19:00:14.617677+0000","last_clean":"2024-09-12T19:00:14.617677+0000","last_became_active":"2024-09-12T17:40:20.132930+0000","last_became_peered":"2024-09-12T17:40:20.132930+0000","last_unstale":"2024-09-12T19:00:14.617677+0000","last_undegraded":"2024-09-12T19:00:14.617677+0000","last_fullsized":"2024-09-12T19:00:14.617677+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-12T19:00:14.617493+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-12T19:00:14.617493+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.617493+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:11.145807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1081,"num_read_kb":890,"num_write":398,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'338","reported_seq":1106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.929838+0000","last_change":"2024-09-12T19:00:13.929838+0000","last_active":"2024-09-12T19:00:13.929838+0000","last_peered":"2024-09-12T19:00:13.929838+0000","last_clean":"2024-09-12T19:00:13.929838+0000","last_became_active":"2024-09-12T17:40:18.785762+0000","last_became_peered":"2024-09-12T17:40:18.785762+0000","last_unstale":"2024-09-12T19:00:13.929838+0000","last_undegraded":"2024-09-12T19:00:13.929838+0000","last_fullsized":"2024-09-12T19:00:13.929838+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T19:00:13.929601+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T19:00:13.929601+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.929601+0000","objects_scrubbed":11,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:54.986642+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364400,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":651,"num_read_kb":5513,"num_write":1121,"num_write_kb":17948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.653979+0000","last_change":"2024-09-12T17:40:22.146973+0000","last_active":"2024-09-12T18:57:42.653979+0000","last_peered":"2024-09-12T18:57:42.653979+0000","last_clean":"2024-09-12T18:57:42.653979+0000","last_became_active":"2024-09-12T17:40:22.146112+0000","last_became_peered":"2024-09-12T17:40:22.146112+0000","last_unstale":"2024-09-12T18:57:42.653979+0000","last_undegraded":"2024-09-12T18:57:42.653979+0000","last_fullsized":"2024-09-12T18:57:42.653979+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'339","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.556998+0000","last_change":"2024-09-12T17:40:24.162348+0000","last_active":"2024-09-12T18:59:59.556998+0000","last_peered":"2024-09-12T18:59:59.556998+0000","last_clean":"2024-09-12T18:59:59.556998+0000","last_became_active":"2024-09-12T17:40:24.161536+0000","last_became_peered":"2024-09-12T17:40:24.161536+0000","last_unstale":"2024-09-12T18:59:59.556998+0000","last_undegraded":"2024-09-12T18:59:59.556998+0000","last_fullsized":"2024-09-12T18:59:59.556998+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50345,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":1205,"num_write":440,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.462487+0000","last_change":"2024-09-12T17:40:26.189627+0000","last_active":"2024-09-12T18:57:47.462487+0000","last_peered":"2024-09-12T18:57:47.462487+0000","last_clean":"2024-09-12T18:57:47.462487+0000","last_became_active":"2024-09-12T17:40:26.188831+0000","last_became_peered":"2024-09-12T17:40:26.188831+0000","last_unstale":"2024-09-12T18:57:47.462487+0000","last_undegraded":"2024-09-12T18:57:47.462487+0000","last_fullsized":"2024-09-12T18:57:47.462487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'158","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.658358+0000","last_change":"2024-09-12T17:40:28.190678+0000","last_active":"2024-09-12T18:58:02.658358+0000","last_peered":"2024-09-12T18:58:02.658358+0000","last_clean":"2024-09-12T18:58:02.658358+0000","last_became_active":"2024-09-12T17:40:28.189899+0000","last_became_peered":"2024-09-12T17:40:28.189899+0000","last_unstale":"2024-09-12T18:58:02.658358+0000","last_undegraded":"2024-09-12T18:58:02.658358+0000","last_fullsized":"2024-09-12T18:58:02.658358+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:37.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":230,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'92","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.294602+0000","last_change":"2024-09-12T19:00:19.294602+0000","last_active":"2024-09-12T19:00:19.294602+0000","last_peered":"2024-09-12T19:00:19.294602+0000","last_clean":"2024-09-12T19:00:19.294602+0000","last_became_active":"2024-09-12T17:40:20.137252+0000","last_became_peered":"2024-09-12T17:40:20.137252+0000","last_unstale":"2024-09-12T19:00:19.294602+0000","last_undegraded":"2024-09-12T19:00:19.294602+0000","last_fullsized":"2024-09-12T19:00:19.294602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-12T19:00:19.294422+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-12T19:00:19.294422+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.294422+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:43.295706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":356,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'347","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.376265+0000","last_change":"2024-09-12T19:00:05.376265+0000","last_active":"2024-09-12T19:00:05.376265+0000","last_peered":"2024-09-12T19:00:05.376265+0000","last_clean":"2024-09-12T19:00:05.376265+0000","last_became_active":"2024-09-12T17:40:18.756518+0000","last_became_peered":"2024-09-12T17:40:18.756518+0000","last_unstale":"2024-09-12T19:00:05.376265+0000","last_undegraded":"2024-09-12T19:00:05.376265+0000","last_fullsized":"2024-09-12T19:00:05.376265+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T19:00:05.376068+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T19:00:05.376068+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.376068+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:46.598497+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272857,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":466,"num_read_kb":2596,"num_write":1023,"num_write_kb":33023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.461115+0000","last_change":"2024-09-12T17:40:22.153805+0000","last_active":"2024-09-12T18:57:42.461115+0000","last_peered":"2024-09-12T18:57:42.461115+0000","last_clean":"2024-09-12T18:57:42.461115+0000","last_became_active":"2024-09-12T17:40:22.153074+0000","last_became_peered":"2024-09-12T17:40:22.153074+0000","last_unstale":"2024-09-12T18:57:42.461115+0000","last_undegraded":"2024-09-12T18:57:42.461115+0000","last_fullsized":"2024-09-12T18:57:42.461115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:18.398925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'102","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.824996+0000","last_change":"2024-09-12T17:40:24.170127+0000","last_active":"2024-09-12T18:57:47.824996+0000","last_peered":"2024-09-12T18:57:47.824996+0000","last_clean":"2024-09-12T18:57:47.824996+0000","last_became_active":"2024-09-12T17:40:24.169431+0000","last_became_peered":"2024-09-12T17:40:24.169431+0000","last_unstale":"2024-09-12T18:57:47.824996+0000","last_undegraded":"2024-09-12T18:57:47.824996+0000","last_fullsized":"2024-09-12T18:57:47.824996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.824950+0000","last_change":"2024-09-12T17:40:26.189218+0000","last_active":"2024-09-12T18:57:47.824950+0000","last_peered":"2024-09-12T18:57:47.824950+0000","last_clean":"2024-09-12T18:57:47.824950+0000","last_became_active":"2024-09-12T17:40:26.188501+0000","last_became_peered":"2024-09-12T17:40:26.188501+0000","last_unstale":"2024-09-12T18:57:47.824950+0000","last_undegraded":"2024-09-12T18:57:47.824950+0000","last_fullsized":"2024-09-12T18:57:47.824950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'131","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:20.748031+0000","last_change":"2024-09-12T17:40:28.186974+0000","last_active":"2024-09-12T18:56:20.748031+0000","last_peered":"2024-09-12T18:56:20.748031+0000","last_clean":"2024-09-12T18:56:20.748031+0000","last_became_active":"2024-09-12T17:40:28.186224+0000","last_became_peered":"2024-09-12T17:40:28.186224+0000","last_unstale":"2024-09-12T18:56:20.748031+0000","last_undegraded":"2024-09-12T18:56:20.748031+0000","last_fullsized":"2024-09-12T18:56:20.748031+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:16.871107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":201,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'278","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.374182+0000","last_change":"2024-09-12T19:00:16.374182+0000","last_active":"2024-09-12T19:00:16.374182+0000","last_peered":"2024-09-12T19:00:16.374182+0000","last_clean":"2024-09-12T19:00:16.374182+0000","last_became_active":"2024-09-12T17:40:20.115862+0000","last_became_peered":"2024-09-12T17:40:20.115862+0000","last_unstale":"2024-09-12T19:00:16.374182+0000","last_undegraded":"2024-09-12T19:00:16.374182+0000","last_fullsized":"2024-09-12T19:00:16.374182+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'278","last_scrub_stamp":"2024-09-12T19:00:16.374003+0000","last_deep_scrub":"264'278","last_deep_scrub_stamp":"2024-09-12T19:00:16.374003+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.374003+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:39.249116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1211,"num_read_kb":988,"num_write":419,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'376","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.350085+0000","last_change":"2024-09-12T19:00:07.349944+0000","last_active":"2024-09-12T19:00:07.350085+0000","last_peered":"2024-09-12T19:00:07.350085+0000","last_clean":"2024-09-12T19:00:07.350085+0000","last_became_active":"2024-09-12T17:40:55.329597+0000","last_became_peered":"2024-09-12T17:40:55.329597+0000","last_unstale":"2024-09-12T19:00:07.350085+0000","last_undegraded":"2024-09-12T19:00:07.350085+0000","last_fullsized":"2024-09-12T19:00:07.350085+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-12T19:00:07.349768+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-12T19:00:07.349768+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.349768+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:52.137674+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263284,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":44050,"num_write":1244,"num_write_kb":40700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.461319+0000","last_change":"2024-09-12T17:40:22.146475+0000","last_active":"2024-09-12T18:57:42.461319+0000","last_peered":"2024-09-12T18:57:42.461319+0000","last_clean":"2024-09-12T18:57:42.461319+0000","last_became_active":"2024-09-12T17:40:22.145769+0000","last_became_peered":"2024-09-12T17:40:22.145769+0000","last_unstale":"2024-09-12T18:57:42.461319+0000","last_undegraded":"2024-09-12T18:57:42.461319+0000","last_fullsized":"2024-09-12T18:57:42.461319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'151","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.637691+0000","last_change":"2024-09-12T19:00:20.637691+0000","last_active":"2024-09-12T19:00:20.637691+0000","last_peered":"2024-09-12T19:00:20.637691+0000","last_clean":"2024-09-12T19:00:20.637691+0000","last_became_active":"2024-09-12T17:40:24.163809+0000","last_became_peered":"2024-09-12T17:40:24.163809+0000","last_unstale":"2024-09-12T19:00:20.637691+0000","last_undegraded":"2024-09-12T19:00:20.637691+0000","last_fullsized":"2024-09-12T19:00:20.637691+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T19:00:20.637471+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T19:00:20.637471+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.637471+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:01.042195+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":124,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'764","reported_seq":2945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.091738+0000","last_change":"2024-09-12T17:40:26.201403+0000","last_active":"2024-09-12T19:00:00.091738+0000","last_peered":"2024-09-12T19:00:00.091738+0000","last_clean":"2024-09-12T19:00:00.091738+0000","last_became_active":"2024-09-12T17:40:26.200567+0000","last_became_peered":"2024-09-12T17:40:26.200567+0000","last_unstale":"2024-09-12T19:00:00.091738+0000","last_undegraded":"2024-09-12T19:00:00.091738+0000","last_fullsized":"2024-09-12T19:00:00.091738+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":701,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'215","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.683461+0000","last_change":"2024-09-12T17:40:28.172338+0000","last_active":"2024-09-12T18:58:04.683461+0000","last_peered":"2024-09-12T18:58:04.683461+0000","last_clean":"2024-09-12T18:58:04.683461+0000","last_became_active":"2024-09-12T17:40:28.171602+0000","last_became_peered":"2024-09-12T17:40:28.171602+0000","last_unstale":"2024-09-12T18:58:04.683461+0000","last_undegraded":"2024-09-12T18:58:04.683461+0000","last_fullsized":"2024-09-12T18:58:04.683461+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:30.488801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":670,"num_read_kb":661,"num_write":473,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'82","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.627173+0000","last_change":"2024-09-12T19:00:10.627173+0000","last_active":"2024-09-12T19:00:10.627173+0000","last_peered":"2024-09-12T19:00:10.627173+0000","last_clean":"2024-09-12T19:00:10.627173+0000","last_became_active":"2024-09-12T17:40:55.305123+0000","last_became_peered":"2024-09-12T17:40:55.305123+0000","last_unstale":"2024-09-12T19:00:10.627173+0000","last_undegraded":"2024-09-12T19:00:10.627173+0000","last_fullsized":"2024-09-12T19:00:10.627173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'82","last_scrub_stamp":"2024-09-12T19:00:10.626973+0000","last_deep_scrub":"264'82","last_deep_scrub_stamp":"2024-09-12T19:00:10.626973+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.626973+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:35.142530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":316,"num_write":118,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"264'427","reported_seq":1184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.363489+0000","last_change":"2024-09-12T19:00:10.363489+0000","last_active":"2024-09-12T19:00:10.363489+0000","last_peered":"2024-09-12T19:00:10.363489+0000","last_clean":"2024-09-12T19:00:10.363489+0000","last_became_active":"2024-09-12T17:40:18.755758+0000","last_became_peered":"2024-09-12T17:40:18.755758+0000","last_unstale":"2024-09-12T19:00:10.363489+0000","last_undegraded":"2024-09-12T19:00:10.363489+0000","last_fullsized":"2024-09-12T19:00:10.363489+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'427","last_scrub_stamp":"2024-09-12T19:00:10.363268+0000","last_deep_scrub":"264'427","last_deep_scrub_stamp":"2024-09-12T19:00:10.363268+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.363268+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:15.235474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":768,"num_read_kb":10976,"num_write":1273,"num_write_kb":39454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.654058+0000","last_change":"2024-09-12T17:40:22.145057+0000","last_active":"2024-09-12T18:57:42.654058+0000","last_peered":"2024-09-12T18:57:42.654058+0000","last_clean":"2024-09-12T18:57:42.654058+0000","last_became_active":"2024-09-12T17:40:22.144266+0000","last_became_peered":"2024-09-12T17:40:22.144266+0000","last_unstale":"2024-09-12T18:57:42.654058+0000","last_undegraded":"2024-09-12T18:57:42.654058+0000","last_fullsized":"2024-09-12T18:57:42.654058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'279","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.353898+0000","last_change":"2024-09-12T17:40:24.333448+0000","last_active":"2024-09-12T18:59:59.353898+0000","last_peered":"2024-09-12T18:59:59.353898+0000","last_clean":"2024-09-12T18:59:59.353898+0000","last_became_active":"2024-09-12T17:40:24.332623+0000","last_became_peered":"2024-09-12T17:40:24.332623+0000","last_unstale":"2024-09-12T18:59:59.353898+0000","last_undegraded":"2024-09-12T18:59:59.353898+0000","last_fullsized":"2024-09-12T18:59:59.353898+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50618,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1084,"num_write":376,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'786","reported_seq":4960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.097607+0000","last_change":"2024-09-12T17:40:26.195115+0000","last_active":"2024-09-12T19:00:00.097607+0000","last_peered":"2024-09-12T19:00:00.097607+0000","last_clean":"2024-09-12T19:00:00.097607+0000","last_became_active":"2024-09-12T17:40:26.194264+0000","last_became_peered":"2024-09-12T17:40:26.194264+0000","last_unstale":"2024-09-12T19:00:00.097607+0000","last_undegraded":"2024-09-12T19:00:00.097607+0000","last_fullsized":"2024-09-12T19:00:00.097607+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'4314","reported_seq":4935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.309077+0000","last_change":"2024-09-12T19:00:18.309077+0000","last_active":"2024-09-12T19:00:18.309077+0000","last_peered":"2024-09-12T19:00:18.309077+0000","last_clean":"2024-09-12T19:00:18.309077+0000","last_became_active":"2024-09-12T17:40:20.136595+0000","last_became_peered":"2024-09-12T17:40:20.136595+0000","last_unstale":"2024-09-12T19:00:18.309077+0000","last_undegraded":"2024-09-12T19:00:18.309077+0000","last_fullsized":"2024-09-12T19:00:18.309077+0000","mapping_epoch":25,"log_start":"264'4300","ondisk_log_start":"264'4300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4314","last_scrub_stamp":"2024-09-12T19:00:18.308892+0000","last_deep_scrub":"264'4314","last_deep_scrub_stamp":"2024-09-12T19:00:18.308892+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.308892+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:40.254536+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17313,"num_read_kb":14480,"num_write":6459,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8763,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'327","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.882869+0000","last_change":"2024-09-12T19:00:08.882869+0000","last_active":"2024-09-12T19:00:08.882869+0000","last_peered":"2024-09-12T19:00:08.882869+0000","last_clean":"2024-09-12T19:00:08.882869+0000","last_became_active":"2024-09-12T17:40:18.792274+0000","last_became_peered":"2024-09-12T17:40:18.792274+0000","last_unstale":"2024-09-12T19:00:08.882869+0000","last_undegraded":"2024-09-12T19:00:08.882869+0000","last_fullsized":"2024-09-12T19:00:08.882869+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T19:00:08.882605+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T19:00:08.882605+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.882605+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:09.532780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":45936,"num_write":1086,"num_write_kb":27157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439724+0000","last_change":"2024-09-12T17:40:22.152894+0000","last_active":"2024-09-12T18:56:12.439724+0000","last_peered":"2024-09-12T18:56:12.439724+0000","last_clean":"2024-09-12T18:56:12.439724+0000","last_became_active":"2024-09-12T17:40:22.150553+0000","last_became_peered":"2024-09-12T17:40:22.150553+0000","last_unstale":"2024-09-12T18:56:12.439724+0000","last_undegraded":"2024-09-12T18:56:12.439724+0000","last_fullsized":"2024-09-12T18:56:12.439724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:24.942654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'412","reported_seq":1053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.704432+0000","last_change":"2024-09-12T17:40:24.333149+0000","last_active":"2024-09-12T18:59:59.704432+0000","last_peered":"2024-09-12T18:59:59.704432+0000","last_clean":"2024-09-12T18:59:59.704432+0000","last_became_active":"2024-09-12T17:40:24.332413+0000","last_became_peered":"2024-09-12T17:40:24.332413+0000","last_unstale":"2024-09-12T18:59:59.704432+0000","last_undegraded":"2024-09-12T18:59:59.704432+0000","last_fullsized":"2024-09-12T18:59:59.704432+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:54.765665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52951,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":647,"num_read_kb":1274,"num_write":502,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.457290+0000","last_change":"2024-09-12T17:40:26.197292+0000","last_active":"2024-09-12T18:56:57.457290+0000","last_peered":"2024-09-12T18:56:57.457290+0000","last_clean":"2024-09-12T18:56:57.457290+0000","last_became_active":"2024-09-12T17:40:26.180448+0000","last_became_peered":"2024-09-12T17:40:26.180448+0000","last_unstale":"2024-09-12T18:56:57.457290+0000","last_undegraded":"2024-09-12T18:56:57.457290+0000","last_fullsized":"2024-09-12T18:56:57.457290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:40.842285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'559","reported_seq":1375,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.758187+0000","last_change":"2024-09-12T17:40:28.190641+0000","last_active":"2024-09-12T18:59:27.758187+0000","last_peered":"2024-09-12T18:59:27.758187+0000","last_clean":"2024-09-12T18:59:27.758187+0000","last_became_active":"2024-09-12T17:40:28.189872+0000","last_became_peered":"2024-09-12T17:40:28.189872+0000","last_unstale":"2024-09-12T18:59:27.758187+0000","last_undegraded":"2024-09-12T18:59:27.758187+0000","last_fullsized":"2024-09-12T18:59:27.758187+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:20.487874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1323,"num_read_kb":1321,"num_write":1170,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'151","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.852277+0000","last_change":"2024-09-12T19:00:15.852277+0000","last_active":"2024-09-12T19:00:15.852277+0000","last_peered":"2024-09-12T19:00:15.852277+0000","last_clean":"2024-09-12T19:00:15.852277+0000","last_became_active":"2024-09-12T17:40:20.133890+0000","last_became_peered":"2024-09-12T17:40:20.133890+0000","last_unstale":"2024-09-12T19:00:15.852277+0000","last_undegraded":"2024-09-12T19:00:15.852277+0000","last_fullsized":"2024-09-12T19:00:15.852277+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T19:00:15.852091+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T19:00:15.852091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.852091+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:54.370817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":596,"num_write":262,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'398","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.942259+0000","last_change":"2024-09-12T19:00:10.942259+0000","last_active":"2024-09-12T19:00:10.942259+0000","last_peered":"2024-09-12T19:00:10.942259+0000","last_clean":"2024-09-12T19:00:10.942259+0000","last_became_active":"2024-09-12T17:40:18.779278+0000","last_became_peered":"2024-09-12T17:40:18.779278+0000","last_unstale":"2024-09-12T19:00:10.942259+0000","last_undegraded":"2024-09-12T19:00:10.942259+0000","last_fullsized":"2024-09-12T19:00:10.942259+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-12T19:00:10.942027+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-12T19:00:10.942027+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.942027+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:54.061993+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4801217,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":581,"num_read_kb":90800,"num_write":1176,"num_write_kb":50508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"264'6","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.569464+0000","last_change":"2024-09-12T19:00:17.569464+0000","last_active":"2024-09-12T19:00:17.569464+0000","last_peered":"2024-09-12T19:00:17.569464+0000","last_clean":"2024-09-12T19:00:17.569464+0000","last_became_active":"2024-09-12T17:40:22.133525+0000","last_became_peered":"2024-09-12T17:40:22.133525+0000","last_unstale":"2024-09-12T19:00:17.569464+0000","last_undegraded":"2024-09-12T19:00:17.569464+0000","last_fullsized":"2024-09-12T19:00:17.569464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:17.569265+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:17.569265+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.569265+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:55.942607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'289","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.966921+0000","last_change":"2024-09-12T17:40:24.178387+0000","last_active":"2024-09-12T18:59:58.966921+0000","last_peered":"2024-09-12T18:59:58.966921+0000","last_clean":"2024-09-12T18:59:58.966921+0000","last_became_active":"2024-09-12T17:40:24.177609+0000","last_became_peered":"2024-09-12T17:40:24.177609+0000","last_unstale":"2024-09-12T18:59:58.966921+0000","last_undegraded":"2024-09-12T18:59:58.966921+0000","last_fullsized":"2024-09-12T18:59:58.966921+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.549312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1115,"num_write":388,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.445281+0000","last_change":"2024-09-12T17:40:26.203926+0000","last_active":"2024-09-12T18:56:37.445281+0000","last_peered":"2024-09-12T18:56:37.445281+0000","last_clean":"2024-09-12T18:56:37.445281+0000","last_became_active":"2024-09-12T17:40:26.203313+0000","last_became_peered":"2024-09-12T17:40:26.203313+0000","last_unstale":"2024-09-12T18:56:37.445281+0000","last_undegraded":"2024-09-12T18:56:37.445281+0000","last_fullsized":"2024-09-12T18:56:37.445281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:57.623918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2394","reported_seq":4223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:19.224714+0000","last_change":"2024-09-12T17:40:28.184253+0000","last_active":"2024-09-12T18:59:19.224714+0000","last_peered":"2024-09-12T18:59:19.224714+0000","last_clean":"2024-09-12T18:59:19.224714+0000","last_became_active":"2024-09-12T17:40:28.183181+0000","last_became_peered":"2024-09-12T17:40:28.183181+0000","last_unstale":"2024-09-12T18:59:19.224714+0000","last_undegraded":"2024-09-12T18:59:19.224714+0000","last_fullsized":"2024-09-12T18:59:19.224714+0000","mapping_epoch":33,"log_start":"264'2300","ondisk_log_start":"264'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:07.933119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6012,"num_read_kb":6017,"num_write":4828,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'262","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.462287+0000","last_change":"2024-09-12T19:00:15.462287+0000","last_active":"2024-09-12T19:00:15.462287+0000","last_peered":"2024-09-12T19:00:15.462287+0000","last_clean":"2024-09-12T19:00:15.462287+0000","last_became_active":"2024-09-12T17:40:20.133614+0000","last_became_peered":"2024-09-12T17:40:20.133614+0000","last_unstale":"2024-09-12T19:00:15.462287+0000","last_undegraded":"2024-09-12T19:00:15.462287+0000","last_fullsized":"2024-09-12T19:00:15.462287+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'262","last_scrub_stamp":"2024-09-12T19:00:15.462110+0000","last_deep_scrub":"264'262","last_deep_scrub_stamp":"2024-09-12T19:00:15.462110+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.462110+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:42.164388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1175,"num_read_kb":965,"num_write":385,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'314","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.901535+0000","last_change":"2024-09-12T19:00:09.901535+0000","last_active":"2024-09-12T19:00:09.901535+0000","last_peered":"2024-09-12T19:00:09.901535+0000","last_clean":"2024-09-12T19:00:09.901535+0000","last_became_active":"2024-09-12T17:40:18.786288+0000","last_became_peered":"2024-09-12T17:40:18.786288+0000","last_unstale":"2024-09-12T19:00:09.901535+0000","last_undegraded":"2024-09-12T19:00:09.901535+0000","last_fullsized":"2024-09-12T19:00:09.901535+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T19:00:09.901234+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T19:00:09.901234+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.901234+0000","objects_scrubbed":11,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:32.060870+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263265,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":395,"num_read_kb":29289,"num_write":926,"num_write_kb":24158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.613306+0000","last_change":"2024-09-12T19:00:18.613306+0000","last_active":"2024-09-12T19:00:18.613306+0000","last_peered":"2024-09-12T19:00:18.613306+0000","last_clean":"2024-09-12T19:00:18.613306+0000","last_became_active":"2024-09-12T17:40:22.131242+0000","last_became_peered":"2024-09-12T17:40:22.131242+0000","last_unstale":"2024-09-12T19:00:18.613306+0000","last_undegraded":"2024-09-12T19:00:18.613306+0000","last_fullsized":"2024-09-12T19:00:18.613306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:18.613075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:18.613075+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.613075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:08.425791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'304","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.787146+0000","last_change":"2024-09-12T17:40:24.163379+0000","last_active":"2024-09-12T18:59:59.787146+0000","last_peered":"2024-09-12T18:59:59.787146+0000","last_clean":"2024-09-12T18:59:59.787146+0000","last_became_active":"2024-09-12T17:40:24.162722+0000","last_became_peered":"2024-09-12T17:40:24.162722+0000","last_unstale":"2024-09-12T18:59:59.787146+0000","last_undegraded":"2024-09-12T18:59:59.787146+0000","last_fullsized":"2024-09-12T18:59:59.787146+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:54.964194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":1041,"num_write":382,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'762","reported_seq":2700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.947346+0000","last_change":"2024-09-12T17:40:26.182440+0000","last_active":"2024-09-12T18:59:59.947346+0000","last_peered":"2024-09-12T18:59:59.947346+0000","last_clean":"2024-09-12T18:59:59.947346+0000","last_became_active":"2024-09-12T17:40:26.181656+0000","last_became_peered":"2024-09-12T17:40:26.181656+0000","last_unstale":"2024-09-12T18:59:59.947346+0000","last_undegraded":"2024-09-12T18:59:59.947346+0000","last_fullsized":"2024-09-12T18:59:59.947346+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:17.173815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'117","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.441759+0000","last_change":"2024-09-12T17:40:28.187639+0000","last_active":"2024-09-12T18:59:26.441759+0000","last_peered":"2024-09-12T18:59:26.441759+0000","last_clean":"2024-09-12T18:59:26.441759+0000","last_became_active":"2024-09-12T17:40:28.185975+0000","last_became_peered":"2024-09-12T17:40:28.185975+0000","last_unstale":"2024-09-12T18:59:26.441759+0000","last_undegraded":"2024-09-12T18:59:26.441759+0000","last_fullsized":"2024-09-12T18:59:26.441759+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:59.724854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'268","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.360248+0000","last_change":"2024-09-12T19:00:15.360248+0000","last_active":"2024-09-12T19:00:15.360248+0000","last_peered":"2024-09-12T19:00:15.360248+0000","last_clean":"2024-09-12T19:00:15.360248+0000","last_became_active":"2024-09-12T17:40:20.125386+0000","last_became_peered":"2024-09-12T17:40:20.125386+0000","last_unstale":"2024-09-12T19:00:15.360248+0000","last_undegraded":"2024-09-12T19:00:15.360248+0000","last_fullsized":"2024-09-12T19:00:15.360248+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'268","last_scrub_stamp":"2024-09-12T19:00:15.359983+0000","last_deep_scrub":"264'268","last_deep_scrub_stamp":"2024-09-12T19:00:15.359983+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.359983+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:39.540314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1147,"num_read_kb":967,"num_write":444,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'346","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.286839+0000","last_change":"2024-09-12T19:00:09.286839+0000","last_active":"2024-09-12T19:00:09.286839+0000","last_peered":"2024-09-12T19:00:09.286839+0000","last_clean":"2024-09-12T19:00:09.286839+0000","last_became_active":"2024-09-12T17:40:18.761052+0000","last_became_peered":"2024-09-12T17:40:18.761052+0000","last_unstale":"2024-09-12T19:00:09.286839+0000","last_undegraded":"2024-09-12T19:00:09.286839+0000","last_fullsized":"2024-09-12T19:00:09.286839+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-12T19:00:09.286528+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-12T19:00:09.286528+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.286528+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:01.066566+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":20006,"num_write":1061,"num_write_kb":43376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.564506+0000","last_change":"2024-09-12T19:00:16.564506+0000","last_active":"2024-09-12T19:00:16.564506+0000","last_peered":"2024-09-12T19:00:16.564506+0000","last_clean":"2024-09-12T19:00:16.564506+0000","last_became_active":"2024-09-12T17:40:22.134290+0000","last_became_peered":"2024-09-12T17:40:22.134290+0000","last_unstale":"2024-09-12T19:00:16.564506+0000","last_undegraded":"2024-09-12T19:00:16.564506+0000","last_fullsized":"2024-09-12T19:00:16.564506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:16.564293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:16.564293+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.564293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:21.426598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'491","reported_seq":1144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.859649+0000","last_change":"2024-09-12T17:40:24.161967+0000","last_active":"2024-09-12T18:59:59.859649+0000","last_peered":"2024-09-12T18:59:59.859649+0000","last_clean":"2024-09-12T18:59:59.859649+0000","last_became_active":"2024-09-12T17:40:24.161322+0000","last_became_peered":"2024-09-12T17:40:24.161322+0000","last_unstale":"2024-09-12T18:59:59.859649+0000","last_undegraded":"2024-09-12T18:59:59.859649+0000","last_fullsized":"2024-09-12T18:59:59.859649+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.436434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92212,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2116,"num_write":710,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.615101+0000","last_change":"2024-09-12T19:00:22.615101+0000","last_active":"2024-09-12T19:00:22.615101+0000","last_peered":"2024-09-12T19:00:22.615101+0000","last_clean":"2024-09-12T19:00:22.615101+0000","last_became_active":"2024-09-12T17:40:26.191395+0000","last_became_peered":"2024-09-12T17:40:26.191395+0000","last_unstale":"2024-09-12T19:00:22.615101+0000","last_undegraded":"2024-09-12T19:00:22.615101+0000","last_fullsized":"2024-09-12T19:00:22.615101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.614917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.614917+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.614917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:11.312442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'146","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:33.286149+0000","last_change":"2024-09-12T17:40:28.205050+0000","last_active":"2024-09-12T18:56:33.286149+0000","last_peered":"2024-09-12T18:56:33.286149+0000","last_clean":"2024-09-12T18:56:33.286149+0000","last_became_active":"2024-09-12T17:40:28.204260+0000","last_became_peered":"2024-09-12T17:40:28.204260+0000","last_unstale":"2024-09-12T18:56:33.286149+0000","last_undegraded":"2024-09-12T18:56:33.286149+0000","last_fullsized":"2024-09-12T18:56:33.286149+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:03.489071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":166,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'137","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.750749+0000","last_change":"2024-09-12T19:00:09.750749+0000","last_active":"2024-09-12T19:00:09.750749+0000","last_peered":"2024-09-12T19:00:09.750749+0000","last_clean":"2024-09-12T19:00:09.750749+0000","last_became_active":"2024-09-12T17:40:20.137143+0000","last_became_peered":"2024-09-12T17:40:20.137143+0000","last_unstale":"2024-09-12T19:00:09.750749+0000","last_undegraded":"2024-09-12T19:00:09.750749+0000","last_fullsized":"2024-09-12T19:00:09.750749+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T19:00:09.750552+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T19:00:09.750552+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.750552+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:20.403074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":630,"num_read_kb":531,"num_write":209,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'373","reported_seq":1212,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.707106+0000","last_change":"2024-09-12T19:00:07.707106+0000","last_active":"2024-09-12T19:00:07.707106+0000","last_peered":"2024-09-12T19:00:07.707106+0000","last_clean":"2024-09-12T19:00:07.707106+0000","last_became_active":"2024-09-12T17:40:18.759516+0000","last_became_peered":"2024-09-12T17:40:18.759516+0000","last_unstale":"2024-09-12T19:00:07.707106+0000","last_undegraded":"2024-09-12T19:00:07.707106+0000","last_fullsized":"2024-09-12T19:00:07.707106+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T19:00:07.706889+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T19:00:07.706889+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.706889+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:42.136959+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457548,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":9130,"num_write":1131,"num_write_kb":40035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.653978+0000","last_change":"2024-09-12T19:00:19.653978+0000","last_active":"2024-09-12T19:00:19.653978+0000","last_peered":"2024-09-12T19:00:19.653978+0000","last_clean":"2024-09-12T19:00:19.653978+0000","last_became_active":"2024-09-12T17:40:22.151755+0000","last_became_peered":"2024-09-12T17:40:22.151755+0000","last_unstale":"2024-09-12T19:00:19.653978+0000","last_undegraded":"2024-09-12T19:00:19.653978+0000","last_fullsized":"2024-09-12T19:00:19.653978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:19.653812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:19.653812+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.653812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:32.089068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'328","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.121445+0000","last_change":"2024-09-12T17:40:24.172818+0000","last_active":"2024-09-12T18:59:59.121445+0000","last_peered":"2024-09-12T18:59:59.121445+0000","last_clean":"2024-09-12T18:59:59.121445+0000","last_became_active":"2024-09-12T17:40:24.171973+0000","last_became_peered":"2024-09-12T17:40:24.171973+0000","last_unstale":"2024-09-12T18:59:59.121445+0000","last_undegraded":"2024-09-12T18:59:59.121445+0000","last_fullsized":"2024-09-12T18:59:59.121445+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:48.182083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50887,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":1156,"num_write":474,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.469988+0000","last_change":"2024-09-12T17:40:26.185794+0000","last_active":"2024-09-12T18:57:12.469988+0000","last_peered":"2024-09-12T18:57:12.469988+0000","last_clean":"2024-09-12T18:57:12.469988+0000","last_became_active":"2024-09-12T17:40:26.185070+0000","last_became_peered":"2024-09-12T17:40:26.185070+0000","last_unstale":"2024-09-12T18:57:12.469988+0000","last_undegraded":"2024-09-12T18:57:12.469988+0000","last_fullsized":"2024-09-12T18:57:12.469988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:50.080805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'139","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:47.476159+0000","last_change":"2024-09-12T17:40:28.195461+0000","last_active":"2024-09-12T18:58:47.476159+0000","last_peered":"2024-09-12T18:58:47.476159+0000","last_clean":"2024-09-12T18:58:47.476159+0000","last_became_active":"2024-09-12T17:40:28.194137+0000","last_became_peered":"2024-09-12T17:40:28.194137+0000","last_unstale":"2024-09-12T18:58:47.476159+0000","last_undegraded":"2024-09-12T18:58:47.476159+0000","last_fullsized":"2024-09-12T18:58:47.476159+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:02.040950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":145,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'125","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.830631+0000","last_change":"2024-09-12T19:00:11.830631+0000","last_active":"2024-09-12T19:00:11.830631+0000","last_peered":"2024-09-12T19:00:11.830631+0000","last_clean":"2024-09-12T19:00:11.830631+0000","last_became_active":"2024-09-12T17:40:20.132115+0000","last_became_peered":"2024-09-12T17:40:20.132115+0000","last_unstale":"2024-09-12T19:00:11.830631+0000","last_undegraded":"2024-09-12T19:00:11.830631+0000","last_fullsized":"2024-09-12T19:00:11.830631+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T19:00:11.830405+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T19:00:11.830405+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.830405+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:28.343246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":428,"num_write":212,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'350","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.413688+0000","last_change":"2024-09-12T19:00:07.413688+0000","last_active":"2024-09-12T19:00:07.413688+0000","last_peered":"2024-09-12T19:00:07.413688+0000","last_clean":"2024-09-12T19:00:07.413688+0000","last_became_active":"2024-09-12T17:40:18.773579+0000","last_became_peered":"2024-09-12T17:40:18.773579+0000","last_unstale":"2024-09-12T19:00:07.413688+0000","last_undegraded":"2024-09-12T19:00:07.413688+0000","last_fullsized":"2024-09-12T19:00:07.413688+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T19:00:07.413481+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T19:00:07.413481+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.413481+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:28.872079+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4506445,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":44851,"num_write":1031,"num_write_kb":35490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.278282+0000","last_change":"2024-09-12T19:00:22.278282+0000","last_active":"2024-09-12T19:00:22.278282+0000","last_peered":"2024-09-12T19:00:22.278282+0000","last_clean":"2024-09-12T19:00:22.278282+0000","last_became_active":"2024-09-12T17:40:22.142112+0000","last_became_peered":"2024-09-12T17:40:22.142112+0000","last_unstale":"2024-09-12T19:00:22.278282+0000","last_undegraded":"2024-09-12T19:00:22.278282+0000","last_fullsized":"2024-09-12T19:00:22.278282+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.278103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.278103+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.278103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:49.670652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'343","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.651045+0000","last_change":"2024-09-12T19:00:21.651045+0000","last_active":"2024-09-12T19:00:21.651045+0000","last_peered":"2024-09-12T19:00:21.651045+0000","last_clean":"2024-09-12T19:00:21.651045+0000","last_became_active":"2024-09-12T17:40:24.181982+0000","last_became_peered":"2024-09-12T17:40:24.181982+0000","last_unstale":"2024-09-12T19:00:21.651045+0000","last_undegraded":"2024-09-12T19:00:21.651045+0000","last_fullsized":"2024-09-12T19:00:21.651045+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T19:00:21.650816+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T19:00:21.650816+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.650816+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:42.753209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52587,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1218,"num_write":444,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'725","reported_seq":2535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.721975+0000","last_change":"2024-09-12T17:40:26.187935+0000","last_active":"2024-09-12T18:59:59.721975+0000","last_peered":"2024-09-12T18:59:59.721975+0000","last_clean":"2024-09-12T18:59:59.721975+0000","last_became_active":"2024-09-12T17:40:26.187269+0000","last_became_peered":"2024-09-12T17:40:26.187269+0000","last_unstale":"2024-09-12T18:59:59.721975+0000","last_undegraded":"2024-09-12T18:59:59.721975+0000","last_fullsized":"2024-09-12T18:59:59.721975+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:57.828902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'139","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.277441+0000","last_change":"2024-09-12T17:40:28.192959+0000","last_active":"2024-09-12T18:58:02.277441+0000","last_peered":"2024-09-12T18:58:02.277441+0000","last_clean":"2024-09-12T18:58:02.277441+0000","last_became_active":"2024-09-12T17:40:28.192211+0000","last_became_peered":"2024-09-12T17:40:28.192211+0000","last_unstale":"2024-09-12T18:58:02.277441+0000","last_undegraded":"2024-09-12T18:58:02.277441+0000","last_fullsized":"2024-09-12T18:58:02.277441+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:29.331632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":224,"num_write":356,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'4139","reported_seq":4793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.856712+0000","last_change":"2024-09-12T19:00:14.856712+0000","last_active":"2024-09-12T19:00:14.856712+0000","last_peered":"2024-09-12T19:00:14.856712+0000","last_clean":"2024-09-12T19:00:14.856712+0000","last_became_active":"2024-09-12T17:40:20.136148+0000","last_became_peered":"2024-09-12T17:40:20.136148+0000","last_unstale":"2024-09-12T19:00:14.856712+0000","last_undegraded":"2024-09-12T19:00:14.856712+0000","last_fullsized":"2024-09-12T19:00:14.856712+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4139","last_scrub_stamp":"2024-09-12T19:00:14.856530+0000","last_deep_scrub":"264'4139","last_deep_scrub_stamp":"2024-09-12T19:00:14.856530+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.856530+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":3000,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:49.369462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16638,"num_read_kb":13967,"num_write":6216,"num_write_kb":3097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'309","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.811526+0000","last_change":"2024-09-12T19:00:06.811526+0000","last_active":"2024-09-12T19:00:06.811526+0000","last_peered":"2024-09-12T19:00:06.811526+0000","last_clean":"2024-09-12T19:00:06.811526+0000","last_became_active":"2024-09-12T17:40:18.773552+0000","last_became_peered":"2024-09-12T17:40:18.773552+0000","last_unstale":"2024-09-12T19:00:06.811526+0000","last_undegraded":"2024-09-12T19:00:06.811526+0000","last_fullsized":"2024-09-12T19:00:06.811526+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-09-12T19:00:06.811280+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-09-12T19:00:06.811280+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.811280+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:29.209861+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5770401,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":475,"num_read_kb":17949,"num_write":926,"num_write_kb":45991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1457,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.684126+0000","last_change":"2024-09-12T17:40:22.144205+0000","last_active":"2024-09-12T18:59:58.684126+0000","last_peered":"2024-09-12T18:59:58.684126+0000","last_clean":"2024-09-12T18:59:58.684126+0000","last_became_active":"2024-09-12T17:40:22.143463+0000","last_became_peered":"2024-09-12T17:40:22.143463+0000","last_unstale":"2024-09-12T18:59:58.684126+0000","last_undegraded":"2024-09-12T18:59:58.684126+0000","last_fullsized":"2024-09-12T18:59:58.684126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:11.027627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'110","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450877+0000","last_change":"2024-09-12T17:40:24.330084+0000","last_active":"2024-09-12T18:56:57.450877+0000","last_peered":"2024-09-12T18:56:57.450877+0000","last_clean":"2024-09-12T18:56:57.450877+0000","last_became_active":"2024-09-12T17:40:24.329452+0000","last_became_peered":"2024-09-12T17:40:24.329452+0000","last_unstale":"2024-09-12T18:56:57.450877+0000","last_undegraded":"2024-09-12T18:56:57.450877+0000","last_fullsized":"2024-09-12T18:56:57.450877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:41.298862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'753","reported_seq":2625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.719270+0000","last_change":"2024-09-12T17:40:26.183775+0000","last_active":"2024-09-12T18:59:58.719270+0000","last_peered":"2024-09-12T18:59:58.719270+0000","last_clean":"2024-09-12T18:59:58.719270+0000","last_became_active":"2024-09-12T17:40:26.183016+0000","last_became_peered":"2024-09-12T17:40:26.183016+0000","last_unstale":"2024-09-12T18:59:58.719270+0000","last_undegraded":"2024-09-12T18:59:58.719270+0000","last_fullsized":"2024-09-12T18:59:58.719270+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:45.838846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'112","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821328+0000","last_change":"2024-09-12T17:40:28.180920+0000","last_active":"2024-09-12T18:57:32.821328+0000","last_peered":"2024-09-12T18:57:32.821328+0000","last_clean":"2024-09-12T18:57:32.821328+0000","last_became_active":"2024-09-12T17:40:28.180192+0000","last_became_peered":"2024-09-12T17:40:28.180192+0000","last_unstale":"2024-09-12T18:57:32.821328+0000","last_undegraded":"2024-09-12T18:57:32.821328+0000","last_fullsized":"2024-09-12T18:57:32.821328+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:20.350489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":167,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'272","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.355420+0000","last_change":"2024-09-12T19:00:18.355420+0000","last_active":"2024-09-12T19:00:18.355420+0000","last_peered":"2024-09-12T19:00:18.355420+0000","last_clean":"2024-09-12T19:00:18.355420+0000","last_became_active":"2024-09-12T17:40:20.125511+0000","last_became_peered":"2024-09-12T17:40:20.125511+0000","last_unstale":"2024-09-12T19:00:18.355420+0000","last_undegraded":"2024-09-12T19:00:18.355420+0000","last_fullsized":"2024-09-12T19:00:18.355420+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-12T19:00:18.355195+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-12T19:00:18.355195+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.355195+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:41.045399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1212,"num_read_kb":1000,"num_write":434,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'288","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.711722+0000","last_change":"2024-09-12T19:00:06.711722+0000","last_active":"2024-09-12T19:00:06.711722+0000","last_peered":"2024-09-12T19:00:06.711722+0000","last_clean":"2024-09-12T19:00:06.711722+0000","last_became_active":"2024-09-12T17:40:18.769054+0000","last_became_peered":"2024-09-12T17:40:18.769054+0000","last_unstale":"2024-09-12T19:00:06.711722+0000","last_undegraded":"2024-09-12T19:00:06.711722+0000","last_fullsized":"2024-09-12T19:00:06.711722+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'288","last_scrub_stamp":"2024-09-12T19:00:06.711610+0000","last_deep_scrub":"264'288","last_deep_scrub_stamp":"2024-09-12T19:00:06.711610+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.711610+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:07.586624+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526370,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":78920,"num_write":889,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:52.812532+0000","last_change":"2024-09-12T17:40:22.139642+0000","last_active":"2024-09-12T18:56:52.812532+0000","last_peered":"2024-09-12T18:56:52.812532+0000","last_clean":"2024-09-12T18:56:52.812532+0000","last_became_active":"2024-09-12T17:40:22.138875+0000","last_became_peered":"2024-09-12T17:40:22.138875+0000","last_unstale":"2024-09-12T18:56:52.812532+0000","last_undegraded":"2024-09-12T18:56:52.812532+0000","last_fullsized":"2024-09-12T18:56:52.812532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:04.385118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'397","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.596183+0000","last_change":"2024-09-12T17:40:24.174213+0000","last_active":"2024-09-12T18:59:59.596183+0000","last_peered":"2024-09-12T18:59:59.596183+0000","last_clean":"2024-09-12T18:59:59.596183+0000","last_became_active":"2024-09-12T17:40:24.173537+0000","last_became_peered":"2024-09-12T17:40:24.173537+0000","last_unstale":"2024-09-12T18:59:59.596183+0000","last_undegraded":"2024-09-12T18:59:59.596183+0000","last_fullsized":"2024-09-12T18:59:59.596183+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:35.315463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47427,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":650,"num_read_kb":1371,"num_write":508,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.364124+0000","last_change":"2024-09-12T19:00:22.364124+0000","last_active":"2024-09-12T19:00:22.364124+0000","last_peered":"2024-09-12T19:00:22.364124+0000","last_clean":"2024-09-12T19:00:22.364124+0000","last_became_active":"2024-09-12T17:40:26.183228+0000","last_became_peered":"2024-09-12T17:40:26.183228+0000","last_unstale":"2024-09-12T19:00:22.364124+0000","last_undegraded":"2024-09-12T19:00:22.364124+0000","last_fullsized":"2024-09-12T19:00:22.364124+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.363940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.363940+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.363940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:55.507213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'138","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.417590+0000","last_change":"2024-09-12T17:40:28.192535+0000","last_active":"2024-09-12T18:58:04.417590+0000","last_peered":"2024-09-12T18:58:04.417590+0000","last_clean":"2024-09-12T18:58:04.417590+0000","last_became_active":"2024-09-12T17:40:28.191461+0000","last_became_peered":"2024-09-12T17:40:28.191461+0000","last_unstale":"2024-09-12T18:58:04.417590+0000","last_undegraded":"2024-09-12T18:58:04.417590+0000","last_fullsized":"2024-09-12T18:58:04.417590+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:39.691469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":326,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'92","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.412245+0000","last_change":"2024-09-12T19:00:14.412245+0000","last_active":"2024-09-12T19:00:14.412245+0000","last_peered":"2024-09-12T19:00:14.412245+0000","last_clean":"2024-09-12T19:00:14.412245+0000","last_became_active":"2024-09-12T17:40:20.146160+0000","last_became_peered":"2024-09-12T17:40:20.146160+0000","last_unstale":"2024-09-12T19:00:14.412245+0000","last_undegraded":"2024-09-12T19:00:14.412245+0000","last_fullsized":"2024-09-12T19:00:14.412245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-12T19:00:14.412058+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-12T19:00:14.412058+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.412058+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:06.611295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.851657+0000","last_change":"2024-09-12T19:00:07.851479+0000","last_active":"2024-09-12T19:00:07.851657+0000","last_peered":"2024-09-12T19:00:07.851657+0000","last_clean":"2024-09-12T19:00:07.851657+0000","last_became_active":"2024-09-12T17:40:03.636856+0000","last_became_peered":"2024-09-12T17:40:03.636856+0000","last_unstale":"2024-09-12T19:00:07.851657+0000","last_undegraded":"2024-09-12T19:00:07.851657+0000","last_fullsized":"2024-09-12T19:00:07.851657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T19:00:07.851245+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T19:00:07.851245+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.851245+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:47.311318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.303193+0000","last_change":"2024-09-12T19:00:06.303193+0000","last_active":"2024-09-12T19:00:06.303193+0000","last_peered":"2024-09-12T19:00:06.303193+0000","last_clean":"2024-09-12T19:00:06.303193+0000","last_became_active":"2024-09-12T17:40:09.670674+0000","last_became_peered":"2024-09-12T17:40:09.670674+0000","last_unstale":"2024-09-12T19:00:06.303193+0000","last_undegraded":"2024-09-12T19:00:06.303193+0000","last_fullsized":"2024-09-12T19:00:06.303193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:06.303007+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:06.303007+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.303007+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:00.965061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001302742,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'381","reported_seq":1139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.703311+0000","last_change":"2024-09-12T19:00:05.703311+0000","last_active":"2024-09-12T19:00:05.703311+0000","last_peered":"2024-09-12T19:00:05.703311+0000","last_clean":"2024-09-12T19:00:05.703311+0000","last_became_active":"2024-09-12T17:40:18.774164+0000","last_became_peered":"2024-09-12T17:40:18.774164+0000","last_unstale":"2024-09-12T19:00:05.703311+0000","last_undegraded":"2024-09-12T19:00:05.703311+0000","last_fullsized":"2024-09-12T19:00:05.703311+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-12T19:00:05.703231+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-12T19:00:05.703231+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.703231+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.776143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1557056,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":732,"num_read_kb":41235,"num_write":1123,"num_write_kb":37796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457318+0000","last_change":"2024-09-12T17:40:22.150388+0000","last_active":"2024-09-12T18:57:27.457318+0000","last_peered":"2024-09-12T18:57:27.457318+0000","last_clean":"2024-09-12T18:57:27.457318+0000","last_became_active":"2024-09-12T17:40:22.148190+0000","last_became_peered":"2024-09-12T17:40:22.148190+0000","last_unstale":"2024-09-12T18:57:27.457318+0000","last_undegraded":"2024-09-12T18:57:27.457318+0000","last_fullsized":"2024-09-12T18:57:27.457318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:47.144440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'735","reported_seq":1451,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.005992+0000","last_change":"2024-09-12T17:40:24.177543+0000","last_active":"2024-09-12T19:00:00.005992+0000","last_peered":"2024-09-12T19:00:00.005992+0000","last_clean":"2024-09-12T19:00:00.005992+0000","last_became_active":"2024-09-12T17:40:24.176757+0000","last_became_peered":"2024-09-12T17:40:24.176757+0000","last_unstale":"2024-09-12T19:00:00.005992+0000","last_undegraded":"2024-09-12T19:00:00.005992+0000","last_fullsized":"2024-09-12T19:00:00.005992+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.566492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107902,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1433,"num_read_kb":3342,"num_write":1350,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.458091+0000","last_change":"2024-09-12T17:40:26.191218+0000","last_active":"2024-09-12T18:56:17.458091+0000","last_peered":"2024-09-12T18:56:17.458091+0000","last_clean":"2024-09-12T18:56:17.458091+0000","last_became_active":"2024-09-12T17:40:26.190522+0000","last_became_peered":"2024-09-12T17:40:26.190522+0000","last_unstale":"2024-09-12T18:56:17.458091+0000","last_undegraded":"2024-09-12T18:56:17.458091+0000","last_fullsized":"2024-09-12T18:56:17.458091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:36.917179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'197","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.131600+0000","last_change":"2024-09-12T17:40:28.194274+0000","last_active":"2024-09-12T18:58:06.131600+0000","last_peered":"2024-09-12T18:58:06.131600+0000","last_clean":"2024-09-12T18:58:06.131600+0000","last_became_active":"2024-09-12T17:40:28.193456+0000","last_became_peered":"2024-09-12T17:40:28.193456+0000","last_unstale":"2024-09-12T18:58:06.131600+0000","last_undegraded":"2024-09-12T18:58:06.131600+0000","last_fullsized":"2024-09-12T18:58:06.131600+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:18.966712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":530,"num_write":424,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'121","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.359729+0000","last_change":"2024-09-12T19:00:14.359729+0000","last_active":"2024-09-12T19:00:14.359729+0000","last_peered":"2024-09-12T19:00:14.359729+0000","last_clean":"2024-09-12T19:00:14.359729+0000","last_became_active":"2024-09-12T17:40:20.130774+0000","last_became_peered":"2024-09-12T17:40:20.130774+0000","last_unstale":"2024-09-12T19:00:14.359729+0000","last_undegraded":"2024-09-12T19:00:14.359729+0000","last_fullsized":"2024-09-12T19:00:14.359729+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-12T19:00:14.359520+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-12T19:00:14.359520+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.359520+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:27.221397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":441,"num_write":172,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.888004+0000","last_change":"2024-09-12T19:00:16.888004+0000","last_active":"2024-09-12T19:00:16.888004+0000","last_peered":"2024-09-12T19:00:16.888004+0000","last_clean":"2024-09-12T19:00:16.888004+0000","last_became_active":"2024-09-12T17:40:09.666272+0000","last_became_peered":"2024-09-12T17:40:09.666272+0000","last_unstale":"2024-09-12T19:00:16.888004+0000","last_undegraded":"2024-09-12T19:00:16.888004+0000","last_fullsized":"2024-09-12T19:00:16.888004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:16.887821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:16.887821+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.887821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:53.458174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001052545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'381","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:03.380638+0000","last_change":"2024-09-12T19:00:03.380638+0000","last_active":"2024-09-12T19:00:03.380638+0000","last_peered":"2024-09-12T19:00:03.380638+0000","last_clean":"2024-09-12T19:00:03.380638+0000","last_became_active":"2024-09-12T17:40:18.774751+0000","last_became_peered":"2024-09-12T17:40:18.774751+0000","last_unstale":"2024-09-12T19:00:03.380638+0000","last_undegraded":"2024-09-12T19:00:03.380638+0000","last_fullsized":"2024-09-12T19:00:03.380638+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-12T19:00:03.380508+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-12T19:00:03.380508+0000","last_clean_scrub_stamp":"2024-09-12T19:00:03.380508+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:57.346685+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":730,"num_write":1215,"num_write_kb":17029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.622557+0000","last_change":"2024-09-12T17:40:22.147871+0000","last_active":"2024-09-12T18:56:12.622557+0000","last_peered":"2024-09-12T18:56:12.622557+0000","last_clean":"2024-09-12T18:56:12.622557+0000","last_became_active":"2024-09-12T17:40:22.147184+0000","last_became_peered":"2024-09-12T17:40:22.147184+0000","last_unstale":"2024-09-12T18:56:12.622557+0000","last_undegraded":"2024-09-12T18:56:12.622557+0000","last_fullsized":"2024-09-12T18:56:12.622557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:31.847917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1349","reported_seq":3257,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.639681+0000","last_change":"2024-09-12T17:40:24.169842+0000","last_active":"2024-09-12T18:59:59.639681+0000","last_peered":"2024-09-12T18:59:59.639681+0000","last_clean":"2024-09-12T18:59:59.639681+0000","last_became_active":"2024-09-12T17:40:24.169050+0000","last_became_peered":"2024-09-12T17:40:24.169050+0000","last_unstale":"2024-09-12T18:59:59.639681+0000","last_undegraded":"2024-09-12T18:59:59.639681+0000","last_fullsized":"2024-09-12T18:59:59.639681+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":1300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:15.887934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147644,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2159,"num_read_kb":4153,"num_write":1266,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.462335+0000","last_change":"2024-09-12T17:40:26.203093+0000","last_active":"2024-09-12T18:57:47.462335+0000","last_peered":"2024-09-12T18:57:47.462335+0000","last_clean":"2024-09-12T18:57:47.462335+0000","last_became_active":"2024-09-12T17:40:26.202360+0000","last_became_peered":"2024-09-12T17:40:26.202360+0000","last_unstale":"2024-09-12T18:57:47.462335+0000","last_undegraded":"2024-09-12T18:57:47.462335+0000","last_fullsized":"2024-09-12T18:57:47.462335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:51.977257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'190","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.452907+0000","last_change":"2024-09-12T17:40:28.190152+0000","last_active":"2024-09-12T18:56:37.452907+0000","last_peered":"2024-09-12T18:56:37.452907+0000","last_clean":"2024-09-12T18:56:37.452907+0000","last_became_active":"2024-09-12T17:40:28.189387+0000","last_became_peered":"2024-09-12T17:40:28.189387+0000","last_unstale":"2024-09-12T18:56:37.452907+0000","last_undegraded":"2024-09-12T18:56:37.452907+0000","last_fullsized":"2024-09-12T18:56:37.452907+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:39.878519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":364,"num_write":413,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'193","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.427403+0000","last_change":"2024-09-12T19:00:14.427403+0000","last_active":"2024-09-12T19:00:14.427403+0000","last_peered":"2024-09-12T19:00:14.427403+0000","last_clean":"2024-09-12T19:00:14.427403+0000","last_became_active":"2024-09-12T17:40:20.129646+0000","last_became_peered":"2024-09-12T17:40:20.129646+0000","last_unstale":"2024-09-12T19:00:14.427403+0000","last_undegraded":"2024-09-12T19:00:14.427403+0000","last_fullsized":"2024-09-12T19:00:14.427403+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-12T19:00:14.427181+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-12T19:00:14.427181+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.427181+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:07.543026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":706,"num_write":294,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.575456+0000","last_change":"2024-09-12T19:00:05.575456+0000","last_active":"2024-09-12T19:00:05.575456+0000","last_peered":"2024-09-12T19:00:05.575456+0000","last_clean":"2024-09-12T19:00:05.575456+0000","last_became_active":"2024-09-12T17:40:09.771196+0000","last_became_peered":"2024-09-12T17:40:09.771196+0000","last_unstale":"2024-09-12T19:00:05.575456+0000","last_undegraded":"2024-09-12T19:00:05.575456+0000","last_fullsized":"2024-09-12T19:00:05.575456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:05.575379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:05.575379+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.575379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:05.851170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010655720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'333","reported_seq":1035,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.412049+0000","last_change":"2024-09-12T19:00:05.412049+0000","last_active":"2024-09-12T19:00:05.412049+0000","last_peered":"2024-09-12T19:00:05.412049+0000","last_clean":"2024-09-12T19:00:05.412049+0000","last_became_active":"2024-09-12T17:40:18.759514+0000","last_became_peered":"2024-09-12T17:40:18.759514+0000","last_unstale":"2024-09-12T19:00:05.412049+0000","last_undegraded":"2024-09-12T19:00:05.412049+0000","last_fullsized":"2024-09-12T19:00:05.412049+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-12T19:00:05.411956+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-12T19:00:05.411956+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.411956+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:48.630492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1491790,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":20357,"num_write":1029,"num_write_kb":29003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.647430+0000","last_change":"2024-09-12T19:00:12.647430+0000","last_active":"2024-09-12T19:00:12.647430+0000","last_peered":"2024-09-12T19:00:12.647430+0000","last_clean":"2024-09-12T19:00:12.647430+0000","last_became_active":"2024-09-12T17:40:22.138606+0000","last_became_peered":"2024-09-12T17:40:22.138606+0000","last_unstale":"2024-09-12T19:00:12.647430+0000","last_undegraded":"2024-09-12T19:00:12.647430+0000","last_fullsized":"2024-09-12T19:00:12.647430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:12.647148+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:12.647148+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.647148+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:08.127072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'294","reported_seq":1802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.983546+0000","last_change":"2024-09-12T17:40:24.330435+0000","last_active":"2024-09-12T18:59:27.983546+0000","last_peered":"2024-09-12T18:59:27.983546+0000","last_clean":"2024-09-12T18:59:27.983546+0000","last_became_active":"2024-09-12T17:40:24.329425+0000","last_became_peered":"2024-09-12T17:40:24.329425+0000","last_unstale":"2024-09-12T18:59:27.983546+0000","last_undegraded":"2024-09-12T18:59:27.983546+0000","last_fullsized":"2024-09-12T18:59:27.983546+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:18.922243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":264,"num_read_kb":256,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.474435+0000","last_change":"2024-09-12T17:40:26.190790+0000","last_active":"2024-09-12T18:57:32.474435+0000","last_peered":"2024-09-12T18:57:32.474435+0000","last_clean":"2024-09-12T18:57:32.474435+0000","last_became_active":"2024-09-12T17:40:26.188740+0000","last_became_peered":"2024-09-12T17:40:26.188740+0000","last_unstale":"2024-09-12T18:57:32.474435+0000","last_undegraded":"2024-09-12T18:57:32.474435+0000","last_fullsized":"2024-09-12T18:57:32.474435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:41.526051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'269","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.609250+0000","last_change":"2024-09-12T17:40:28.202892+0000","last_active":"2024-09-12T18:58:06.609250+0000","last_peered":"2024-09-12T18:58:06.609250+0000","last_clean":"2024-09-12T18:58:06.609250+0000","last_became_active":"2024-09-12T17:40:28.202238+0000","last_became_peered":"2024-09-12T17:40:28.202238+0000","last_unstale":"2024-09-12T18:58:06.609250+0000","last_undegraded":"2024-09-12T18:58:06.609250+0000","last_fullsized":"2024-09-12T18:58:06.609250+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:40.299625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":592,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'389","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.365530+0000","last_change":"2024-09-12T19:00:16.365530+0000","last_active":"2024-09-12T19:00:16.365530+0000","last_peered":"2024-09-12T19:00:16.365530+0000","last_clean":"2024-09-12T19:00:16.365530+0000","last_became_active":"2024-09-12T17:40:20.127774+0000","last_became_peered":"2024-09-12T17:40:20.127774+0000","last_unstale":"2024-09-12T19:00:16.365530+0000","last_undegraded":"2024-09-12T19:00:16.365530+0000","last_fullsized":"2024-09-12T19:00:16.365530+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'389","last_scrub_stamp":"2024-09-12T19:00:16.365337+0000","last_deep_scrub":"264'389","last_deep_scrub_stamp":"2024-09-12T19:00:16.365337+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.365337+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:35.682974+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1689,"num_read_kb":1329,"num_write":647,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":733,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.329130+0000","last_change":"2024-09-12T19:00:07.329130+0000","last_active":"2024-09-12T19:00:07.329130+0000","last_peered":"2024-09-12T19:00:07.329130+0000","last_clean":"2024-09-12T19:00:07.329130+0000","last_became_active":"2024-09-12T17:40:09.672745+0000","last_became_peered":"2024-09-12T17:40:09.672745+0000","last_unstale":"2024-09-12T19:00:07.329130+0000","last_undegraded":"2024-09-12T19:00:07.329130+0000","last_fullsized":"2024-09-12T19:00:07.329130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:07.328927+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:07.328927+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.328927+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:19.924413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002775694,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'386","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.822955+0000","last_change":"2024-09-12T19:00:05.822955+0000","last_active":"2024-09-12T19:00:05.822955+0000","last_peered":"2024-09-12T19:00:05.822955+0000","last_clean":"2024-09-12T19:00:05.822955+0000","last_became_active":"2024-09-12T17:40:18.769909+0000","last_became_peered":"2024-09-12T17:40:18.769909+0000","last_unstale":"2024-09-12T19:00:05.822955+0000","last_undegraded":"2024-09-12T19:00:05.822955+0000","last_fullsized":"2024-09-12T19:00:05.822955+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'386","last_scrub_stamp":"2024-09-12T19:00:05.822732+0000","last_deep_scrub":"264'386","last_deep_scrub_stamp":"2024-09-12T19:00:05.822732+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.822732+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:20.836010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":740079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":12377,"num_write":1306,"num_write_kb":22203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.476785+0000","last_change":"2024-09-12T17:40:22.145902+0000","last_active":"2024-09-12T18:57:42.476785+0000","last_peered":"2024-09-12T18:57:42.476785+0000","last_clean":"2024-09-12T18:57:42.476785+0000","last_became_active":"2024-09-12T17:40:22.145410+0000","last_became_peered":"2024-09-12T17:40:22.145410+0000","last_unstale":"2024-09-12T18:57:42.476785+0000","last_undegraded":"2024-09-12T18:57:42.476785+0000","last_fullsized":"2024-09-12T18:57:42.476785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:20.122905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'162","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:25.961675+0000","last_change":"2024-09-12T17:40:24.170740+0000","last_active":"2024-09-12T18:59:25.961675+0000","last_peered":"2024-09-12T18:59:25.961675+0000","last_clean":"2024-09-12T18:59:25.961675+0000","last_became_active":"2024-09-12T17:40:24.169937+0000","last_became_peered":"2024-09-12T17:40:24.169937+0000","last_unstale":"2024-09-12T18:59:25.961675+0000","last_undegraded":"2024-09-12T18:59:25.961675+0000","last_fullsized":"2024-09-12T18:59:25.961675+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:52.608977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":193,"num_write":146,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.372606+0000","last_change":"2024-09-12T19:00:21.372606+0000","last_active":"2024-09-12T19:00:21.372606+0000","last_peered":"2024-09-12T19:00:21.372606+0000","last_clean":"2024-09-12T19:00:21.372606+0000","last_became_active":"2024-09-12T17:40:26.171660+0000","last_became_peered":"2024-09-12T17:40:26.171660+0000","last_unstale":"2024-09-12T19:00:21.372606+0000","last_undegraded":"2024-09-12T19:00:21.372606+0000","last_fullsized":"2024-09-12T19:00:21.372606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.372426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.372426+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.372426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:44.988743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'122","reported_seq":672,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:17.623502+0000","last_change":"2024-09-12T17:40:28.202494+0000","last_active":"2024-09-12T18:56:17.623502+0000","last_peered":"2024-09-12T18:56:17.623502+0000","last_clean":"2024-09-12T18:56:17.623502+0000","last_became_active":"2024-09-12T17:40:28.201694+0000","last_became_peered":"2024-09-12T17:40:28.201694+0000","last_unstale":"2024-09-12T18:56:17.623502+0000","last_undegraded":"2024-09-12T18:56:17.623502+0000","last_fullsized":"2024-09-12T18:56:17.623502+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:49.909677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":250,"num_write":312,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'144","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.402435+0000","last_change":"2024-09-12T19:00:13.402435+0000","last_active":"2024-09-12T19:00:13.402435+0000","last_peered":"2024-09-12T19:00:13.402435+0000","last_clean":"2024-09-12T19:00:13.402435+0000","last_became_active":"2024-09-12T17:40:20.127727+0000","last_became_peered":"2024-09-12T17:40:20.127727+0000","last_unstale":"2024-09-12T19:00:13.402435+0000","last_undegraded":"2024-09-12T19:00:13.402435+0000","last_fullsized":"2024-09-12T19:00:13.402435+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:13.402249+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:13.402249+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.402249+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:53.064547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":625,"num_read_kb":513,"num_write":241,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'316","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.312786+0000","last_change":"2024-09-12T19:00:08.312786+0000","last_active":"2024-09-12T19:00:08.312786+0000","last_peered":"2024-09-12T19:00:08.312786+0000","last_clean":"2024-09-12T19:00:08.312786+0000","last_became_active":"2024-09-12T17:40:18.768544+0000","last_became_peered":"2024-09-12T17:40:18.768544+0000","last_unstale":"2024-09-12T19:00:08.312786+0000","last_undegraded":"2024-09-12T19:00:08.312786+0000","last_fullsized":"2024-09-12T19:00:08.312786+0000","mapping_epoch":23,"log_start":"264'301","ondisk_log_start":"264'301","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T19:00:08.312642+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T19:00:08.312642+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.312642+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":301,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:52.360053+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":425,"num_read_kb":64899,"num_write":927,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.370168+0000","last_change":"2024-09-12T19:00:06.370168+0000","last_active":"2024-09-12T19:00:06.370168+0000","last_peered":"2024-09-12T19:00:06.370168+0000","last_clean":"2024-09-12T19:00:06.370168+0000","last_became_active":"2024-09-12T17:40:09.770645+0000","last_became_peered":"2024-09-12T17:40:09.770645+0000","last_unstale":"2024-09-12T19:00:06.370168+0000","last_undegraded":"2024-09-12T19:00:06.370168+0000","last_fullsized":"2024-09-12T19:00:06.370168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.370093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.370093+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.370093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:21.045928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091158000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.368257+0000","last_change":"2024-09-12T19:00:22.368257+0000","last_active":"2024-09-12T19:00:22.368257+0000","last_peered":"2024-09-12T19:00:22.368257+0000","last_clean":"2024-09-12T19:00:22.368257+0000","last_became_active":"2024-09-12T17:40:22.136155+0000","last_became_peered":"2024-09-12T17:40:22.136155+0000","last_unstale":"2024-09-12T19:00:22.368257+0000","last_undegraded":"2024-09-12T19:00:22.368257+0000","last_fullsized":"2024-09-12T19:00:22.368257+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.368076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.368076+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.368076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.095079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'651","reported_seq":1347,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.047995+0000","last_change":"2024-09-12T17:40:24.174815+0000","last_active":"2024-09-12T19:00:00.047995+0000","last_peered":"2024-09-12T19:00:00.047995+0000","last_clean":"2024-09-12T19:00:00.047995+0000","last_became_active":"2024-09-12T17:40:24.173380+0000","last_became_peered":"2024-09-12T17:40:24.173380+0000","last_unstale":"2024-09-12T19:00:00.047995+0000","last_undegraded":"2024-09-12T19:00:00.047995+0000","last_fullsized":"2024-09-12T19:00:00.047995+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:43.915482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106768,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":3034,"num_write":2200,"num_write_kb":2020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821238+0000","last_change":"2024-09-12T17:40:26.192118+0000","last_active":"2024-09-12T18:57:32.821238+0000","last_peered":"2024-09-12T18:57:32.821238+0000","last_clean":"2024-09-12T18:57:32.821238+0000","last_became_active":"2024-09-12T17:40:26.191417+0000","last_became_peered":"2024-09-12T17:40:26.191417+0000","last_unstale":"2024-09-12T18:57:32.821238+0000","last_undegraded":"2024-09-12T18:57:32.821238+0000","last_fullsized":"2024-09-12T18:57:32.821238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:38.892952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'174","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.340189+0000","last_change":"2024-09-12T17:40:28.187802+0000","last_active":"2024-09-12T18:58:06.340189+0000","last_peered":"2024-09-12T18:58:06.340189+0000","last_clean":"2024-09-12T18:58:06.340189+0000","last_became_active":"2024-09-12T17:40:28.186922+0000","last_became_peered":"2024-09-12T17:40:28.186922+0000","last_unstale":"2024-09-12T18:58:06.340189+0000","last_undegraded":"2024-09-12T18:58:06.340189+0000","last_fullsized":"2024-09-12T18:58:06.340189+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.041023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'144","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.343342+0000","last_change":"2024-09-12T19:00:13.343342+0000","last_active":"2024-09-12T19:00:13.343342+0000","last_peered":"2024-09-12T19:00:13.343342+0000","last_clean":"2024-09-12T19:00:13.343342+0000","last_became_active":"2024-09-12T17:40:20.112490+0000","last_became_peered":"2024-09-12T17:40:20.112490+0000","last_unstale":"2024-09-12T19:00:13.343342+0000","last_undegraded":"2024-09-12T19:00:13.343342+0000","last_fullsized":"2024-09-12T19:00:13.343342+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:13.343164+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:13.343164+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.343164+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:03.480373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":606,"num_read_kb":504,"num_write":208,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'318","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.356400+0000","last_change":"2024-09-12T19:00:09.356400+0000","last_active":"2024-09-12T19:00:09.356400+0000","last_peered":"2024-09-12T19:00:09.356400+0000","last_clean":"2024-09-12T19:00:09.356400+0000","last_became_active":"2024-09-12T17:40:18.760130+0000","last_became_peered":"2024-09-12T17:40:18.760130+0000","last_unstale":"2024-09-12T19:00:09.356400+0000","last_undegraded":"2024-09-12T19:00:09.356400+0000","last_fullsized":"2024-09-12T19:00:09.356400+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-12T19:00:09.356157+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-12T19:00:09.356157+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.356157+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:59.332713+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359201,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":428,"num_read_kb":2118,"num_write":932,"num_write_kb":13193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.862213+0000","last_change":"2024-09-12T19:00:06.862213+0000","last_active":"2024-09-12T19:00:06.862213+0000","last_peered":"2024-09-12T19:00:06.862213+0000","last_clean":"2024-09-12T19:00:06.862213+0000","last_became_active":"2024-09-12T17:40:09.770504+0000","last_became_peered":"2024-09-12T17:40:09.770504+0000","last_unstale":"2024-09-12T19:00:06.862213+0000","last_undegraded":"2024-09-12T19:00:06.862213+0000","last_fullsized":"2024-09-12T19:00:06.862213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.862012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.862012+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.862012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:25.645802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001093257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.417289+0000","last_change":"2024-09-12T19:00:19.417289+0000","last_active":"2024-09-12T19:00:19.417289+0000","last_peered":"2024-09-12T19:00:19.417289+0000","last_clean":"2024-09-12T19:00:19.417289+0000","last_became_active":"2024-09-12T17:40:22.136095+0000","last_became_peered":"2024-09-12T17:40:22.136095+0000","last_unstale":"2024-09-12T19:00:19.417289+0000","last_undegraded":"2024-09-12T19:00:19.417289+0000","last_fullsized":"2024-09-12T19:00:19.417289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:19.417107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:19.417107+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.417107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:24.668335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'255","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:25.949567+0000","last_change":"2024-09-12T17:40:24.333148+0000","last_active":"2024-09-12T18:58:25.949567+0000","last_peered":"2024-09-12T18:58:25.949567+0000","last_clean":"2024-09-12T18:58:25.949567+0000","last_became_active":"2024-09-12T17:40:24.332477+0000","last_became_peered":"2024-09-12T17:40:24.332477+0000","last_unstale":"2024-09-12T18:58:25.949567+0000","last_undegraded":"2024-09-12T18:58:25.949567+0000","last_fullsized":"2024-09-12T18:58:25.949567+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:09.053613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":296,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'759","reported_seq":3096,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.374040+0000","last_change":"2024-09-12T17:40:26.180479+0000","last_active":"2024-09-12T18:59:59.374040+0000","last_peered":"2024-09-12T18:59:59.374040+0000","last_clean":"2024-09-12T18:59:59.374040+0000","last_became_active":"2024-09-12T17:40:26.179728+0000","last_became_peered":"2024-09-12T17:40:26.179728+0000","last_unstale":"2024-09-12T18:59:59.374040+0000","last_undegraded":"2024-09-12T18:59:59.374040+0000","last_fullsized":"2024-09-12T18:59:59.374040+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:15.964800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'144","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.754378+0000","last_change":"2024-09-12T17:40:28.202506+0000","last_active":"2024-09-12T18:59:27.754378+0000","last_peered":"2024-09-12T18:59:27.754378+0000","last_clean":"2024-09-12T18:59:27.754378+0000","last_became_active":"2024-09-12T17:40:28.201571+0000","last_became_peered":"2024-09-12T17:40:28.201571+0000","last_unstale":"2024-09-12T18:59:27.754378+0000","last_undegraded":"2024-09-12T18:59:27.754378+0000","last_fullsized":"2024-09-12T18:59:27.754378+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:40.742392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":253,"num_write":364,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'450","reported_seq":1171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.610343+0000","last_change":"2024-09-12T19:00:13.610343+0000","last_active":"2024-09-12T19:00:13.610343+0000","last_peered":"2024-09-12T19:00:13.610343+0000","last_clean":"2024-09-12T19:00:13.610343+0000","last_became_active":"2024-09-12T17:40:20.135950+0000","last_became_peered":"2024-09-12T17:40:20.135950+0000","last_unstale":"2024-09-12T19:00:13.610343+0000","last_undegraded":"2024-09-12T19:00:13.610343+0000","last_fullsized":"2024-09-12T19:00:13.610343+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'450","last_scrub_stamp":"2024-09-12T19:00:13.610072+0000","last_deep_scrub":"264'450","last_deep_scrub_stamp":"2024-09-12T19:00:13.610072+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.610072+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:40.560388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1875,"num_read_kb":1500,"num_write":660,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'335","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.674790+0000","last_change":"2024-09-12T19:00:04.674790+0000","last_active":"2024-09-12T19:00:04.674790+0000","last_peered":"2024-09-12T19:00:04.674790+0000","last_clean":"2024-09-12T19:00:04.674790+0000","last_became_active":"2024-09-12T17:40:18.762324+0000","last_became_peered":"2024-09-12T17:40:18.762324+0000","last_unstale":"2024-09-12T19:00:04.674790+0000","last_undegraded":"2024-09-12T19:00:04.674790+0000","last_fullsized":"2024-09-12T19:00:04.674790+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T19:00:04.674691+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T19:00:04.674691+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.674691+0000","objects_scrubbed":10,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:30.535201+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651838,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":496,"num_read_kb":85957,"num_write":1018,"num_write_kb":37704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.356092+0000","last_change":"2024-09-12T19:00:04.355848+0000","last_active":"2024-09-12T19:00:04.356092+0000","last_peered":"2024-09-12T19:00:04.356092+0000","last_clean":"2024-09-12T19:00:04.356092+0000","last_became_active":"2024-09-12T17:40:09.671019+0000","last_became_peered":"2024-09-12T17:40:09.671019+0000","last_unstale":"2024-09-12T19:00:04.356092+0000","last_undegraded":"2024-09-12T19:00:04.356092+0000","last_fullsized":"2024-09-12T19:00:04.356092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:04.355617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:04.355617+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.355617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:55.946006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096571,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.820072+0000","last_change":"2024-09-12T17:40:22.146908+0000","last_active":"2024-09-12T18:57:27.820072+0000","last_peered":"2024-09-12T18:57:27.820072+0000","last_clean":"2024-09-12T18:57:27.820072+0000","last_became_active":"2024-09-12T17:40:22.146131+0000","last_became_peered":"2024-09-12T17:40:22.146131+0000","last_unstale":"2024-09-12T18:57:27.820072+0000","last_undegraded":"2024-09-12T18:57:27.820072+0000","last_fullsized":"2024-09-12T18:57:27.820072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:43.916632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'135","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.821299+0000","last_change":"2024-09-12T17:40:24.165118+0000","last_active":"2024-09-12T18:57:32.821299+0000","last_peered":"2024-09-12T18:57:32.821299+0000","last_clean":"2024-09-12T18:57:32.821299+0000","last_became_active":"2024-09-12T17:40:24.163566+0000","last_became_peered":"2024-09-12T17:40:24.163566+0000","last_unstale":"2024-09-12T18:57:32.821299+0000","last_undegraded":"2024-09-12T18:57:32.821299+0000","last_fullsized":"2024-09-12T18:57:32.821299+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.865870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'787","reported_seq":2824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.714907+0000","last_change":"2024-09-12T17:40:26.195048+0000","last_active":"2024-09-12T18:59:59.714907+0000","last_peered":"2024-09-12T18:59:59.714907+0000","last_clean":"2024-09-12T18:59:59.714907+0000","last_became_active":"2024-09-12T17:40:26.194293+0000","last_became_peered":"2024-09-12T17:40:26.194293+0000","last_unstale":"2024-09-12T18:59:59.714907+0000","last_undegraded":"2024-09-12T18:59:59.714907+0000","last_fullsized":"2024-09-12T18:59:59.714907+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:29.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'199","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.466585+0000","last_change":"2024-09-12T17:40:28.207712+0000","last_active":"2024-09-12T18:56:57.466585+0000","last_peered":"2024-09-12T18:56:57.466585+0000","last_clean":"2024-09-12T18:56:57.466585+0000","last_became_active":"2024-09-12T17:40:28.207048+0000","last_became_peered":"2024-09-12T17:40:28.207048+0000","last_unstale":"2024-09-12T18:56:57.466585+0000","last_undegraded":"2024-09-12T18:56:57.466585+0000","last_fullsized":"2024-09-12T18:56:57.466585+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:43.200882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":318,"num_write":457,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'86","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.883647+0000","last_change":"2024-09-12T19:00:13.883647+0000","last_active":"2024-09-12T19:00:13.883647+0000","last_peered":"2024-09-12T19:00:13.883647+0000","last_clean":"2024-09-12T19:00:13.883647+0000","last_became_active":"2024-09-12T17:40:20.142323+0000","last_became_peered":"2024-09-12T17:40:20.142323+0000","last_unstale":"2024-09-12T19:00:13.883647+0000","last_undegraded":"2024-09-12T19:00:13.883647+0000","last_fullsized":"2024-09-12T19:00:13.883647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T19:00:13.883445+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T19:00:13.883445+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.883445+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:31.548172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":391,"num_read_kb":327,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'428","reported_seq":1217,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.396668+0000","last_change":"2024-09-12T19:00:04.396668+0000","last_active":"2024-09-12T19:00:04.396668+0000","last_peered":"2024-09-12T19:00:04.396668+0000","last_clean":"2024-09-12T19:00:04.396668+0000","last_became_active":"2024-09-12T17:40:18.766817+0000","last_became_peered":"2024-09-12T17:40:18.766817+0000","last_unstale":"2024-09-12T19:00:04.396668+0000","last_undegraded":"2024-09-12T19:00:04.396668+0000","last_fullsized":"2024-09-12T19:00:04.396668+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-12T19:00:04.396400+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-12T19:00:04.396400+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.396400+0000","objects_scrubbed":10,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:18.046636+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4983875,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":942,"num_read_kb":8527,"num_write":1357,"num_write_kb":43864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.360350+0000","last_change":"2024-09-12T19:00:06.360220+0000","last_active":"2024-09-12T19:00:06.360350+0000","last_peered":"2024-09-12T19:00:06.360350+0000","last_clean":"2024-09-12T19:00:06.360350+0000","last_became_active":"2024-09-12T17:40:09.674331+0000","last_became_peered":"2024-09-12T17:40:09.674331+0000","last_unstale":"2024-09-12T19:00:06.360350+0000","last_undegraded":"2024-09-12T19:00:06.360350+0000","last_fullsized":"2024-09-12T19:00:06.360350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.360038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.360038+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.360038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:41.602732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012562929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.627955+0000","last_change":"2024-09-12T19:00:21.627955+0000","last_active":"2024-09-12T19:00:21.627955+0000","last_peered":"2024-09-12T19:00:21.627955+0000","last_clean":"2024-09-12T19:00:21.627955+0000","last_became_active":"2024-09-12T17:40:22.147341+0000","last_became_peered":"2024-09-12T17:40:22.147341+0000","last_unstale":"2024-09-12T19:00:21.627955+0000","last_undegraded":"2024-09-12T19:00:21.627955+0000","last_fullsized":"2024-09-12T19:00:21.627955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.627773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.627773+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.627773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:41.060971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'789","reported_seq":1534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.515751+0000","last_change":"2024-09-12T17:40:24.330059+0000","last_active":"2024-09-12T18:59:59.515751+0000","last_peered":"2024-09-12T18:59:59.515751+0000","last_clean":"2024-09-12T18:59:59.515751+0000","last_became_active":"2024-09-12T17:40:24.329314+0000","last_became_peered":"2024-09-12T17:40:24.329314+0000","last_unstale":"2024-09-12T18:59:59.515751+0000","last_undegraded":"2024-09-12T18:59:59.515751+0000","last_fullsized":"2024-09-12T18:59:59.515751+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:42.536254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1403,"num_read_kb":3378,"num_write":1144,"num_write_kb":925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.458785+0000","last_change":"2024-09-12T17:40:26.199233+0000","last_active":"2024-09-12T18:57:32.458785+0000","last_peered":"2024-09-12T18:57:32.458785+0000","last_clean":"2024-09-12T18:57:32.458785+0000","last_became_active":"2024-09-12T17:40:26.197718+0000","last_became_peered":"2024-09-12T17:40:26.197718+0000","last_unstale":"2024-09-12T18:57:32.458785+0000","last_undegraded":"2024-09-12T18:57:32.458785+0000","last_fullsized":"2024-09-12T18:57:32.458785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:57.822527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'117","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.632901+0000","last_change":"2024-09-12T17:40:28.199911+0000","last_active":"2024-09-12T18:56:57.632901+0000","last_peered":"2024-09-12T18:56:57.632901+0000","last_clean":"2024-09-12T18:56:57.632901+0000","last_became_active":"2024-09-12T17:40:28.199295+0000","last_became_peered":"2024-09-12T17:40:28.199295+0000","last_unstale":"2024-09-12T18:56:57.632901+0000","last_undegraded":"2024-09-12T18:56:57.632901+0000","last_fullsized":"2024-09-12T18:56:57.632901+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:22.472810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":147,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'106","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:06.518640+0000","last_change":"2024-09-12T17:40:28.192741+0000","last_active":"2024-09-12T18:58:06.518640+0000","last_peered":"2024-09-12T18:58:06.518640+0000","last_clean":"2024-09-12T18:58:06.518640+0000","last_became_active":"2024-09-12T17:40:28.192019+0000","last_became_peered":"2024-09-12T17:40:28.192019+0000","last_unstale":"2024-09-12T18:58:06.518640+0000","last_undegraded":"2024-09-12T18:58:06.518640+0000","last_fullsized":"2024-09-12T18:58:06.518640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:03.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":192,"num_write":225,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'111","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.848789+0000","last_change":"2024-09-12T19:00:12.848789+0000","last_active":"2024-09-12T19:00:12.848789+0000","last_peered":"2024-09-12T19:00:12.848789+0000","last_clean":"2024-09-12T19:00:12.848789+0000","last_became_active":"2024-09-12T17:40:20.135868+0000","last_became_peered":"2024-09-12T17:40:20.135868+0000","last_unstale":"2024-09-12T19:00:12.848789+0000","last_undegraded":"2024-09-12T19:00:12.848789+0000","last_fullsized":"2024-09-12T19:00:12.848789+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'111","last_scrub_stamp":"2024-09-12T19:00:12.848609+0000","last_deep_scrub":"264'111","last_deep_scrub_stamp":"2024-09-12T19:00:12.848609+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.848609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:47.505689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":445,"num_write":160,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'289","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.773680+0000","last_change":"2024-09-12T19:00:07.773680+0000","last_active":"2024-09-12T19:00:07.773680+0000","last_peered":"2024-09-12T19:00:07.773680+0000","last_clean":"2024-09-12T19:00:07.773680+0000","last_became_active":"2024-09-12T17:40:18.788674+0000","last_became_peered":"2024-09-12T17:40:18.788674+0000","last_unstale":"2024-09-12T19:00:07.773680+0000","last_undegraded":"2024-09-12T19:00:07.773680+0000","last_fullsized":"2024-09-12T19:00:07.773680+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-12T19:00:07.773396+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-12T19:00:07.773396+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.773396+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:22.864639+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117782,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":10615,"num_write":904,"num_write_kb":14901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.325270+0000","last_change":"2024-09-12T19:00:21.325270+0000","last_active":"2024-09-12T19:00:21.325270+0000","last_peered":"2024-09-12T19:00:21.325270+0000","last_clean":"2024-09-12T19:00:21.325270+0000","last_became_active":"2024-09-12T17:40:22.141326+0000","last_became_peered":"2024-09-12T17:40:22.141326+0000","last_unstale":"2024-09-12T19:00:21.325270+0000","last_undegraded":"2024-09-12T19:00:21.325270+0000","last_fullsized":"2024-09-12T19:00:21.325270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.325088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.325088+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.325088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:11.574471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'304","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.748241+0000","last_change":"2024-09-12T17:40:24.171008+0000","last_active":"2024-09-12T18:59:59.748241+0000","last_peered":"2024-09-12T18:59:59.748241+0000","last_clean":"2024-09-12T18:59:59.748241+0000","last_became_active":"2024-09-12T17:40:24.169248+0000","last_became_peered":"2024-09-12T17:40:24.169248+0000","last_unstale":"2024-09-12T18:59:59.748241+0000","last_undegraded":"2024-09-12T18:59:59.748241+0000","last_fullsized":"2024-09-12T18:59:59.748241+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:18.401232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1219,"num_write":420,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457958+0000","last_change":"2024-09-12T17:40:26.204596+0000","last_active":"2024-09-12T18:57:27.457958+0000","last_peered":"2024-09-12T18:57:27.457958+0000","last_clean":"2024-09-12T18:57:27.457958+0000","last_became_active":"2024-09-12T17:40:26.203855+0000","last_became_peered":"2024-09-12T17:40:26.203855+0000","last_unstale":"2024-09-12T18:57:27.457958+0000","last_undegraded":"2024-09-12T18:57:27.457958+0000","last_fullsized":"2024-09-12T18:57:27.457958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:26.029987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.597637+0000","last_change":"2024-09-12T17:40:28.205116+0000","last_active":"2024-09-12T18:57:32.597637+0000","last_peered":"2024-09-12T18:57:32.597637+0000","last_clean":"2024-09-12T18:57:32.597637+0000","last_became_active":"2024-09-12T17:40:28.204204+0000","last_became_peered":"2024-09-12T17:40:28.204204+0000","last_unstale":"2024-09-12T18:57:32.597637+0000","last_undegraded":"2024-09-12T18:57:32.597637+0000","last_fullsized":"2024-09-12T18:57:32.597637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:13.281028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":252,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'238","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.393511+0000","last_change":"2024-09-12T19:00:15.393511+0000","last_active":"2024-09-12T19:00:15.393511+0000","last_peered":"2024-09-12T19:00:15.393511+0000","last_clean":"2024-09-12T19:00:15.393511+0000","last_became_active":"2024-09-12T17:40:20.128532+0000","last_became_peered":"2024-09-12T17:40:20.128532+0000","last_unstale":"2024-09-12T19:00:15.393511+0000","last_undegraded":"2024-09-12T19:00:15.393511+0000","last_fullsized":"2024-09-12T19:00:15.393511+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'238","last_scrub_stamp":"2024-09-12T19:00:15.393329+0000","last_deep_scrub":"264'238","last_deep_scrub_stamp":"2024-09-12T19:00:15.393329+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.393329+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:00.980128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":846,"num_write":360,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'397","reported_seq":1111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.937018+0000","last_change":"2024-09-12T19:00:11.937018+0000","last_active":"2024-09-12T19:00:11.937018+0000","last_peered":"2024-09-12T19:00:11.937018+0000","last_clean":"2024-09-12T19:00:11.937018+0000","last_became_active":"2024-09-12T17:40:55.305689+0000","last_became_peered":"2024-09-12T17:40:55.305689+0000","last_unstale":"2024-09-12T19:00:11.937018+0000","last_undegraded":"2024-09-12T19:00:11.937018+0000","last_fullsized":"2024-09-12T19:00:11.937018+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:11.936824+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:11.936824+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.936824+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:31.586190+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":44917,"num_write":1304,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.618172+0000","last_change":"2024-09-12T19:00:20.618172+0000","last_active":"2024-09-12T19:00:20.618172+0000","last_peered":"2024-09-12T19:00:20.618172+0000","last_clean":"2024-09-12T19:00:20.618172+0000","last_became_active":"2024-09-12T17:40:22.143466+0000","last_became_peered":"2024-09-12T17:40:22.143466+0000","last_unstale":"2024-09-12T19:00:20.618172+0000","last_undegraded":"2024-09-12T19:00:20.618172+0000","last_fullsized":"2024-09-12T19:00:20.618172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:20.617988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:20.617988+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.617988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:25.354445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'61","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473152+0000","last_change":"2024-09-12T17:40:24.152265+0000","last_active":"2024-09-12T18:57:27.473152+0000","last_peered":"2024-09-12T18:57:27.473152+0000","last_clean":"2024-09-12T18:57:27.473152+0000","last_became_active":"2024-09-12T17:40:24.151530+0000","last_became_peered":"2024-09-12T17:40:24.151530+0000","last_unstale":"2024-09-12T18:57:27.473152+0000","last_undegraded":"2024-09-12T18:57:27.473152+0000","last_fullsized":"2024-09-12T18:57:27.473152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:13.980036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457196+0000","last_change":"2024-09-12T17:40:26.187903+0000","last_active":"2024-09-12T18:57:27.457196+0000","last_peered":"2024-09-12T18:57:27.457196+0000","last_clean":"2024-09-12T18:57:27.457196+0000","last_became_active":"2024-09-12T17:40:26.187122+0000","last_became_peered":"2024-09-12T17:40:26.187122+0000","last_unstale":"2024-09-12T18:57:27.457196+0000","last_undegraded":"2024-09-12T18:57:27.457196+0000","last_fullsized":"2024-09-12T18:57:27.457196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:36.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'248","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.372703+0000","last_change":"2024-09-12T17:40:28.194923+0000","last_active":"2024-09-12T18:58:04.372703+0000","last_peered":"2024-09-12T18:58:04.372703+0000","last_clean":"2024-09-12T18:58:04.372703+0000","last_became_active":"2024-09-12T17:40:28.194047+0000","last_became_peered":"2024-09-12T17:40:28.194047+0000","last_unstale":"2024-09-12T18:58:04.372703+0000","last_undegraded":"2024-09-12T18:58:04.372703+0000","last_fullsized":"2024-09-12T18:58:04.372703+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:44.148991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":352,"num_write":540,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'120","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.619652+0000","last_change":"2024-09-12T19:00:18.619652+0000","last_active":"2024-09-12T19:00:18.619652+0000","last_peered":"2024-09-12T19:00:18.619652+0000","last_clean":"2024-09-12T19:00:18.619652+0000","last_became_active":"2024-09-12T17:40:20.130567+0000","last_became_peered":"2024-09-12T17:40:20.130567+0000","last_unstale":"2024-09-12T19:00:18.619652+0000","last_undegraded":"2024-09-12T19:00:18.619652+0000","last_fullsized":"2024-09-12T19:00:18.619652+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T19:00:18.619454+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T19:00:18.619454+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.619454+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:46.704065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":440,"num_write":198,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'397","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.290827+0000","last_change":"2024-09-12T19:00:11.290827+0000","last_active":"2024-09-12T19:00:11.290827+0000","last_peered":"2024-09-12T19:00:11.290827+0000","last_clean":"2024-09-12T19:00:11.290827+0000","last_became_active":"2024-09-12T17:40:18.781135+0000","last_became_peered":"2024-09-12T17:40:18.781135+0000","last_unstale":"2024-09-12T19:00:11.290827+0000","last_undegraded":"2024-09-12T19:00:11.290827+0000","last_fullsized":"2024-09-12T19:00:11.290827+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:11.290616+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:11.290616+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.290616+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:13.553119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306781,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":11928,"num_write":1198,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.456026+0000","last_change":"2024-09-12T17:40:22.151655+0000","last_active":"2024-09-12T18:57:22.456026+0000","last_peered":"2024-09-12T18:57:22.456026+0000","last_clean":"2024-09-12T18:57:22.456026+0000","last_became_active":"2024-09-12T17:40:22.150912+0000","last_became_peered":"2024-09-12T17:40:22.150912+0000","last_unstale":"2024-09-12T18:57:22.456026+0000","last_undegraded":"2024-09-12T18:57:22.456026+0000","last_fullsized":"2024-09-12T18:57:22.456026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:49.335095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'342","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.319988+0000","last_change":"2024-09-12T17:40:24.177728+0000","last_active":"2024-09-12T18:59:59.319988+0000","last_peered":"2024-09-12T18:59:59.319988+0000","last_clean":"2024-09-12T18:59:59.319988+0000","last_became_active":"2024-09-12T17:40:24.176722+0000","last_became_peered":"2024-09-12T17:40:24.176722+0000","last_unstale":"2024-09-12T18:59:59.319988+0000","last_undegraded":"2024-09-12T18:59:59.319988+0000","last_fullsized":"2024-09-12T18:59:59.319988+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.865870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48896,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":559,"num_read_kb":1238,"num_write":442,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.443157+0000","last_change":"2024-09-12T17:40:26.168192+0000","last_active":"2024-09-12T18:57:27.443157+0000","last_peered":"2024-09-12T18:57:27.443157+0000","last_clean":"2024-09-12T18:57:27.443157+0000","last_became_active":"2024-09-12T17:40:26.167280+0000","last_became_peered":"2024-09-12T17:40:26.167280+0000","last_unstale":"2024-09-12T18:57:27.443157+0000","last_undegraded":"2024-09-12T18:57:27.443157+0000","last_fullsized":"2024-09-12T18:57:27.443157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:03.370653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'106","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:04.559076+0000","last_change":"2024-09-12T17:40:28.194951+0000","last_active":"2024-09-12T18:58:04.559076+0000","last_peered":"2024-09-12T18:58:04.559076+0000","last_clean":"2024-09-12T18:58:04.559076+0000","last_became_active":"2024-09-12T17:40:28.192629+0000","last_became_peered":"2024-09-12T17:40:28.192629+0000","last_unstale":"2024-09-12T18:58:04.559076+0000","last_undegraded":"2024-09-12T18:58:04.559076+0000","last_fullsized":"2024-09-12T18:58:04.559076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:40.252151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.590597+0000","last_change":"2024-09-12T19:00:16.590597+0000","last_active":"2024-09-12T19:00:16.590597+0000","last_peered":"2024-09-12T19:00:16.590597+0000","last_clean":"2024-09-12T19:00:16.590597+0000","last_became_active":"2024-09-12T17:40:55.301950+0000","last_became_peered":"2024-09-12T17:40:55.301950+0000","last_unstale":"2024-09-12T19:00:16.590597+0000","last_undegraded":"2024-09-12T19:00:16.590597+0000","last_fullsized":"2024-09-12T19:00:16.590597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-12T19:00:16.590364+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-12T19:00:16.590364+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.590364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:37.860965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":400,"num_write":158,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'409","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.344070+0000","last_change":"2024-09-12T19:00:06.344003+0000","last_active":"2024-09-12T19:00:06.344070+0000","last_peered":"2024-09-12T19:00:06.344070+0000","last_clean":"2024-09-12T19:00:06.344070+0000","last_became_active":"2024-09-12T17:40:18.755694+0000","last_became_peered":"2024-09-12T17:40:18.755694+0000","last_unstale":"2024-09-12T19:00:06.344070+0000","last_undegraded":"2024-09-12T19:00:06.344070+0000","last_fullsized":"2024-09-12T19:00:06.344070+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'409","last_scrub_stamp":"2024-09-12T19:00:06.343896+0000","last_deep_scrub":"264'409","last_deep_scrub_stamp":"2024-09-12T19:00:06.343896+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.343896+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:09.006520+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194332,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":35553,"num_write":1273,"num_write_kb":53517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:22.442028+0000","last_change":"2024-09-12T17:40:22.136120+0000","last_active":"2024-09-12T18:57:22.442028+0000","last_peered":"2024-09-12T18:57:22.442028+0000","last_clean":"2024-09-12T18:57:22.442028+0000","last_became_active":"2024-09-12T17:40:22.135547+0000","last_became_peered":"2024-09-12T17:40:22.135547+0000","last_unstale":"2024-09-12T18:57:22.442028+0000","last_undegraded":"2024-09-12T18:57:22.442028+0000","last_fullsized":"2024-09-12T18:57:22.442028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:28.203301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'309","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.205374+0000","last_change":"2024-09-12T17:40:24.163735+0000","last_active":"2024-09-12T18:59:59.205374+0000","last_peered":"2024-09-12T18:59:59.205374+0000","last_clean":"2024-09-12T18:59:59.205374+0000","last_became_active":"2024-09-12T17:40:24.162901+0000","last_became_peered":"2024-09-12T17:40:24.162901+0000","last_unstale":"2024-09-12T18:59:59.205374+0000","last_undegraded":"2024-09-12T18:59:59.205374+0000","last_fullsized":"2024-09-12T18:59:59.205374+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:08.268660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51001,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1227,"num_write":416,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473259+0000","last_change":"2024-09-12T17:40:26.191520+0000","last_active":"2024-09-12T18:57:27.473259+0000","last_peered":"2024-09-12T18:57:27.473259+0000","last_clean":"2024-09-12T18:57:27.473259+0000","last_became_active":"2024-09-12T17:40:26.190755+0000","last_became_peered":"2024-09-12T17:40:26.190755+0000","last_unstale":"2024-09-12T18:57:27.473259+0000","last_undegraded":"2024-09-12T18:57:27.473259+0000","last_fullsized":"2024-09-12T18:57:27.473259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:00.734100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'428","reported_seq":1200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.440828+0000","last_change":"2024-09-12T19:00:16.440828+0000","last_active":"2024-09-12T19:00:16.440828+0000","last_peered":"2024-09-12T19:00:16.440828+0000","last_clean":"2024-09-12T19:00:16.440828+0000","last_became_active":"2024-09-12T17:40:20.127413+0000","last_became_peered":"2024-09-12T17:40:20.127413+0000","last_unstale":"2024-09-12T19:00:16.440828+0000","last_undegraded":"2024-09-12T19:00:16.440828+0000","last_fullsized":"2024-09-12T19:00:16.440828+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-12T19:00:16.440639+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-12T19:00:16.440639+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.440639+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:08.283126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2096,"num_read_kb":1807,"num_write":754,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'348","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.711102+0000","last_change":"2024-09-12T19:00:08.711102+0000","last_active":"2024-09-12T19:00:08.711102+0000","last_peered":"2024-09-12T19:00:08.711102+0000","last_clean":"2024-09-12T19:00:08.711102+0000","last_became_active":"2024-09-12T17:40:18.759467+0000","last_became_peered":"2024-09-12T17:40:18.759467+0000","last_unstale":"2024-09-12T19:00:08.711102+0000","last_undegraded":"2024-09-12T19:00:08.711102+0000","last_fullsized":"2024-09-12T19:00:08.711102+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T19:00:08.710899+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T19:00:08.710899+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.710899+0000","objects_scrubbed":10,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:25.297780+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399269,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":67738,"num_write":1092,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.462225+0000","last_change":"2024-09-12T17:40:22.144503+0000","last_active":"2024-09-12T18:56:37.462225+0000","last_peered":"2024-09-12T18:56:37.462225+0000","last_clean":"2024-09-12T18:56:37.462225+0000","last_became_active":"2024-09-12T17:40:22.143764+0000","last_became_peered":"2024-09-12T17:40:22.143764+0000","last_unstale":"2024-09-12T18:56:37.462225+0000","last_undegraded":"2024-09-12T18:56:37.462225+0000","last_fullsized":"2024-09-12T18:56:37.462225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:07.658407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'539","reported_seq":1186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.971899+0000","last_change":"2024-09-12T17:40:24.179162+0000","last_active":"2024-09-12T18:59:59.971899+0000","last_peered":"2024-09-12T18:59:59.971899+0000","last_clean":"2024-09-12T18:59:59.971899+0000","last_became_active":"2024-09-12T17:40:24.178354+0000","last_became_peered":"2024-09-12T17:40:24.178354+0000","last_unstale":"2024-09-12T18:59:59.971899+0000","last_undegraded":"2024-09-12T18:59:59.971899+0000","last_fullsized":"2024-09-12T18:59:59.971899+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:39.728053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110471,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":953,"num_read_kb":2361,"num_write":826,"num_write_kb":742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.612487+0000","last_change":"2024-09-12T17:40:26.185364+0000","last_active":"2024-09-12T18:55:27.612487+0000","last_peered":"2024-09-12T18:55:27.612487+0000","last_clean":"2024-09-12T18:55:27.612487+0000","last_became_active":"2024-09-12T17:40:26.184572+0000","last_became_peered":"2024-09-12T17:40:26.184572+0000","last_unstale":"2024-09-12T18:55:27.612487+0000","last_undegraded":"2024-09-12T18:55:27.612487+0000","last_fullsized":"2024-09-12T18:55:27.612487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:35.867018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'243","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:05.971764+0000","last_change":"2024-09-12T17:40:28.201022+0000","last_active":"2024-09-12T18:58:05.971764+0000","last_peered":"2024-09-12T18:58:05.971764+0000","last_clean":"2024-09-12T18:58:05.971764+0000","last_became_active":"2024-09-12T17:40:28.200289+0000","last_became_peered":"2024-09-12T17:40:28.200289+0000","last_unstale":"2024-09-12T18:58:05.971764+0000","last_undegraded":"2024-09-12T18:58:05.971764+0000","last_fullsized":"2024-09-12T18:58:05.971764+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:57.750960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":402,"num_read_kb":380,"num_write":484,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'278","reported_seq":975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.329492+0000","last_change":"2024-09-12T19:00:17.329492+0000","last_active":"2024-09-12T19:00:17.329492+0000","last_peered":"2024-09-12T19:00:17.329492+0000","last_clean":"2024-09-12T19:00:17.329492+0000","last_became_active":"2024-09-12T17:40:20.128840+0000","last_became_peered":"2024-09-12T17:40:20.128840+0000","last_unstale":"2024-09-12T19:00:17.329492+0000","last_undegraded":"2024-09-12T19:00:17.329492+0000","last_fullsized":"2024-09-12T19:00:17.329492+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'278","last_scrub_stamp":"2024-09-12T19:00:17.329286+0000","last_deep_scrub":"264'278","last_deep_scrub_stamp":"2024-09-12T19:00:17.329286+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.329286+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:15.910212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1419,"num_read_kb":1187,"num_write":525,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'305","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.388940+0000","last_change":"2024-09-12T19:00:10.388940+0000","last_active":"2024-09-12T19:00:10.388940+0000","last_peered":"2024-09-12T19:00:10.388940+0000","last_clean":"2024-09-12T19:00:10.388940+0000","last_became_active":"2024-09-12T17:40:18.762421+0000","last_became_peered":"2024-09-12T17:40:18.762421+0000","last_unstale":"2024-09-12T19:00:10.388940+0000","last_undegraded":"2024-09-12T19:00:10.388940+0000","last_fullsized":"2024-09-12T19:00:10.388940+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-12T19:00:10.388665+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-12T19:00:10.388665+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.388665+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:37.537161+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":428,"num_read_kb":9963,"num_write":965,"num_write_kb":16756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.400755+0000","last_change":"2024-09-12T19:00:20.400755+0000","last_active":"2024-09-12T19:00:20.400755+0000","last_peered":"2024-09-12T19:00:20.400755+0000","last_clean":"2024-09-12T19:00:20.400755+0000","last_became_active":"2024-09-12T17:40:22.133919+0000","last_became_peered":"2024-09-12T17:40:22.133919+0000","last_unstale":"2024-09-12T19:00:20.400755+0000","last_undegraded":"2024-09-12T19:00:20.400755+0000","last_fullsized":"2024-09-12T19:00:20.400755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:20.400574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:20.400574+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.400574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:25.599834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'313","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.240235+0000","last_change":"2024-09-12T17:40:24.168575+0000","last_active":"2024-09-12T18:59:59.240235+0000","last_peered":"2024-09-12T18:59:59.240235+0000","last_clean":"2024-09-12T18:59:59.240235+0000","last_became_active":"2024-09-12T17:40:24.167870+0000","last_became_peered":"2024-09-12T17:40:24.167870+0000","last_unstale":"2024-09-12T18:59:59.240235+0000","last_undegraded":"2024-09-12T18:59:59.240235+0000","last_fullsized":"2024-09-12T18:59:59.240235+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:06.921434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50431,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":1079,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.438227+0000","last_change":"2024-09-12T17:40:26.199740+0000","last_active":"2024-09-12T18:55:27.438227+0000","last_peered":"2024-09-12T18:55:27.438227+0000","last_clean":"2024-09-12T18:55:27.438227+0000","last_became_active":"2024-09-12T17:40:26.199065+0000","last_became_peered":"2024-09-12T17:40:26.199065+0000","last_unstale":"2024-09-12T18:55:27.438227+0000","last_undegraded":"2024-09-12T18:55:27.438227+0000","last_fullsized":"2024-09-12T18:55:27.438227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:29.279788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'184","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:00.492872+0000","last_change":"2024-09-12T17:40:28.193740+0000","last_active":"2024-09-12T18:58:00.492872+0000","last_peered":"2024-09-12T18:58:00.492872+0000","last_clean":"2024-09-12T18:58:00.492872+0000","last_became_active":"2024-09-12T17:40:28.192588+0000","last_became_peered":"2024-09-12T17:40:28.192588+0000","last_unstale":"2024-09-12T18:58:00.492872+0000","last_undegraded":"2024-09-12T18:58:00.492872+0000","last_fullsized":"2024-09-12T18:58:00.492872+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:35.257214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":737,"num_read_kb":706,"num_write":515,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'254","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.634317+0000","last_change":"2024-09-12T19:00:15.634145+0000","last_active":"2024-09-12T19:00:15.634317+0000","last_peered":"2024-09-12T19:00:15.634317+0000","last_clean":"2024-09-12T19:00:15.634317+0000","last_became_active":"2024-09-12T17:40:20.133067+0000","last_became_peered":"2024-09-12T17:40:20.133067+0000","last_unstale":"2024-09-12T19:00:15.634317+0000","last_undegraded":"2024-09-12T19:00:15.634317+0000","last_fullsized":"2024-09-12T19:00:15.634317+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'254","last_scrub_stamp":"2024-09-12T19:00:15.633957+0000","last_deep_scrub":"264'254","last_deep_scrub_stamp":"2024-09-12T19:00:15.633957+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.633957+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:24.007199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1200,"num_read_kb":1015,"num_write":444,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'349","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.743053+0000","last_change":"2024-09-12T19:00:08.742895+0000","last_active":"2024-09-12T19:00:08.743053+0000","last_peered":"2024-09-12T19:00:08.743053+0000","last_clean":"2024-09-12T19:00:08.743053+0000","last_became_active":"2024-09-12T17:40:18.773029+0000","last_became_peered":"2024-09-12T17:40:18.773029+0000","last_unstale":"2024-09-12T19:00:08.743053+0000","last_undegraded":"2024-09-12T19:00:08.743053+0000","last_fullsized":"2024-09-12T19:00:08.743053+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-12T19:00:08.742672+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-12T19:00:08.742672+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.742672+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:43.956356+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5769265,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":426,"num_read_kb":38404,"num_write":1086,"num_write_kb":31393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:52.826181+0000","last_change":"2024-09-12T17:40:22.146616+0000","last_active":"2024-09-12T18:57:52.826181+0000","last_peered":"2024-09-12T18:57:52.826181+0000","last_clean":"2024-09-12T18:57:52.826181+0000","last_became_active":"2024-09-12T17:40:22.145871+0000","last_became_peered":"2024-09-12T17:40:22.145871+0000","last_unstale":"2024-09-12T18:57:52.826181+0000","last_undegraded":"2024-09-12T18:57:52.826181+0000","last_fullsized":"2024-09-12T18:57:52.826181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'308","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.897217+0000","last_change":"2024-09-12T17:40:24.330122+0000","last_active":"2024-09-12T18:59:59.897217+0000","last_peered":"2024-09-12T18:59:59.897217+0000","last_clean":"2024-09-12T18:59:59.897217+0000","last_became_active":"2024-09-12T17:40:24.329413+0000","last_became_peered":"2024-09-12T17:40:24.329413+0000","last_unstale":"2024-09-12T18:59:59.897217+0000","last_undegraded":"2024-09-12T18:59:59.897217+0000","last_fullsized":"2024-09-12T18:59:59.897217+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:11.778689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47334,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1206,"num_write":420,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.455205+0000","last_change":"2024-09-12T17:40:26.199588+0000","last_active":"2024-09-12T18:56:47.455205+0000","last_peered":"2024-09-12T18:56:47.455205+0000","last_clean":"2024-09-12T18:56:47.455205+0000","last_became_active":"2024-09-12T17:40:26.198930+0000","last_became_peered":"2024-09-12T17:40:26.198930+0000","last_unstale":"2024-09-12T18:56:47.455205+0000","last_undegraded":"2024-09-12T18:56:47.455205+0000","last_fullsized":"2024-09-12T18:56:47.455205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:48.763531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'117","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.763203+0000","last_change":"2024-09-12T17:40:28.194240+0000","last_active":"2024-09-12T18:59:27.763203+0000","last_peered":"2024-09-12T18:59:27.763203+0000","last_clean":"2024-09-12T18:59:27.763203+0000","last_became_active":"2024-09-12T17:40:28.192689+0000","last_became_peered":"2024-09-12T17:40:28.192689+0000","last_unstale":"2024-09-12T18:59:27.763203+0000","last_undegraded":"2024-09-12T18:59:27.763203+0000","last_fullsized":"2024-09-12T18:59:27.763203+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:53.085665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":258,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'197","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.631338+0000","last_change":"2024-09-12T19:00:09.631176+0000","last_active":"2024-09-12T19:00:09.631338+0000","last_peered":"2024-09-12T19:00:09.631338+0000","last_clean":"2024-09-12T19:00:09.631338+0000","last_became_active":"2024-09-12T17:40:20.132998+0000","last_became_peered":"2024-09-12T17:40:20.132998+0000","last_unstale":"2024-09-12T19:00:09.631338+0000","last_undegraded":"2024-09-12T19:00:09.631338+0000","last_fullsized":"2024-09-12T19:00:09.631338+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'197","last_scrub_stamp":"2024-09-12T19:00:09.630961+0000","last_deep_scrub":"264'197","last_deep_scrub_stamp":"2024-09-12T19:00:09.630961+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.630961+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:43.492350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":791,"num_read_kb":641,"num_write":284,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'452","reported_seq":1204,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.350146+0000","last_change":"2024-09-12T19:00:07.349873+0000","last_active":"2024-09-12T19:00:07.350146+0000","last_peered":"2024-09-12T19:00:07.350146+0000","last_clean":"2024-09-12T19:00:07.350146+0000","last_became_active":"2024-09-12T17:40:18.774892+0000","last_became_peered":"2024-09-12T17:40:18.774892+0000","last_unstale":"2024-09-12T19:00:07.350146+0000","last_undegraded":"2024-09-12T19:00:07.350146+0000","last_fullsized":"2024-09-12T19:00:07.350146+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'452","last_scrub_stamp":"2024-09-12T19:00:07.349511+0000","last_deep_scrub":"264'452","last_deep_scrub_stamp":"2024-09-12T19:00:07.349511+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.349511+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:27.593097+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":517958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":741,"num_read_kb":87834,"num_write":1424,"num_write_kb":30285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:52.468961+0000","last_change":"2024-09-12T17:40:22.142115+0000","last_active":"2024-09-12T18:57:52.468961+0000","last_peered":"2024-09-12T18:57:52.468961+0000","last_clean":"2024-09-12T18:57:52.468961+0000","last_became_active":"2024-09-12T17:40:22.141670+0000","last_became_peered":"2024-09-12T17:40:22.141670+0000","last_unstale":"2024-09-12T18:57:52.468961+0000","last_undegraded":"2024-09-12T18:57:52.468961+0000","last_fullsized":"2024-09-12T18:57:52.468961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'131","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:37.809263+0000","last_change":"2024-09-12T17:40:24.330200+0000","last_active":"2024-09-12T18:56:37.809263+0000","last_peered":"2024-09-12T18:56:37.809263+0000","last_clean":"2024-09-12T18:56:37.809263+0000","last_became_active":"2024-09-12T17:40:24.329446+0000","last_became_peered":"2024-09-12T17:40:24.329446+0000","last_unstale":"2024-09-12T18:56:37.809263+0000","last_undegraded":"2024-09-12T18:56:37.809263+0000","last_fullsized":"2024-09-12T18:56:37.809263+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:39.604725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'753","reported_seq":4496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.711806+0000","last_change":"2024-09-12T17:40:26.193089+0000","last_active":"2024-09-12T18:59:58.711806+0000","last_peered":"2024-09-12T18:59:58.711806+0000","last_clean":"2024-09-12T18:59:58.711806+0000","last_became_active":"2024-09-12T17:40:26.192341+0000","last_became_peered":"2024-09-12T17:40:26.192341+0000","last_unstale":"2024-09-12T18:59:58.711806+0000","last_undegraded":"2024-09-12T18:59:58.711806+0000","last_fullsized":"2024-09-12T18:59:58.711806+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:04.649327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'116","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457136+0000","last_change":"2024-09-12T17:40:28.187817+0000","last_active":"2024-09-12T18:57:27.457136+0000","last_peered":"2024-09-12T18:57:27.457136+0000","last_clean":"2024-09-12T18:57:27.457136+0000","last_became_active":"2024-09-12T17:40:28.187089+0000","last_became_peered":"2024-09-12T17:40:28.187089+0000","last_unstale":"2024-09-12T18:57:27.457136+0000","last_undegraded":"2024-09-12T18:57:27.457136+0000","last_fullsized":"2024-09-12T18:57:27.457136+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:39.669386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'389","reported_seq":1142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.883979+0000","last_change":"2024-09-12T19:00:19.883704+0000","last_active":"2024-09-12T19:00:19.883979+0000","last_peered":"2024-09-12T19:00:19.883979+0000","last_clean":"2024-09-12T19:00:19.883979+0000","last_became_active":"2024-09-12T17:40:20.142478+0000","last_became_peered":"2024-09-12T17:40:20.142478+0000","last_unstale":"2024-09-12T19:00:19.883979+0000","last_undegraded":"2024-09-12T19:00:19.883979+0000","last_fullsized":"2024-09-12T19:00:19.883979+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'389","last_scrub_stamp":"2024-09-12T19:00:19.883428+0000","last_deep_scrub":"264'389","last_deep_scrub_stamp":"2024-09-12T19:00:19.883428+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.883428+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:21.623543+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1845,"num_read_kb":1583,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25754,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'344","reported_seq":1177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.599290+0000","last_change":"2024-09-12T19:00:04.599290+0000","last_active":"2024-09-12T19:00:04.599290+0000","last_peered":"2024-09-12T19:00:04.599290+0000","last_clean":"2024-09-12T19:00:04.599290+0000","last_became_active":"2024-09-12T17:40:55.330696+0000","last_became_peered":"2024-09-12T17:40:55.330696+0000","last_unstale":"2024-09-12T19:00:04.599290+0000","last_undegraded":"2024-09-12T19:00:04.599290+0000","last_fullsized":"2024-09-12T19:00:04.599290+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T19:00:04.599196+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T19:00:04.599196+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.599196+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:34.856416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35759,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":915,"num_read_kb":9625,"num_write":1190,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:52.463603+0000","last_change":"2024-09-12T17:40:22.152165+0000","last_active":"2024-09-12T18:57:52.463603+0000","last_peered":"2024-09-12T18:57:52.463603+0000","last_clean":"2024-09-12T18:57:52.463603+0000","last_became_active":"2024-09-12T17:40:22.151083+0000","last_became_peered":"2024-09-12T17:40:22.151083+0000","last_unstale":"2024-09-12T18:57:52.463603+0000","last_undegraded":"2024-09-12T18:57:52.463603+0000","last_fullsized":"2024-09-12T18:57:52.463603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'335","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.865580+0000","last_change":"2024-09-12T17:40:24.174149+0000","last_active":"2024-09-12T18:59:58.865580+0000","last_peered":"2024-09-12T18:59:58.865580+0000","last_clean":"2024-09-12T18:59:58.865580+0000","last_became_active":"2024-09-12T17:40:24.173360+0000","last_became_peered":"2024-09-12T17:40:24.173360+0000","last_unstale":"2024-09-12T18:59:58.865580+0000","last_undegraded":"2024-09-12T18:59:58.865580+0000","last_fullsized":"2024-09-12T18:59:58.865580+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:01.318365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61671,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":561,"num_read_kb":1233,"num_write":446,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.477868+0000","last_change":"2024-09-12T17:40:26.164532+0000","last_active":"2024-09-12T18:57:47.477868+0000","last_peered":"2024-09-12T18:57:47.477868+0000","last_clean":"2024-09-12T18:57:47.477868+0000","last_became_active":"2024-09-12T17:40:26.163773+0000","last_became_peered":"2024-09-12T17:40:26.163773+0000","last_unstale":"2024-09-12T18:57:47.477868+0000","last_undegraded":"2024-09-12T18:57:47.477868+0000","last_fullsized":"2024-09-12T18:57:47.477868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'102","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:27.747415+0000","last_change":"2024-09-12T17:40:28.199692+0000","last_active":"2024-09-12T18:59:27.747415+0000","last_peered":"2024-09-12T18:59:27.747415+0000","last_clean":"2024-09-12T18:59:27.747415+0000","last_became_active":"2024-09-12T17:40:28.198792+0000","last_became_peered":"2024-09-12T17:40:28.198792+0000","last_unstale":"2024-09-12T18:59:27.747415+0000","last_undegraded":"2024-09-12T18:59:27.747415+0000","last_fullsized":"2024-09-12T18:59:27.747415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":239,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'185","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.805223+0000","last_change":"2024-09-12T19:00:17.804978+0000","last_active":"2024-09-12T19:00:17.805223+0000","last_peered":"2024-09-12T19:00:17.805223+0000","last_clean":"2024-09-12T19:00:17.805223+0000","last_became_active":"2024-09-12T17:40:20.136564+0000","last_became_peered":"2024-09-12T17:40:20.136564+0000","last_unstale":"2024-09-12T19:00:17.805223+0000","last_undegraded":"2024-09-12T19:00:17.805223+0000","last_fullsized":"2024-09-12T19:00:17.805223+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T19:00:17.804709+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T19:00:17.804709+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.804709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:22.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":640,"num_write":266,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'423","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.276533+0000","last_change":"2024-09-12T19:00:10.276396+0000","last_active":"2024-09-12T19:00:10.276533+0000","last_peered":"2024-09-12T19:00:10.276533+0000","last_clean":"2024-09-12T19:00:10.276533+0000","last_became_active":"2024-09-12T17:40:18.779946+0000","last_became_peered":"2024-09-12T17:40:18.779946+0000","last_unstale":"2024-09-12T19:00:10.276533+0000","last_undegraded":"2024-09-12T19:00:10.276533+0000","last_fullsized":"2024-09-12T19:00:10.276533+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'423","last_scrub_stamp":"2024-09-12T19:00:10.276179+0000","last_deep_scrub":"264'423","last_deep_scrub_stamp":"2024-09-12T19:00:10.276179+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.276179+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:31.510413+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1239867,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":711,"num_read_kb":21197,"num_write":1193,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:52.656214+0000","last_change":"2024-09-12T17:40:22.138047+0000","last_active":"2024-09-12T18:57:52.656214+0000","last_peered":"2024-09-12T18:57:52.656214+0000","last_clean":"2024-09-12T18:57:52.656214+0000","last_became_active":"2024-09-12T17:40:22.137291+0000","last_became_peered":"2024-09-12T17:40:22.137291+0000","last_unstale":"2024-09-12T18:57:52.656214+0000","last_undegraded":"2024-09-12T18:57:52.656214+0000","last_fullsized":"2024-09-12T18:57:52.656214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'264","reported_seq":852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.919681+0000","last_change":"2024-09-12T17:40:24.175430+0000","last_active":"2024-09-12T18:59:58.919681+0000","last_peered":"2024-09-12T18:59:58.919681+0000","last_clean":"2024-09-12T18:59:58.919681+0000","last_became_active":"2024-09-12T17:40:24.174681+0000","last_became_peered":"2024-09-12T17:40:24.174681+0000","last_unstale":"2024-09-12T18:59:58.919681+0000","last_undegraded":"2024-09-12T18:59:58.919681+0000","last_fullsized":"2024-09-12T18:59:58.919681+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51960,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":993,"num_write":344,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:42.421121+0000","last_change":"2024-09-12T17:40:26.188512+0000","last_active":"2024-09-12T18:55:42.421121+0000","last_peered":"2024-09-12T18:55:42.421121+0000","last_clean":"2024-09-12T18:55:42.421121+0000","last_became_active":"2024-09-12T17:40:26.187438+0000","last_became_peered":"2024-09-12T17:40:26.187438+0000","last_unstale":"2024-09-12T18:55:42.421121+0000","last_undegraded":"2024-09-12T18:55:42.421121+0000","last_fullsized":"2024-09-12T18:55:42.421121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:20.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'124","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.462395+0000","last_change":"2024-09-12T17:40:28.202550+0000","last_active":"2024-09-12T18:57:47.462395+0000","last_peered":"2024-09-12T18:57:47.462395+0000","last_clean":"2024-09-12T18:57:47.462395+0000","last_became_active":"2024-09-12T17:40:28.201534+0000","last_became_peered":"2024-09-12T17:40:28.201534+0000","last_unstale":"2024-09-12T18:57:47.462395+0000","last_undegraded":"2024-09-12T18:57:47.462395+0000","last_fullsized":"2024-09-12T18:57:47.462395+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":291,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'52","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.612666+0000","last_change":"2024-09-12T19:00:19.612666+0000","last_active":"2024-09-12T19:00:19.612666+0000","last_peered":"2024-09-12T19:00:19.612666+0000","last_clean":"2024-09-12T19:00:19.612666+0000","last_became_active":"2024-09-12T17:40:20.117604+0000","last_became_peered":"2024-09-12T17:40:20.117604+0000","last_unstale":"2024-09-12T19:00:19.612666+0000","last_undegraded":"2024-09-12T19:00:19.612666+0000","last_fullsized":"2024-09-12T19:00:19.612666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T19:00:19.612475+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T19:00:19.612475+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.612475+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:58.666585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":67,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'324","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.061121+0000","last_change":"2024-09-12T17:40:18.767654+0000","last_active":"2024-09-12T19:00:00.061121+0000","last_peered":"2024-09-12T19:00:00.061121+0000","last_clean":"2024-09-12T19:00:00.061121+0000","last_became_active":"2024-09-12T17:40:18.767103+0000","last_became_peered":"2024-09-12T17:40:18.767103+0000","last_unstale":"2024-09-12T19:00:00.061121+0000","last_undegraded":"2024-09-12T19:00:00.061121+0000","last_fullsized":"2024-09-12T19:00:00.061121+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:13.247336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097225,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":436,"num_read_kb":34280,"num_write":1068,"num_write_kb":41945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.823526+0000","last_change":"2024-09-12T17:40:22.135061+0000","last_active":"2024-09-12T18:57:42.823526+0000","last_peered":"2024-09-12T18:57:42.823526+0000","last_clean":"2024-09-12T18:57:42.823526+0000","last_became_active":"2024-09-12T17:40:22.134242+0000","last_became_peered":"2024-09-12T17:40:22.134242+0000","last_unstale":"2024-09-12T18:57:42.823526+0000","last_undegraded":"2024-09-12T18:57:42.823526+0000","last_fullsized":"2024-09-12T18:57:42.823526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'239","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.826054+0000","last_change":"2024-09-12T17:40:24.183504+0000","last_active":"2024-09-12T18:59:59.826054+0000","last_peered":"2024-09-12T18:59:59.826054+0000","last_clean":"2024-09-12T18:59:59.826054+0000","last_became_active":"2024-09-12T17:40:24.181581+0000","last_became_peered":"2024-09-12T17:40:24.181581+0000","last_unstale":"2024-09-12T18:59:59.826054+0000","last_undegraded":"2024-09-12T18:59:59.826054+0000","last_fullsized":"2024-09-12T18:59:59.826054+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:34.205562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":967,"num_write":316,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.794291+0000","last_change":"2024-09-12T17:40:26.196580+0000","last_active":"2024-09-12T18:55:27.794291+0000","last_peered":"2024-09-12T18:55:27.794291+0000","last_clean":"2024-09-12T18:55:27.794291+0000","last_became_active":"2024-09-12T17:40:26.195603+0000","last_became_peered":"2024-09-12T17:40:26.195603+0000","last_unstale":"2024-09-12T18:55:27.794291+0000","last_undegraded":"2024-09-12T18:55:27.794291+0000","last_fullsized":"2024-09-12T18:55:27.794291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:00.612716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'168","reported_seq":1282,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:00.430223+0000","last_change":"2024-09-12T17:40:28.200915+0000","last_active":"2024-09-12T18:58:00.430223+0000","last_peered":"2024-09-12T18:58:00.430223+0000","last_clean":"2024-09-12T18:58:00.430223+0000","last_became_active":"2024-09-12T17:40:28.200126+0000","last_became_peered":"2024-09-12T17:40:28.200126+0000","last_unstale":"2024-09-12T18:58:00.430223+0000","last_undegraded":"2024-09-12T18:58:00.430223+0000","last_fullsized":"2024-09-12T18:58:00.430223+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":872,"num_read_kb":859,"num_write":427,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'166","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.848337+0000","last_change":"2024-09-12T19:00:16.848337+0000","last_active":"2024-09-12T19:00:16.848337+0000","last_peered":"2024-09-12T19:00:16.848337+0000","last_clean":"2024-09-12T19:00:16.848337+0000","last_became_active":"2024-09-12T17:40:20.131459+0000","last_became_peered":"2024-09-12T17:40:20.131459+0000","last_unstale":"2024-09-12T19:00:16.848337+0000","last_undegraded":"2024-09-12T19:00:16.848337+0000","last_fullsized":"2024-09-12T19:00:16.848337+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T19:00:16.848164+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T19:00:16.848164+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.848164+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:33.348709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":677,"num_write":293,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'344","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.318433+0000","last_change":"2024-09-12T19:00:08.318433+0000","last_active":"2024-09-12T19:00:08.318433+0000","last_peered":"2024-09-12T19:00:08.318433+0000","last_clean":"2024-09-12T19:00:08.318433+0000","last_became_active":"2024-09-12T17:40:18.773667+0000","last_became_peered":"2024-09-12T17:40:18.773667+0000","last_unstale":"2024-09-12T19:00:08.318433+0000","last_undegraded":"2024-09-12T19:00:08.318433+0000","last_fullsized":"2024-09-12T19:00:08.318433+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T19:00:08.318197+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T19:00:08.318197+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.318197+0000","objects_scrubbed":10,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:30.683986+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263633,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":554,"num_read_kb":8714,"num_write":1079,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"35'4","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.673801+0000","last_change":"2024-09-12T17:40:22.141628+0000","last_active":"2024-09-12T18:59:58.673801+0000","last_peered":"2024-09-12T18:59:58.673801+0000","last_clean":"2024-09-12T18:59:58.673801+0000","last_became_active":"2024-09-12T17:40:22.141182+0000","last_became_peered":"2024-09-12T17:40:22.141182+0000","last_unstale":"2024-09-12T18:59:58.673801+0000","last_undegraded":"2024-09-12T18:59:58.673801+0000","last_fullsized":"2024-09-12T18:59:58.673801+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:21.099986+0000","last_clean_scrub_stamp":"2024-09-12T17:40:21.099986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:38.121269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'306","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.929903+0000","last_change":"2024-09-12T17:40:24.167135+0000","last_active":"2024-09-12T18:59:59.929903+0000","last_peered":"2024-09-12T18:59:59.929903+0000","last_clean":"2024-09-12T18:59:59.929903+0000","last_became_active":"2024-09-12T17:40:24.166330+0000","last_became_peered":"2024-09-12T17:40:24.166330+0000","last_unstale":"2024-09-12T18:59:59.929903+0000","last_undegraded":"2024-09-12T18:59:59.929903+0000","last_fullsized":"2024-09-12T18:59:59.929903+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:23.122570+0000","last_clean_scrub_stamp":"2024-09-12T17:40:23.122570+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.549312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51905,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1128,"num_write":400,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:55:27.447210+0000","last_change":"2024-09-12T17:40:26.189177+0000","last_active":"2024-09-12T18:55:27.447210+0000","last_peered":"2024-09-12T18:55:27.447210+0000","last_clean":"2024-09-12T18:55:27.447210+0000","last_became_active":"2024-09-12T17:40:26.188351+0000","last_became_peered":"2024-09-12T17:40:26.188351+0000","last_unstale":"2024-09-12T18:55:27.447210+0000","last_undegraded":"2024-09-12T18:55:27.447210+0000","last_fullsized":"2024-09-12T18:55:27.447210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:25.141149+0000","last_clean_scrub_stamp":"2024-09-12T17:40:25.141149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:14.730369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'136","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.601050+0000","last_change":"2024-09-12T17:40:28.180850+0000","last_active":"2024-09-12T18:59:26.601050+0000","last_peered":"2024-09-12T18:59:26.601050+0000","last_clean":"2024-09-12T18:59:26.601050+0000","last_became_active":"2024-09-12T17:40:28.180148+0000","last_became_peered":"2024-09-12T17:40:28.180148+0000","last_unstale":"2024-09-12T18:59:26.601050+0000","last_undegraded":"2024-09-12T18:59:26.601050+0000","last_fullsized":"2024-09-12T18:59:26.601050+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:56.213405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":171,"num_read_kb":158,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'174","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.338356+0000","last_change":"2024-09-12T19:00:19.338356+0000","last_active":"2024-09-12T19:00:19.338356+0000","last_peered":"2024-09-12T19:00:19.338356+0000","last_clean":"2024-09-12T19:00:19.338356+0000","last_became_active":"2024-09-12T17:40:20.127006+0000","last_became_peered":"2024-09-12T17:40:20.127006+0000","last_unstale":"2024-09-12T19:00:19.338356+0000","last_undegraded":"2024-09-12T19:00:19.338356+0000","last_fullsized":"2024-09-12T19:00:19.338356+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T19:00:19.338125+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T19:00:19.338125+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.338125+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:28.379386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":779,"num_read_kb":649,"num_write":260,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'327","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.432395+0000","last_change":"2024-09-12T19:00:12.432395+0000","last_active":"2024-09-12T19:00:12.432395+0000","last_peered":"2024-09-12T19:00:12.432395+0000","last_clean":"2024-09-12T19:00:12.432395+0000","last_became_active":"2024-09-12T17:40:18.757444+0000","last_became_peered":"2024-09-12T17:40:18.757444+0000","last_unstale":"2024-09-12T19:00:12.432395+0000","last_undegraded":"2024-09-12T19:00:12.432395+0000","last_fullsized":"2024-09-12T19:00:12.432395+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T19:00:12.432143+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T19:00:12.432143+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.432143+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:39.703339+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194355,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":91614,"num_write":1080,"num_write_kb":46187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'4205","reported_seq":4827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.334280+0000","last_change":"2024-09-12T19:00:17.334280+0000","last_active":"2024-09-12T19:00:17.334280+0000","last_peered":"2024-09-12T19:00:17.334280+0000","last_clean":"2024-09-12T19:00:17.334280+0000","last_became_active":"2024-09-12T17:40:20.125586+0000","last_became_peered":"2024-09-12T17:40:20.125586+0000","last_unstale":"2024-09-12T19:00:17.334280+0000","last_undegraded":"2024-09-12T19:00:17.334280+0000","last_fullsized":"2024-09-12T19:00:17.334280+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4205","last_scrub_stamp":"2024-09-12T19:00:17.334001+0000","last_deep_scrub":"264'4205","last_deep_scrub_stamp":"2024-09-12T19:00:17.334001+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.334001+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":3000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:15.949061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16904,"num_read_kb":14161,"num_write":6332,"num_write_kb":3161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'321","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.590276+0000","last_change":"2024-09-12T19:00:07.590276+0000","last_active":"2024-09-12T19:00:07.590276+0000","last_peered":"2024-09-12T19:00:07.590276+0000","last_clean":"2024-09-12T19:00:07.590276+0000","last_became_active":"2024-09-12T17:40:18.754335+0000","last_became_peered":"2024-09-12T17:40:18.754335+0000","last_unstale":"2024-09-12T19:00:07.590276+0000","last_undegraded":"2024-09-12T19:00:07.590276+0000","last_fullsized":"2024-09-12T19:00:07.590276+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T19:00:07.590095+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T19:00:07.590095+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.590095+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:24.884297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":433,"num_read_kb":13730,"num_write":1004,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'413","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.622495+0000","last_change":"2024-09-12T17:40:20.137604+0000","last_active":"2024-09-12T18:56:12.622495+0000","last_peered":"2024-09-12T18:56:12.622495+0000","last_clean":"2024-09-12T18:56:12.622495+0000","last_became_active":"2024-09-12T17:40:20.136831+0000","last_became_peered":"2024-09-12T17:40:20.136831+0000","last_unstale":"2024-09-12T18:56:12.622495+0000","last_undegraded":"2024-09-12T18:56:12.622495+0000","last_fullsized":"2024-09-12T18:56:12.622495+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:14.463672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1812,"num_read_kb":1536,"num_write":694,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'341","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.271766+0000","last_change":"2024-09-12T19:00:12.271766+0000","last_active":"2024-09-12T19:00:12.271766+0000","last_peered":"2024-09-12T19:00:12.271766+0000","last_clean":"2024-09-12T19:00:12.271766+0000","last_became_active":"2024-09-12T17:40:18.753576+0000","last_became_peered":"2024-09-12T17:40:18.753576+0000","last_unstale":"2024-09-12T19:00:12.271766+0000","last_undegraded":"2024-09-12T19:00:12.271766+0000","last_fullsized":"2024-09-12T19:00:12.271766+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T19:00:12.271560+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T19:00:12.271560+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.271560+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:34.437310+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":449,"num_read_kb":36529,"num_write":1017,"num_write_kb":32314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'363","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.371890+0000","last_change":"2024-09-12T19:00:20.371890+0000","last_active":"2024-09-12T19:00:20.371890+0000","last_peered":"2024-09-12T19:00:20.371890+0000","last_clean":"2024-09-12T19:00:20.371890+0000","last_became_active":"2024-09-12T17:40:20.132826+0000","last_became_peered":"2024-09-12T17:40:20.132826+0000","last_unstale":"2024-09-12T19:00:20.371890+0000","last_undegraded":"2024-09-12T19:00:20.371890+0000","last_fullsized":"2024-09-12T19:00:20.371890+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-12T19:00:20.371710+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-12T19:00:20.371710+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.371710+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:53.712192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1596,"num_read_kb":1285,"num_write":598,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'350","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.351167+0000","last_change":"2024-09-12T19:00:09.351167+0000","last_active":"2024-09-12T19:00:09.351167+0000","last_peered":"2024-09-12T19:00:09.351167+0000","last_clean":"2024-09-12T19:00:09.351167+0000","last_became_active":"2024-09-12T17:40:18.754933+0000","last_became_peered":"2024-09-12T17:40:18.754933+0000","last_unstale":"2024-09-12T19:00:09.351167+0000","last_undegraded":"2024-09-12T19:00:09.351167+0000","last_fullsized":"2024-09-12T19:00:09.351167+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T19:00:09.350866+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T19:00:09.350866+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.350866+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:40.151355+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081897,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":46825,"num_write":1040,"num_write_kb":45673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'114","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.622228+0000","last_change":"2024-09-12T19:00:17.622228+0000","last_active":"2024-09-12T19:00:17.622228+0000","last_peered":"2024-09-12T19:00:17.622228+0000","last_clean":"2024-09-12T19:00:17.622228+0000","last_became_active":"2024-09-12T17:40:20.129769+0000","last_became_peered":"2024-09-12T17:40:20.129769+0000","last_unstale":"2024-09-12T19:00:17.622228+0000","last_undegraded":"2024-09-12T19:00:17.622228+0000","last_fullsized":"2024-09-12T19:00:17.622228+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T19:00:17.622030+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T19:00:17.622030+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.622030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:54.615405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":414,"num_write":175,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'356","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.690017+0000","last_change":"2024-09-12T19:00:10.690017+0000","last_active":"2024-09-12T19:00:10.690017+0000","last_peered":"2024-09-12T19:00:10.690017+0000","last_clean":"2024-09-12T19:00:10.690017+0000","last_became_active":"2024-09-12T17:40:18.773052+0000","last_became_peered":"2024-09-12T17:40:18.773052+0000","last_unstale":"2024-09-12T19:00:10.690017+0000","last_undegraded":"2024-09-12T19:00:10.690017+0000","last_fullsized":"2024-09-12T19:00:10.690017+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T19:00:10.689810+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T19:00:10.689810+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.689810+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:54.998455+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2648214,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":619,"num_read_kb":23542,"num_write":1059,"num_write_kb":26208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'141","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.828290+0000","last_change":"2024-09-12T19:00:18.828290+0000","last_active":"2024-09-12T19:00:18.828290+0000","last_peered":"2024-09-12T19:00:18.828290+0000","last_clean":"2024-09-12T19:00:18.828290+0000","last_became_active":"2024-09-12T17:40:20.146835+0000","last_became_peered":"2024-09-12T17:40:20.146835+0000","last_unstale":"2024-09-12T19:00:18.828290+0000","last_undegraded":"2024-09-12T19:00:18.828290+0000","last_fullsized":"2024-09-12T19:00:18.828290+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T19:00:18.828089+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T19:00:18.828089+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.828089+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:42.635478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":516,"num_write":222,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'452","reported_seq":1234,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.396458+0000","last_change":"2024-09-12T19:00:08.396458+0000","last_active":"2024-09-12T19:00:08.396458+0000","last_peered":"2024-09-12T19:00:08.396458+0000","last_clean":"2024-09-12T19:00:08.396458+0000","last_became_active":"2024-09-12T17:40:18.764545+0000","last_became_peered":"2024-09-12T17:40:18.764545+0000","last_unstale":"2024-09-12T19:00:08.396458+0000","last_undegraded":"2024-09-12T19:00:08.396458+0000","last_fullsized":"2024-09-12T19:00:08.396458+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'452","last_scrub_stamp":"2024-09-12T19:00:08.396245+0000","last_deep_scrub":"264'452","last_deep_scrub_stamp":"2024-09-12T19:00:08.396245+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.396245+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:44.809947+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263245,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":913,"num_read_kb":25412,"num_write":1371,"num_write_kb":29284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'206","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457994+0000","last_change":"2024-09-12T17:40:20.133394+0000","last_active":"2024-09-12T18:57:27.457994+0000","last_peered":"2024-09-12T18:57:27.457994+0000","last_clean":"2024-09-12T18:57:27.457994+0000","last_became_active":"2024-09-12T17:40:20.133055+0000","last_became_peered":"2024-09-12T17:40:20.133055+0000","last_unstale":"2024-09-12T18:57:27.457994+0000","last_undegraded":"2024-09-12T18:57:27.457994+0000","last_fullsized":"2024-09-12T18:57:27.457994+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:30.582322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":974,"num_read_kb":794,"num_write":355,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'338","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.422287+0000","last_change":"2024-09-12T19:00:08.422287+0000","last_active":"2024-09-12T19:00:08.422287+0000","last_peered":"2024-09-12T19:00:08.422287+0000","last_clean":"2024-09-12T19:00:08.422287+0000","last_became_active":"2024-09-12T17:40:18.764658+0000","last_became_peered":"2024-09-12T17:40:18.764658+0000","last_unstale":"2024-09-12T19:00:08.422287+0000","last_undegraded":"2024-09-12T19:00:08.422287+0000","last_fullsized":"2024-09-12T19:00:08.422287+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T19:00:08.421985+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T19:00:08.421985+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.421985+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:05.651015+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4856534,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":14122,"num_write":1065,"num_write_kb":26720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'195","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.424693+0000","last_change":"2024-09-12T19:00:17.424693+0000","last_active":"2024-09-12T19:00:17.424693+0000","last_peered":"2024-09-12T19:00:17.424693+0000","last_clean":"2024-09-12T19:00:17.424693+0000","last_became_active":"2024-09-12T17:40:20.124247+0000","last_became_peered":"2024-09-12T17:40:20.124247+0000","last_unstale":"2024-09-12T19:00:17.424693+0000","last_undegraded":"2024-09-12T19:00:17.424693+0000","last_fullsized":"2024-09-12T19:00:17.424693+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T19:00:17.424514+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T19:00:17.424514+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.424514+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:47.443716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":903,"num_read_kb":737,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'372","reported_seq":1061,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.718958+0000","last_change":"2024-09-12T19:00:09.718958+0000","last_active":"2024-09-12T19:00:09.718958+0000","last_peered":"2024-09-12T19:00:09.718958+0000","last_clean":"2024-09-12T19:00:09.718958+0000","last_became_active":"2024-09-12T17:40:18.772776+0000","last_became_peered":"2024-09-12T17:40:18.772776+0000","last_unstale":"2024-09-12T19:00:09.718958+0000","last_undegraded":"2024-09-12T19:00:09.718958+0000","last_fullsized":"2024-09-12T19:00:09.718958+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T19:00:09.718726+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T19:00:09.718726+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.718726+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:59.239489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":25353,"num_write":1144,"num_write_kb":19697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'233","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.362881+0000","last_change":"2024-09-12T19:00:19.362881+0000","last_active":"2024-09-12T19:00:19.362881+0000","last_peered":"2024-09-12T19:00:19.362881+0000","last_clean":"2024-09-12T19:00:19.362881+0000","last_became_active":"2024-09-12T17:40:20.116064+0000","last_became_peered":"2024-09-12T17:40:20.116064+0000","last_unstale":"2024-09-12T19:00:19.362881+0000","last_undegraded":"2024-09-12T19:00:19.362881+0000","last_fullsized":"2024-09-12T19:00:19.362881+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-12T19:00:19.362701+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-12T19:00:19.362701+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.362701+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:26.580777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1004,"num_read_kb":824,"num_write":355,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'342","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.289501+0000","last_change":"2024-09-12T19:00:13.289501+0000","last_active":"2024-09-12T19:00:13.289501+0000","last_peered":"2024-09-12T19:00:13.289501+0000","last_clean":"2024-09-12T19:00:13.289501+0000","last_became_active":"2024-09-12T17:40:18.753693+0000","last_became_peered":"2024-09-12T17:40:18.753693+0000","last_unstale":"2024-09-12T19:00:13.289501+0000","last_undegraded":"2024-09-12T19:00:13.289501+0000","last_fullsized":"2024-09-12T19:00:13.289501+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-12T19:00:13.289299+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-12T19:00:13.289299+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.289299+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:49.965185+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194334,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":459,"num_read_kb":12118,"num_write":1082,"num_write_kb":50446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'82","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.817953+0000","last_change":"2024-09-12T19:00:21.817953+0000","last_active":"2024-09-12T19:00:21.817953+0000","last_peered":"2024-09-12T19:00:21.817953+0000","last_clean":"2024-09-12T19:00:21.817953+0000","last_became_active":"2024-09-12T17:40:20.129687+0000","last_became_peered":"2024-09-12T17:40:20.129687+0000","last_unstale":"2024-09-12T19:00:21.817953+0000","last_undegraded":"2024-09-12T19:00:21.817953+0000","last_fullsized":"2024-09-12T19:00:21.817953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'82","last_scrub_stamp":"2024-09-12T19:00:21.817743+0000","last_deep_scrub":"264'82","last_deep_scrub_stamp":"2024-09-12T19:00:21.817743+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.817743+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:53.779281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":302,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'389","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:00.030244+0000","last_change":"2024-09-12T17:40:18.773313+0000","last_active":"2024-09-12T19:00:00.030244+0000","last_peered":"2024-09-12T19:00:00.030244+0000","last_clean":"2024-09-12T19:00:00.030244+0000","last_became_active":"2024-09-12T17:40:18.772969+0000","last_became_peered":"2024-09-12T17:40:18.772969+0000","last_unstale":"2024-09-12T19:00:00.030244+0000","last_undegraded":"2024-09-12T19:00:00.030244+0000","last_fullsized":"2024-09-12T19:00:00.030244+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:17.710913+0000","last_clean_scrub_stamp":"2024-09-12T17:40:17.710913+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:42.889939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242937,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":478,"num_read_kb":13353,"num_write":1113,"num_write_kb":30519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'211","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.609423+0000","last_change":"2024-09-12T19:00:13.609423+0000","last_active":"2024-09-12T19:00:13.609423+0000","last_peered":"2024-09-12T19:00:13.609423+0000","last_clean":"2024-09-12T19:00:13.609423+0000","last_became_active":"2024-09-12T17:40:20.130606+0000","last_became_peered":"2024-09-12T17:40:20.130606+0000","last_unstale":"2024-09-12T19:00:13.609423+0000","last_undegraded":"2024-09-12T19:00:13.609423+0000","last_fullsized":"2024-09-12T19:00:13.609423+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T19:00:13.609244+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T19:00:13.609244+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.609244+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:10.927640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":765,"num_write":331,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'361","reported_seq":1143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.290572+0000","last_change":"2024-09-12T19:00:14.290572+0000","last_active":"2024-09-12T19:00:14.290572+0000","last_peered":"2024-09-12T19:00:14.290572+0000","last_clean":"2024-09-12T19:00:14.290572+0000","last_became_active":"2024-09-12T17:40:18.780861+0000","last_became_peered":"2024-09-12T17:40:18.780861+0000","last_unstale":"2024-09-12T19:00:14.290572+0000","last_undegraded":"2024-09-12T19:00:14.290572+0000","last_fullsized":"2024-09-12T19:00:14.290572+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-12T19:00:14.290350+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-12T19:00:14.290350+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.290350+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:52.086504+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747960,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":883,"num_read_kb":18830,"num_write":1183,"num_write_kb":42628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'422","reported_seq":1188,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.862014+0000","last_change":"2024-09-12T19:00:20.862014+0000","last_active":"2024-09-12T19:00:20.862014+0000","last_peered":"2024-09-12T19:00:20.862014+0000","last_clean":"2024-09-12T19:00:20.862014+0000","last_became_active":"2024-09-12T17:40:20.149176+0000","last_became_peered":"2024-09-12T17:40:20.149176+0000","last_unstale":"2024-09-12T19:00:20.862014+0000","last_undegraded":"2024-09-12T19:00:20.862014+0000","last_fullsized":"2024-09-12T19:00:20.862014+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'422","last_scrub_stamp":"2024-09-12T19:00:20.861788+0000","last_deep_scrub":"264'422","last_deep_scrub_stamp":"2024-09-12T19:00:20.861788+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.861788+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:54.694114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2034,"num_read_kb":1768,"num_write":658,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'346","reported_seq":1036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.360750+0000","last_change":"2024-09-12T19:00:10.360750+0000","last_active":"2024-09-12T19:00:10.360750+0000","last_peered":"2024-09-12T19:00:10.360750+0000","last_clean":"2024-09-12T19:00:10.360750+0000","last_became_active":"2024-09-12T17:40:18.781543+0000","last_became_peered":"2024-09-12T17:40:18.781543+0000","last_unstale":"2024-09-12T19:00:10.360750+0000","last_undegraded":"2024-09-12T19:00:10.360750+0000","last_fullsized":"2024-09-12T19:00:10.360750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-12T19:00:10.360515+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-12T19:00:10.360515+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.360515+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:06.783092+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457569,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":553,"num_read_kb":27146,"num_write":1120,"num_write_kb":17169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'186","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.911553+0000","last_change":"2024-09-12T19:00:21.911553+0000","last_active":"2024-09-12T19:00:21.911553+0000","last_peered":"2024-09-12T19:00:21.911553+0000","last_clean":"2024-09-12T19:00:21.911553+0000","last_became_active":"2024-09-12T17:40:20.132914+0000","last_became_peered":"2024-09-12T17:40:20.132914+0000","last_unstale":"2024-09-12T19:00:21.911553+0000","last_undegraded":"2024-09-12T19:00:21.911553+0000","last_fullsized":"2024-09-12T19:00:21.911553+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-12T19:00:21.911343+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-12T19:00:21.911343+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.911343+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:50.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":685,"num_write":286,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'422","reported_seq":1145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.381965+0000","last_change":"2024-09-12T19:00:09.381965+0000","last_active":"2024-09-12T19:00:09.381965+0000","last_peered":"2024-09-12T19:00:09.381965+0000","last_clean":"2024-09-12T19:00:09.381965+0000","last_became_active":"2024-09-12T17:40:18.773572+0000","last_became_peered":"2024-09-12T17:40:18.773572+0000","last_unstale":"2024-09-12T19:00:09.381965+0000","last_undegraded":"2024-09-12T19:00:09.381965+0000","last_fullsized":"2024-09-12T19:00:09.381965+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'422","last_scrub_stamp":"2024-09-12T19:00:09.381751+0000","last_deep_scrub":"264'422","last_deep_scrub_stamp":"2024-09-12T19:00:09.381751+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.381751+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:32.068671+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":27791,"num_write":1413,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'107","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.338332+0000","last_change":"2024-09-12T19:00:18.338332+0000","last_active":"2024-09-12T19:00:18.338332+0000","last_peered":"2024-09-12T19:00:18.338332+0000","last_clean":"2024-09-12T19:00:18.338332+0000","last_became_active":"2024-09-12T17:40:20.124905+0000","last_became_peered":"2024-09-12T17:40:20.124905+0000","last_unstale":"2024-09-12T19:00:18.338332+0000","last_undegraded":"2024-09-12T19:00:18.338332+0000","last_fullsized":"2024-09-12T19:00:18.338332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T19:00:18.338034+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T19:00:18.338034+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.338034+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:10.384014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":441,"num_write":144,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'398","reported_seq":1116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.920289+0000","last_change":"2024-09-12T19:00:15.920289+0000","last_active":"2024-09-12T19:00:15.920289+0000","last_peered":"2024-09-12T19:00:15.920289+0000","last_clean":"2024-09-12T19:00:15.920289+0000","last_became_active":"2024-09-12T17:40:18.776865+0000","last_became_peered":"2024-09-12T17:40:18.776865+0000","last_unstale":"2024-09-12T19:00:15.920289+0000","last_undegraded":"2024-09-12T19:00:15.920289+0000","last_fullsized":"2024-09-12T19:00:15.920289+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-12T19:00:15.920038+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-12T19:00:15.920038+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.920038+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:26.024841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":2000,"num_write":1257,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'104","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:26.554319+0000","last_change":"2024-09-12T17:40:20.119380+0000","last_active":"2024-09-12T18:59:26.554319+0000","last_peered":"2024-09-12T18:59:26.554319+0000","last_clean":"2024-09-12T18:59:26.554319+0000","last_became_active":"2024-09-12T17:40:20.119036+0000","last_became_peered":"2024-09-12T17:40:20.119036+0000","last_unstale":"2024-09-12T18:59:26.554319+0000","last_undegraded":"2024-09-12T18:59:26.554319+0000","last_fullsized":"2024-09-12T18:59:26.554319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:19.093091+0000","last_clean_scrub_stamp":"2024-09-12T17:40:19.093091+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:31.564674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":455,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'498","reported_seq":1210,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.639674+0000","last_change":"2024-09-12T19:00:08.639674+0000","last_active":"2024-09-12T19:00:08.639674+0000","last_peered":"2024-09-12T19:00:08.639674+0000","last_clean":"2024-09-12T19:00:08.639674+0000","last_became_active":"2024-09-12T17:40:18.768688+0000","last_became_peered":"2024-09-12T17:40:18.768688+0000","last_unstale":"2024-09-12T19:00:08.639674+0000","last_undegraded":"2024-09-12T19:00:08.639674+0000","last_fullsized":"2024-09-12T19:00:08.639674+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'498","last_scrub_stamp":"2024-09-12T19:00:08.639435+0000","last_deep_scrub":"264'498","last_deep_scrub_stamp":"2024-09-12T19:00:08.639435+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.639435+0000","objects_scrubbed":10,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:14.008750+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1574987,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":867,"num_read_kb":49769,"num_write":1400,"num_write_kb":26119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'160","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.912993+0000","last_change":"2024-09-12T19:00:19.912993+0000","last_active":"2024-09-12T19:00:19.912993+0000","last_peered":"2024-09-12T19:00:19.912993+0000","last_clean":"2024-09-12T19:00:19.912993+0000","last_became_active":"2024-09-12T17:40:20.132698+0000","last_became_peered":"2024-09-12T17:40:20.132698+0000","last_unstale":"2024-09-12T19:00:19.912993+0000","last_undegraded":"2024-09-12T19:00:19.912993+0000","last_fullsized":"2024-09-12T19:00:19.912993+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'160","last_scrub_stamp":"2024-09-12T19:00:19.912805+0000","last_deep_scrub":"264'160","last_deep_scrub_stamp":"2024-09-12T19:00:19.912805+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.912805+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:29.782789+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":512,"num_write":259,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'360","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.274101+0000","last_change":"2024-09-12T19:00:15.274101+0000","last_active":"2024-09-12T19:00:15.274101+0000","last_peered":"2024-09-12T19:00:15.274101+0000","last_clean":"2024-09-12T19:00:15.274101+0000","last_became_active":"2024-09-12T17:40:18.784024+0000","last_became_peered":"2024-09-12T17:40:18.784024+0000","last_unstale":"2024-09-12T19:00:15.274101+0000","last_undegraded":"2024-09-12T19:00:15.274101+0000","last_fullsized":"2024-09-12T19:00:15.274101+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-12T19:00:15.273885+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-12T19:00:15.273885+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.273885+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:38.508212+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506065,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":13540,"num_write":1118,"num_write_kb":25363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'385","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.627938+0000","last_change":"2024-09-12T19:00:06.627843+0000","last_active":"2024-09-12T19:00:06.627938+0000","last_peered":"2024-09-12T19:00:06.627938+0000","last_clean":"2024-09-12T19:00:06.627938+0000","last_became_active":"2024-09-12T17:40:55.331839+0000","last_became_peered":"2024-09-12T17:40:55.331839+0000","last_unstale":"2024-09-12T19:00:06.627938+0000","last_undegraded":"2024-09-12T19:00:06.627938+0000","last_fullsized":"2024-09-12T19:00:06.627938+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T19:00:06.627706+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T19:00:06.627706+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.627706+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:52.807717+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":31466,"num_write":1073,"num_write_kb":39606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'70","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.316844+0000","last_change":"2024-09-12T19:00:20.316695+0000","last_active":"2024-09-12T19:00:20.316844+0000","last_peered":"2024-09-12T19:00:20.316844+0000","last_clean":"2024-09-12T19:00:20.316844+0000","last_became_active":"2024-09-12T17:40:20.116230+0000","last_became_peered":"2024-09-12T17:40:20.116230+0000","last_unstale":"2024-09-12T19:00:20.316844+0000","last_undegraded":"2024-09-12T19:00:20.316844+0000","last_fullsized":"2024-09-12T19:00:20.316844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'70","last_scrub_stamp":"2024-09-12T19:00:20.316504+0000","last_deep_scrub":"264'70","last_deep_scrub_stamp":"2024-09-12T19:00:20.316504+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.316504+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:02.569846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":294,"num_write":113,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'391","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.415348+0000","last_change":"2024-09-12T19:00:11.415348+0000","last_active":"2024-09-12T19:00:11.415348+0000","last_peered":"2024-09-12T19:00:11.415348+0000","last_clean":"2024-09-12T19:00:11.415348+0000","last_became_active":"2024-09-12T17:40:18.774332+0000","last_became_peered":"2024-09-12T17:40:18.774332+0000","last_unstale":"2024-09-12T19:00:11.415348+0000","last_undegraded":"2024-09-12T19:00:11.415348+0000","last_fullsized":"2024-09-12T19:00:11.415348+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'391","last_scrub_stamp":"2024-09-12T19:00:11.415109+0000","last_deep_scrub":"264'391","last_deep_scrub_stamp":"2024-09-12T19:00:11.415109+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.415109+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:08.336481+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482012,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":8119,"num_write":1461,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'266","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.311756+0000","last_change":"2024-09-12T19:00:21.311756+0000","last_active":"2024-09-12T19:00:21.311756+0000","last_peered":"2024-09-12T19:00:21.311756+0000","last_clean":"2024-09-12T19:00:21.311756+0000","last_became_active":"2024-09-12T17:40:20.112521+0000","last_became_peered":"2024-09-12T17:40:20.112521+0000","last_unstale":"2024-09-12T19:00:21.311756+0000","last_undegraded":"2024-09-12T19:00:21.311756+0000","last_fullsized":"2024-09-12T19:00:21.311756+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T19:00:21.311545+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T19:00:21.311545+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.311545+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.668351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1090,"num_read_kb":887,"num_write":395,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5850,"num_read_kb":4138,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16272,"num_read_kb":15940,"num_write":16723,"num_write_kb":4884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1758,"ondisk_log_size":1758,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":488,"ondisk_log_size":488,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1567416,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":19029,"num_read_kb":39666,"num_write":15931,"num_write_kb":12049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2066,"ondisk_log_size":2066,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103249,"num_read_kb":86122,"num_write":37396,"num_write_kb":18900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":41238,"num_omap_keys":166,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3959,"ondisk_log_size":3959,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":156029425,"num_objects":414,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":414,"num_whiteouts":0,"num_read":36445,"num_read_kb":1876664,"num_write":72236,"num_write_kb":2152272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":313376768,"data_stored":312058850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3594,"ondisk_log_size":3594,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":197405,"num_write":186,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":186093,"num_write":186,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510409,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304660,"kb_used_data":52740,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94067180,"statfs":{"total":96636764160,"available":96324792320,"internally_reserved":0,"allocated":54005760,"data_stored":52302612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":257948106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510409,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261840,"kb_used_data":27968,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94110000,"statfs":{"total":96636764160,"available":96368640000,"internally_reserved":0,"allocated":28639232,"data_stored":27005259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510408,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140380,"kb_used_data":41228,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94231460,"statfs":{"total":96636764160,"available":96493015040,"internally_reserved":0,"allocated":42217472,"data_stored":40481962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510409,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117828,"kb_used_data":46388,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94254012,"statfs":{"total":96636764160,"available":96516108288,"internally_reserved":0,"allocated":47501312,"data_stored":45836760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510407,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303104,"kb_used_data":51184,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94068736,"statfs":{"total":96636764160,"available":96326385664,"internally_reserved":0,"allocated":52412416,"data_stored":50705649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510407,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133100,"kb_used_data":29788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94238740,"statfs":{"total":96636764160,"available":96500469760,"internally_reserved":0,"allocated":30502912,"data_stored":28881998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510409,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272500,"kb_used_data":56676,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94099340,"statfs":{"total":96636764160,"available":96357724160,"internally_reserved":0,"allocated":58036224,"data_stored":56286500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575816,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92812,"kb_used_data":29756,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94279028,"statfs":{"total":96636764160,"available":96541724672,"internally_reserved":0,"allocated":30470144,"data_stored":28895816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":64551368},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53760000,"data_stored":53550290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26857472,"data_stored":26738240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26849280,"data_stored":26750445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48742400,"data_stored":48559608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":43892736,"data_stored":43694024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":38510592,"data_stored":38336597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25014272,"data_stored":24861531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49750016,"data_stored":49568115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:00:27.196 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.196 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.196 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.196 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.196 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.196 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.196 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.197 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.197 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.197 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.197 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.197 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.197 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.197 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.198 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.198 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.198 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.198 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.198 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.198 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.198 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.198 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.199 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.199 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.199 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.199 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.199 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.199 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.199 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.199 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.199 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.200 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.200 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.200 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.200 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.200 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.200 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.200 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.200 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.200 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.201 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.201 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.201 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.201 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.201 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.201 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.201 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.201 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.201 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.202 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.202 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.202 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.202 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.202 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.202 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.202 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.202 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.202 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.202 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.203 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.203 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.203 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.203 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.203 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.203 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.203 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.203 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.204 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.204 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.204 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.204 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.204 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.204 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.204 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.204 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.204 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.205 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.205 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.205 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.205 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.205 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.205 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.206 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.206 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.206 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.206 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.206 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.206 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.206 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.206 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.206 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.207 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.207 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.207 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.207 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.207 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.207 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.207 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.207 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.208 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.208 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.208 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.208 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.208 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.208 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.208 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.208 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.209 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.209 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.209 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.209 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.209 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.209 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.209 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.209 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.210 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.210 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.210 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.210 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.210 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.210 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.210 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.210 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.210 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.211 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.211 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.211 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.211 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.211 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.211 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.211 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.212 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.212 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.212 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.212 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.212 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.212 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.212 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.213 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.213 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.213 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.213 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.213 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.213 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.214 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.214 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.214 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.214 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.214 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.214 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.214 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.214 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.215 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.215 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.215 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.215 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.215 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.215 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.215 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.216 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.216 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.216 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.216 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.216 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.216 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.216 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.216 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.217 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.217 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.217 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.217 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.217 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.217 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.217 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.217 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.218 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.218 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.218 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.218 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.218 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.218 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.218 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.218 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.219 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.219 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.219 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.219 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.219 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.219 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.219 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.219 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.220 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.220 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.220 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.220 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.220 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.220 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.220 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.221 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.221 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.221 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.221 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.221 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.221 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.221 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.222 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.222 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.222 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.222 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.222 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.222 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.222 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.222 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.223 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.223 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.223 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.223 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.223 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.223 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.223 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.223 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.224 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.224 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.224 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.224 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.224 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.224 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.224 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.225 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.225 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.225 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.225 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.225 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.225 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.225 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.225 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.226 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.226 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.226 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.226 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.226 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.226 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:40:21.099986+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.226 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:40:23.122570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.226 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:40:25.141149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.226 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.227 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.227 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.227 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:40:17.710913+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.227 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:40:19.093091+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:27.227 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:00:47.228 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:00:47.586 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T19:00:47.598 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-09-12T19:00:47.611 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":2680,"stamp":"2024-09-12T19:00:47.354423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158204416,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":183664,"num_read_kb":2408959,"num_write":144741,"num_write_kb":2446021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":729441,"num_omap_keys":1758,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13104,"ondisk_log_size":13104,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1630384,"kb_used_data":335728,"kb_used_omap":12,"kb_used_meta":1294515,"kb_avail":753344336,"statfs":{"total":773094113280,"available":771424600064,"internally_reserved":0,"allocated":343785472,"data_stored":330396556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1325583923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":32890,"num_omap_keys":88,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008265"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639884+0000","last_change":"2024-09-12T18:19:57.854037+0000","last_active":"2024-09-12T18:57:27.639884+0000","last_peered":"2024-09-12T18:57:27.639884+0000","last_clean":"2024-09-12T18:57:27.639884+0000","last_became_active":"2024-09-12T18:19:57.853375+0000","last_became_peered":"2024-09-12T18:19:57.853375+0000","last_unstale":"2024-09-12T18:57:27.639884+0000","last_undegraded":"2024-09-12T18:57:27.639884+0000","last_fullsized":"2024-09-12T18:57:27.639884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:39.334575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:42.681464+0000","last_change":"2024-09-12T17:59:43.011642+0000","last_active":"2024-09-12T18:59:42.681464+0000","last_peered":"2024-09-12T18:59:42.681464+0000","last_clean":"2024-09-12T18:59:42.681464+0000","last_became_active":"2024-09-12T17:59:43.010854+0000","last_became_peered":"2024-09-12T17:59:43.010854+0000","last_unstale":"2024-09-12T18:59:42.681464+0000","last_undegraded":"2024-09-12T18:59:42.681464+0000","last_fullsized":"2024-09-12T18:59:42.681464+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:05.224690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454697+0000","last_change":"2024-09-12T17:59:38.988698+0000","last_active":"2024-09-12T18:57:12.454697+0000","last_peered":"2024-09-12T18:57:12.454697+0000","last_clean":"2024-09-12T18:57:12.454697+0000","last_became_active":"2024-09-12T17:59:38.987739+0000","last_became_peered":"2024-09-12T17:59:38.987739+0000","last_unstale":"2024-09-12T18:57:12.454697+0000","last_undegraded":"2024-09-12T18:57:12.454697+0000","last_fullsized":"2024-09-12T18:57:12.454697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:32.330775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'44","reported_seq":185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:32.488386+0000","last_change":"2024-09-12T17:55:59.359070+0000","last_active":"2024-09-12T18:58:32.488386+0000","last_peered":"2024-09-12T18:58:32.488386+0000","last_clean":"2024-09-12T18:58:32.488386+0000","last_became_active":"2024-09-12T17:55:59.358302+0000","last_became_peered":"2024-09-12T17:55:59.358302+0000","last_unstale":"2024-09-12T18:58:32.488386+0000","last_undegraded":"2024-09-12T18:58:32.488386+0000","last_fullsized":"2024-09-12T18:58:32.488386+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":154,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.602712+0000","last_change":"2024-09-12T19:00:34.602712+0000","last_active":"2024-09-12T19:00:34.602712+0000","last_peered":"2024-09-12T19:00:34.602712+0000","last_clean":"2024-09-12T19:00:34.602712+0000","last_became_active":"2024-09-12T18:19:57.838918+0000","last_became_peered":"2024-09-12T18:19:57.838918+0000","last_unstale":"2024-09-12T19:00:34.602712+0000","last_undegraded":"2024-09-12T19:00:34.602712+0000","last_fullsized":"2024-09-12T19:00:34.602712+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.602418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.602418+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.602418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:58.606445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:42.450552+0000","last_change":"2024-09-12T17:59:43.018636+0000","last_active":"2024-09-12T18:59:42.450552+0000","last_peered":"2024-09-12T18:59:42.450552+0000","last_clean":"2024-09-12T18:59:42.450552+0000","last_became_active":"2024-09-12T17:59:43.005733+0000","last_became_peered":"2024-09-12T17:59:43.005733+0000","last_unstale":"2024-09-12T18:59:42.450552+0000","last_undegraded":"2024-09-12T18:59:42.450552+0000","last_fullsized":"2024-09-12T18:59:42.450552+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.942784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'8","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.448440+0000","last_change":"2024-09-12T19:00:35.448440+0000","last_active":"2024-09-12T19:00:35.448440+0000","last_peered":"2024-09-12T19:00:35.448440+0000","last_clean":"2024-09-12T19:00:35.448440+0000","last_became_active":"2024-09-12T17:59:38.989854+0000","last_became_peered":"2024-09-12T17:59:38.989854+0000","last_unstale":"2024-09-12T19:00:35.448440+0000","last_undegraded":"2024-09-12T19:00:35.448440+0000","last_fullsized":"2024-09-12T19:00:35.448440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T19:00:35.448258+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T19:00:35.448258+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.448258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.753556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8763,"num_write":8,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'34","reported_seq":165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.644434+0000","last_change":"2024-09-12T19:00:26.644434+0000","last_active":"2024-09-12T19:00:26.644434+0000","last_peered":"2024-09-12T19:00:26.644434+0000","last_clean":"2024-09-12T19:00:26.644434+0000","last_became_active":"2024-09-12T17:55:59.367426+0000","last_became_peered":"2024-09-12T17:55:59.367426+0000","last_unstale":"2024-09-12T19:00:26.644434+0000","last_undegraded":"2024-09-12T19:00:26.644434+0000","last_fullsized":"2024-09-12T19:00:26.644434+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-12T19:00:26.644251+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-12T19:00:26.644251+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.644251+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:22.784901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":114,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.427354+0000","last_change":"2024-09-12T18:19:57.849468+0000","last_active":"2024-09-12T18:56:12.427354+0000","last_peered":"2024-09-12T18:56:12.427354+0000","last_clean":"2024-09-12T18:56:12.427354+0000","last_became_active":"2024-09-12T18:19:57.848735+0000","last_became_peered":"2024-09-12T18:19:57.848735+0000","last_unstale":"2024-09-12T18:56:12.427354+0000","last_undegraded":"2024-09-12T18:56:12.427354+0000","last_fullsized":"2024-09-12T18:56:12.427354+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:59.827170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.440489+0000","last_change":"2024-09-12T17:59:43.012346+0000","last_active":"2024-09-12T18:59:59.440489+0000","last_peered":"2024-09-12T18:59:59.440489+0000","last_clean":"2024-09-12T18:59:59.440489+0000","last_became_active":"2024-09-12T17:59:43.011603+0000","last_became_peered":"2024-09-12T17:59:43.011603+0000","last_unstale":"2024-09-12T18:59:59.440489+0000","last_undegraded":"2024-09-12T18:59:59.440489+0000","last_fullsized":"2024-09-12T18:59:59.440489+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.598570+0000","last_change":"2024-09-12T19:00:30.598570+0000","last_active":"2024-09-12T19:00:30.598570+0000","last_peered":"2024-09-12T19:00:30.598570+0000","last_clean":"2024-09-12T19:00:30.598570+0000","last_became_active":"2024-09-12T17:59:38.984980+0000","last_became_peered":"2024-09-12T17:59:38.984980+0000","last_unstale":"2024-09-12T19:00:30.598570+0000","last_undegraded":"2024-09-12T19:00:30.598570+0000","last_fullsized":"2024-09-12T19:00:30.598570+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.598387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.598387+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.598387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.429276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'15","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.454640+0000","last_change":"2024-09-12T17:55:59.357028+0000","last_active":"2024-09-12T18:56:02.454640+0000","last_peered":"2024-09-12T18:56:02.454640+0000","last_clean":"2024-09-12T18:56:02.454640+0000","last_became_active":"2024-09-12T17:55:59.356144+0000","last_became_peered":"2024-09-12T17:55:59.356144+0000","last_unstale":"2024-09-12T18:56:02.454640+0000","last_undegraded":"2024-09-12T18:56:02.454640+0000","last_fullsized":"2024-09-12T18:56:02.454640+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:40.644103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442648+0000","last_change":"2024-09-12T18:19:57.861119+0000","last_active":"2024-09-12T18:56:27.442648+0000","last_peered":"2024-09-12T18:56:27.442648+0000","last_clean":"2024-09-12T18:56:27.442648+0000","last_became_active":"2024-09-12T18:19:57.860464+0000","last_became_peered":"2024-09-12T18:19:57.860464+0000","last_unstale":"2024-09-12T18:56:27.442648+0000","last_undegraded":"2024-09-12T18:56:27.442648+0000","last_fullsized":"2024-09-12T18:56:27.442648+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:37.217624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'4","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.129553+0000","last_change":"2024-09-12T17:59:43.031327+0000","last_active":"2024-09-12T18:59:59.129553+0000","last_peered":"2024-09-12T18:59:59.129553+0000","last_clean":"2024-09-12T18:59:59.129553+0000","last_became_active":"2024-09-12T17:59:43.030545+0000","last_became_peered":"2024-09-12T17:59:43.030545+0000","last_unstale":"2024-09-12T18:59:59.129553+0000","last_undegraded":"2024-09-12T18:59:59.129553+0000","last_fullsized":"2024-09-12T18:59:59.129553+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:11.859283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4192,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.828538+0000","last_change":"2024-09-12T17:59:38.946186+0000","last_active":"2024-09-12T18:58:02.828538+0000","last_peered":"2024-09-12T18:58:02.828538+0000","last_clean":"2024-09-12T18:58:02.828538+0000","last_became_active":"2024-09-12T17:59:38.945373+0000","last_became_peered":"2024-09-12T17:59:38.945373+0000","last_unstale":"2024-09-12T18:58:02.828538+0000","last_undegraded":"2024-09-12T18:58:02.828538+0000","last_fullsized":"2024-09-12T18:58:02.828538+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'6","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437289+0000","last_change":"2024-09-12T17:55:59.340661+0000","last_active":"2024-09-12T18:56:02.437289+0000","last_peered":"2024-09-12T18:56:02.437289+0000","last_clean":"2024-09-12T18:56:02.437289+0000","last_became_active":"2024-09-12T17:55:59.338550+0000","last_became_peered":"2024-09-12T17:55:59.338550+0000","last_unstale":"2024-09-12T18:56:02.437289+0000","last_undegraded":"2024-09-12T18:56:02.437289+0000","last_fullsized":"2024-09-12T18:56:02.437289+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:44.861905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468443+0000","last_change":"2024-09-12T18:19:57.871984+0000","last_active":"2024-09-12T18:58:12.468443+0000","last_peered":"2024-09-12T18:58:12.468443+0000","last_clean":"2024-09-12T18:58:12.468443+0000","last_became_active":"2024-09-12T18:19:57.871345+0000","last_became_peered":"2024-09-12T18:19:57.871345+0000","last_unstale":"2024-09-12T18:58:12.468443+0000","last_undegraded":"2024-09-12T18:58:12.468443+0000","last_fullsized":"2024-09-12T18:58:12.468443+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:52.656125+0000","last_change":"2024-09-12T17:59:43.034960+0000","last_active":"2024-09-12T18:57:52.656125+0000","last_peered":"2024-09-12T18:57:52.656125+0000","last_clean":"2024-09-12T18:57:52.656125+0000","last_became_active":"2024-09-12T17:59:43.034299+0000","last_became_peered":"2024-09-12T17:59:43.034299+0000","last_unstale":"2024-09-12T18:57:52.656125+0000","last_undegraded":"2024-09-12T18:57:52.656125+0000","last_fullsized":"2024-09-12T18:57:52.656125+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'6","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.476565+0000","last_change":"2024-09-12T17:59:38.981877+0000","last_active":"2024-09-12T18:57:42.476565+0000","last_peered":"2024-09-12T18:57:42.476565+0000","last_clean":"2024-09-12T18:57:42.476565+0000","last_became_active":"2024-09-12T17:59:38.976348+0000","last_became_peered":"2024-09-12T17:59:38.976348+0000","last_unstale":"2024-09-12T18:57:42.476565+0000","last_undegraded":"2024-09-12T18:57:42.476565+0000","last_fullsized":"2024-09-12T18:57:42.476565+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'16","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:02.437226+0000","last_change":"2024-09-12T17:55:59.357701+0000","last_active":"2024-09-12T18:56:02.437226+0000","last_peered":"2024-09-12T18:56:02.437226+0000","last_clean":"2024-09-12T18:56:02.437226+0000","last_became_active":"2024-09-12T17:55:59.356970+0000","last_became_peered":"2024-09-12T17:55:59.356970+0000","last_unstale":"2024-09-12T18:56:02.437226+0000","last_undegraded":"2024-09-12T18:56:02.437226+0000","last_fullsized":"2024-09-12T18:56:02.437226+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:46.362725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":58,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.464203+0000","last_change":"2024-09-12T18:19:57.867587+0000","last_active":"2024-09-12T18:57:27.464203+0000","last_peered":"2024-09-12T18:57:27.464203+0000","last_clean":"2024-09-12T18:57:27.464203+0000","last_became_active":"2024-09-12T18:19:57.865319+0000","last_became_peered":"2024-09-12T18:19:57.865319+0000","last_unstale":"2024-09-12T18:57:27.464203+0000","last_undegraded":"2024-09-12T18:57:27.464203+0000","last_fullsized":"2024-09-12T18:57:27.464203+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:03.710006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'2","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.326653+0000","last_change":"2024-09-12T19:00:40.326653+0000","last_active":"2024-09-12T19:00:40.326653+0000","last_peered":"2024-09-12T19:00:40.326653+0000","last_clean":"2024-09-12T19:00:40.326653+0000","last_became_active":"2024-09-12T17:59:56.386194+0000","last_became_peered":"2024-09-12T17:59:56.386194+0000","last_unstale":"2024-09-12T19:00:40.326653+0000","last_undegraded":"2024-09-12T19:00:40.326653+0000","last_fullsized":"2024-09-12T19:00:40.326653+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:40.326477+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:40.326477+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.326477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:00.992353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'9","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.793177+0000","last_change":"2024-09-12T17:59:38.978120+0000","last_active":"2024-09-12T18:59:59.793177+0000","last_peered":"2024-09-12T18:59:59.793177+0000","last_clean":"2024-09-12T18:59:59.793177+0000","last_became_active":"2024-09-12T17:59:38.977316+0000","last_became_peered":"2024-09-12T17:59:38.977316+0000","last_unstale":"2024-09-12T18:59:59.793177+0000","last_undegraded":"2024-09-12T18:59:59.793177+0000","last_fullsized":"2024-09-12T18:59:59.793177+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16386,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'37","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.282096+0000","last_change":"2024-09-12T19:00:34.282096+0000","last_active":"2024-09-12T19:00:34.282096+0000","last_peered":"2024-09-12T19:00:34.282096+0000","last_clean":"2024-09-12T19:00:34.282096+0000","last_became_active":"2024-09-12T17:55:59.366177+0000","last_became_peered":"2024-09-12T17:55:59.366177+0000","last_unstale":"2024-09-12T19:00:34.282096+0000","last_undegraded":"2024-09-12T19:00:34.282096+0000","last_fullsized":"2024-09-12T19:00:34.282096+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-12T19:00:34.281883+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-12T19:00:34.281883+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.281883+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:39.353385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":133,"num_write":64,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457338+0000","last_change":"2024-09-12T18:19:57.844732+0000","last_active":"2024-09-12T18:57:27.457338+0000","last_peered":"2024-09-12T18:57:27.457338+0000","last_clean":"2024-09-12T18:57:27.457338+0000","last_became_active":"2024-09-12T18:19:57.843946+0000","last_became_peered":"2024-09-12T18:19:57.843946+0000","last_unstale":"2024-09-12T18:57:27.457338+0000","last_undegraded":"2024-09-12T18:57:27.457338+0000","last_fullsized":"2024-09-12T18:57:27.457338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:48.999189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.312204+0000","last_change":"2024-09-12T19:00:41.312204+0000","last_active":"2024-09-12T19:00:41.312204+0000","last_peered":"2024-09-12T19:00:41.312204+0000","last_clean":"2024-09-12T19:00:41.312204+0000","last_became_active":"2024-09-12T17:59:43.013293+0000","last_became_peered":"2024-09-12T17:59:43.013293+0000","last_unstale":"2024-09-12T19:00:41.312204+0000","last_undegraded":"2024-09-12T19:00:41.312204+0000","last_fullsized":"2024-09-12T19:00:41.312204+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:41.312027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:41.312027+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.312027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:34.062293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.816755+0000","last_change":"2024-09-12T17:59:38.984819+0000","last_active":"2024-09-12T18:57:12.816755+0000","last_peered":"2024-09-12T18:57:12.816755+0000","last_clean":"2024-09-12T18:57:12.816755+0000","last_became_active":"2024-09-12T17:59:38.984004+0000","last_became_peered":"2024-09-12T17:59:38.984004+0000","last_unstale":"2024-09-12T18:57:12.816755+0000","last_undegraded":"2024-09-12T18:57:12.816755+0000","last_fullsized":"2024-09-12T18:57:12.816755+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:47.953455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'21","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463100+0000","last_change":"2024-09-12T17:55:59.367890+0000","last_active":"2024-09-12T18:56:42.463100+0000","last_peered":"2024-09-12T18:56:42.463100+0000","last_clean":"2024-09-12T18:56:42.463100+0000","last_became_active":"2024-09-12T17:55:59.366968+0000","last_became_peered":"2024-09-12T17:55:59.366968+0000","last_unstale":"2024-09-12T18:56:42.463100+0000","last_undegraded":"2024-09-12T18:56:42.463100+0000","last_fullsized":"2024-09-12T18:56:42.463100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:25.297113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457398+0000","last_change":"2024-09-12T18:19:57.871547+0000","last_active":"2024-09-12T18:57:27.457398+0000","last_peered":"2024-09-12T18:57:27.457398+0000","last_clean":"2024-09-12T18:57:27.457398+0000","last_became_active":"2024-09-12T18:19:57.870750+0000","last_became_peered":"2024-09-12T18:19:57.870750+0000","last_unstale":"2024-09-12T18:57:27.457398+0000","last_undegraded":"2024-09-12T18:57:27.457398+0000","last_fullsized":"2024-09-12T18:57:27.457398+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:27.428422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.454597+0000","last_change":"2024-09-12T17:59:43.027485+0000","last_active":"2024-09-12T18:57:12.454597+0000","last_peered":"2024-09-12T18:57:12.454597+0000","last_clean":"2024-09-12T18:57:12.454597+0000","last_became_active":"2024-09-12T17:59:43.021777+0000","last_became_peered":"2024-09-12T17:59:43.021777+0000","last_unstale":"2024-09-12T18:57:12.454597+0000","last_undegraded":"2024-09-12T18:57:12.454597+0000","last_fullsized":"2024-09-12T18:57:12.454597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:26.307507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:12.469779+0000","last_change":"2024-09-12T17:59:38.990405+0000","last_active":"2024-09-12T18:57:12.469779+0000","last_peered":"2024-09-12T18:57:12.469779+0000","last_clean":"2024-09-12T18:57:12.469779+0000","last_became_active":"2024-09-12T17:59:38.989753+0000","last_became_peered":"2024-09-12T17:59:38.989753+0000","last_unstale":"2024-09-12T18:57:12.469779+0000","last_undegraded":"2024-09-12T18:57:12.469779+0000","last_fullsized":"2024-09-12T18:57:12.469779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:31.519684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'22","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.429649+0000","last_change":"2024-09-12T19:00:34.429649+0000","last_active":"2024-09-12T19:00:34.429649+0000","last_peered":"2024-09-12T19:00:34.429649+0000","last_clean":"2024-09-12T19:00:34.429649+0000","last_became_active":"2024-09-12T17:55:59.329792+0000","last_became_peered":"2024-09-12T17:55:59.329792+0000","last_unstale":"2024-09-12T19:00:34.429649+0000","last_undegraded":"2024-09-12T19:00:34.429649+0000","last_fullsized":"2024-09-12T19:00:34.429649+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-12T19:00:34.429450+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-12T19:00:34.429450+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.429450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:51.008916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.461644+0000","last_change":"2024-09-12T18:19:57.868119+0000","last_active":"2024-09-12T18:57:17.461644+0000","last_peered":"2024-09-12T18:57:17.461644+0000","last_clean":"2024-09-12T18:57:17.461644+0000","last_became_active":"2024-09-12T18:19:57.863600+0000","last_became_peered":"2024-09-12T18:19:57.863600+0000","last_unstale":"2024-09-12T18:57:17.461644+0000","last_undegraded":"2024-09-12T18:57:17.461644+0000","last_fullsized":"2024-09-12T18:57:17.461644+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.347599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.903652+0000","last_change":"2024-09-12T17:59:43.033456+0000","last_active":"2024-09-12T18:59:59.903652+0000","last_peered":"2024-09-12T18:59:59.903652+0000","last_clean":"2024-09-12T18:59:59.903652+0000","last_became_active":"2024-09-12T17:59:43.031016+0000","last_became_peered":"2024-09-12T17:59:43.031016+0000","last_unstale":"2024-09-12T18:59:59.903652+0000","last_undegraded":"2024-09-12T18:59:59.903652+0000","last_fullsized":"2024-09-12T18:59:59.903652+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.660615+0000","last_change":"2024-09-12T17:59:38.966961+0000","last_active":"2024-09-12T18:58:12.660615+0000","last_peered":"2024-09-12T18:58:12.660615+0000","last_clean":"2024-09-12T18:58:12.660615+0000","last_became_active":"2024-09-12T17:59:38.966158+0000","last_became_peered":"2024-09-12T17:59:38.966158+0000","last_unstale":"2024-09-12T18:58:12.660615+0000","last_undegraded":"2024-09-12T18:58:12.660615+0000","last_fullsized":"2024-09-12T18:58:12.660615+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'26","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.460293+0000","last_change":"2024-09-12T17:55:59.367819+0000","last_active":"2024-09-12T18:56:27.460293+0000","last_peered":"2024-09-12T18:56:27.460293+0000","last_clean":"2024-09-12T18:56:27.460293+0000","last_became_active":"2024-09-12T17:55:59.366803+0000","last_became_peered":"2024-09-12T17:55:59.366803+0000","last_unstale":"2024-09-12T18:56:27.460293+0000","last_undegraded":"2024-09-12T18:56:27.460293+0000","last_fullsized":"2024-09-12T18:56:27.460293+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:11.044959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.621793+0000","last_change":"2024-09-12T19:00:33.621793+0000","last_active":"2024-09-12T19:00:33.621793+0000","last_peered":"2024-09-12T19:00:33.621793+0000","last_clean":"2024-09-12T19:00:33.621793+0000","last_became_active":"2024-09-12T18:19:57.845474+0000","last_became_peered":"2024-09-12T18:19:57.845474+0000","last_unstale":"2024-09-12T19:00:33.621793+0000","last_undegraded":"2024-09-12T19:00:33.621793+0000","last_fullsized":"2024-09-12T19:00:33.621793+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:33.621590+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:33.621590+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.621590+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:48.260800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'6","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.903423+0000","last_change":"2024-09-12T17:59:43.034867+0000","last_active":"2024-09-12T18:59:59.903423+0000","last_peered":"2024-09-12T18:59:59.903423+0000","last_clean":"2024-09-12T18:59:59.903423+0000","last_became_active":"2024-09-12T17:59:43.034159+0000","last_became_peered":"2024-09-12T17:59:43.034159+0000","last_unstale":"2024-09-12T18:59:59.903423+0000","last_undegraded":"2024-09-12T18:59:59.903423+0000","last_fullsized":"2024-09-12T18:59:59.903423+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.461041+0000","last_change":"2024-09-12T17:59:38.981580+0000","last_active":"2024-09-12T18:57:42.461041+0000","last_peered":"2024-09-12T18:57:42.461041+0000","last_clean":"2024-09-12T18:57:42.461041+0000","last_became_active":"2024-09-12T17:59:38.980797+0000","last_became_peered":"2024-09-12T17:59:38.980797+0000","last_unstale":"2024-09-12T18:57:42.461041+0000","last_undegraded":"2024-09-12T18:57:42.461041+0000","last_fullsized":"2024-09-12T18:57:42.461041+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'6","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442893+0000","last_change":"2024-09-12T17:55:59.367443+0000","last_active":"2024-09-12T18:56:27.442893+0000","last_peered":"2024-09-12T18:56:27.442893+0000","last_clean":"2024-09-12T18:56:27.442893+0000","last_became_active":"2024-09-12T17:55:59.366679+0000","last_became_peered":"2024-09-12T17:55:59.366679+0000","last_unstale":"2024-09-12T18:56:27.442893+0000","last_undegraded":"2024-09-12T18:56:27.442893+0000","last_fullsized":"2024-09-12T18:56:27.442893+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.004334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.454894+0000","last_change":"2024-09-12T18:19:57.841634+0000","last_active":"2024-09-12T18:57:17.454894+0000","last_peered":"2024-09-12T18:57:17.454894+0000","last_clean":"2024-09-12T18:57:17.454894+0000","last_became_active":"2024-09-12T18:19:57.840855+0000","last_became_peered":"2024-09-12T18:19:57.840855+0000","last_unstale":"2024-09-12T18:57:17.454894+0000","last_undegraded":"2024-09-12T18:57:17.454894+0000","last_fullsized":"2024-09-12T18:57:17.454894+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:43.276958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'4","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:58.805921+0000","last_change":"2024-09-12T17:59:43.029670+0000","last_active":"2024-09-12T18:59:58.805921+0000","last_peered":"2024-09-12T18:59:58.805921+0000","last_clean":"2024-09-12T18:59:58.805921+0000","last_became_active":"2024-09-12T17:59:43.021538+0000","last_became_peered":"2024-09-12T17:59:43.021538+0000","last_unstale":"2024-09-12T18:59:58.805921+0000","last_undegraded":"2024-09-12T18:59:58.805921+0000","last_fullsized":"2024-09-12T18:59:58.805921+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'6","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.608183+0000","last_change":"2024-09-12T19:00:29.608183+0000","last_active":"2024-09-12T19:00:29.608183+0000","last_peered":"2024-09-12T19:00:29.608183+0000","last_clean":"2024-09-12T19:00:29.608183+0000","last_became_active":"2024-09-12T17:59:38.979939+0000","last_became_peered":"2024-09-12T17:59:38.979939+0000","last_unstale":"2024-09-12T19:00:29.608183+0000","last_undegraded":"2024-09-12T19:00:29.608183+0000","last_fullsized":"2024-09-12T19:00:29.608183+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:29.607994+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:29.607994+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.607994+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:24.431667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'36","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.606507+0000","last_change":"2024-09-12T19:00:25.606507+0000","last_active":"2024-09-12T19:00:25.606507+0000","last_peered":"2024-09-12T19:00:25.606507+0000","last_clean":"2024-09-12T19:00:25.606507+0000","last_became_active":"2024-09-12T17:55:59.330570+0000","last_became_peered":"2024-09-12T17:55:59.330570+0000","last_unstale":"2024-09-12T19:00:25.606507+0000","last_undegraded":"2024-09-12T19:00:25.606507+0000","last_fullsized":"2024-09-12T19:00:25.606507+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-12T19:00:25.606314+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-12T19:00:25.606314+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.606314+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:49.274900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":139,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:17.637308+0000","last_change":"2024-09-12T18:19:57.854199+0000","last_active":"2024-09-12T18:57:17.637308+0000","last_peered":"2024-09-12T18:57:17.637308+0000","last_clean":"2024-09-12T18:57:17.637308+0000","last_became_active":"2024-09-12T18:19:57.853269+0000","last_became_peered":"2024-09-12T18:19:57.853269+0000","last_unstale":"2024-09-12T18:57:17.637308+0000","last_undegraded":"2024-09-12T18:57:17.637308+0000","last_fullsized":"2024-09-12T18:57:17.637308+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:58.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:42.823815+0000","last_change":"2024-09-12T17:59:43.022601+0000","last_active":"2024-09-12T18:57:42.823815+0000","last_peered":"2024-09-12T18:57:42.823815+0000","last_clean":"2024-09-12T18:57:42.823815+0000","last_became_active":"2024-09-12T17:59:43.020450+0000","last_became_peered":"2024-09-12T17:59:43.020450+0000","last_unstale":"2024-09-12T18:57:42.823815+0000","last_undegraded":"2024-09-12T18:57:42.823815+0000","last_fullsized":"2024-09-12T18:57:42.823815+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'7","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.865358+0000","last_change":"2024-09-12T17:59:38.983301+0000","last_active":"2024-09-12T18:59:59.865358+0000","last_peered":"2024-09-12T18:59:59.865358+0000","last_clean":"2024-09-12T18:59:59.865358+0000","last_became_active":"2024-09-12T17:59:38.982556+0000","last_became_peered":"2024-09-12T17:59:38.982556+0000","last_unstale":"2024-09-12T18:59:59.865358+0000","last_undegraded":"2024-09-12T18:59:59.865358+0000","last_fullsized":"2024-09-12T18:59:59.865358+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'83","reported_seq":293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:57.450356+0000","last_change":"2024-09-12T17:55:59.364021+0000","last_active":"2024-09-12T18:56:57.450356+0000","last_peered":"2024-09-12T18:56:57.450356+0000","last_clean":"2024-09-12T18:56:57.450356+0000","last_became_active":"2024-09-12T17:55:59.363431+0000","last_became_peered":"2024-09-12T17:55:59.363431+0000","last_unstale":"2024-09-12T18:56:57.450356+0000","last_undegraded":"2024-09-12T18:56:57.450356+0000","last_fullsized":"2024-09-12T18:56:57.450356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:37.240236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":321,"num_write":127,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439374+0000","last_change":"2024-09-12T18:19:57.836599+0000","last_active":"2024-09-12T18:56:12.439374+0000","last_peered":"2024-09-12T18:56:12.439374+0000","last_clean":"2024-09-12T18:56:12.439374+0000","last_became_active":"2024-09-12T18:19:57.835852+0000","last_became_peered":"2024-09-12T18:19:57.835852+0000","last_unstale":"2024-09-12T18:56:12.439374+0000","last_undegraded":"2024-09-12T18:56:12.439374+0000","last_fullsized":"2024-09-12T18:56:12.439374+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:03.387557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.056766+0000","last_change":"2024-09-12T17:59:43.024923+0000","last_active":"2024-09-12T18:59:59.056766+0000","last_peered":"2024-09-12T18:59:59.056766+0000","last_clean":"2024-09-12T18:59:59.056766+0000","last_became_active":"2024-09-12T17:59:43.024103+0000","last_became_peered":"2024-09-12T17:59:43.024103+0000","last_unstale":"2024-09-12T18:59:59.056766+0000","last_undegraded":"2024-09-12T18:59:59.056766+0000","last_fullsized":"2024-09-12T18:59:59.056766+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'3","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.863370+0000","last_change":"2024-09-12T17:59:38.978753+0000","last_active":"2024-09-12T18:59:59.863370+0000","last_peered":"2024-09-12T18:59:59.863370+0000","last_clean":"2024-09-12T18:59:59.863370+0000","last_became_active":"2024-09-12T17:59:38.978126+0000","last_became_peered":"2024-09-12T17:59:38.978126+0000","last_unstale":"2024-09-12T18:59:59.863370+0000","last_undegraded":"2024-09-12T18:59:59.863370+0000","last_fullsized":"2024-09-12T18:59:59.863370+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'82","reported_seq":334,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446848+0000","last_change":"2024-09-12T17:55:59.364464+0000","last_active":"2024-09-12T18:56:42.446848+0000","last_peered":"2024-09-12T18:56:42.446848+0000","last_clean":"2024-09-12T18:56:42.446848+0000","last_became_active":"2024-09-12T17:55:59.363574+0000","last_became_peered":"2024-09-12T17:55:59.363574+0000","last_unstale":"2024-09-12T18:56:42.446848+0000","last_undegraded":"2024-09-12T18:56:42.446848+0000","last_fullsized":"2024-09-12T18:56:42.446848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:45.008706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":530,"num_read_kb":371,"num_write":118,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.456819+0000","last_change":"2024-09-12T18:19:57.847909+0000","last_active":"2024-09-12T18:56:12.456819+0000","last_peered":"2024-09-12T18:56:12.456819+0000","last_clean":"2024-09-12T18:56:12.456819+0000","last_became_active":"2024-09-12T18:19:57.847092+0000","last_became_peered":"2024-09-12T18:19:57.847092+0000","last_unstale":"2024-09-12T18:56:12.456819+0000","last_undegraded":"2024-09-12T18:56:12.456819+0000","last_fullsized":"2024-09-12T18:56:12.456819+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:58.160509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.470997+0000","last_change":"2024-09-12T17:59:43.034884+0000","last_active":"2024-09-12T18:58:02.470997+0000","last_peered":"2024-09-12T18:58:02.470997+0000","last_clean":"2024-09-12T18:58:02.470997+0000","last_became_active":"2024-09-12T17:59:43.034180+0000","last_became_peered":"2024-09-12T17:59:43.034180+0000","last_unstale":"2024-09-12T18:58:02.470997+0000","last_undegraded":"2024-09-12T18:58:02.470997+0000","last_fullsized":"2024-09-12T18:58:02.470997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.440264+0000","last_change":"2024-09-12T17:59:38.976298+0000","last_active":"2024-09-12T18:59:59.440264+0000","last_peered":"2024-09-12T18:59:59.440264+0000","last_clean":"2024-09-12T18:59:59.440264+0000","last_became_active":"2024-09-12T17:59:38.969338+0000","last_became_peered":"2024-09-12T17:59:38.969338+0000","last_unstale":"2024-09-12T18:59:59.440264+0000","last_undegraded":"2024-09-12T18:59:59.440264+0000","last_fullsized":"2024-09-12T18:59:59.440264+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'36","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463141+0000","last_change":"2024-09-12T17:55:59.357946+0000","last_active":"2024-09-12T18:56:42.463141+0000","last_peered":"2024-09-12T18:56:42.463141+0000","last_clean":"2024-09-12T18:56:42.463141+0000","last_became_active":"2024-09-12T17:55:59.357330+0000","last_became_peered":"2024-09-12T17:55:59.357330+0000","last_unstale":"2024-09-12T18:56:42.463141+0000","last_undegraded":"2024-09-12T18:56:42.463141+0000","last_fullsized":"2024-09-12T18:56:42.463141+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.691647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":130,"num_write":63,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473367+0000","last_change":"2024-09-12T18:19:57.840998+0000","last_active":"2024-09-12T18:57:27.473367+0000","last_peered":"2024-09-12T18:57:27.473367+0000","last_clean":"2024-09-12T18:57:27.473367+0000","last_became_active":"2024-09-12T18:19:57.839696+0000","last_became_peered":"2024-09-12T18:19:57.839696+0000","last_unstale":"2024-09-12T18:57:27.473367+0000","last_undegraded":"2024-09-12T18:57:27.473367+0000","last_fullsized":"2024-09-12T18:57:27.473367+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:36.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.056564+0000","last_change":"2024-09-12T17:59:43.031197+0000","last_active":"2024-09-12T18:59:59.056564+0000","last_peered":"2024-09-12T18:59:59.056564+0000","last_clean":"2024-09-12T18:59:59.056564+0000","last_became_active":"2024-09-12T17:59:43.030490+0000","last_became_peered":"2024-09-12T17:59:43.030490+0000","last_unstale":"2024-09-12T18:59:59.056564+0000","last_undegraded":"2024-09-12T18:59:59.056564+0000","last_fullsized":"2024-09-12T18:59:59.056564+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16955,"num_write":6,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"261'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.312246+0000","last_change":"2024-09-12T19:00:38.312246+0000","last_active":"2024-09-12T19:00:38.312246+0000","last_peered":"2024-09-12T19:00:38.312246+0000","last_clean":"2024-09-12T19:00:38.312246+0000","last_became_active":"2024-09-12T17:59:38.990212+0000","last_became_peered":"2024-09-12T17:59:38.990212+0000","last_unstale":"2024-09-12T19:00:38.312246+0000","last_undegraded":"2024-09-12T19:00:38.312246+0000","last_fullsized":"2024-09-12T19:00:38.312246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:38.312048+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:38.312048+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.312048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:46.576970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'28","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.810172+0000","last_change":"2024-09-12T17:55:59.357645+0000","last_active":"2024-09-12T18:56:42.810172+0000","last_peered":"2024-09-12T18:56:42.810172+0000","last_clean":"2024-09-12T18:56:42.810172+0000","last_became_active":"2024-09-12T17:55:59.356838+0000","last_became_peered":"2024-09-12T17:55:59.356838+0000","last_unstale":"2024-09-12T18:56:42.810172+0000","last_undegraded":"2024-09-12T18:56:42.810172+0000","last_fullsized":"2024-09-12T18:56:42.810172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:09.388925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":96,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:12.439310+0000","last_change":"2024-09-12T18:19:57.837873+0000","last_active":"2024-09-12T18:56:12.439310+0000","last_peered":"2024-09-12T18:56:12.439310+0000","last_clean":"2024-09-12T18:56:12.439310+0000","last_became_active":"2024-09-12T18:19:57.837079+0000","last_became_peered":"2024-09-12T18:19:57.837079+0000","last_unstale":"2024-09-12T18:56:12.439310+0000","last_undegraded":"2024-09-12T18:56:12.439310+0000","last_fullsized":"2024-09-12T18:56:12.439310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:28.254760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.331177+0000","last_change":"2024-09-12T19:00:39.331177+0000","last_active":"2024-09-12T19:00:39.331177+0000","last_peered":"2024-09-12T19:00:39.331177+0000","last_clean":"2024-09-12T19:00:39.331177+0000","last_became_active":"2024-09-12T17:59:43.032008+0000","last_became_peered":"2024-09-12T17:59:43.032008+0000","last_unstale":"2024-09-12T19:00:39.331177+0000","last_undegraded":"2024-09-12T19:00:39.331177+0000","last_fullsized":"2024-09-12T19:00:39.331177+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T19:00:39.330975+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T19:00:39.330975+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.330975+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:32.780484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'5","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.010992+0000","last_change":"2024-09-12T17:59:38.982851+0000","last_active":"2024-09-12T18:59:59.010992+0000","last_peered":"2024-09-12T18:59:59.010992+0000","last_clean":"2024-09-12T18:59:59.010992+0000","last_became_active":"2024-09-12T17:59:38.982037+0000","last_became_peered":"2024-09-12T17:59:38.982037+0000","last_unstale":"2024-09-12T18:59:59.010992+0000","last_undegraded":"2024-09-12T18:59:59.010992+0000","last_fullsized":"2024-09-12T18:59:59.010992+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446599+0000","last_change":"2024-09-12T17:55:59.358325+0000","last_active":"2024-09-12T18:56:42.446599+0000","last_peered":"2024-09-12T18:56:42.446599+0000","last_clean":"2024-09-12T18:56:42.446599+0000","last_became_active":"2024-09-12T17:55:59.357659+0000","last_became_peered":"2024-09-12T17:55:59.357659+0000","last_unstale":"2024-09-12T18:56:42.446599+0000","last_undegraded":"2024-09-12T18:56:42.446599+0000","last_fullsized":"2024-09-12T18:56:42.446599+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:47.942214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":69,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.561637+0000","last_change":"2024-09-12T19:00:31.561637+0000","last_active":"2024-09-12T19:00:31.561637+0000","last_peered":"2024-09-12T19:00:31.561637+0000","last_clean":"2024-09-12T19:00:31.561637+0000","last_became_active":"2024-09-12T18:19:57.849682+0000","last_became_peered":"2024-09-12T18:19:57.849682+0000","last_unstale":"2024-09-12T19:00:31.561637+0000","last_undegraded":"2024-09-12T19:00:31.561637+0000","last_fullsized":"2024-09-12T19:00:31.561637+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:31.561428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:31.561428+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.561428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:44.351076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.399273+0000","last_change":"2024-09-12T17:59:43.027722+0000","last_active":"2024-09-12T18:59:59.399273+0000","last_peered":"2024-09-12T18:59:59.399273+0000","last_clean":"2024-09-12T18:59:59.399273+0000","last_became_active":"2024-09-12T17:59:43.026619+0000","last_became_peered":"2024-09-12T17:59:43.026619+0000","last_unstale":"2024-09-12T18:59:59.399273+0000","last_undegraded":"2024-09-12T18:59:59.399273+0000","last_fullsized":"2024-09-12T18:59:59.399273+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.602211+0000","last_change":"2024-09-12T17:59:38.988617+0000","last_active":"2024-09-12T18:59:59.602211+0000","last_peered":"2024-09-12T18:59:59.602211+0000","last_clean":"2024-09-12T18:59:59.602211+0000","last_became_active":"2024-09-12T17:59:38.988028+0000","last_became_peered":"2024-09-12T17:59:38.988028+0000","last_unstale":"2024-09-12T18:59:59.602211+0000","last_undegraded":"2024-09-12T18:59:59.602211+0000","last_fullsized":"2024-09-12T18:59:59.602211+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'56","reported_seq":214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:07.453486+0000","last_change":"2024-09-12T17:55:59.361430+0000","last_active":"2024-09-12T18:57:07.453486+0000","last_peered":"2024-09-12T18:57:07.453486+0000","last_clean":"2024-09-12T18:57:07.453486+0000","last_became_active":"2024-09-12T17:55:59.360197+0000","last_became_peered":"2024-09-12T17:55:59.360197+0000","last_unstale":"2024-09-12T18:57:07.453486+0000","last_undegraded":"2024-09-12T18:57:07.453486+0000","last_fullsized":"2024-09-12T18:57:07.453486+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:56.611826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":199,"num_write":102,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468369+0000","last_change":"2024-09-12T18:19:57.869950+0000","last_active":"2024-09-12T18:58:12.468369+0000","last_peered":"2024-09-12T18:58:12.468369+0000","last_clean":"2024-09-12T18:58:12.468369+0000","last_became_active":"2024-09-12T18:19:57.869302+0000","last_became_peered":"2024-09-12T18:19:57.869302+0000","last_unstale":"2024-09-12T18:58:12.468369+0000","last_undegraded":"2024-09-12T18:58:12.468369+0000","last_fullsized":"2024-09-12T18:58:12.468369+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.903970+0000","last_change":"2024-09-12T17:59:43.034683+0000","last_active":"2024-09-12T18:59:59.903970+0000","last_peered":"2024-09-12T18:59:59.903970+0000","last_clean":"2024-09-12T18:59:59.903970+0000","last_became_active":"2024-09-12T17:59:43.030846+0000","last_became_peered":"2024-09-12T17:59:43.030846+0000","last_unstale":"2024-09-12T18:59:59.903970+0000","last_undegraded":"2024-09-12T18:59:59.903970+0000","last_fullsized":"2024-09-12T18:59:59.903970+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'6","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.608003+0000","last_change":"2024-09-12T19:00:28.608003+0000","last_active":"2024-09-12T19:00:28.608003+0000","last_peered":"2024-09-12T19:00:28.608003+0000","last_clean":"2024-09-12T19:00:28.608003+0000","last_became_active":"2024-09-12T17:59:38.968775+0000","last_became_peered":"2024-09-12T17:59:38.968775+0000","last_unstale":"2024-09-12T19:00:28.608003+0000","last_undegraded":"2024-09-12T19:00:28.608003+0000","last_fullsized":"2024-09-12T19:00:28.608003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:28.607823+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:28.607823+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.607823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:30.368834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":6,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.630374+0000","last_change":"2024-09-12T17:55:59.362984+0000","last_active":"2024-09-12T18:56:47.630374+0000","last_peered":"2024-09-12T18:56:47.630374+0000","last_clean":"2024-09-12T18:56:47.630374+0000","last_became_active":"2024-09-12T17:55:59.358747+0000","last_became_peered":"2024-09-12T17:55:59.358747+0000","last_unstale":"2024-09-12T18:56:47.630374+0000","last_undegraded":"2024-09-12T18:56:47.630374+0000","last_fullsized":"2024-09-12T18:56:47.630374+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:28.675045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.332641+0000","last_change":"2024-09-12T19:00:42.332641+0000","last_active":"2024-09-12T19:00:42.332641+0000","last_peered":"2024-09-12T19:00:42.332641+0000","last_clean":"2024-09-12T19:00:42.332641+0000","last_became_active":"2024-09-12T18:19:57.822958+0000","last_became_peered":"2024-09-12T18:19:57.822958+0000","last_unstale":"2024-09-12T19:00:42.332641+0000","last_undegraded":"2024-09-12T19:00:42.332641+0000","last_fullsized":"2024-09-12T19:00:42.332641+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:42.332460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:42.332460+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.332460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:11.254643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.440332+0000","last_change":"2024-09-12T17:59:43.007833+0000","last_active":"2024-09-12T18:59:59.440332+0000","last_peered":"2024-09-12T18:59:59.440332+0000","last_clean":"2024-09-12T18:59:59.440332+0000","last_became_active":"2024-09-12T17:59:43.006748+0000","last_became_peered":"2024-09-12T17:59:43.006748+0000","last_unstale":"2024-09-12T18:59:59.440332+0000","last_undegraded":"2024-09-12T18:59:59.440332+0000","last_fullsized":"2024-09-12T18:59:59.440332+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.794563+0000","last_change":"2024-09-12T17:59:38.963724+0000","last_active":"2024-09-12T18:59:59.794563+0000","last_peered":"2024-09-12T18:59:59.794563+0000","last_clean":"2024-09-12T18:59:59.794563+0000","last_became_active":"2024-09-12T17:59:38.962944+0000","last_became_peered":"2024-09-12T17:59:38.962944+0000","last_unstale":"2024-09-12T18:59:59.794563+0000","last_undegraded":"2024-09-12T18:59:59.794563+0000","last_fullsized":"2024-09-12T18:59:59.794563+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'30","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.320979+0000","last_change":"2024-09-12T19:00:35.320979+0000","last_active":"2024-09-12T19:00:35.320979+0000","last_peered":"2024-09-12T19:00:35.320979+0000","last_clean":"2024-09-12T19:00:35.320979+0000","last_became_active":"2024-09-12T17:55:59.345735+0000","last_became_peered":"2024-09-12T17:55:59.345735+0000","last_unstale":"2024-09-12T19:00:35.320979+0000","last_undegraded":"2024-09-12T19:00:35.320979+0000","last_fullsized":"2024-09-12T19:00:35.320979+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-12T19:00:35.320795+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-12T19:00:35.320795+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.320795+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:40.138142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.447954+0000","last_change":"2024-09-12T18:19:57.856472+0000","last_active":"2024-09-12T18:56:47.447954+0000","last_peered":"2024-09-12T18:56:47.447954+0000","last_clean":"2024-09-12T18:56:47.447954+0000","last_became_active":"2024-09-12T18:19:57.855728+0000","last_became_peered":"2024-09-12T18:19:57.855728+0000","last_unstale":"2024-09-12T18:56:47.447954+0000","last_undegraded":"2024-09-12T18:56:47.447954+0000","last_fullsized":"2024-09-12T18:56:47.447954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:06.104974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.056763+0000","last_change":"2024-09-12T17:59:43.020154+0000","last_active":"2024-09-12T18:59:59.056763+0000","last_peered":"2024-09-12T18:59:59.056763+0000","last_clean":"2024-09-12T18:59:59.056763+0000","last_became_active":"2024-09-12T17:59:43.019325+0000","last_became_peered":"2024-09-12T17:59:43.019325+0000","last_unstale":"2024-09-12T18:59:59.056763+0000","last_undegraded":"2024-09-12T18:59:59.056763+0000","last_fullsized":"2024-09-12T18:59:59.056763+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.464740+0000","last_change":"2024-09-12T19:00:33.464603+0000","last_active":"2024-09-12T19:00:33.464740+0000","last_peered":"2024-09-12T19:00:33.464740+0000","last_clean":"2024-09-12T19:00:33.464740+0000","last_became_active":"2024-09-12T17:59:38.977733+0000","last_became_peered":"2024-09-12T17:59:38.977733+0000","last_unstale":"2024-09-12T19:00:33.464740+0000","last_undegraded":"2024-09-12T19:00:33.464740+0000","last_fullsized":"2024-09-12T19:00:33.464740+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:33.464414+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:33.464414+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.464414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:30.669642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'50","reported_seq":205,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.648328+0000","last_change":"2024-09-12T19:00:23.648328+0000","last_active":"2024-09-12T19:00:23.648328+0000","last_peered":"2024-09-12T19:00:23.648328+0000","last_clean":"2024-09-12T19:00:23.648328+0000","last_became_active":"2024-09-12T17:55:59.341145+0000","last_became_peered":"2024-09-12T17:55:59.341145+0000","last_unstale":"2024-09-12T19:00:23.648328+0000","last_undegraded":"2024-09-12T19:00:23.648328+0000","last_fullsized":"2024-09-12T19:00:23.648328+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-12T19:00:23.648148+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-12T19:00:23.648148+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.648148+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:09.004260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":177,"num_write":99,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468555+0000","last_change":"2024-09-12T18:19:57.865840+0000","last_active":"2024-09-12T18:58:12.468555+0000","last_peered":"2024-09-12T18:58:12.468555+0000","last_clean":"2024-09-12T18:58:12.468555+0000","last_became_active":"2024-09-12T18:19:57.865311+0000","last_became_peered":"2024-09-12T18:19:57.865311+0000","last_unstale":"2024-09-12T18:58:12.468555+0000","last_undegraded":"2024-09-12T18:58:12.468555+0000","last_fullsized":"2024-09-12T18:58:12.468555+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.397700+0000","last_change":"2024-09-12T17:59:43.030010+0000","last_active":"2024-09-12T18:59:59.397700+0000","last_peered":"2024-09-12T18:59:59.397700+0000","last_clean":"2024-09-12T18:59:59.397700+0000","last_became_active":"2024-09-12T17:59:43.029489+0000","last_became_peered":"2024-09-12T17:59:43.029489+0000","last_unstale":"2024-09-12T18:59:59.397700+0000","last_undegraded":"2024-09-12T18:59:59.397700+0000","last_fullsized":"2024-09-12T18:59:59.397700+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.865506+0000","last_change":"2024-09-12T17:59:38.976141+0000","last_active":"2024-09-12T18:59:59.865506+0000","last_peered":"2024-09-12T18:59:59.865506+0000","last_clean":"2024-09-12T18:59:59.865506+0000","last_became_active":"2024-09-12T17:59:38.965185+0000","last_became_peered":"2024-09-12T17:59:38.965185+0000","last_unstale":"2024-09-12T18:59:59.865506+0000","last_undegraded":"2024-09-12T18:59:59.865506+0000","last_fullsized":"2024-09-12T18:59:59.865506+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'20","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464249+0000","last_change":"2024-09-12T17:55:59.360413+0000","last_active":"2024-09-12T18:56:47.464249+0000","last_peered":"2024-09-12T18:56:47.464249+0000","last_clean":"2024-09-12T18:56:47.464249+0000","last_became_active":"2024-09-12T17:55:59.359849+0000","last_became_peered":"2024-09-12T17:55:59.359849+0000","last_unstale":"2024-09-12T18:56:47.464249+0000","last_undegraded":"2024-09-12T18:56:47.464249+0000","last_fullsized":"2024-09-12T18:56:47.464249+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:05.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:22.470851+0000","last_change":"2024-09-12T18:19:57.855820+0000","last_active":"2024-09-12T18:58:22.470851+0000","last_peered":"2024-09-12T18:58:22.470851+0000","last_clean":"2024-09-12T18:58:22.470851+0000","last_became_active":"2024-09-12T18:19:57.855140+0000","last_became_peered":"2024-09-12T18:19:57.855140+0000","last_unstale":"2024-09-12T18:58:22.470851+0000","last_undegraded":"2024-09-12T18:58:22.470851+0000","last_fullsized":"2024-09-12T18:58:22.470851+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468253+0000","last_change":"2024-09-12T17:59:43.016545+0000","last_active":"2024-09-12T18:58:12.468253+0000","last_peered":"2024-09-12T18:58:12.468253+0000","last_clean":"2024-09-12T18:58:12.468253+0000","last_became_active":"2024-09-12T17:59:43.015273+0000","last_became_peered":"2024-09-12T17:59:43.015273+0000","last_unstale":"2024-09-12T18:58:12.468253+0000","last_undegraded":"2024-09-12T18:58:12.468253+0000","last_fullsized":"2024-09-12T18:58:12.468253+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'11","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.450205+0000","last_change":"2024-09-12T19:00:36.450205+0000","last_active":"2024-09-12T19:00:36.450205+0000","last_peered":"2024-09-12T19:00:36.450205+0000","last_clean":"2024-09-12T19:00:36.450205+0000","last_became_active":"2024-09-12T17:59:38.984684+0000","last_became_peered":"2024-09-12T17:59:38.984684+0000","last_unstale":"2024-09-12T19:00:36.450205+0000","last_undegraded":"2024-09-12T19:00:36.450205+0000","last_fullsized":"2024-09-12T19:00:36.450205+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-12T19:00:36.449928+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-12T19:00:36.449928+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.449928+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:31.664959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6144,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'48","reported_seq":205,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.771972+0000","last_change":"2024-09-12T19:00:41.771972+0000","last_active":"2024-09-12T19:00:41.771972+0000","last_peered":"2024-09-12T19:00:41.771972+0000","last_clean":"2024-09-12T19:00:41.771972+0000","last_became_active":"2024-09-12T17:55:59.346128+0000","last_became_peered":"2024-09-12T17:55:59.346128+0000","last_unstale":"2024-09-12T19:00:41.771972+0000","last_undegraded":"2024-09-12T19:00:41.771972+0000","last_fullsized":"2024-09-12T19:00:41.771972+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-12T19:00:41.771779+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-12T19:00:41.771779+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.771779+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:56.531299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":194,"num_write":71,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468411+0000","last_change":"2024-09-12T18:19:57.851475+0000","last_active":"2024-09-12T18:58:12.468411+0000","last_peered":"2024-09-12T18:58:12.468411+0000","last_clean":"2024-09-12T18:58:12.468411+0000","last_became_active":"2024-09-12T18:19:57.848892+0000","last_became_peered":"2024-09-12T18:19:57.848892+0000","last_unstale":"2024-09-12T18:58:12.468411+0000","last_undegraded":"2024-09-12T18:58:12.468411+0000","last_fullsized":"2024-09-12T18:58:12.468411+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.475789+0000","last_change":"2024-09-12T19:00:42.475789+0000","last_active":"2024-09-12T19:00:42.475789+0000","last_peered":"2024-09-12T19:00:42.475789+0000","last_clean":"2024-09-12T19:00:42.475789+0000","last_became_active":"2024-09-12T17:59:43.034558+0000","last_became_peered":"2024-09-12T17:59:43.034558+0000","last_unstale":"2024-09-12T19:00:42.475789+0000","last_undegraded":"2024-09-12T19:00:42.475789+0000","last_fullsized":"2024-09-12T19:00:42.475789+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:42.475526+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:42.475526+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.475526+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:40.704163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.013586+0000","last_change":"2024-09-12T17:59:38.981757+0000","last_active":"2024-09-12T18:59:59.013586+0000","last_peered":"2024-09-12T18:59:59.013586+0000","last_clean":"2024-09-12T18:59:59.013586+0000","last_became_active":"2024-09-12T17:59:38.973403+0000","last_became_peered":"2024-09-12T17:59:38.973403+0000","last_unstale":"2024-09-12T18:59:59.013586+0000","last_undegraded":"2024-09-12T18:59:59.013586+0000","last_fullsized":"2024-09-12T18:59:59.013586+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'38","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446643+0000","last_change":"2024-09-12T17:55:59.346585+0000","last_active":"2024-09-12T18:56:42.446643+0000","last_peered":"2024-09-12T18:56:42.446643+0000","last_clean":"2024-09-12T18:56:42.446643+0000","last_became_active":"2024-09-12T17:55:59.345382+0000","last_became_peered":"2024-09-12T17:55:59.345382+0000","last_unstale":"2024-09-12T18:56:42.446643+0000","last_undegraded":"2024-09-12T18:56:42.446643+0000","last_fullsized":"2024-09-12T18:56:42.446643+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:18.100800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":134,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.483530+0000","last_change":"2024-09-12T18:19:57.844298+0000","last_active":"2024-09-12T18:58:12.483530+0000","last_peered":"2024-09-12T18:58:12.483530+0000","last_clean":"2024-09-12T18:58:12.483530+0000","last_became_active":"2024-09-12T18:19:57.843489+0000","last_became_peered":"2024-09-12T18:19:57.843489+0000","last_unstale":"2024-09-12T18:58:12.483530+0000","last_undegraded":"2024-09-12T18:58:12.483530+0000","last_fullsized":"2024-09-12T18:58:12.483530+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:27.471966+0000","last_change":"2024-09-12T17:59:43.023323+0000","last_active":"2024-09-12T18:58:27.471966+0000","last_peered":"2024-09-12T18:58:27.471966+0000","last_clean":"2024-09-12T18:58:27.471966+0000","last_became_active":"2024-09-12T17:59:43.022592+0000","last_became_peered":"2024-09-12T17:59:43.022592+0000","last_unstale":"2024-09-12T18:58:27.471966+0000","last_undegraded":"2024-09-12T18:58:27.471966+0000","last_fullsized":"2024-09-12T18:58:27.471966+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'3","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.830684+0000","last_change":"2024-09-12T17:59:38.976388+0000","last_active":"2024-09-12T18:58:12.830684+0000","last_peered":"2024-09-12T18:58:12.830684+0000","last_clean":"2024-09-12T18:58:12.830684+0000","last_became_active":"2024-09-12T17:59:38.975635+0000","last_became_peered":"2024-09-12T17:59:38.975635+0000","last_unstale":"2024-09-12T18:58:12.830684+0000","last_undegraded":"2024-09-12T18:58:12.830684+0000","last_fullsized":"2024-09-12T18:58:12.830684+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'44","reported_seq":188,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.290763+0000","last_change":"2024-09-12T19:00:32.290763+0000","last_active":"2024-09-12T19:00:32.290763+0000","last_peered":"2024-09-12T19:00:32.290763+0000","last_clean":"2024-09-12T19:00:32.290763+0000","last_became_active":"2024-09-12T17:55:59.351492+0000","last_became_peered":"2024-09-12T17:55:59.351492+0000","last_unstale":"2024-09-12T19:00:32.290763+0000","last_undegraded":"2024-09-12T19:00:32.290763+0000","last_fullsized":"2024-09-12T19:00:32.290763+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T19:00:32.290574+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T19:00:32.290574+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.290574+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.374730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":151,"num_write":82,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457255+0000","last_change":"2024-09-12T18:19:57.856229+0000","last_active":"2024-09-12T18:57:27.457255+0000","last_peered":"2024-09-12T18:57:27.457255+0000","last_clean":"2024-09-12T18:57:27.457255+0000","last_became_active":"2024-09-12T18:19:57.855547+0000","last_became_peered":"2024-09-12T18:19:57.855547+0000","last_unstale":"2024-09-12T18:57:27.457255+0000","last_undegraded":"2024-09-12T18:57:27.457255+0000","last_fullsized":"2024-09-12T18:57:27.457255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:07.356723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'12","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.903652+0000","last_change":"2024-09-12T17:59:43.010558+0000","last_active":"2024-09-12T18:59:59.903652+0000","last_peered":"2024-09-12T18:59:59.903652+0000","last_clean":"2024-09-12T18:59:59.903652+0000","last_became_active":"2024-09-12T17:59:43.009629+0000","last_became_peered":"2024-09-12T17:59:43.009629+0000","last_unstale":"2024-09-12T18:59:59.903652+0000","last_undegraded":"2024-09-12T18:59:59.903652+0000","last_fullsized":"2024-09-12T18:59:59.903652+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":22,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'3","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.935682+0000","last_change":"2024-09-12T17:59:38.980397+0000","last_active":"2024-09-12T18:59:59.935682+0000","last_peered":"2024-09-12T18:59:59.935682+0000","last_clean":"2024-09-12T18:59:59.935682+0000","last_became_active":"2024-09-12T17:59:38.979704+0000","last_became_peered":"2024-09-12T17:59:38.979704+0000","last_unstale":"2024-09-12T18:59:59.935682+0000","last_undegraded":"2024-09-12T18:59:59.935682+0000","last_fullsized":"2024-09-12T18:59:59.935682+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.463327+0000","last_change":"2024-09-12T17:55:59.357098+0000","last_active":"2024-09-12T18:56:42.463327+0000","last_peered":"2024-09-12T18:56:42.463327+0000","last_clean":"2024-09-12T18:56:42.463327+0000","last_became_active":"2024-09-12T17:55:59.356402+0000","last_became_peered":"2024-09-12T17:55:59.356402+0000","last_unstale":"2024-09-12T18:56:42.463327+0000","last_undegraded":"2024-09-12T18:56:42.463327+0000","last_fullsized":"2024-09-12T18:56:42.463327+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:21.680579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.639954+0000","last_change":"2024-09-12T18:19:57.860245+0000","last_active":"2024-09-12T18:57:27.639954+0000","last_peered":"2024-09-12T18:57:27.639954+0000","last_clean":"2024-09-12T18:57:27.639954+0000","last_became_active":"2024-09-12T18:19:57.859591+0000","last_became_peered":"2024-09-12T18:19:57.859591+0000","last_unstale":"2024-09-12T18:57:27.639954+0000","last_undegraded":"2024-09-12T18:57:27.639954+0000","last_fullsized":"2024-09-12T18:57:27.639954+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:28.131141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:02.481246+0000","last_change":"2024-09-12T17:59:43.009259+0000","last_active":"2024-09-12T18:58:02.481246+0000","last_peered":"2024-09-12T18:58:02.481246+0000","last_clean":"2024-09-12T18:58:02.481246+0000","last_became_active":"2024-09-12T17:59:43.008547+0000","last_became_peered":"2024-09-12T17:59:43.008547+0000","last_unstale":"2024-09-12T18:58:02.481246+0000","last_undegraded":"2024-09-12T18:58:02.481246+0000","last_fullsized":"2024-09-12T18:58:02.481246+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.602025+0000","last_change":"2024-09-12T19:00:27.602025+0000","last_active":"2024-09-12T19:00:27.602025+0000","last_peered":"2024-09-12T19:00:27.602025+0000","last_clean":"2024-09-12T19:00:27.602025+0000","last_became_active":"2024-09-12T17:59:38.968249+0000","last_became_peered":"2024-09-12T17:59:38.968249+0000","last_unstale":"2024-09-12T19:00:27.602025+0000","last_undegraded":"2024-09-12T19:00:27.602025+0000","last_fullsized":"2024-09-12T19:00:27.602025+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:27.601798+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:27.601798+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.601798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:48.890180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'17","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.300836+0000","last_change":"2024-09-12T19:00:33.300836+0000","last_active":"2024-09-12T19:00:33.300836+0000","last_peered":"2024-09-12T19:00:33.300836+0000","last_clean":"2024-09-12T19:00:33.300836+0000","last_became_active":"2024-09-12T17:55:59.354383+0000","last_became_peered":"2024-09-12T17:55:59.354383+0000","last_unstale":"2024-09-12T19:00:33.300836+0000","last_undegraded":"2024-09-12T19:00:33.300836+0000","last_fullsized":"2024-09-12T19:00:33.300836+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-12T19:00:33.300644+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-12T19:00:33.300644+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.300644+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:06.669201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:07.472021+0000","last_change":"2024-09-12T18:19:57.864592+0000","last_active":"2024-09-12T18:58:07.472021+0000","last_peered":"2024-09-12T18:58:07.472021+0000","last_clean":"2024-09-12T18:58:07.472021+0000","last_became_active":"2024-09-12T18:19:57.858987+0000","last_became_peered":"2024-09-12T18:19:57.858987+0000","last_unstale":"2024-09-12T18:58:07.472021+0000","last_undegraded":"2024-09-12T18:58:07.472021+0000","last_fullsized":"2024-09-12T18:58:07.472021+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'10","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.710130+0000","last_change":"2024-09-12T17:59:43.023426+0000","last_active":"2024-09-12T18:59:59.710130+0000","last_peered":"2024-09-12T18:59:59.710130+0000","last_clean":"2024-09-12T18:59:59.710130+0000","last_became_active":"2024-09-12T17:59:43.022405+0000","last_became_peered":"2024-09-12T17:59:43.022405+0000","last_unstale":"2024-09-12T18:59:59.710130+0000","last_undegraded":"2024-09-12T18:59:59.710130+0000","last_fullsized":"2024-09-12T18:59:59.710130+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12356,"num_write":10,"num_write_kb":8260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.603488+0000","last_change":"2024-09-12T17:59:38.966348+0000","last_active":"2024-09-12T18:59:59.603488+0000","last_peered":"2024-09-12T18:59:59.603488+0000","last_clean":"2024-09-12T18:59:59.603488+0000","last_became_active":"2024-09-12T17:59:38.964439+0000","last_became_peered":"2024-09-12T17:59:38.964439+0000","last_unstale":"2024-09-12T18:59:59.603488+0000","last_undegraded":"2024-09-12T18:59:59.603488+0000","last_fullsized":"2024-09-12T18:59:59.603488+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'113","reported_seq":414,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:42.446927+0000","last_change":"2024-09-12T17:55:59.361437+0000","last_active":"2024-09-12T18:56:42.446927+0000","last_peered":"2024-09-12T18:56:42.446927+0000","last_clean":"2024-09-12T18:56:42.446927+0000","last_became_active":"2024-09-12T17:55:59.360296+0000","last_became_peered":"2024-09-12T17:55:59.360296+0000","last_unstale":"2024-09-12T18:56:42.446927+0000","last_undegraded":"2024-09-12T18:56:42.446927+0000","last_fullsized":"2024-09-12T18:56:42.446927+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:54.893983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":493,"num_write":148,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.819989+0000","last_change":"2024-09-12T18:19:57.871333+0000","last_active":"2024-09-12T18:57:27.819989+0000","last_peered":"2024-09-12T18:57:27.819989+0000","last_clean":"2024-09-12T18:57:27.819989+0000","last_became_active":"2024-09-12T18:19:57.870563+0000","last_became_peered":"2024-09-12T18:19:57.870563+0000","last_unstale":"2024-09-12T18:57:27.819989+0000","last_undegraded":"2024-09-12T18:57:27.819989+0000","last_fullsized":"2024-09-12T18:57:27.819989+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:12.142130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.830788+0000","last_change":"2024-09-12T17:59:43.019692+0000","last_active":"2024-09-12T18:58:12.830788+0000","last_peered":"2024-09-12T18:58:12.830788+0000","last_clean":"2024-09-12T18:58:12.830788+0000","last_became_active":"2024-09-12T17:59:43.018869+0000","last_became_peered":"2024-09-12T17:59:43.018869+0000","last_unstale":"2024-09-12T18:58:12.830788+0000","last_undegraded":"2024-09-12T18:58:12.830788+0000","last_fullsized":"2024-09-12T18:58:12.830788+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.212567+0000","last_change":"2024-09-12T17:59:38.989030+0000","last_active":"2024-09-12T18:59:59.212567+0000","last_peered":"2024-09-12T18:59:59.212567+0000","last_clean":"2024-09-12T18:59:59.212567+0000","last_became_active":"2024-09-12T17:59:38.988237+0000","last_became_peered":"2024-09-12T17:59:38.988237+0000","last_unstale":"2024-09-12T18:59:59.212567+0000","last_undegraded":"2024-09-12T18:59:59.212567+0000","last_fullsized":"2024-09-12T18:59:59.212567+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'6","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.391627+0000","last_change":"2024-09-12T19:00:38.391627+0000","last_active":"2024-09-12T19:00:38.391627+0000","last_peered":"2024-09-12T19:00:38.391627+0000","last_clean":"2024-09-12T19:00:38.391627+0000","last_became_active":"2024-09-12T17:55:59.353823+0000","last_became_peered":"2024-09-12T17:55:59.353823+0000","last_unstale":"2024-09-12T19:00:38.391627+0000","last_undegraded":"2024-09-12T19:00:38.391627+0000","last_fullsized":"2024-09-12T19:00:38.391627+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:38.391331+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:38.391331+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.391331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.195971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.608185+0000","last_change":"2024-09-12T19:00:32.608185+0000","last_active":"2024-09-12T19:00:32.608185+0000","last_peered":"2024-09-12T19:00:32.608185+0000","last_clean":"2024-09-12T19:00:32.608185+0000","last_became_active":"2024-09-12T18:19:57.839756+0000","last_became_peered":"2024-09-12T18:19:57.839756+0000","last_unstale":"2024-09-12T19:00:32.608185+0000","last_undegraded":"2024-09-12T19:00:32.608185+0000","last_fullsized":"2024-09-12T19:00:32.608185+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:32.608001+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:32.608001+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.608001+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:41.725203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.435243+0000","last_change":"2024-09-12T19:00:41.435243+0000","last_active":"2024-09-12T19:00:41.435243+0000","last_peered":"2024-09-12T19:00:41.435243+0000","last_clean":"2024-09-12T19:00:41.435243+0000","last_became_active":"2024-09-12T17:59:43.033049+0000","last_became_peered":"2024-09-12T17:59:43.033049+0000","last_unstale":"2024-09-12T19:00:41.435243+0000","last_undegraded":"2024-09-12T19:00:41.435243+0000","last_fullsized":"2024-09-12T19:00:41.435243+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:41.435048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:41.435048+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.435048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.077538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'9","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:57.464697+0000","last_change":"2024-09-12T17:59:38.986578+0000","last_active":"2024-09-12T18:57:57.464697+0000","last_peered":"2024-09-12T18:57:57.464697+0000","last_clean":"2024-09-12T18:57:57.464697+0000","last_became_active":"2024-09-12T17:59:38.985971+0000","last_became_peered":"2024-09-12T17:59:38.985971+0000","last_unstale":"2024-09-12T18:57:57.464697+0000","last_undegraded":"2024-09-12T18:57:57.464697+0000","last_fullsized":"2024-09-12T18:57:57.464697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:41.717343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'13","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.262143+0000","last_change":"2024-09-12T19:00:42.262143+0000","last_active":"2024-09-12T19:00:42.262143+0000","last_peered":"2024-09-12T19:00:42.262143+0000","last_clean":"2024-09-12T19:00:42.262143+0000","last_became_active":"2024-09-12T17:55:59.352474+0000","last_became_peered":"2024-09-12T17:55:59.352474+0000","last_unstale":"2024-09-12T19:00:42.262143+0000","last_undegraded":"2024-09-12T19:00:42.262143+0000","last_fullsized":"2024-09-12T19:00:42.262143+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T19:00:42.261969+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T19:00:42.261969+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.261969+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:15:23.236744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:47.464409+0000","last_change":"2024-09-12T18:19:57.847713+0000","last_active":"2024-09-12T18:56:47.464409+0000","last_peered":"2024-09-12T18:56:47.464409+0000","last_clean":"2024-09-12T18:56:47.464409+0000","last_became_active":"2024-09-12T18:19:57.846907+0000","last_became_peered":"2024-09-12T18:19:57.846907+0000","last_unstale":"2024-09-12T18:56:47.464409+0000","last_undegraded":"2024-09-12T18:56:47.464409+0000","last_fullsized":"2024-09-12T18:56:47.464409+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:30.600770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'12","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:52.683786+0000","last_change":"2024-09-12T17:59:43.023811+0000","last_active":"2024-09-12T18:59:52.683786+0000","last_peered":"2024-09-12T18:59:52.683786+0000","last_clean":"2024-09-12T18:59:52.683786+0000","last_became_active":"2024-09-12T17:59:43.022991+0000","last_became_peered":"2024-09-12T17:59:43.022991+0000","last_unstale":"2024-09-12T18:59:52.683786+0000","last_undegraded":"2024-09-12T18:59:52.683786+0000","last_fullsized":"2024-09-12T18:59:52.683786+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:41.803212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20482,"num_write":22,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.863323+0000","last_change":"2024-09-12T17:59:38.990278+0000","last_active":"2024-09-12T18:59:59.863323+0000","last_peered":"2024-09-12T18:59:59.863323+0000","last_clean":"2024-09-12T18:59:59.863323+0000","last_became_active":"2024-09-12T17:59:38.989530+0000","last_became_peered":"2024-09-12T17:59:38.989530+0000","last_unstale":"2024-09-12T18:59:59.863323+0000","last_undegraded":"2024-09-12T18:59:59.863323+0000","last_fullsized":"2024-09-12T18:59:59.863323+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:37.920488+0000","last_clean_scrub_stamp":"2024-09-12T17:59:37.920488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'9","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:32.835056+0000","last_change":"2024-09-12T17:55:59.345043+0000","last_active":"2024-09-12T18:58:32.835056+0000","last_peered":"2024-09-12T18:58:32.835056+0000","last_clean":"2024-09-12T18:58:32.835056+0000","last_became_active":"2024-09-12T17:55:59.344251+0000","last_became_peered":"2024-09-12T17:55:59.344251+0000","last_unstale":"2024-09-12T18:58:32.835056+0000","last_undegraded":"2024-09-12T18:58:32.835056+0000","last_fullsized":"2024-09-12T18:58:32.835056+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:55:58.298802+0000","last_clean_scrub_stamp":"2024-09-12T17:55:58.298802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.473350+0000","last_change":"2024-09-12T18:19:57.848079+0000","last_active":"2024-09-12T18:57:27.473350+0000","last_peered":"2024-09-12T18:57:27.473350+0000","last_clean":"2024-09-12T18:57:27.473350+0000","last_became_active":"2024-09-12T18:19:57.847330+0000","last_became_peered":"2024-09-12T18:19:57.847330+0000","last_unstale":"2024-09-12T18:57:27.473350+0000","last_undegraded":"2024-09-12T18:57:27.473350+0000","last_fullsized":"2024-09-12T18:57:27.473350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:06.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.297210+0000","last_change":"2024-09-12T19:00:36.297210+0000","last_active":"2024-09-12T19:00:36.297210+0000","last_peered":"2024-09-12T19:00:36.297210+0000","last_clean":"2024-09-12T19:00:36.297210+0000","last_became_active":"2024-09-12T17:59:43.028305+0000","last_became_peered":"2024-09-12T17:59:43.028305+0000","last_unstale":"2024-09-12T19:00:36.297210+0000","last_undegraded":"2024-09-12T19:00:36.297210+0000","last_fullsized":"2024-09-12T19:00:36.297210+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:00:36.297030+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:00:36.297030+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.297030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:06.922209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.423999+0000","last_change":"2024-09-12T19:00:39.423999+0000","last_active":"2024-09-12T19:00:39.423999+0000","last_peered":"2024-09-12T19:00:39.423999+0000","last_clean":"2024-09-12T19:00:39.423999+0000","last_became_active":"2024-09-12T17:59:38.986062+0000","last_became_peered":"2024-09-12T17:59:38.986062+0000","last_unstale":"2024-09-12T19:00:39.423999+0000","last_undegraded":"2024-09-12T19:00:39.423999+0000","last_fullsized":"2024-09-12T19:00:39.423999+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T19:00:39.423814+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T19:00:39.423814+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.423814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:26.741012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'31","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.308812+0000","last_change":"2024-09-12T19:00:30.308634+0000","last_active":"2024-09-12T19:00:30.308812+0000","last_peered":"2024-09-12T19:00:30.308812+0000","last_clean":"2024-09-12T19:00:30.308812+0000","last_became_active":"2024-09-12T17:55:59.345469+0000","last_became_peered":"2024-09-12T17:55:59.345469+0000","last_unstale":"2024-09-12T19:00:30.308812+0000","last_undegraded":"2024-09-12T19:00:30.308812+0000","last_fullsized":"2024-09-12T19:00:30.308812+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'31","last_scrub_stamp":"2024-09-12T19:00:30.308449+0000","last_deep_scrub":"261'31","last_deep_scrub_stamp":"2024-09-12T19:00:30.308449+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.308449+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:35.666105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":47,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:37.459721+0000","last_change":"2024-09-12T18:19:57.845031+0000","last_active":"2024-09-12T18:57:37.459721+0000","last_peered":"2024-09-12T18:57:37.459721+0000","last_clean":"2024-09-12T18:57:37.459721+0000","last_became_active":"2024-09-12T18:19:57.844161+0000","last_became_peered":"2024-09-12T18:19:57.844161+0000","last_unstale":"2024-09-12T18:57:37.459721+0000","last_undegraded":"2024-09-12T18:57:37.459721+0000","last_fullsized":"2024-09-12T18:57:37.459721+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:42.398579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.710565+0000","last_change":"2024-09-12T17:59:43.020614+0000","last_active":"2024-09-12T18:59:59.710565+0000","last_peered":"2024-09-12T18:59:59.710565+0000","last_clean":"2024-09-12T18:59:59.710565+0000","last_became_active":"2024-09-12T17:59:43.019274+0000","last_became_peered":"2024-09-12T17:59:43.019274+0000","last_unstale":"2024-09-12T18:59:59.710565+0000","last_undegraded":"2024-09-12T18:59:59.710565+0000","last_fullsized":"2024-09-12T18:59:59.710565+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.292917+0000","last_change":"2024-09-12T19:00:37.292917+0000","last_active":"2024-09-12T19:00:37.292917+0000","last_peered":"2024-09-12T19:00:37.292917+0000","last_clean":"2024-09-12T19:00:37.292917+0000","last_became_active":"2024-09-12T17:59:38.968500+0000","last_became_peered":"2024-09-12T17:59:38.968500+0000","last_unstale":"2024-09-12T19:00:37.292917+0000","last_undegraded":"2024-09-12T19:00:37.292917+0000","last_fullsized":"2024-09-12T19:00:37.292917+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T19:00:37.292713+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T19:00:37.292713+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.292713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:31.367201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1072,"num_write":18,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.785035+0000","last_change":"2024-09-12T19:00:40.785035+0000","last_active":"2024-09-12T19:00:40.785035+0000","last_peered":"2024-09-12T19:00:40.785035+0000","last_clean":"2024-09-12T19:00:40.785035+0000","last_became_active":"2024-09-12T17:55:59.354620+0000","last_became_peered":"2024-09-12T17:55:59.354620+0000","last_unstale":"2024-09-12T19:00:40.785035+0000","last_undegraded":"2024-09-12T19:00:40.785035+0000","last_fullsized":"2024-09-12T19:00:40.785035+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-12T19:00:40.784849+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-12T19:00:40.784849+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.784849+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:26.840696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":145,"num_write":78,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'397","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.897784+0000","last_change":"2024-09-12T19:00:18.897784+0000","last_active":"2024-09-12T19:00:18.897784+0000","last_peered":"2024-09-12T19:00:18.897784+0000","last_clean":"2024-09-12T19:00:18.897784+0000","last_became_active":"2024-09-12T17:40:18.784159+0000","last_became_peered":"2024-09-12T17:40:18.784159+0000","last_unstale":"2024-09-12T19:00:18.897784+0000","last_undegraded":"2024-09-12T19:00:18.897784+0000","last_fullsized":"2024-09-12T19:00:18.897784+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:18.897555+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:18.897555+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.897555+0000","objects_scrubbed":10,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:40.787061+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813897,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":527,"num_read_kb":37913,"num_write":1207,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'93","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.361475+0000","last_change":"2024-09-12T19:00:22.361348+0000","last_active":"2024-09-12T19:00:22.361475+0000","last_peered":"2024-09-12T19:00:22.361475+0000","last_clean":"2024-09-12T19:00:22.361475+0000","last_became_active":"2024-09-12T17:40:20.138680+0000","last_became_peered":"2024-09-12T17:40:20.138680+0000","last_unstale":"2024-09-12T19:00:22.361475+0000","last_undegraded":"2024-09-12T19:00:22.361475+0000","last_fullsized":"2024-09-12T19:00:22.361475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-12T19:00:22.361173+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-12T19:00:22.361173+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.361173+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:49.691123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'329","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.454755+0000","last_change":"2024-09-12T19:00:12.454755+0000","last_active":"2024-09-12T19:00:12.454755+0000","last_peered":"2024-09-12T19:00:12.454755+0000","last_clean":"2024-09-12T19:00:12.454755+0000","last_became_active":"2024-09-12T17:40:18.761214+0000","last_became_peered":"2024-09-12T17:40:18.761214+0000","last_unstale":"2024-09-12T19:00:12.454755+0000","last_undegraded":"2024-09-12T19:00:12.454755+0000","last_fullsized":"2024-09-12T19:00:12.454755+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T19:00:12.454463+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T19:00:12.454463+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.454463+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:45.994067+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4802709,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":37097,"num_write":958,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'256","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.944120+0000","last_change":"2024-09-12T19:00:22.944120+0000","last_active":"2024-09-12T19:00:22.944120+0000","last_peered":"2024-09-12T19:00:22.944120+0000","last_clean":"2024-09-12T19:00:22.944120+0000","last_became_active":"2024-09-12T17:40:20.133791+0000","last_became_peered":"2024-09-12T17:40:20.133791+0000","last_unstale":"2024-09-12T19:00:22.944120+0000","last_undegraded":"2024-09-12T19:00:22.944120+0000","last_fullsized":"2024-09-12T19:00:22.944120+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'256","last_scrub_stamp":"2024-09-12T19:00:22.943873+0000","last_deep_scrub":"264'256","last_deep_scrub_stamp":"2024-09-12T19:00:22.943873+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.943873+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:13.423617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1087,"num_read_kb":867,"num_write":420,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'407","reported_seq":1075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.350302+0000","last_change":"2024-09-12T19:00:12.350302+0000","last_active":"2024-09-12T19:00:12.350302+0000","last_peered":"2024-09-12T19:00:12.350302+0000","last_clean":"2024-09-12T19:00:12.350302+0000","last_became_active":"2024-09-12T17:40:18.755606+0000","last_became_peered":"2024-09-12T17:40:18.755606+0000","last_unstale":"2024-09-12T19:00:12.350302+0000","last_undegraded":"2024-09-12T19:00:12.350302+0000","last_fullsized":"2024-09-12T19:00:12.350302+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T19:00:12.350095+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T19:00:12.350095+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.350095+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:10.932589+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457546,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":570,"num_read_kb":26533,"num_write":1277,"num_write_kb":46376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'130","reported_seq":768,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.867775+0000","last_change":"2024-09-12T19:00:24.867775+0000","last_active":"2024-09-12T19:00:24.867775+0000","last_peered":"2024-09-12T19:00:24.867775+0000","last_clean":"2024-09-12T19:00:24.867775+0000","last_became_active":"2024-09-12T17:40:20.130123+0000","last_became_peered":"2024-09-12T17:40:20.130123+0000","last_unstale":"2024-09-12T19:00:24.867775+0000","last_undegraded":"2024-09-12T19:00:24.867775+0000","last_fullsized":"2024-09-12T19:00:24.867775+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T19:00:24.867600+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T19:00:24.867600+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.867600+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:11.063827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":589,"num_read_kb":499,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'345","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.351078+0000","last_change":"2024-09-12T19:00:17.350905+0000","last_active":"2024-09-12T19:00:17.351078+0000","last_peered":"2024-09-12T19:00:17.351078+0000","last_clean":"2024-09-12T19:00:17.351078+0000","last_became_active":"2024-09-12T17:40:18.768170+0000","last_became_peered":"2024-09-12T17:40:18.768170+0000","last_unstale":"2024-09-12T19:00:17.351078+0000","last_undegraded":"2024-09-12T19:00:17.351078+0000","last_fullsized":"2024-09-12T19:00:17.351078+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-12T19:00:17.350715+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-12T19:00:17.350715+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.350715+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.875766+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388668,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":59190,"num_write":1207,"num_write_kb":44467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'100","reported_seq":709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.333064+0000","last_change":"2024-09-12T19:00:21.332900+0000","last_active":"2024-09-12T19:00:21.333064+0000","last_peered":"2024-09-12T19:00:21.333064+0000","last_clean":"2024-09-12T19:00:21.333064+0000","last_became_active":"2024-09-12T17:40:20.114923+0000","last_became_peered":"2024-09-12T17:40:20.114923+0000","last_unstale":"2024-09-12T19:00:21.333064+0000","last_undegraded":"2024-09-12T19:00:21.333064+0000","last_fullsized":"2024-09-12T19:00:21.333064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T19:00:21.332717+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T19:00:21.332717+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.332717+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:04.580548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":408,"num_write":151,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'318","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.885850+0000","last_change":"2024-09-12T19:00:14.885692+0000","last_active":"2024-09-12T19:00:14.885850+0000","last_peered":"2024-09-12T19:00:14.885850+0000","last_clean":"2024-09-12T19:00:14.885850+0000","last_became_active":"2024-09-12T17:40:18.778991+0000","last_became_peered":"2024-09-12T17:40:18.778991+0000","last_unstale":"2024-09-12T19:00:14.885850+0000","last_undegraded":"2024-09-12T19:00:14.885850+0000","last_fullsized":"2024-09-12T19:00:14.885850+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-12T19:00:14.885480+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-12T19:00:14.885480+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.885480+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:10.907616+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311787,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":19945,"num_write":986,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'100","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.464947+0000","last_change":"2024-09-12T19:00:18.464796+0000","last_active":"2024-09-12T19:00:18.464947+0000","last_peered":"2024-09-12T19:00:18.464947+0000","last_clean":"2024-09-12T19:00:18.464947+0000","last_became_active":"2024-09-12T17:40:20.127556+0000","last_became_peered":"2024-09-12T17:40:20.127556+0000","last_unstale":"2024-09-12T19:00:18.464947+0000","last_undegraded":"2024-09-12T19:00:18.464947+0000","last_fullsized":"2024-09-12T19:00:18.464947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T19:00:18.464562+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T19:00:18.464562+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.464562+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:00.473679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":458,"num_read_kb":378,"num_write":157,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'384","reported_seq":1012,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.311697+0000","last_change":"2024-09-12T19:00:16.311566+0000","last_active":"2024-09-12T19:00:16.311697+0000","last_peered":"2024-09-12T19:00:16.311697+0000","last_clean":"2024-09-12T19:00:16.311697+0000","last_became_active":"2024-09-12T17:40:18.760958+0000","last_became_peered":"2024-09-12T17:40:18.760958+0000","last_unstale":"2024-09-12T19:00:16.311697+0000","last_undegraded":"2024-09-12T19:00:16.311697+0000","last_fullsized":"2024-09-12T19:00:16.311697+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-12T19:00:16.311345+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-12T19:00:16.311345+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.311345+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:52.751993+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":8666,"num_write":1215,"num_write_kb":27182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'123","reported_seq":763,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.886918+0000","last_change":"2024-09-12T19:00:25.886918+0000","last_active":"2024-09-12T19:00:25.886918+0000","last_peered":"2024-09-12T19:00:25.886918+0000","last_clean":"2024-09-12T19:00:25.886918+0000","last_became_active":"2024-09-12T17:40:20.132985+0000","last_became_peered":"2024-09-12T17:40:20.132985+0000","last_unstale":"2024-09-12T19:00:25.886918+0000","last_undegraded":"2024-09-12T19:00:25.886918+0000","last_fullsized":"2024-09-12T19:00:25.886918+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-09-12T19:00:25.886728+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-09-12T19:00:25.886728+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.886728+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:06.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":462,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'403","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.903729+0000","last_change":"2024-09-12T19:00:17.903504+0000","last_active":"2024-09-12T19:00:17.903729+0000","last_peered":"2024-09-12T19:00:17.903729+0000","last_clean":"2024-09-12T19:00:17.903729+0000","last_became_active":"2024-09-12T17:40:18.761056+0000","last_became_peered":"2024-09-12T17:40:18.761056+0000","last_unstale":"2024-09-12T19:00:17.903729+0000","last_undegraded":"2024-09-12T19:00:17.903729+0000","last_fullsized":"2024-09-12T19:00:17.903729+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'403","last_scrub_stamp":"2024-09-12T19:00:17.903214+0000","last_deep_scrub":"264'403","last_deep_scrub_stamp":"2024-09-12T19:00:17.903214+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.903214+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:06.436732+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":74800,"num_write":1233,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'208","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.298403+0000","last_change":"2024-09-12T19:00:25.298403+0000","last_active":"2024-09-12T19:00:25.298403+0000","last_peered":"2024-09-12T19:00:25.298403+0000","last_clean":"2024-09-12T19:00:25.298403+0000","last_became_active":"2024-09-12T17:40:20.134441+0000","last_became_peered":"2024-09-12T17:40:20.134441+0000","last_unstale":"2024-09-12T19:00:25.298403+0000","last_undegraded":"2024-09-12T19:00:25.298403+0000","last_fullsized":"2024-09-12T19:00:25.298403+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T19:00:25.298122+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T19:00:25.298122+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.298122+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:23.155447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":897,"num_read_kb":734,"num_write":311,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'373","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.647147+0000","last_change":"2024-09-12T19:00:11.647011+0000","last_active":"2024-09-12T19:00:11.647147+0000","last_peered":"2024-09-12T19:00:11.647147+0000","last_clean":"2024-09-12T19:00:11.647147+0000","last_became_active":"2024-09-12T17:40:18.773843+0000","last_became_peered":"2024-09-12T17:40:18.773843+0000","last_unstale":"2024-09-12T19:00:11.647147+0000","last_undegraded":"2024-09-12T19:00:11.647147+0000","last_fullsized":"2024-09-12T19:00:11.647147+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T19:00:11.646768+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T19:00:11.646768+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.646768+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:20.752287+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":629,"num_read_kb":30255,"num_write":1158,"num_write_kb":52642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'233","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.570316+0000","last_change":"2024-09-12T19:00:15.570316+0000","last_active":"2024-09-12T19:00:15.570316+0000","last_peered":"2024-09-12T19:00:15.570316+0000","last_clean":"2024-09-12T19:00:15.570316+0000","last_became_active":"2024-09-12T17:40:20.120891+0000","last_became_peered":"2024-09-12T17:40:20.120891+0000","last_unstale":"2024-09-12T19:00:15.570316+0000","last_undegraded":"2024-09-12T19:00:15.570316+0000","last_fullsized":"2024-09-12T19:00:15.570316+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-12T19:00:15.570121+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-12T19:00:15.570121+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.570121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:40.079950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":858,"num_write":384,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'192","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.856800+0000","last_change":"2024-09-12T19:00:22.856800+0000","last_active":"2024-09-12T19:00:22.856800+0000","last_peered":"2024-09-12T19:00:22.856800+0000","last_clean":"2024-09-12T19:00:22.856800+0000","last_became_active":"2024-09-12T17:40:20.132466+0000","last_became_peered":"2024-09-12T17:40:20.132466+0000","last_unstale":"2024-09-12T19:00:22.856800+0000","last_undegraded":"2024-09-12T19:00:22.856800+0000","last_fullsized":"2024-09-12T19:00:22.856800+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-09-12T19:00:22.856632+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-09-12T19:00:22.856632+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.856632+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:33.052539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":674,"num_write":287,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'340","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.947779+0000","last_change":"2024-09-12T19:00:12.947508+0000","last_active":"2024-09-12T19:00:12.947779+0000","last_peered":"2024-09-12T19:00:12.947779+0000","last_clean":"2024-09-12T19:00:12.947779+0000","last_became_active":"2024-09-12T17:40:18.783282+0000","last_became_peered":"2024-09-12T17:40:18.783282+0000","last_unstale":"2024-09-12T19:00:12.947779+0000","last_undegraded":"2024-09-12T19:00:12.947779+0000","last_fullsized":"2024-09-12T19:00:12.947779+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-12T19:00:12.947254+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-12T19:00:12.947254+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.947254+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:14.588512+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":17792,"num_write":1019,"num_write_kb":32630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'129","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.953874+0000","last_change":"2024-09-12T19:00:20.953874+0000","last_active":"2024-09-12T19:00:20.953874+0000","last_peered":"2024-09-12T19:00:20.953874+0000","last_clean":"2024-09-12T19:00:20.953874+0000","last_became_active":"2024-09-12T17:40:20.143471+0000","last_became_peered":"2024-09-12T17:40:20.143471+0000","last_unstale":"2024-09-12T19:00:20.953874+0000","last_undegraded":"2024-09-12T19:00:20.953874+0000","last_fullsized":"2024-09-12T19:00:20.953874+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T19:00:20.953686+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T19:00:20.953686+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.953686+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:56.936299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":544,"num_read_kb":441,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'314","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.428631+0000","last_change":"2024-09-12T19:00:13.428631+0000","last_active":"2024-09-12T19:00:13.428631+0000","last_peered":"2024-09-12T19:00:13.428631+0000","last_clean":"2024-09-12T19:00:13.428631+0000","last_became_active":"2024-09-12T17:40:18.756814+0000","last_became_peered":"2024-09-12T17:40:18.756814+0000","last_unstale":"2024-09-12T19:00:13.428631+0000","last_undegraded":"2024-09-12T19:00:13.428631+0000","last_fullsized":"2024-09-12T19:00:13.428631+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T19:00:13.428455+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T19:00:13.428455+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.428455+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:27.159173+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048617,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":410,"num_read_kb":9611,"num_write":991,"num_write_kb":28982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'86","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.320660+0000","last_change":"2024-09-12T19:00:20.320660+0000","last_active":"2024-09-12T19:00:20.320660+0000","last_peered":"2024-09-12T19:00:20.320660+0000","last_clean":"2024-09-12T19:00:20.320660+0000","last_became_active":"2024-09-12T17:40:20.124104+0000","last_became_peered":"2024-09-12T17:40:20.124104+0000","last_unstale":"2024-09-12T19:00:20.320660+0000","last_undegraded":"2024-09-12T19:00:20.320660+0000","last_fullsized":"2024-09-12T19:00:20.320660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T19:00:20.320383+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T19:00:20.320383+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.320383+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:50.248150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":294,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'414","reported_seq":1113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.412693+0000","last_change":"2024-09-12T19:00:11.412693+0000","last_active":"2024-09-12T19:00:11.412693+0000","last_peered":"2024-09-12T19:00:11.412693+0000","last_clean":"2024-09-12T19:00:11.412693+0000","last_became_active":"2024-09-12T17:40:18.773787+0000","last_became_peered":"2024-09-12T17:40:18.773787+0000","last_unstale":"2024-09-12T19:00:11.412693+0000","last_undegraded":"2024-09-12T19:00:11.412693+0000","last_fullsized":"2024-09-12T19:00:11.412693+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-12T19:00:11.412318+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-12T19:00:11.412318+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.412318+0000","objects_scrubbed":10,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:40.943987+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1575003,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":648,"num_read_kb":7584,"num_write":1228,"num_write_kb":45057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'154","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.627859+0000","last_change":"2024-09-12T19:00:11.627859+0000","last_active":"2024-09-12T19:00:11.627859+0000","last_peered":"2024-09-12T19:00:11.627859+0000","last_clean":"2024-09-12T19:00:11.627859+0000","last_became_active":"2024-09-12T17:40:20.120803+0000","last_became_peered":"2024-09-12T17:40:20.120803+0000","last_unstale":"2024-09-12T19:00:11.627859+0000","last_undegraded":"2024-09-12T19:00:11.627859+0000","last_fullsized":"2024-09-12T19:00:11.627859+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-12T19:00:11.627566+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-12T19:00:11.627566+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.627566+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:32.581707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":714,"num_read_kb":606,"num_write":221,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'317","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.802687+0000","last_change":"2024-09-12T19:00:10.802687+0000","last_active":"2024-09-12T19:00:10.802687+0000","last_peered":"2024-09-12T19:00:10.802687+0000","last_clean":"2024-09-12T19:00:10.802687+0000","last_became_active":"2024-09-12T17:40:18.769867+0000","last_became_peered":"2024-09-12T17:40:18.769867+0000","last_unstale":"2024-09-12T19:00:10.802687+0000","last_undegraded":"2024-09-12T19:00:10.802687+0000","last_fullsized":"2024-09-12T19:00:10.802687+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T19:00:10.802484+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T19:00:10.802484+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.802484+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:37.820292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":25356,"num_write":1086,"num_write_kb":19597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'166","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.599974+0000","last_change":"2024-09-12T19:00:14.599974+0000","last_active":"2024-09-12T19:00:14.599974+0000","last_peered":"2024-09-12T19:00:14.599974+0000","last_clean":"2024-09-12T19:00:14.599974+0000","last_became_active":"2024-09-12T17:40:20.131603+0000","last_became_peered":"2024-09-12T17:40:20.131603+0000","last_unstale":"2024-09-12T19:00:14.599974+0000","last_undegraded":"2024-09-12T19:00:14.599974+0000","last_fullsized":"2024-09-12T19:00:14.599974+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T19:00:14.599795+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T19:00:14.599795+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.599795+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:11.205160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":647,"num_write":268,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'329","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.651668+0000","last_change":"2024-09-12T19:00:12.651668+0000","last_active":"2024-09-12T19:00:12.651668+0000","last_peered":"2024-09-12T19:00:12.651668+0000","last_clean":"2024-09-12T19:00:12.651668+0000","last_became_active":"2024-09-12T17:40:18.765584+0000","last_became_peered":"2024-09-12T17:40:18.765584+0000","last_unstale":"2024-09-12T19:00:12.651668+0000","last_undegraded":"2024-09-12T19:00:12.651668+0000","last_fullsized":"2024-09-12T19:00:12.651668+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T19:00:12.651452+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T19:00:12.651452+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.651452+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:48.653995+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":14373,"num_write":1088,"num_write_kb":24714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'218","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.886654+0000","last_change":"2024-09-12T19:00:23.886654+0000","last_active":"2024-09-12T19:00:23.886654+0000","last_peered":"2024-09-12T19:00:23.886654+0000","last_clean":"2024-09-12T19:00:23.886654+0000","last_became_active":"2024-09-12T17:40:20.132166+0000","last_became_peered":"2024-09-12T17:40:20.132166+0000","last_unstale":"2024-09-12T19:00:23.886654+0000","last_undegraded":"2024-09-12T19:00:23.886654+0000","last_fullsized":"2024-09-12T19:00:23.886654+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-09-12T19:00:23.886463+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-09-12T19:00:23.886463+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.886463+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:14.565713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":801,"num_write":328,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'324","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.305986+0000","last_change":"2024-09-12T19:00:11.305986+0000","last_active":"2024-09-12T19:00:11.305986+0000","last_peered":"2024-09-12T19:00:11.305986+0000","last_clean":"2024-09-12T19:00:11.305986+0000","last_became_active":"2024-09-12T17:40:18.753673+0000","last_became_peered":"2024-09-12T17:40:18.753673+0000","last_unstale":"2024-09-12T19:00:11.305986+0000","last_undegraded":"2024-09-12T19:00:11.305986+0000","last_fullsized":"2024-09-12T19:00:11.305986+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-12T19:00:11.305739+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-12T19:00:11.305739+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.305739+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:02.108364+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602146,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":9306,"num_write":1013,"num_write_kb":26120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'144","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.930286+0000","last_change":"2024-09-12T19:00:40.930286+0000","last_active":"2024-09-12T19:00:40.930286+0000","last_peered":"2024-09-12T19:00:40.930286+0000","last_clean":"2024-09-12T19:00:40.930286+0000","last_became_active":"2024-09-12T17:40:28.201205+0000","last_became_peered":"2024-09-12T17:40:28.201205+0000","last_unstale":"2024-09-12T19:00:40.930286+0000","last_undegraded":"2024-09-12T19:00:40.930286+0000","last_fullsized":"2024-09-12T19:00:40.930286+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:40.930076+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:40.930076+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.930076+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:42.788562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'257","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.617677+0000","last_change":"2024-09-12T19:00:14.617677+0000","last_active":"2024-09-12T19:00:14.617677+0000","last_peered":"2024-09-12T19:00:14.617677+0000","last_clean":"2024-09-12T19:00:14.617677+0000","last_became_active":"2024-09-12T17:40:20.132930+0000","last_became_peered":"2024-09-12T17:40:20.132930+0000","last_unstale":"2024-09-12T19:00:14.617677+0000","last_undegraded":"2024-09-12T19:00:14.617677+0000","last_fullsized":"2024-09-12T19:00:14.617677+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-12T19:00:14.617493+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-12T19:00:14.617493+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.617493+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:11.145807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1081,"num_read_kb":890,"num_write":398,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'338","reported_seq":1106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.929838+0000","last_change":"2024-09-12T19:00:13.929838+0000","last_active":"2024-09-12T19:00:13.929838+0000","last_peered":"2024-09-12T19:00:13.929838+0000","last_clean":"2024-09-12T19:00:13.929838+0000","last_became_active":"2024-09-12T17:40:18.785762+0000","last_became_peered":"2024-09-12T17:40:18.785762+0000","last_unstale":"2024-09-12T19:00:13.929838+0000","last_undegraded":"2024-09-12T19:00:13.929838+0000","last_fullsized":"2024-09-12T19:00:13.929838+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T19:00:13.929601+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T19:00:13.929601+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.929601+0000","objects_scrubbed":11,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:54.986642+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364400,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":651,"num_read_kb":5513,"num_write":1121,"num_write_kb":17948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.294876+0000","last_change":"2024-09-12T19:00:26.294876+0000","last_active":"2024-09-12T19:00:26.294876+0000","last_peered":"2024-09-12T19:00:26.294876+0000","last_clean":"2024-09-12T19:00:26.294876+0000","last_became_active":"2024-09-12T17:40:22.146112+0000","last_became_peered":"2024-09-12T17:40:22.146112+0000","last_unstale":"2024-09-12T19:00:26.294876+0000","last_undegraded":"2024-09-12T19:00:26.294876+0000","last_fullsized":"2024-09-12T19:00:26.294876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.294692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.294692+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.294692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:19.193532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'342","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.367212+0000","last_change":"2024-09-12T19:00:28.367212+0000","last_active":"2024-09-12T19:00:28.367212+0000","last_peered":"2024-09-12T19:00:28.367212+0000","last_clean":"2024-09-12T19:00:28.367212+0000","last_became_active":"2024-09-12T17:40:24.161536+0000","last_became_peered":"2024-09-12T17:40:24.161536+0000","last_unstale":"2024-09-12T19:00:28.367212+0000","last_undegraded":"2024-09-12T19:00:28.367212+0000","last_fullsized":"2024-09-12T19:00:28.367212+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-12T19:00:28.367009+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-12T19:00:28.367009+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.367009+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:49.442023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50345,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":1205,"num_write":440,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.791994+0000","last_change":"2024-09-12T19:00:36.791994+0000","last_active":"2024-09-12T19:00:36.791994+0000","last_peered":"2024-09-12T19:00:36.791994+0000","last_clean":"2024-09-12T19:00:36.791994+0000","last_became_active":"2024-09-12T17:40:26.188831+0000","last_became_peered":"2024-09-12T17:40:26.188831+0000","last_unstale":"2024-09-12T19:00:36.791994+0000","last_undegraded":"2024-09-12T19:00:36.791994+0000","last_fullsized":"2024-09-12T19:00:36.791994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:36.791726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:36.791726+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.791726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:23.483824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'162","reported_seq":726,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.278715+0000","last_change":"2024-09-12T19:00:40.278715+0000","last_active":"2024-09-12T19:00:40.278715+0000","last_peered":"2024-09-12T19:00:40.278715+0000","last_clean":"2024-09-12T19:00:40.278715+0000","last_became_active":"2024-09-12T17:40:28.189899+0000","last_became_peered":"2024-09-12T17:40:28.189899+0000","last_unstale":"2024-09-12T19:00:40.278715+0000","last_undegraded":"2024-09-12T19:00:40.278715+0000","last_fullsized":"2024-09-12T19:00:40.278715+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T19:00:40.278524+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T19:00:40.278524+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.278524+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:11.990738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":230,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'92","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.294602+0000","last_change":"2024-09-12T19:00:19.294602+0000","last_active":"2024-09-12T19:00:19.294602+0000","last_peered":"2024-09-12T19:00:19.294602+0000","last_clean":"2024-09-12T19:00:19.294602+0000","last_became_active":"2024-09-12T17:40:20.137252+0000","last_became_peered":"2024-09-12T17:40:20.137252+0000","last_unstale":"2024-09-12T19:00:19.294602+0000","last_undegraded":"2024-09-12T19:00:19.294602+0000","last_fullsized":"2024-09-12T19:00:19.294602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-12T19:00:19.294422+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-12T19:00:19.294422+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.294422+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:43.295706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":356,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'347","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.376265+0000","last_change":"2024-09-12T19:00:05.376265+0000","last_active":"2024-09-12T19:00:05.376265+0000","last_peered":"2024-09-12T19:00:05.376265+0000","last_clean":"2024-09-12T19:00:05.376265+0000","last_became_active":"2024-09-12T17:40:18.756518+0000","last_became_peered":"2024-09-12T17:40:18.756518+0000","last_unstale":"2024-09-12T19:00:05.376265+0000","last_undegraded":"2024-09-12T19:00:05.376265+0000","last_fullsized":"2024-09-12T19:00:05.376265+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T19:00:05.376068+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T19:00:05.376068+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.376068+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:46.598497+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272857,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":466,"num_read_kb":2596,"num_write":1023,"num_write_kb":33023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.624097+0000","last_change":"2024-09-12T19:00:22.624097+0000","last_active":"2024-09-12T19:00:22.624097+0000","last_peered":"2024-09-12T19:00:22.624097+0000","last_clean":"2024-09-12T19:00:22.624097+0000","last_became_active":"2024-09-12T17:40:22.153074+0000","last_became_peered":"2024-09-12T17:40:22.153074+0000","last_unstale":"2024-09-12T19:00:22.624097+0000","last_undegraded":"2024-09-12T19:00:22.624097+0000","last_fullsized":"2024-09-12T19:00:22.624097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.623901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.623901+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.623901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:49.381263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'105","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.924730+0000","last_change":"2024-09-12T19:00:32.924730+0000","last_active":"2024-09-12T19:00:32.924730+0000","last_peered":"2024-09-12T19:00:32.924730+0000","last_clean":"2024-09-12T19:00:32.924730+0000","last_became_active":"2024-09-12T17:40:24.169431+0000","last_became_peered":"2024-09-12T17:40:24.169431+0000","last_unstale":"2024-09-12T19:00:32.924730+0000","last_undegraded":"2024-09-12T19:00:32.924730+0000","last_fullsized":"2024-09-12T19:00:32.924730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T19:00:32.924491+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T19:00:32.924491+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.924491+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:19.774401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.881908+0000","last_change":"2024-09-12T19:00:36.881908+0000","last_active":"2024-09-12T19:00:36.881908+0000","last_peered":"2024-09-12T19:00:36.881908+0000","last_clean":"2024-09-12T19:00:36.881908+0000","last_became_active":"2024-09-12T17:40:26.188501+0000","last_became_peered":"2024-09-12T17:40:26.188501+0000","last_unstale":"2024-09-12T19:00:36.881908+0000","last_undegraded":"2024-09-12T19:00:36.881908+0000","last_fullsized":"2024-09-12T19:00:36.881908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:36.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:36.881726+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:04.430721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'136","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.297377+0000","last_change":"2024-09-12T19:00:41.297377+0000","last_active":"2024-09-12T19:00:41.297377+0000","last_peered":"2024-09-12T19:00:41.297377+0000","last_clean":"2024-09-12T19:00:41.297377+0000","last_became_active":"2024-09-12T17:40:28.186224+0000","last_became_peered":"2024-09-12T17:40:28.186224+0000","last_unstale":"2024-09-12T19:00:41.297377+0000","last_undegraded":"2024-09-12T19:00:41.297377+0000","last_fullsized":"2024-09-12T19:00:41.297377+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-12T19:00:41.297189+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-12T19:00:41.297189+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.297189+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:59.058653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":201,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'278","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.374182+0000","last_change":"2024-09-12T19:00:16.374182+0000","last_active":"2024-09-12T19:00:16.374182+0000","last_peered":"2024-09-12T19:00:16.374182+0000","last_clean":"2024-09-12T19:00:16.374182+0000","last_became_active":"2024-09-12T17:40:20.115862+0000","last_became_peered":"2024-09-12T17:40:20.115862+0000","last_unstale":"2024-09-12T19:00:16.374182+0000","last_undegraded":"2024-09-12T19:00:16.374182+0000","last_fullsized":"2024-09-12T19:00:16.374182+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'278","last_scrub_stamp":"2024-09-12T19:00:16.374003+0000","last_deep_scrub":"264'278","last_deep_scrub_stamp":"2024-09-12T19:00:16.374003+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.374003+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:39.249116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1211,"num_read_kb":988,"num_write":419,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'376","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.350085+0000","last_change":"2024-09-12T19:00:07.349944+0000","last_active":"2024-09-12T19:00:07.350085+0000","last_peered":"2024-09-12T19:00:07.350085+0000","last_clean":"2024-09-12T19:00:07.350085+0000","last_became_active":"2024-09-12T17:40:55.329597+0000","last_became_peered":"2024-09-12T17:40:55.329597+0000","last_unstale":"2024-09-12T19:00:07.350085+0000","last_undegraded":"2024-09-12T19:00:07.350085+0000","last_fullsized":"2024-09-12T19:00:07.350085+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-12T19:00:07.349768+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-12T19:00:07.349768+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.349768+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:52.137674+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263284,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":44050,"num_write":1244,"num_write_kb":40700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.733255+0000","last_change":"2024-09-12T19:00:25.733255+0000","last_active":"2024-09-12T19:00:25.733255+0000","last_peered":"2024-09-12T19:00:25.733255+0000","last_clean":"2024-09-12T19:00:25.733255+0000","last_became_active":"2024-09-12T17:40:22.145769+0000","last_became_peered":"2024-09-12T17:40:22.145769+0000","last_unstale":"2024-09-12T19:00:25.733255+0000","last_undegraded":"2024-09-12T19:00:25.733255+0000","last_fullsized":"2024-09-12T19:00:25.733255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:25.733080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:25.733080+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.733080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:21.958659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'151","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.637691+0000","last_change":"2024-09-12T19:00:20.637691+0000","last_active":"2024-09-12T19:00:20.637691+0000","last_peered":"2024-09-12T19:00:20.637691+0000","last_clean":"2024-09-12T19:00:20.637691+0000","last_became_active":"2024-09-12T17:40:24.163809+0000","last_became_peered":"2024-09-12T17:40:24.163809+0000","last_unstale":"2024-09-12T19:00:20.637691+0000","last_undegraded":"2024-09-12T19:00:20.637691+0000","last_fullsized":"2024-09-12T19:00:20.637691+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T19:00:20.637471+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T19:00:20.637471+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.637471+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:01.042195+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":124,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'765","reported_seq":2954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.836254+0000","last_change":"2024-09-12T19:00:35.836254+0000","last_active":"2024-09-12T19:00:35.836254+0000","last_peered":"2024-09-12T19:00:35.836254+0000","last_clean":"2024-09-12T19:00:35.836254+0000","last_became_active":"2024-09-12T17:40:26.200567+0000","last_became_peered":"2024-09-12T17:40:26.200567+0000","last_unstale":"2024-09-12T19:00:35.836254+0000","last_undegraded":"2024-09-12T19:00:35.836254+0000","last_fullsized":"2024-09-12T19:00:35.836254+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'765","last_scrub_stamp":"2024-09-12T19:00:35.836060+0000","last_deep_scrub":"264'765","last_deep_scrub_stamp":"2024-09-12T19:00:35.836060+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.836060+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:05.982251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'219","reported_seq":1069,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.901011+0000","last_change":"2024-09-12T19:00:41.901011+0000","last_active":"2024-09-12T19:00:41.901011+0000","last_peered":"2024-09-12T19:00:41.901011+0000","last_clean":"2024-09-12T19:00:41.901011+0000","last_became_active":"2024-09-12T17:40:28.171602+0000","last_became_peered":"2024-09-12T17:40:28.171602+0000","last_unstale":"2024-09-12T19:00:41.901011+0000","last_undegraded":"2024-09-12T19:00:41.901011+0000","last_fullsized":"2024-09-12T19:00:41.901011+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-12T19:00:41.900820+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-12T19:00:41.900820+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.900820+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:41.173591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":670,"num_read_kb":661,"num_write":473,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'82","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.627310+0000","last_change":"2024-09-12T19:00:10.627173+0000","last_active":"2024-09-12T19:00:10.627310+0000","last_peered":"2024-09-12T19:00:10.627310+0000","last_clean":"2024-09-12T19:00:10.627310+0000","last_became_active":"2024-09-12T17:40:55.305123+0000","last_became_peered":"2024-09-12T17:40:55.305123+0000","last_unstale":"2024-09-12T19:00:10.627310+0000","last_undegraded":"2024-09-12T19:00:10.627310+0000","last_fullsized":"2024-09-12T19:00:10.627310+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'82","last_scrub_stamp":"2024-09-12T19:00:10.626973+0000","last_deep_scrub":"264'82","last_deep_scrub_stamp":"2024-09-12T19:00:10.626973+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.626973+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:35.142530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":316,"num_write":118,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"264'427","reported_seq":1184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.363489+0000","last_change":"2024-09-12T19:00:10.363489+0000","last_active":"2024-09-12T19:00:10.363489+0000","last_peered":"2024-09-12T19:00:10.363489+0000","last_clean":"2024-09-12T19:00:10.363489+0000","last_became_active":"2024-09-12T17:40:18.755758+0000","last_became_peered":"2024-09-12T17:40:18.755758+0000","last_unstale":"2024-09-12T19:00:10.363489+0000","last_undegraded":"2024-09-12T19:00:10.363489+0000","last_fullsized":"2024-09-12T19:00:10.363489+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'427","last_scrub_stamp":"2024-09-12T19:00:10.363268+0000","last_deep_scrub":"264'427","last_deep_scrub_stamp":"2024-09-12T19:00:10.363268+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.363268+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:15.235474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":768,"num_read_kb":10976,"num_write":1273,"num_write_kb":39454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.266415+0000","last_change":"2024-09-12T19:00:30.266415+0000","last_active":"2024-09-12T19:00:30.266415+0000","last_peered":"2024-09-12T19:00:30.266415+0000","last_clean":"2024-09-12T19:00:30.266415+0000","last_became_active":"2024-09-12T17:40:22.144266+0000","last_became_peered":"2024-09-12T17:40:22.144266+0000","last_unstale":"2024-09-12T19:00:30.266415+0000","last_undegraded":"2024-09-12T19:00:30.266415+0000","last_fullsized":"2024-09-12T19:00:30.266415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.266230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.266230+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.266230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:53.470295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'283","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.875571+0000","last_change":"2024-09-12T19:00:31.875571+0000","last_active":"2024-09-12T19:00:31.875571+0000","last_peered":"2024-09-12T19:00:31.875571+0000","last_clean":"2024-09-12T19:00:31.875571+0000","last_became_active":"2024-09-12T17:40:24.332623+0000","last_became_peered":"2024-09-12T17:40:24.332623+0000","last_unstale":"2024-09-12T19:00:31.875571+0000","last_undegraded":"2024-09-12T19:00:31.875571+0000","last_fullsized":"2024-09-12T19:00:31.875571+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'283","last_scrub_stamp":"2024-09-12T19:00:31.875334+0000","last_deep_scrub":"264'283","last_deep_scrub_stamp":"2024-09-12T19:00:31.875334+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.875334+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:28.468065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50618,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1084,"num_write":376,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'787","reported_seq":4969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.759039+0000","last_change":"2024-09-12T19:00:37.759039+0000","last_active":"2024-09-12T19:00:37.759039+0000","last_peered":"2024-09-12T19:00:37.759039+0000","last_clean":"2024-09-12T19:00:37.759039+0000","last_became_active":"2024-09-12T17:40:26.194264+0000","last_became_peered":"2024-09-12T17:40:26.194264+0000","last_unstale":"2024-09-12T19:00:37.759039+0000","last_undegraded":"2024-09-12T19:00:37.759039+0000","last_fullsized":"2024-09-12T19:00:37.759039+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'787","last_scrub_stamp":"2024-09-12T19:00:37.758842+0000","last_deep_scrub":"264'787","last_deep_scrub_stamp":"2024-09-12T19:00:37.758842+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.758842+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:59.879886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'4314","reported_seq":4936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.309249+0000","last_change":"2024-09-12T19:00:18.309077+0000","last_active":"2024-09-12T19:00:18.309249+0000","last_peered":"2024-09-12T19:00:18.309249+0000","last_clean":"2024-09-12T19:00:18.309249+0000","last_became_active":"2024-09-12T17:40:20.136595+0000","last_became_peered":"2024-09-12T17:40:20.136595+0000","last_unstale":"2024-09-12T19:00:18.309249+0000","last_undegraded":"2024-09-12T19:00:18.309249+0000","last_fullsized":"2024-09-12T19:00:18.309249+0000","mapping_epoch":25,"log_start":"264'4300","ondisk_log_start":"264'4300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4314","last_scrub_stamp":"2024-09-12T19:00:18.308892+0000","last_deep_scrub":"264'4314","last_deep_scrub_stamp":"2024-09-12T19:00:18.308892+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.308892+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:40.254536+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17313,"num_read_kb":14480,"num_write":6459,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8763,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'327","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.882869+0000","last_change":"2024-09-12T19:00:08.882869+0000","last_active":"2024-09-12T19:00:08.882869+0000","last_peered":"2024-09-12T19:00:08.882869+0000","last_clean":"2024-09-12T19:00:08.882869+0000","last_became_active":"2024-09-12T17:40:18.792274+0000","last_became_peered":"2024-09-12T17:40:18.792274+0000","last_unstale":"2024-09-12T19:00:08.882869+0000","last_undegraded":"2024-09-12T19:00:08.882869+0000","last_fullsized":"2024-09-12T19:00:08.882869+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T19:00:08.882605+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T19:00:08.882605+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.882605+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:09.532780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":45936,"num_write":1086,"num_write_kb":27157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.923195+0000","last_change":"2024-09-12T19:00:23.923013+0000","last_active":"2024-09-12T19:00:23.923195+0000","last_peered":"2024-09-12T19:00:23.923195+0000","last_clean":"2024-09-12T19:00:23.923195+0000","last_became_active":"2024-09-12T17:40:22.150553+0000","last_became_peered":"2024-09-12T17:40:22.150553+0000","last_unstale":"2024-09-12T19:00:23.923195+0000","last_undegraded":"2024-09-12T19:00:23.923195+0000","last_fullsized":"2024-09-12T19:00:23.923195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.922835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.922835+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.922835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:28.392845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'421","reported_seq":1070,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.265945+0000","last_change":"2024-09-12T19:00:31.265945+0000","last_active":"2024-09-12T19:00:31.265945+0000","last_peered":"2024-09-12T19:00:31.265945+0000","last_clean":"2024-09-12T19:00:31.265945+0000","last_became_active":"2024-09-12T17:40:24.332413+0000","last_became_peered":"2024-09-12T17:40:24.332413+0000","last_unstale":"2024-09-12T19:00:31.265945+0000","last_undegraded":"2024-09-12T19:00:31.265945+0000","last_fullsized":"2024-09-12T19:00:31.265945+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-09-12T19:00:31.265700+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-09-12T19:00:31.265700+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.265700+0000","objects_scrubbed":9,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:30.182370+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52951,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":647,"num_read_kb":1274,"num_write":502,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.347008+0000","last_change":"2024-09-12T19:00:27.347008+0000","last_active":"2024-09-12T19:00:27.347008+0000","last_peered":"2024-09-12T19:00:27.347008+0000","last_clean":"2024-09-12T19:00:27.347008+0000","last_became_active":"2024-09-12T17:40:26.180448+0000","last_became_peered":"2024-09-12T17:40:26.180448+0000","last_unstale":"2024-09-12T19:00:27.347008+0000","last_undegraded":"2024-09-12T19:00:27.347008+0000","last_fullsized":"2024-09-12T19:00:27.347008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:27.346786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:27.346786+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.346786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:53.370738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'562","reported_seq":1386,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.221015+0000","last_change":"2024-09-12T19:00:36.221015+0000","last_active":"2024-09-12T19:00:36.221015+0000","last_peered":"2024-09-12T19:00:36.221015+0000","last_clean":"2024-09-12T19:00:36.221015+0000","last_became_active":"2024-09-12T17:40:28.189872+0000","last_became_peered":"2024-09-12T17:40:28.189872+0000","last_unstale":"2024-09-12T19:00:36.221015+0000","last_undegraded":"2024-09-12T19:00:36.221015+0000","last_fullsized":"2024-09-12T19:00:36.221015+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'562","last_scrub_stamp":"2024-09-12T19:00:36.220759+0000","last_deep_scrub":"264'562","last_deep_scrub_stamp":"2024-09-12T19:00:36.220759+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.220759+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:18.822188+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1323,"num_read_kb":1321,"num_write":1170,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'151","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.852439+0000","last_change":"2024-09-12T19:00:15.852277+0000","last_active":"2024-09-12T19:00:15.852439+0000","last_peered":"2024-09-12T19:00:15.852439+0000","last_clean":"2024-09-12T19:00:15.852439+0000","last_became_active":"2024-09-12T17:40:20.133890+0000","last_became_peered":"2024-09-12T17:40:20.133890+0000","last_unstale":"2024-09-12T19:00:15.852439+0000","last_undegraded":"2024-09-12T19:00:15.852439+0000","last_fullsized":"2024-09-12T19:00:15.852439+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T19:00:15.852091+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T19:00:15.852091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.852091+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:54.370817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":596,"num_write":262,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'398","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.942259+0000","last_change":"2024-09-12T19:00:10.942259+0000","last_active":"2024-09-12T19:00:10.942259+0000","last_peered":"2024-09-12T19:00:10.942259+0000","last_clean":"2024-09-12T19:00:10.942259+0000","last_became_active":"2024-09-12T17:40:18.779278+0000","last_became_peered":"2024-09-12T17:40:18.779278+0000","last_unstale":"2024-09-12T19:00:10.942259+0000","last_undegraded":"2024-09-12T19:00:10.942259+0000","last_fullsized":"2024-09-12T19:00:10.942259+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-12T19:00:10.942027+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-12T19:00:10.942027+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.942027+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:54.061993+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4801217,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":581,"num_read_kb":90800,"num_write":1176,"num_write_kb":50508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"264'6","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.569622+0000","last_change":"2024-09-12T19:00:17.569464+0000","last_active":"2024-09-12T19:00:17.569622+0000","last_peered":"2024-09-12T19:00:17.569622+0000","last_clean":"2024-09-12T19:00:17.569622+0000","last_became_active":"2024-09-12T17:40:22.133525+0000","last_became_peered":"2024-09-12T17:40:22.133525+0000","last_unstale":"2024-09-12T19:00:17.569622+0000","last_undegraded":"2024-09-12T19:00:17.569622+0000","last_fullsized":"2024-09-12T19:00:17.569622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:17.569265+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:17.569265+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.569265+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:55.942607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'293","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.707014+0000","last_change":"2024-09-12T19:00:26.707014+0000","last_active":"2024-09-12T19:00:26.707014+0000","last_peered":"2024-09-12T19:00:26.707014+0000","last_clean":"2024-09-12T19:00:26.707014+0000","last_became_active":"2024-09-12T17:40:24.177609+0000","last_became_peered":"2024-09-12T17:40:24.177609+0000","last_unstale":"2024-09-12T19:00:26.707014+0000","last_undegraded":"2024-09-12T19:00:26.707014+0000","last_fullsized":"2024-09-12T19:00:26.707014+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'293","last_scrub_stamp":"2024-09-12T19:00:26.706832+0000","last_deep_scrub":"264'293","last_deep_scrub_stamp":"2024-09-12T19:00:26.706832+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.706832+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:04.968086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1115,"num_write":388,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.738506+0000","last_change":"2024-09-12T19:00:39.738506+0000","last_active":"2024-09-12T19:00:39.738506+0000","last_peered":"2024-09-12T19:00:39.738506+0000","last_clean":"2024-09-12T19:00:39.738506+0000","last_became_active":"2024-09-12T17:40:26.203313+0000","last_became_peered":"2024-09-12T17:40:26.203313+0000","last_unstale":"2024-09-12T19:00:39.738506+0000","last_undegraded":"2024-09-12T19:00:39.738506+0000","last_fullsized":"2024-09-12T19:00:39.738506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:39.738317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:39.738317+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.738317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:15.402624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2396","reported_seq":4233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.304518+0000","last_change":"2024-09-12T19:00:28.304518+0000","last_active":"2024-09-12T19:00:28.304518+0000","last_peered":"2024-09-12T19:00:28.304518+0000","last_clean":"2024-09-12T19:00:28.304518+0000","last_became_active":"2024-09-12T17:40:28.183181+0000","last_became_peered":"2024-09-12T17:40:28.183181+0000","last_unstale":"2024-09-12T19:00:28.304518+0000","last_undegraded":"2024-09-12T19:00:28.304518+0000","last_fullsized":"2024-09-12T19:00:28.304518+0000","mapping_epoch":33,"log_start":"264'2300","ondisk_log_start":"264'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2396","last_scrub_stamp":"2024-09-12T19:00:28.304334+0000","last_deep_scrub":"264'2396","last_deep_scrub_stamp":"2024-09-12T19:00:28.304334+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.304334+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":2300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:13.034973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6012,"num_read_kb":6017,"num_write":4828,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'262","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.462287+0000","last_change":"2024-09-12T19:00:15.462287+0000","last_active":"2024-09-12T19:00:15.462287+0000","last_peered":"2024-09-12T19:00:15.462287+0000","last_clean":"2024-09-12T19:00:15.462287+0000","last_became_active":"2024-09-12T17:40:20.133614+0000","last_became_peered":"2024-09-12T17:40:20.133614+0000","last_unstale":"2024-09-12T19:00:15.462287+0000","last_undegraded":"2024-09-12T19:00:15.462287+0000","last_fullsized":"2024-09-12T19:00:15.462287+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'262","last_scrub_stamp":"2024-09-12T19:00:15.462110+0000","last_deep_scrub":"264'262","last_deep_scrub_stamp":"2024-09-12T19:00:15.462110+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.462110+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:42.164388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1175,"num_read_kb":965,"num_write":385,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'314","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.901535+0000","last_change":"2024-09-12T19:00:09.901535+0000","last_active":"2024-09-12T19:00:09.901535+0000","last_peered":"2024-09-12T19:00:09.901535+0000","last_clean":"2024-09-12T19:00:09.901535+0000","last_became_active":"2024-09-12T17:40:18.786288+0000","last_became_peered":"2024-09-12T17:40:18.786288+0000","last_unstale":"2024-09-12T19:00:09.901535+0000","last_undegraded":"2024-09-12T19:00:09.901535+0000","last_fullsized":"2024-09-12T19:00:09.901535+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T19:00:09.901234+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T19:00:09.901234+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.901234+0000","objects_scrubbed":11,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:32.060870+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263265,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":395,"num_read_kb":29289,"num_write":926,"num_write_kb":24158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.613306+0000","last_change":"2024-09-12T19:00:18.613306+0000","last_active":"2024-09-12T19:00:18.613306+0000","last_peered":"2024-09-12T19:00:18.613306+0000","last_clean":"2024-09-12T19:00:18.613306+0000","last_became_active":"2024-09-12T17:40:22.131242+0000","last_became_peered":"2024-09-12T17:40:22.131242+0000","last_unstale":"2024-09-12T19:00:18.613306+0000","last_undegraded":"2024-09-12T19:00:18.613306+0000","last_fullsized":"2024-09-12T19:00:18.613306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:18.613075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:18.613075+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.613075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:08.425791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'311","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.905085+0000","last_change":"2024-09-12T19:00:29.904934+0000","last_active":"2024-09-12T19:00:29.905085+0000","last_peered":"2024-09-12T19:00:29.905085+0000","last_clean":"2024-09-12T19:00:29.905085+0000","last_became_active":"2024-09-12T17:40:24.162722+0000","last_became_peered":"2024-09-12T17:40:24.162722+0000","last_unstale":"2024-09-12T19:00:29.905085+0000","last_undegraded":"2024-09-12T19:00:29.905085+0000","last_fullsized":"2024-09-12T19:00:29.905085+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-09-12T19:00:29.904721+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-09-12T19:00:29.904721+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.904721+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:27.096545+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":1041,"num_write":382,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'763","reported_seq":2710,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.353917+0000","last_change":"2024-09-12T19:00:31.353760+0000","last_active":"2024-09-12T19:00:31.353917+0000","last_peered":"2024-09-12T19:00:31.353917+0000","last_clean":"2024-09-12T19:00:31.353917+0000","last_became_active":"2024-09-12T17:40:26.181656+0000","last_became_peered":"2024-09-12T17:40:26.181656+0000","last_unstale":"2024-09-12T19:00:31.353917+0000","last_undegraded":"2024-09-12T19:00:31.353917+0000","last_fullsized":"2024-09-12T19:00:31.353917+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'763","last_scrub_stamp":"2024-09-12T19:00:31.353551+0000","last_deep_scrub":"264'763","last_deep_scrub_stamp":"2024-09-12T19:00:31.353551+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.353551+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:43.697271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'119","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.276180+0000","last_change":"2024-09-12T19:00:37.276043+0000","last_active":"2024-09-12T19:00:37.276180+0000","last_peered":"2024-09-12T19:00:37.276180+0000","last_clean":"2024-09-12T19:00:37.276180+0000","last_became_active":"2024-09-12T17:40:28.185975+0000","last_became_peered":"2024-09-12T17:40:28.185975+0000","last_unstale":"2024-09-12T19:00:37.276180+0000","last_undegraded":"2024-09-12T19:00:37.276180+0000","last_fullsized":"2024-09-12T19:00:37.276180+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T19:00:37.275835+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T19:00:37.275835+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.275835+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:40.024593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'268","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.360248+0000","last_change":"2024-09-12T19:00:15.360248+0000","last_active":"2024-09-12T19:00:15.360248+0000","last_peered":"2024-09-12T19:00:15.360248+0000","last_clean":"2024-09-12T19:00:15.360248+0000","last_became_active":"2024-09-12T17:40:20.125386+0000","last_became_peered":"2024-09-12T17:40:20.125386+0000","last_unstale":"2024-09-12T19:00:15.360248+0000","last_undegraded":"2024-09-12T19:00:15.360248+0000","last_fullsized":"2024-09-12T19:00:15.360248+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'268","last_scrub_stamp":"2024-09-12T19:00:15.359983+0000","last_deep_scrub":"264'268","last_deep_scrub_stamp":"2024-09-12T19:00:15.359983+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.359983+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:39.540314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1147,"num_read_kb":967,"num_write":444,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'346","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.286839+0000","last_change":"2024-09-12T19:00:09.286839+0000","last_active":"2024-09-12T19:00:09.286839+0000","last_peered":"2024-09-12T19:00:09.286839+0000","last_clean":"2024-09-12T19:00:09.286839+0000","last_became_active":"2024-09-12T17:40:18.761052+0000","last_became_peered":"2024-09-12T17:40:18.761052+0000","last_unstale":"2024-09-12T19:00:09.286839+0000","last_undegraded":"2024-09-12T19:00:09.286839+0000","last_fullsized":"2024-09-12T19:00:09.286839+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-12T19:00:09.286528+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-12T19:00:09.286528+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.286528+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:01.066566+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":20006,"num_write":1061,"num_write_kb":43376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.564506+0000","last_change":"2024-09-12T19:00:16.564506+0000","last_active":"2024-09-12T19:00:16.564506+0000","last_peered":"2024-09-12T19:00:16.564506+0000","last_clean":"2024-09-12T19:00:16.564506+0000","last_became_active":"2024-09-12T17:40:22.134290+0000","last_became_peered":"2024-09-12T17:40:22.134290+0000","last_unstale":"2024-09-12T19:00:16.564506+0000","last_undegraded":"2024-09-12T19:00:16.564506+0000","last_fullsized":"2024-09-12T19:00:16.564506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:16.564293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:16.564293+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.564293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:21.426598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'495","reported_seq":1157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.378108+0000","last_change":"2024-09-12T19:00:26.377955+0000","last_active":"2024-09-12T19:00:26.378108+0000","last_peered":"2024-09-12T19:00:26.378108+0000","last_clean":"2024-09-12T19:00:26.378108+0000","last_became_active":"2024-09-12T17:40:24.161322+0000","last_became_peered":"2024-09-12T17:40:24.161322+0000","last_unstale":"2024-09-12T19:00:26.378108+0000","last_undegraded":"2024-09-12T19:00:26.378108+0000","last_fullsized":"2024-09-12T19:00:26.378108+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'495","last_scrub_stamp":"2024-09-12T19:00:26.377759+0000","last_deep_scrub":"264'495","last_deep_scrub_stamp":"2024-09-12T19:00:26.377759+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.377759+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:25.593749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92212,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2116,"num_write":710,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.615238+0000","last_change":"2024-09-12T19:00:22.615101+0000","last_active":"2024-09-12T19:00:22.615238+0000","last_peered":"2024-09-12T19:00:22.615238+0000","last_clean":"2024-09-12T19:00:22.615238+0000","last_became_active":"2024-09-12T17:40:26.191395+0000","last_became_peered":"2024-09-12T17:40:26.191395+0000","last_unstale":"2024-09-12T19:00:22.615238+0000","last_undegraded":"2024-09-12T19:00:22.615238+0000","last_fullsized":"2024-09-12T19:00:22.615238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.614917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.614917+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.614917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:11.312442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'148","reported_seq":672,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.372816+0000","last_change":"2024-09-12T19:00:29.372653+0000","last_active":"2024-09-12T19:00:29.372816+0000","last_peered":"2024-09-12T19:00:29.372816+0000","last_clean":"2024-09-12T19:00:29.372816+0000","last_became_active":"2024-09-12T17:40:28.204260+0000","last_became_peered":"2024-09-12T17:40:28.204260+0000","last_unstale":"2024-09-12T19:00:29.372816+0000","last_undegraded":"2024-09-12T19:00:29.372816+0000","last_fullsized":"2024-09-12T19:00:29.372816+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'148","last_scrub_stamp":"2024-09-12T19:00:29.372433+0000","last_deep_scrub":"264'148","last_deep_scrub_stamp":"2024-09-12T19:00:29.372433+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.372433+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:09.349129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":166,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'137","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.750749+0000","last_change":"2024-09-12T19:00:09.750749+0000","last_active":"2024-09-12T19:00:09.750749+0000","last_peered":"2024-09-12T19:00:09.750749+0000","last_clean":"2024-09-12T19:00:09.750749+0000","last_became_active":"2024-09-12T17:40:20.137143+0000","last_became_peered":"2024-09-12T17:40:20.137143+0000","last_unstale":"2024-09-12T19:00:09.750749+0000","last_undegraded":"2024-09-12T19:00:09.750749+0000","last_fullsized":"2024-09-12T19:00:09.750749+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T19:00:09.750552+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T19:00:09.750552+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.750552+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:20.403074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":630,"num_read_kb":531,"num_write":209,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'373","reported_seq":1212,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.707106+0000","last_change":"2024-09-12T19:00:07.707106+0000","last_active":"2024-09-12T19:00:07.707106+0000","last_peered":"2024-09-12T19:00:07.707106+0000","last_clean":"2024-09-12T19:00:07.707106+0000","last_became_active":"2024-09-12T17:40:18.759516+0000","last_became_peered":"2024-09-12T17:40:18.759516+0000","last_unstale":"2024-09-12T19:00:07.707106+0000","last_undegraded":"2024-09-12T19:00:07.707106+0000","last_fullsized":"2024-09-12T19:00:07.707106+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T19:00:07.706889+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T19:00:07.706889+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.706889+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:42.136959+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457548,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":9130,"num_write":1131,"num_write_kb":40035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.653978+0000","last_change":"2024-09-12T19:00:19.653978+0000","last_active":"2024-09-12T19:00:19.653978+0000","last_peered":"2024-09-12T19:00:19.653978+0000","last_clean":"2024-09-12T19:00:19.653978+0000","last_became_active":"2024-09-12T17:40:22.151755+0000","last_became_peered":"2024-09-12T17:40:22.151755+0000","last_unstale":"2024-09-12T19:00:19.653978+0000","last_undegraded":"2024-09-12T19:00:19.653978+0000","last_fullsized":"2024-09-12T19:00:19.653978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:19.653812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:19.653812+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.653812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:32.089068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'335","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.959837+0000","last_change":"2024-09-12T19:00:31.959837+0000","last_active":"2024-09-12T19:00:31.959837+0000","last_peered":"2024-09-12T19:00:31.959837+0000","last_clean":"2024-09-12T19:00:31.959837+0000","last_became_active":"2024-09-12T17:40:24.171973+0000","last_became_peered":"2024-09-12T17:40:24.171973+0000","last_unstale":"2024-09-12T19:00:31.959837+0000","last_undegraded":"2024-09-12T19:00:31.959837+0000","last_fullsized":"2024-09-12T19:00:31.959837+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T19:00:31.959642+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T19:00:31.959642+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.959642+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:22.025659+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50887,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":1156,"num_write":474,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.379478+0000","last_change":"2024-09-12T19:00:32.379478+0000","last_active":"2024-09-12T19:00:32.379478+0000","last_peered":"2024-09-12T19:00:32.379478+0000","last_clean":"2024-09-12T19:00:32.379478+0000","last_became_active":"2024-09-12T17:40:26.185070+0000","last_became_peered":"2024-09-12T17:40:26.185070+0000","last_unstale":"2024-09-12T19:00:32.379478+0000","last_undegraded":"2024-09-12T19:00:32.379478+0000","last_fullsized":"2024-09-12T19:00:32.379478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:32.379284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:32.379284+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.379284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:06.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'139","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:47.476159+0000","last_change":"2024-09-12T17:40:28.195461+0000","last_active":"2024-09-12T18:58:47.476159+0000","last_peered":"2024-09-12T18:58:47.476159+0000","last_clean":"2024-09-12T18:58:47.476159+0000","last_became_active":"2024-09-12T17:40:28.194137+0000","last_became_peered":"2024-09-12T17:40:28.194137+0000","last_unstale":"2024-09-12T18:58:47.476159+0000","last_undegraded":"2024-09-12T18:58:47.476159+0000","last_fullsized":"2024-09-12T18:58:47.476159+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:02.040950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":145,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'125","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.830631+0000","last_change":"2024-09-12T19:00:11.830631+0000","last_active":"2024-09-12T19:00:11.830631+0000","last_peered":"2024-09-12T19:00:11.830631+0000","last_clean":"2024-09-12T19:00:11.830631+0000","last_became_active":"2024-09-12T17:40:20.132115+0000","last_became_peered":"2024-09-12T17:40:20.132115+0000","last_unstale":"2024-09-12T19:00:11.830631+0000","last_undegraded":"2024-09-12T19:00:11.830631+0000","last_fullsized":"2024-09-12T19:00:11.830631+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T19:00:11.830405+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T19:00:11.830405+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.830405+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:28.343246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":428,"num_write":212,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'350","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.413688+0000","last_change":"2024-09-12T19:00:07.413688+0000","last_active":"2024-09-12T19:00:07.413688+0000","last_peered":"2024-09-12T19:00:07.413688+0000","last_clean":"2024-09-12T19:00:07.413688+0000","last_became_active":"2024-09-12T17:40:18.773579+0000","last_became_peered":"2024-09-12T17:40:18.773579+0000","last_unstale":"2024-09-12T19:00:07.413688+0000","last_undegraded":"2024-09-12T19:00:07.413688+0000","last_fullsized":"2024-09-12T19:00:07.413688+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T19:00:07.413481+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T19:00:07.413481+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.413481+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:28.872079+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4506445,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":44851,"num_write":1031,"num_write_kb":35490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.278282+0000","last_change":"2024-09-12T19:00:22.278282+0000","last_active":"2024-09-12T19:00:22.278282+0000","last_peered":"2024-09-12T19:00:22.278282+0000","last_clean":"2024-09-12T19:00:22.278282+0000","last_became_active":"2024-09-12T17:40:22.142112+0000","last_became_peered":"2024-09-12T17:40:22.142112+0000","last_unstale":"2024-09-12T19:00:22.278282+0000","last_undegraded":"2024-09-12T19:00:22.278282+0000","last_fullsized":"2024-09-12T19:00:22.278282+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.278103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.278103+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.278103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:49.670652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'343","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.651045+0000","last_change":"2024-09-12T19:00:21.651045+0000","last_active":"2024-09-12T19:00:21.651045+0000","last_peered":"2024-09-12T19:00:21.651045+0000","last_clean":"2024-09-12T19:00:21.651045+0000","last_became_active":"2024-09-12T17:40:24.181982+0000","last_became_peered":"2024-09-12T17:40:24.181982+0000","last_unstale":"2024-09-12T19:00:21.651045+0000","last_undegraded":"2024-09-12T19:00:21.651045+0000","last_fullsized":"2024-09-12T19:00:21.651045+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T19:00:21.650816+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T19:00:21.650816+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.650816+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:42.753209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52587,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1218,"num_write":444,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'725","reported_seq":2543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.599978+0000","last_change":"2024-09-12T19:00:24.599978+0000","last_active":"2024-09-12T19:00:24.599978+0000","last_peered":"2024-09-12T19:00:24.599978+0000","last_clean":"2024-09-12T19:00:24.599978+0000","last_became_active":"2024-09-12T17:40:26.187269+0000","last_became_peered":"2024-09-12T17:40:26.187269+0000","last_unstale":"2024-09-12T19:00:24.599978+0000","last_undegraded":"2024-09-12T19:00:24.599978+0000","last_fullsized":"2024-09-12T19:00:24.599978+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'725","last_scrub_stamp":"2024-09-12T19:00:24.599793+0000","last_deep_scrub":"264'725","last_deep_scrub_stamp":"2024-09-12T19:00:24.599793+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.599793+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:04.456575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'142","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.457205+0000","last_change":"2024-09-12T19:00:32.457205+0000","last_active":"2024-09-12T19:00:32.457205+0000","last_peered":"2024-09-12T19:00:32.457205+0000","last_clean":"2024-09-12T19:00:32.457205+0000","last_became_active":"2024-09-12T17:40:28.192211+0000","last_became_peered":"2024-09-12T17:40:28.192211+0000","last_unstale":"2024-09-12T19:00:32.457205+0000","last_undegraded":"2024-09-12T19:00:32.457205+0000","last_fullsized":"2024-09-12T19:00:32.457205+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T19:00:32.457018+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T19:00:32.457018+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.457018+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:52.182385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":224,"num_write":356,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'4139","reported_seq":4793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.856712+0000","last_change":"2024-09-12T19:00:14.856712+0000","last_active":"2024-09-12T19:00:14.856712+0000","last_peered":"2024-09-12T19:00:14.856712+0000","last_clean":"2024-09-12T19:00:14.856712+0000","last_became_active":"2024-09-12T17:40:20.136148+0000","last_became_peered":"2024-09-12T17:40:20.136148+0000","last_unstale":"2024-09-12T19:00:14.856712+0000","last_undegraded":"2024-09-12T19:00:14.856712+0000","last_fullsized":"2024-09-12T19:00:14.856712+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4139","last_scrub_stamp":"2024-09-12T19:00:14.856530+0000","last_deep_scrub":"264'4139","last_deep_scrub_stamp":"2024-09-12T19:00:14.856530+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.856530+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":3000,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:49.369462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16638,"num_read_kb":13967,"num_write":6216,"num_write_kb":3097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'309","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.811675+0000","last_change":"2024-09-12T19:00:06.811526+0000","last_active":"2024-09-12T19:00:06.811675+0000","last_peered":"2024-09-12T19:00:06.811675+0000","last_clean":"2024-09-12T19:00:06.811675+0000","last_became_active":"2024-09-12T17:40:18.773552+0000","last_became_peered":"2024-09-12T17:40:18.773552+0000","last_unstale":"2024-09-12T19:00:06.811675+0000","last_undegraded":"2024-09-12T19:00:06.811675+0000","last_fullsized":"2024-09-12T19:00:06.811675+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-09-12T19:00:06.811280+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-09-12T19:00:06.811280+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.811280+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:29.209861+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5770401,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":475,"num_read_kb":17949,"num_write":926,"num_write_kb":45991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1467,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.287267+0000","last_change":"2024-09-12T19:00:27.287267+0000","last_active":"2024-09-12T19:00:27.287267+0000","last_peered":"2024-09-12T19:00:27.287267+0000","last_clean":"2024-09-12T19:00:27.287267+0000","last_became_active":"2024-09-12T17:40:22.143463+0000","last_became_peered":"2024-09-12T17:40:22.143463+0000","last_unstale":"2024-09-12T19:00:27.287267+0000","last_undegraded":"2024-09-12T19:00:27.287267+0000","last_fullsized":"2024-09-12T19:00:27.287267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:00:27.287082+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:00:27.287082+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.287082+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:51.076103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'115","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.759134+0000","last_change":"2024-09-12T19:00:35.759134+0000","last_active":"2024-09-12T19:00:35.759134+0000","last_peered":"2024-09-12T19:00:35.759134+0000","last_clean":"2024-09-12T19:00:35.759134+0000","last_became_active":"2024-09-12T17:40:24.329452+0000","last_became_peered":"2024-09-12T17:40:24.329452+0000","last_unstale":"2024-09-12T19:00:35.759134+0000","last_undegraded":"2024-09-12T19:00:35.759134+0000","last_fullsized":"2024-09-12T19:00:35.759134+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-12T19:00:35.758923+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-12T19:00:35.758923+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.758923+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:17.591973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'753","reported_seq":2633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.384786+0000","last_change":"2024-09-12T19:00:24.384786+0000","last_active":"2024-09-12T19:00:24.384786+0000","last_peered":"2024-09-12T19:00:24.384786+0000","last_clean":"2024-09-12T19:00:24.384786+0000","last_became_active":"2024-09-12T17:40:26.183016+0000","last_became_peered":"2024-09-12T17:40:26.183016+0000","last_unstale":"2024-09-12T19:00:24.384786+0000","last_undegraded":"2024-09-12T19:00:24.384786+0000","last_fullsized":"2024-09-12T19:00:24.384786+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'753","last_scrub_stamp":"2024-09-12T19:00:24.384601+0000","last_deep_scrub":"264'753","last_deep_scrub_stamp":"2024-09-12T19:00:24.384601+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.384601+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:42.720645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'113","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.901377+0000","last_change":"2024-09-12T19:00:38.901377+0000","last_active":"2024-09-12T19:00:38.901377+0000","last_peered":"2024-09-12T19:00:38.901377+0000","last_clean":"2024-09-12T19:00:38.901377+0000","last_became_active":"2024-09-12T17:40:28.180192+0000","last_became_peered":"2024-09-12T17:40:28.180192+0000","last_unstale":"2024-09-12T19:00:38.901377+0000","last_undegraded":"2024-09-12T19:00:38.901377+0000","last_fullsized":"2024-09-12T19:00:38.901377+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'113","last_scrub_stamp":"2024-09-12T19:00:38.901198+0000","last_deep_scrub":"264'113","last_deep_scrub_stamp":"2024-09-12T19:00:38.901198+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.901198+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:35.073698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":167,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'272","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.355420+0000","last_change":"2024-09-12T19:00:18.355420+0000","last_active":"2024-09-12T19:00:18.355420+0000","last_peered":"2024-09-12T19:00:18.355420+0000","last_clean":"2024-09-12T19:00:18.355420+0000","last_became_active":"2024-09-12T17:40:20.125511+0000","last_became_peered":"2024-09-12T17:40:20.125511+0000","last_unstale":"2024-09-12T19:00:18.355420+0000","last_undegraded":"2024-09-12T19:00:18.355420+0000","last_fullsized":"2024-09-12T19:00:18.355420+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-12T19:00:18.355195+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-12T19:00:18.355195+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.355195+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:41.045399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1212,"num_read_kb":1000,"num_write":434,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'288","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.711798+0000","last_change":"2024-09-12T19:00:06.711722+0000","last_active":"2024-09-12T19:00:06.711798+0000","last_peered":"2024-09-12T19:00:06.711798+0000","last_clean":"2024-09-12T19:00:06.711798+0000","last_became_active":"2024-09-12T17:40:18.769054+0000","last_became_peered":"2024-09-12T17:40:18.769054+0000","last_unstale":"2024-09-12T19:00:06.711798+0000","last_undegraded":"2024-09-12T19:00:06.711798+0000","last_fullsized":"2024-09-12T19:00:06.711798+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'288","last_scrub_stamp":"2024-09-12T19:00:06.711610+0000","last_deep_scrub":"264'288","last_deep_scrub_stamp":"2024-09-12T19:00:06.711610+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.711610+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:07.586624+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526370,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":78920,"num_write":889,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.906171+0000","last_change":"2024-09-12T19:00:26.906171+0000","last_active":"2024-09-12T19:00:26.906171+0000","last_peered":"2024-09-12T19:00:26.906171+0000","last_clean":"2024-09-12T19:00:26.906171+0000","last_became_active":"2024-09-12T17:40:22.138875+0000","last_became_peered":"2024-09-12T17:40:22.138875+0000","last_unstale":"2024-09-12T19:00:26.906171+0000","last_undegraded":"2024-09-12T19:00:26.906171+0000","last_fullsized":"2024-09-12T19:00:26.906171+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.905998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.905998+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.905998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:49.165143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'405","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.221799+0000","last_change":"2024-09-12T19:00:32.221799+0000","last_active":"2024-09-12T19:00:32.221799+0000","last_peered":"2024-09-12T19:00:32.221799+0000","last_clean":"2024-09-12T19:00:32.221799+0000","last_became_active":"2024-09-12T17:40:24.173537+0000","last_became_peered":"2024-09-12T17:40:24.173537+0000","last_unstale":"2024-09-12T19:00:32.221799+0000","last_undegraded":"2024-09-12T19:00:32.221799+0000","last_fullsized":"2024-09-12T19:00:32.221799+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-12T19:00:32.221589+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-12T19:00:32.221589+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.221589+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:49.519214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47427,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":650,"num_read_kb":1371,"num_write":508,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.364124+0000","last_change":"2024-09-12T19:00:22.364124+0000","last_active":"2024-09-12T19:00:22.364124+0000","last_peered":"2024-09-12T19:00:22.364124+0000","last_clean":"2024-09-12T19:00:22.364124+0000","last_became_active":"2024-09-12T17:40:26.183228+0000","last_became_peered":"2024-09-12T17:40:26.183228+0000","last_unstale":"2024-09-12T19:00:22.364124+0000","last_undegraded":"2024-09-12T19:00:22.364124+0000","last_fullsized":"2024-09-12T19:00:22.364124+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.363940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.363940+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.363940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:55.507213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'141","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.409412+0000","last_change":"2024-09-12T19:00:31.409412+0000","last_active":"2024-09-12T19:00:31.409412+0000","last_peered":"2024-09-12T19:00:31.409412+0000","last_clean":"2024-09-12T19:00:31.409412+0000","last_became_active":"2024-09-12T17:40:28.191461+0000","last_became_peered":"2024-09-12T17:40:28.191461+0000","last_unstale":"2024-09-12T19:00:31.409412+0000","last_undegraded":"2024-09-12T19:00:31.409412+0000","last_fullsized":"2024-09-12T19:00:31.409412+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T19:00:31.409211+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T19:00:31.409211+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.409211+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:12.731717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":326,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'92","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.412245+0000","last_change":"2024-09-12T19:00:14.412245+0000","last_active":"2024-09-12T19:00:14.412245+0000","last_peered":"2024-09-12T19:00:14.412245+0000","last_clean":"2024-09-12T19:00:14.412245+0000","last_became_active":"2024-09-12T17:40:20.146160+0000","last_became_peered":"2024-09-12T17:40:20.146160+0000","last_unstale":"2024-09-12T19:00:14.412245+0000","last_undegraded":"2024-09-12T19:00:14.412245+0000","last_fullsized":"2024-09-12T19:00:14.412245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-12T19:00:14.412058+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-12T19:00:14.412058+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.412058+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:06.611295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.851657+0000","last_change":"2024-09-12T19:00:07.851479+0000","last_active":"2024-09-12T19:00:07.851657+0000","last_peered":"2024-09-12T19:00:07.851657+0000","last_clean":"2024-09-12T19:00:07.851657+0000","last_became_active":"2024-09-12T17:40:03.636856+0000","last_became_peered":"2024-09-12T17:40:03.636856+0000","last_unstale":"2024-09-12T19:00:07.851657+0000","last_undegraded":"2024-09-12T19:00:07.851657+0000","last_fullsized":"2024-09-12T19:00:07.851657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T19:00:07.851245+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T19:00:07.851245+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.851245+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:47.311318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.303193+0000","last_change":"2024-09-12T19:00:06.303193+0000","last_active":"2024-09-12T19:00:06.303193+0000","last_peered":"2024-09-12T19:00:06.303193+0000","last_clean":"2024-09-12T19:00:06.303193+0000","last_became_active":"2024-09-12T17:40:09.670674+0000","last_became_peered":"2024-09-12T17:40:09.670674+0000","last_unstale":"2024-09-12T19:00:06.303193+0000","last_undegraded":"2024-09-12T19:00:06.303193+0000","last_fullsized":"2024-09-12T19:00:06.303193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:06.303007+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:06.303007+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.303007+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:00.965061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001302742,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'381","reported_seq":1139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.703311+0000","last_change":"2024-09-12T19:00:05.703311+0000","last_active":"2024-09-12T19:00:05.703311+0000","last_peered":"2024-09-12T19:00:05.703311+0000","last_clean":"2024-09-12T19:00:05.703311+0000","last_became_active":"2024-09-12T17:40:18.774164+0000","last_became_peered":"2024-09-12T17:40:18.774164+0000","last_unstale":"2024-09-12T19:00:05.703311+0000","last_undegraded":"2024-09-12T19:00:05.703311+0000","last_fullsized":"2024-09-12T19:00:05.703311+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-12T19:00:05.703231+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-12T19:00:05.703231+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.703231+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.776143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1557056,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":732,"num_read_kb":41235,"num_write":1123,"num_write_kb":37796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.935647+0000","last_change":"2024-09-12T19:00:26.935647+0000","last_active":"2024-09-12T19:00:26.935647+0000","last_peered":"2024-09-12T19:00:26.935647+0000","last_clean":"2024-09-12T19:00:26.935647+0000","last_became_active":"2024-09-12T17:40:22.148190+0000","last_became_peered":"2024-09-12T17:40:22.148190+0000","last_unstale":"2024-09-12T19:00:26.935647+0000","last_undegraded":"2024-09-12T19:00:26.935647+0000","last_fullsized":"2024-09-12T19:00:26.935647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.935461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.935461+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.935461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:01.083634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'739","reported_seq":1464,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.317276+0000","last_change":"2024-09-12T19:00:29.317143+0000","last_active":"2024-09-12T19:00:29.317276+0000","last_peered":"2024-09-12T19:00:29.317276+0000","last_clean":"2024-09-12T19:00:29.317276+0000","last_became_active":"2024-09-12T17:40:24.176757+0000","last_became_peered":"2024-09-12T17:40:24.176757+0000","last_unstale":"2024-09-12T19:00:29.317276+0000","last_undegraded":"2024-09-12T19:00:29.317276+0000","last_fullsized":"2024-09-12T19:00:29.317276+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'739","last_scrub_stamp":"2024-09-12T19:00:29.316937+0000","last_deep_scrub":"264'739","last_deep_scrub_stamp":"2024-09-12T19:00:29.316937+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.316937+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:55.400378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107902,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1433,"num_read_kb":3342,"num_write":1350,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89038,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.307929+0000","last_change":"2024-09-12T19:00:30.307789+0000","last_active":"2024-09-12T19:00:30.307929+0000","last_peered":"2024-09-12T19:00:30.307929+0000","last_clean":"2024-09-12T19:00:30.307929+0000","last_became_active":"2024-09-12T17:40:26.190522+0000","last_became_peered":"2024-09-12T17:40:26.190522+0000","last_unstale":"2024-09-12T19:00:30.307929+0000","last_undegraded":"2024-09-12T19:00:30.307929+0000","last_fullsized":"2024-09-12T19:00:30.307929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.307597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.307597+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.307597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:45.814039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'199","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.271683+0000","last_change":"2024-09-12T19:00:29.271518+0000","last_active":"2024-09-12T19:00:29.271683+0000","last_peered":"2024-09-12T19:00:29.271683+0000","last_clean":"2024-09-12T19:00:29.271683+0000","last_became_active":"2024-09-12T17:40:28.193456+0000","last_became_peered":"2024-09-12T17:40:28.193456+0000","last_unstale":"2024-09-12T19:00:29.271683+0000","last_undegraded":"2024-09-12T19:00:29.271683+0000","last_fullsized":"2024-09-12T19:00:29.271683+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-12T19:00:29.271294+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-12T19:00:29.271294+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.271294+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:08.895317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":530,"num_write":424,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'121","reported_seq":726,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.359863+0000","last_change":"2024-09-12T19:00:14.359729+0000","last_active":"2024-09-12T19:00:14.359863+0000","last_peered":"2024-09-12T19:00:14.359863+0000","last_clean":"2024-09-12T19:00:14.359863+0000","last_became_active":"2024-09-12T17:40:20.130774+0000","last_became_peered":"2024-09-12T17:40:20.130774+0000","last_unstale":"2024-09-12T19:00:14.359863+0000","last_undegraded":"2024-09-12T19:00:14.359863+0000","last_fullsized":"2024-09-12T19:00:14.359863+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-12T19:00:14.359520+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-12T19:00:14.359520+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.359520+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:27.221397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":441,"num_write":172,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.888185+0000","last_change":"2024-09-12T19:00:16.888004+0000","last_active":"2024-09-12T19:00:16.888185+0000","last_peered":"2024-09-12T19:00:16.888185+0000","last_clean":"2024-09-12T19:00:16.888185+0000","last_became_active":"2024-09-12T17:40:09.666272+0000","last_became_peered":"2024-09-12T17:40:09.666272+0000","last_unstale":"2024-09-12T19:00:16.888185+0000","last_undegraded":"2024-09-12T19:00:16.888185+0000","last_fullsized":"2024-09-12T19:00:16.888185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:16.887821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:16.887821+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.887821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:53.458174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001052545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'381","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:03.380638+0000","last_change":"2024-09-12T19:00:03.380638+0000","last_active":"2024-09-12T19:00:03.380638+0000","last_peered":"2024-09-12T19:00:03.380638+0000","last_clean":"2024-09-12T19:00:03.380638+0000","last_became_active":"2024-09-12T17:40:18.774751+0000","last_became_peered":"2024-09-12T17:40:18.774751+0000","last_unstale":"2024-09-12T19:00:03.380638+0000","last_undegraded":"2024-09-12T19:00:03.380638+0000","last_fullsized":"2024-09-12T19:00:03.380638+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-12T19:00:03.380508+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-12T19:00:03.380508+0000","last_clean_scrub_stamp":"2024-09-12T19:00:03.380508+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:57.346685+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":730,"num_write":1215,"num_write_kb":17029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.340588+0000","last_change":"2024-09-12T19:00:23.340365+0000","last_active":"2024-09-12T19:00:23.340588+0000","last_peered":"2024-09-12T19:00:23.340588+0000","last_clean":"2024-09-12T19:00:23.340588+0000","last_became_active":"2024-09-12T17:40:22.147184+0000","last_became_peered":"2024-09-12T17:40:22.147184+0000","last_unstale":"2024-09-12T19:00:23.340588+0000","last_undegraded":"2024-09-12T19:00:23.340588+0000","last_fullsized":"2024-09-12T19:00:23.340588+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.340151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.340151+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.340151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:44.036811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1357","reported_seq":3273,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.312642+0000","last_change":"2024-09-12T19:00:25.312642+0000","last_active":"2024-09-12T19:00:25.312642+0000","last_peered":"2024-09-12T19:00:25.312642+0000","last_clean":"2024-09-12T19:00:25.312642+0000","last_became_active":"2024-09-12T17:40:24.169050+0000","last_became_peered":"2024-09-12T17:40:24.169050+0000","last_unstale":"2024-09-12T19:00:25.312642+0000","last_undegraded":"2024-09-12T19:00:25.312642+0000","last_fullsized":"2024-09-12T19:00:25.312642+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1357","last_scrub_stamp":"2024-09-12T19:00:25.312325+0000","last_deep_scrub":"264'1357","last_deep_scrub_stamp":"2024-09-12T19:00:25.312325+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.312325+0000","objects_scrubbed":12,"log_size":57,"log_dups_size":1300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:35.859451+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147644,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2159,"num_read_kb":4153,"num_write":1266,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.827311+0000","last_change":"2024-09-12T19:00:33.827311+0000","last_active":"2024-09-12T19:00:33.827311+0000","last_peered":"2024-09-12T19:00:33.827311+0000","last_clean":"2024-09-12T19:00:33.827311+0000","last_became_active":"2024-09-12T17:40:26.202360+0000","last_became_peered":"2024-09-12T17:40:26.202360+0000","last_unstale":"2024-09-12T19:00:33.827311+0000","last_undegraded":"2024-09-12T19:00:33.827311+0000","last_fullsized":"2024-09-12T19:00:33.827311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:33.827129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:33.827129+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.827129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:10.410127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'193","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.423960+0000","last_change":"2024-09-12T19:00:37.423960+0000","last_active":"2024-09-12T19:00:37.423960+0000","last_peered":"2024-09-12T19:00:37.423960+0000","last_clean":"2024-09-12T19:00:37.423960+0000","last_became_active":"2024-09-12T17:40:28.189387+0000","last_became_peered":"2024-09-12T17:40:28.189387+0000","last_unstale":"2024-09-12T19:00:37.423960+0000","last_undegraded":"2024-09-12T19:00:37.423960+0000","last_fullsized":"2024-09-12T19:00:37.423960+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-12T19:00:37.423750+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-12T19:00:37.423750+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.423750+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:40.018773+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":364,"num_write":413,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'193","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.427674+0000","last_change":"2024-09-12T19:00:14.427403+0000","last_active":"2024-09-12T19:00:14.427674+0000","last_peered":"2024-09-12T19:00:14.427674+0000","last_clean":"2024-09-12T19:00:14.427674+0000","last_became_active":"2024-09-12T17:40:20.129646+0000","last_became_peered":"2024-09-12T17:40:20.129646+0000","last_unstale":"2024-09-12T19:00:14.427674+0000","last_undegraded":"2024-09-12T19:00:14.427674+0000","last_fullsized":"2024-09-12T19:00:14.427674+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-12T19:00:14.427181+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-12T19:00:14.427181+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.427181+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:07.543026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":706,"num_write":294,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.575456+0000","last_change":"2024-09-12T19:00:05.575456+0000","last_active":"2024-09-12T19:00:05.575456+0000","last_peered":"2024-09-12T19:00:05.575456+0000","last_clean":"2024-09-12T19:00:05.575456+0000","last_became_active":"2024-09-12T17:40:09.771196+0000","last_became_peered":"2024-09-12T17:40:09.771196+0000","last_unstale":"2024-09-12T19:00:05.575456+0000","last_undegraded":"2024-09-12T19:00:05.575456+0000","last_fullsized":"2024-09-12T19:00:05.575456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:05.575379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:05.575379+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.575379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:05.851170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010655720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'333","reported_seq":1036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.412121+0000","last_change":"2024-09-12T19:00:05.412049+0000","last_active":"2024-09-12T19:00:05.412121+0000","last_peered":"2024-09-12T19:00:05.412121+0000","last_clean":"2024-09-12T19:00:05.412121+0000","last_became_active":"2024-09-12T17:40:18.759514+0000","last_became_peered":"2024-09-12T17:40:18.759514+0000","last_unstale":"2024-09-12T19:00:05.412121+0000","last_undegraded":"2024-09-12T19:00:05.412121+0000","last_fullsized":"2024-09-12T19:00:05.412121+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-12T19:00:05.411956+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-12T19:00:05.411956+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.411956+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:48.630492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1491790,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":20357,"num_write":1029,"num_write_kb":29003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.647771+0000","last_change":"2024-09-12T19:00:12.647430+0000","last_active":"2024-09-12T19:00:12.647771+0000","last_peered":"2024-09-12T19:00:12.647771+0000","last_clean":"2024-09-12T19:00:12.647771+0000","last_became_active":"2024-09-12T17:40:22.138606+0000","last_became_peered":"2024-09-12T17:40:22.138606+0000","last_unstale":"2024-09-12T19:00:12.647771+0000","last_undegraded":"2024-09-12T19:00:12.647771+0000","last_fullsized":"2024-09-12T19:00:12.647771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:12.647148+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:12.647148+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.647148+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:08.127072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'303","reported_seq":1819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.954465+0000","last_change":"2024-09-12T19:00:28.954465+0000","last_active":"2024-09-12T19:00:28.954465+0000","last_peered":"2024-09-12T19:00:28.954465+0000","last_clean":"2024-09-12T19:00:28.954465+0000","last_became_active":"2024-09-12T17:40:24.329425+0000","last_became_peered":"2024-09-12T17:40:24.329425+0000","last_unstale":"2024-09-12T19:00:28.954465+0000","last_undegraded":"2024-09-12T19:00:28.954465+0000","last_fullsized":"2024-09-12T19:00:28.954465+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-12T19:00:28.954269+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-12T19:00:28.954269+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.954269+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:32.215543+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":264,"num_read_kb":256,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.354987+0000","last_change":"2024-09-12T19:00:35.354987+0000","last_active":"2024-09-12T19:00:35.354987+0000","last_peered":"2024-09-12T19:00:35.354987+0000","last_clean":"2024-09-12T19:00:35.354987+0000","last_became_active":"2024-09-12T17:40:26.188740+0000","last_became_peered":"2024-09-12T17:40:26.188740+0000","last_unstale":"2024-09-12T19:00:35.354987+0000","last_undegraded":"2024-09-12T19:00:35.354987+0000","last_fullsized":"2024-09-12T19:00:35.354987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:35.354801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:35.354801+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.354801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:02.362356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'273","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.791677+0000","last_change":"2024-09-12T19:00:41.791677+0000","last_active":"2024-09-12T19:00:41.791677+0000","last_peered":"2024-09-12T19:00:41.791677+0000","last_clean":"2024-09-12T19:00:41.791677+0000","last_became_active":"2024-09-12T17:40:28.202238+0000","last_became_peered":"2024-09-12T17:40:28.202238+0000","last_unstale":"2024-09-12T19:00:41.791677+0000","last_undegraded":"2024-09-12T19:00:41.791677+0000","last_fullsized":"2024-09-12T19:00:41.791677+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-12T19:00:41.791464+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-12T19:00:41.791464+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.791464+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:50.967702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":592,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'389","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.365530+0000","last_change":"2024-09-12T19:00:16.365530+0000","last_active":"2024-09-12T19:00:16.365530+0000","last_peered":"2024-09-12T19:00:16.365530+0000","last_clean":"2024-09-12T19:00:16.365530+0000","last_became_active":"2024-09-12T17:40:20.127774+0000","last_became_peered":"2024-09-12T17:40:20.127774+0000","last_unstale":"2024-09-12T19:00:16.365530+0000","last_undegraded":"2024-09-12T19:00:16.365530+0000","last_fullsized":"2024-09-12T19:00:16.365530+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'389","last_scrub_stamp":"2024-09-12T19:00:16.365337+0000","last_deep_scrub":"264'389","last_deep_scrub_stamp":"2024-09-12T19:00:16.365337+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.365337+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:35.682974+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1689,"num_read_kb":1329,"num_write":647,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":733,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.329130+0000","last_change":"2024-09-12T19:00:07.329130+0000","last_active":"2024-09-12T19:00:07.329130+0000","last_peered":"2024-09-12T19:00:07.329130+0000","last_clean":"2024-09-12T19:00:07.329130+0000","last_became_active":"2024-09-12T17:40:09.672745+0000","last_became_peered":"2024-09-12T17:40:09.672745+0000","last_unstale":"2024-09-12T19:00:07.329130+0000","last_undegraded":"2024-09-12T19:00:07.329130+0000","last_fullsized":"2024-09-12T19:00:07.329130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:07.328927+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:07.328927+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.328927+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:19.924413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002775694,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'386","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.822955+0000","last_change":"2024-09-12T19:00:05.822955+0000","last_active":"2024-09-12T19:00:05.822955+0000","last_peered":"2024-09-12T19:00:05.822955+0000","last_clean":"2024-09-12T19:00:05.822955+0000","last_became_active":"2024-09-12T17:40:18.769909+0000","last_became_peered":"2024-09-12T17:40:18.769909+0000","last_unstale":"2024-09-12T19:00:05.822955+0000","last_undegraded":"2024-09-12T19:00:05.822955+0000","last_fullsized":"2024-09-12T19:00:05.822955+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'386","last_scrub_stamp":"2024-09-12T19:00:05.822732+0000","last_deep_scrub":"264'386","last_deep_scrub_stamp":"2024-09-12T19:00:05.822732+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.822732+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:20.836010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":740079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":12377,"num_write":1306,"num_write_kb":22203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.344459+0000","last_change":"2024-09-12T19:00:23.344459+0000","last_active":"2024-09-12T19:00:23.344459+0000","last_peered":"2024-09-12T19:00:23.344459+0000","last_clean":"2024-09-12T19:00:23.344459+0000","last_became_active":"2024-09-12T17:40:22.145410+0000","last_became_peered":"2024-09-12T17:40:22.145410+0000","last_unstale":"2024-09-12T19:00:23.344459+0000","last_undegraded":"2024-09-12T19:00:23.344459+0000","last_fullsized":"2024-09-12T19:00:23.344459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.344276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.344276+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.344276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:27.422058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'169","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.726655+0000","last_change":"2024-09-12T19:00:28.726514+0000","last_active":"2024-09-12T19:00:28.726655+0000","last_peered":"2024-09-12T19:00:28.726655+0000","last_clean":"2024-09-12T19:00:28.726655+0000","last_became_active":"2024-09-12T17:40:24.169937+0000","last_became_peered":"2024-09-12T17:40:24.169937+0000","last_unstale":"2024-09-12T19:00:28.726655+0000","last_undegraded":"2024-09-12T19:00:28.726655+0000","last_fullsized":"2024-09-12T19:00:28.726655+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-12T19:00:28.726336+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-12T19:00:28.726336+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.726336+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:14.806353+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":193,"num_write":146,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.372733+0000","last_change":"2024-09-12T19:00:21.372606+0000","last_active":"2024-09-12T19:00:21.372733+0000","last_peered":"2024-09-12T19:00:21.372733+0000","last_clean":"2024-09-12T19:00:21.372733+0000","last_became_active":"2024-09-12T17:40:26.171660+0000","last_became_peered":"2024-09-12T17:40:26.171660+0000","last_unstale":"2024-09-12T19:00:21.372733+0000","last_undegraded":"2024-09-12T19:00:21.372733+0000","last_fullsized":"2024-09-12T19:00:21.372733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.372426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.372426+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.372426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:44.988743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'123","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.259951+0000","last_change":"2024-09-12T19:00:37.259703+0000","last_active":"2024-09-12T19:00:37.259951+0000","last_peered":"2024-09-12T19:00:37.259951+0000","last_clean":"2024-09-12T19:00:37.259951+0000","last_became_active":"2024-09-12T17:40:28.201694+0000","last_became_peered":"2024-09-12T17:40:28.201694+0000","last_unstale":"2024-09-12T19:00:37.259951+0000","last_undegraded":"2024-09-12T19:00:37.259951+0000","last_fullsized":"2024-09-12T19:00:37.259951+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-09-12T19:00:37.259452+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-09-12T19:00:37.259452+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.259452+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:06.026195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":250,"num_write":312,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'144","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.402435+0000","last_change":"2024-09-12T19:00:13.402435+0000","last_active":"2024-09-12T19:00:13.402435+0000","last_peered":"2024-09-12T19:00:13.402435+0000","last_clean":"2024-09-12T19:00:13.402435+0000","last_became_active":"2024-09-12T17:40:20.127727+0000","last_became_peered":"2024-09-12T17:40:20.127727+0000","last_unstale":"2024-09-12T19:00:13.402435+0000","last_undegraded":"2024-09-12T19:00:13.402435+0000","last_fullsized":"2024-09-12T19:00:13.402435+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:13.402249+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:13.402249+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.402249+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:53.064547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":625,"num_read_kb":513,"num_write":241,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'316","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.312786+0000","last_change":"2024-09-12T19:00:08.312786+0000","last_active":"2024-09-12T19:00:08.312786+0000","last_peered":"2024-09-12T19:00:08.312786+0000","last_clean":"2024-09-12T19:00:08.312786+0000","last_became_active":"2024-09-12T17:40:18.768544+0000","last_became_peered":"2024-09-12T17:40:18.768544+0000","last_unstale":"2024-09-12T19:00:08.312786+0000","last_undegraded":"2024-09-12T19:00:08.312786+0000","last_fullsized":"2024-09-12T19:00:08.312786+0000","mapping_epoch":23,"log_start":"264'301","ondisk_log_start":"264'301","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T19:00:08.312642+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T19:00:08.312642+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.312642+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":301,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:52.360053+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":425,"num_read_kb":64899,"num_write":927,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.370168+0000","last_change":"2024-09-12T19:00:06.370168+0000","last_active":"2024-09-12T19:00:06.370168+0000","last_peered":"2024-09-12T19:00:06.370168+0000","last_clean":"2024-09-12T19:00:06.370168+0000","last_became_active":"2024-09-12T17:40:09.770645+0000","last_became_peered":"2024-09-12T17:40:09.770645+0000","last_unstale":"2024-09-12T19:00:06.370168+0000","last_undegraded":"2024-09-12T19:00:06.370168+0000","last_fullsized":"2024-09-12T19:00:06.370168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.370093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.370093+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.370093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:21.045928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091158000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.368257+0000","last_change":"2024-09-12T19:00:22.368257+0000","last_active":"2024-09-12T19:00:22.368257+0000","last_peered":"2024-09-12T19:00:22.368257+0000","last_clean":"2024-09-12T19:00:22.368257+0000","last_became_active":"2024-09-12T17:40:22.136155+0000","last_became_peered":"2024-09-12T17:40:22.136155+0000","last_unstale":"2024-09-12T19:00:22.368257+0000","last_undegraded":"2024-09-12T19:00:22.368257+0000","last_fullsized":"2024-09-12T19:00:22.368257+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.368076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.368076+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.368076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.095079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'658","reported_seq":1363,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.401099+0000","last_change":"2024-09-12T19:00:25.400934+0000","last_active":"2024-09-12T19:00:25.401099+0000","last_peered":"2024-09-12T19:00:25.401099+0000","last_clean":"2024-09-12T19:00:25.401099+0000","last_became_active":"2024-09-12T17:40:24.173380+0000","last_became_peered":"2024-09-12T17:40:24.173380+0000","last_unstale":"2024-09-12T19:00:25.401099+0000","last_undegraded":"2024-09-12T19:00:25.401099+0000","last_fullsized":"2024-09-12T19:00:25.401099+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'658","last_scrub_stamp":"2024-09-12T19:00:25.400715+0000","last_deep_scrub":"264'658","last_deep_scrub_stamp":"2024-09-12T19:00:25.400715+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.400715+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:19.643462+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106768,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":3034,"num_write":2200,"num_write_kb":2020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500800,"num_omap_keys":1132,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.928929+0000","last_change":"2024-09-12T19:00:35.928929+0000","last_active":"2024-09-12T19:00:35.928929+0000","last_peered":"2024-09-12T19:00:35.928929+0000","last_clean":"2024-09-12T19:00:35.928929+0000","last_became_active":"2024-09-12T17:40:26.191417+0000","last_became_peered":"2024-09-12T17:40:26.191417+0000","last_unstale":"2024-09-12T19:00:35.928929+0000","last_undegraded":"2024-09-12T19:00:35.928929+0000","last_fullsized":"2024-09-12T19:00:35.928929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:35.928742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:35.928742+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.928742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:13.337364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'177","reported_seq":715,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.300628+0000","last_change":"2024-09-12T19:00:39.300628+0000","last_active":"2024-09-12T19:00:39.300628+0000","last_peered":"2024-09-12T19:00:39.300628+0000","last_clean":"2024-09-12T19:00:39.300628+0000","last_became_active":"2024-09-12T17:40:28.186922+0000","last_became_peered":"2024-09-12T17:40:28.186922+0000","last_unstale":"2024-09-12T19:00:39.300628+0000","last_undegraded":"2024-09-12T19:00:39.300628+0000","last_fullsized":"2024-09-12T19:00:39.300628+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T19:00:39.300439+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T19:00:39.300439+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.300439+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:10.112573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'144","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.343342+0000","last_change":"2024-09-12T19:00:13.343342+0000","last_active":"2024-09-12T19:00:13.343342+0000","last_peered":"2024-09-12T19:00:13.343342+0000","last_clean":"2024-09-12T19:00:13.343342+0000","last_became_active":"2024-09-12T17:40:20.112490+0000","last_became_peered":"2024-09-12T17:40:20.112490+0000","last_unstale":"2024-09-12T19:00:13.343342+0000","last_undegraded":"2024-09-12T19:00:13.343342+0000","last_fullsized":"2024-09-12T19:00:13.343342+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:13.343164+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:13.343164+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.343164+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:03.480373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":606,"num_read_kb":504,"num_write":208,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'318","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.356400+0000","last_change":"2024-09-12T19:00:09.356400+0000","last_active":"2024-09-12T19:00:09.356400+0000","last_peered":"2024-09-12T19:00:09.356400+0000","last_clean":"2024-09-12T19:00:09.356400+0000","last_became_active":"2024-09-12T17:40:18.760130+0000","last_became_peered":"2024-09-12T17:40:18.760130+0000","last_unstale":"2024-09-12T19:00:09.356400+0000","last_undegraded":"2024-09-12T19:00:09.356400+0000","last_fullsized":"2024-09-12T19:00:09.356400+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-12T19:00:09.356157+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-12T19:00:09.356157+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.356157+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:59.332713+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359201,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":428,"num_read_kb":2118,"num_write":932,"num_write_kb":13193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.862213+0000","last_change":"2024-09-12T19:00:06.862213+0000","last_active":"2024-09-12T19:00:06.862213+0000","last_peered":"2024-09-12T19:00:06.862213+0000","last_clean":"2024-09-12T19:00:06.862213+0000","last_became_active":"2024-09-12T17:40:09.770504+0000","last_became_peered":"2024-09-12T17:40:09.770504+0000","last_unstale":"2024-09-12T19:00:06.862213+0000","last_undegraded":"2024-09-12T19:00:06.862213+0000","last_fullsized":"2024-09-12T19:00:06.862213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.862012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.862012+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.862012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:25.645802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001093257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.417289+0000","last_change":"2024-09-12T19:00:19.417289+0000","last_active":"2024-09-12T19:00:19.417289+0000","last_peered":"2024-09-12T19:00:19.417289+0000","last_clean":"2024-09-12T19:00:19.417289+0000","last_became_active":"2024-09-12T17:40:22.136095+0000","last_became_peered":"2024-09-12T17:40:22.136095+0000","last_unstale":"2024-09-12T19:00:19.417289+0000","last_undegraded":"2024-09-12T19:00:19.417289+0000","last_fullsized":"2024-09-12T19:00:19.417289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:19.417107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:19.417107+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.417107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:24.668335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'263","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.374917+0000","last_change":"2024-09-12T19:00:28.374917+0000","last_active":"2024-09-12T19:00:28.374917+0000","last_peered":"2024-09-12T19:00:28.374917+0000","last_clean":"2024-09-12T19:00:28.374917+0000","last_became_active":"2024-09-12T17:40:24.332477+0000","last_became_peered":"2024-09-12T17:40:24.332477+0000","last_unstale":"2024-09-12T19:00:28.374917+0000","last_undegraded":"2024-09-12T19:00:28.374917+0000","last_fullsized":"2024-09-12T19:00:28.374917+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-09-12T19:00:28.374594+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-09-12T19:00:28.374594+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.374594+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:33.713209+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":296,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'760","reported_seq":3106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.209433+0000","last_change":"2024-09-12T19:00:33.209275+0000","last_active":"2024-09-12T19:00:33.209433+0000","last_peered":"2024-09-12T19:00:33.209433+0000","last_clean":"2024-09-12T19:00:33.209433+0000","last_became_active":"2024-09-12T17:40:26.179728+0000","last_became_peered":"2024-09-12T17:40:26.179728+0000","last_unstale":"2024-09-12T19:00:33.209433+0000","last_undegraded":"2024-09-12T19:00:33.209433+0000","last_fullsized":"2024-09-12T19:00:33.209433+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'760","last_scrub_stamp":"2024-09-12T19:00:33.209091+0000","last_deep_scrub":"264'760","last_deep_scrub_stamp":"2024-09-12T19:00:33.209091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.209091+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:21.534199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'149","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.767198+0000","last_change":"2024-09-12T19:00:40.767198+0000","last_active":"2024-09-12T19:00:40.767198+0000","last_peered":"2024-09-12T19:00:40.767198+0000","last_clean":"2024-09-12T19:00:40.767198+0000","last_became_active":"2024-09-12T17:40:28.201571+0000","last_became_peered":"2024-09-12T17:40:28.201571+0000","last_unstale":"2024-09-12T19:00:40.767198+0000","last_undegraded":"2024-09-12T19:00:40.767198+0000","last_fullsized":"2024-09-12T19:00:40.767198+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T19:00:40.767001+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T19:00:40.767001+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.767001+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:36.748244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":253,"num_write":364,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'450","reported_seq":1172,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.610597+0000","last_change":"2024-09-12T19:00:13.610343+0000","last_active":"2024-09-12T19:00:13.610597+0000","last_peered":"2024-09-12T19:00:13.610597+0000","last_clean":"2024-09-12T19:00:13.610597+0000","last_became_active":"2024-09-12T17:40:20.135950+0000","last_became_peered":"2024-09-12T17:40:20.135950+0000","last_unstale":"2024-09-12T19:00:13.610597+0000","last_undegraded":"2024-09-12T19:00:13.610597+0000","last_fullsized":"2024-09-12T19:00:13.610597+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'450","last_scrub_stamp":"2024-09-12T19:00:13.610072+0000","last_deep_scrub":"264'450","last_deep_scrub_stamp":"2024-09-12T19:00:13.610072+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.610072+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:40.560388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1875,"num_read_kb":1500,"num_write":660,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'335","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.674839+0000","last_change":"2024-09-12T19:00:04.674790+0000","last_active":"2024-09-12T19:00:04.674839+0000","last_peered":"2024-09-12T19:00:04.674839+0000","last_clean":"2024-09-12T19:00:04.674839+0000","last_became_active":"2024-09-12T17:40:18.762324+0000","last_became_peered":"2024-09-12T17:40:18.762324+0000","last_unstale":"2024-09-12T19:00:04.674839+0000","last_undegraded":"2024-09-12T19:00:04.674839+0000","last_fullsized":"2024-09-12T19:00:04.674839+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T19:00:04.674691+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T19:00:04.674691+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.674691+0000","objects_scrubbed":10,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:30.535201+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651838,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":496,"num_read_kb":85957,"num_write":1018,"num_write_kb":37704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.356092+0000","last_change":"2024-09-12T19:00:04.355848+0000","last_active":"2024-09-12T19:00:04.356092+0000","last_peered":"2024-09-12T19:00:04.356092+0000","last_clean":"2024-09-12T19:00:04.356092+0000","last_became_active":"2024-09-12T17:40:09.671019+0000","last_became_peered":"2024-09-12T17:40:09.671019+0000","last_unstale":"2024-09-12T19:00:04.356092+0000","last_undegraded":"2024-09-12T19:00:04.356092+0000","last_fullsized":"2024-09-12T19:00:04.356092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:04.355617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:04.355617+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.355617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:55.946006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096571,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.917725+0000","last_change":"2024-09-12T19:00:27.917725+0000","last_active":"2024-09-12T19:00:27.917725+0000","last_peered":"2024-09-12T19:00:27.917725+0000","last_clean":"2024-09-12T19:00:27.917725+0000","last_became_active":"2024-09-12T17:40:22.146131+0000","last_became_peered":"2024-09-12T17:40:22.146131+0000","last_unstale":"2024-09-12T19:00:27.917725+0000","last_undegraded":"2024-09-12T19:00:27.917725+0000","last_fullsized":"2024-09-12T19:00:27.917725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:27.917530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:27.917530+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.917530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:21.943314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'140","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.982000+0000","last_change":"2024-09-12T19:00:30.982000+0000","last_active":"2024-09-12T19:00:30.982000+0000","last_peered":"2024-09-12T19:00:30.982000+0000","last_clean":"2024-09-12T19:00:30.982000+0000","last_became_active":"2024-09-12T17:40:24.163566+0000","last_became_peered":"2024-09-12T17:40:24.163566+0000","last_unstale":"2024-09-12T19:00:30.982000+0000","last_undegraded":"2024-09-12T19:00:30.982000+0000","last_fullsized":"2024-09-12T19:00:30.982000+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-12T19:00:30.981801+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-12T19:00:30.981801+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.981801+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:33.987008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'788","reported_seq":2833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.751402+0000","last_change":"2024-09-12T19:00:36.751402+0000","last_active":"2024-09-12T19:00:36.751402+0000","last_peered":"2024-09-12T19:00:36.751402+0000","last_clean":"2024-09-12T19:00:36.751402+0000","last_became_active":"2024-09-12T17:40:26.194293+0000","last_became_peered":"2024-09-12T17:40:26.194293+0000","last_unstale":"2024-09-12T19:00:36.751402+0000","last_undegraded":"2024-09-12T19:00:36.751402+0000","last_fullsized":"2024-09-12T19:00:36.751402+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'788","last_scrub_stamp":"2024-09-12T19:00:36.751181+0000","last_deep_scrub":"264'788","last_deep_scrub_stamp":"2024-09-12T19:00:36.751181+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.751181+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:42.437380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'202","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.303698+0000","last_change":"2024-09-12T19:00:38.303698+0000","last_active":"2024-09-12T19:00:38.303698+0000","last_peered":"2024-09-12T19:00:38.303698+0000","last_clean":"2024-09-12T19:00:38.303698+0000","last_became_active":"2024-09-12T17:40:28.207048+0000","last_became_peered":"2024-09-12T17:40:28.207048+0000","last_unstale":"2024-09-12T19:00:38.303698+0000","last_undegraded":"2024-09-12T19:00:38.303698+0000","last_fullsized":"2024-09-12T19:00:38.303698+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-09-12T19:00:38.303469+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-09-12T19:00:38.303469+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.303469+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:54.874761+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":318,"num_write":457,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'86","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.883647+0000","last_change":"2024-09-12T19:00:13.883647+0000","last_active":"2024-09-12T19:00:13.883647+0000","last_peered":"2024-09-12T19:00:13.883647+0000","last_clean":"2024-09-12T19:00:13.883647+0000","last_became_active":"2024-09-12T17:40:20.142323+0000","last_became_peered":"2024-09-12T17:40:20.142323+0000","last_unstale":"2024-09-12T19:00:13.883647+0000","last_undegraded":"2024-09-12T19:00:13.883647+0000","last_fullsized":"2024-09-12T19:00:13.883647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T19:00:13.883445+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T19:00:13.883445+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.883445+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:31.548172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":391,"num_read_kb":327,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'428","reported_seq":1218,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.396943+0000","last_change":"2024-09-12T19:00:04.396668+0000","last_active":"2024-09-12T19:00:04.396943+0000","last_peered":"2024-09-12T19:00:04.396943+0000","last_clean":"2024-09-12T19:00:04.396943+0000","last_became_active":"2024-09-12T17:40:18.766817+0000","last_became_peered":"2024-09-12T17:40:18.766817+0000","last_unstale":"2024-09-12T19:00:04.396943+0000","last_undegraded":"2024-09-12T19:00:04.396943+0000","last_fullsized":"2024-09-12T19:00:04.396943+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-12T19:00:04.396400+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-12T19:00:04.396400+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.396400+0000","objects_scrubbed":10,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:18.046636+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4983875,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":942,"num_read_kb":8527,"num_write":1357,"num_write_kb":43864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.360350+0000","last_change":"2024-09-12T19:00:06.360220+0000","last_active":"2024-09-12T19:00:06.360350+0000","last_peered":"2024-09-12T19:00:06.360350+0000","last_clean":"2024-09-12T19:00:06.360350+0000","last_became_active":"2024-09-12T17:40:09.674331+0000","last_became_peered":"2024-09-12T17:40:09.674331+0000","last_unstale":"2024-09-12T19:00:06.360350+0000","last_undegraded":"2024-09-12T19:00:06.360350+0000","last_fullsized":"2024-09-12T19:00:06.360350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.360038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.360038+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.360038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:41.602732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012562929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.628096+0000","last_change":"2024-09-12T19:00:21.627955+0000","last_active":"2024-09-12T19:00:21.628096+0000","last_peered":"2024-09-12T19:00:21.628096+0000","last_clean":"2024-09-12T19:00:21.628096+0000","last_became_active":"2024-09-12T17:40:22.147341+0000","last_became_peered":"2024-09-12T17:40:22.147341+0000","last_unstale":"2024-09-12T19:00:21.628096+0000","last_undegraded":"2024-09-12T19:00:21.628096+0000","last_fullsized":"2024-09-12T19:00:21.628096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.627773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.627773+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.627773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:41.060971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'794","reported_seq":1547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.993031+0000","last_change":"2024-09-12T19:00:27.993031+0000","last_active":"2024-09-12T19:00:27.993031+0000","last_peered":"2024-09-12T19:00:27.993031+0000","last_clean":"2024-09-12T19:00:27.993031+0000","last_became_active":"2024-09-12T17:40:24.329314+0000","last_became_peered":"2024-09-12T17:40:24.329314+0000","last_unstale":"2024-09-12T19:00:27.993031+0000","last_undegraded":"2024-09-12T19:00:27.993031+0000","last_fullsized":"2024-09-12T19:00:27.993031+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-09-12T19:00:27.992823+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-09-12T19:00:27.992823+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.992823+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:08.998967+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1403,"num_read_kb":3378,"num_write":1144,"num_write_kb":925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.761641+0000","last_change":"2024-09-12T19:00:34.761641+0000","last_active":"2024-09-12T19:00:34.761641+0000","last_peered":"2024-09-12T19:00:34.761641+0000","last_clean":"2024-09-12T19:00:34.761641+0000","last_became_active":"2024-09-12T17:40:26.197718+0000","last_became_peered":"2024-09-12T17:40:26.197718+0000","last_unstale":"2024-09-12T19:00:34.761641+0000","last_undegraded":"2024-09-12T19:00:34.761641+0000","last_fullsized":"2024-09-12T19:00:34.761641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.761433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.761433+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.761433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:18.548460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'119","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.301208+0000","last_change":"2024-09-12T19:00:38.301208+0000","last_active":"2024-09-12T19:00:38.301208+0000","last_peered":"2024-09-12T19:00:38.301208+0000","last_clean":"2024-09-12T19:00:38.301208+0000","last_became_active":"2024-09-12T17:40:28.199295+0000","last_became_peered":"2024-09-12T17:40:28.199295+0000","last_unstale":"2024-09-12T19:00:38.301208+0000","last_undegraded":"2024-09-12T19:00:38.301208+0000","last_fullsized":"2024-09-12T19:00:38.301208+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T19:00:38.300989+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T19:00:38.300989+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.300989+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:21.748465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":147,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'108","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.325770+0000","last_change":"2024-09-12T19:00:42.325770+0000","last_active":"2024-09-12T19:00:42.325770+0000","last_peered":"2024-09-12T19:00:42.325770+0000","last_clean":"2024-09-12T19:00:42.325770+0000","last_became_active":"2024-09-12T17:40:28.192019+0000","last_became_peered":"2024-09-12T17:40:28.192019+0000","last_unstale":"2024-09-12T19:00:42.325770+0000","last_undegraded":"2024-09-12T19:00:42.325770+0000","last_fullsized":"2024-09-12T19:00:42.325770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'108","last_scrub_stamp":"2024-09-12T19:00:42.325587+0000","last_deep_scrub":"264'108","last_deep_scrub_stamp":"2024-09-12T19:00:42.325587+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.325587+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:11.590573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":192,"num_write":225,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'111","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.848789+0000","last_change":"2024-09-12T19:00:12.848789+0000","last_active":"2024-09-12T19:00:12.848789+0000","last_peered":"2024-09-12T19:00:12.848789+0000","last_clean":"2024-09-12T19:00:12.848789+0000","last_became_active":"2024-09-12T17:40:20.135868+0000","last_became_peered":"2024-09-12T17:40:20.135868+0000","last_unstale":"2024-09-12T19:00:12.848789+0000","last_undegraded":"2024-09-12T19:00:12.848789+0000","last_fullsized":"2024-09-12T19:00:12.848789+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'111","last_scrub_stamp":"2024-09-12T19:00:12.848609+0000","last_deep_scrub":"264'111","last_deep_scrub_stamp":"2024-09-12T19:00:12.848609+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.848609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:47.505689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":445,"num_write":160,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'289","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.773680+0000","last_change":"2024-09-12T19:00:07.773680+0000","last_active":"2024-09-12T19:00:07.773680+0000","last_peered":"2024-09-12T19:00:07.773680+0000","last_clean":"2024-09-12T19:00:07.773680+0000","last_became_active":"2024-09-12T17:40:18.788674+0000","last_became_peered":"2024-09-12T17:40:18.788674+0000","last_unstale":"2024-09-12T19:00:07.773680+0000","last_undegraded":"2024-09-12T19:00:07.773680+0000","last_fullsized":"2024-09-12T19:00:07.773680+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-12T19:00:07.773396+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-12T19:00:07.773396+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.773396+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:22.864639+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117782,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":10615,"num_write":904,"num_write_kb":14901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.325270+0000","last_change":"2024-09-12T19:00:21.325270+0000","last_active":"2024-09-12T19:00:21.325270+0000","last_peered":"2024-09-12T19:00:21.325270+0000","last_clean":"2024-09-12T19:00:21.325270+0000","last_became_active":"2024-09-12T17:40:22.141326+0000","last_became_peered":"2024-09-12T17:40:22.141326+0000","last_unstale":"2024-09-12T19:00:21.325270+0000","last_undegraded":"2024-09-12T19:00:21.325270+0000","last_fullsized":"2024-09-12T19:00:21.325270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.325088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.325088+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.325088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:11.574471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'309","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.735075+0000","last_change":"2024-09-12T19:00:30.735075+0000","last_active":"2024-09-12T19:00:30.735075+0000","last_peered":"2024-09-12T19:00:30.735075+0000","last_clean":"2024-09-12T19:00:30.735075+0000","last_became_active":"2024-09-12T17:40:24.169248+0000","last_became_peered":"2024-09-12T17:40:24.169248+0000","last_unstale":"2024-09-12T19:00:30.735075+0000","last_undegraded":"2024-09-12T19:00:30.735075+0000","last_fullsized":"2024-09-12T19:00:30.735075+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-09-12T19:00:30.734871+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-09-12T19:00:30.734871+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.734871+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:57.413664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1219,"num_write":420,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.712706+0000","last_change":"2024-09-12T19:00:38.712706+0000","last_active":"2024-09-12T19:00:38.712706+0000","last_peered":"2024-09-12T19:00:38.712706+0000","last_clean":"2024-09-12T19:00:38.712706+0000","last_became_active":"2024-09-12T17:40:26.203855+0000","last_became_peered":"2024-09-12T17:40:26.203855+0000","last_unstale":"2024-09-12T19:00:38.712706+0000","last_undegraded":"2024-09-12T19:00:38.712706+0000","last_fullsized":"2024-09-12T19:00:38.712706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:38.712521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:38.712521+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.712521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:52.759517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:32.597637+0000","last_change":"2024-09-12T17:40:28.205116+0000","last_active":"2024-09-12T18:57:32.597637+0000","last_peered":"2024-09-12T18:57:32.597637+0000","last_clean":"2024-09-12T18:57:32.597637+0000","last_became_active":"2024-09-12T17:40:28.204204+0000","last_became_peered":"2024-09-12T17:40:28.204204+0000","last_unstale":"2024-09-12T18:57:32.597637+0000","last_undegraded":"2024-09-12T18:57:32.597637+0000","last_fullsized":"2024-09-12T18:57:32.597637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:13.281028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":252,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'238","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.393511+0000","last_change":"2024-09-12T19:00:15.393511+0000","last_active":"2024-09-12T19:00:15.393511+0000","last_peered":"2024-09-12T19:00:15.393511+0000","last_clean":"2024-09-12T19:00:15.393511+0000","last_became_active":"2024-09-12T17:40:20.128532+0000","last_became_peered":"2024-09-12T17:40:20.128532+0000","last_unstale":"2024-09-12T19:00:15.393511+0000","last_undegraded":"2024-09-12T19:00:15.393511+0000","last_fullsized":"2024-09-12T19:00:15.393511+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'238","last_scrub_stamp":"2024-09-12T19:00:15.393329+0000","last_deep_scrub":"264'238","last_deep_scrub_stamp":"2024-09-12T19:00:15.393329+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.393329+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:00.980128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":846,"num_write":360,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'397","reported_seq":1111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.937018+0000","last_change":"2024-09-12T19:00:11.937018+0000","last_active":"2024-09-12T19:00:11.937018+0000","last_peered":"2024-09-12T19:00:11.937018+0000","last_clean":"2024-09-12T19:00:11.937018+0000","last_became_active":"2024-09-12T17:40:55.305689+0000","last_became_peered":"2024-09-12T17:40:55.305689+0000","last_unstale":"2024-09-12T19:00:11.937018+0000","last_undegraded":"2024-09-12T19:00:11.937018+0000","last_fullsized":"2024-09-12T19:00:11.937018+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:11.936824+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:11.936824+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.936824+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:31.586190+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":44917,"num_write":1304,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.618172+0000","last_change":"2024-09-12T19:00:20.618172+0000","last_active":"2024-09-12T19:00:20.618172+0000","last_peered":"2024-09-12T19:00:20.618172+0000","last_clean":"2024-09-12T19:00:20.618172+0000","last_became_active":"2024-09-12T17:40:22.143466+0000","last_became_peered":"2024-09-12T17:40:22.143466+0000","last_unstale":"2024-09-12T19:00:20.618172+0000","last_undegraded":"2024-09-12T19:00:20.618172+0000","last_fullsized":"2024-09-12T19:00:20.618172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:20.617988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:20.617988+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.617988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:25.354445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'64","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.330148+0000","last_change":"2024-09-12T19:00:27.330148+0000","last_active":"2024-09-12T19:00:27.330148+0000","last_peered":"2024-09-12T19:00:27.330148+0000","last_clean":"2024-09-12T19:00:27.330148+0000","last_became_active":"2024-09-12T17:40:24.151530+0000","last_became_peered":"2024-09-12T17:40:24.151530+0000","last_unstale":"2024-09-12T19:00:27.330148+0000","last_undegraded":"2024-09-12T19:00:27.330148+0000","last_fullsized":"2024-09-12T19:00:27.330148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-12T19:00:27.329940+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-12T19:00:27.329940+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.329940+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:38.476922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.820506+0000","last_change":"2024-09-12T19:00:34.820506+0000","last_active":"2024-09-12T19:00:34.820506+0000","last_peered":"2024-09-12T19:00:34.820506+0000","last_clean":"2024-09-12T19:00:34.820506+0000","last_became_active":"2024-09-12T17:40:26.187122+0000","last_became_peered":"2024-09-12T17:40:26.187122+0000","last_unstale":"2024-09-12T19:00:34.820506+0000","last_undegraded":"2024-09-12T19:00:34.820506+0000","last_fullsized":"2024-09-12T19:00:34.820506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.820308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.820308+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.820308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:23.590071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'251","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.270085+0000","last_change":"2024-09-12T19:00:40.270085+0000","last_active":"2024-09-12T19:00:40.270085+0000","last_peered":"2024-09-12T19:00:40.270085+0000","last_clean":"2024-09-12T19:00:40.270085+0000","last_became_active":"2024-09-12T17:40:28.194047+0000","last_became_peered":"2024-09-12T17:40:28.194047+0000","last_unstale":"2024-09-12T19:00:40.270085+0000","last_undegraded":"2024-09-12T19:00:40.270085+0000","last_fullsized":"2024-09-12T19:00:40.270085+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T19:00:40.269814+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T19:00:40.269814+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.269814+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:38.167229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":352,"num_write":540,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'120","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.619652+0000","last_change":"2024-09-12T19:00:18.619652+0000","last_active":"2024-09-12T19:00:18.619652+0000","last_peered":"2024-09-12T19:00:18.619652+0000","last_clean":"2024-09-12T19:00:18.619652+0000","last_became_active":"2024-09-12T17:40:20.130567+0000","last_became_peered":"2024-09-12T17:40:20.130567+0000","last_unstale":"2024-09-12T19:00:18.619652+0000","last_undegraded":"2024-09-12T19:00:18.619652+0000","last_fullsized":"2024-09-12T19:00:18.619652+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T19:00:18.619454+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T19:00:18.619454+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.619454+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:46.704065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":440,"num_write":198,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'397","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.290827+0000","last_change":"2024-09-12T19:00:11.290827+0000","last_active":"2024-09-12T19:00:11.290827+0000","last_peered":"2024-09-12T19:00:11.290827+0000","last_clean":"2024-09-12T19:00:11.290827+0000","last_became_active":"2024-09-12T17:40:18.781135+0000","last_became_peered":"2024-09-12T17:40:18.781135+0000","last_unstale":"2024-09-12T19:00:11.290827+0000","last_undegraded":"2024-09-12T19:00:11.290827+0000","last_fullsized":"2024-09-12T19:00:11.290827+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:11.290616+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:11.290616+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.290616+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:13.553119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306781,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":11928,"num_write":1198,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.965742+0000","last_change":"2024-09-12T19:00:24.965742+0000","last_active":"2024-09-12T19:00:24.965742+0000","last_peered":"2024-09-12T19:00:24.965742+0000","last_clean":"2024-09-12T19:00:24.965742+0000","last_became_active":"2024-09-12T17:40:22.150912+0000","last_became_peered":"2024-09-12T17:40:22.150912+0000","last_unstale":"2024-09-12T19:00:24.965742+0000","last_undegraded":"2024-09-12T19:00:24.965742+0000","last_fullsized":"2024-09-12T19:00:24.965742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:24.965556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:24.965556+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.965556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:45.272866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'347","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.748826+0000","last_change":"2024-09-12T19:00:32.748826+0000","last_active":"2024-09-12T19:00:32.748826+0000","last_peered":"2024-09-12T19:00:32.748826+0000","last_clean":"2024-09-12T19:00:32.748826+0000","last_became_active":"2024-09-12T17:40:24.176722+0000","last_became_peered":"2024-09-12T17:40:24.176722+0000","last_unstale":"2024-09-12T19:00:32.748826+0000","last_undegraded":"2024-09-12T19:00:32.748826+0000","last_fullsized":"2024-09-12T19:00:32.748826+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T19:00:32.748627+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T19:00:32.748627+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.748627+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:59.648696+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48896,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":559,"num_read_kb":1238,"num_write":442,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.373420+0000","last_change":"2024-09-12T19:00:23.373420+0000","last_active":"2024-09-12T19:00:23.373420+0000","last_peered":"2024-09-12T19:00:23.373420+0000","last_clean":"2024-09-12T19:00:23.373420+0000","last_became_active":"2024-09-12T17:40:26.167280+0000","last_became_peered":"2024-09-12T17:40:26.167280+0000","last_unstale":"2024-09-12T19:00:23.373420+0000","last_undegraded":"2024-09-12T19:00:23.373420+0000","last_fullsized":"2024-09-12T19:00:23.373420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.373235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.373235+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.373235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:28.340798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'108","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.254669+0000","last_change":"2024-09-12T19:00:41.254669+0000","last_active":"2024-09-12T19:00:41.254669+0000","last_peered":"2024-09-12T19:00:41.254669+0000","last_clean":"2024-09-12T19:00:41.254669+0000","last_became_active":"2024-09-12T17:40:28.192629+0000","last_became_peered":"2024-09-12T17:40:28.192629+0000","last_unstale":"2024-09-12T19:00:41.254669+0000","last_undegraded":"2024-09-12T19:00:41.254669+0000","last_fullsized":"2024-09-12T19:00:41.254669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'108","last_scrub_stamp":"2024-09-12T19:00:41.254478+0000","last_deep_scrub":"264'108","last_deep_scrub_stamp":"2024-09-12T19:00:41.254478+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.254478+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:41.328980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.590597+0000","last_change":"2024-09-12T19:00:16.590597+0000","last_active":"2024-09-12T19:00:16.590597+0000","last_peered":"2024-09-12T19:00:16.590597+0000","last_clean":"2024-09-12T19:00:16.590597+0000","last_became_active":"2024-09-12T17:40:55.301950+0000","last_became_peered":"2024-09-12T17:40:55.301950+0000","last_unstale":"2024-09-12T19:00:16.590597+0000","last_undegraded":"2024-09-12T19:00:16.590597+0000","last_fullsized":"2024-09-12T19:00:16.590597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-12T19:00:16.590364+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-12T19:00:16.590364+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.590364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:37.860965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":400,"num_write":158,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'409","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.344070+0000","last_change":"2024-09-12T19:00:06.344003+0000","last_active":"2024-09-12T19:00:06.344070+0000","last_peered":"2024-09-12T19:00:06.344070+0000","last_clean":"2024-09-12T19:00:06.344070+0000","last_became_active":"2024-09-12T17:40:18.755694+0000","last_became_peered":"2024-09-12T17:40:18.755694+0000","last_unstale":"2024-09-12T19:00:06.344070+0000","last_undegraded":"2024-09-12T19:00:06.344070+0000","last_fullsized":"2024-09-12T19:00:06.344070+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'409","last_scrub_stamp":"2024-09-12T19:00:06.343896+0000","last_deep_scrub":"264'409","last_deep_scrub_stamp":"2024-09-12T19:00:06.343896+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.343896+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:09.006520+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194332,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":35553,"num_write":1273,"num_write_kb":53517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.338329+0000","last_change":"2024-09-12T19:00:25.338329+0000","last_active":"2024-09-12T19:00:25.338329+0000","last_peered":"2024-09-12T19:00:25.338329+0000","last_clean":"2024-09-12T19:00:25.338329+0000","last_became_active":"2024-09-12T17:40:22.135547+0000","last_became_peered":"2024-09-12T17:40:22.135547+0000","last_unstale":"2024-09-12T19:00:25.338329+0000","last_undegraded":"2024-09-12T19:00:25.338329+0000","last_fullsized":"2024-09-12T19:00:25.338329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:25.338146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:25.338146+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.338146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:19.495885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'313","reported_seq":906,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.900396+0000","last_change":"2024-09-12T19:00:30.900396+0000","last_active":"2024-09-12T19:00:30.900396+0000","last_peered":"2024-09-12T19:00:30.900396+0000","last_clean":"2024-09-12T19:00:30.900396+0000","last_became_active":"2024-09-12T17:40:24.162901+0000","last_became_peered":"2024-09-12T17:40:24.162901+0000","last_unstale":"2024-09-12T19:00:30.900396+0000","last_undegraded":"2024-09-12T19:00:30.900396+0000","last_fullsized":"2024-09-12T19:00:30.900396+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T19:00:30.900145+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T19:00:30.900145+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.900145+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:39.433014+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51001,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1227,"num_write":416,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.367179+0000","last_change":"2024-09-12T19:00:33.367179+0000","last_active":"2024-09-12T19:00:33.367179+0000","last_peered":"2024-09-12T19:00:33.367179+0000","last_clean":"2024-09-12T19:00:33.367179+0000","last_became_active":"2024-09-12T17:40:26.190755+0000","last_became_peered":"2024-09-12T17:40:26.190755+0000","last_unstale":"2024-09-12T19:00:33.367179+0000","last_undegraded":"2024-09-12T19:00:33.367179+0000","last_fullsized":"2024-09-12T19:00:33.367179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:33.367006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:33.367006+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.367006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:39.709430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'428","reported_seq":1200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.440828+0000","last_change":"2024-09-12T19:00:16.440828+0000","last_active":"2024-09-12T19:00:16.440828+0000","last_peered":"2024-09-12T19:00:16.440828+0000","last_clean":"2024-09-12T19:00:16.440828+0000","last_became_active":"2024-09-12T17:40:20.127413+0000","last_became_peered":"2024-09-12T17:40:20.127413+0000","last_unstale":"2024-09-12T19:00:16.440828+0000","last_undegraded":"2024-09-12T19:00:16.440828+0000","last_fullsized":"2024-09-12T19:00:16.440828+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-12T19:00:16.440639+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-12T19:00:16.440639+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.440639+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:08.283126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2096,"num_read_kb":1807,"num_write":754,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'348","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.711102+0000","last_change":"2024-09-12T19:00:08.711102+0000","last_active":"2024-09-12T19:00:08.711102+0000","last_peered":"2024-09-12T19:00:08.711102+0000","last_clean":"2024-09-12T19:00:08.711102+0000","last_became_active":"2024-09-12T17:40:18.759467+0000","last_became_peered":"2024-09-12T17:40:18.759467+0000","last_unstale":"2024-09-12T19:00:08.711102+0000","last_undegraded":"2024-09-12T19:00:08.711102+0000","last_fullsized":"2024-09-12T19:00:08.711102+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T19:00:08.710899+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T19:00:08.710899+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.710899+0000","objects_scrubbed":10,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:25.297780+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399269,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":67738,"num_write":1092,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.349916+0000","last_change":"2024-09-12T19:00:24.349773+0000","last_active":"2024-09-12T19:00:24.349916+0000","last_peered":"2024-09-12T19:00:24.349916+0000","last_clean":"2024-09-12T19:00:24.349916+0000","last_became_active":"2024-09-12T17:40:22.143764+0000","last_became_peered":"2024-09-12T17:40:22.143764+0000","last_unstale":"2024-09-12T19:00:24.349916+0000","last_undegraded":"2024-09-12T19:00:24.349916+0000","last_fullsized":"2024-09-12T19:00:24.349916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:24.349597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:24.349597+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.349597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:40.760179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'543","reported_seq":1199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.338159+0000","last_change":"2024-09-12T19:00:26.338025+0000","last_active":"2024-09-12T19:00:26.338159+0000","last_peered":"2024-09-12T19:00:26.338159+0000","last_clean":"2024-09-12T19:00:26.338159+0000","last_became_active":"2024-09-12T17:40:24.178354+0000","last_became_peered":"2024-09-12T17:40:24.178354+0000","last_unstale":"2024-09-12T19:00:26.338159+0000","last_undegraded":"2024-09-12T19:00:26.338159+0000","last_fullsized":"2024-09-12T19:00:26.338159+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'543","last_scrub_stamp":"2024-09-12T19:00:26.337832+0000","last_deep_scrub":"264'543","last_deep_scrub_stamp":"2024-09-12T19:00:26.337832+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.337832+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:34.313521+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110471,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":953,"num_read_kb":2361,"num_write":826,"num_write_kb":742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.232729+0000","last_change":"2024-09-12T19:00:34.232729+0000","last_active":"2024-09-12T19:00:34.232729+0000","last_peered":"2024-09-12T19:00:34.232729+0000","last_clean":"2024-09-12T19:00:34.232729+0000","last_became_active":"2024-09-12T17:40:26.184572+0000","last_became_peered":"2024-09-12T17:40:26.184572+0000","last_unstale":"2024-09-12T19:00:34.232729+0000","last_undegraded":"2024-09-12T19:00:34.232729+0000","last_fullsized":"2024-09-12T19:00:34.232729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.232547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.232547+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.232547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:15.459942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'243","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:05.971764+0000","last_change":"2024-09-12T17:40:28.201022+0000","last_active":"2024-09-12T18:58:05.971764+0000","last_peered":"2024-09-12T18:58:05.971764+0000","last_clean":"2024-09-12T18:58:05.971764+0000","last_became_active":"2024-09-12T17:40:28.200289+0000","last_became_peered":"2024-09-12T17:40:28.200289+0000","last_unstale":"2024-09-12T18:58:05.971764+0000","last_undegraded":"2024-09-12T18:58:05.971764+0000","last_fullsized":"2024-09-12T18:58:05.971764+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:57.750960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":402,"num_read_kb":380,"num_write":484,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'278","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.329668+0000","last_change":"2024-09-12T19:00:17.329492+0000","last_active":"2024-09-12T19:00:17.329668+0000","last_peered":"2024-09-12T19:00:17.329668+0000","last_clean":"2024-09-12T19:00:17.329668+0000","last_became_active":"2024-09-12T17:40:20.128840+0000","last_became_peered":"2024-09-12T17:40:20.128840+0000","last_unstale":"2024-09-12T19:00:17.329668+0000","last_undegraded":"2024-09-12T19:00:17.329668+0000","last_fullsized":"2024-09-12T19:00:17.329668+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'278","last_scrub_stamp":"2024-09-12T19:00:17.329286+0000","last_deep_scrub":"264'278","last_deep_scrub_stamp":"2024-09-12T19:00:17.329286+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.329286+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:15.910212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1419,"num_read_kb":1187,"num_write":525,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'305","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.389191+0000","last_change":"2024-09-12T19:00:10.388940+0000","last_active":"2024-09-12T19:00:10.389191+0000","last_peered":"2024-09-12T19:00:10.389191+0000","last_clean":"2024-09-12T19:00:10.389191+0000","last_became_active":"2024-09-12T17:40:18.762421+0000","last_became_peered":"2024-09-12T17:40:18.762421+0000","last_unstale":"2024-09-12T19:00:10.389191+0000","last_undegraded":"2024-09-12T19:00:10.389191+0000","last_fullsized":"2024-09-12T19:00:10.389191+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-12T19:00:10.388665+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-12T19:00:10.388665+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.388665+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:37.537161+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":428,"num_read_kb":9963,"num_write":965,"num_write_kb":16756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.400755+0000","last_change":"2024-09-12T19:00:20.400755+0000","last_active":"2024-09-12T19:00:20.400755+0000","last_peered":"2024-09-12T19:00:20.400755+0000","last_clean":"2024-09-12T19:00:20.400755+0000","last_became_active":"2024-09-12T17:40:22.133919+0000","last_became_peered":"2024-09-12T17:40:22.133919+0000","last_unstale":"2024-09-12T19:00:20.400755+0000","last_undegraded":"2024-09-12T19:00:20.400755+0000","last_fullsized":"2024-09-12T19:00:20.400755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:20.400574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:20.400574+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.400574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:25.599834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'321","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.834473+0000","last_change":"2024-09-12T19:00:32.834473+0000","last_active":"2024-09-12T19:00:32.834473+0000","last_peered":"2024-09-12T19:00:32.834473+0000","last_clean":"2024-09-12T19:00:32.834473+0000","last_became_active":"2024-09-12T17:40:24.167870+0000","last_became_peered":"2024-09-12T17:40:24.167870+0000","last_unstale":"2024-09-12T19:00:32.834473+0000","last_undegraded":"2024-09-12T19:00:32.834473+0000","last_fullsized":"2024-09-12T19:00:32.834473+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T19:00:32.834263+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T19:00:32.834263+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.834263+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:47.433880+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50431,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":1079,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12380,"num_omap_keys":28,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.413176+0000","last_change":"2024-09-12T19:00:30.413176+0000","last_active":"2024-09-12T19:00:30.413176+0000","last_peered":"2024-09-12T19:00:30.413176+0000","last_clean":"2024-09-12T19:00:30.413176+0000","last_became_active":"2024-09-12T17:40:26.199065+0000","last_became_peered":"2024-09-12T17:40:26.199065+0000","last_unstale":"2024-09-12T19:00:30.413176+0000","last_undegraded":"2024-09-12T19:00:30.413176+0000","last_fullsized":"2024-09-12T19:00:30.413176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.412978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.412978+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.412978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:31.543757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'190","reported_seq":1097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.337413+0000","last_change":"2024-09-12T19:00:31.337413+0000","last_active":"2024-09-12T19:00:31.337413+0000","last_peered":"2024-09-12T19:00:31.337413+0000","last_clean":"2024-09-12T19:00:31.337413+0000","last_became_active":"2024-09-12T17:40:28.192588+0000","last_became_peered":"2024-09-12T17:40:28.192588+0000","last_unstale":"2024-09-12T19:00:31.337413+0000","last_undegraded":"2024-09-12T19:00:31.337413+0000","last_fullsized":"2024-09-12T19:00:31.337413+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T19:00:31.337228+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T19:00:31.337228+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.337228+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:13.419733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":737,"num_read_kb":706,"num_write":515,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'254","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.634317+0000","last_change":"2024-09-12T19:00:15.634145+0000","last_active":"2024-09-12T19:00:15.634317+0000","last_peered":"2024-09-12T19:00:15.634317+0000","last_clean":"2024-09-12T19:00:15.634317+0000","last_became_active":"2024-09-12T17:40:20.133067+0000","last_became_peered":"2024-09-12T17:40:20.133067+0000","last_unstale":"2024-09-12T19:00:15.634317+0000","last_undegraded":"2024-09-12T19:00:15.634317+0000","last_fullsized":"2024-09-12T19:00:15.634317+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'254","last_scrub_stamp":"2024-09-12T19:00:15.633957+0000","last_deep_scrub":"264'254","last_deep_scrub_stamp":"2024-09-12T19:00:15.633957+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.633957+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:24.007199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1200,"num_read_kb":1015,"num_write":444,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'349","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.743053+0000","last_change":"2024-09-12T19:00:08.742895+0000","last_active":"2024-09-12T19:00:08.743053+0000","last_peered":"2024-09-12T19:00:08.743053+0000","last_clean":"2024-09-12T19:00:08.743053+0000","last_became_active":"2024-09-12T17:40:18.773029+0000","last_became_peered":"2024-09-12T17:40:18.773029+0000","last_unstale":"2024-09-12T19:00:08.743053+0000","last_undegraded":"2024-09-12T19:00:08.743053+0000","last_fullsized":"2024-09-12T19:00:08.743053+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-12T19:00:08.742672+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-12T19:00:08.742672+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.742672+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:43.956356+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5769265,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":426,"num_read_kb":38404,"num_write":1086,"num_write_kb":31393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.951082+0000","last_change":"2024-09-12T19:00:29.951082+0000","last_active":"2024-09-12T19:00:29.951082+0000","last_peered":"2024-09-12T19:00:29.951082+0000","last_clean":"2024-09-12T19:00:29.951082+0000","last_became_active":"2024-09-12T17:40:22.145871+0000","last_became_peered":"2024-09-12T17:40:22.145871+0000","last_unstale":"2024-09-12T19:00:29.951082+0000","last_undegraded":"2024-09-12T19:00:29.951082+0000","last_fullsized":"2024-09-12T19:00:29.951082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:29.950902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:29.950902+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.950902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:28.152645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'313","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.770346+0000","last_change":"2024-09-12T19:00:31.770346+0000","last_active":"2024-09-12T19:00:31.770346+0000","last_peered":"2024-09-12T19:00:31.770346+0000","last_clean":"2024-09-12T19:00:31.770346+0000","last_became_active":"2024-09-12T17:40:24.329413+0000","last_became_peered":"2024-09-12T17:40:24.329413+0000","last_unstale":"2024-09-12T19:00:31.770346+0000","last_undegraded":"2024-09-12T19:00:31.770346+0000","last_fullsized":"2024-09-12T19:00:31.770346+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T19:00:31.770156+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T19:00:31.770156+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.770156+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:12.931738+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47334,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1206,"num_write":420,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.471475+0000","last_change":"2024-09-12T19:00:40.471475+0000","last_active":"2024-09-12T19:00:40.471475+0000","last_peered":"2024-09-12T19:00:40.471475+0000","last_clean":"2024-09-12T19:00:40.471475+0000","last_became_active":"2024-09-12T17:40:26.198930+0000","last_became_peered":"2024-09-12T17:40:26.198930+0000","last_unstale":"2024-09-12T19:00:40.471475+0000","last_undegraded":"2024-09-12T19:00:40.471475+0000","last_fullsized":"2024-09-12T19:00:40.471475+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:40.471293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:40.471293+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.471293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:17.593253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'120","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.321432+0000","last_change":"2024-09-12T19:00:39.321432+0000","last_active":"2024-09-12T19:00:39.321432+0000","last_peered":"2024-09-12T19:00:39.321432+0000","last_clean":"2024-09-12T19:00:39.321432+0000","last_became_active":"2024-09-12T17:40:28.192689+0000","last_became_peered":"2024-09-12T17:40:28.192689+0000","last_unstale":"2024-09-12T19:00:39.321432+0000","last_undegraded":"2024-09-12T19:00:39.321432+0000","last_fullsized":"2024-09-12T19:00:39.321432+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T19:00:39.321187+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T19:00:39.321187+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.321187+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:00.540498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":258,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'197","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.631338+0000","last_change":"2024-09-12T19:00:09.631176+0000","last_active":"2024-09-12T19:00:09.631338+0000","last_peered":"2024-09-12T19:00:09.631338+0000","last_clean":"2024-09-12T19:00:09.631338+0000","last_became_active":"2024-09-12T17:40:20.132998+0000","last_became_peered":"2024-09-12T17:40:20.132998+0000","last_unstale":"2024-09-12T19:00:09.631338+0000","last_undegraded":"2024-09-12T19:00:09.631338+0000","last_fullsized":"2024-09-12T19:00:09.631338+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'197","last_scrub_stamp":"2024-09-12T19:00:09.630961+0000","last_deep_scrub":"264'197","last_deep_scrub_stamp":"2024-09-12T19:00:09.630961+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.630961+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:43.492350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":791,"num_read_kb":641,"num_write":284,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'452","reported_seq":1204,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.350146+0000","last_change":"2024-09-12T19:00:07.349873+0000","last_active":"2024-09-12T19:00:07.350146+0000","last_peered":"2024-09-12T19:00:07.350146+0000","last_clean":"2024-09-12T19:00:07.350146+0000","last_became_active":"2024-09-12T17:40:18.774892+0000","last_became_peered":"2024-09-12T17:40:18.774892+0000","last_unstale":"2024-09-12T19:00:07.350146+0000","last_undegraded":"2024-09-12T19:00:07.350146+0000","last_fullsized":"2024-09-12T19:00:07.350146+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'452","last_scrub_stamp":"2024-09-12T19:00:07.349511+0000","last_deep_scrub":"264'452","last_deep_scrub_stamp":"2024-09-12T19:00:07.349511+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.349511+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:27.593097+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":517958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":741,"num_read_kb":87834,"num_write":1424,"num_write_kb":30285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.305895+0000","last_change":"2024-09-12T19:00:23.305895+0000","last_active":"2024-09-12T19:00:23.305895+0000","last_peered":"2024-09-12T19:00:23.305895+0000","last_clean":"2024-09-12T19:00:23.305895+0000","last_became_active":"2024-09-12T17:40:22.141670+0000","last_became_peered":"2024-09-12T17:40:22.141670+0000","last_unstale":"2024-09-12T19:00:23.305895+0000","last_undegraded":"2024-09-12T19:00:23.305895+0000","last_fullsized":"2024-09-12T19:00:23.305895+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.305714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.305714+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.305714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:29.599014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'139","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.910715+0000","last_change":"2024-09-12T19:00:34.910582+0000","last_active":"2024-09-12T19:00:34.910715+0000","last_peered":"2024-09-12T19:00:34.910715+0000","last_clean":"2024-09-12T19:00:34.910715+0000","last_became_active":"2024-09-12T17:40:24.329446+0000","last_became_peered":"2024-09-12T17:40:24.329446+0000","last_unstale":"2024-09-12T19:00:34.910715+0000","last_undegraded":"2024-09-12T19:00:34.910715+0000","last_fullsized":"2024-09-12T19:00:34.910715+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'139","last_scrub_stamp":"2024-09-12T19:00:34.910379+0000","last_deep_scrub":"264'139","last_deep_scrub_stamp":"2024-09-12T19:00:34.910379+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.910379+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:51.726194+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'753","reported_seq":4504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.318003+0000","last_change":"2024-09-12T19:00:27.318003+0000","last_active":"2024-09-12T19:00:27.318003+0000","last_peered":"2024-09-12T19:00:27.318003+0000","last_clean":"2024-09-12T19:00:27.318003+0000","last_became_active":"2024-09-12T17:40:26.192341+0000","last_became_peered":"2024-09-12T17:40:26.192341+0000","last_unstale":"2024-09-12T19:00:27.318003+0000","last_undegraded":"2024-09-12T19:00:27.318003+0000","last_fullsized":"2024-09-12T19:00:27.318003+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'753","last_scrub_stamp":"2024-09-12T19:00:27.317824+0000","last_deep_scrub":"264'753","last_deep_scrub_stamp":"2024-09-12T19:00:27.317824+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.317824+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:00.226970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'117","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.841374+0000","last_change":"2024-09-12T19:00:37.841374+0000","last_active":"2024-09-12T19:00:37.841374+0000","last_peered":"2024-09-12T19:00:37.841374+0000","last_clean":"2024-09-12T19:00:37.841374+0000","last_became_active":"2024-09-12T17:40:28.187089+0000","last_became_peered":"2024-09-12T17:40:28.187089+0000","last_unstale":"2024-09-12T19:00:37.841374+0000","last_undegraded":"2024-09-12T19:00:37.841374+0000","last_fullsized":"2024-09-12T19:00:37.841374+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T19:00:37.841189+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T19:00:37.841189+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.841189+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:43.510128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'389","reported_seq":1142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.883979+0000","last_change":"2024-09-12T19:00:19.883704+0000","last_active":"2024-09-12T19:00:19.883979+0000","last_peered":"2024-09-12T19:00:19.883979+0000","last_clean":"2024-09-12T19:00:19.883979+0000","last_became_active":"2024-09-12T17:40:20.142478+0000","last_became_peered":"2024-09-12T17:40:20.142478+0000","last_unstale":"2024-09-12T19:00:19.883979+0000","last_undegraded":"2024-09-12T19:00:19.883979+0000","last_fullsized":"2024-09-12T19:00:19.883979+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'389","last_scrub_stamp":"2024-09-12T19:00:19.883428+0000","last_deep_scrub":"264'389","last_deep_scrub_stamp":"2024-09-12T19:00:19.883428+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.883428+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:21.623543+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1845,"num_read_kb":1583,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25754,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'344","reported_seq":1177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.599290+0000","last_change":"2024-09-12T19:00:04.599290+0000","last_active":"2024-09-12T19:00:04.599290+0000","last_peered":"2024-09-12T19:00:04.599290+0000","last_clean":"2024-09-12T19:00:04.599290+0000","last_became_active":"2024-09-12T17:40:55.330696+0000","last_became_peered":"2024-09-12T17:40:55.330696+0000","last_unstale":"2024-09-12T19:00:04.599290+0000","last_undegraded":"2024-09-12T19:00:04.599290+0000","last_fullsized":"2024-09-12T19:00:04.599290+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T19:00:04.599196+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T19:00:04.599196+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.599196+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:34.856416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35759,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":915,"num_read_kb":9625,"num_write":1190,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.944316+0000","last_change":"2024-09-12T19:00:25.944316+0000","last_active":"2024-09-12T19:00:25.944316+0000","last_peered":"2024-09-12T19:00:25.944316+0000","last_clean":"2024-09-12T19:00:25.944316+0000","last_became_active":"2024-09-12T17:40:22.151083+0000","last_became_peered":"2024-09-12T17:40:22.151083+0000","last_unstale":"2024-09-12T19:00:25.944316+0000","last_undegraded":"2024-09-12T19:00:25.944316+0000","last_fullsized":"2024-09-12T19:00:25.944316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:25.944122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:25.944122+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.944122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:30.866495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'343","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.197137+0000","last_change":"2024-09-12T19:00:35.197137+0000","last_active":"2024-09-12T19:00:35.197137+0000","last_peered":"2024-09-12T19:00:35.197137+0000","last_clean":"2024-09-12T19:00:35.197137+0000","last_became_active":"2024-09-12T17:40:24.173360+0000","last_became_peered":"2024-09-12T17:40:24.173360+0000","last_unstale":"2024-09-12T19:00:35.197137+0000","last_undegraded":"2024-09-12T19:00:35.197137+0000","last_fullsized":"2024-09-12T19:00:35.197137+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T19:00:35.196835+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T19:00:35.196835+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.196835+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:55.759104+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61671,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":561,"num_read_kb":1233,"num_write":446,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.376891+0000","last_change":"2024-09-12T19:00:34.376891+0000","last_active":"2024-09-12T19:00:34.376891+0000","last_peered":"2024-09-12T19:00:34.376891+0000","last_clean":"2024-09-12T19:00:34.376891+0000","last_became_active":"2024-09-12T17:40:26.163773+0000","last_became_peered":"2024-09-12T17:40:26.163773+0000","last_unstale":"2024-09-12T19:00:34.376891+0000","last_undegraded":"2024-09-12T19:00:34.376891+0000","last_fullsized":"2024-09-12T19:00:34.376891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.376716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.376716+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.376716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:16.630035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'105","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.816338+0000","last_change":"2024-09-12T19:00:39.816338+0000","last_active":"2024-09-12T19:00:39.816338+0000","last_peered":"2024-09-12T19:00:39.816338+0000","last_clean":"2024-09-12T19:00:39.816338+0000","last_became_active":"2024-09-12T17:40:28.198792+0000","last_became_peered":"2024-09-12T17:40:28.198792+0000","last_unstale":"2024-09-12T19:00:39.816338+0000","last_undegraded":"2024-09-12T19:00:39.816338+0000","last_fullsized":"2024-09-12T19:00:39.816338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T19:00:39.816143+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T19:00:39.816143+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.816143+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:25.653460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":239,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'185","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.805223+0000","last_change":"2024-09-12T19:00:17.804978+0000","last_active":"2024-09-12T19:00:17.805223+0000","last_peered":"2024-09-12T19:00:17.805223+0000","last_clean":"2024-09-12T19:00:17.805223+0000","last_became_active":"2024-09-12T17:40:20.136564+0000","last_became_peered":"2024-09-12T17:40:20.136564+0000","last_unstale":"2024-09-12T19:00:17.805223+0000","last_undegraded":"2024-09-12T19:00:17.805223+0000","last_fullsized":"2024-09-12T19:00:17.805223+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T19:00:17.804709+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T19:00:17.804709+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.804709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:22.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":640,"num_write":266,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'423","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.276533+0000","last_change":"2024-09-12T19:00:10.276396+0000","last_active":"2024-09-12T19:00:10.276533+0000","last_peered":"2024-09-12T19:00:10.276533+0000","last_clean":"2024-09-12T19:00:10.276533+0000","last_became_active":"2024-09-12T17:40:18.779946+0000","last_became_peered":"2024-09-12T17:40:18.779946+0000","last_unstale":"2024-09-12T19:00:10.276533+0000","last_undegraded":"2024-09-12T19:00:10.276533+0000","last_fullsized":"2024-09-12T19:00:10.276533+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'423","last_scrub_stamp":"2024-09-12T19:00:10.276179+0000","last_deep_scrub":"264'423","last_deep_scrub_stamp":"2024-09-12T19:00:10.276179+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.276179+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:31.510413+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1239867,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":711,"num_read_kb":21197,"num_write":1193,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.296054+0000","last_change":"2024-09-12T19:00:28.296054+0000","last_active":"2024-09-12T19:00:28.296054+0000","last_peered":"2024-09-12T19:00:28.296054+0000","last_clean":"2024-09-12T19:00:28.296054+0000","last_became_active":"2024-09-12T17:40:22.137291+0000","last_became_peered":"2024-09-12T17:40:22.137291+0000","last_unstale":"2024-09-12T19:00:28.296054+0000","last_undegraded":"2024-09-12T19:00:28.296054+0000","last_fullsized":"2024-09-12T19:00:28.296054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:28.295851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:28.295851+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.295851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:03.319406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'268","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.360743+0000","last_change":"2024-09-12T19:00:29.360743+0000","last_active":"2024-09-12T19:00:29.360743+0000","last_peered":"2024-09-12T19:00:29.360743+0000","last_clean":"2024-09-12T19:00:29.360743+0000","last_became_active":"2024-09-12T17:40:24.174681+0000","last_became_peered":"2024-09-12T17:40:24.174681+0000","last_unstale":"2024-09-12T19:00:29.360743+0000","last_undegraded":"2024-09-12T19:00:29.360743+0000","last_fullsized":"2024-09-12T19:00:29.360743+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'268","last_scrub_stamp":"2024-09-12T19:00:29.360510+0000","last_deep_scrub":"264'268","last_deep_scrub_stamp":"2024-09-12T19:00:29.360510+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.360510+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:44.506730+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51960,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":993,"num_write":344,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.360878+0000","last_change":"2024-09-12T19:00:26.360731+0000","last_active":"2024-09-12T19:00:26.360878+0000","last_peered":"2024-09-12T19:00:26.360878+0000","last_clean":"2024-09-12T19:00:26.360878+0000","last_became_active":"2024-09-12T17:40:26.187438+0000","last_became_peered":"2024-09-12T17:40:26.187438+0000","last_unstale":"2024-09-12T19:00:26.360878+0000","last_undegraded":"2024-09-12T19:00:26.360878+0000","last_fullsized":"2024-09-12T19:00:26.360878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.360536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.360536+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.360536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:17.085073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'124","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:47.462395+0000","last_change":"2024-09-12T17:40:28.202550+0000","last_active":"2024-09-12T18:57:47.462395+0000","last_peered":"2024-09-12T18:57:47.462395+0000","last_clean":"2024-09-12T18:57:47.462395+0000","last_became_active":"2024-09-12T17:40:28.201534+0000","last_became_peered":"2024-09-12T17:40:28.201534+0000","last_unstale":"2024-09-12T18:57:47.462395+0000","last_undegraded":"2024-09-12T18:57:47.462395+0000","last_fullsized":"2024-09-12T18:57:47.462395+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:27.152654+0000","last_clean_scrub_stamp":"2024-09-12T17:40:27.152654+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":291,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'52","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.612810+0000","last_change":"2024-09-12T19:00:19.612666+0000","last_active":"2024-09-12T19:00:19.612810+0000","last_peered":"2024-09-12T19:00:19.612810+0000","last_clean":"2024-09-12T19:00:19.612810+0000","last_became_active":"2024-09-12T17:40:20.117604+0000","last_became_peered":"2024-09-12T17:40:20.117604+0000","last_unstale":"2024-09-12T19:00:19.612810+0000","last_undegraded":"2024-09-12T19:00:19.612810+0000","last_fullsized":"2024-09-12T19:00:19.612810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T19:00:19.612475+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T19:00:19.612475+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.612475+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:58.666585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":67,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'333","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.706552+0000","last_change":"2024-09-12T19:00:24.706416+0000","last_active":"2024-09-12T19:00:24.706552+0000","last_peered":"2024-09-12T19:00:24.706552+0000","last_clean":"2024-09-12T19:00:24.706552+0000","last_became_active":"2024-09-12T17:40:18.767103+0000","last_became_peered":"2024-09-12T17:40:18.767103+0000","last_unstale":"2024-09-12T19:00:24.706552+0000","last_undegraded":"2024-09-12T19:00:24.706552+0000","last_fullsized":"2024-09-12T19:00:24.706552+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-12T19:00:24.706215+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-12T19:00:24.706215+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.706215+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:26.639198+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097225,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":436,"num_read_kb":34280,"num_write":1068,"num_write_kb":41945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.960509+0000","last_change":"2024-09-12T19:00:28.960509+0000","last_active":"2024-09-12T19:00:28.960509+0000","last_peered":"2024-09-12T19:00:28.960509+0000","last_clean":"2024-09-12T19:00:28.960509+0000","last_became_active":"2024-09-12T17:40:22.134242+0000","last_became_peered":"2024-09-12T17:40:22.134242+0000","last_unstale":"2024-09-12T19:00:28.960509+0000","last_undegraded":"2024-09-12T19:00:28.960509+0000","last_fullsized":"2024-09-12T19:00:28.960509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:28.960299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:28.960299+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.960299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:33.212237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'241","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.747311+0000","last_change":"2024-09-12T19:00:33.747311+0000","last_active":"2024-09-12T19:00:33.747311+0000","last_peered":"2024-09-12T19:00:33.747311+0000","last_clean":"2024-09-12T19:00:33.747311+0000","last_became_active":"2024-09-12T17:40:24.181581+0000","last_became_peered":"2024-09-12T17:40:24.181581+0000","last_unstale":"2024-09-12T19:00:33.747311+0000","last_undegraded":"2024-09-12T19:00:33.747311+0000","last_fullsized":"2024-09-12T19:00:33.747311+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'241","last_scrub_stamp":"2024-09-12T19:00:33.747120+0000","last_deep_scrub":"264'241","last_deep_scrub_stamp":"2024-09-12T19:00:33.747120+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.747120+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:35.708518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":967,"num_write":316,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.909798+0000","last_change":"2024-09-12T19:00:37.909798+0000","last_active":"2024-09-12T19:00:37.909798+0000","last_peered":"2024-09-12T19:00:37.909798+0000","last_clean":"2024-09-12T19:00:37.909798+0000","last_became_active":"2024-09-12T17:40:26.195603+0000","last_became_peered":"2024-09-12T17:40:26.195603+0000","last_unstale":"2024-09-12T19:00:37.909798+0000","last_undegraded":"2024-09-12T19:00:37.909798+0000","last_fullsized":"2024-09-12T19:00:37.909798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:37.909628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:37.909628+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.909628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:37.888689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'171","reported_seq":1293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.841114+0000","last_change":"2024-09-12T19:00:38.841114+0000","last_active":"2024-09-12T19:00:38.841114+0000","last_peered":"2024-09-12T19:00:38.841114+0000","last_clean":"2024-09-12T19:00:38.841114+0000","last_became_active":"2024-09-12T17:40:28.200126+0000","last_became_peered":"2024-09-12T17:40:28.200126+0000","last_unstale":"2024-09-12T19:00:38.841114+0000","last_undegraded":"2024-09-12T19:00:38.841114+0000","last_fullsized":"2024-09-12T19:00:38.841114+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T19:00:38.840922+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T19:00:38.840922+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.840922+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:43.048043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":872,"num_read_kb":859,"num_write":427,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'166","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.848337+0000","last_change":"2024-09-12T19:00:16.848337+0000","last_active":"2024-09-12T19:00:16.848337+0000","last_peered":"2024-09-12T19:00:16.848337+0000","last_clean":"2024-09-12T19:00:16.848337+0000","last_became_active":"2024-09-12T17:40:20.131459+0000","last_became_peered":"2024-09-12T17:40:20.131459+0000","last_unstale":"2024-09-12T19:00:16.848337+0000","last_undegraded":"2024-09-12T19:00:16.848337+0000","last_fullsized":"2024-09-12T19:00:16.848337+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T19:00:16.848164+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T19:00:16.848164+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.848164+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:33.348709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":677,"num_write":293,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'344","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.318433+0000","last_change":"2024-09-12T19:00:08.318433+0000","last_active":"2024-09-12T19:00:08.318433+0000","last_peered":"2024-09-12T19:00:08.318433+0000","last_clean":"2024-09-12T19:00:08.318433+0000","last_became_active":"2024-09-12T17:40:18.773667+0000","last_became_peered":"2024-09-12T17:40:18.773667+0000","last_unstale":"2024-09-12T19:00:08.318433+0000","last_undegraded":"2024-09-12T19:00:08.318433+0000","last_fullsized":"2024-09-12T19:00:08.318433+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T19:00:08.318197+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T19:00:08.318197+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.318197+0000","objects_scrubbed":10,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:30.683986+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263633,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":554,"num_read_kb":8714,"num_write":1079,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'6","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.294939+0000","last_change":"2024-09-12T19:00:24.294769+0000","last_active":"2024-09-12T19:00:24.294939+0000","last_peered":"2024-09-12T19:00:24.294939+0000","last_clean":"2024-09-12T19:00:24.294939+0000","last_became_active":"2024-09-12T17:40:22.141182+0000","last_became_peered":"2024-09-12T17:40:22.141182+0000","last_unstale":"2024-09-12T19:00:24.294939+0000","last_undegraded":"2024-09-12T19:00:24.294939+0000","last_fullsized":"2024-09-12T19:00:24.294939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:24.294580+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:24.294580+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.294580+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:23.277435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'310","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.937956+0000","last_change":"2024-09-12T19:00:33.937956+0000","last_active":"2024-09-12T19:00:33.937956+0000","last_peered":"2024-09-12T19:00:33.937956+0000","last_clean":"2024-09-12T19:00:33.937956+0000","last_became_active":"2024-09-12T17:40:24.166330+0000","last_became_peered":"2024-09-12T17:40:24.166330+0000","last_unstale":"2024-09-12T19:00:33.937956+0000","last_undegraded":"2024-09-12T19:00:33.937956+0000","last_fullsized":"2024-09-12T19:00:33.937956+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-12T19:00:33.937774+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-12T19:00:33.937774+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.937774+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:21.539066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51905,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1128,"num_write":400,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.318424+0000","last_change":"2024-09-12T19:00:36.318424+0000","last_active":"2024-09-12T19:00:36.318424+0000","last_peered":"2024-09-12T19:00:36.318424+0000","last_clean":"2024-09-12T19:00:36.318424+0000","last_became_active":"2024-09-12T17:40:26.188351+0000","last_became_peered":"2024-09-12T17:40:26.188351+0000","last_unstale":"2024-09-12T19:00:36.318424+0000","last_undegraded":"2024-09-12T19:00:36.318424+0000","last_fullsized":"2024-09-12T19:00:36.318424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:36.318245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:36.318245+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.318245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:56.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'140","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.889301+0000","last_change":"2024-09-12T19:00:39.889301+0000","last_active":"2024-09-12T19:00:39.889301+0000","last_peered":"2024-09-12T19:00:39.889301+0000","last_clean":"2024-09-12T19:00:39.889301+0000","last_became_active":"2024-09-12T17:40:28.180148+0000","last_became_peered":"2024-09-12T17:40:28.180148+0000","last_unstale":"2024-09-12T19:00:39.889301+0000","last_undegraded":"2024-09-12T19:00:39.889301+0000","last_fullsized":"2024-09-12T19:00:39.889301+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-12T19:00:39.889091+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-12T19:00:39.889091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.889091+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:44.717196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":171,"num_read_kb":158,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'174","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.338634+0000","last_change":"2024-09-12T19:00:19.338356+0000","last_active":"2024-09-12T19:00:19.338634+0000","last_peered":"2024-09-12T19:00:19.338634+0000","last_clean":"2024-09-12T19:00:19.338634+0000","last_became_active":"2024-09-12T17:40:20.127006+0000","last_became_peered":"2024-09-12T17:40:20.127006+0000","last_unstale":"2024-09-12T19:00:19.338634+0000","last_undegraded":"2024-09-12T19:00:19.338634+0000","last_fullsized":"2024-09-12T19:00:19.338634+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T19:00:19.338125+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T19:00:19.338125+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.338125+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:28.379386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":779,"num_read_kb":649,"num_write":260,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'327","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.432395+0000","last_change":"2024-09-12T19:00:12.432395+0000","last_active":"2024-09-12T19:00:12.432395+0000","last_peered":"2024-09-12T19:00:12.432395+0000","last_clean":"2024-09-12T19:00:12.432395+0000","last_became_active":"2024-09-12T17:40:18.757444+0000","last_became_peered":"2024-09-12T17:40:18.757444+0000","last_unstale":"2024-09-12T19:00:12.432395+0000","last_undegraded":"2024-09-12T19:00:12.432395+0000","last_fullsized":"2024-09-12T19:00:12.432395+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T19:00:12.432143+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T19:00:12.432143+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.432143+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:39.703339+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194355,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":91614,"num_write":1080,"num_write_kb":46187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'4205","reported_seq":4828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.334513+0000","last_change":"2024-09-12T19:00:17.334280+0000","last_active":"2024-09-12T19:00:17.334513+0000","last_peered":"2024-09-12T19:00:17.334513+0000","last_clean":"2024-09-12T19:00:17.334513+0000","last_became_active":"2024-09-12T17:40:20.125586+0000","last_became_peered":"2024-09-12T17:40:20.125586+0000","last_unstale":"2024-09-12T19:00:17.334513+0000","last_undegraded":"2024-09-12T19:00:17.334513+0000","last_fullsized":"2024-09-12T19:00:17.334513+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4205","last_scrub_stamp":"2024-09-12T19:00:17.334001+0000","last_deep_scrub":"264'4205","last_deep_scrub_stamp":"2024-09-12T19:00:17.334001+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.334001+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":3000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:15.949061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16904,"num_read_kb":14161,"num_write":6332,"num_write_kb":3161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'321","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.590276+0000","last_change":"2024-09-12T19:00:07.590276+0000","last_active":"2024-09-12T19:00:07.590276+0000","last_peered":"2024-09-12T19:00:07.590276+0000","last_clean":"2024-09-12T19:00:07.590276+0000","last_became_active":"2024-09-12T17:40:18.754335+0000","last_became_peered":"2024-09-12T17:40:18.754335+0000","last_unstale":"2024-09-12T19:00:07.590276+0000","last_undegraded":"2024-09-12T19:00:07.590276+0000","last_fullsized":"2024-09-12T19:00:07.590276+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T19:00:07.590095+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T19:00:07.590095+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.590095+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:24.884297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":433,"num_read_kb":13730,"num_write":1004,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'414","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.347254+0000","last_change":"2024-09-12T19:00:24.347121+0000","last_active":"2024-09-12T19:00:24.347254+0000","last_peered":"2024-09-12T19:00:24.347254+0000","last_clean":"2024-09-12T19:00:24.347254+0000","last_became_active":"2024-09-12T17:40:20.136831+0000","last_became_peered":"2024-09-12T17:40:20.136831+0000","last_unstale":"2024-09-12T19:00:24.347254+0000","last_undegraded":"2024-09-12T19:00:24.347254+0000","last_fullsized":"2024-09-12T19:00:24.347254+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-12T19:00:24.346937+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-12T19:00:24.346937+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.346937+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:09.754944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1812,"num_read_kb":1536,"num_write":694,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2875,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'341","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.271766+0000","last_change":"2024-09-12T19:00:12.271766+0000","last_active":"2024-09-12T19:00:12.271766+0000","last_peered":"2024-09-12T19:00:12.271766+0000","last_clean":"2024-09-12T19:00:12.271766+0000","last_became_active":"2024-09-12T17:40:18.753576+0000","last_became_peered":"2024-09-12T17:40:18.753576+0000","last_unstale":"2024-09-12T19:00:12.271766+0000","last_undegraded":"2024-09-12T19:00:12.271766+0000","last_fullsized":"2024-09-12T19:00:12.271766+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T19:00:12.271560+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T19:00:12.271560+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.271560+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:34.437310+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":449,"num_read_kb":36529,"num_write":1017,"num_write_kb":32314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'363","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.372056+0000","last_change":"2024-09-12T19:00:20.371890+0000","last_active":"2024-09-12T19:00:20.372056+0000","last_peered":"2024-09-12T19:00:20.372056+0000","last_clean":"2024-09-12T19:00:20.372056+0000","last_became_active":"2024-09-12T17:40:20.132826+0000","last_became_peered":"2024-09-12T17:40:20.132826+0000","last_unstale":"2024-09-12T19:00:20.372056+0000","last_undegraded":"2024-09-12T19:00:20.372056+0000","last_fullsized":"2024-09-12T19:00:20.372056+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-12T19:00:20.371710+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-12T19:00:20.371710+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.371710+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:53.712192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1596,"num_read_kb":1285,"num_write":598,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'350","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.351167+0000","last_change":"2024-09-12T19:00:09.351167+0000","last_active":"2024-09-12T19:00:09.351167+0000","last_peered":"2024-09-12T19:00:09.351167+0000","last_clean":"2024-09-12T19:00:09.351167+0000","last_became_active":"2024-09-12T17:40:18.754933+0000","last_became_peered":"2024-09-12T17:40:18.754933+0000","last_unstale":"2024-09-12T19:00:09.351167+0000","last_undegraded":"2024-09-12T19:00:09.351167+0000","last_fullsized":"2024-09-12T19:00:09.351167+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T19:00:09.350866+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T19:00:09.350866+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.350866+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:40.151355+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081897,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":46825,"num_write":1040,"num_write_kb":45673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'114","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.622228+0000","last_change":"2024-09-12T19:00:17.622228+0000","last_active":"2024-09-12T19:00:17.622228+0000","last_peered":"2024-09-12T19:00:17.622228+0000","last_clean":"2024-09-12T19:00:17.622228+0000","last_became_active":"2024-09-12T17:40:20.129769+0000","last_became_peered":"2024-09-12T17:40:20.129769+0000","last_unstale":"2024-09-12T19:00:17.622228+0000","last_undegraded":"2024-09-12T19:00:17.622228+0000","last_fullsized":"2024-09-12T19:00:17.622228+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T19:00:17.622030+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T19:00:17.622030+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.622030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:54.615405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":414,"num_write":175,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'356","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.690197+0000","last_change":"2024-09-12T19:00:10.690017+0000","last_active":"2024-09-12T19:00:10.690197+0000","last_peered":"2024-09-12T19:00:10.690197+0000","last_clean":"2024-09-12T19:00:10.690197+0000","last_became_active":"2024-09-12T17:40:18.773052+0000","last_became_peered":"2024-09-12T17:40:18.773052+0000","last_unstale":"2024-09-12T19:00:10.690197+0000","last_undegraded":"2024-09-12T19:00:10.690197+0000","last_fullsized":"2024-09-12T19:00:10.690197+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T19:00:10.689810+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T19:00:10.689810+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.689810+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:54.998455+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2648214,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":619,"num_read_kb":23542,"num_write":1059,"num_write_kb":26208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'141","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.828290+0000","last_change":"2024-09-12T19:00:18.828290+0000","last_active":"2024-09-12T19:00:18.828290+0000","last_peered":"2024-09-12T19:00:18.828290+0000","last_clean":"2024-09-12T19:00:18.828290+0000","last_became_active":"2024-09-12T17:40:20.146835+0000","last_became_peered":"2024-09-12T17:40:20.146835+0000","last_unstale":"2024-09-12T19:00:18.828290+0000","last_undegraded":"2024-09-12T19:00:18.828290+0000","last_fullsized":"2024-09-12T19:00:18.828290+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T19:00:18.828089+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T19:00:18.828089+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.828089+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:42.635478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":516,"num_write":222,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'452","reported_seq":1235,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.396589+0000","last_change":"2024-09-12T19:00:08.396458+0000","last_active":"2024-09-12T19:00:08.396589+0000","last_peered":"2024-09-12T19:00:08.396589+0000","last_clean":"2024-09-12T19:00:08.396589+0000","last_became_active":"2024-09-12T17:40:18.764545+0000","last_became_peered":"2024-09-12T17:40:18.764545+0000","last_unstale":"2024-09-12T19:00:08.396589+0000","last_undegraded":"2024-09-12T19:00:08.396589+0000","last_fullsized":"2024-09-12T19:00:08.396589+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'452","last_scrub_stamp":"2024-09-12T19:00:08.396245+0000","last_deep_scrub":"264'452","last_deep_scrub_stamp":"2024-09-12T19:00:08.396245+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.396245+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:44.809947+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263245,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":913,"num_read_kb":25412,"num_write":1371,"num_write_kb":29284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'206","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.666116+0000","last_change":"2024-09-12T19:00:23.666116+0000","last_active":"2024-09-12T19:00:23.666116+0000","last_peered":"2024-09-12T19:00:23.666116+0000","last_clean":"2024-09-12T19:00:23.666116+0000","last_became_active":"2024-09-12T17:40:20.133055+0000","last_became_peered":"2024-09-12T17:40:20.133055+0000","last_unstale":"2024-09-12T19:00:23.666116+0000","last_undegraded":"2024-09-12T19:00:23.666116+0000","last_fullsized":"2024-09-12T19:00:23.666116+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T19:00:23.665932+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T19:00:23.665932+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.665932+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:04.141641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":974,"num_read_kb":794,"num_write":355,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'338","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.422529+0000","last_change":"2024-09-12T19:00:08.422287+0000","last_active":"2024-09-12T19:00:08.422529+0000","last_peered":"2024-09-12T19:00:08.422529+0000","last_clean":"2024-09-12T19:00:08.422529+0000","last_became_active":"2024-09-12T17:40:18.764658+0000","last_became_peered":"2024-09-12T17:40:18.764658+0000","last_unstale":"2024-09-12T19:00:08.422529+0000","last_undegraded":"2024-09-12T19:00:08.422529+0000","last_fullsized":"2024-09-12T19:00:08.422529+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T19:00:08.421985+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T19:00:08.421985+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.421985+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:05.651015+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4856534,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":14122,"num_write":1065,"num_write_kb":26720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'195","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.424693+0000","last_change":"2024-09-12T19:00:17.424693+0000","last_active":"2024-09-12T19:00:17.424693+0000","last_peered":"2024-09-12T19:00:17.424693+0000","last_clean":"2024-09-12T19:00:17.424693+0000","last_became_active":"2024-09-12T17:40:20.124247+0000","last_became_peered":"2024-09-12T17:40:20.124247+0000","last_unstale":"2024-09-12T19:00:17.424693+0000","last_undegraded":"2024-09-12T19:00:17.424693+0000","last_fullsized":"2024-09-12T19:00:17.424693+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T19:00:17.424514+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T19:00:17.424514+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.424514+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:47.443716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":903,"num_read_kb":737,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'372","reported_seq":1062,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.719139+0000","last_change":"2024-09-12T19:00:09.718958+0000","last_active":"2024-09-12T19:00:09.719139+0000","last_peered":"2024-09-12T19:00:09.719139+0000","last_clean":"2024-09-12T19:00:09.719139+0000","last_became_active":"2024-09-12T17:40:18.772776+0000","last_became_peered":"2024-09-12T17:40:18.772776+0000","last_unstale":"2024-09-12T19:00:09.719139+0000","last_undegraded":"2024-09-12T19:00:09.719139+0000","last_fullsized":"2024-09-12T19:00:09.719139+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T19:00:09.718726+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T19:00:09.718726+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.718726+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:59.239489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":25353,"num_write":1144,"num_write_kb":19697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'233","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.362881+0000","last_change":"2024-09-12T19:00:19.362881+0000","last_active":"2024-09-12T19:00:19.362881+0000","last_peered":"2024-09-12T19:00:19.362881+0000","last_clean":"2024-09-12T19:00:19.362881+0000","last_became_active":"2024-09-12T17:40:20.116064+0000","last_became_peered":"2024-09-12T17:40:20.116064+0000","last_unstale":"2024-09-12T19:00:19.362881+0000","last_undegraded":"2024-09-12T19:00:19.362881+0000","last_fullsized":"2024-09-12T19:00:19.362881+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-12T19:00:19.362701+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-12T19:00:19.362701+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.362701+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:26.580777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1004,"num_read_kb":824,"num_write":355,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'342","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.289501+0000","last_change":"2024-09-12T19:00:13.289501+0000","last_active":"2024-09-12T19:00:13.289501+0000","last_peered":"2024-09-12T19:00:13.289501+0000","last_clean":"2024-09-12T19:00:13.289501+0000","last_became_active":"2024-09-12T17:40:18.753693+0000","last_became_peered":"2024-09-12T17:40:18.753693+0000","last_unstale":"2024-09-12T19:00:13.289501+0000","last_undegraded":"2024-09-12T19:00:13.289501+0000","last_fullsized":"2024-09-12T19:00:13.289501+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-12T19:00:13.289299+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-12T19:00:13.289299+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.289299+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:49.965185+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194334,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":459,"num_read_kb":12118,"num_write":1082,"num_write_kb":50446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'82","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.817953+0000","last_change":"2024-09-12T19:00:21.817953+0000","last_active":"2024-09-12T19:00:21.817953+0000","last_peered":"2024-09-12T19:00:21.817953+0000","last_clean":"2024-09-12T19:00:21.817953+0000","last_became_active":"2024-09-12T17:40:20.129687+0000","last_became_peered":"2024-09-12T17:40:20.129687+0000","last_unstale":"2024-09-12T19:00:21.817953+0000","last_undegraded":"2024-09-12T19:00:21.817953+0000","last_fullsized":"2024-09-12T19:00:21.817953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'82","last_scrub_stamp":"2024-09-12T19:00:21.817743+0000","last_deep_scrub":"264'82","last_deep_scrub_stamp":"2024-09-12T19:00:21.817743+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.817743+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:53.779281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":302,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'397","reported_seq":1045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.744811+0000","last_change":"2024-09-12T19:00:27.744811+0000","last_active":"2024-09-12T19:00:27.744811+0000","last_peered":"2024-09-12T19:00:27.744811+0000","last_clean":"2024-09-12T19:00:27.744811+0000","last_became_active":"2024-09-12T17:40:18.772969+0000","last_became_peered":"2024-09-12T17:40:18.772969+0000","last_unstale":"2024-09-12T19:00:27.744811+0000","last_undegraded":"2024-09-12T19:00:27.744811+0000","last_fullsized":"2024-09-12T19:00:27.744811+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:27.744590+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:27.744590+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.744590+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:39.153902+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242937,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":478,"num_read_kb":13353,"num_write":1113,"num_write_kb":30519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'211","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.609423+0000","last_change":"2024-09-12T19:00:13.609423+0000","last_active":"2024-09-12T19:00:13.609423+0000","last_peered":"2024-09-12T19:00:13.609423+0000","last_clean":"2024-09-12T19:00:13.609423+0000","last_became_active":"2024-09-12T17:40:20.130606+0000","last_became_peered":"2024-09-12T17:40:20.130606+0000","last_unstale":"2024-09-12T19:00:13.609423+0000","last_undegraded":"2024-09-12T19:00:13.609423+0000","last_fullsized":"2024-09-12T19:00:13.609423+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T19:00:13.609244+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T19:00:13.609244+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.609244+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:10.927640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":765,"num_write":331,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'361","reported_seq":1143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.290572+0000","last_change":"2024-09-12T19:00:14.290572+0000","last_active":"2024-09-12T19:00:14.290572+0000","last_peered":"2024-09-12T19:00:14.290572+0000","last_clean":"2024-09-12T19:00:14.290572+0000","last_became_active":"2024-09-12T17:40:18.780861+0000","last_became_peered":"2024-09-12T17:40:18.780861+0000","last_unstale":"2024-09-12T19:00:14.290572+0000","last_undegraded":"2024-09-12T19:00:14.290572+0000","last_fullsized":"2024-09-12T19:00:14.290572+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-12T19:00:14.290350+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-12T19:00:14.290350+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.290350+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:52.086504+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747960,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":883,"num_read_kb":18830,"num_write":1183,"num_write_kb":42628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'422","reported_seq":1188,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.862014+0000","last_change":"2024-09-12T19:00:20.862014+0000","last_active":"2024-09-12T19:00:20.862014+0000","last_peered":"2024-09-12T19:00:20.862014+0000","last_clean":"2024-09-12T19:00:20.862014+0000","last_became_active":"2024-09-12T17:40:20.149176+0000","last_became_peered":"2024-09-12T17:40:20.149176+0000","last_unstale":"2024-09-12T19:00:20.862014+0000","last_undegraded":"2024-09-12T19:00:20.862014+0000","last_fullsized":"2024-09-12T19:00:20.862014+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'422","last_scrub_stamp":"2024-09-12T19:00:20.861788+0000","last_deep_scrub":"264'422","last_deep_scrub_stamp":"2024-09-12T19:00:20.861788+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.861788+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:54.694114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2034,"num_read_kb":1768,"num_write":658,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'346","reported_seq":1036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.360750+0000","last_change":"2024-09-12T19:00:10.360750+0000","last_active":"2024-09-12T19:00:10.360750+0000","last_peered":"2024-09-12T19:00:10.360750+0000","last_clean":"2024-09-12T19:00:10.360750+0000","last_became_active":"2024-09-12T17:40:18.781543+0000","last_became_peered":"2024-09-12T17:40:18.781543+0000","last_unstale":"2024-09-12T19:00:10.360750+0000","last_undegraded":"2024-09-12T19:00:10.360750+0000","last_fullsized":"2024-09-12T19:00:10.360750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-12T19:00:10.360515+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-12T19:00:10.360515+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.360515+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:06.783092+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457569,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":553,"num_read_kb":27146,"num_write":1120,"num_write_kb":17169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'186","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.911553+0000","last_change":"2024-09-12T19:00:21.911553+0000","last_active":"2024-09-12T19:00:21.911553+0000","last_peered":"2024-09-12T19:00:21.911553+0000","last_clean":"2024-09-12T19:00:21.911553+0000","last_became_active":"2024-09-12T17:40:20.132914+0000","last_became_peered":"2024-09-12T17:40:20.132914+0000","last_unstale":"2024-09-12T19:00:21.911553+0000","last_undegraded":"2024-09-12T19:00:21.911553+0000","last_fullsized":"2024-09-12T19:00:21.911553+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-12T19:00:21.911343+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-12T19:00:21.911343+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.911343+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:50.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":685,"num_write":286,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'422","reported_seq":1145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.381965+0000","last_change":"2024-09-12T19:00:09.381965+0000","last_active":"2024-09-12T19:00:09.381965+0000","last_peered":"2024-09-12T19:00:09.381965+0000","last_clean":"2024-09-12T19:00:09.381965+0000","last_became_active":"2024-09-12T17:40:18.773572+0000","last_became_peered":"2024-09-12T17:40:18.773572+0000","last_unstale":"2024-09-12T19:00:09.381965+0000","last_undegraded":"2024-09-12T19:00:09.381965+0000","last_fullsized":"2024-09-12T19:00:09.381965+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'422","last_scrub_stamp":"2024-09-12T19:00:09.381751+0000","last_deep_scrub":"264'422","last_deep_scrub_stamp":"2024-09-12T19:00:09.381751+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.381751+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:32.068671+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":27791,"num_write":1413,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'107","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.338332+0000","last_change":"2024-09-12T19:00:18.338332+0000","last_active":"2024-09-12T19:00:18.338332+0000","last_peered":"2024-09-12T19:00:18.338332+0000","last_clean":"2024-09-12T19:00:18.338332+0000","last_became_active":"2024-09-12T17:40:20.124905+0000","last_became_peered":"2024-09-12T17:40:20.124905+0000","last_unstale":"2024-09-12T19:00:18.338332+0000","last_undegraded":"2024-09-12T19:00:18.338332+0000","last_fullsized":"2024-09-12T19:00:18.338332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T19:00:18.338034+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T19:00:18.338034+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.338034+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:10.384014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":441,"num_write":144,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'398","reported_seq":1116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.920289+0000","last_change":"2024-09-12T19:00:15.920289+0000","last_active":"2024-09-12T19:00:15.920289+0000","last_peered":"2024-09-12T19:00:15.920289+0000","last_clean":"2024-09-12T19:00:15.920289+0000","last_became_active":"2024-09-12T17:40:18.776865+0000","last_became_peered":"2024-09-12T17:40:18.776865+0000","last_unstale":"2024-09-12T19:00:15.920289+0000","last_undegraded":"2024-09-12T19:00:15.920289+0000","last_fullsized":"2024-09-12T19:00:15.920289+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-12T19:00:15.920038+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-12T19:00:15.920038+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.920038+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:26.024841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":2000,"num_write":1257,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'104","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.745170+0000","last_change":"2024-09-12T19:00:29.745170+0000","last_active":"2024-09-12T19:00:29.745170+0000","last_peered":"2024-09-12T19:00:29.745170+0000","last_clean":"2024-09-12T19:00:29.745170+0000","last_became_active":"2024-09-12T17:40:20.119036+0000","last_became_peered":"2024-09-12T17:40:20.119036+0000","last_unstale":"2024-09-12T19:00:29.745170+0000","last_undegraded":"2024-09-12T19:00:29.745170+0000","last_fullsized":"2024-09-12T19:00:29.745170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'104","last_scrub_stamp":"2024-09-12T19:00:29.744980+0000","last_deep_scrub":"264'104","last_deep_scrub_stamp":"2024-09-12T19:00:29.744980+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.744980+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:13.725787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":455,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'498","reported_seq":1210,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.639674+0000","last_change":"2024-09-12T19:00:08.639674+0000","last_active":"2024-09-12T19:00:08.639674+0000","last_peered":"2024-09-12T19:00:08.639674+0000","last_clean":"2024-09-12T19:00:08.639674+0000","last_became_active":"2024-09-12T17:40:18.768688+0000","last_became_peered":"2024-09-12T17:40:18.768688+0000","last_unstale":"2024-09-12T19:00:08.639674+0000","last_undegraded":"2024-09-12T19:00:08.639674+0000","last_fullsized":"2024-09-12T19:00:08.639674+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'498","last_scrub_stamp":"2024-09-12T19:00:08.639435+0000","last_deep_scrub":"264'498","last_deep_scrub_stamp":"2024-09-12T19:00:08.639435+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.639435+0000","objects_scrubbed":10,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:14.008750+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1574987,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":867,"num_read_kb":49769,"num_write":1400,"num_write_kb":26119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'160","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.912993+0000","last_change":"2024-09-12T19:00:19.912993+0000","last_active":"2024-09-12T19:00:19.912993+0000","last_peered":"2024-09-12T19:00:19.912993+0000","last_clean":"2024-09-12T19:00:19.912993+0000","last_became_active":"2024-09-12T17:40:20.132698+0000","last_became_peered":"2024-09-12T17:40:20.132698+0000","last_unstale":"2024-09-12T19:00:19.912993+0000","last_undegraded":"2024-09-12T19:00:19.912993+0000","last_fullsized":"2024-09-12T19:00:19.912993+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'160","last_scrub_stamp":"2024-09-12T19:00:19.912805+0000","last_deep_scrub":"264'160","last_deep_scrub_stamp":"2024-09-12T19:00:19.912805+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.912805+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:29.782789+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":512,"num_write":259,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'360","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.274101+0000","last_change":"2024-09-12T19:00:15.274101+0000","last_active":"2024-09-12T19:00:15.274101+0000","last_peered":"2024-09-12T19:00:15.274101+0000","last_clean":"2024-09-12T19:00:15.274101+0000","last_became_active":"2024-09-12T17:40:18.784024+0000","last_became_peered":"2024-09-12T17:40:18.784024+0000","last_unstale":"2024-09-12T19:00:15.274101+0000","last_undegraded":"2024-09-12T19:00:15.274101+0000","last_fullsized":"2024-09-12T19:00:15.274101+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-12T19:00:15.273885+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-12T19:00:15.273885+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.273885+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:38.508212+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506065,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":13540,"num_write":1118,"num_write_kb":25363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'385","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.627938+0000","last_change":"2024-09-12T19:00:06.627843+0000","last_active":"2024-09-12T19:00:06.627938+0000","last_peered":"2024-09-12T19:00:06.627938+0000","last_clean":"2024-09-12T19:00:06.627938+0000","last_became_active":"2024-09-12T17:40:55.331839+0000","last_became_peered":"2024-09-12T17:40:55.331839+0000","last_unstale":"2024-09-12T19:00:06.627938+0000","last_undegraded":"2024-09-12T19:00:06.627938+0000","last_fullsized":"2024-09-12T19:00:06.627938+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T19:00:06.627706+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T19:00:06.627706+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.627706+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:52.807717+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":31466,"num_write":1073,"num_write_kb":39606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'70","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.316844+0000","last_change":"2024-09-12T19:00:20.316695+0000","last_active":"2024-09-12T19:00:20.316844+0000","last_peered":"2024-09-12T19:00:20.316844+0000","last_clean":"2024-09-12T19:00:20.316844+0000","last_became_active":"2024-09-12T17:40:20.116230+0000","last_became_peered":"2024-09-12T17:40:20.116230+0000","last_unstale":"2024-09-12T19:00:20.316844+0000","last_undegraded":"2024-09-12T19:00:20.316844+0000","last_fullsized":"2024-09-12T19:00:20.316844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'70","last_scrub_stamp":"2024-09-12T19:00:20.316504+0000","last_deep_scrub":"264'70","last_deep_scrub_stamp":"2024-09-12T19:00:20.316504+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.316504+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:02.569846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":294,"num_write":113,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'391","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.415348+0000","last_change":"2024-09-12T19:00:11.415348+0000","last_active":"2024-09-12T19:00:11.415348+0000","last_peered":"2024-09-12T19:00:11.415348+0000","last_clean":"2024-09-12T19:00:11.415348+0000","last_became_active":"2024-09-12T17:40:18.774332+0000","last_became_peered":"2024-09-12T17:40:18.774332+0000","last_unstale":"2024-09-12T19:00:11.415348+0000","last_undegraded":"2024-09-12T19:00:11.415348+0000","last_fullsized":"2024-09-12T19:00:11.415348+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'391","last_scrub_stamp":"2024-09-12T19:00:11.415109+0000","last_deep_scrub":"264'391","last_deep_scrub_stamp":"2024-09-12T19:00:11.415109+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.415109+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:08.336481+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482012,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":8119,"num_write":1461,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'266","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.311756+0000","last_change":"2024-09-12T19:00:21.311756+0000","last_active":"2024-09-12T19:00:21.311756+0000","last_peered":"2024-09-12T19:00:21.311756+0000","last_clean":"2024-09-12T19:00:21.311756+0000","last_became_active":"2024-09-12T17:40:20.112521+0000","last_became_peered":"2024-09-12T17:40:20.112521+0000","last_unstale":"2024-09-12T19:00:21.311756+0000","last_undegraded":"2024-09-12T19:00:21.311756+0000","last_fullsized":"2024-09-12T19:00:21.311756+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T19:00:21.311545+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T19:00:21.311545+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.311545+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.668351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1090,"num_read_kb":887,"num_write":395,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5850,"num_read_kb":4138,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16272,"num_read_kb":15940,"num_write":16723,"num_write_kb":4884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1838,"ondisk_log_size":1838,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":493,"ondisk_log_size":493,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1567416,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":19029,"num_read_kb":39666,"num_write":15931,"num_write_kb":12049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":682050,"num_omap_keys":1558,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1833,"ondisk_log_size":1833,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103249,"num_read_kb":86122,"num_write":37396,"num_write_kb":18900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44332,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3961,"ondisk_log_size":3961,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":156029425,"num_objects":414,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":414,"num_whiteouts":0,"num_read":36445,"num_read_kb":1876664,"num_write":72236,"num_write_kb":2152272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":313376768,"data_stored":312058850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3611,"ondisk_log_size":3611,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":197405,"num_write":186,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":186093,"num_write":186,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510413,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308820,"kb_used_data":52740,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94063020,"statfs":{"total":96636764160,"available":96320532480,"internally_reserved":0,"allocated":54005760,"data_stored":52302612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":262207946},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510413,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261840,"kb_used_data":27968,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94110000,"statfs":{"total":96636764160,"available":96368640000,"internally_reserved":0,"allocated":28639232,"data_stored":27005259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510412,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140380,"kb_used_data":41228,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94231460,"statfs":{"total":96636764160,"available":96493015040,"internally_reserved":0,"allocated":42217472,"data_stored":40481962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510413,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117828,"kb_used_data":46388,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94254012,"statfs":{"total":96636764160,"available":96516108288,"internally_reserved":0,"allocated":47501312,"data_stored":45836760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510411,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303104,"kb_used_data":51184,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94068736,"statfs":{"total":96636764160,"available":96326385664,"internally_reserved":0,"allocated":52412416,"data_stored":50705649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510411,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133100,"kb_used_data":29788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94238740,"statfs":{"total":96636764160,"available":96500469760,"internally_reserved":0,"allocated":30502912,"data_stored":28881998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510413,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272500,"kb_used_data":56676,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94099340,"statfs":{"total":96636764160,"available":96357724160,"internally_reserved":0,"allocated":58036224,"data_stored":56286500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575820,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92812,"kb_used_data":29756,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94279028,"statfs":{"total":96636764160,"available":96541724672,"internally_reserved":0,"allocated":30470144,"data_stored":28895816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":64551368},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53760000,"data_stored":53550290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26857472,"data_stored":26738240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26849280,"data_stored":26750445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48742400,"data_stored":48559608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":43892736,"data_stored":43694024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":38510592,"data_stored":38336597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25014272,"data_stored":24861531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49750016,"data_stored":49568115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:00:47.672 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.673 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.673 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.673 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.673 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.673 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.673 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.673 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.673 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.674 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.674 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.674 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.674 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.674 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.674 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.674 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.674 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.674 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.674 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.675 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.675 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.675 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.675 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.675 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.675 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.675 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.675 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.675 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.676 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.676 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.676 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.676 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.676 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.676 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.676 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.676 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.676 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.677 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.677 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.677 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.677 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.677 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.677 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.677 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.677 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.677 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.677 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.678 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.678 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.678 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.678 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.678 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.678 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.678 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.678 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.678 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.679 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.679 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.679 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.679 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.679 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.679 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.679 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.680 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.680 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.680 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.680 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.680 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.680 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.680 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.680 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.681 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.681 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.681 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.681 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.681 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.681 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.681 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.681 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.681 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.681 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.682 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.682 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.682 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.682 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.682 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.682 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.682 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.682 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.682 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:59:37.920488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.683 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:55:58.298802+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=55, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.683 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.683 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.683 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.684 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.685 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.685 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.686 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:40:27.152654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:00:47.687 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:01:07.688 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:01:08.048 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T19:01:08.065 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-09-12T19:01:08.082 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":2690,"stamp":"2024-09-12T19:01:07.368385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158204416,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":183664,"num_read_kb":2408959,"num_write":144741,"num_write_kb":2446021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":739430,"num_omap_keys":1783,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13118,"ondisk_log_size":13118,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1652592,"kb_used_data":335728,"kb_used_omap":12,"kb_used_meta":1316723,"kb_avail":753322128,"statfs":{"total":773094113280,"available":771401859072,"internally_reserved":0,"allocated":343785472,"data_stored":330396556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1348324915},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007873"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:52.143113+0000","last_change":"2024-09-12T19:00:52.143113+0000","last_active":"2024-09-12T19:00:52.143113+0000","last_peered":"2024-09-12T19:00:52.143113+0000","last_clean":"2024-09-12T19:00:52.143113+0000","last_became_active":"2024-09-12T18:19:57.853375+0000","last_became_peered":"2024-09-12T18:19:57.853375+0000","last_unstale":"2024-09-12T19:00:52.143113+0000","last_undegraded":"2024-09-12T19:00:52.143113+0000","last_fullsized":"2024-09-12T19:00:52.143113+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:52.142932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:52.142932+0000","last_clean_scrub_stamp":"2024-09-12T19:00:52.142932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:37.656070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:49.179492+0000","last_change":"2024-09-12T19:00:49.179492+0000","last_active":"2024-09-12T19:00:49.179492+0000","last_peered":"2024-09-12T19:00:49.179492+0000","last_clean":"2024-09-12T19:00:49.179492+0000","last_became_active":"2024-09-12T17:59:43.010854+0000","last_became_peered":"2024-09-12T17:59:43.010854+0000","last_unstale":"2024-09-12T19:00:49.179492+0000","last_undegraded":"2024-09-12T19:00:49.179492+0000","last_fullsized":"2024-09-12T19:00:49.179492+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:49.179284+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:49.179284+0000","last_clean_scrub_stamp":"2024-09-12T19:00:49.179284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:40.599701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:51.871562+0000","last_change":"2024-09-12T19:00:51.871562+0000","last_active":"2024-09-12T19:00:51.871562+0000","last_peered":"2024-09-12T19:00:51.871562+0000","last_clean":"2024-09-12T19:00:51.871562+0000","last_became_active":"2024-09-12T17:59:38.987739+0000","last_became_peered":"2024-09-12T17:59:38.987739+0000","last_unstale":"2024-09-12T19:00:51.871562+0000","last_undegraded":"2024-09-12T19:00:51.871562+0000","last_fullsized":"2024-09-12T19:00:51.871562+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:51.871273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:51.871273+0000","last_clean_scrub_stamp":"2024-09-12T19:00:51.871273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:55.840848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'44","reported_seq":193,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.265254+0000","last_change":"2024-09-12T19:00:48.265254+0000","last_active":"2024-09-12T19:00:48.265254+0000","last_peered":"2024-09-12T19:00:48.265254+0000","last_clean":"2024-09-12T19:00:48.265254+0000","last_became_active":"2024-09-12T17:55:59.358302+0000","last_became_peered":"2024-09-12T17:55:59.358302+0000","last_unstale":"2024-09-12T19:00:48.265254+0000","last_undegraded":"2024-09-12T19:00:48.265254+0000","last_fullsized":"2024-09-12T19:00:48.265254+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T19:00:48.265064+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T19:00:48.265064+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.265064+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:02.881099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":154,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.602712+0000","last_change":"2024-09-12T19:00:34.602712+0000","last_active":"2024-09-12T19:00:34.602712+0000","last_peered":"2024-09-12T19:00:34.602712+0000","last_clean":"2024-09-12T19:00:34.602712+0000","last_became_active":"2024-09-12T18:19:57.838918+0000","last_became_peered":"2024-09-12T18:19:57.838918+0000","last_unstale":"2024-09-12T19:00:34.602712+0000","last_undegraded":"2024-09-12T19:00:34.602712+0000","last_fullsized":"2024-09-12T19:00:34.602712+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.602418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.602418+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.602418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:58.606445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:53.797406+0000","last_change":"2024-09-12T19:00:53.797406+0000","last_active":"2024-09-12T19:00:53.797406+0000","last_peered":"2024-09-12T19:00:53.797406+0000","last_clean":"2024-09-12T19:00:53.797406+0000","last_became_active":"2024-09-12T17:59:43.005733+0000","last_became_peered":"2024-09-12T17:59:43.005733+0000","last_unstale":"2024-09-12T19:00:53.797406+0000","last_undegraded":"2024-09-12T19:00:53.797406+0000","last_fullsized":"2024-09-12T19:00:53.797406+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:53.797230+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:53.797230+0000","last_clean_scrub_stamp":"2024-09-12T19:00:53.797230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:34.439903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'8","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.448440+0000","last_change":"2024-09-12T19:00:35.448440+0000","last_active":"2024-09-12T19:00:35.448440+0000","last_peered":"2024-09-12T19:00:35.448440+0000","last_clean":"2024-09-12T19:00:35.448440+0000","last_became_active":"2024-09-12T17:59:38.989854+0000","last_became_peered":"2024-09-12T17:59:38.989854+0000","last_unstale":"2024-09-12T19:00:35.448440+0000","last_undegraded":"2024-09-12T19:00:35.448440+0000","last_fullsized":"2024-09-12T19:00:35.448440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T19:00:35.448258+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T19:00:35.448258+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.448258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.753556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8763,"num_write":8,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'34","reported_seq":165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.644434+0000","last_change":"2024-09-12T19:00:26.644434+0000","last_active":"2024-09-12T19:00:26.644434+0000","last_peered":"2024-09-12T19:00:26.644434+0000","last_clean":"2024-09-12T19:00:26.644434+0000","last_became_active":"2024-09-12T17:55:59.367426+0000","last_became_peered":"2024-09-12T17:55:59.367426+0000","last_unstale":"2024-09-12T19:00:26.644434+0000","last_undegraded":"2024-09-12T19:00:26.644434+0000","last_fullsized":"2024-09-12T19:00:26.644434+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-12T19:00:26.644251+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-12T19:00:26.644251+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.644251+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:22.784901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":114,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.301014+0000","last_change":"2024-09-12T19:00:43.300784+0000","last_active":"2024-09-12T19:00:43.301014+0000","last_peered":"2024-09-12T19:00:43.301014+0000","last_clean":"2024-09-12T19:00:43.301014+0000","last_became_active":"2024-09-12T18:19:57.848735+0000","last_became_peered":"2024-09-12T18:19:57.848735+0000","last_unstale":"2024-09-12T19:00:43.301014+0000","last_undegraded":"2024-09-12T19:00:43.301014+0000","last_fullsized":"2024-09-12T19:00:43.301014+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:43.300572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:43.300572+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.300572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:37.373507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:59.048494+0000","last_change":"2024-09-12T19:00:59.048494+0000","last_active":"2024-09-12T19:00:59.048494+0000","last_peered":"2024-09-12T19:00:59.048494+0000","last_clean":"2024-09-12T19:00:59.048494+0000","last_became_active":"2024-09-12T17:59:43.011603+0000","last_became_peered":"2024-09-12T17:59:43.011603+0000","last_unstale":"2024-09-12T19:00:59.048494+0000","last_undegraded":"2024-09-12T19:00:59.048494+0000","last_fullsized":"2024-09-12T19:00:59.048494+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:00:59.048294+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:00:59.048294+0000","last_clean_scrub_stamp":"2024-09-12T19:00:59.048294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:16.558431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.598570+0000","last_change":"2024-09-12T19:00:30.598570+0000","last_active":"2024-09-12T19:00:30.598570+0000","last_peered":"2024-09-12T19:00:30.598570+0000","last_clean":"2024-09-12T19:00:30.598570+0000","last_became_active":"2024-09-12T17:59:38.984980+0000","last_became_peered":"2024-09-12T17:59:38.984980+0000","last_unstale":"2024-09-12T19:00:30.598570+0000","last_undegraded":"2024-09-12T19:00:30.598570+0000","last_fullsized":"2024-09-12T19:00:30.598570+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.598387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.598387+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.598387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.429276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'15","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.322556+0000","last_change":"2024-09-12T19:00:46.322377+0000","last_active":"2024-09-12T19:00:46.322556+0000","last_peered":"2024-09-12T19:00:46.322556+0000","last_clean":"2024-09-12T19:00:46.322556+0000","last_became_active":"2024-09-12T17:55:59.356144+0000","last_became_peered":"2024-09-12T17:55:59.356144+0000","last_unstale":"2024-09-12T19:00:46.322556+0000","last_undegraded":"2024-09-12T19:00:46.322556+0000","last_fullsized":"2024-09-12T19:00:46.322556+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-09-12T19:00:46.322189+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-09-12T19:00:46.322189+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.322189+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:03.365571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:56:27.442648+0000","last_change":"2024-09-12T18:19:57.861119+0000","last_active":"2024-09-12T18:56:27.442648+0000","last_peered":"2024-09-12T18:56:27.442648+0000","last_clean":"2024-09-12T18:56:27.442648+0000","last_became_active":"2024-09-12T18:19:57.860464+0000","last_became_peered":"2024-09-12T18:19:57.860464+0000","last_unstale":"2024-09-12T18:56:27.442648+0000","last_undegraded":"2024-09-12T18:56:27.442648+0000","last_fullsized":"2024-09-12T18:56:27.442648+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:37.217624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'4","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:59:59.129553+0000","last_change":"2024-09-12T17:59:43.031327+0000","last_active":"2024-09-12T18:59:59.129553+0000","last_peered":"2024-09-12T18:59:59.129553+0000","last_clean":"2024-09-12T18:59:59.129553+0000","last_became_active":"2024-09-12T17:59:43.030545+0000","last_became_peered":"2024-09-12T17:59:43.030545+0000","last_unstale":"2024-09-12T18:59:59.129553+0000","last_undegraded":"2024-09-12T18:59:59.129553+0000","last_fullsized":"2024-09-12T18:59:59.129553+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:59:41.963373+0000","last_clean_scrub_stamp":"2024-09-12T17:59:41.963373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:11.859283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4192,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.810854+0000","last_change":"2024-09-12T19:00:46.810854+0000","last_active":"2024-09-12T19:00:46.810854+0000","last_peered":"2024-09-12T19:00:46.810854+0000","last_clean":"2024-09-12T19:00:46.810854+0000","last_became_active":"2024-09-12T17:59:38.945373+0000","last_became_peered":"2024-09-12T17:59:38.945373+0000","last_unstale":"2024-09-12T19:00:46.810854+0000","last_undegraded":"2024-09-12T19:00:46.810854+0000","last_fullsized":"2024-09-12T19:00:46.810854+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:46.810616+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:46.810616+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.810616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:16.284198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'6","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:49.848794+0000","last_change":"2024-09-12T19:00:49.848598+0000","last_active":"2024-09-12T19:00:49.848794+0000","last_peered":"2024-09-12T19:00:49.848794+0000","last_clean":"2024-09-12T19:00:49.848794+0000","last_became_active":"2024-09-12T17:55:59.338550+0000","last_became_peered":"2024-09-12T17:55:59.338550+0000","last_unstale":"2024-09-12T19:00:49.848794+0000","last_undegraded":"2024-09-12T19:00:49.848794+0000","last_fullsized":"2024-09-12T19:00:49.848794+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:49.848417+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:49.848417+0000","last_clean_scrub_stamp":"2024-09-12T19:00:49.848417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:07.641525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468443+0000","last_change":"2024-09-12T18:19:57.871984+0000","last_active":"2024-09-12T18:58:12.468443+0000","last_peered":"2024-09-12T18:58:12.468443+0000","last_clean":"2024-09-12T18:58:12.468443+0000","last_became_active":"2024-09-12T18:19:57.871345+0000","last_became_peered":"2024-09-12T18:19:57.871345+0000","last_unstale":"2024-09-12T18:58:12.468443+0000","last_undegraded":"2024-09-12T18:58:12.468443+0000","last_fullsized":"2024-09-12T18:58:12.468443+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.221817+0000","last_change":"2024-09-12T19:00:48.221817+0000","last_active":"2024-09-12T19:00:48.221817+0000","last_peered":"2024-09-12T19:00:48.221817+0000","last_clean":"2024-09-12T19:00:48.221817+0000","last_became_active":"2024-09-12T17:59:43.034299+0000","last_became_peered":"2024-09-12T17:59:43.034299+0000","last_unstale":"2024-09-12T19:00:48.221817+0000","last_undegraded":"2024-09-12T19:00:48.221817+0000","last_fullsized":"2024-09-12T19:00:48.221817+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T19:00:48.221632+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T19:00:48.221632+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.221632+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:51.320406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'6","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:53.140558+0000","last_change":"2024-09-12T19:00:53.140558+0000","last_active":"2024-09-12T19:00:53.140558+0000","last_peered":"2024-09-12T19:00:53.140558+0000","last_clean":"2024-09-12T19:00:53.140558+0000","last_became_active":"2024-09-12T17:59:38.976348+0000","last_became_peered":"2024-09-12T17:59:38.976348+0000","last_unstale":"2024-09-12T19:00:53.140558+0000","last_undegraded":"2024-09-12T19:00:53.140558+0000","last_fullsized":"2024-09-12T19:00:53.140558+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T19:00:53.140370+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T19:00:53.140370+0000","last_clean_scrub_stamp":"2024-09-12T19:00:53.140370+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:56.951784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'16","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.803174+0000","last_change":"2024-09-12T19:00:45.803029+0000","last_active":"2024-09-12T19:00:45.803174+0000","last_peered":"2024-09-12T19:00:45.803174+0000","last_clean":"2024-09-12T19:00:45.803174+0000","last_became_active":"2024-09-12T17:55:59.356970+0000","last_became_peered":"2024-09-12T17:55:59.356970+0000","last_unstale":"2024-09-12T19:00:45.803174+0000","last_undegraded":"2024-09-12T19:00:45.803174+0000","last_fullsized":"2024-09-12T19:00:45.803174+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T19:00:45.802864+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T19:00:45.802864+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.802864+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:33.411161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":58,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.466343+0000","last_change":"2024-09-12T19:00:47.466343+0000","last_active":"2024-09-12T19:00:47.466343+0000","last_peered":"2024-09-12T19:00:47.466343+0000","last_clean":"2024-09-12T19:00:47.466343+0000","last_became_active":"2024-09-12T18:19:57.865319+0000","last_became_peered":"2024-09-12T18:19:57.865319+0000","last_unstale":"2024-09-12T19:00:47.466343+0000","last_undegraded":"2024-09-12T19:00:47.466343+0000","last_fullsized":"2024-09-12T19:00:47.466343+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:47.466158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:47.466158+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.466158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:45.700520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'2","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.326653+0000","last_change":"2024-09-12T19:00:40.326653+0000","last_active":"2024-09-12T19:00:40.326653+0000","last_peered":"2024-09-12T19:00:40.326653+0000","last_clean":"2024-09-12T19:00:40.326653+0000","last_became_active":"2024-09-12T17:59:56.386194+0000","last_became_peered":"2024-09-12T17:59:56.386194+0000","last_unstale":"2024-09-12T19:00:40.326653+0000","last_undegraded":"2024-09-12T19:00:40.326653+0000","last_fullsized":"2024-09-12T19:00:40.326653+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:40.326477+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:40.326477+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.326477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:00.992353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'9","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.807079+0000","last_change":"2024-09-12T19:00:48.807079+0000","last_active":"2024-09-12T19:00:48.807079+0000","last_peered":"2024-09-12T19:00:48.807079+0000","last_clean":"2024-09-12T19:00:48.807079+0000","last_became_active":"2024-09-12T17:59:38.977316+0000","last_became_peered":"2024-09-12T17:59:38.977316+0000","last_unstale":"2024-09-12T19:00:48.807079+0000","last_undegraded":"2024-09-12T19:00:48.807079+0000","last_fullsized":"2024-09-12T19:00:48.807079+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T19:00:48.806887+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T19:00:48.806887+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.806887+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.411227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16386,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'37","reported_seq":169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.282266+0000","last_change":"2024-09-12T19:00:34.282096+0000","last_active":"2024-09-12T19:00:34.282266+0000","last_peered":"2024-09-12T19:00:34.282266+0000","last_clean":"2024-09-12T19:00:34.282266+0000","last_became_active":"2024-09-12T17:55:59.366177+0000","last_became_peered":"2024-09-12T17:55:59.366177+0000","last_unstale":"2024-09-12T19:00:34.282266+0000","last_undegraded":"2024-09-12T19:00:34.282266+0000","last_fullsized":"2024-09-12T19:00:34.282266+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-12T19:00:34.281883+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-12T19:00:34.281883+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.281883+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:39.353385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":133,"num_write":64,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:01.812970+0000","last_change":"2024-09-12T19:01:01.812970+0000","last_active":"2024-09-12T19:01:01.812970+0000","last_peered":"2024-09-12T19:01:01.812970+0000","last_clean":"2024-09-12T19:01:01.812970+0000","last_became_active":"2024-09-12T18:19:57.843946+0000","last_became_peered":"2024-09-12T18:19:57.843946+0000","last_unstale":"2024-09-12T19:01:01.812970+0000","last_undegraded":"2024-09-12T19:01:01.812970+0000","last_fullsized":"2024-09-12T19:01:01.812970+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:01:01.812756+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:01:01.812756+0000","last_clean_scrub_stamp":"2024-09-12T19:01:01.812756+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:33.229092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.312204+0000","last_change":"2024-09-12T19:00:41.312204+0000","last_active":"2024-09-12T19:00:41.312204+0000","last_peered":"2024-09-12T19:00:41.312204+0000","last_clean":"2024-09-12T19:00:41.312204+0000","last_became_active":"2024-09-12T17:59:43.013293+0000","last_became_peered":"2024-09-12T17:59:43.013293+0000","last_unstale":"2024-09-12T19:00:41.312204+0000","last_undegraded":"2024-09-12T19:00:41.312204+0000","last_fullsized":"2024-09-12T19:00:41.312204+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:41.312027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:41.312027+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.312027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:34.062293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.833891+0000","last_change":"2024-09-12T19:00:44.833891+0000","last_active":"2024-09-12T19:00:44.833891+0000","last_peered":"2024-09-12T19:00:44.833891+0000","last_clean":"2024-09-12T19:00:44.833891+0000","last_became_active":"2024-09-12T17:59:38.984004+0000","last_became_peered":"2024-09-12T17:59:38.984004+0000","last_unstale":"2024-09-12T19:00:44.833891+0000","last_undegraded":"2024-09-12T19:00:44.833891+0000","last_fullsized":"2024-09-12T19:00:44.833891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:44.833706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:44.833706+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.833706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:43.545551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'21","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.318147+0000","last_change":"2024-09-12T19:00:45.318147+0000","last_active":"2024-09-12T19:00:45.318147+0000","last_peered":"2024-09-12T19:00:45.318147+0000","last_clean":"2024-09-12T19:00:45.318147+0000","last_became_active":"2024-09-12T17:55:59.366968+0000","last_became_peered":"2024-09-12T17:55:59.366968+0000","last_unstale":"2024-09-12T19:00:45.318147+0000","last_undegraded":"2024-09-12T19:00:45.318147+0000","last_fullsized":"2024-09-12T19:00:45.318147+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-12T19:00:45.317964+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-12T19:00:45.317964+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.317964+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:09.029203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:57:27.457398+0000","last_change":"2024-09-12T18:19:57.871547+0000","last_active":"2024-09-12T18:57:27.457398+0000","last_peered":"2024-09-12T18:57:27.457398+0000","last_clean":"2024-09-12T18:57:27.457398+0000","last_became_active":"2024-09-12T18:19:57.870750+0000","last_became_peered":"2024-09-12T18:19:57.870750+0000","last_unstale":"2024-09-12T18:57:27.457398+0000","last_undegraded":"2024-09-12T18:57:27.457398+0000","last_fullsized":"2024-09-12T18:57:27.457398+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:27.428422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:58.902274+0000","last_change":"2024-09-12T19:00:58.902274+0000","last_active":"2024-09-12T19:00:58.902274+0000","last_peered":"2024-09-12T19:00:58.902274+0000","last_clean":"2024-09-12T19:00:58.902274+0000","last_became_active":"2024-09-12T17:59:43.021777+0000","last_became_peered":"2024-09-12T17:59:43.021777+0000","last_unstale":"2024-09-12T19:00:58.902274+0000","last_undegraded":"2024-09-12T19:00:58.902274+0000","last_fullsized":"2024-09-12T19:00:58.902274+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T19:00:58.902088+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T19:00:58.902088+0000","last_clean_scrub_stamp":"2024-09-12T19:00:58.902088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:06.336718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'6","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:56.093615+0000","last_change":"2024-09-12T19:00:56.093615+0000","last_active":"2024-09-12T19:00:56.093615+0000","last_peered":"2024-09-12T19:00:56.093615+0000","last_clean":"2024-09-12T19:00:56.093615+0000","last_became_active":"2024-09-12T17:59:38.989753+0000","last_became_peered":"2024-09-12T17:59:38.989753+0000","last_unstale":"2024-09-12T19:00:56.093615+0000","last_undegraded":"2024-09-12T19:00:56.093615+0000","last_fullsized":"2024-09-12T19:00:56.093615+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T19:00:56.093374+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T19:00:56.093374+0000","last_clean_scrub_stamp":"2024-09-12T19:00:56.093374+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:30.412948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'22","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.429649+0000","last_change":"2024-09-12T19:00:34.429649+0000","last_active":"2024-09-12T19:00:34.429649+0000","last_peered":"2024-09-12T19:00:34.429649+0000","last_clean":"2024-09-12T19:00:34.429649+0000","last_became_active":"2024-09-12T17:55:59.329792+0000","last_became_peered":"2024-09-12T17:55:59.329792+0000","last_unstale":"2024-09-12T19:00:34.429649+0000","last_undegraded":"2024-09-12T19:00:34.429649+0000","last_fullsized":"2024-09-12T19:00:34.429649+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-12T19:00:34.429450+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-12T19:00:34.429450+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.429450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:51.008916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.477892+0000","last_change":"2024-09-12T19:00:46.477892+0000","last_active":"2024-09-12T19:00:46.477892+0000","last_peered":"2024-09-12T19:00:46.477892+0000","last_clean":"2024-09-12T19:00:46.477892+0000","last_became_active":"2024-09-12T18:19:57.863600+0000","last_became_peered":"2024-09-12T18:19:57.863600+0000","last_unstale":"2024-09-12T19:00:46.477892+0000","last_undegraded":"2024-09-12T19:00:46.477892+0000","last_fullsized":"2024-09-12T19:00:46.477892+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:46.477707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:46.477707+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.477707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:31.175442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:59.875767+0000","last_change":"2024-09-12T19:00:59.875767+0000","last_active":"2024-09-12T19:00:59.875767+0000","last_peered":"2024-09-12T19:00:59.875767+0000","last_clean":"2024-09-12T19:00:59.875767+0000","last_became_active":"2024-09-12T17:59:43.031016+0000","last_became_peered":"2024-09-12T17:59:43.031016+0000","last_unstale":"2024-09-12T19:00:59.875767+0000","last_undegraded":"2024-09-12T19:00:59.875767+0000","last_fullsized":"2024-09-12T19:00:59.875767+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:00:59.875526+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:00:59.875526+0000","last_clean_scrub_stamp":"2024-09-12T19:00:59.875526+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:42.867904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.224160+0000","last_change":"2024-09-12T19:00:46.224160+0000","last_active":"2024-09-12T19:00:46.224160+0000","last_peered":"2024-09-12T19:00:46.224160+0000","last_clean":"2024-09-12T19:00:46.224160+0000","last_became_active":"2024-09-12T17:59:38.966158+0000","last_became_peered":"2024-09-12T17:59:38.966158+0000","last_unstale":"2024-09-12T19:00:46.224160+0000","last_undegraded":"2024-09-12T19:00:46.224160+0000","last_fullsized":"2024-09-12T19:00:46.224160+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:46.223984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:46.223984+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.223984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:40.994472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'26","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:50.214157+0000","last_change":"2024-09-12T19:00:50.214157+0000","last_active":"2024-09-12T19:00:50.214157+0000","last_peered":"2024-09-12T19:00:50.214157+0000","last_clean":"2024-09-12T19:00:50.214157+0000","last_became_active":"2024-09-12T17:55:59.366803+0000","last_became_peered":"2024-09-12T17:55:59.366803+0000","last_unstale":"2024-09-12T19:00:50.214157+0000","last_undegraded":"2024-09-12T19:00:50.214157+0000","last_fullsized":"2024-09-12T19:00:50.214157+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T19:00:50.213963+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T19:00:50.213963+0000","last_clean_scrub_stamp":"2024-09-12T19:00:50.213963+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:01.936720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.621793+0000","last_change":"2024-09-12T19:00:33.621793+0000","last_active":"2024-09-12T19:00:33.621793+0000","last_peered":"2024-09-12T19:00:33.621793+0000","last_clean":"2024-09-12T19:00:33.621793+0000","last_became_active":"2024-09-12T18:19:57.845474+0000","last_became_peered":"2024-09-12T18:19:57.845474+0000","last_unstale":"2024-09-12T19:00:33.621793+0000","last_undegraded":"2024-09-12T19:00:33.621793+0000","last_fullsized":"2024-09-12T19:00:33.621793+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:33.621590+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:33.621590+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.621590+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:48.260800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:53.848573+0000","last_change":"2024-09-12T19:00:53.848573+0000","last_active":"2024-09-12T19:00:53.848573+0000","last_peered":"2024-09-12T19:00:53.848573+0000","last_clean":"2024-09-12T19:00:53.848573+0000","last_became_active":"2024-09-12T17:59:43.034159+0000","last_became_peered":"2024-09-12T17:59:43.034159+0000","last_unstale":"2024-09-12T19:00:53.848573+0000","last_undegraded":"2024-09-12T19:00:53.848573+0000","last_fullsized":"2024-09-12T19:00:53.848573+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:53.848378+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:53.848378+0000","last_clean_scrub_stamp":"2024-09-12T19:00:53.848378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:01.085747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:51.684508+0000","last_change":"2024-09-12T19:00:51.684508+0000","last_active":"2024-09-12T19:00:51.684508+0000","last_peered":"2024-09-12T19:00:51.684508+0000","last_clean":"2024-09-12T19:00:51.684508+0000","last_became_active":"2024-09-12T17:59:38.980797+0000","last_became_peered":"2024-09-12T17:59:38.980797+0000","last_unstale":"2024-09-12T19:00:51.684508+0000","last_undegraded":"2024-09-12T19:00:51.684508+0000","last_fullsized":"2024-09-12T19:00:51.684508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:51.684313+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:51.684313+0000","last_clean_scrub_stamp":"2024-09-12T19:00:51.684313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:20.425081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'6","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:57.864284+0000","last_change":"2024-09-12T19:00:57.864284+0000","last_active":"2024-09-12T19:00:57.864284+0000","last_peered":"2024-09-12T19:00:57.864284+0000","last_clean":"2024-09-12T19:00:57.864284+0000","last_became_active":"2024-09-12T17:55:59.366679+0000","last_became_peered":"2024-09-12T17:55:59.366679+0000","last_unstale":"2024-09-12T19:00:57.864284+0000","last_undegraded":"2024-09-12T19:00:57.864284+0000","last_fullsized":"2024-09-12T19:00:57.864284+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:57.864091+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:57.864091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:57.864091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:15.276951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:00.809681+0000","last_change":"2024-09-12T19:01:00.809681+0000","last_active":"2024-09-12T19:01:00.809681+0000","last_peered":"2024-09-12T19:01:00.809681+0000","last_clean":"2024-09-12T19:01:00.809681+0000","last_became_active":"2024-09-12T18:19:57.840855+0000","last_became_peered":"2024-09-12T18:19:57.840855+0000","last_unstale":"2024-09-12T19:01:00.809681+0000","last_undegraded":"2024-09-12T19:01:00.809681+0000","last_fullsized":"2024-09-12T19:01:00.809681+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:01:00.809494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:01:00.809494+0000","last_clean_scrub_stamp":"2024-09-12T19:01:00.809494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:07.450262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'4","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:00.890980+0000","last_change":"2024-09-12T19:01:00.890980+0000","last_active":"2024-09-12T19:01:00.890980+0000","last_peered":"2024-09-12T19:01:00.890980+0000","last_clean":"2024-09-12T19:01:00.890980+0000","last_became_active":"2024-09-12T17:59:43.021538+0000","last_became_peered":"2024-09-12T17:59:43.021538+0000","last_unstale":"2024-09-12T19:01:00.890980+0000","last_undegraded":"2024-09-12T19:01:00.890980+0000","last_fullsized":"2024-09-12T19:01:00.890980+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:01:00.890737+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:01:00.890737+0000","last_clean_scrub_stamp":"2024-09-12T19:01:00.890737+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:03.567058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'6","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.608183+0000","last_change":"2024-09-12T19:00:29.608183+0000","last_active":"2024-09-12T19:00:29.608183+0000","last_peered":"2024-09-12T19:00:29.608183+0000","last_clean":"2024-09-12T19:00:29.608183+0000","last_became_active":"2024-09-12T17:59:38.979939+0000","last_became_peered":"2024-09-12T17:59:38.979939+0000","last_unstale":"2024-09-12T19:00:29.608183+0000","last_undegraded":"2024-09-12T19:00:29.608183+0000","last_fullsized":"2024-09-12T19:00:29.608183+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:29.607994+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:29.607994+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.607994+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:24.431667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'36","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.606507+0000","last_change":"2024-09-12T19:00:25.606507+0000","last_active":"2024-09-12T19:00:25.606507+0000","last_peered":"2024-09-12T19:00:25.606507+0000","last_clean":"2024-09-12T19:00:25.606507+0000","last_became_active":"2024-09-12T17:55:59.330570+0000","last_became_peered":"2024-09-12T17:55:59.330570+0000","last_unstale":"2024-09-12T19:00:25.606507+0000","last_undegraded":"2024-09-12T19:00:25.606507+0000","last_fullsized":"2024-09-12T19:00:25.606507+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-12T19:00:25.606314+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-12T19:00:25.606314+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.606314+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:49.274900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":139,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:51.126911+0000","last_change":"2024-09-12T19:00:51.126911+0000","last_active":"2024-09-12T19:00:51.126911+0000","last_peered":"2024-09-12T19:00:51.126911+0000","last_clean":"2024-09-12T19:00:51.126911+0000","last_became_active":"2024-09-12T18:19:57.853269+0000","last_became_peered":"2024-09-12T18:19:57.853269+0000","last_unstale":"2024-09-12T19:00:51.126911+0000","last_undegraded":"2024-09-12T19:00:51.126911+0000","last_fullsized":"2024-09-12T19:00:51.126911+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:51.126706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:51.126706+0000","last_clean_scrub_stamp":"2024-09-12T19:00:51.126706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:31.638078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:52.828240+0000","last_change":"2024-09-12T19:00:52.828240+0000","last_active":"2024-09-12T19:00:52.828240+0000","last_peered":"2024-09-12T19:00:52.828240+0000","last_clean":"2024-09-12T19:00:52.828240+0000","last_became_active":"2024-09-12T17:59:43.020450+0000","last_became_peered":"2024-09-12T17:59:43.020450+0000","last_unstale":"2024-09-12T19:00:52.828240+0000","last_undegraded":"2024-09-12T19:00:52.828240+0000","last_fullsized":"2024-09-12T19:00:52.828240+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T19:00:52.828055+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T19:00:52.828055+0000","last_clean_scrub_stamp":"2024-09-12T19:00:52.828055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:54.571910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'7","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:49.261944+0000","last_change":"2024-09-12T19:00:49.261944+0000","last_active":"2024-09-12T19:00:49.261944+0000","last_peered":"2024-09-12T19:00:49.261944+0000","last_clean":"2024-09-12T19:00:49.261944+0000","last_became_active":"2024-09-12T17:59:38.982556+0000","last_became_peered":"2024-09-12T17:59:38.982556+0000","last_unstale":"2024-09-12T19:00:49.261944+0000","last_undegraded":"2024-09-12T19:00:49.261944+0000","last_fullsized":"2024-09-12T19:00:49.261944+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T19:00:49.261678+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T19:00:49.261678+0000","last_clean_scrub_stamp":"2024-09-12T19:00:49.261678+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.499200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'83","reported_seq":301,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.784338+0000","last_change":"2024-09-12T19:00:45.784338+0000","last_active":"2024-09-12T19:00:45.784338+0000","last_peered":"2024-09-12T19:00:45.784338+0000","last_clean":"2024-09-12T19:00:45.784338+0000","last_became_active":"2024-09-12T17:55:59.363431+0000","last_became_peered":"2024-09-12T17:55:59.363431+0000","last_unstale":"2024-09-12T19:00:45.784338+0000","last_undegraded":"2024-09-12T19:00:45.784338+0000","last_fullsized":"2024-09-12T19:00:45.784338+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'83","last_scrub_stamp":"2024-09-12T19:00:45.784154+0000","last_deep_scrub":"264'83","last_deep_scrub_stamp":"2024-09-12T19:00:45.784154+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.784154+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:24.158887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":321,"num_write":127,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:37.474655+0000","last_change":"2024-09-12T18:19:57.836599+0000","last_active":"2024-09-12T18:58:37.474655+0000","last_peered":"2024-09-12T18:58:37.474655+0000","last_clean":"2024-09-12T18:58:37.474655+0000","last_became_active":"2024-09-12T18:19:57.835852+0000","last_became_peered":"2024-09-12T18:19:57.835852+0000","last_unstale":"2024-09-12T18:58:37.474655+0000","last_undegraded":"2024-09-12T18:58:37.474655+0000","last_fullsized":"2024-09-12T18:58:37.474655+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.428350+0000","last_change":"2024-09-12T19:00:45.428350+0000","last_active":"2024-09-12T19:00:45.428350+0000","last_peered":"2024-09-12T19:00:45.428350+0000","last_clean":"2024-09-12T19:00:45.428350+0000","last_became_active":"2024-09-12T17:59:43.024103+0000","last_became_peered":"2024-09-12T17:59:43.024103+0000","last_unstale":"2024-09-12T19:00:45.428350+0000","last_undegraded":"2024-09-12T19:00:45.428350+0000","last_fullsized":"2024-09-12T19:00:45.428350+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:45.428168+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:45.428168+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.428168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:13.741664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'3","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.799104+0000","last_change":"2024-09-12T19:00:45.799104+0000","last_active":"2024-09-12T19:00:45.799104+0000","last_peered":"2024-09-12T19:00:45.799104+0000","last_clean":"2024-09-12T19:00:45.799104+0000","last_became_active":"2024-09-12T17:59:38.978126+0000","last_became_peered":"2024-09-12T17:59:38.978126+0000","last_unstale":"2024-09-12T19:00:45.799104+0000","last_undegraded":"2024-09-12T19:00:45.799104+0000","last_fullsized":"2024-09-12T19:00:45.799104+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:45.798914+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:45.798914+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.798914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:47.415942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'83","reported_seq":343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.728861+0000","last_change":"2024-09-12T19:00:42.728861+0000","last_active":"2024-09-12T19:00:42.728861+0000","last_peered":"2024-09-12T19:00:42.728861+0000","last_clean":"2024-09-12T19:00:42.728861+0000","last_became_active":"2024-09-12T17:55:59.363574+0000","last_became_peered":"2024-09-12T17:55:59.363574+0000","last_unstale":"2024-09-12T19:00:42.728861+0000","last_undegraded":"2024-09-12T19:00:42.728861+0000","last_fullsized":"2024-09-12T19:00:42.728861+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'83","last_scrub_stamp":"2024-09-12T19:00:42.728674+0000","last_deep_scrub":"264'83","last_deep_scrub_stamp":"2024-09-12T19:00:42.728674+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.728674+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:15.202874+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":530,"num_read_kb":371,"num_write":118,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4970,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:37.489107+0000","last_change":"2024-09-12T18:19:57.847909+0000","last_active":"2024-09-12T18:58:37.489107+0000","last_peered":"2024-09-12T18:58:37.489107+0000","last_clean":"2024-09-12T18:58:37.489107+0000","last_became_active":"2024-09-12T18:19:57.847092+0000","last_became_peered":"2024-09-12T18:19:57.847092+0000","last_unstale":"2024-09-12T18:58:37.489107+0000","last_undegraded":"2024-09-12T18:58:37.489107+0000","last_fullsized":"2024-09-12T18:58:37.489107+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.464268+0000","last_change":"2024-09-12T19:00:44.464268+0000","last_active":"2024-09-12T19:00:44.464268+0000","last_peered":"2024-09-12T19:00:44.464268+0000","last_clean":"2024-09-12T19:00:44.464268+0000","last_became_active":"2024-09-12T17:59:43.034180+0000","last_became_peered":"2024-09-12T17:59:43.034180+0000","last_unstale":"2024-09-12T19:00:44.464268+0000","last_undegraded":"2024-09-12T19:00:44.464268+0000","last_fullsized":"2024-09-12T19:00:44.464268+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T19:00:44.464055+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T19:00:44.464055+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.464055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:03.215015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.855528+0000","last_change":"2024-09-12T19:00:48.855528+0000","last_active":"2024-09-12T19:00:48.855528+0000","last_peered":"2024-09-12T19:00:48.855528+0000","last_clean":"2024-09-12T19:00:48.855528+0000","last_became_active":"2024-09-12T17:59:38.969338+0000","last_became_peered":"2024-09-12T17:59:38.969338+0000","last_unstale":"2024-09-12T19:00:48.855528+0000","last_undegraded":"2024-09-12T19:00:48.855528+0000","last_fullsized":"2024-09-12T19:00:48.855528+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:48.855313+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:48.855313+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.855313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:43.334322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'36","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.279055+0000","last_change":"2024-09-12T19:00:47.279055+0000","last_active":"2024-09-12T19:00:47.279055+0000","last_peered":"2024-09-12T19:00:47.279055+0000","last_clean":"2024-09-12T19:00:47.279055+0000","last_became_active":"2024-09-12T17:55:59.357330+0000","last_became_peered":"2024-09-12T17:55:59.357330+0000","last_unstale":"2024-09-12T19:00:47.279055+0000","last_undegraded":"2024-09-12T19:00:47.279055+0000","last_fullsized":"2024-09-12T19:00:47.279055+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-12T19:00:47.278954+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-12T19:00:47.278954+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.278954+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:36.537205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":130,"num_write":63,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:02.093124+0000","last_change":"2024-09-12T19:01:02.093124+0000","last_active":"2024-09-12T19:01:02.093124+0000","last_peered":"2024-09-12T19:01:02.093124+0000","last_clean":"2024-09-12T19:01:02.093124+0000","last_became_active":"2024-09-12T18:19:57.839696+0000","last_became_peered":"2024-09-12T18:19:57.839696+0000","last_unstale":"2024-09-12T19:01:02.093124+0000","last_undegraded":"2024-09-12T19:01:02.093124+0000","last_fullsized":"2024-09-12T19:01:02.093124+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:01:02.092949+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:01:02.092949+0000","last_clean_scrub_stamp":"2024-09-12T19:01:02.092949+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:59.124099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:56.895265+0000","last_change":"2024-09-12T19:00:56.895265+0000","last_active":"2024-09-12T19:00:56.895265+0000","last_peered":"2024-09-12T19:00:56.895265+0000","last_clean":"2024-09-12T19:00:56.895265+0000","last_became_active":"2024-09-12T17:59:43.030490+0000","last_became_peered":"2024-09-12T17:59:43.030490+0000","last_unstale":"2024-09-12T19:00:56.895265+0000","last_undegraded":"2024-09-12T19:00:56.895265+0000","last_fullsized":"2024-09-12T19:00:56.895265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:56.895042+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:56.895042+0000","last_clean_scrub_stamp":"2024-09-12T19:00:56.895042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:34.772003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16955,"num_write":6,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"261'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.312246+0000","last_change":"2024-09-12T19:00:38.312246+0000","last_active":"2024-09-12T19:00:38.312246+0000","last_peered":"2024-09-12T19:00:38.312246+0000","last_clean":"2024-09-12T19:00:38.312246+0000","last_became_active":"2024-09-12T17:59:38.990212+0000","last_became_peered":"2024-09-12T17:59:38.990212+0000","last_unstale":"2024-09-12T19:00:38.312246+0000","last_undegraded":"2024-09-12T19:00:38.312246+0000","last_fullsized":"2024-09-12T19:00:38.312246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:38.312048+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:38.312048+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.312048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:46.576970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'28","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:49.849104+0000","last_change":"2024-09-12T19:00:49.849104+0000","last_active":"2024-09-12T19:00:49.849104+0000","last_peered":"2024-09-12T19:00:49.849104+0000","last_clean":"2024-09-12T19:00:49.849104+0000","last_became_active":"2024-09-12T17:55:59.356838+0000","last_became_peered":"2024-09-12T17:55:59.356838+0000","last_unstale":"2024-09-12T19:00:49.849104+0000","last_undegraded":"2024-09-12T19:00:49.849104+0000","last_fullsized":"2024-09-12T19:00:49.849104+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-12T19:00:49.848928+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-12T19:00:49.848928+0000","last_clean_scrub_stamp":"2024-09-12T19:00:49.848928+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:40.206866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":96,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:37.474561+0000","last_change":"2024-09-12T18:19:57.837873+0000","last_active":"2024-09-12T18:58:37.474561+0000","last_peered":"2024-09-12T18:58:37.474561+0000","last_clean":"2024-09-12T18:58:37.474561+0000","last_became_active":"2024-09-12T18:19:57.837079+0000","last_became_peered":"2024-09-12T18:19:57.837079+0000","last_unstale":"2024-09-12T18:58:37.474561+0000","last_undegraded":"2024-09-12T18:58:37.474561+0000","last_fullsized":"2024-09-12T18:58:37.474561+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.331177+0000","last_change":"2024-09-12T19:00:39.331177+0000","last_active":"2024-09-12T19:00:39.331177+0000","last_peered":"2024-09-12T19:00:39.331177+0000","last_clean":"2024-09-12T19:00:39.331177+0000","last_became_active":"2024-09-12T17:59:43.032008+0000","last_became_peered":"2024-09-12T17:59:43.032008+0000","last_unstale":"2024-09-12T19:00:39.331177+0000","last_undegraded":"2024-09-12T19:00:39.331177+0000","last_fullsized":"2024-09-12T19:00:39.331177+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T19:00:39.330975+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T19:00:39.330975+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.330975+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:32.780484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'5","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.256602+0000","last_change":"2024-09-12T19:00:45.256602+0000","last_active":"2024-09-12T19:00:45.256602+0000","last_peered":"2024-09-12T19:00:45.256602+0000","last_clean":"2024-09-12T19:00:45.256602+0000","last_became_active":"2024-09-12T17:59:38.982037+0000","last_became_peered":"2024-09-12T17:59:38.982037+0000","last_unstale":"2024-09-12T19:00:45.256602+0000","last_undegraded":"2024-09-12T19:00:45.256602+0000","last_fullsized":"2024-09-12T19:00:45.256602+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:00:45.256428+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:00:45.256428+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.256428+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:58.516528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.874356+0000","last_change":"2024-09-12T19:00:47.874356+0000","last_active":"2024-09-12T19:00:47.874356+0000","last_peered":"2024-09-12T19:00:47.874356+0000","last_clean":"2024-09-12T19:00:47.874356+0000","last_became_active":"2024-09-12T17:55:59.357659+0000","last_became_peered":"2024-09-12T17:55:59.357659+0000","last_unstale":"2024-09-12T19:00:47.874356+0000","last_undegraded":"2024-09-12T19:00:47.874356+0000","last_fullsized":"2024-09-12T19:00:47.874356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T19:00:47.874165+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T19:00:47.874165+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.874165+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:24.831893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":69,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.561637+0000","last_change":"2024-09-12T19:00:31.561637+0000","last_active":"2024-09-12T19:00:31.561637+0000","last_peered":"2024-09-12T19:00:31.561637+0000","last_clean":"2024-09-12T19:00:31.561637+0000","last_became_active":"2024-09-12T18:19:57.849682+0000","last_became_peered":"2024-09-12T18:19:57.849682+0000","last_unstale":"2024-09-12T19:00:31.561637+0000","last_undegraded":"2024-09-12T19:00:31.561637+0000","last_fullsized":"2024-09-12T19:00:31.561637+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:31.561428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:31.561428+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.561428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:44.351076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:55.869972+0000","last_change":"2024-09-12T19:00:55.869972+0000","last_active":"2024-09-12T19:00:55.869972+0000","last_peered":"2024-09-12T19:00:55.869972+0000","last_clean":"2024-09-12T19:00:55.869972+0000","last_became_active":"2024-09-12T17:59:43.026619+0000","last_became_peered":"2024-09-12T17:59:43.026619+0000","last_unstale":"2024-09-12T19:00:55.869972+0000","last_undegraded":"2024-09-12T19:00:55.869972+0000","last_fullsized":"2024-09-12T19:00:55.869972+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:55.869792+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:55.869792+0000","last_clean_scrub_stamp":"2024-09-12T19:00:55.869792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:42.744250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:49.774983+0000","last_change":"2024-09-12T19:00:49.774983+0000","last_active":"2024-09-12T19:00:49.774983+0000","last_peered":"2024-09-12T19:00:49.774983+0000","last_clean":"2024-09-12T19:00:49.774983+0000","last_became_active":"2024-09-12T17:59:38.988028+0000","last_became_peered":"2024-09-12T17:59:38.988028+0000","last_unstale":"2024-09-12T19:00:49.774983+0000","last_undegraded":"2024-09-12T19:00:49.774983+0000","last_fullsized":"2024-09-12T19:00:49.774983+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:49.774789+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:49.774789+0000","last_clean_scrub_stamp":"2024-09-12T19:00:49.774789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:13.152150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'56","reported_seq":222,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.806939+0000","last_change":"2024-09-12T19:00:44.806939+0000","last_active":"2024-09-12T19:00:44.806939+0000","last_peered":"2024-09-12T19:00:44.806939+0000","last_clean":"2024-09-12T19:00:44.806939+0000","last_became_active":"2024-09-12T17:55:59.360197+0000","last_became_peered":"2024-09-12T17:55:59.360197+0000","last_unstale":"2024-09-12T19:00:44.806939+0000","last_undegraded":"2024-09-12T19:00:44.806939+0000","last_fullsized":"2024-09-12T19:00:44.806939+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-09-12T19:00:44.806766+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-09-12T19:00:44.806766+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.806766+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:17.799959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":199,"num_write":102,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:57.751513+0000","last_change":"2024-09-12T19:00:57.751513+0000","last_active":"2024-09-12T19:00:57.751513+0000","last_peered":"2024-09-12T19:00:57.751513+0000","last_clean":"2024-09-12T19:00:57.751513+0000","last_became_active":"2024-09-12T18:19:57.869302+0000","last_became_peered":"2024-09-12T18:19:57.869302+0000","last_unstale":"2024-09-12T19:00:57.751513+0000","last_undegraded":"2024-09-12T19:00:57.751513+0000","last_fullsized":"2024-09-12T19:00:57.751513+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:57.751310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:57.751310+0000","last_clean_scrub_stamp":"2024-09-12T19:00:57.751310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:29.760205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:54.850637+0000","last_change":"2024-09-12T19:00:54.850637+0000","last_active":"2024-09-12T19:00:54.850637+0000","last_peered":"2024-09-12T19:00:54.850637+0000","last_clean":"2024-09-12T19:00:54.850637+0000","last_became_active":"2024-09-12T17:59:43.030846+0000","last_became_peered":"2024-09-12T17:59:43.030846+0000","last_unstale":"2024-09-12T19:00:54.850637+0000","last_undegraded":"2024-09-12T19:00:54.850637+0000","last_fullsized":"2024-09-12T19:00:54.850637+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:54.850449+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:54.850449+0000","last_clean_scrub_stamp":"2024-09-12T19:00:54.850449+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:48.192144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'6","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.608003+0000","last_change":"2024-09-12T19:00:28.608003+0000","last_active":"2024-09-12T19:00:28.608003+0000","last_peered":"2024-09-12T19:00:28.608003+0000","last_clean":"2024-09-12T19:00:28.608003+0000","last_became_active":"2024-09-12T17:59:38.968775+0000","last_became_peered":"2024-09-12T17:59:38.968775+0000","last_unstale":"2024-09-12T19:00:28.608003+0000","last_undegraded":"2024-09-12T19:00:28.608003+0000","last_fullsized":"2024-09-12T19:00:28.608003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:28.607823+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:28.607823+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.607823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:30.368834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":6,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.250171+0000","last_change":"2024-09-12T19:00:43.250171+0000","last_active":"2024-09-12T19:00:43.250171+0000","last_peered":"2024-09-12T19:00:43.250171+0000","last_clean":"2024-09-12T19:00:43.250171+0000","last_became_active":"2024-09-12T17:55:59.358747+0000","last_became_peered":"2024-09-12T17:55:59.358747+0000","last_unstale":"2024-09-12T19:00:43.250171+0000","last_undegraded":"2024-09-12T19:00:43.250171+0000","last_fullsized":"2024-09-12T19:00:43.250171+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-12T19:00:43.249993+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-12T19:00:43.249993+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.249993+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:46.531373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.332641+0000","last_change":"2024-09-12T19:00:42.332641+0000","last_active":"2024-09-12T19:00:42.332641+0000","last_peered":"2024-09-12T19:00:42.332641+0000","last_clean":"2024-09-12T19:00:42.332641+0000","last_became_active":"2024-09-12T18:19:57.822958+0000","last_became_peered":"2024-09-12T18:19:57.822958+0000","last_unstale":"2024-09-12T19:00:42.332641+0000","last_undegraded":"2024-09-12T19:00:42.332641+0000","last_fullsized":"2024-09-12T19:00:42.332641+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:42.332460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:42.332460+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.332460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:11.254643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'5","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.432452+0000","last_change":"2024-09-12T19:00:43.432452+0000","last_active":"2024-09-12T19:00:43.432452+0000","last_peered":"2024-09-12T19:00:43.432452+0000","last_clean":"2024-09-12T19:00:43.432452+0000","last_became_active":"2024-09-12T17:59:43.006748+0000","last_became_peered":"2024-09-12T17:59:43.006748+0000","last_unstale":"2024-09-12T19:00:43.432452+0000","last_undegraded":"2024-09-12T19:00:43.432452+0000","last_fullsized":"2024-09-12T19:00:43.432452+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:00:43.432269+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:00:43.432269+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.432269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:47.795522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:51.204482+0000","last_change":"2024-09-12T19:00:51.204482+0000","last_active":"2024-09-12T19:00:51.204482+0000","last_peered":"2024-09-12T19:00:51.204482+0000","last_clean":"2024-09-12T19:00:51.204482+0000","last_became_active":"2024-09-12T17:59:38.962944+0000","last_became_peered":"2024-09-12T17:59:38.962944+0000","last_unstale":"2024-09-12T19:00:51.204482+0000","last_undegraded":"2024-09-12T19:00:51.204482+0000","last_fullsized":"2024-09-12T19:00:51.204482+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:51.204294+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:51.204294+0000","last_clean_scrub_stamp":"2024-09-12T19:00:51.204294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:58.660709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'30","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.320979+0000","last_change":"2024-09-12T19:00:35.320979+0000","last_active":"2024-09-12T19:00:35.320979+0000","last_peered":"2024-09-12T19:00:35.320979+0000","last_clean":"2024-09-12T19:00:35.320979+0000","last_became_active":"2024-09-12T17:55:59.345735+0000","last_became_peered":"2024-09-12T17:55:59.345735+0000","last_unstale":"2024-09-12T19:00:35.320979+0000","last_undegraded":"2024-09-12T19:00:35.320979+0000","last_fullsized":"2024-09-12T19:00:35.320979+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-12T19:00:35.320795+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-12T19:00:35.320795+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.320795+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:40.138142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:56.729807+0000","last_change":"2024-09-12T19:00:56.729807+0000","last_active":"2024-09-12T19:00:56.729807+0000","last_peered":"2024-09-12T19:00:56.729807+0000","last_clean":"2024-09-12T19:00:56.729807+0000","last_became_active":"2024-09-12T18:19:57.855728+0000","last_became_peered":"2024-09-12T18:19:57.855728+0000","last_unstale":"2024-09-12T19:00:56.729807+0000","last_undegraded":"2024-09-12T19:00:56.729807+0000","last_fullsized":"2024-09-12T19:00:56.729807+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:56.729578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:56.729578+0000","last_clean_scrub_stamp":"2024-09-12T19:00:56.729578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:09.004484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:01.850925+0000","last_change":"2024-09-12T19:01:01.850925+0000","last_active":"2024-09-12T19:01:01.850925+0000","last_peered":"2024-09-12T19:01:01.850925+0000","last_clean":"2024-09-12T19:01:01.850925+0000","last_became_active":"2024-09-12T17:59:43.019325+0000","last_became_peered":"2024-09-12T17:59:43.019325+0000","last_unstale":"2024-09-12T19:01:01.850925+0000","last_undegraded":"2024-09-12T19:01:01.850925+0000","last_fullsized":"2024-09-12T19:01:01.850925+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:01:01.850736+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:01:01.850736+0000","last_clean_scrub_stamp":"2024-09-12T19:01:01.850736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:42.171727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.464740+0000","last_change":"2024-09-12T19:00:33.464603+0000","last_active":"2024-09-12T19:00:33.464740+0000","last_peered":"2024-09-12T19:00:33.464740+0000","last_clean":"2024-09-12T19:00:33.464740+0000","last_became_active":"2024-09-12T17:59:38.977733+0000","last_became_peered":"2024-09-12T17:59:38.977733+0000","last_unstale":"2024-09-12T19:00:33.464740+0000","last_undegraded":"2024-09-12T19:00:33.464740+0000","last_fullsized":"2024-09-12T19:00:33.464740+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:33.464414+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:33.464414+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.464414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:30.669642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'50","reported_seq":205,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.648328+0000","last_change":"2024-09-12T19:00:23.648328+0000","last_active":"2024-09-12T19:00:23.648328+0000","last_peered":"2024-09-12T19:00:23.648328+0000","last_clean":"2024-09-12T19:00:23.648328+0000","last_became_active":"2024-09-12T17:55:59.341145+0000","last_became_peered":"2024-09-12T17:55:59.341145+0000","last_unstale":"2024-09-12T19:00:23.648328+0000","last_undegraded":"2024-09-12T19:00:23.648328+0000","last_fullsized":"2024-09-12T19:00:23.648328+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-12T19:00:23.648148+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-12T19:00:23.648148+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.648148+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:09.004260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":177,"num_write":99,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:58:12.468555+0000","last_change":"2024-09-12T18:19:57.865840+0000","last_active":"2024-09-12T18:58:12.468555+0000","last_peered":"2024-09-12T18:58:12.468555+0000","last_clean":"2024-09-12T18:58:12.468555+0000","last_became_active":"2024-09-12T18:19:57.865311+0000","last_became_peered":"2024-09-12T18:19:57.865311+0000","last_unstale":"2024-09-12T18:58:12.468555+0000","last_undegraded":"2024-09-12T18:58:12.468555+0000","last_fullsized":"2024-09-12T18:58:12.468555+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:56.803597+0000","last_clean_scrub_stamp":"2024-09-12T18:19:56.803597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'8","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:51.809758+0000","last_change":"2024-09-12T19:00:51.809758+0000","last_active":"2024-09-12T19:00:51.809758+0000","last_peered":"2024-09-12T19:00:51.809758+0000","last_clean":"2024-09-12T19:00:51.809758+0000","last_became_active":"2024-09-12T17:59:43.029489+0000","last_became_peered":"2024-09-12T17:59:43.029489+0000","last_unstale":"2024-09-12T19:00:51.809758+0000","last_undegraded":"2024-09-12T19:00:51.809758+0000","last_fullsized":"2024-09-12T19:00:51.809758+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T19:00:51.809573+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T19:00:51.809573+0000","last_clean_scrub_stamp":"2024-09-12T19:00:51.809573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:36.659177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'3","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:52.165405+0000","last_change":"2024-09-12T19:00:52.165405+0000","last_active":"2024-09-12T19:00:52.165405+0000","last_peered":"2024-09-12T19:00:52.165405+0000","last_clean":"2024-09-12T19:00:52.165405+0000","last_became_active":"2024-09-12T17:59:38.965185+0000","last_became_peered":"2024-09-12T17:59:38.965185+0000","last_unstale":"2024-09-12T19:00:52.165405+0000","last_undegraded":"2024-09-12T19:00:52.165405+0000","last_fullsized":"2024-09-12T19:00:52.165405+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:52.165215+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:52.165215+0000","last_clean_scrub_stamp":"2024-09-12T19:00:52.165215+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:57.150469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'20","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.315476+0000","last_change":"2024-09-12T19:00:43.315476+0000","last_active":"2024-09-12T19:00:43.315476+0000","last_peered":"2024-09-12T19:00:43.315476+0000","last_clean":"2024-09-12T19:00:43.315476+0000","last_became_active":"2024-09-12T17:55:59.359849+0000","last_became_peered":"2024-09-12T17:55:59.359849+0000","last_unstale":"2024-09-12T19:00:43.315476+0000","last_undegraded":"2024-09-12T19:00:43.315476+0000","last_fullsized":"2024-09-12T19:00:43.315476+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-12T19:00:43.315286+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-12T19:00:43.315286+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.315286+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:04.065775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:59.781861+0000","last_change":"2024-09-12T19:00:59.781861+0000","last_active":"2024-09-12T19:00:59.781861+0000","last_peered":"2024-09-12T19:00:59.781861+0000","last_clean":"2024-09-12T19:00:59.781861+0000","last_became_active":"2024-09-12T18:19:57.855140+0000","last_became_peered":"2024-09-12T18:19:57.855140+0000","last_unstale":"2024-09-12T19:00:59.781861+0000","last_undegraded":"2024-09-12T19:00:59.781861+0000","last_fullsized":"2024-09-12T19:00:59.781861+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:59.781671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:59.781671+0000","last_clean_scrub_stamp":"2024-09-12T19:00:59.781671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.657490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:52.710990+0000","last_change":"2024-09-12T19:00:52.710990+0000","last_active":"2024-09-12T19:00:52.710990+0000","last_peered":"2024-09-12T19:00:52.710990+0000","last_clean":"2024-09-12T19:00:52.710990+0000","last_became_active":"2024-09-12T17:59:43.015273+0000","last_became_peered":"2024-09-12T17:59:43.015273+0000","last_unstale":"2024-09-12T19:00:52.710990+0000","last_undegraded":"2024-09-12T19:00:52.710990+0000","last_fullsized":"2024-09-12T19:00:52.710990+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:52.710800+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:52.710800+0000","last_clean_scrub_stamp":"2024-09-12T19:00:52.710800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:14.950909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'11","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.450205+0000","last_change":"2024-09-12T19:00:36.450205+0000","last_active":"2024-09-12T19:00:36.450205+0000","last_peered":"2024-09-12T19:00:36.450205+0000","last_clean":"2024-09-12T19:00:36.450205+0000","last_became_active":"2024-09-12T17:59:38.984684+0000","last_became_peered":"2024-09-12T17:59:38.984684+0000","last_unstale":"2024-09-12T19:00:36.450205+0000","last_undegraded":"2024-09-12T19:00:36.450205+0000","last_fullsized":"2024-09-12T19:00:36.450205+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-12T19:00:36.449928+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-12T19:00:36.449928+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.449928+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:31.664959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6144,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'48","reported_seq":205,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.771972+0000","last_change":"2024-09-12T19:00:41.771972+0000","last_active":"2024-09-12T19:00:41.771972+0000","last_peered":"2024-09-12T19:00:41.771972+0000","last_clean":"2024-09-12T19:00:41.771972+0000","last_became_active":"2024-09-12T17:55:59.346128+0000","last_became_peered":"2024-09-12T17:55:59.346128+0000","last_unstale":"2024-09-12T19:00:41.771972+0000","last_undegraded":"2024-09-12T19:00:41.771972+0000","last_fullsized":"2024-09-12T19:00:41.771972+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-12T19:00:41.771779+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-12T19:00:41.771779+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.771779+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:56.531299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":194,"num_write":71,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:58.739694+0000","last_change":"2024-09-12T19:00:58.739694+0000","last_active":"2024-09-12T19:00:58.739694+0000","last_peered":"2024-09-12T19:00:58.739694+0000","last_clean":"2024-09-12T19:00:58.739694+0000","last_became_active":"2024-09-12T18:19:57.848892+0000","last_became_peered":"2024-09-12T18:19:57.848892+0000","last_unstale":"2024-09-12T19:00:58.739694+0000","last_undegraded":"2024-09-12T19:00:58.739694+0000","last_fullsized":"2024-09-12T19:00:58.739694+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:58.739434+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:58.739434+0000","last_clean_scrub_stamp":"2024-09-12T19:00:58.739434+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:30.515044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.475789+0000","last_change":"2024-09-12T19:00:42.475789+0000","last_active":"2024-09-12T19:00:42.475789+0000","last_peered":"2024-09-12T19:00:42.475789+0000","last_clean":"2024-09-12T19:00:42.475789+0000","last_became_active":"2024-09-12T17:59:43.034558+0000","last_became_peered":"2024-09-12T17:59:43.034558+0000","last_unstale":"2024-09-12T19:00:42.475789+0000","last_undegraded":"2024-09-12T19:00:42.475789+0000","last_fullsized":"2024-09-12T19:00:42.475789+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:42.475526+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:42.475526+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.475526+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:40.704163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:54.097082+0000","last_change":"2024-09-12T19:00:54.097082+0000","last_active":"2024-09-12T19:00:54.097082+0000","last_peered":"2024-09-12T19:00:54.097082+0000","last_clean":"2024-09-12T19:00:54.097082+0000","last_became_active":"2024-09-12T17:59:38.973403+0000","last_became_peered":"2024-09-12T17:59:38.973403+0000","last_unstale":"2024-09-12T19:00:54.097082+0000","last_undegraded":"2024-09-12T19:00:54.097082+0000","last_fullsized":"2024-09-12T19:00:54.097082+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:00:54.096879+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:00:54.096879+0000","last_clean_scrub_stamp":"2024-09-12T19:00:54.096879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:53.218842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'38","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.765771+0000","last_change":"2024-09-12T19:00:42.765597+0000","last_active":"2024-09-12T19:00:42.765771+0000","last_peered":"2024-09-12T19:00:42.765771+0000","last_clean":"2024-09-12T19:00:42.765771+0000","last_became_active":"2024-09-12T17:55:59.345382+0000","last_became_peered":"2024-09-12T17:55:59.345382+0000","last_unstale":"2024-09-12T19:00:42.765771+0000","last_undegraded":"2024-09-12T19:00:42.765771+0000","last_fullsized":"2024-09-12T19:00:42.765771+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-12T19:00:42.765400+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-12T19:00:42.765400+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.765400+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:19.605112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":134,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:01.082681+0000","last_change":"2024-09-12T19:01:01.082681+0000","last_active":"2024-09-12T19:01:01.082681+0000","last_peered":"2024-09-12T19:01:01.082681+0000","last_clean":"2024-09-12T19:01:01.082681+0000","last_became_active":"2024-09-12T18:19:57.843489+0000","last_became_peered":"2024-09-12T18:19:57.843489+0000","last_unstale":"2024-09-12T19:01:01.082681+0000","last_undegraded":"2024-09-12T19:01:01.082681+0000","last_fullsized":"2024-09-12T19:01:01.082681+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:01:01.082503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:01:01.082503+0000","last_clean_scrub_stamp":"2024-09-12T19:01:01.082503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:23.789597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:53.720050+0000","last_change":"2024-09-12T19:00:53.720050+0000","last_active":"2024-09-12T19:00:53.720050+0000","last_peered":"2024-09-12T19:00:53.720050+0000","last_clean":"2024-09-12T19:00:53.720050+0000","last_became_active":"2024-09-12T17:59:43.022592+0000","last_became_peered":"2024-09-12T17:59:43.022592+0000","last_unstale":"2024-09-12T19:00:53.720050+0000","last_undegraded":"2024-09-12T19:00:53.720050+0000","last_fullsized":"2024-09-12T19:00:53.720050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:53.719837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:53.719837+0000","last_clean_scrub_stamp":"2024-09-12T19:00:53.719837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:00.858786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'3","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.839518+0000","last_change":"2024-09-12T19:00:43.839518+0000","last_active":"2024-09-12T19:00:43.839518+0000","last_peered":"2024-09-12T19:00:43.839518+0000","last_clean":"2024-09-12T19:00:43.839518+0000","last_became_active":"2024-09-12T17:59:38.975635+0000","last_became_peered":"2024-09-12T17:59:38.975635+0000","last_unstale":"2024-09-12T19:00:43.839518+0000","last_undegraded":"2024-09-12T19:00:43.839518+0000","last_fullsized":"2024-09-12T19:00:43.839518+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T19:00:43.839286+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T19:00:43.839286+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.839286+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:23.415859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'44","reported_seq":189,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.290898+0000","last_change":"2024-09-12T19:00:32.290763+0000","last_active":"2024-09-12T19:00:32.290898+0000","last_peered":"2024-09-12T19:00:32.290898+0000","last_clean":"2024-09-12T19:00:32.290898+0000","last_became_active":"2024-09-12T17:55:59.351492+0000","last_became_peered":"2024-09-12T17:55:59.351492+0000","last_unstale":"2024-09-12T19:00:32.290898+0000","last_undegraded":"2024-09-12T19:00:32.290898+0000","last_fullsized":"2024-09-12T19:00:32.290898+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T19:00:32.290574+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T19:00:32.290574+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.290574+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.374730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":151,"num_write":82,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:54.700446+0000","last_change":"2024-09-12T19:00:54.700446+0000","last_active":"2024-09-12T19:00:54.700446+0000","last_peered":"2024-09-12T19:00:54.700446+0000","last_clean":"2024-09-12T19:00:54.700446+0000","last_became_active":"2024-09-12T18:19:57.855547+0000","last_became_peered":"2024-09-12T18:19:57.855547+0000","last_unstale":"2024-09-12T19:00:54.700446+0000","last_undegraded":"2024-09-12T19:00:54.700446+0000","last_fullsized":"2024-09-12T19:00:54.700446+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:54.700266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:54.700266+0000","last_clean_scrub_stamp":"2024-09-12T19:00:54.700266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:55.916944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'12","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:00.053927+0000","last_change":"2024-09-12T19:01:00.053927+0000","last_active":"2024-09-12T19:01:00.053927+0000","last_peered":"2024-09-12T19:01:00.053927+0000","last_clean":"2024-09-12T19:01:00.053927+0000","last_became_active":"2024-09-12T17:59:43.009629+0000","last_became_peered":"2024-09-12T17:59:43.009629+0000","last_unstale":"2024-09-12T19:01:00.053927+0000","last_undegraded":"2024-09-12T19:01:00.053927+0000","last_fullsized":"2024-09-12T19:01:00.053927+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-12T19:01:00.053759+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-12T19:01:00.053759+0000","last_clean_scrub_stamp":"2024-09-12T19:01:00.053759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:35.067519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":22,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'3","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.723174+0000","last_change":"2024-09-12T19:00:47.723174+0000","last_active":"2024-09-12T19:00:47.723174+0000","last_peered":"2024-09-12T19:00:47.723174+0000","last_clean":"2024-09-12T19:00:47.723174+0000","last_became_active":"2024-09-12T17:59:38.979704+0000","last_became_peered":"2024-09-12T17:59:38.979704+0000","last_unstale":"2024-09-12T19:00:47.723174+0000","last_undegraded":"2024-09-12T19:00:47.723174+0000","last_fullsized":"2024-09-12T19:00:47.723174+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:47.722886+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:47.722886+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.722886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:51.921401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.310746+0000","last_change":"2024-09-12T19:00:44.310597+0000","last_active":"2024-09-12T19:00:44.310746+0000","last_peered":"2024-09-12T19:00:44.310746+0000","last_clean":"2024-09-12T19:00:44.310746+0000","last_became_active":"2024-09-12T17:55:59.356402+0000","last_became_peered":"2024-09-12T17:55:59.356402+0000","last_unstale":"2024-09-12T19:00:44.310746+0000","last_undegraded":"2024-09-12T19:00:44.310746+0000","last_fullsized":"2024-09-12T19:00:44.310746+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T19:00:44.310418+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T19:00:44.310418+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.310418+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:57.608628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:50.141952+0000","last_change":"2024-09-12T19:00:50.141952+0000","last_active":"2024-09-12T19:00:50.141952+0000","last_peered":"2024-09-12T19:00:50.141952+0000","last_clean":"2024-09-12T19:00:50.141952+0000","last_became_active":"2024-09-12T18:19:57.859591+0000","last_became_peered":"2024-09-12T18:19:57.859591+0000","last_unstale":"2024-09-12T19:00:50.141952+0000","last_undegraded":"2024-09-12T19:00:50.141952+0000","last_fullsized":"2024-09-12T19:00:50.141952+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:50.141776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:50.141776+0000","last_clean_scrub_stamp":"2024-09-12T19:00:50.141776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:27.206812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:55.109520+0000","last_change":"2024-09-12T19:00:55.109520+0000","last_active":"2024-09-12T19:00:55.109520+0000","last_peered":"2024-09-12T19:00:55.109520+0000","last_clean":"2024-09-12T19:00:55.109520+0000","last_became_active":"2024-09-12T17:59:43.008547+0000","last_became_peered":"2024-09-12T17:59:43.008547+0000","last_unstale":"2024-09-12T19:00:55.109520+0000","last_undegraded":"2024-09-12T19:00:55.109520+0000","last_fullsized":"2024-09-12T19:00:55.109520+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:55.109304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:55.109304+0000","last_clean_scrub_stamp":"2024-09-12T19:00:55.109304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:48.499558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.602025+0000","last_change":"2024-09-12T19:00:27.602025+0000","last_active":"2024-09-12T19:00:27.602025+0000","last_peered":"2024-09-12T19:00:27.602025+0000","last_clean":"2024-09-12T19:00:27.602025+0000","last_became_active":"2024-09-12T17:59:38.968249+0000","last_became_peered":"2024-09-12T17:59:38.968249+0000","last_unstale":"2024-09-12T19:00:27.602025+0000","last_undegraded":"2024-09-12T19:00:27.602025+0000","last_fullsized":"2024-09-12T19:00:27.602025+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:27.601798+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:27.601798+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.601798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:48.890180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'17","reported_seq":119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.301017+0000","last_change":"2024-09-12T19:00:33.300836+0000","last_active":"2024-09-12T19:00:33.301017+0000","last_peered":"2024-09-12T19:00:33.301017+0000","last_clean":"2024-09-12T19:00:33.301017+0000","last_became_active":"2024-09-12T17:55:59.354383+0000","last_became_peered":"2024-09-12T17:55:59.354383+0000","last_unstale":"2024-09-12T19:00:33.301017+0000","last_undegraded":"2024-09-12T19:00:33.301017+0000","last_fullsized":"2024-09-12T19:00:33.301017+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-12T19:00:33.300644+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-12T19:00:33.300644+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.300644+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:06.669201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.493345+0000","last_change":"2024-09-12T19:00:48.493345+0000","last_active":"2024-09-12T19:00:48.493345+0000","last_peered":"2024-09-12T19:00:48.493345+0000","last_clean":"2024-09-12T19:00:48.493345+0000","last_became_active":"2024-09-12T18:19:57.858987+0000","last_became_peered":"2024-09-12T18:19:57.858987+0000","last_unstale":"2024-09-12T19:00:48.493345+0000","last_undegraded":"2024-09-12T19:00:48.493345+0000","last_fullsized":"2024-09-12T19:00:48.493345+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:48.493161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:48.493161+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.493161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:52.293664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'10","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:50.727759+0000","last_change":"2024-09-12T19:00:50.727759+0000","last_active":"2024-09-12T19:00:50.727759+0000","last_peered":"2024-09-12T19:00:50.727759+0000","last_clean":"2024-09-12T19:00:50.727759+0000","last_became_active":"2024-09-12T17:59:43.022405+0000","last_became_peered":"2024-09-12T17:59:43.022405+0000","last_unstale":"2024-09-12T19:00:50.727759+0000","last_undegraded":"2024-09-12T19:00:50.727759+0000","last_fullsized":"2024-09-12T19:00:50.727759+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-12T19:00:50.727575+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-12T19:00:50.727575+0000","last_clean_scrub_stamp":"2024-09-12T19:00:50.727575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:33.553881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12356,"num_write":10,"num_write_kb":8260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.207293+0000","last_change":"2024-09-12T19:00:44.207293+0000","last_active":"2024-09-12T19:00:44.207293+0000","last_peered":"2024-09-12T19:00:44.207293+0000","last_clean":"2024-09-12T19:00:44.207293+0000","last_became_active":"2024-09-12T17:59:38.964439+0000","last_became_peered":"2024-09-12T17:59:38.964439+0000","last_unstale":"2024-09-12T19:00:44.207293+0000","last_undegraded":"2024-09-12T19:00:44.207293+0000","last_fullsized":"2024-09-12T19:00:44.207293+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:00:44.207118+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:00:44.207118+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.207118+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:00.319203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'114","reported_seq":424,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.769023+0000","last_change":"2024-09-12T19:00:46.768851+0000","last_active":"2024-09-12T19:00:46.769023+0000","last_peered":"2024-09-12T19:00:46.769023+0000","last_clean":"2024-09-12T19:00:46.769023+0000","last_became_active":"2024-09-12T17:55:59.360296+0000","last_became_peered":"2024-09-12T17:55:59.360296+0000","last_unstale":"2024-09-12T19:00:46.769023+0000","last_undegraded":"2024-09-12T19:00:46.769023+0000","last_fullsized":"2024-09-12T19:00:46.769023+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T19:00:46.768666+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T19:00:46.768666+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.768666+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:24.705477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":493,"num_write":148,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:54.774098+0000","last_change":"2024-09-12T19:00:54.774098+0000","last_active":"2024-09-12T19:00:54.774098+0000","last_peered":"2024-09-12T19:00:54.774098+0000","last_clean":"2024-09-12T19:00:54.774098+0000","last_became_active":"2024-09-12T18:19:57.870563+0000","last_became_peered":"2024-09-12T18:19:57.870563+0000","last_unstale":"2024-09-12T19:00:54.774098+0000","last_undegraded":"2024-09-12T19:00:54.774098+0000","last_fullsized":"2024-09-12T19:00:54.774098+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:54.773916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:54.773916+0000","last_clean_scrub_stamp":"2024-09-12T19:00:54.773916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:34.035437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:50.807525+0000","last_change":"2024-09-12T19:00:50.807525+0000","last_active":"2024-09-12T19:00:50.807525+0000","last_peered":"2024-09-12T19:00:50.807525+0000","last_clean":"2024-09-12T19:00:50.807525+0000","last_became_active":"2024-09-12T17:59:43.018869+0000","last_became_peered":"2024-09-12T17:59:43.018869+0000","last_unstale":"2024-09-12T19:00:50.807525+0000","last_undegraded":"2024-09-12T19:00:50.807525+0000","last_fullsized":"2024-09-12T19:00:50.807525+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:50.807303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:50.807303+0000","last_clean_scrub_stamp":"2024-09-12T19:00:50.807303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:09.276143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.750739+0000","last_change":"2024-09-12T19:00:48.750739+0000","last_active":"2024-09-12T19:00:48.750739+0000","last_peered":"2024-09-12T19:00:48.750739+0000","last_clean":"2024-09-12T19:00:48.750739+0000","last_became_active":"2024-09-12T17:59:38.988237+0000","last_became_peered":"2024-09-12T17:59:38.988237+0000","last_unstale":"2024-09-12T19:00:48.750739+0000","last_undegraded":"2024-09-12T19:00:48.750739+0000","last_fullsized":"2024-09-12T19:00:48.750739+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:48.750546+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:48.750546+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.750546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:13.103954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'6","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.391627+0000","last_change":"2024-09-12T19:00:38.391627+0000","last_active":"2024-09-12T19:00:38.391627+0000","last_peered":"2024-09-12T19:00:38.391627+0000","last_clean":"2024-09-12T19:00:38.391627+0000","last_became_active":"2024-09-12T17:55:59.353823+0000","last_became_peered":"2024-09-12T17:55:59.353823+0000","last_unstale":"2024-09-12T19:00:38.391627+0000","last_undegraded":"2024-09-12T19:00:38.391627+0000","last_fullsized":"2024-09-12T19:00:38.391627+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:38.391331+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:38.391331+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.391331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.195971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.608185+0000","last_change":"2024-09-12T19:00:32.608185+0000","last_active":"2024-09-12T19:00:32.608185+0000","last_peered":"2024-09-12T19:00:32.608185+0000","last_clean":"2024-09-12T19:00:32.608185+0000","last_became_active":"2024-09-12T18:19:57.839756+0000","last_became_peered":"2024-09-12T18:19:57.839756+0000","last_unstale":"2024-09-12T19:00:32.608185+0000","last_undegraded":"2024-09-12T19:00:32.608185+0000","last_fullsized":"2024-09-12T19:00:32.608185+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:32.608001+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:32.608001+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.608001+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:41.725203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.435243+0000","last_change":"2024-09-12T19:00:41.435243+0000","last_active":"2024-09-12T19:00:41.435243+0000","last_peered":"2024-09-12T19:00:41.435243+0000","last_clean":"2024-09-12T19:00:41.435243+0000","last_became_active":"2024-09-12T17:59:43.033049+0000","last_became_peered":"2024-09-12T17:59:43.033049+0000","last_unstale":"2024-09-12T19:00:41.435243+0000","last_undegraded":"2024-09-12T19:00:41.435243+0000","last_fullsized":"2024-09-12T19:00:41.435243+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:41.435048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:41.435048+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.435048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.077538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'9","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.719288+0000","last_change":"2024-09-12T19:00:43.719288+0000","last_active":"2024-09-12T19:00:43.719288+0000","last_peered":"2024-09-12T19:00:43.719288+0000","last_clean":"2024-09-12T19:00:43.719288+0000","last_became_active":"2024-09-12T17:59:38.985971+0000","last_became_peered":"2024-09-12T17:59:38.985971+0000","last_unstale":"2024-09-12T19:00:43.719288+0000","last_undegraded":"2024-09-12T19:00:43.719288+0000","last_fullsized":"2024-09-12T19:00:43.719288+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'9","last_scrub_stamp":"2024-09-12T19:00:43.719096+0000","last_deep_scrub":"261'9","last_deep_scrub_stamp":"2024-09-12T19:00:43.719096+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.719096+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:44.602293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'13","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.262143+0000","last_change":"2024-09-12T19:00:42.262143+0000","last_active":"2024-09-12T19:00:42.262143+0000","last_peered":"2024-09-12T19:00:42.262143+0000","last_clean":"2024-09-12T19:00:42.262143+0000","last_became_active":"2024-09-12T17:55:59.352474+0000","last_became_peered":"2024-09-12T17:55:59.352474+0000","last_unstale":"2024-09-12T19:00:42.262143+0000","last_undegraded":"2024-09-12T19:00:42.262143+0000","last_fullsized":"2024-09-12T19:00:42.262143+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T19:00:42.261969+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T19:00:42.261969+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.261969+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:15:23.236744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:58.065221+0000","last_change":"2024-09-12T19:00:58.065221+0000","last_active":"2024-09-12T19:00:58.065221+0000","last_peered":"2024-09-12T19:00:58.065221+0000","last_clean":"2024-09-12T19:00:58.065221+0000","last_became_active":"2024-09-12T18:19:57.846907+0000","last_became_peered":"2024-09-12T18:19:57.846907+0000","last_unstale":"2024-09-12T19:00:58.065221+0000","last_undegraded":"2024-09-12T19:00:58.065221+0000","last_fullsized":"2024-09-12T19:00:58.065221+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:58.065041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:58.065041+0000","last_clean_scrub_stamp":"2024-09-12T19:00:58.065041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:06.942015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'12","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.175246+0000","last_change":"2024-09-12T19:00:47.175246+0000","last_active":"2024-09-12T19:00:47.175246+0000","last_peered":"2024-09-12T19:00:47.175246+0000","last_clean":"2024-09-12T19:00:47.175246+0000","last_became_active":"2024-09-12T17:59:43.022991+0000","last_became_peered":"2024-09-12T17:59:43.022991+0000","last_unstale":"2024-09-12T19:00:47.175246+0000","last_undegraded":"2024-09-12T19:00:47.175246+0000","last_fullsized":"2024-09-12T19:00:47.175246+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-12T19:00:47.175059+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-12T19:00:47.175059+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.175059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:22.362047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20482,"num_write":22,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'2","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.753290+0000","last_change":"2024-09-12T19:00:44.753290+0000","last_active":"2024-09-12T19:00:44.753290+0000","last_peered":"2024-09-12T19:00:44.753290+0000","last_clean":"2024-09-12T19:00:44.753290+0000","last_became_active":"2024-09-12T17:59:38.989530+0000","last_became_peered":"2024-09-12T17:59:38.989530+0000","last_unstale":"2024-09-12T19:00:44.753290+0000","last_undegraded":"2024-09-12T19:00:44.753290+0000","last_fullsized":"2024-09-12T19:00:44.753290+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:44.753097+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:44.753097+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.753097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:31.423311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'9","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.870652+0000","last_change":"2024-09-12T19:00:42.870652+0000","last_active":"2024-09-12T19:00:42.870652+0000","last_peered":"2024-09-12T19:00:42.870652+0000","last_clean":"2024-09-12T19:00:42.870652+0000","last_became_active":"2024-09-12T17:55:59.344251+0000","last_became_peered":"2024-09-12T17:55:59.344251+0000","last_unstale":"2024-09-12T19:00:42.870652+0000","last_undegraded":"2024-09-12T19:00:42.870652+0000","last_fullsized":"2024-09-12T19:00:42.870652+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T19:00:42.870477+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T19:00:42.870477+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.870477+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:19.295504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:57.059209+0000","last_change":"2024-09-12T19:00:57.059209+0000","last_active":"2024-09-12T19:00:57.059209+0000","last_peered":"2024-09-12T19:00:57.059209+0000","last_clean":"2024-09-12T19:00:57.059209+0000","last_became_active":"2024-09-12T18:19:57.847330+0000","last_became_peered":"2024-09-12T18:19:57.847330+0000","last_unstale":"2024-09-12T19:00:57.059209+0000","last_undegraded":"2024-09-12T19:00:57.059209+0000","last_fullsized":"2024-09-12T19:00:57.059209+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:57.059021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:57.059021+0000","last_clean_scrub_stamp":"2024-09-12T19:00:57.059021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:33.004959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.297210+0000","last_change":"2024-09-12T19:00:36.297210+0000","last_active":"2024-09-12T19:00:36.297210+0000","last_peered":"2024-09-12T19:00:36.297210+0000","last_clean":"2024-09-12T19:00:36.297210+0000","last_became_active":"2024-09-12T17:59:43.028305+0000","last_became_peered":"2024-09-12T17:59:43.028305+0000","last_unstale":"2024-09-12T19:00:36.297210+0000","last_undegraded":"2024-09-12T19:00:36.297210+0000","last_fullsized":"2024-09-12T19:00:36.297210+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:00:36.297030+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:00:36.297030+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.297030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:06.922209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.423999+0000","last_change":"2024-09-12T19:00:39.423999+0000","last_active":"2024-09-12T19:00:39.423999+0000","last_peered":"2024-09-12T19:00:39.423999+0000","last_clean":"2024-09-12T19:00:39.423999+0000","last_became_active":"2024-09-12T17:59:38.986062+0000","last_became_peered":"2024-09-12T17:59:38.986062+0000","last_unstale":"2024-09-12T19:00:39.423999+0000","last_undegraded":"2024-09-12T19:00:39.423999+0000","last_fullsized":"2024-09-12T19:00:39.423999+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T19:00:39.423814+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T19:00:39.423814+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.423814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:26.741012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'31","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.308812+0000","last_change":"2024-09-12T19:00:30.308634+0000","last_active":"2024-09-12T19:00:30.308812+0000","last_peered":"2024-09-12T19:00:30.308812+0000","last_clean":"2024-09-12T19:00:30.308812+0000","last_became_active":"2024-09-12T17:55:59.345469+0000","last_became_peered":"2024-09-12T17:55:59.345469+0000","last_unstale":"2024-09-12T19:00:30.308812+0000","last_undegraded":"2024-09-12T19:00:30.308812+0000","last_fullsized":"2024-09-12T19:00:30.308812+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'31","last_scrub_stamp":"2024-09-12T19:00:30.308449+0000","last_deep_scrub":"261'31","last_deep_scrub_stamp":"2024-09-12T19:00:30.308449+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.308449+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:35.666105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":47,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:55.729066+0000","last_change":"2024-09-12T19:00:55.729066+0000","last_active":"2024-09-12T19:00:55.729066+0000","last_peered":"2024-09-12T19:00:55.729066+0000","last_clean":"2024-09-12T19:00:55.729066+0000","last_became_active":"2024-09-12T18:19:57.844161+0000","last_became_peered":"2024-09-12T18:19:57.844161+0000","last_unstale":"2024-09-12T19:00:55.729066+0000","last_undegraded":"2024-09-12T19:00:55.729066+0000","last_fullsized":"2024-09-12T19:00:55.729066+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:55.728879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:55.728879+0000","last_clean_scrub_stamp":"2024-09-12T19:00:55.728879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.137170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.805242+0000","last_change":"2024-09-12T19:00:47.805242+0000","last_active":"2024-09-12T19:00:47.805242+0000","last_peered":"2024-09-12T19:00:47.805242+0000","last_clean":"2024-09-12T19:00:47.805242+0000","last_became_active":"2024-09-12T17:59:43.019274+0000","last_became_peered":"2024-09-12T17:59:43.019274+0000","last_unstale":"2024-09-12T19:00:47.805242+0000","last_undegraded":"2024-09-12T19:00:47.805242+0000","last_fullsized":"2024-09-12T19:00:47.805242+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:47.805023+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:47.805023+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.805023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:09.189463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.292917+0000","last_change":"2024-09-12T19:00:37.292917+0000","last_active":"2024-09-12T19:00:37.292917+0000","last_peered":"2024-09-12T19:00:37.292917+0000","last_clean":"2024-09-12T19:00:37.292917+0000","last_became_active":"2024-09-12T17:59:38.968500+0000","last_became_peered":"2024-09-12T17:59:38.968500+0000","last_unstale":"2024-09-12T19:00:37.292917+0000","last_undegraded":"2024-09-12T19:00:37.292917+0000","last_fullsized":"2024-09-12T19:00:37.292917+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T19:00:37.292713+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T19:00:37.292713+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.292713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:31.367201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1072,"num_write":18,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.785035+0000","last_change":"2024-09-12T19:00:40.785035+0000","last_active":"2024-09-12T19:00:40.785035+0000","last_peered":"2024-09-12T19:00:40.785035+0000","last_clean":"2024-09-12T19:00:40.785035+0000","last_became_active":"2024-09-12T17:55:59.354620+0000","last_became_peered":"2024-09-12T17:55:59.354620+0000","last_unstale":"2024-09-12T19:00:40.785035+0000","last_undegraded":"2024-09-12T19:00:40.785035+0000","last_fullsized":"2024-09-12T19:00:40.785035+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-12T19:00:40.784849+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-12T19:00:40.784849+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.784849+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:26.840696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":145,"num_write":78,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'397","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.897784+0000","last_change":"2024-09-12T19:00:18.897784+0000","last_active":"2024-09-12T19:00:18.897784+0000","last_peered":"2024-09-12T19:00:18.897784+0000","last_clean":"2024-09-12T19:00:18.897784+0000","last_became_active":"2024-09-12T17:40:18.784159+0000","last_became_peered":"2024-09-12T17:40:18.784159+0000","last_unstale":"2024-09-12T19:00:18.897784+0000","last_undegraded":"2024-09-12T19:00:18.897784+0000","last_fullsized":"2024-09-12T19:00:18.897784+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:18.897555+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:18.897555+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.897555+0000","objects_scrubbed":10,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:40.787061+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813897,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":527,"num_read_kb":37913,"num_write":1207,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'93","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.361475+0000","last_change":"2024-09-12T19:00:22.361348+0000","last_active":"2024-09-12T19:00:22.361475+0000","last_peered":"2024-09-12T19:00:22.361475+0000","last_clean":"2024-09-12T19:00:22.361475+0000","last_became_active":"2024-09-12T17:40:20.138680+0000","last_became_peered":"2024-09-12T17:40:20.138680+0000","last_unstale":"2024-09-12T19:00:22.361475+0000","last_undegraded":"2024-09-12T19:00:22.361475+0000","last_fullsized":"2024-09-12T19:00:22.361475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-12T19:00:22.361173+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-12T19:00:22.361173+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.361173+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:49.691123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'329","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.454755+0000","last_change":"2024-09-12T19:00:12.454755+0000","last_active":"2024-09-12T19:00:12.454755+0000","last_peered":"2024-09-12T19:00:12.454755+0000","last_clean":"2024-09-12T19:00:12.454755+0000","last_became_active":"2024-09-12T17:40:18.761214+0000","last_became_peered":"2024-09-12T17:40:18.761214+0000","last_unstale":"2024-09-12T19:00:12.454755+0000","last_undegraded":"2024-09-12T19:00:12.454755+0000","last_fullsized":"2024-09-12T19:00:12.454755+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T19:00:12.454463+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T19:00:12.454463+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.454463+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:45.994067+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4802709,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":37097,"num_write":958,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'256","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.944120+0000","last_change":"2024-09-12T19:00:22.944120+0000","last_active":"2024-09-12T19:00:22.944120+0000","last_peered":"2024-09-12T19:00:22.944120+0000","last_clean":"2024-09-12T19:00:22.944120+0000","last_became_active":"2024-09-12T17:40:20.133791+0000","last_became_peered":"2024-09-12T17:40:20.133791+0000","last_unstale":"2024-09-12T19:00:22.944120+0000","last_undegraded":"2024-09-12T19:00:22.944120+0000","last_fullsized":"2024-09-12T19:00:22.944120+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'256","last_scrub_stamp":"2024-09-12T19:00:22.943873+0000","last_deep_scrub":"264'256","last_deep_scrub_stamp":"2024-09-12T19:00:22.943873+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.943873+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:13.423617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1087,"num_read_kb":867,"num_write":420,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'407","reported_seq":1075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.350302+0000","last_change":"2024-09-12T19:00:12.350302+0000","last_active":"2024-09-12T19:00:12.350302+0000","last_peered":"2024-09-12T19:00:12.350302+0000","last_clean":"2024-09-12T19:00:12.350302+0000","last_became_active":"2024-09-12T17:40:18.755606+0000","last_became_peered":"2024-09-12T17:40:18.755606+0000","last_unstale":"2024-09-12T19:00:12.350302+0000","last_undegraded":"2024-09-12T19:00:12.350302+0000","last_fullsized":"2024-09-12T19:00:12.350302+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T19:00:12.350095+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T19:00:12.350095+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.350095+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:10.932589+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457546,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":570,"num_read_kb":26533,"num_write":1277,"num_write_kb":46376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'130","reported_seq":768,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.867775+0000","last_change":"2024-09-12T19:00:24.867775+0000","last_active":"2024-09-12T19:00:24.867775+0000","last_peered":"2024-09-12T19:00:24.867775+0000","last_clean":"2024-09-12T19:00:24.867775+0000","last_became_active":"2024-09-12T17:40:20.130123+0000","last_became_peered":"2024-09-12T17:40:20.130123+0000","last_unstale":"2024-09-12T19:00:24.867775+0000","last_undegraded":"2024-09-12T19:00:24.867775+0000","last_fullsized":"2024-09-12T19:00:24.867775+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T19:00:24.867600+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T19:00:24.867600+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.867600+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:11.063827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":589,"num_read_kb":499,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'345","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.351078+0000","last_change":"2024-09-12T19:00:17.350905+0000","last_active":"2024-09-12T19:00:17.351078+0000","last_peered":"2024-09-12T19:00:17.351078+0000","last_clean":"2024-09-12T19:00:17.351078+0000","last_became_active":"2024-09-12T17:40:18.768170+0000","last_became_peered":"2024-09-12T17:40:18.768170+0000","last_unstale":"2024-09-12T19:00:17.351078+0000","last_undegraded":"2024-09-12T19:00:17.351078+0000","last_fullsized":"2024-09-12T19:00:17.351078+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-12T19:00:17.350715+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-12T19:00:17.350715+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.350715+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.875766+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388668,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":59190,"num_write":1207,"num_write_kb":44467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'100","reported_seq":709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.333064+0000","last_change":"2024-09-12T19:00:21.332900+0000","last_active":"2024-09-12T19:00:21.333064+0000","last_peered":"2024-09-12T19:00:21.333064+0000","last_clean":"2024-09-12T19:00:21.333064+0000","last_became_active":"2024-09-12T17:40:20.114923+0000","last_became_peered":"2024-09-12T17:40:20.114923+0000","last_unstale":"2024-09-12T19:00:21.333064+0000","last_undegraded":"2024-09-12T19:00:21.333064+0000","last_fullsized":"2024-09-12T19:00:21.333064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T19:00:21.332717+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T19:00:21.332717+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.332717+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:04.580548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":408,"num_write":151,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'318","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.885850+0000","last_change":"2024-09-12T19:00:14.885692+0000","last_active":"2024-09-12T19:00:14.885850+0000","last_peered":"2024-09-12T19:00:14.885850+0000","last_clean":"2024-09-12T19:00:14.885850+0000","last_became_active":"2024-09-12T17:40:18.778991+0000","last_became_peered":"2024-09-12T17:40:18.778991+0000","last_unstale":"2024-09-12T19:00:14.885850+0000","last_undegraded":"2024-09-12T19:00:14.885850+0000","last_fullsized":"2024-09-12T19:00:14.885850+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-12T19:00:14.885480+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-12T19:00:14.885480+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.885480+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:10.907616+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311787,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":19945,"num_write":986,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'100","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.464947+0000","last_change":"2024-09-12T19:00:18.464796+0000","last_active":"2024-09-12T19:00:18.464947+0000","last_peered":"2024-09-12T19:00:18.464947+0000","last_clean":"2024-09-12T19:00:18.464947+0000","last_became_active":"2024-09-12T17:40:20.127556+0000","last_became_peered":"2024-09-12T17:40:20.127556+0000","last_unstale":"2024-09-12T19:00:18.464947+0000","last_undegraded":"2024-09-12T19:00:18.464947+0000","last_fullsized":"2024-09-12T19:00:18.464947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T19:00:18.464562+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T19:00:18.464562+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.464562+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:00.473679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":458,"num_read_kb":378,"num_write":157,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'384","reported_seq":1012,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.311697+0000","last_change":"2024-09-12T19:00:16.311566+0000","last_active":"2024-09-12T19:00:16.311697+0000","last_peered":"2024-09-12T19:00:16.311697+0000","last_clean":"2024-09-12T19:00:16.311697+0000","last_became_active":"2024-09-12T17:40:18.760958+0000","last_became_peered":"2024-09-12T17:40:18.760958+0000","last_unstale":"2024-09-12T19:00:16.311697+0000","last_undegraded":"2024-09-12T19:00:16.311697+0000","last_fullsized":"2024-09-12T19:00:16.311697+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-12T19:00:16.311345+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-12T19:00:16.311345+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.311345+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:52.751993+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":8666,"num_write":1215,"num_write_kb":27182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'123","reported_seq":763,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.886918+0000","last_change":"2024-09-12T19:00:25.886918+0000","last_active":"2024-09-12T19:00:25.886918+0000","last_peered":"2024-09-12T19:00:25.886918+0000","last_clean":"2024-09-12T19:00:25.886918+0000","last_became_active":"2024-09-12T17:40:20.132985+0000","last_became_peered":"2024-09-12T17:40:20.132985+0000","last_unstale":"2024-09-12T19:00:25.886918+0000","last_undegraded":"2024-09-12T19:00:25.886918+0000","last_fullsized":"2024-09-12T19:00:25.886918+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-09-12T19:00:25.886728+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-09-12T19:00:25.886728+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.886728+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:06.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":462,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'403","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.903729+0000","last_change":"2024-09-12T19:00:17.903504+0000","last_active":"2024-09-12T19:00:17.903729+0000","last_peered":"2024-09-12T19:00:17.903729+0000","last_clean":"2024-09-12T19:00:17.903729+0000","last_became_active":"2024-09-12T17:40:18.761056+0000","last_became_peered":"2024-09-12T17:40:18.761056+0000","last_unstale":"2024-09-12T19:00:17.903729+0000","last_undegraded":"2024-09-12T19:00:17.903729+0000","last_fullsized":"2024-09-12T19:00:17.903729+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'403","last_scrub_stamp":"2024-09-12T19:00:17.903214+0000","last_deep_scrub":"264'403","last_deep_scrub_stamp":"2024-09-12T19:00:17.903214+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.903214+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:06.436732+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":74800,"num_write":1233,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'208","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.298403+0000","last_change":"2024-09-12T19:00:25.298403+0000","last_active":"2024-09-12T19:00:25.298403+0000","last_peered":"2024-09-12T19:00:25.298403+0000","last_clean":"2024-09-12T19:00:25.298403+0000","last_became_active":"2024-09-12T17:40:20.134441+0000","last_became_peered":"2024-09-12T17:40:20.134441+0000","last_unstale":"2024-09-12T19:00:25.298403+0000","last_undegraded":"2024-09-12T19:00:25.298403+0000","last_fullsized":"2024-09-12T19:00:25.298403+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T19:00:25.298122+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T19:00:25.298122+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.298122+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:23.155447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":897,"num_read_kb":734,"num_write":311,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'373","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.647147+0000","last_change":"2024-09-12T19:00:11.647011+0000","last_active":"2024-09-12T19:00:11.647147+0000","last_peered":"2024-09-12T19:00:11.647147+0000","last_clean":"2024-09-12T19:00:11.647147+0000","last_became_active":"2024-09-12T17:40:18.773843+0000","last_became_peered":"2024-09-12T17:40:18.773843+0000","last_unstale":"2024-09-12T19:00:11.647147+0000","last_undegraded":"2024-09-12T19:00:11.647147+0000","last_fullsized":"2024-09-12T19:00:11.647147+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T19:00:11.646768+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T19:00:11.646768+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.646768+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:20.752287+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":629,"num_read_kb":30255,"num_write":1158,"num_write_kb":52642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'233","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.570316+0000","last_change":"2024-09-12T19:00:15.570316+0000","last_active":"2024-09-12T19:00:15.570316+0000","last_peered":"2024-09-12T19:00:15.570316+0000","last_clean":"2024-09-12T19:00:15.570316+0000","last_became_active":"2024-09-12T17:40:20.120891+0000","last_became_peered":"2024-09-12T17:40:20.120891+0000","last_unstale":"2024-09-12T19:00:15.570316+0000","last_undegraded":"2024-09-12T19:00:15.570316+0000","last_fullsized":"2024-09-12T19:00:15.570316+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-12T19:00:15.570121+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-12T19:00:15.570121+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.570121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:40.079950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":858,"num_write":384,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'192","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.856800+0000","last_change":"2024-09-12T19:00:22.856800+0000","last_active":"2024-09-12T19:00:22.856800+0000","last_peered":"2024-09-12T19:00:22.856800+0000","last_clean":"2024-09-12T19:00:22.856800+0000","last_became_active":"2024-09-12T17:40:20.132466+0000","last_became_peered":"2024-09-12T17:40:20.132466+0000","last_unstale":"2024-09-12T19:00:22.856800+0000","last_undegraded":"2024-09-12T19:00:22.856800+0000","last_fullsized":"2024-09-12T19:00:22.856800+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-09-12T19:00:22.856632+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-09-12T19:00:22.856632+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.856632+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:33.052539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":674,"num_write":287,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'340","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.947779+0000","last_change":"2024-09-12T19:00:12.947508+0000","last_active":"2024-09-12T19:00:12.947779+0000","last_peered":"2024-09-12T19:00:12.947779+0000","last_clean":"2024-09-12T19:00:12.947779+0000","last_became_active":"2024-09-12T17:40:18.783282+0000","last_became_peered":"2024-09-12T17:40:18.783282+0000","last_unstale":"2024-09-12T19:00:12.947779+0000","last_undegraded":"2024-09-12T19:00:12.947779+0000","last_fullsized":"2024-09-12T19:00:12.947779+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-12T19:00:12.947254+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-12T19:00:12.947254+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.947254+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:14.588512+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":17792,"num_write":1019,"num_write_kb":32630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'129","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.953874+0000","last_change":"2024-09-12T19:00:20.953874+0000","last_active":"2024-09-12T19:00:20.953874+0000","last_peered":"2024-09-12T19:00:20.953874+0000","last_clean":"2024-09-12T19:00:20.953874+0000","last_became_active":"2024-09-12T17:40:20.143471+0000","last_became_peered":"2024-09-12T17:40:20.143471+0000","last_unstale":"2024-09-12T19:00:20.953874+0000","last_undegraded":"2024-09-12T19:00:20.953874+0000","last_fullsized":"2024-09-12T19:00:20.953874+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T19:00:20.953686+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T19:00:20.953686+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.953686+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:56.936299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":544,"num_read_kb":441,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'314","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.428631+0000","last_change":"2024-09-12T19:00:13.428631+0000","last_active":"2024-09-12T19:00:13.428631+0000","last_peered":"2024-09-12T19:00:13.428631+0000","last_clean":"2024-09-12T19:00:13.428631+0000","last_became_active":"2024-09-12T17:40:18.756814+0000","last_became_peered":"2024-09-12T17:40:18.756814+0000","last_unstale":"2024-09-12T19:00:13.428631+0000","last_undegraded":"2024-09-12T19:00:13.428631+0000","last_fullsized":"2024-09-12T19:00:13.428631+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T19:00:13.428455+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T19:00:13.428455+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.428455+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:27.159173+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048617,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":410,"num_read_kb":9611,"num_write":991,"num_write_kb":28982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'86","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.320660+0000","last_change":"2024-09-12T19:00:20.320660+0000","last_active":"2024-09-12T19:00:20.320660+0000","last_peered":"2024-09-12T19:00:20.320660+0000","last_clean":"2024-09-12T19:00:20.320660+0000","last_became_active":"2024-09-12T17:40:20.124104+0000","last_became_peered":"2024-09-12T17:40:20.124104+0000","last_unstale":"2024-09-12T19:00:20.320660+0000","last_undegraded":"2024-09-12T19:00:20.320660+0000","last_fullsized":"2024-09-12T19:00:20.320660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T19:00:20.320383+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T19:00:20.320383+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.320383+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:50.248150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":294,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'414","reported_seq":1113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.412693+0000","last_change":"2024-09-12T19:00:11.412693+0000","last_active":"2024-09-12T19:00:11.412693+0000","last_peered":"2024-09-12T19:00:11.412693+0000","last_clean":"2024-09-12T19:00:11.412693+0000","last_became_active":"2024-09-12T17:40:18.773787+0000","last_became_peered":"2024-09-12T17:40:18.773787+0000","last_unstale":"2024-09-12T19:00:11.412693+0000","last_undegraded":"2024-09-12T19:00:11.412693+0000","last_fullsized":"2024-09-12T19:00:11.412693+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-12T19:00:11.412318+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-12T19:00:11.412318+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.412318+0000","objects_scrubbed":10,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:40.943987+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1575003,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":648,"num_read_kb":7584,"num_write":1228,"num_write_kb":45057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'154","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.627859+0000","last_change":"2024-09-12T19:00:11.627859+0000","last_active":"2024-09-12T19:00:11.627859+0000","last_peered":"2024-09-12T19:00:11.627859+0000","last_clean":"2024-09-12T19:00:11.627859+0000","last_became_active":"2024-09-12T17:40:20.120803+0000","last_became_peered":"2024-09-12T17:40:20.120803+0000","last_unstale":"2024-09-12T19:00:11.627859+0000","last_undegraded":"2024-09-12T19:00:11.627859+0000","last_fullsized":"2024-09-12T19:00:11.627859+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-12T19:00:11.627566+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-12T19:00:11.627566+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.627566+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:32.581707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":714,"num_read_kb":606,"num_write":221,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'317","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.802687+0000","last_change":"2024-09-12T19:00:10.802687+0000","last_active":"2024-09-12T19:00:10.802687+0000","last_peered":"2024-09-12T19:00:10.802687+0000","last_clean":"2024-09-12T19:00:10.802687+0000","last_became_active":"2024-09-12T17:40:18.769867+0000","last_became_peered":"2024-09-12T17:40:18.769867+0000","last_unstale":"2024-09-12T19:00:10.802687+0000","last_undegraded":"2024-09-12T19:00:10.802687+0000","last_fullsized":"2024-09-12T19:00:10.802687+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T19:00:10.802484+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T19:00:10.802484+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.802484+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:37.820292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":25356,"num_write":1086,"num_write_kb":19597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'166","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.599974+0000","last_change":"2024-09-12T19:00:14.599974+0000","last_active":"2024-09-12T19:00:14.599974+0000","last_peered":"2024-09-12T19:00:14.599974+0000","last_clean":"2024-09-12T19:00:14.599974+0000","last_became_active":"2024-09-12T17:40:20.131603+0000","last_became_peered":"2024-09-12T17:40:20.131603+0000","last_unstale":"2024-09-12T19:00:14.599974+0000","last_undegraded":"2024-09-12T19:00:14.599974+0000","last_fullsized":"2024-09-12T19:00:14.599974+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T19:00:14.599795+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T19:00:14.599795+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.599795+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:11.205160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":647,"num_write":268,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'329","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.651668+0000","last_change":"2024-09-12T19:00:12.651668+0000","last_active":"2024-09-12T19:00:12.651668+0000","last_peered":"2024-09-12T19:00:12.651668+0000","last_clean":"2024-09-12T19:00:12.651668+0000","last_became_active":"2024-09-12T17:40:18.765584+0000","last_became_peered":"2024-09-12T17:40:18.765584+0000","last_unstale":"2024-09-12T19:00:12.651668+0000","last_undegraded":"2024-09-12T19:00:12.651668+0000","last_fullsized":"2024-09-12T19:00:12.651668+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T19:00:12.651452+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T19:00:12.651452+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.651452+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:48.653995+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":14373,"num_write":1088,"num_write_kb":24714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'218","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.886654+0000","last_change":"2024-09-12T19:00:23.886654+0000","last_active":"2024-09-12T19:00:23.886654+0000","last_peered":"2024-09-12T19:00:23.886654+0000","last_clean":"2024-09-12T19:00:23.886654+0000","last_became_active":"2024-09-12T17:40:20.132166+0000","last_became_peered":"2024-09-12T17:40:20.132166+0000","last_unstale":"2024-09-12T19:00:23.886654+0000","last_undegraded":"2024-09-12T19:00:23.886654+0000","last_fullsized":"2024-09-12T19:00:23.886654+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-09-12T19:00:23.886463+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-09-12T19:00:23.886463+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.886463+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:14.565713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":801,"num_write":328,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'324","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.305986+0000","last_change":"2024-09-12T19:00:11.305986+0000","last_active":"2024-09-12T19:00:11.305986+0000","last_peered":"2024-09-12T19:00:11.305986+0000","last_clean":"2024-09-12T19:00:11.305986+0000","last_became_active":"2024-09-12T17:40:18.753673+0000","last_became_peered":"2024-09-12T17:40:18.753673+0000","last_unstale":"2024-09-12T19:00:11.305986+0000","last_undegraded":"2024-09-12T19:00:11.305986+0000","last_fullsized":"2024-09-12T19:00:11.305986+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-12T19:00:11.305739+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-12T19:00:11.305739+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.305739+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:02.108364+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602146,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":9306,"num_write":1013,"num_write_kb":26120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'144","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.930286+0000","last_change":"2024-09-12T19:00:40.930286+0000","last_active":"2024-09-12T19:00:40.930286+0000","last_peered":"2024-09-12T19:00:40.930286+0000","last_clean":"2024-09-12T19:00:40.930286+0000","last_became_active":"2024-09-12T17:40:28.201205+0000","last_became_peered":"2024-09-12T17:40:28.201205+0000","last_unstale":"2024-09-12T19:00:40.930286+0000","last_undegraded":"2024-09-12T19:00:40.930286+0000","last_fullsized":"2024-09-12T19:00:40.930286+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:40.930076+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:40.930076+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.930076+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:42.788562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'257","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.617677+0000","last_change":"2024-09-12T19:00:14.617677+0000","last_active":"2024-09-12T19:00:14.617677+0000","last_peered":"2024-09-12T19:00:14.617677+0000","last_clean":"2024-09-12T19:00:14.617677+0000","last_became_active":"2024-09-12T17:40:20.132930+0000","last_became_peered":"2024-09-12T17:40:20.132930+0000","last_unstale":"2024-09-12T19:00:14.617677+0000","last_undegraded":"2024-09-12T19:00:14.617677+0000","last_fullsized":"2024-09-12T19:00:14.617677+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-12T19:00:14.617493+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-12T19:00:14.617493+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.617493+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:11.145807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1081,"num_read_kb":890,"num_write":398,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'338","reported_seq":1106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.929838+0000","last_change":"2024-09-12T19:00:13.929838+0000","last_active":"2024-09-12T19:00:13.929838+0000","last_peered":"2024-09-12T19:00:13.929838+0000","last_clean":"2024-09-12T19:00:13.929838+0000","last_became_active":"2024-09-12T17:40:18.785762+0000","last_became_peered":"2024-09-12T17:40:18.785762+0000","last_unstale":"2024-09-12T19:00:13.929838+0000","last_undegraded":"2024-09-12T19:00:13.929838+0000","last_fullsized":"2024-09-12T19:00:13.929838+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T19:00:13.929601+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T19:00:13.929601+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.929601+0000","objects_scrubbed":11,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:54.986642+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364400,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":651,"num_read_kb":5513,"num_write":1121,"num_write_kb":17948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.294876+0000","last_change":"2024-09-12T19:00:26.294876+0000","last_active":"2024-09-12T19:00:26.294876+0000","last_peered":"2024-09-12T19:00:26.294876+0000","last_clean":"2024-09-12T19:00:26.294876+0000","last_became_active":"2024-09-12T17:40:22.146112+0000","last_became_peered":"2024-09-12T17:40:22.146112+0000","last_unstale":"2024-09-12T19:00:26.294876+0000","last_undegraded":"2024-09-12T19:00:26.294876+0000","last_fullsized":"2024-09-12T19:00:26.294876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.294692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.294692+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.294692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:19.193532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'342","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.367212+0000","last_change":"2024-09-12T19:00:28.367212+0000","last_active":"2024-09-12T19:00:28.367212+0000","last_peered":"2024-09-12T19:00:28.367212+0000","last_clean":"2024-09-12T19:00:28.367212+0000","last_became_active":"2024-09-12T17:40:24.161536+0000","last_became_peered":"2024-09-12T17:40:24.161536+0000","last_unstale":"2024-09-12T19:00:28.367212+0000","last_undegraded":"2024-09-12T19:00:28.367212+0000","last_fullsized":"2024-09-12T19:00:28.367212+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-12T19:00:28.367009+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-12T19:00:28.367009+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.367009+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:49.442023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50345,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":1205,"num_write":440,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.791994+0000","last_change":"2024-09-12T19:00:36.791994+0000","last_active":"2024-09-12T19:00:36.791994+0000","last_peered":"2024-09-12T19:00:36.791994+0000","last_clean":"2024-09-12T19:00:36.791994+0000","last_became_active":"2024-09-12T17:40:26.188831+0000","last_became_peered":"2024-09-12T17:40:26.188831+0000","last_unstale":"2024-09-12T19:00:36.791994+0000","last_undegraded":"2024-09-12T19:00:36.791994+0000","last_fullsized":"2024-09-12T19:00:36.791994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:36.791726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:36.791726+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.791726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:23.483824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'162","reported_seq":726,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.278715+0000","last_change":"2024-09-12T19:00:40.278715+0000","last_active":"2024-09-12T19:00:40.278715+0000","last_peered":"2024-09-12T19:00:40.278715+0000","last_clean":"2024-09-12T19:00:40.278715+0000","last_became_active":"2024-09-12T17:40:28.189899+0000","last_became_peered":"2024-09-12T17:40:28.189899+0000","last_unstale":"2024-09-12T19:00:40.278715+0000","last_undegraded":"2024-09-12T19:00:40.278715+0000","last_fullsized":"2024-09-12T19:00:40.278715+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T19:00:40.278524+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T19:00:40.278524+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.278524+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:11.990738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":230,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'92","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.294602+0000","last_change":"2024-09-12T19:00:19.294602+0000","last_active":"2024-09-12T19:00:19.294602+0000","last_peered":"2024-09-12T19:00:19.294602+0000","last_clean":"2024-09-12T19:00:19.294602+0000","last_became_active":"2024-09-12T17:40:20.137252+0000","last_became_peered":"2024-09-12T17:40:20.137252+0000","last_unstale":"2024-09-12T19:00:19.294602+0000","last_undegraded":"2024-09-12T19:00:19.294602+0000","last_fullsized":"2024-09-12T19:00:19.294602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-12T19:00:19.294422+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-12T19:00:19.294422+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.294422+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:43.295706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":356,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'347","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.376265+0000","last_change":"2024-09-12T19:00:05.376265+0000","last_active":"2024-09-12T19:00:05.376265+0000","last_peered":"2024-09-12T19:00:05.376265+0000","last_clean":"2024-09-12T19:00:05.376265+0000","last_became_active":"2024-09-12T17:40:18.756518+0000","last_became_peered":"2024-09-12T17:40:18.756518+0000","last_unstale":"2024-09-12T19:00:05.376265+0000","last_undegraded":"2024-09-12T19:00:05.376265+0000","last_fullsized":"2024-09-12T19:00:05.376265+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T19:00:05.376068+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T19:00:05.376068+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.376068+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:46.598497+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272857,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":466,"num_read_kb":2596,"num_write":1023,"num_write_kb":33023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.624097+0000","last_change":"2024-09-12T19:00:22.624097+0000","last_active":"2024-09-12T19:00:22.624097+0000","last_peered":"2024-09-12T19:00:22.624097+0000","last_clean":"2024-09-12T19:00:22.624097+0000","last_became_active":"2024-09-12T17:40:22.153074+0000","last_became_peered":"2024-09-12T17:40:22.153074+0000","last_unstale":"2024-09-12T19:00:22.624097+0000","last_undegraded":"2024-09-12T19:00:22.624097+0000","last_fullsized":"2024-09-12T19:00:22.624097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.623901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.623901+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.623901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:49.381263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'105","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.924730+0000","last_change":"2024-09-12T19:00:32.924730+0000","last_active":"2024-09-12T19:00:32.924730+0000","last_peered":"2024-09-12T19:00:32.924730+0000","last_clean":"2024-09-12T19:00:32.924730+0000","last_became_active":"2024-09-12T17:40:24.169431+0000","last_became_peered":"2024-09-12T17:40:24.169431+0000","last_unstale":"2024-09-12T19:00:32.924730+0000","last_undegraded":"2024-09-12T19:00:32.924730+0000","last_fullsized":"2024-09-12T19:00:32.924730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T19:00:32.924491+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T19:00:32.924491+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.924491+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:19.774401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.881908+0000","last_change":"2024-09-12T19:00:36.881908+0000","last_active":"2024-09-12T19:00:36.881908+0000","last_peered":"2024-09-12T19:00:36.881908+0000","last_clean":"2024-09-12T19:00:36.881908+0000","last_became_active":"2024-09-12T17:40:26.188501+0000","last_became_peered":"2024-09-12T17:40:26.188501+0000","last_unstale":"2024-09-12T19:00:36.881908+0000","last_undegraded":"2024-09-12T19:00:36.881908+0000","last_fullsized":"2024-09-12T19:00:36.881908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:36.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:36.881726+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:04.430721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'136","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.297377+0000","last_change":"2024-09-12T19:00:41.297377+0000","last_active":"2024-09-12T19:00:41.297377+0000","last_peered":"2024-09-12T19:00:41.297377+0000","last_clean":"2024-09-12T19:00:41.297377+0000","last_became_active":"2024-09-12T17:40:28.186224+0000","last_became_peered":"2024-09-12T17:40:28.186224+0000","last_unstale":"2024-09-12T19:00:41.297377+0000","last_undegraded":"2024-09-12T19:00:41.297377+0000","last_fullsized":"2024-09-12T19:00:41.297377+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-12T19:00:41.297189+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-12T19:00:41.297189+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.297189+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:59.058653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":201,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'278","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.374182+0000","last_change":"2024-09-12T19:00:16.374182+0000","last_active":"2024-09-12T19:00:16.374182+0000","last_peered":"2024-09-12T19:00:16.374182+0000","last_clean":"2024-09-12T19:00:16.374182+0000","last_became_active":"2024-09-12T17:40:20.115862+0000","last_became_peered":"2024-09-12T17:40:20.115862+0000","last_unstale":"2024-09-12T19:00:16.374182+0000","last_undegraded":"2024-09-12T19:00:16.374182+0000","last_fullsized":"2024-09-12T19:00:16.374182+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'278","last_scrub_stamp":"2024-09-12T19:00:16.374003+0000","last_deep_scrub":"264'278","last_deep_scrub_stamp":"2024-09-12T19:00:16.374003+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.374003+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:39.249116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1211,"num_read_kb":988,"num_write":419,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'376","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.350085+0000","last_change":"2024-09-12T19:00:07.349944+0000","last_active":"2024-09-12T19:00:07.350085+0000","last_peered":"2024-09-12T19:00:07.350085+0000","last_clean":"2024-09-12T19:00:07.350085+0000","last_became_active":"2024-09-12T17:40:55.329597+0000","last_became_peered":"2024-09-12T17:40:55.329597+0000","last_unstale":"2024-09-12T19:00:07.350085+0000","last_undegraded":"2024-09-12T19:00:07.350085+0000","last_fullsized":"2024-09-12T19:00:07.350085+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-12T19:00:07.349768+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-12T19:00:07.349768+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.349768+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:52.137674+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263284,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":44050,"num_write":1244,"num_write_kb":40700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.733255+0000","last_change":"2024-09-12T19:00:25.733255+0000","last_active":"2024-09-12T19:00:25.733255+0000","last_peered":"2024-09-12T19:00:25.733255+0000","last_clean":"2024-09-12T19:00:25.733255+0000","last_became_active":"2024-09-12T17:40:22.145769+0000","last_became_peered":"2024-09-12T17:40:22.145769+0000","last_unstale":"2024-09-12T19:00:25.733255+0000","last_undegraded":"2024-09-12T19:00:25.733255+0000","last_fullsized":"2024-09-12T19:00:25.733255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:25.733080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:25.733080+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.733080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:21.958659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'151","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.637691+0000","last_change":"2024-09-12T19:00:20.637691+0000","last_active":"2024-09-12T19:00:20.637691+0000","last_peered":"2024-09-12T19:00:20.637691+0000","last_clean":"2024-09-12T19:00:20.637691+0000","last_became_active":"2024-09-12T17:40:24.163809+0000","last_became_peered":"2024-09-12T17:40:24.163809+0000","last_unstale":"2024-09-12T19:00:20.637691+0000","last_undegraded":"2024-09-12T19:00:20.637691+0000","last_fullsized":"2024-09-12T19:00:20.637691+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T19:00:20.637471+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T19:00:20.637471+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.637471+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:01.042195+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":124,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'765","reported_seq":2954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.836254+0000","last_change":"2024-09-12T19:00:35.836254+0000","last_active":"2024-09-12T19:00:35.836254+0000","last_peered":"2024-09-12T19:00:35.836254+0000","last_clean":"2024-09-12T19:00:35.836254+0000","last_became_active":"2024-09-12T17:40:26.200567+0000","last_became_peered":"2024-09-12T17:40:26.200567+0000","last_unstale":"2024-09-12T19:00:35.836254+0000","last_undegraded":"2024-09-12T19:00:35.836254+0000","last_fullsized":"2024-09-12T19:00:35.836254+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'765","last_scrub_stamp":"2024-09-12T19:00:35.836060+0000","last_deep_scrub":"264'765","last_deep_scrub_stamp":"2024-09-12T19:00:35.836060+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.836060+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:05.982251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'219","reported_seq":1069,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.901011+0000","last_change":"2024-09-12T19:00:41.901011+0000","last_active":"2024-09-12T19:00:41.901011+0000","last_peered":"2024-09-12T19:00:41.901011+0000","last_clean":"2024-09-12T19:00:41.901011+0000","last_became_active":"2024-09-12T17:40:28.171602+0000","last_became_peered":"2024-09-12T17:40:28.171602+0000","last_unstale":"2024-09-12T19:00:41.901011+0000","last_undegraded":"2024-09-12T19:00:41.901011+0000","last_fullsized":"2024-09-12T19:00:41.901011+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-12T19:00:41.900820+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-12T19:00:41.900820+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.900820+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:41.173591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":670,"num_read_kb":661,"num_write":473,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'82","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.627310+0000","last_change":"2024-09-12T19:00:10.627173+0000","last_active":"2024-09-12T19:00:10.627310+0000","last_peered":"2024-09-12T19:00:10.627310+0000","last_clean":"2024-09-12T19:00:10.627310+0000","last_became_active":"2024-09-12T17:40:55.305123+0000","last_became_peered":"2024-09-12T17:40:55.305123+0000","last_unstale":"2024-09-12T19:00:10.627310+0000","last_undegraded":"2024-09-12T19:00:10.627310+0000","last_fullsized":"2024-09-12T19:00:10.627310+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'82","last_scrub_stamp":"2024-09-12T19:00:10.626973+0000","last_deep_scrub":"264'82","last_deep_scrub_stamp":"2024-09-12T19:00:10.626973+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.626973+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:35.142530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":316,"num_write":118,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"264'427","reported_seq":1184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.363489+0000","last_change":"2024-09-12T19:00:10.363489+0000","last_active":"2024-09-12T19:00:10.363489+0000","last_peered":"2024-09-12T19:00:10.363489+0000","last_clean":"2024-09-12T19:00:10.363489+0000","last_became_active":"2024-09-12T17:40:18.755758+0000","last_became_peered":"2024-09-12T17:40:18.755758+0000","last_unstale":"2024-09-12T19:00:10.363489+0000","last_undegraded":"2024-09-12T19:00:10.363489+0000","last_fullsized":"2024-09-12T19:00:10.363489+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'427","last_scrub_stamp":"2024-09-12T19:00:10.363268+0000","last_deep_scrub":"264'427","last_deep_scrub_stamp":"2024-09-12T19:00:10.363268+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.363268+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:15.235474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":768,"num_read_kb":10976,"num_write":1273,"num_write_kb":39454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.266415+0000","last_change":"2024-09-12T19:00:30.266415+0000","last_active":"2024-09-12T19:00:30.266415+0000","last_peered":"2024-09-12T19:00:30.266415+0000","last_clean":"2024-09-12T19:00:30.266415+0000","last_became_active":"2024-09-12T17:40:22.144266+0000","last_became_peered":"2024-09-12T17:40:22.144266+0000","last_unstale":"2024-09-12T19:00:30.266415+0000","last_undegraded":"2024-09-12T19:00:30.266415+0000","last_fullsized":"2024-09-12T19:00:30.266415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.266230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.266230+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.266230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:53.470295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'283","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.875571+0000","last_change":"2024-09-12T19:00:31.875571+0000","last_active":"2024-09-12T19:00:31.875571+0000","last_peered":"2024-09-12T19:00:31.875571+0000","last_clean":"2024-09-12T19:00:31.875571+0000","last_became_active":"2024-09-12T17:40:24.332623+0000","last_became_peered":"2024-09-12T17:40:24.332623+0000","last_unstale":"2024-09-12T19:00:31.875571+0000","last_undegraded":"2024-09-12T19:00:31.875571+0000","last_fullsized":"2024-09-12T19:00:31.875571+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'283","last_scrub_stamp":"2024-09-12T19:00:31.875334+0000","last_deep_scrub":"264'283","last_deep_scrub_stamp":"2024-09-12T19:00:31.875334+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.875334+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:28.468065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50618,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1084,"num_write":376,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'787","reported_seq":4969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.759039+0000","last_change":"2024-09-12T19:00:37.759039+0000","last_active":"2024-09-12T19:00:37.759039+0000","last_peered":"2024-09-12T19:00:37.759039+0000","last_clean":"2024-09-12T19:00:37.759039+0000","last_became_active":"2024-09-12T17:40:26.194264+0000","last_became_peered":"2024-09-12T17:40:26.194264+0000","last_unstale":"2024-09-12T19:00:37.759039+0000","last_undegraded":"2024-09-12T19:00:37.759039+0000","last_fullsized":"2024-09-12T19:00:37.759039+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'787","last_scrub_stamp":"2024-09-12T19:00:37.758842+0000","last_deep_scrub":"264'787","last_deep_scrub_stamp":"2024-09-12T19:00:37.758842+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.758842+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:59.879886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'4314","reported_seq":4936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.309249+0000","last_change":"2024-09-12T19:00:18.309077+0000","last_active":"2024-09-12T19:00:18.309249+0000","last_peered":"2024-09-12T19:00:18.309249+0000","last_clean":"2024-09-12T19:00:18.309249+0000","last_became_active":"2024-09-12T17:40:20.136595+0000","last_became_peered":"2024-09-12T17:40:20.136595+0000","last_unstale":"2024-09-12T19:00:18.309249+0000","last_undegraded":"2024-09-12T19:00:18.309249+0000","last_fullsized":"2024-09-12T19:00:18.309249+0000","mapping_epoch":25,"log_start":"264'4300","ondisk_log_start":"264'4300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4314","last_scrub_stamp":"2024-09-12T19:00:18.308892+0000","last_deep_scrub":"264'4314","last_deep_scrub_stamp":"2024-09-12T19:00:18.308892+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.308892+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:40.254536+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17313,"num_read_kb":14480,"num_write":6459,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8763,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'327","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.882869+0000","last_change":"2024-09-12T19:00:08.882869+0000","last_active":"2024-09-12T19:00:08.882869+0000","last_peered":"2024-09-12T19:00:08.882869+0000","last_clean":"2024-09-12T19:00:08.882869+0000","last_became_active":"2024-09-12T17:40:18.792274+0000","last_became_peered":"2024-09-12T17:40:18.792274+0000","last_unstale":"2024-09-12T19:00:08.882869+0000","last_undegraded":"2024-09-12T19:00:08.882869+0000","last_fullsized":"2024-09-12T19:00:08.882869+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T19:00:08.882605+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T19:00:08.882605+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.882605+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:09.532780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":45936,"num_write":1086,"num_write_kb":27157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.923195+0000","last_change":"2024-09-12T19:00:23.923013+0000","last_active":"2024-09-12T19:00:23.923195+0000","last_peered":"2024-09-12T19:00:23.923195+0000","last_clean":"2024-09-12T19:00:23.923195+0000","last_became_active":"2024-09-12T17:40:22.150553+0000","last_became_peered":"2024-09-12T17:40:22.150553+0000","last_unstale":"2024-09-12T19:00:23.923195+0000","last_undegraded":"2024-09-12T19:00:23.923195+0000","last_fullsized":"2024-09-12T19:00:23.923195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.922835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.922835+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.922835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:28.392845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'421","reported_seq":1071,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.266200+0000","last_change":"2024-09-12T19:00:31.265945+0000","last_active":"2024-09-12T19:00:31.266200+0000","last_peered":"2024-09-12T19:00:31.266200+0000","last_clean":"2024-09-12T19:00:31.266200+0000","last_became_active":"2024-09-12T17:40:24.332413+0000","last_became_peered":"2024-09-12T17:40:24.332413+0000","last_unstale":"2024-09-12T19:00:31.266200+0000","last_undegraded":"2024-09-12T19:00:31.266200+0000","last_fullsized":"2024-09-12T19:00:31.266200+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-09-12T19:00:31.265700+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-09-12T19:00:31.265700+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.265700+0000","objects_scrubbed":9,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:30.182370+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52951,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":647,"num_read_kb":1274,"num_write":502,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.347008+0000","last_change":"2024-09-12T19:00:27.347008+0000","last_active":"2024-09-12T19:00:27.347008+0000","last_peered":"2024-09-12T19:00:27.347008+0000","last_clean":"2024-09-12T19:00:27.347008+0000","last_became_active":"2024-09-12T17:40:26.180448+0000","last_became_peered":"2024-09-12T17:40:26.180448+0000","last_unstale":"2024-09-12T19:00:27.347008+0000","last_undegraded":"2024-09-12T19:00:27.347008+0000","last_fullsized":"2024-09-12T19:00:27.347008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:27.346786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:27.346786+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.346786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:53.370738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'562","reported_seq":1386,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.221015+0000","last_change":"2024-09-12T19:00:36.221015+0000","last_active":"2024-09-12T19:00:36.221015+0000","last_peered":"2024-09-12T19:00:36.221015+0000","last_clean":"2024-09-12T19:00:36.221015+0000","last_became_active":"2024-09-12T17:40:28.189872+0000","last_became_peered":"2024-09-12T17:40:28.189872+0000","last_unstale":"2024-09-12T19:00:36.221015+0000","last_undegraded":"2024-09-12T19:00:36.221015+0000","last_fullsized":"2024-09-12T19:00:36.221015+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'562","last_scrub_stamp":"2024-09-12T19:00:36.220759+0000","last_deep_scrub":"264'562","last_deep_scrub_stamp":"2024-09-12T19:00:36.220759+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.220759+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:18.822188+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1323,"num_read_kb":1321,"num_write":1170,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'151","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.852439+0000","last_change":"2024-09-12T19:00:15.852277+0000","last_active":"2024-09-12T19:00:15.852439+0000","last_peered":"2024-09-12T19:00:15.852439+0000","last_clean":"2024-09-12T19:00:15.852439+0000","last_became_active":"2024-09-12T17:40:20.133890+0000","last_became_peered":"2024-09-12T17:40:20.133890+0000","last_unstale":"2024-09-12T19:00:15.852439+0000","last_undegraded":"2024-09-12T19:00:15.852439+0000","last_fullsized":"2024-09-12T19:00:15.852439+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T19:00:15.852091+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T19:00:15.852091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.852091+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:54.370817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":596,"num_write":262,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'398","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.942259+0000","last_change":"2024-09-12T19:00:10.942259+0000","last_active":"2024-09-12T19:00:10.942259+0000","last_peered":"2024-09-12T19:00:10.942259+0000","last_clean":"2024-09-12T19:00:10.942259+0000","last_became_active":"2024-09-12T17:40:18.779278+0000","last_became_peered":"2024-09-12T17:40:18.779278+0000","last_unstale":"2024-09-12T19:00:10.942259+0000","last_undegraded":"2024-09-12T19:00:10.942259+0000","last_fullsized":"2024-09-12T19:00:10.942259+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-12T19:00:10.942027+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-12T19:00:10.942027+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.942027+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:54.061993+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4801217,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":581,"num_read_kb":90800,"num_write":1176,"num_write_kb":50508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"264'6","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.569622+0000","last_change":"2024-09-12T19:00:17.569464+0000","last_active":"2024-09-12T19:00:17.569622+0000","last_peered":"2024-09-12T19:00:17.569622+0000","last_clean":"2024-09-12T19:00:17.569622+0000","last_became_active":"2024-09-12T17:40:22.133525+0000","last_became_peered":"2024-09-12T17:40:22.133525+0000","last_unstale":"2024-09-12T19:00:17.569622+0000","last_undegraded":"2024-09-12T19:00:17.569622+0000","last_fullsized":"2024-09-12T19:00:17.569622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:17.569265+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:17.569265+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.569265+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:55.942607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'293","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.707014+0000","last_change":"2024-09-12T19:00:26.707014+0000","last_active":"2024-09-12T19:00:26.707014+0000","last_peered":"2024-09-12T19:00:26.707014+0000","last_clean":"2024-09-12T19:00:26.707014+0000","last_became_active":"2024-09-12T17:40:24.177609+0000","last_became_peered":"2024-09-12T17:40:24.177609+0000","last_unstale":"2024-09-12T19:00:26.707014+0000","last_undegraded":"2024-09-12T19:00:26.707014+0000","last_fullsized":"2024-09-12T19:00:26.707014+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'293","last_scrub_stamp":"2024-09-12T19:00:26.706832+0000","last_deep_scrub":"264'293","last_deep_scrub_stamp":"2024-09-12T19:00:26.706832+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.706832+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:04.968086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1115,"num_write":388,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.738630+0000","last_change":"2024-09-12T19:00:39.738506+0000","last_active":"2024-09-12T19:00:39.738630+0000","last_peered":"2024-09-12T19:00:39.738630+0000","last_clean":"2024-09-12T19:00:39.738630+0000","last_became_active":"2024-09-12T17:40:26.203313+0000","last_became_peered":"2024-09-12T17:40:26.203313+0000","last_unstale":"2024-09-12T19:00:39.738630+0000","last_undegraded":"2024-09-12T19:00:39.738630+0000","last_fullsized":"2024-09-12T19:00:39.738630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:39.738317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:39.738317+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.738317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:15.402624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2396","reported_seq":4233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.304518+0000","last_change":"2024-09-12T19:00:28.304518+0000","last_active":"2024-09-12T19:00:28.304518+0000","last_peered":"2024-09-12T19:00:28.304518+0000","last_clean":"2024-09-12T19:00:28.304518+0000","last_became_active":"2024-09-12T17:40:28.183181+0000","last_became_peered":"2024-09-12T17:40:28.183181+0000","last_unstale":"2024-09-12T19:00:28.304518+0000","last_undegraded":"2024-09-12T19:00:28.304518+0000","last_fullsized":"2024-09-12T19:00:28.304518+0000","mapping_epoch":33,"log_start":"264'2300","ondisk_log_start":"264'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2396","last_scrub_stamp":"2024-09-12T19:00:28.304334+0000","last_deep_scrub":"264'2396","last_deep_scrub_stamp":"2024-09-12T19:00:28.304334+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.304334+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":2300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:13.034973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6012,"num_read_kb":6017,"num_write":4828,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'262","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.462441+0000","last_change":"2024-09-12T19:00:15.462287+0000","last_active":"2024-09-12T19:00:15.462441+0000","last_peered":"2024-09-12T19:00:15.462441+0000","last_clean":"2024-09-12T19:00:15.462441+0000","last_became_active":"2024-09-12T17:40:20.133614+0000","last_became_peered":"2024-09-12T17:40:20.133614+0000","last_unstale":"2024-09-12T19:00:15.462441+0000","last_undegraded":"2024-09-12T19:00:15.462441+0000","last_fullsized":"2024-09-12T19:00:15.462441+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'262","last_scrub_stamp":"2024-09-12T19:00:15.462110+0000","last_deep_scrub":"264'262","last_deep_scrub_stamp":"2024-09-12T19:00:15.462110+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.462110+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:42.164388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1175,"num_read_kb":965,"num_write":385,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'314","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.901535+0000","last_change":"2024-09-12T19:00:09.901535+0000","last_active":"2024-09-12T19:00:09.901535+0000","last_peered":"2024-09-12T19:00:09.901535+0000","last_clean":"2024-09-12T19:00:09.901535+0000","last_became_active":"2024-09-12T17:40:18.786288+0000","last_became_peered":"2024-09-12T17:40:18.786288+0000","last_unstale":"2024-09-12T19:00:09.901535+0000","last_undegraded":"2024-09-12T19:00:09.901535+0000","last_fullsized":"2024-09-12T19:00:09.901535+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T19:00:09.901234+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T19:00:09.901234+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.901234+0000","objects_scrubbed":11,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:32.060870+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263265,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":395,"num_read_kb":29289,"num_write":926,"num_write_kb":24158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.613306+0000","last_change":"2024-09-12T19:00:18.613306+0000","last_active":"2024-09-12T19:00:18.613306+0000","last_peered":"2024-09-12T19:00:18.613306+0000","last_clean":"2024-09-12T19:00:18.613306+0000","last_became_active":"2024-09-12T17:40:22.131242+0000","last_became_peered":"2024-09-12T17:40:22.131242+0000","last_unstale":"2024-09-12T19:00:18.613306+0000","last_undegraded":"2024-09-12T19:00:18.613306+0000","last_fullsized":"2024-09-12T19:00:18.613306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:18.613075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:18.613075+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.613075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:08.425791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'311","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.905085+0000","last_change":"2024-09-12T19:00:29.904934+0000","last_active":"2024-09-12T19:00:29.905085+0000","last_peered":"2024-09-12T19:00:29.905085+0000","last_clean":"2024-09-12T19:00:29.905085+0000","last_became_active":"2024-09-12T17:40:24.162722+0000","last_became_peered":"2024-09-12T17:40:24.162722+0000","last_unstale":"2024-09-12T19:00:29.905085+0000","last_undegraded":"2024-09-12T19:00:29.905085+0000","last_fullsized":"2024-09-12T19:00:29.905085+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-09-12T19:00:29.904721+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-09-12T19:00:29.904721+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.904721+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:27.096545+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":1041,"num_write":382,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'763","reported_seq":2710,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.353917+0000","last_change":"2024-09-12T19:00:31.353760+0000","last_active":"2024-09-12T19:00:31.353917+0000","last_peered":"2024-09-12T19:00:31.353917+0000","last_clean":"2024-09-12T19:00:31.353917+0000","last_became_active":"2024-09-12T17:40:26.181656+0000","last_became_peered":"2024-09-12T17:40:26.181656+0000","last_unstale":"2024-09-12T19:00:31.353917+0000","last_undegraded":"2024-09-12T19:00:31.353917+0000","last_fullsized":"2024-09-12T19:00:31.353917+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'763","last_scrub_stamp":"2024-09-12T19:00:31.353551+0000","last_deep_scrub":"264'763","last_deep_scrub_stamp":"2024-09-12T19:00:31.353551+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.353551+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:43.697271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'119","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.276180+0000","last_change":"2024-09-12T19:00:37.276043+0000","last_active":"2024-09-12T19:00:37.276180+0000","last_peered":"2024-09-12T19:00:37.276180+0000","last_clean":"2024-09-12T19:00:37.276180+0000","last_became_active":"2024-09-12T17:40:28.185975+0000","last_became_peered":"2024-09-12T17:40:28.185975+0000","last_unstale":"2024-09-12T19:00:37.276180+0000","last_undegraded":"2024-09-12T19:00:37.276180+0000","last_fullsized":"2024-09-12T19:00:37.276180+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T19:00:37.275835+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T19:00:37.275835+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.275835+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:40.024593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'268","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.360248+0000","last_change":"2024-09-12T19:00:15.360248+0000","last_active":"2024-09-12T19:00:15.360248+0000","last_peered":"2024-09-12T19:00:15.360248+0000","last_clean":"2024-09-12T19:00:15.360248+0000","last_became_active":"2024-09-12T17:40:20.125386+0000","last_became_peered":"2024-09-12T17:40:20.125386+0000","last_unstale":"2024-09-12T19:00:15.360248+0000","last_undegraded":"2024-09-12T19:00:15.360248+0000","last_fullsized":"2024-09-12T19:00:15.360248+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'268","last_scrub_stamp":"2024-09-12T19:00:15.359983+0000","last_deep_scrub":"264'268","last_deep_scrub_stamp":"2024-09-12T19:00:15.359983+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.359983+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:39.540314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1147,"num_read_kb":967,"num_write":444,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'346","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.286839+0000","last_change":"2024-09-12T19:00:09.286839+0000","last_active":"2024-09-12T19:00:09.286839+0000","last_peered":"2024-09-12T19:00:09.286839+0000","last_clean":"2024-09-12T19:00:09.286839+0000","last_became_active":"2024-09-12T17:40:18.761052+0000","last_became_peered":"2024-09-12T17:40:18.761052+0000","last_unstale":"2024-09-12T19:00:09.286839+0000","last_undegraded":"2024-09-12T19:00:09.286839+0000","last_fullsized":"2024-09-12T19:00:09.286839+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-12T19:00:09.286528+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-12T19:00:09.286528+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.286528+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:01.066566+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":20006,"num_write":1061,"num_write_kb":43376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.564779+0000","last_change":"2024-09-12T19:00:16.564506+0000","last_active":"2024-09-12T19:00:16.564779+0000","last_peered":"2024-09-12T19:00:16.564779+0000","last_clean":"2024-09-12T19:00:16.564779+0000","last_became_active":"2024-09-12T17:40:22.134290+0000","last_became_peered":"2024-09-12T17:40:22.134290+0000","last_unstale":"2024-09-12T19:00:16.564779+0000","last_undegraded":"2024-09-12T19:00:16.564779+0000","last_fullsized":"2024-09-12T19:00:16.564779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:16.564293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:16.564293+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.564293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:21.426598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'495","reported_seq":1157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.378108+0000","last_change":"2024-09-12T19:00:26.377955+0000","last_active":"2024-09-12T19:00:26.378108+0000","last_peered":"2024-09-12T19:00:26.378108+0000","last_clean":"2024-09-12T19:00:26.378108+0000","last_became_active":"2024-09-12T17:40:24.161322+0000","last_became_peered":"2024-09-12T17:40:24.161322+0000","last_unstale":"2024-09-12T19:00:26.378108+0000","last_undegraded":"2024-09-12T19:00:26.378108+0000","last_fullsized":"2024-09-12T19:00:26.378108+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'495","last_scrub_stamp":"2024-09-12T19:00:26.377759+0000","last_deep_scrub":"264'495","last_deep_scrub_stamp":"2024-09-12T19:00:26.377759+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.377759+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:25.593749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92212,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2116,"num_write":710,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.615238+0000","last_change":"2024-09-12T19:00:22.615101+0000","last_active":"2024-09-12T19:00:22.615238+0000","last_peered":"2024-09-12T19:00:22.615238+0000","last_clean":"2024-09-12T19:00:22.615238+0000","last_became_active":"2024-09-12T17:40:26.191395+0000","last_became_peered":"2024-09-12T17:40:26.191395+0000","last_unstale":"2024-09-12T19:00:22.615238+0000","last_undegraded":"2024-09-12T19:00:22.615238+0000","last_fullsized":"2024-09-12T19:00:22.615238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.614917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.614917+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.614917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:11.312442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'148","reported_seq":672,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.372816+0000","last_change":"2024-09-12T19:00:29.372653+0000","last_active":"2024-09-12T19:00:29.372816+0000","last_peered":"2024-09-12T19:00:29.372816+0000","last_clean":"2024-09-12T19:00:29.372816+0000","last_became_active":"2024-09-12T17:40:28.204260+0000","last_became_peered":"2024-09-12T17:40:28.204260+0000","last_unstale":"2024-09-12T19:00:29.372816+0000","last_undegraded":"2024-09-12T19:00:29.372816+0000","last_fullsized":"2024-09-12T19:00:29.372816+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'148","last_scrub_stamp":"2024-09-12T19:00:29.372433+0000","last_deep_scrub":"264'148","last_deep_scrub_stamp":"2024-09-12T19:00:29.372433+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.372433+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:09.349129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":166,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'137","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.750749+0000","last_change":"2024-09-12T19:00:09.750749+0000","last_active":"2024-09-12T19:00:09.750749+0000","last_peered":"2024-09-12T19:00:09.750749+0000","last_clean":"2024-09-12T19:00:09.750749+0000","last_became_active":"2024-09-12T17:40:20.137143+0000","last_became_peered":"2024-09-12T17:40:20.137143+0000","last_unstale":"2024-09-12T19:00:09.750749+0000","last_undegraded":"2024-09-12T19:00:09.750749+0000","last_fullsized":"2024-09-12T19:00:09.750749+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T19:00:09.750552+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T19:00:09.750552+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.750552+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:20.403074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":630,"num_read_kb":531,"num_write":209,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'373","reported_seq":1212,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.707106+0000","last_change":"2024-09-12T19:00:07.707106+0000","last_active":"2024-09-12T19:00:07.707106+0000","last_peered":"2024-09-12T19:00:07.707106+0000","last_clean":"2024-09-12T19:00:07.707106+0000","last_became_active":"2024-09-12T17:40:18.759516+0000","last_became_peered":"2024-09-12T17:40:18.759516+0000","last_unstale":"2024-09-12T19:00:07.707106+0000","last_undegraded":"2024-09-12T19:00:07.707106+0000","last_fullsized":"2024-09-12T19:00:07.707106+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T19:00:07.706889+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T19:00:07.706889+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.706889+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:42.136959+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457548,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":9130,"num_write":1131,"num_write_kb":40035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.653978+0000","last_change":"2024-09-12T19:00:19.653978+0000","last_active":"2024-09-12T19:00:19.653978+0000","last_peered":"2024-09-12T19:00:19.653978+0000","last_clean":"2024-09-12T19:00:19.653978+0000","last_became_active":"2024-09-12T17:40:22.151755+0000","last_became_peered":"2024-09-12T17:40:22.151755+0000","last_unstale":"2024-09-12T19:00:19.653978+0000","last_undegraded":"2024-09-12T19:00:19.653978+0000","last_fullsized":"2024-09-12T19:00:19.653978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:19.653812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:19.653812+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.653812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:32.089068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'335","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.959837+0000","last_change":"2024-09-12T19:00:31.959837+0000","last_active":"2024-09-12T19:00:31.959837+0000","last_peered":"2024-09-12T19:00:31.959837+0000","last_clean":"2024-09-12T19:00:31.959837+0000","last_became_active":"2024-09-12T17:40:24.171973+0000","last_became_peered":"2024-09-12T17:40:24.171973+0000","last_unstale":"2024-09-12T19:00:31.959837+0000","last_undegraded":"2024-09-12T19:00:31.959837+0000","last_fullsized":"2024-09-12T19:00:31.959837+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T19:00:31.959642+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T19:00:31.959642+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.959642+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:22.025659+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50887,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":1156,"num_write":474,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.379478+0000","last_change":"2024-09-12T19:00:32.379478+0000","last_active":"2024-09-12T19:00:32.379478+0000","last_peered":"2024-09-12T19:00:32.379478+0000","last_clean":"2024-09-12T19:00:32.379478+0000","last_became_active":"2024-09-12T17:40:26.185070+0000","last_became_peered":"2024-09-12T17:40:26.185070+0000","last_unstale":"2024-09-12T19:00:32.379478+0000","last_undegraded":"2024-09-12T19:00:32.379478+0000","last_fullsized":"2024-09-12T19:00:32.379478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:32.379284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:32.379284+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.379284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:06.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'144","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.812475+0000","last_change":"2024-09-12T19:00:43.812322+0000","last_active":"2024-09-12T19:00:43.812475+0000","last_peered":"2024-09-12T19:00:43.812475+0000","last_clean":"2024-09-12T19:00:43.812475+0000","last_became_active":"2024-09-12T17:40:28.194137+0000","last_became_peered":"2024-09-12T17:40:28.194137+0000","last_unstale":"2024-09-12T19:00:43.812475+0000","last_undegraded":"2024-09-12T19:00:43.812475+0000","last_fullsized":"2024-09-12T19:00:43.812475+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:43.812103+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:43.812103+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.812103+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:44.673892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":145,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'125","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.830631+0000","last_change":"2024-09-12T19:00:11.830631+0000","last_active":"2024-09-12T19:00:11.830631+0000","last_peered":"2024-09-12T19:00:11.830631+0000","last_clean":"2024-09-12T19:00:11.830631+0000","last_became_active":"2024-09-12T17:40:20.132115+0000","last_became_peered":"2024-09-12T17:40:20.132115+0000","last_unstale":"2024-09-12T19:00:11.830631+0000","last_undegraded":"2024-09-12T19:00:11.830631+0000","last_fullsized":"2024-09-12T19:00:11.830631+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T19:00:11.830405+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T19:00:11.830405+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.830405+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:28.343246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":428,"num_write":212,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'350","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.413824+0000","last_change":"2024-09-12T19:00:07.413688+0000","last_active":"2024-09-12T19:00:07.413824+0000","last_peered":"2024-09-12T19:00:07.413824+0000","last_clean":"2024-09-12T19:00:07.413824+0000","last_became_active":"2024-09-12T17:40:18.773579+0000","last_became_peered":"2024-09-12T17:40:18.773579+0000","last_unstale":"2024-09-12T19:00:07.413824+0000","last_undegraded":"2024-09-12T19:00:07.413824+0000","last_fullsized":"2024-09-12T19:00:07.413824+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T19:00:07.413481+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T19:00:07.413481+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.413481+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:28.872079+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4506445,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":44851,"num_write":1031,"num_write_kb":35490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.278282+0000","last_change":"2024-09-12T19:00:22.278282+0000","last_active":"2024-09-12T19:00:22.278282+0000","last_peered":"2024-09-12T19:00:22.278282+0000","last_clean":"2024-09-12T19:00:22.278282+0000","last_became_active":"2024-09-12T17:40:22.142112+0000","last_became_peered":"2024-09-12T17:40:22.142112+0000","last_unstale":"2024-09-12T19:00:22.278282+0000","last_undegraded":"2024-09-12T19:00:22.278282+0000","last_fullsized":"2024-09-12T19:00:22.278282+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.278103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.278103+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.278103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:49.670652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'343","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.651045+0000","last_change":"2024-09-12T19:00:21.651045+0000","last_active":"2024-09-12T19:00:21.651045+0000","last_peered":"2024-09-12T19:00:21.651045+0000","last_clean":"2024-09-12T19:00:21.651045+0000","last_became_active":"2024-09-12T17:40:24.181982+0000","last_became_peered":"2024-09-12T17:40:24.181982+0000","last_unstale":"2024-09-12T19:00:21.651045+0000","last_undegraded":"2024-09-12T19:00:21.651045+0000","last_fullsized":"2024-09-12T19:00:21.651045+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T19:00:21.650816+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T19:00:21.650816+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.650816+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:42.753209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52587,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1218,"num_write":444,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'725","reported_seq":2543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.599978+0000","last_change":"2024-09-12T19:00:24.599978+0000","last_active":"2024-09-12T19:00:24.599978+0000","last_peered":"2024-09-12T19:00:24.599978+0000","last_clean":"2024-09-12T19:00:24.599978+0000","last_became_active":"2024-09-12T17:40:26.187269+0000","last_became_peered":"2024-09-12T17:40:26.187269+0000","last_unstale":"2024-09-12T19:00:24.599978+0000","last_undegraded":"2024-09-12T19:00:24.599978+0000","last_fullsized":"2024-09-12T19:00:24.599978+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'725","last_scrub_stamp":"2024-09-12T19:00:24.599793+0000","last_deep_scrub":"264'725","last_deep_scrub_stamp":"2024-09-12T19:00:24.599793+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.599793+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:04.456575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'142","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.457205+0000","last_change":"2024-09-12T19:00:32.457205+0000","last_active":"2024-09-12T19:00:32.457205+0000","last_peered":"2024-09-12T19:00:32.457205+0000","last_clean":"2024-09-12T19:00:32.457205+0000","last_became_active":"2024-09-12T17:40:28.192211+0000","last_became_peered":"2024-09-12T17:40:28.192211+0000","last_unstale":"2024-09-12T19:00:32.457205+0000","last_undegraded":"2024-09-12T19:00:32.457205+0000","last_fullsized":"2024-09-12T19:00:32.457205+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T19:00:32.457018+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T19:00:32.457018+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.457018+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:52.182385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":224,"num_write":356,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'4139","reported_seq":4793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.856712+0000","last_change":"2024-09-12T19:00:14.856712+0000","last_active":"2024-09-12T19:00:14.856712+0000","last_peered":"2024-09-12T19:00:14.856712+0000","last_clean":"2024-09-12T19:00:14.856712+0000","last_became_active":"2024-09-12T17:40:20.136148+0000","last_became_peered":"2024-09-12T17:40:20.136148+0000","last_unstale":"2024-09-12T19:00:14.856712+0000","last_undegraded":"2024-09-12T19:00:14.856712+0000","last_fullsized":"2024-09-12T19:00:14.856712+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4139","last_scrub_stamp":"2024-09-12T19:00:14.856530+0000","last_deep_scrub":"264'4139","last_deep_scrub_stamp":"2024-09-12T19:00:14.856530+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.856530+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":3000,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:49.369462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16638,"num_read_kb":13967,"num_write":6216,"num_write_kb":3097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'309","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.811675+0000","last_change":"2024-09-12T19:00:06.811526+0000","last_active":"2024-09-12T19:00:06.811675+0000","last_peered":"2024-09-12T19:00:06.811675+0000","last_clean":"2024-09-12T19:00:06.811675+0000","last_became_active":"2024-09-12T17:40:18.773552+0000","last_became_peered":"2024-09-12T17:40:18.773552+0000","last_unstale":"2024-09-12T19:00:06.811675+0000","last_undegraded":"2024-09-12T19:00:06.811675+0000","last_fullsized":"2024-09-12T19:00:06.811675+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-09-12T19:00:06.811280+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-09-12T19:00:06.811280+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.811280+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:29.209861+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5770401,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":475,"num_read_kb":17949,"num_write":926,"num_write_kb":45991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1467,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.287267+0000","last_change":"2024-09-12T19:00:27.287267+0000","last_active":"2024-09-12T19:00:27.287267+0000","last_peered":"2024-09-12T19:00:27.287267+0000","last_clean":"2024-09-12T19:00:27.287267+0000","last_became_active":"2024-09-12T17:40:22.143463+0000","last_became_peered":"2024-09-12T17:40:22.143463+0000","last_unstale":"2024-09-12T19:00:27.287267+0000","last_undegraded":"2024-09-12T19:00:27.287267+0000","last_fullsized":"2024-09-12T19:00:27.287267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:00:27.287082+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:00:27.287082+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.287082+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:51.076103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'115","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.759134+0000","last_change":"2024-09-12T19:00:35.759134+0000","last_active":"2024-09-12T19:00:35.759134+0000","last_peered":"2024-09-12T19:00:35.759134+0000","last_clean":"2024-09-12T19:00:35.759134+0000","last_became_active":"2024-09-12T17:40:24.329452+0000","last_became_peered":"2024-09-12T17:40:24.329452+0000","last_unstale":"2024-09-12T19:00:35.759134+0000","last_undegraded":"2024-09-12T19:00:35.759134+0000","last_fullsized":"2024-09-12T19:00:35.759134+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-12T19:00:35.758923+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-12T19:00:35.758923+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.758923+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:17.591973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'753","reported_seq":2633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.384786+0000","last_change":"2024-09-12T19:00:24.384786+0000","last_active":"2024-09-12T19:00:24.384786+0000","last_peered":"2024-09-12T19:00:24.384786+0000","last_clean":"2024-09-12T19:00:24.384786+0000","last_became_active":"2024-09-12T17:40:26.183016+0000","last_became_peered":"2024-09-12T17:40:26.183016+0000","last_unstale":"2024-09-12T19:00:24.384786+0000","last_undegraded":"2024-09-12T19:00:24.384786+0000","last_fullsized":"2024-09-12T19:00:24.384786+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'753","last_scrub_stamp":"2024-09-12T19:00:24.384601+0000","last_deep_scrub":"264'753","last_deep_scrub_stamp":"2024-09-12T19:00:24.384601+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.384601+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:42.720645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'113","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.901377+0000","last_change":"2024-09-12T19:00:38.901377+0000","last_active":"2024-09-12T19:00:38.901377+0000","last_peered":"2024-09-12T19:00:38.901377+0000","last_clean":"2024-09-12T19:00:38.901377+0000","last_became_active":"2024-09-12T17:40:28.180192+0000","last_became_peered":"2024-09-12T17:40:28.180192+0000","last_unstale":"2024-09-12T19:00:38.901377+0000","last_undegraded":"2024-09-12T19:00:38.901377+0000","last_fullsized":"2024-09-12T19:00:38.901377+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'113","last_scrub_stamp":"2024-09-12T19:00:38.901198+0000","last_deep_scrub":"264'113","last_deep_scrub_stamp":"2024-09-12T19:00:38.901198+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.901198+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:35.073698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":167,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'272","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.355420+0000","last_change":"2024-09-12T19:00:18.355420+0000","last_active":"2024-09-12T19:00:18.355420+0000","last_peered":"2024-09-12T19:00:18.355420+0000","last_clean":"2024-09-12T19:00:18.355420+0000","last_became_active":"2024-09-12T17:40:20.125511+0000","last_became_peered":"2024-09-12T17:40:20.125511+0000","last_unstale":"2024-09-12T19:00:18.355420+0000","last_undegraded":"2024-09-12T19:00:18.355420+0000","last_fullsized":"2024-09-12T19:00:18.355420+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-12T19:00:18.355195+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-12T19:00:18.355195+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.355195+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:41.045399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1212,"num_read_kb":1000,"num_write":434,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'288","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.711798+0000","last_change":"2024-09-12T19:00:06.711722+0000","last_active":"2024-09-12T19:00:06.711798+0000","last_peered":"2024-09-12T19:00:06.711798+0000","last_clean":"2024-09-12T19:00:06.711798+0000","last_became_active":"2024-09-12T17:40:18.769054+0000","last_became_peered":"2024-09-12T17:40:18.769054+0000","last_unstale":"2024-09-12T19:00:06.711798+0000","last_undegraded":"2024-09-12T19:00:06.711798+0000","last_fullsized":"2024-09-12T19:00:06.711798+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'288","last_scrub_stamp":"2024-09-12T19:00:06.711610+0000","last_deep_scrub":"264'288","last_deep_scrub_stamp":"2024-09-12T19:00:06.711610+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.711610+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:07.586624+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526370,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":78920,"num_write":889,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.906171+0000","last_change":"2024-09-12T19:00:26.906171+0000","last_active":"2024-09-12T19:00:26.906171+0000","last_peered":"2024-09-12T19:00:26.906171+0000","last_clean":"2024-09-12T19:00:26.906171+0000","last_became_active":"2024-09-12T17:40:22.138875+0000","last_became_peered":"2024-09-12T17:40:22.138875+0000","last_unstale":"2024-09-12T19:00:26.906171+0000","last_undegraded":"2024-09-12T19:00:26.906171+0000","last_fullsized":"2024-09-12T19:00:26.906171+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.905998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.905998+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.905998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:49.165143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'405","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.221799+0000","last_change":"2024-09-12T19:00:32.221799+0000","last_active":"2024-09-12T19:00:32.221799+0000","last_peered":"2024-09-12T19:00:32.221799+0000","last_clean":"2024-09-12T19:00:32.221799+0000","last_became_active":"2024-09-12T17:40:24.173537+0000","last_became_peered":"2024-09-12T17:40:24.173537+0000","last_unstale":"2024-09-12T19:00:32.221799+0000","last_undegraded":"2024-09-12T19:00:32.221799+0000","last_fullsized":"2024-09-12T19:00:32.221799+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-12T19:00:32.221589+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-12T19:00:32.221589+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.221589+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:49.519214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47427,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":650,"num_read_kb":1371,"num_write":508,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.364124+0000","last_change":"2024-09-12T19:00:22.364124+0000","last_active":"2024-09-12T19:00:22.364124+0000","last_peered":"2024-09-12T19:00:22.364124+0000","last_clean":"2024-09-12T19:00:22.364124+0000","last_became_active":"2024-09-12T17:40:26.183228+0000","last_became_peered":"2024-09-12T17:40:26.183228+0000","last_unstale":"2024-09-12T19:00:22.364124+0000","last_undegraded":"2024-09-12T19:00:22.364124+0000","last_fullsized":"2024-09-12T19:00:22.364124+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.363940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.363940+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.363940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:55.507213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'141","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.409412+0000","last_change":"2024-09-12T19:00:31.409412+0000","last_active":"2024-09-12T19:00:31.409412+0000","last_peered":"2024-09-12T19:00:31.409412+0000","last_clean":"2024-09-12T19:00:31.409412+0000","last_became_active":"2024-09-12T17:40:28.191461+0000","last_became_peered":"2024-09-12T17:40:28.191461+0000","last_unstale":"2024-09-12T19:00:31.409412+0000","last_undegraded":"2024-09-12T19:00:31.409412+0000","last_fullsized":"2024-09-12T19:00:31.409412+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T19:00:31.409211+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T19:00:31.409211+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.409211+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:12.731717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":326,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'92","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.412245+0000","last_change":"2024-09-12T19:00:14.412245+0000","last_active":"2024-09-12T19:00:14.412245+0000","last_peered":"2024-09-12T19:00:14.412245+0000","last_clean":"2024-09-12T19:00:14.412245+0000","last_became_active":"2024-09-12T17:40:20.146160+0000","last_became_peered":"2024-09-12T17:40:20.146160+0000","last_unstale":"2024-09-12T19:00:14.412245+0000","last_undegraded":"2024-09-12T19:00:14.412245+0000","last_fullsized":"2024-09-12T19:00:14.412245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-12T19:00:14.412058+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-12T19:00:14.412058+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.412058+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:06.611295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.851657+0000","last_change":"2024-09-12T19:00:07.851479+0000","last_active":"2024-09-12T19:00:07.851657+0000","last_peered":"2024-09-12T19:00:07.851657+0000","last_clean":"2024-09-12T19:00:07.851657+0000","last_became_active":"2024-09-12T17:40:03.636856+0000","last_became_peered":"2024-09-12T17:40:03.636856+0000","last_unstale":"2024-09-12T19:00:07.851657+0000","last_undegraded":"2024-09-12T19:00:07.851657+0000","last_fullsized":"2024-09-12T19:00:07.851657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T19:00:07.851245+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T19:00:07.851245+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.851245+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:47.311318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.303193+0000","last_change":"2024-09-12T19:00:06.303193+0000","last_active":"2024-09-12T19:00:06.303193+0000","last_peered":"2024-09-12T19:00:06.303193+0000","last_clean":"2024-09-12T19:00:06.303193+0000","last_became_active":"2024-09-12T17:40:09.670674+0000","last_became_peered":"2024-09-12T17:40:09.670674+0000","last_unstale":"2024-09-12T19:00:06.303193+0000","last_undegraded":"2024-09-12T19:00:06.303193+0000","last_fullsized":"2024-09-12T19:00:06.303193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:06.303007+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:06.303007+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.303007+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:00.965061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001302742,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'381","reported_seq":1139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.703311+0000","last_change":"2024-09-12T19:00:05.703311+0000","last_active":"2024-09-12T19:00:05.703311+0000","last_peered":"2024-09-12T19:00:05.703311+0000","last_clean":"2024-09-12T19:00:05.703311+0000","last_became_active":"2024-09-12T17:40:18.774164+0000","last_became_peered":"2024-09-12T17:40:18.774164+0000","last_unstale":"2024-09-12T19:00:05.703311+0000","last_undegraded":"2024-09-12T19:00:05.703311+0000","last_fullsized":"2024-09-12T19:00:05.703311+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-12T19:00:05.703231+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-12T19:00:05.703231+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.703231+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.776143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1557056,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":732,"num_read_kb":41235,"num_write":1123,"num_write_kb":37796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.935647+0000","last_change":"2024-09-12T19:00:26.935647+0000","last_active":"2024-09-12T19:00:26.935647+0000","last_peered":"2024-09-12T19:00:26.935647+0000","last_clean":"2024-09-12T19:00:26.935647+0000","last_became_active":"2024-09-12T17:40:22.148190+0000","last_became_peered":"2024-09-12T17:40:22.148190+0000","last_unstale":"2024-09-12T19:00:26.935647+0000","last_undegraded":"2024-09-12T19:00:26.935647+0000","last_fullsized":"2024-09-12T19:00:26.935647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.935461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.935461+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.935461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:01.083634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'739","reported_seq":1464,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.317276+0000","last_change":"2024-09-12T19:00:29.317143+0000","last_active":"2024-09-12T19:00:29.317276+0000","last_peered":"2024-09-12T19:00:29.317276+0000","last_clean":"2024-09-12T19:00:29.317276+0000","last_became_active":"2024-09-12T17:40:24.176757+0000","last_became_peered":"2024-09-12T17:40:24.176757+0000","last_unstale":"2024-09-12T19:00:29.317276+0000","last_undegraded":"2024-09-12T19:00:29.317276+0000","last_fullsized":"2024-09-12T19:00:29.317276+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'739","last_scrub_stamp":"2024-09-12T19:00:29.316937+0000","last_deep_scrub":"264'739","last_deep_scrub_stamp":"2024-09-12T19:00:29.316937+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.316937+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:55.400378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107902,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1433,"num_read_kb":3342,"num_write":1350,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89038,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.307929+0000","last_change":"2024-09-12T19:00:30.307789+0000","last_active":"2024-09-12T19:00:30.307929+0000","last_peered":"2024-09-12T19:00:30.307929+0000","last_clean":"2024-09-12T19:00:30.307929+0000","last_became_active":"2024-09-12T17:40:26.190522+0000","last_became_peered":"2024-09-12T17:40:26.190522+0000","last_unstale":"2024-09-12T19:00:30.307929+0000","last_undegraded":"2024-09-12T19:00:30.307929+0000","last_fullsized":"2024-09-12T19:00:30.307929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.307597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.307597+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.307597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:45.814039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'199","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.271683+0000","last_change":"2024-09-12T19:00:29.271518+0000","last_active":"2024-09-12T19:00:29.271683+0000","last_peered":"2024-09-12T19:00:29.271683+0000","last_clean":"2024-09-12T19:00:29.271683+0000","last_became_active":"2024-09-12T17:40:28.193456+0000","last_became_peered":"2024-09-12T17:40:28.193456+0000","last_unstale":"2024-09-12T19:00:29.271683+0000","last_undegraded":"2024-09-12T19:00:29.271683+0000","last_fullsized":"2024-09-12T19:00:29.271683+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-12T19:00:29.271294+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-12T19:00:29.271294+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.271294+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:08.895317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":530,"num_write":424,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'121","reported_seq":726,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.359863+0000","last_change":"2024-09-12T19:00:14.359729+0000","last_active":"2024-09-12T19:00:14.359863+0000","last_peered":"2024-09-12T19:00:14.359863+0000","last_clean":"2024-09-12T19:00:14.359863+0000","last_became_active":"2024-09-12T17:40:20.130774+0000","last_became_peered":"2024-09-12T17:40:20.130774+0000","last_unstale":"2024-09-12T19:00:14.359863+0000","last_undegraded":"2024-09-12T19:00:14.359863+0000","last_fullsized":"2024-09-12T19:00:14.359863+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-12T19:00:14.359520+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-12T19:00:14.359520+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.359520+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:27.221397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":441,"num_write":172,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.888185+0000","last_change":"2024-09-12T19:00:16.888004+0000","last_active":"2024-09-12T19:00:16.888185+0000","last_peered":"2024-09-12T19:00:16.888185+0000","last_clean":"2024-09-12T19:00:16.888185+0000","last_became_active":"2024-09-12T17:40:09.666272+0000","last_became_peered":"2024-09-12T17:40:09.666272+0000","last_unstale":"2024-09-12T19:00:16.888185+0000","last_undegraded":"2024-09-12T19:00:16.888185+0000","last_fullsized":"2024-09-12T19:00:16.888185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:16.887821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:16.887821+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.887821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:53.458174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001052545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'381","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:03.380638+0000","last_change":"2024-09-12T19:00:03.380638+0000","last_active":"2024-09-12T19:00:03.380638+0000","last_peered":"2024-09-12T19:00:03.380638+0000","last_clean":"2024-09-12T19:00:03.380638+0000","last_became_active":"2024-09-12T17:40:18.774751+0000","last_became_peered":"2024-09-12T17:40:18.774751+0000","last_unstale":"2024-09-12T19:00:03.380638+0000","last_undegraded":"2024-09-12T19:00:03.380638+0000","last_fullsized":"2024-09-12T19:00:03.380638+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-12T19:00:03.380508+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-12T19:00:03.380508+0000","last_clean_scrub_stamp":"2024-09-12T19:00:03.380508+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:57.346685+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":730,"num_write":1215,"num_write_kb":17029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.340588+0000","last_change":"2024-09-12T19:00:23.340365+0000","last_active":"2024-09-12T19:00:23.340588+0000","last_peered":"2024-09-12T19:00:23.340588+0000","last_clean":"2024-09-12T19:00:23.340588+0000","last_became_active":"2024-09-12T17:40:22.147184+0000","last_became_peered":"2024-09-12T17:40:22.147184+0000","last_unstale":"2024-09-12T19:00:23.340588+0000","last_undegraded":"2024-09-12T19:00:23.340588+0000","last_fullsized":"2024-09-12T19:00:23.340588+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.340151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.340151+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.340151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:44.036811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1357","reported_seq":3273,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.312642+0000","last_change":"2024-09-12T19:00:25.312642+0000","last_active":"2024-09-12T19:00:25.312642+0000","last_peered":"2024-09-12T19:00:25.312642+0000","last_clean":"2024-09-12T19:00:25.312642+0000","last_became_active":"2024-09-12T17:40:24.169050+0000","last_became_peered":"2024-09-12T17:40:24.169050+0000","last_unstale":"2024-09-12T19:00:25.312642+0000","last_undegraded":"2024-09-12T19:00:25.312642+0000","last_fullsized":"2024-09-12T19:00:25.312642+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1357","last_scrub_stamp":"2024-09-12T19:00:25.312325+0000","last_deep_scrub":"264'1357","last_deep_scrub_stamp":"2024-09-12T19:00:25.312325+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.312325+0000","objects_scrubbed":12,"log_size":57,"log_dups_size":1300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:35.859451+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147644,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2159,"num_read_kb":4153,"num_write":1266,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.827311+0000","last_change":"2024-09-12T19:00:33.827311+0000","last_active":"2024-09-12T19:00:33.827311+0000","last_peered":"2024-09-12T19:00:33.827311+0000","last_clean":"2024-09-12T19:00:33.827311+0000","last_became_active":"2024-09-12T17:40:26.202360+0000","last_became_peered":"2024-09-12T17:40:26.202360+0000","last_unstale":"2024-09-12T19:00:33.827311+0000","last_undegraded":"2024-09-12T19:00:33.827311+0000","last_fullsized":"2024-09-12T19:00:33.827311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:33.827129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:33.827129+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.827129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:10.410127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'193","reported_seq":742,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.424140+0000","last_change":"2024-09-12T19:00:37.423960+0000","last_active":"2024-09-12T19:00:37.424140+0000","last_peered":"2024-09-12T19:00:37.424140+0000","last_clean":"2024-09-12T19:00:37.424140+0000","last_became_active":"2024-09-12T17:40:28.189387+0000","last_became_peered":"2024-09-12T17:40:28.189387+0000","last_unstale":"2024-09-12T19:00:37.424140+0000","last_undegraded":"2024-09-12T19:00:37.424140+0000","last_fullsized":"2024-09-12T19:00:37.424140+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-12T19:00:37.423750+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-12T19:00:37.423750+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.423750+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:40.018773+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":364,"num_write":413,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'193","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.427674+0000","last_change":"2024-09-12T19:00:14.427403+0000","last_active":"2024-09-12T19:00:14.427674+0000","last_peered":"2024-09-12T19:00:14.427674+0000","last_clean":"2024-09-12T19:00:14.427674+0000","last_became_active":"2024-09-12T17:40:20.129646+0000","last_became_peered":"2024-09-12T17:40:20.129646+0000","last_unstale":"2024-09-12T19:00:14.427674+0000","last_undegraded":"2024-09-12T19:00:14.427674+0000","last_fullsized":"2024-09-12T19:00:14.427674+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-12T19:00:14.427181+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-12T19:00:14.427181+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.427181+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:07.543026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":706,"num_write":294,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.575456+0000","last_change":"2024-09-12T19:00:05.575456+0000","last_active":"2024-09-12T19:00:05.575456+0000","last_peered":"2024-09-12T19:00:05.575456+0000","last_clean":"2024-09-12T19:00:05.575456+0000","last_became_active":"2024-09-12T17:40:09.771196+0000","last_became_peered":"2024-09-12T17:40:09.771196+0000","last_unstale":"2024-09-12T19:00:05.575456+0000","last_undegraded":"2024-09-12T19:00:05.575456+0000","last_fullsized":"2024-09-12T19:00:05.575456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:05.575379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:05.575379+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.575379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:05.851170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010655720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'333","reported_seq":1036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.412121+0000","last_change":"2024-09-12T19:00:05.412049+0000","last_active":"2024-09-12T19:00:05.412121+0000","last_peered":"2024-09-12T19:00:05.412121+0000","last_clean":"2024-09-12T19:00:05.412121+0000","last_became_active":"2024-09-12T17:40:18.759514+0000","last_became_peered":"2024-09-12T17:40:18.759514+0000","last_unstale":"2024-09-12T19:00:05.412121+0000","last_undegraded":"2024-09-12T19:00:05.412121+0000","last_fullsized":"2024-09-12T19:00:05.412121+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-12T19:00:05.411956+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-12T19:00:05.411956+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.411956+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:48.630492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1491790,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":20357,"num_write":1029,"num_write_kb":29003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.647771+0000","last_change":"2024-09-12T19:00:12.647430+0000","last_active":"2024-09-12T19:00:12.647771+0000","last_peered":"2024-09-12T19:00:12.647771+0000","last_clean":"2024-09-12T19:00:12.647771+0000","last_became_active":"2024-09-12T17:40:22.138606+0000","last_became_peered":"2024-09-12T17:40:22.138606+0000","last_unstale":"2024-09-12T19:00:12.647771+0000","last_undegraded":"2024-09-12T19:00:12.647771+0000","last_fullsized":"2024-09-12T19:00:12.647771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:12.647148+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:12.647148+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.647148+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:08.127072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'303","reported_seq":1819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.954465+0000","last_change":"2024-09-12T19:00:28.954465+0000","last_active":"2024-09-12T19:00:28.954465+0000","last_peered":"2024-09-12T19:00:28.954465+0000","last_clean":"2024-09-12T19:00:28.954465+0000","last_became_active":"2024-09-12T17:40:24.329425+0000","last_became_peered":"2024-09-12T17:40:24.329425+0000","last_unstale":"2024-09-12T19:00:28.954465+0000","last_undegraded":"2024-09-12T19:00:28.954465+0000","last_fullsized":"2024-09-12T19:00:28.954465+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-12T19:00:28.954269+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-12T19:00:28.954269+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.954269+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:32.215543+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":264,"num_read_kb":256,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.354987+0000","last_change":"2024-09-12T19:00:35.354987+0000","last_active":"2024-09-12T19:00:35.354987+0000","last_peered":"2024-09-12T19:00:35.354987+0000","last_clean":"2024-09-12T19:00:35.354987+0000","last_became_active":"2024-09-12T17:40:26.188740+0000","last_became_peered":"2024-09-12T17:40:26.188740+0000","last_unstale":"2024-09-12T19:00:35.354987+0000","last_undegraded":"2024-09-12T19:00:35.354987+0000","last_fullsized":"2024-09-12T19:00:35.354987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:35.354801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:35.354801+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.354801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:02.362356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'273","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.791677+0000","last_change":"2024-09-12T19:00:41.791677+0000","last_active":"2024-09-12T19:00:41.791677+0000","last_peered":"2024-09-12T19:00:41.791677+0000","last_clean":"2024-09-12T19:00:41.791677+0000","last_became_active":"2024-09-12T17:40:28.202238+0000","last_became_peered":"2024-09-12T17:40:28.202238+0000","last_unstale":"2024-09-12T19:00:41.791677+0000","last_undegraded":"2024-09-12T19:00:41.791677+0000","last_fullsized":"2024-09-12T19:00:41.791677+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-12T19:00:41.791464+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-12T19:00:41.791464+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.791464+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:50.967702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":592,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'389","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.365530+0000","last_change":"2024-09-12T19:00:16.365530+0000","last_active":"2024-09-12T19:00:16.365530+0000","last_peered":"2024-09-12T19:00:16.365530+0000","last_clean":"2024-09-12T19:00:16.365530+0000","last_became_active":"2024-09-12T17:40:20.127774+0000","last_became_peered":"2024-09-12T17:40:20.127774+0000","last_unstale":"2024-09-12T19:00:16.365530+0000","last_undegraded":"2024-09-12T19:00:16.365530+0000","last_fullsized":"2024-09-12T19:00:16.365530+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'389","last_scrub_stamp":"2024-09-12T19:00:16.365337+0000","last_deep_scrub":"264'389","last_deep_scrub_stamp":"2024-09-12T19:00:16.365337+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.365337+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:35.682974+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1689,"num_read_kb":1329,"num_write":647,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":733,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.329130+0000","last_change":"2024-09-12T19:00:07.329130+0000","last_active":"2024-09-12T19:00:07.329130+0000","last_peered":"2024-09-12T19:00:07.329130+0000","last_clean":"2024-09-12T19:00:07.329130+0000","last_became_active":"2024-09-12T17:40:09.672745+0000","last_became_peered":"2024-09-12T17:40:09.672745+0000","last_unstale":"2024-09-12T19:00:07.329130+0000","last_undegraded":"2024-09-12T19:00:07.329130+0000","last_fullsized":"2024-09-12T19:00:07.329130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:07.328927+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:07.328927+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.328927+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:19.924413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002775694,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'386","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.822955+0000","last_change":"2024-09-12T19:00:05.822955+0000","last_active":"2024-09-12T19:00:05.822955+0000","last_peered":"2024-09-12T19:00:05.822955+0000","last_clean":"2024-09-12T19:00:05.822955+0000","last_became_active":"2024-09-12T17:40:18.769909+0000","last_became_peered":"2024-09-12T17:40:18.769909+0000","last_unstale":"2024-09-12T19:00:05.822955+0000","last_undegraded":"2024-09-12T19:00:05.822955+0000","last_fullsized":"2024-09-12T19:00:05.822955+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'386","last_scrub_stamp":"2024-09-12T19:00:05.822732+0000","last_deep_scrub":"264'386","last_deep_scrub_stamp":"2024-09-12T19:00:05.822732+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.822732+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:20.836010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":740079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":12377,"num_write":1306,"num_write_kb":22203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.344459+0000","last_change":"2024-09-12T19:00:23.344459+0000","last_active":"2024-09-12T19:00:23.344459+0000","last_peered":"2024-09-12T19:00:23.344459+0000","last_clean":"2024-09-12T19:00:23.344459+0000","last_became_active":"2024-09-12T17:40:22.145410+0000","last_became_peered":"2024-09-12T17:40:22.145410+0000","last_unstale":"2024-09-12T19:00:23.344459+0000","last_undegraded":"2024-09-12T19:00:23.344459+0000","last_fullsized":"2024-09-12T19:00:23.344459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.344276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.344276+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.344276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:27.422058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'169","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.726655+0000","last_change":"2024-09-12T19:00:28.726514+0000","last_active":"2024-09-12T19:00:28.726655+0000","last_peered":"2024-09-12T19:00:28.726655+0000","last_clean":"2024-09-12T19:00:28.726655+0000","last_became_active":"2024-09-12T17:40:24.169937+0000","last_became_peered":"2024-09-12T17:40:24.169937+0000","last_unstale":"2024-09-12T19:00:28.726655+0000","last_undegraded":"2024-09-12T19:00:28.726655+0000","last_fullsized":"2024-09-12T19:00:28.726655+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-12T19:00:28.726336+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-12T19:00:28.726336+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.726336+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:14.806353+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":193,"num_write":146,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.372733+0000","last_change":"2024-09-12T19:00:21.372606+0000","last_active":"2024-09-12T19:00:21.372733+0000","last_peered":"2024-09-12T19:00:21.372733+0000","last_clean":"2024-09-12T19:00:21.372733+0000","last_became_active":"2024-09-12T17:40:26.171660+0000","last_became_peered":"2024-09-12T17:40:26.171660+0000","last_unstale":"2024-09-12T19:00:21.372733+0000","last_undegraded":"2024-09-12T19:00:21.372733+0000","last_fullsized":"2024-09-12T19:00:21.372733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.372426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.372426+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.372426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:44.988743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'123","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.259951+0000","last_change":"2024-09-12T19:00:37.259703+0000","last_active":"2024-09-12T19:00:37.259951+0000","last_peered":"2024-09-12T19:00:37.259951+0000","last_clean":"2024-09-12T19:00:37.259951+0000","last_became_active":"2024-09-12T17:40:28.201694+0000","last_became_peered":"2024-09-12T17:40:28.201694+0000","last_unstale":"2024-09-12T19:00:37.259951+0000","last_undegraded":"2024-09-12T19:00:37.259951+0000","last_fullsized":"2024-09-12T19:00:37.259951+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-09-12T19:00:37.259452+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-09-12T19:00:37.259452+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.259452+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:06.026195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":250,"num_write":312,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'144","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.402435+0000","last_change":"2024-09-12T19:00:13.402435+0000","last_active":"2024-09-12T19:00:13.402435+0000","last_peered":"2024-09-12T19:00:13.402435+0000","last_clean":"2024-09-12T19:00:13.402435+0000","last_became_active":"2024-09-12T17:40:20.127727+0000","last_became_peered":"2024-09-12T17:40:20.127727+0000","last_unstale":"2024-09-12T19:00:13.402435+0000","last_undegraded":"2024-09-12T19:00:13.402435+0000","last_fullsized":"2024-09-12T19:00:13.402435+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:13.402249+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:13.402249+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.402249+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:53.064547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":625,"num_read_kb":513,"num_write":241,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'316","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.312786+0000","last_change":"2024-09-12T19:00:08.312786+0000","last_active":"2024-09-12T19:00:08.312786+0000","last_peered":"2024-09-12T19:00:08.312786+0000","last_clean":"2024-09-12T19:00:08.312786+0000","last_became_active":"2024-09-12T17:40:18.768544+0000","last_became_peered":"2024-09-12T17:40:18.768544+0000","last_unstale":"2024-09-12T19:00:08.312786+0000","last_undegraded":"2024-09-12T19:00:08.312786+0000","last_fullsized":"2024-09-12T19:00:08.312786+0000","mapping_epoch":23,"log_start":"264'301","ondisk_log_start":"264'301","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T19:00:08.312642+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T19:00:08.312642+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.312642+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":301,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:52.360053+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":425,"num_read_kb":64899,"num_write":927,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.370168+0000","last_change":"2024-09-12T19:00:06.370168+0000","last_active":"2024-09-12T19:00:06.370168+0000","last_peered":"2024-09-12T19:00:06.370168+0000","last_clean":"2024-09-12T19:00:06.370168+0000","last_became_active":"2024-09-12T17:40:09.770645+0000","last_became_peered":"2024-09-12T17:40:09.770645+0000","last_unstale":"2024-09-12T19:00:06.370168+0000","last_undegraded":"2024-09-12T19:00:06.370168+0000","last_fullsized":"2024-09-12T19:00:06.370168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.370093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.370093+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.370093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:21.045928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091158000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.368257+0000","last_change":"2024-09-12T19:00:22.368257+0000","last_active":"2024-09-12T19:00:22.368257+0000","last_peered":"2024-09-12T19:00:22.368257+0000","last_clean":"2024-09-12T19:00:22.368257+0000","last_became_active":"2024-09-12T17:40:22.136155+0000","last_became_peered":"2024-09-12T17:40:22.136155+0000","last_unstale":"2024-09-12T19:00:22.368257+0000","last_undegraded":"2024-09-12T19:00:22.368257+0000","last_fullsized":"2024-09-12T19:00:22.368257+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.368076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.368076+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.368076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.095079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'658","reported_seq":1363,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.401099+0000","last_change":"2024-09-12T19:00:25.400934+0000","last_active":"2024-09-12T19:00:25.401099+0000","last_peered":"2024-09-12T19:00:25.401099+0000","last_clean":"2024-09-12T19:00:25.401099+0000","last_became_active":"2024-09-12T17:40:24.173380+0000","last_became_peered":"2024-09-12T17:40:24.173380+0000","last_unstale":"2024-09-12T19:00:25.401099+0000","last_undegraded":"2024-09-12T19:00:25.401099+0000","last_fullsized":"2024-09-12T19:00:25.401099+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'658","last_scrub_stamp":"2024-09-12T19:00:25.400715+0000","last_deep_scrub":"264'658","last_deep_scrub_stamp":"2024-09-12T19:00:25.400715+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.400715+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:19.643462+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106768,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":3034,"num_write":2200,"num_write_kb":2020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500800,"num_omap_keys":1132,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.928929+0000","last_change":"2024-09-12T19:00:35.928929+0000","last_active":"2024-09-12T19:00:35.928929+0000","last_peered":"2024-09-12T19:00:35.928929+0000","last_clean":"2024-09-12T19:00:35.928929+0000","last_became_active":"2024-09-12T17:40:26.191417+0000","last_became_peered":"2024-09-12T17:40:26.191417+0000","last_unstale":"2024-09-12T19:00:35.928929+0000","last_undegraded":"2024-09-12T19:00:35.928929+0000","last_fullsized":"2024-09-12T19:00:35.928929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:35.928742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:35.928742+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.928742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:13.337364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'177","reported_seq":715,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.300628+0000","last_change":"2024-09-12T19:00:39.300628+0000","last_active":"2024-09-12T19:00:39.300628+0000","last_peered":"2024-09-12T19:00:39.300628+0000","last_clean":"2024-09-12T19:00:39.300628+0000","last_became_active":"2024-09-12T17:40:28.186922+0000","last_became_peered":"2024-09-12T17:40:28.186922+0000","last_unstale":"2024-09-12T19:00:39.300628+0000","last_undegraded":"2024-09-12T19:00:39.300628+0000","last_fullsized":"2024-09-12T19:00:39.300628+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T19:00:39.300439+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T19:00:39.300439+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.300439+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:10.112573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'144","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.343342+0000","last_change":"2024-09-12T19:00:13.343342+0000","last_active":"2024-09-12T19:00:13.343342+0000","last_peered":"2024-09-12T19:00:13.343342+0000","last_clean":"2024-09-12T19:00:13.343342+0000","last_became_active":"2024-09-12T17:40:20.112490+0000","last_became_peered":"2024-09-12T17:40:20.112490+0000","last_unstale":"2024-09-12T19:00:13.343342+0000","last_undegraded":"2024-09-12T19:00:13.343342+0000","last_fullsized":"2024-09-12T19:00:13.343342+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:13.343164+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:13.343164+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.343164+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:03.480373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":606,"num_read_kb":504,"num_write":208,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'318","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.356400+0000","last_change":"2024-09-12T19:00:09.356400+0000","last_active":"2024-09-12T19:00:09.356400+0000","last_peered":"2024-09-12T19:00:09.356400+0000","last_clean":"2024-09-12T19:00:09.356400+0000","last_became_active":"2024-09-12T17:40:18.760130+0000","last_became_peered":"2024-09-12T17:40:18.760130+0000","last_unstale":"2024-09-12T19:00:09.356400+0000","last_undegraded":"2024-09-12T19:00:09.356400+0000","last_fullsized":"2024-09-12T19:00:09.356400+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-12T19:00:09.356157+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-12T19:00:09.356157+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.356157+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:59.332713+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359201,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":428,"num_read_kb":2118,"num_write":932,"num_write_kb":13193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.862213+0000","last_change":"2024-09-12T19:00:06.862213+0000","last_active":"2024-09-12T19:00:06.862213+0000","last_peered":"2024-09-12T19:00:06.862213+0000","last_clean":"2024-09-12T19:00:06.862213+0000","last_became_active":"2024-09-12T17:40:09.770504+0000","last_became_peered":"2024-09-12T17:40:09.770504+0000","last_unstale":"2024-09-12T19:00:06.862213+0000","last_undegraded":"2024-09-12T19:00:06.862213+0000","last_fullsized":"2024-09-12T19:00:06.862213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.862012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.862012+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.862012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:25.645802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001093257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.417289+0000","last_change":"2024-09-12T19:00:19.417289+0000","last_active":"2024-09-12T19:00:19.417289+0000","last_peered":"2024-09-12T19:00:19.417289+0000","last_clean":"2024-09-12T19:00:19.417289+0000","last_became_active":"2024-09-12T17:40:22.136095+0000","last_became_peered":"2024-09-12T17:40:22.136095+0000","last_unstale":"2024-09-12T19:00:19.417289+0000","last_undegraded":"2024-09-12T19:00:19.417289+0000","last_fullsized":"2024-09-12T19:00:19.417289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:19.417107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:19.417107+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.417107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:24.668335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'263","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.374917+0000","last_change":"2024-09-12T19:00:28.374917+0000","last_active":"2024-09-12T19:00:28.374917+0000","last_peered":"2024-09-12T19:00:28.374917+0000","last_clean":"2024-09-12T19:00:28.374917+0000","last_became_active":"2024-09-12T17:40:24.332477+0000","last_became_peered":"2024-09-12T17:40:24.332477+0000","last_unstale":"2024-09-12T19:00:28.374917+0000","last_undegraded":"2024-09-12T19:00:28.374917+0000","last_fullsized":"2024-09-12T19:00:28.374917+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-09-12T19:00:28.374594+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-09-12T19:00:28.374594+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.374594+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:33.713209+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":296,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'760","reported_seq":3106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.209433+0000","last_change":"2024-09-12T19:00:33.209275+0000","last_active":"2024-09-12T19:00:33.209433+0000","last_peered":"2024-09-12T19:00:33.209433+0000","last_clean":"2024-09-12T19:00:33.209433+0000","last_became_active":"2024-09-12T17:40:26.179728+0000","last_became_peered":"2024-09-12T17:40:26.179728+0000","last_unstale":"2024-09-12T19:00:33.209433+0000","last_undegraded":"2024-09-12T19:00:33.209433+0000","last_fullsized":"2024-09-12T19:00:33.209433+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'760","last_scrub_stamp":"2024-09-12T19:00:33.209091+0000","last_deep_scrub":"264'760","last_deep_scrub_stamp":"2024-09-12T19:00:33.209091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.209091+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:21.534199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'149","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.767198+0000","last_change":"2024-09-12T19:00:40.767198+0000","last_active":"2024-09-12T19:00:40.767198+0000","last_peered":"2024-09-12T19:00:40.767198+0000","last_clean":"2024-09-12T19:00:40.767198+0000","last_became_active":"2024-09-12T17:40:28.201571+0000","last_became_peered":"2024-09-12T17:40:28.201571+0000","last_unstale":"2024-09-12T19:00:40.767198+0000","last_undegraded":"2024-09-12T19:00:40.767198+0000","last_fullsized":"2024-09-12T19:00:40.767198+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T19:00:40.767001+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T19:00:40.767001+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.767001+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:36.748244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":253,"num_write":364,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'450","reported_seq":1172,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.610597+0000","last_change":"2024-09-12T19:00:13.610343+0000","last_active":"2024-09-12T19:00:13.610597+0000","last_peered":"2024-09-12T19:00:13.610597+0000","last_clean":"2024-09-12T19:00:13.610597+0000","last_became_active":"2024-09-12T17:40:20.135950+0000","last_became_peered":"2024-09-12T17:40:20.135950+0000","last_unstale":"2024-09-12T19:00:13.610597+0000","last_undegraded":"2024-09-12T19:00:13.610597+0000","last_fullsized":"2024-09-12T19:00:13.610597+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'450","last_scrub_stamp":"2024-09-12T19:00:13.610072+0000","last_deep_scrub":"264'450","last_deep_scrub_stamp":"2024-09-12T19:00:13.610072+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.610072+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:40.560388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1875,"num_read_kb":1500,"num_write":660,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'335","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.674839+0000","last_change":"2024-09-12T19:00:04.674790+0000","last_active":"2024-09-12T19:00:04.674839+0000","last_peered":"2024-09-12T19:00:04.674839+0000","last_clean":"2024-09-12T19:00:04.674839+0000","last_became_active":"2024-09-12T17:40:18.762324+0000","last_became_peered":"2024-09-12T17:40:18.762324+0000","last_unstale":"2024-09-12T19:00:04.674839+0000","last_undegraded":"2024-09-12T19:00:04.674839+0000","last_fullsized":"2024-09-12T19:00:04.674839+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T19:00:04.674691+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T19:00:04.674691+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.674691+0000","objects_scrubbed":10,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:30.535201+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651838,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":496,"num_read_kb":85957,"num_write":1018,"num_write_kb":37704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.356092+0000","last_change":"2024-09-12T19:00:04.355848+0000","last_active":"2024-09-12T19:00:04.356092+0000","last_peered":"2024-09-12T19:00:04.356092+0000","last_clean":"2024-09-12T19:00:04.356092+0000","last_became_active":"2024-09-12T17:40:09.671019+0000","last_became_peered":"2024-09-12T17:40:09.671019+0000","last_unstale":"2024-09-12T19:00:04.356092+0000","last_undegraded":"2024-09-12T19:00:04.356092+0000","last_fullsized":"2024-09-12T19:00:04.356092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:04.355617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:04.355617+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.355617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:55.946006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096571,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.917725+0000","last_change":"2024-09-12T19:00:27.917725+0000","last_active":"2024-09-12T19:00:27.917725+0000","last_peered":"2024-09-12T19:00:27.917725+0000","last_clean":"2024-09-12T19:00:27.917725+0000","last_became_active":"2024-09-12T17:40:22.146131+0000","last_became_peered":"2024-09-12T17:40:22.146131+0000","last_unstale":"2024-09-12T19:00:27.917725+0000","last_undegraded":"2024-09-12T19:00:27.917725+0000","last_fullsized":"2024-09-12T19:00:27.917725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:27.917530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:27.917530+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.917530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:21.943314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'140","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.982000+0000","last_change":"2024-09-12T19:00:30.982000+0000","last_active":"2024-09-12T19:00:30.982000+0000","last_peered":"2024-09-12T19:00:30.982000+0000","last_clean":"2024-09-12T19:00:30.982000+0000","last_became_active":"2024-09-12T17:40:24.163566+0000","last_became_peered":"2024-09-12T17:40:24.163566+0000","last_unstale":"2024-09-12T19:00:30.982000+0000","last_undegraded":"2024-09-12T19:00:30.982000+0000","last_fullsized":"2024-09-12T19:00:30.982000+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-12T19:00:30.981801+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-12T19:00:30.981801+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.981801+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:33.987008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'788","reported_seq":2833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.751402+0000","last_change":"2024-09-12T19:00:36.751402+0000","last_active":"2024-09-12T19:00:36.751402+0000","last_peered":"2024-09-12T19:00:36.751402+0000","last_clean":"2024-09-12T19:00:36.751402+0000","last_became_active":"2024-09-12T17:40:26.194293+0000","last_became_peered":"2024-09-12T17:40:26.194293+0000","last_unstale":"2024-09-12T19:00:36.751402+0000","last_undegraded":"2024-09-12T19:00:36.751402+0000","last_fullsized":"2024-09-12T19:00:36.751402+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'788","last_scrub_stamp":"2024-09-12T19:00:36.751181+0000","last_deep_scrub":"264'788","last_deep_scrub_stamp":"2024-09-12T19:00:36.751181+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.751181+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:42.437380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'202","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.303698+0000","last_change":"2024-09-12T19:00:38.303698+0000","last_active":"2024-09-12T19:00:38.303698+0000","last_peered":"2024-09-12T19:00:38.303698+0000","last_clean":"2024-09-12T19:00:38.303698+0000","last_became_active":"2024-09-12T17:40:28.207048+0000","last_became_peered":"2024-09-12T17:40:28.207048+0000","last_unstale":"2024-09-12T19:00:38.303698+0000","last_undegraded":"2024-09-12T19:00:38.303698+0000","last_fullsized":"2024-09-12T19:00:38.303698+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-09-12T19:00:38.303469+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-09-12T19:00:38.303469+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.303469+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:54.874761+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":318,"num_write":457,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'86","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.883647+0000","last_change":"2024-09-12T19:00:13.883647+0000","last_active":"2024-09-12T19:00:13.883647+0000","last_peered":"2024-09-12T19:00:13.883647+0000","last_clean":"2024-09-12T19:00:13.883647+0000","last_became_active":"2024-09-12T17:40:20.142323+0000","last_became_peered":"2024-09-12T17:40:20.142323+0000","last_unstale":"2024-09-12T19:00:13.883647+0000","last_undegraded":"2024-09-12T19:00:13.883647+0000","last_fullsized":"2024-09-12T19:00:13.883647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T19:00:13.883445+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T19:00:13.883445+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.883445+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:31.548172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":391,"num_read_kb":327,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'428","reported_seq":1218,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.396943+0000","last_change":"2024-09-12T19:00:04.396668+0000","last_active":"2024-09-12T19:00:04.396943+0000","last_peered":"2024-09-12T19:00:04.396943+0000","last_clean":"2024-09-12T19:00:04.396943+0000","last_became_active":"2024-09-12T17:40:18.766817+0000","last_became_peered":"2024-09-12T17:40:18.766817+0000","last_unstale":"2024-09-12T19:00:04.396943+0000","last_undegraded":"2024-09-12T19:00:04.396943+0000","last_fullsized":"2024-09-12T19:00:04.396943+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-12T19:00:04.396400+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-12T19:00:04.396400+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.396400+0000","objects_scrubbed":10,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:18.046636+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4983875,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":942,"num_read_kb":8527,"num_write":1357,"num_write_kb":43864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.360350+0000","last_change":"2024-09-12T19:00:06.360220+0000","last_active":"2024-09-12T19:00:06.360350+0000","last_peered":"2024-09-12T19:00:06.360350+0000","last_clean":"2024-09-12T19:00:06.360350+0000","last_became_active":"2024-09-12T17:40:09.674331+0000","last_became_peered":"2024-09-12T17:40:09.674331+0000","last_unstale":"2024-09-12T19:00:06.360350+0000","last_undegraded":"2024-09-12T19:00:06.360350+0000","last_fullsized":"2024-09-12T19:00:06.360350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.360038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.360038+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.360038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:41.602732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012562929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.628096+0000","last_change":"2024-09-12T19:00:21.627955+0000","last_active":"2024-09-12T19:00:21.628096+0000","last_peered":"2024-09-12T19:00:21.628096+0000","last_clean":"2024-09-12T19:00:21.628096+0000","last_became_active":"2024-09-12T17:40:22.147341+0000","last_became_peered":"2024-09-12T17:40:22.147341+0000","last_unstale":"2024-09-12T19:00:21.628096+0000","last_undegraded":"2024-09-12T19:00:21.628096+0000","last_fullsized":"2024-09-12T19:00:21.628096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.627773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.627773+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.627773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:41.060971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'794","reported_seq":1547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.993031+0000","last_change":"2024-09-12T19:00:27.993031+0000","last_active":"2024-09-12T19:00:27.993031+0000","last_peered":"2024-09-12T19:00:27.993031+0000","last_clean":"2024-09-12T19:00:27.993031+0000","last_became_active":"2024-09-12T17:40:24.329314+0000","last_became_peered":"2024-09-12T17:40:24.329314+0000","last_unstale":"2024-09-12T19:00:27.993031+0000","last_undegraded":"2024-09-12T19:00:27.993031+0000","last_fullsized":"2024-09-12T19:00:27.993031+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-09-12T19:00:27.992823+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-09-12T19:00:27.992823+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.992823+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:08.998967+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1403,"num_read_kb":3378,"num_write":1144,"num_write_kb":925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.761641+0000","last_change":"2024-09-12T19:00:34.761641+0000","last_active":"2024-09-12T19:00:34.761641+0000","last_peered":"2024-09-12T19:00:34.761641+0000","last_clean":"2024-09-12T19:00:34.761641+0000","last_became_active":"2024-09-12T17:40:26.197718+0000","last_became_peered":"2024-09-12T17:40:26.197718+0000","last_unstale":"2024-09-12T19:00:34.761641+0000","last_undegraded":"2024-09-12T19:00:34.761641+0000","last_fullsized":"2024-09-12T19:00:34.761641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.761433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.761433+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.761433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:18.548460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'119","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.301208+0000","last_change":"2024-09-12T19:00:38.301208+0000","last_active":"2024-09-12T19:00:38.301208+0000","last_peered":"2024-09-12T19:00:38.301208+0000","last_clean":"2024-09-12T19:00:38.301208+0000","last_became_active":"2024-09-12T17:40:28.199295+0000","last_became_peered":"2024-09-12T17:40:28.199295+0000","last_unstale":"2024-09-12T19:00:38.301208+0000","last_undegraded":"2024-09-12T19:00:38.301208+0000","last_fullsized":"2024-09-12T19:00:38.301208+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T19:00:38.300989+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T19:00:38.300989+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.300989+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:21.748465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":147,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'108","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.325770+0000","last_change":"2024-09-12T19:00:42.325770+0000","last_active":"2024-09-12T19:00:42.325770+0000","last_peered":"2024-09-12T19:00:42.325770+0000","last_clean":"2024-09-12T19:00:42.325770+0000","last_became_active":"2024-09-12T17:40:28.192019+0000","last_became_peered":"2024-09-12T17:40:28.192019+0000","last_unstale":"2024-09-12T19:00:42.325770+0000","last_undegraded":"2024-09-12T19:00:42.325770+0000","last_fullsized":"2024-09-12T19:00:42.325770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'108","last_scrub_stamp":"2024-09-12T19:00:42.325587+0000","last_deep_scrub":"264'108","last_deep_scrub_stamp":"2024-09-12T19:00:42.325587+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.325587+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:11.590573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":192,"num_write":225,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'111","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.848789+0000","last_change":"2024-09-12T19:00:12.848789+0000","last_active":"2024-09-12T19:00:12.848789+0000","last_peered":"2024-09-12T19:00:12.848789+0000","last_clean":"2024-09-12T19:00:12.848789+0000","last_became_active":"2024-09-12T17:40:20.135868+0000","last_became_peered":"2024-09-12T17:40:20.135868+0000","last_unstale":"2024-09-12T19:00:12.848789+0000","last_undegraded":"2024-09-12T19:00:12.848789+0000","last_fullsized":"2024-09-12T19:00:12.848789+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'111","last_scrub_stamp":"2024-09-12T19:00:12.848609+0000","last_deep_scrub":"264'111","last_deep_scrub_stamp":"2024-09-12T19:00:12.848609+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.848609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:47.505689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":445,"num_write":160,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'289","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.773680+0000","last_change":"2024-09-12T19:00:07.773680+0000","last_active":"2024-09-12T19:00:07.773680+0000","last_peered":"2024-09-12T19:00:07.773680+0000","last_clean":"2024-09-12T19:00:07.773680+0000","last_became_active":"2024-09-12T17:40:18.788674+0000","last_became_peered":"2024-09-12T17:40:18.788674+0000","last_unstale":"2024-09-12T19:00:07.773680+0000","last_undegraded":"2024-09-12T19:00:07.773680+0000","last_fullsized":"2024-09-12T19:00:07.773680+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-12T19:00:07.773396+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-12T19:00:07.773396+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.773396+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:22.864639+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117782,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":10615,"num_write":904,"num_write_kb":14901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.325270+0000","last_change":"2024-09-12T19:00:21.325270+0000","last_active":"2024-09-12T19:00:21.325270+0000","last_peered":"2024-09-12T19:00:21.325270+0000","last_clean":"2024-09-12T19:00:21.325270+0000","last_became_active":"2024-09-12T17:40:22.141326+0000","last_became_peered":"2024-09-12T17:40:22.141326+0000","last_unstale":"2024-09-12T19:00:21.325270+0000","last_undegraded":"2024-09-12T19:00:21.325270+0000","last_fullsized":"2024-09-12T19:00:21.325270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.325088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.325088+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.325088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:11.574471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'309","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.735075+0000","last_change":"2024-09-12T19:00:30.735075+0000","last_active":"2024-09-12T19:00:30.735075+0000","last_peered":"2024-09-12T19:00:30.735075+0000","last_clean":"2024-09-12T19:00:30.735075+0000","last_became_active":"2024-09-12T17:40:24.169248+0000","last_became_peered":"2024-09-12T17:40:24.169248+0000","last_unstale":"2024-09-12T19:00:30.735075+0000","last_undegraded":"2024-09-12T19:00:30.735075+0000","last_fullsized":"2024-09-12T19:00:30.735075+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-09-12T19:00:30.734871+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-09-12T19:00:30.734871+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.734871+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:57.413664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1219,"num_write":420,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.712706+0000","last_change":"2024-09-12T19:00:38.712706+0000","last_active":"2024-09-12T19:00:38.712706+0000","last_peered":"2024-09-12T19:00:38.712706+0000","last_clean":"2024-09-12T19:00:38.712706+0000","last_became_active":"2024-09-12T17:40:26.203855+0000","last_became_peered":"2024-09-12T17:40:26.203855+0000","last_unstale":"2024-09-12T19:00:38.712706+0000","last_undegraded":"2024-09-12T19:00:38.712706+0000","last_fullsized":"2024-09-12T19:00:38.712706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:38.712521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:38.712521+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.712521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:52.759517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:52.877836+0000","last_change":"2024-09-12T19:00:52.877836+0000","last_active":"2024-09-12T19:00:52.877836+0000","last_peered":"2024-09-12T19:00:52.877836+0000","last_clean":"2024-09-12T19:00:52.877836+0000","last_became_active":"2024-09-12T17:40:28.204204+0000","last_became_peered":"2024-09-12T17:40:28.204204+0000","last_unstale":"2024-09-12T19:00:52.877836+0000","last_undegraded":"2024-09-12T19:00:52.877836+0000","last_fullsized":"2024-09-12T19:00:52.877836+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T19:00:52.877659+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T19:00:52.877659+0000","last_clean_scrub_stamp":"2024-09-12T19:00:52.877659+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:59.019775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":252,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'238","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.393511+0000","last_change":"2024-09-12T19:00:15.393511+0000","last_active":"2024-09-12T19:00:15.393511+0000","last_peered":"2024-09-12T19:00:15.393511+0000","last_clean":"2024-09-12T19:00:15.393511+0000","last_became_active":"2024-09-12T17:40:20.128532+0000","last_became_peered":"2024-09-12T17:40:20.128532+0000","last_unstale":"2024-09-12T19:00:15.393511+0000","last_undegraded":"2024-09-12T19:00:15.393511+0000","last_fullsized":"2024-09-12T19:00:15.393511+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'238","last_scrub_stamp":"2024-09-12T19:00:15.393329+0000","last_deep_scrub":"264'238","last_deep_scrub_stamp":"2024-09-12T19:00:15.393329+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.393329+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:00.980128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":846,"num_write":360,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'397","reported_seq":1111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.937018+0000","last_change":"2024-09-12T19:00:11.937018+0000","last_active":"2024-09-12T19:00:11.937018+0000","last_peered":"2024-09-12T19:00:11.937018+0000","last_clean":"2024-09-12T19:00:11.937018+0000","last_became_active":"2024-09-12T17:40:55.305689+0000","last_became_peered":"2024-09-12T17:40:55.305689+0000","last_unstale":"2024-09-12T19:00:11.937018+0000","last_undegraded":"2024-09-12T19:00:11.937018+0000","last_fullsized":"2024-09-12T19:00:11.937018+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:11.936824+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:11.936824+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.936824+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:31.586190+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":44917,"num_write":1304,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.618172+0000","last_change":"2024-09-12T19:00:20.618172+0000","last_active":"2024-09-12T19:00:20.618172+0000","last_peered":"2024-09-12T19:00:20.618172+0000","last_clean":"2024-09-12T19:00:20.618172+0000","last_became_active":"2024-09-12T17:40:22.143466+0000","last_became_peered":"2024-09-12T17:40:22.143466+0000","last_unstale":"2024-09-12T19:00:20.618172+0000","last_undegraded":"2024-09-12T19:00:20.618172+0000","last_fullsized":"2024-09-12T19:00:20.618172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:20.617988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:20.617988+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.617988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:25.354445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'64","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.330148+0000","last_change":"2024-09-12T19:00:27.330148+0000","last_active":"2024-09-12T19:00:27.330148+0000","last_peered":"2024-09-12T19:00:27.330148+0000","last_clean":"2024-09-12T19:00:27.330148+0000","last_became_active":"2024-09-12T17:40:24.151530+0000","last_became_peered":"2024-09-12T17:40:24.151530+0000","last_unstale":"2024-09-12T19:00:27.330148+0000","last_undegraded":"2024-09-12T19:00:27.330148+0000","last_fullsized":"2024-09-12T19:00:27.330148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-12T19:00:27.329940+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-12T19:00:27.329940+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.329940+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:38.476922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.820506+0000","last_change":"2024-09-12T19:00:34.820506+0000","last_active":"2024-09-12T19:00:34.820506+0000","last_peered":"2024-09-12T19:00:34.820506+0000","last_clean":"2024-09-12T19:00:34.820506+0000","last_became_active":"2024-09-12T17:40:26.187122+0000","last_became_peered":"2024-09-12T17:40:26.187122+0000","last_unstale":"2024-09-12T19:00:34.820506+0000","last_undegraded":"2024-09-12T19:00:34.820506+0000","last_fullsized":"2024-09-12T19:00:34.820506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.820308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.820308+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.820308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:23.590071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'251","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.270085+0000","last_change":"2024-09-12T19:00:40.270085+0000","last_active":"2024-09-12T19:00:40.270085+0000","last_peered":"2024-09-12T19:00:40.270085+0000","last_clean":"2024-09-12T19:00:40.270085+0000","last_became_active":"2024-09-12T17:40:28.194047+0000","last_became_peered":"2024-09-12T17:40:28.194047+0000","last_unstale":"2024-09-12T19:00:40.270085+0000","last_undegraded":"2024-09-12T19:00:40.270085+0000","last_fullsized":"2024-09-12T19:00:40.270085+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T19:00:40.269814+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T19:00:40.269814+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.269814+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:38.167229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":352,"num_write":540,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'120","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.619652+0000","last_change":"2024-09-12T19:00:18.619652+0000","last_active":"2024-09-12T19:00:18.619652+0000","last_peered":"2024-09-12T19:00:18.619652+0000","last_clean":"2024-09-12T19:00:18.619652+0000","last_became_active":"2024-09-12T17:40:20.130567+0000","last_became_peered":"2024-09-12T17:40:20.130567+0000","last_unstale":"2024-09-12T19:00:18.619652+0000","last_undegraded":"2024-09-12T19:00:18.619652+0000","last_fullsized":"2024-09-12T19:00:18.619652+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T19:00:18.619454+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T19:00:18.619454+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.619454+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:46.704065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":440,"num_write":198,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'397","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.290827+0000","last_change":"2024-09-12T19:00:11.290827+0000","last_active":"2024-09-12T19:00:11.290827+0000","last_peered":"2024-09-12T19:00:11.290827+0000","last_clean":"2024-09-12T19:00:11.290827+0000","last_became_active":"2024-09-12T17:40:18.781135+0000","last_became_peered":"2024-09-12T17:40:18.781135+0000","last_unstale":"2024-09-12T19:00:11.290827+0000","last_undegraded":"2024-09-12T19:00:11.290827+0000","last_fullsized":"2024-09-12T19:00:11.290827+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:11.290616+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:11.290616+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.290616+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:13.553119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306781,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":11928,"num_write":1198,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.965742+0000","last_change":"2024-09-12T19:00:24.965742+0000","last_active":"2024-09-12T19:00:24.965742+0000","last_peered":"2024-09-12T19:00:24.965742+0000","last_clean":"2024-09-12T19:00:24.965742+0000","last_became_active":"2024-09-12T17:40:22.150912+0000","last_became_peered":"2024-09-12T17:40:22.150912+0000","last_unstale":"2024-09-12T19:00:24.965742+0000","last_undegraded":"2024-09-12T19:00:24.965742+0000","last_fullsized":"2024-09-12T19:00:24.965742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:24.965556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:24.965556+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.965556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:45.272866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'347","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.748826+0000","last_change":"2024-09-12T19:00:32.748826+0000","last_active":"2024-09-12T19:00:32.748826+0000","last_peered":"2024-09-12T19:00:32.748826+0000","last_clean":"2024-09-12T19:00:32.748826+0000","last_became_active":"2024-09-12T17:40:24.176722+0000","last_became_peered":"2024-09-12T17:40:24.176722+0000","last_unstale":"2024-09-12T19:00:32.748826+0000","last_undegraded":"2024-09-12T19:00:32.748826+0000","last_fullsized":"2024-09-12T19:00:32.748826+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T19:00:32.748627+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T19:00:32.748627+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.748627+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:59.648696+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48896,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":559,"num_read_kb":1238,"num_write":442,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.373420+0000","last_change":"2024-09-12T19:00:23.373420+0000","last_active":"2024-09-12T19:00:23.373420+0000","last_peered":"2024-09-12T19:00:23.373420+0000","last_clean":"2024-09-12T19:00:23.373420+0000","last_became_active":"2024-09-12T17:40:26.167280+0000","last_became_peered":"2024-09-12T17:40:26.167280+0000","last_unstale":"2024-09-12T19:00:23.373420+0000","last_undegraded":"2024-09-12T19:00:23.373420+0000","last_fullsized":"2024-09-12T19:00:23.373420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.373235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.373235+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.373235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:28.340798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'108","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.254669+0000","last_change":"2024-09-12T19:00:41.254669+0000","last_active":"2024-09-12T19:00:41.254669+0000","last_peered":"2024-09-12T19:00:41.254669+0000","last_clean":"2024-09-12T19:00:41.254669+0000","last_became_active":"2024-09-12T17:40:28.192629+0000","last_became_peered":"2024-09-12T17:40:28.192629+0000","last_unstale":"2024-09-12T19:00:41.254669+0000","last_undegraded":"2024-09-12T19:00:41.254669+0000","last_fullsized":"2024-09-12T19:00:41.254669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'108","last_scrub_stamp":"2024-09-12T19:00:41.254478+0000","last_deep_scrub":"264'108","last_deep_scrub_stamp":"2024-09-12T19:00:41.254478+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.254478+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:41.328980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.590597+0000","last_change":"2024-09-12T19:00:16.590597+0000","last_active":"2024-09-12T19:00:16.590597+0000","last_peered":"2024-09-12T19:00:16.590597+0000","last_clean":"2024-09-12T19:00:16.590597+0000","last_became_active":"2024-09-12T17:40:55.301950+0000","last_became_peered":"2024-09-12T17:40:55.301950+0000","last_unstale":"2024-09-12T19:00:16.590597+0000","last_undegraded":"2024-09-12T19:00:16.590597+0000","last_fullsized":"2024-09-12T19:00:16.590597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-12T19:00:16.590364+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-12T19:00:16.590364+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.590364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:37.860965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":400,"num_write":158,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'409","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.344070+0000","last_change":"2024-09-12T19:00:06.344003+0000","last_active":"2024-09-12T19:00:06.344070+0000","last_peered":"2024-09-12T19:00:06.344070+0000","last_clean":"2024-09-12T19:00:06.344070+0000","last_became_active":"2024-09-12T17:40:18.755694+0000","last_became_peered":"2024-09-12T17:40:18.755694+0000","last_unstale":"2024-09-12T19:00:06.344070+0000","last_undegraded":"2024-09-12T19:00:06.344070+0000","last_fullsized":"2024-09-12T19:00:06.344070+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'409","last_scrub_stamp":"2024-09-12T19:00:06.343896+0000","last_deep_scrub":"264'409","last_deep_scrub_stamp":"2024-09-12T19:00:06.343896+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.343896+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:09.006520+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194332,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":35553,"num_write":1273,"num_write_kb":53517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.338329+0000","last_change":"2024-09-12T19:00:25.338329+0000","last_active":"2024-09-12T19:00:25.338329+0000","last_peered":"2024-09-12T19:00:25.338329+0000","last_clean":"2024-09-12T19:00:25.338329+0000","last_became_active":"2024-09-12T17:40:22.135547+0000","last_became_peered":"2024-09-12T17:40:22.135547+0000","last_unstale":"2024-09-12T19:00:25.338329+0000","last_undegraded":"2024-09-12T19:00:25.338329+0000","last_fullsized":"2024-09-12T19:00:25.338329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:25.338146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:25.338146+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.338146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:19.495885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'313","reported_seq":906,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.900396+0000","last_change":"2024-09-12T19:00:30.900396+0000","last_active":"2024-09-12T19:00:30.900396+0000","last_peered":"2024-09-12T19:00:30.900396+0000","last_clean":"2024-09-12T19:00:30.900396+0000","last_became_active":"2024-09-12T17:40:24.162901+0000","last_became_peered":"2024-09-12T17:40:24.162901+0000","last_unstale":"2024-09-12T19:00:30.900396+0000","last_undegraded":"2024-09-12T19:00:30.900396+0000","last_fullsized":"2024-09-12T19:00:30.900396+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T19:00:30.900145+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T19:00:30.900145+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.900145+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:39.433014+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51001,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1227,"num_write":416,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.367179+0000","last_change":"2024-09-12T19:00:33.367179+0000","last_active":"2024-09-12T19:00:33.367179+0000","last_peered":"2024-09-12T19:00:33.367179+0000","last_clean":"2024-09-12T19:00:33.367179+0000","last_became_active":"2024-09-12T17:40:26.190755+0000","last_became_peered":"2024-09-12T17:40:26.190755+0000","last_unstale":"2024-09-12T19:00:33.367179+0000","last_undegraded":"2024-09-12T19:00:33.367179+0000","last_fullsized":"2024-09-12T19:00:33.367179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:33.367006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:33.367006+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.367006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:39.709430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'428","reported_seq":1200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.440828+0000","last_change":"2024-09-12T19:00:16.440828+0000","last_active":"2024-09-12T19:00:16.440828+0000","last_peered":"2024-09-12T19:00:16.440828+0000","last_clean":"2024-09-12T19:00:16.440828+0000","last_became_active":"2024-09-12T17:40:20.127413+0000","last_became_peered":"2024-09-12T17:40:20.127413+0000","last_unstale":"2024-09-12T19:00:16.440828+0000","last_undegraded":"2024-09-12T19:00:16.440828+0000","last_fullsized":"2024-09-12T19:00:16.440828+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-12T19:00:16.440639+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-12T19:00:16.440639+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.440639+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:08.283126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2096,"num_read_kb":1807,"num_write":754,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'348","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.711102+0000","last_change":"2024-09-12T19:00:08.711102+0000","last_active":"2024-09-12T19:00:08.711102+0000","last_peered":"2024-09-12T19:00:08.711102+0000","last_clean":"2024-09-12T19:00:08.711102+0000","last_became_active":"2024-09-12T17:40:18.759467+0000","last_became_peered":"2024-09-12T17:40:18.759467+0000","last_unstale":"2024-09-12T19:00:08.711102+0000","last_undegraded":"2024-09-12T19:00:08.711102+0000","last_fullsized":"2024-09-12T19:00:08.711102+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T19:00:08.710899+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T19:00:08.710899+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.710899+0000","objects_scrubbed":10,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:25.297780+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399269,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":67738,"num_write":1092,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.349916+0000","last_change":"2024-09-12T19:00:24.349773+0000","last_active":"2024-09-12T19:00:24.349916+0000","last_peered":"2024-09-12T19:00:24.349916+0000","last_clean":"2024-09-12T19:00:24.349916+0000","last_became_active":"2024-09-12T17:40:22.143764+0000","last_became_peered":"2024-09-12T17:40:22.143764+0000","last_unstale":"2024-09-12T19:00:24.349916+0000","last_undegraded":"2024-09-12T19:00:24.349916+0000","last_fullsized":"2024-09-12T19:00:24.349916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:24.349597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:24.349597+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.349597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:40.760179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'543","reported_seq":1199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.338159+0000","last_change":"2024-09-12T19:00:26.338025+0000","last_active":"2024-09-12T19:00:26.338159+0000","last_peered":"2024-09-12T19:00:26.338159+0000","last_clean":"2024-09-12T19:00:26.338159+0000","last_became_active":"2024-09-12T17:40:24.178354+0000","last_became_peered":"2024-09-12T17:40:24.178354+0000","last_unstale":"2024-09-12T19:00:26.338159+0000","last_undegraded":"2024-09-12T19:00:26.338159+0000","last_fullsized":"2024-09-12T19:00:26.338159+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'543","last_scrub_stamp":"2024-09-12T19:00:26.337832+0000","last_deep_scrub":"264'543","last_deep_scrub_stamp":"2024-09-12T19:00:26.337832+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.337832+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:34.313521+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110471,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":953,"num_read_kb":2361,"num_write":826,"num_write_kb":742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.232729+0000","last_change":"2024-09-12T19:00:34.232729+0000","last_active":"2024-09-12T19:00:34.232729+0000","last_peered":"2024-09-12T19:00:34.232729+0000","last_clean":"2024-09-12T19:00:34.232729+0000","last_became_active":"2024-09-12T17:40:26.184572+0000","last_became_peered":"2024-09-12T17:40:26.184572+0000","last_unstale":"2024-09-12T19:00:34.232729+0000","last_undegraded":"2024-09-12T19:00:34.232729+0000","last_fullsized":"2024-09-12T19:00:34.232729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.232547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.232547+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.232547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:15.459942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'245","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.834830+0000","last_change":"2024-09-12T19:00:46.834830+0000","last_active":"2024-09-12T19:00:46.834830+0000","last_peered":"2024-09-12T19:00:46.834830+0000","last_clean":"2024-09-12T19:00:46.834830+0000","last_became_active":"2024-09-12T17:40:28.200289+0000","last_became_peered":"2024-09-12T17:40:28.200289+0000","last_unstale":"2024-09-12T19:00:46.834830+0000","last_undegraded":"2024-09-12T19:00:46.834830+0000","last_fullsized":"2024-09-12T19:00:46.834830+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T19:00:46.834609+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T19:00:46.834609+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.834609+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:42.343737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":402,"num_read_kb":380,"num_write":484,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'278","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.329668+0000","last_change":"2024-09-12T19:00:17.329492+0000","last_active":"2024-09-12T19:00:17.329668+0000","last_peered":"2024-09-12T19:00:17.329668+0000","last_clean":"2024-09-12T19:00:17.329668+0000","last_became_active":"2024-09-12T17:40:20.128840+0000","last_became_peered":"2024-09-12T17:40:20.128840+0000","last_unstale":"2024-09-12T19:00:17.329668+0000","last_undegraded":"2024-09-12T19:00:17.329668+0000","last_fullsized":"2024-09-12T19:00:17.329668+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'278","last_scrub_stamp":"2024-09-12T19:00:17.329286+0000","last_deep_scrub":"264'278","last_deep_scrub_stamp":"2024-09-12T19:00:17.329286+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.329286+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:15.910212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1419,"num_read_kb":1187,"num_write":525,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'305","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.389191+0000","last_change":"2024-09-12T19:00:10.388940+0000","last_active":"2024-09-12T19:00:10.389191+0000","last_peered":"2024-09-12T19:00:10.389191+0000","last_clean":"2024-09-12T19:00:10.389191+0000","last_became_active":"2024-09-12T17:40:18.762421+0000","last_became_peered":"2024-09-12T17:40:18.762421+0000","last_unstale":"2024-09-12T19:00:10.389191+0000","last_undegraded":"2024-09-12T19:00:10.389191+0000","last_fullsized":"2024-09-12T19:00:10.389191+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-12T19:00:10.388665+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-12T19:00:10.388665+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.388665+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:37.537161+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":428,"num_read_kb":9963,"num_write":965,"num_write_kb":16756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.400755+0000","last_change":"2024-09-12T19:00:20.400755+0000","last_active":"2024-09-12T19:00:20.400755+0000","last_peered":"2024-09-12T19:00:20.400755+0000","last_clean":"2024-09-12T19:00:20.400755+0000","last_became_active":"2024-09-12T17:40:22.133919+0000","last_became_peered":"2024-09-12T17:40:22.133919+0000","last_unstale":"2024-09-12T19:00:20.400755+0000","last_undegraded":"2024-09-12T19:00:20.400755+0000","last_fullsized":"2024-09-12T19:00:20.400755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:20.400574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:20.400574+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.400574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:25.599834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'321","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.834473+0000","last_change":"2024-09-12T19:00:32.834473+0000","last_active":"2024-09-12T19:00:32.834473+0000","last_peered":"2024-09-12T19:00:32.834473+0000","last_clean":"2024-09-12T19:00:32.834473+0000","last_became_active":"2024-09-12T17:40:24.167870+0000","last_became_peered":"2024-09-12T17:40:24.167870+0000","last_unstale":"2024-09-12T19:00:32.834473+0000","last_undegraded":"2024-09-12T19:00:32.834473+0000","last_fullsized":"2024-09-12T19:00:32.834473+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T19:00:32.834263+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T19:00:32.834263+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.834263+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:47.433880+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50431,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":1079,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12380,"num_omap_keys":28,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.413176+0000","last_change":"2024-09-12T19:00:30.413176+0000","last_active":"2024-09-12T19:00:30.413176+0000","last_peered":"2024-09-12T19:00:30.413176+0000","last_clean":"2024-09-12T19:00:30.413176+0000","last_became_active":"2024-09-12T17:40:26.199065+0000","last_became_peered":"2024-09-12T17:40:26.199065+0000","last_unstale":"2024-09-12T19:00:30.413176+0000","last_undegraded":"2024-09-12T19:00:30.413176+0000","last_fullsized":"2024-09-12T19:00:30.413176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.412978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.412978+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.412978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:31.543757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'190","reported_seq":1097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.337413+0000","last_change":"2024-09-12T19:00:31.337413+0000","last_active":"2024-09-12T19:00:31.337413+0000","last_peered":"2024-09-12T19:00:31.337413+0000","last_clean":"2024-09-12T19:00:31.337413+0000","last_became_active":"2024-09-12T17:40:28.192588+0000","last_became_peered":"2024-09-12T17:40:28.192588+0000","last_unstale":"2024-09-12T19:00:31.337413+0000","last_undegraded":"2024-09-12T19:00:31.337413+0000","last_fullsized":"2024-09-12T19:00:31.337413+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T19:00:31.337228+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T19:00:31.337228+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.337228+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:13.419733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":737,"num_read_kb":706,"num_write":515,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'254","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.634317+0000","last_change":"2024-09-12T19:00:15.634145+0000","last_active":"2024-09-12T19:00:15.634317+0000","last_peered":"2024-09-12T19:00:15.634317+0000","last_clean":"2024-09-12T19:00:15.634317+0000","last_became_active":"2024-09-12T17:40:20.133067+0000","last_became_peered":"2024-09-12T17:40:20.133067+0000","last_unstale":"2024-09-12T19:00:15.634317+0000","last_undegraded":"2024-09-12T19:00:15.634317+0000","last_fullsized":"2024-09-12T19:00:15.634317+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'254","last_scrub_stamp":"2024-09-12T19:00:15.633957+0000","last_deep_scrub":"264'254","last_deep_scrub_stamp":"2024-09-12T19:00:15.633957+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.633957+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:24.007199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1200,"num_read_kb":1015,"num_write":444,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'349","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.743053+0000","last_change":"2024-09-12T19:00:08.742895+0000","last_active":"2024-09-12T19:00:08.743053+0000","last_peered":"2024-09-12T19:00:08.743053+0000","last_clean":"2024-09-12T19:00:08.743053+0000","last_became_active":"2024-09-12T17:40:18.773029+0000","last_became_peered":"2024-09-12T17:40:18.773029+0000","last_unstale":"2024-09-12T19:00:08.743053+0000","last_undegraded":"2024-09-12T19:00:08.743053+0000","last_fullsized":"2024-09-12T19:00:08.743053+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-12T19:00:08.742672+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-12T19:00:08.742672+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.742672+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:43.956356+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5769265,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":426,"num_read_kb":38404,"num_write":1086,"num_write_kb":31393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.951082+0000","last_change":"2024-09-12T19:00:29.951082+0000","last_active":"2024-09-12T19:00:29.951082+0000","last_peered":"2024-09-12T19:00:29.951082+0000","last_clean":"2024-09-12T19:00:29.951082+0000","last_became_active":"2024-09-12T17:40:22.145871+0000","last_became_peered":"2024-09-12T17:40:22.145871+0000","last_unstale":"2024-09-12T19:00:29.951082+0000","last_undegraded":"2024-09-12T19:00:29.951082+0000","last_fullsized":"2024-09-12T19:00:29.951082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:29.950902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:29.950902+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.950902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:28.152645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'313","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.770346+0000","last_change":"2024-09-12T19:00:31.770346+0000","last_active":"2024-09-12T19:00:31.770346+0000","last_peered":"2024-09-12T19:00:31.770346+0000","last_clean":"2024-09-12T19:00:31.770346+0000","last_became_active":"2024-09-12T17:40:24.329413+0000","last_became_peered":"2024-09-12T17:40:24.329413+0000","last_unstale":"2024-09-12T19:00:31.770346+0000","last_undegraded":"2024-09-12T19:00:31.770346+0000","last_fullsized":"2024-09-12T19:00:31.770346+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T19:00:31.770156+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T19:00:31.770156+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.770156+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:12.931738+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47334,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1206,"num_write":420,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.471670+0000","last_change":"2024-09-12T19:00:40.471475+0000","last_active":"2024-09-12T19:00:40.471670+0000","last_peered":"2024-09-12T19:00:40.471670+0000","last_clean":"2024-09-12T19:00:40.471670+0000","last_became_active":"2024-09-12T17:40:26.198930+0000","last_became_peered":"2024-09-12T17:40:26.198930+0000","last_unstale":"2024-09-12T19:00:40.471670+0000","last_undegraded":"2024-09-12T19:00:40.471670+0000","last_fullsized":"2024-09-12T19:00:40.471670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:40.471293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:40.471293+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.471293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:17.593253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'120","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.321432+0000","last_change":"2024-09-12T19:00:39.321432+0000","last_active":"2024-09-12T19:00:39.321432+0000","last_peered":"2024-09-12T19:00:39.321432+0000","last_clean":"2024-09-12T19:00:39.321432+0000","last_became_active":"2024-09-12T17:40:28.192689+0000","last_became_peered":"2024-09-12T17:40:28.192689+0000","last_unstale":"2024-09-12T19:00:39.321432+0000","last_undegraded":"2024-09-12T19:00:39.321432+0000","last_fullsized":"2024-09-12T19:00:39.321432+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T19:00:39.321187+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T19:00:39.321187+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.321187+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:00.540498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":258,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'197","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.631338+0000","last_change":"2024-09-12T19:00:09.631176+0000","last_active":"2024-09-12T19:00:09.631338+0000","last_peered":"2024-09-12T19:00:09.631338+0000","last_clean":"2024-09-12T19:00:09.631338+0000","last_became_active":"2024-09-12T17:40:20.132998+0000","last_became_peered":"2024-09-12T17:40:20.132998+0000","last_unstale":"2024-09-12T19:00:09.631338+0000","last_undegraded":"2024-09-12T19:00:09.631338+0000","last_fullsized":"2024-09-12T19:00:09.631338+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'197","last_scrub_stamp":"2024-09-12T19:00:09.630961+0000","last_deep_scrub":"264'197","last_deep_scrub_stamp":"2024-09-12T19:00:09.630961+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.630961+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:43.492350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":791,"num_read_kb":641,"num_write":284,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'452","reported_seq":1204,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.350146+0000","last_change":"2024-09-12T19:00:07.349873+0000","last_active":"2024-09-12T19:00:07.350146+0000","last_peered":"2024-09-12T19:00:07.350146+0000","last_clean":"2024-09-12T19:00:07.350146+0000","last_became_active":"2024-09-12T17:40:18.774892+0000","last_became_peered":"2024-09-12T17:40:18.774892+0000","last_unstale":"2024-09-12T19:00:07.350146+0000","last_undegraded":"2024-09-12T19:00:07.350146+0000","last_fullsized":"2024-09-12T19:00:07.350146+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'452","last_scrub_stamp":"2024-09-12T19:00:07.349511+0000","last_deep_scrub":"264'452","last_deep_scrub_stamp":"2024-09-12T19:00:07.349511+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.349511+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:27.593097+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":517958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":741,"num_read_kb":87834,"num_write":1424,"num_write_kb":30285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.305895+0000","last_change":"2024-09-12T19:00:23.305895+0000","last_active":"2024-09-12T19:00:23.305895+0000","last_peered":"2024-09-12T19:00:23.305895+0000","last_clean":"2024-09-12T19:00:23.305895+0000","last_became_active":"2024-09-12T17:40:22.141670+0000","last_became_peered":"2024-09-12T17:40:22.141670+0000","last_unstale":"2024-09-12T19:00:23.305895+0000","last_undegraded":"2024-09-12T19:00:23.305895+0000","last_fullsized":"2024-09-12T19:00:23.305895+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.305714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.305714+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.305714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:29.599014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'139","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.910715+0000","last_change":"2024-09-12T19:00:34.910582+0000","last_active":"2024-09-12T19:00:34.910715+0000","last_peered":"2024-09-12T19:00:34.910715+0000","last_clean":"2024-09-12T19:00:34.910715+0000","last_became_active":"2024-09-12T17:40:24.329446+0000","last_became_peered":"2024-09-12T17:40:24.329446+0000","last_unstale":"2024-09-12T19:00:34.910715+0000","last_undegraded":"2024-09-12T19:00:34.910715+0000","last_fullsized":"2024-09-12T19:00:34.910715+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'139","last_scrub_stamp":"2024-09-12T19:00:34.910379+0000","last_deep_scrub":"264'139","last_deep_scrub_stamp":"2024-09-12T19:00:34.910379+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.910379+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:51.726194+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'753","reported_seq":4504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.318003+0000","last_change":"2024-09-12T19:00:27.318003+0000","last_active":"2024-09-12T19:00:27.318003+0000","last_peered":"2024-09-12T19:00:27.318003+0000","last_clean":"2024-09-12T19:00:27.318003+0000","last_became_active":"2024-09-12T17:40:26.192341+0000","last_became_peered":"2024-09-12T17:40:26.192341+0000","last_unstale":"2024-09-12T19:00:27.318003+0000","last_undegraded":"2024-09-12T19:00:27.318003+0000","last_fullsized":"2024-09-12T19:00:27.318003+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'753","last_scrub_stamp":"2024-09-12T19:00:27.317824+0000","last_deep_scrub":"264'753","last_deep_scrub_stamp":"2024-09-12T19:00:27.317824+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.317824+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:00.226970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'117","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.841374+0000","last_change":"2024-09-12T19:00:37.841374+0000","last_active":"2024-09-12T19:00:37.841374+0000","last_peered":"2024-09-12T19:00:37.841374+0000","last_clean":"2024-09-12T19:00:37.841374+0000","last_became_active":"2024-09-12T17:40:28.187089+0000","last_became_peered":"2024-09-12T17:40:28.187089+0000","last_unstale":"2024-09-12T19:00:37.841374+0000","last_undegraded":"2024-09-12T19:00:37.841374+0000","last_fullsized":"2024-09-12T19:00:37.841374+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T19:00:37.841189+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T19:00:37.841189+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.841189+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:43.510128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'389","reported_seq":1142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.883979+0000","last_change":"2024-09-12T19:00:19.883704+0000","last_active":"2024-09-12T19:00:19.883979+0000","last_peered":"2024-09-12T19:00:19.883979+0000","last_clean":"2024-09-12T19:00:19.883979+0000","last_became_active":"2024-09-12T17:40:20.142478+0000","last_became_peered":"2024-09-12T17:40:20.142478+0000","last_unstale":"2024-09-12T19:00:19.883979+0000","last_undegraded":"2024-09-12T19:00:19.883979+0000","last_fullsized":"2024-09-12T19:00:19.883979+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'389","last_scrub_stamp":"2024-09-12T19:00:19.883428+0000","last_deep_scrub":"264'389","last_deep_scrub_stamp":"2024-09-12T19:00:19.883428+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.883428+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:21.623543+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1845,"num_read_kb":1583,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25754,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'344","reported_seq":1178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.599344+0000","last_change":"2024-09-12T19:00:04.599290+0000","last_active":"2024-09-12T19:00:04.599344+0000","last_peered":"2024-09-12T19:00:04.599344+0000","last_clean":"2024-09-12T19:00:04.599344+0000","last_became_active":"2024-09-12T17:40:55.330696+0000","last_became_peered":"2024-09-12T17:40:55.330696+0000","last_unstale":"2024-09-12T19:00:04.599344+0000","last_undegraded":"2024-09-12T19:00:04.599344+0000","last_fullsized":"2024-09-12T19:00:04.599344+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T19:00:04.599196+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T19:00:04.599196+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.599196+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:34.856416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35759,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":915,"num_read_kb":9625,"num_write":1190,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.944316+0000","last_change":"2024-09-12T19:00:25.944316+0000","last_active":"2024-09-12T19:00:25.944316+0000","last_peered":"2024-09-12T19:00:25.944316+0000","last_clean":"2024-09-12T19:00:25.944316+0000","last_became_active":"2024-09-12T17:40:22.151083+0000","last_became_peered":"2024-09-12T17:40:22.151083+0000","last_unstale":"2024-09-12T19:00:25.944316+0000","last_undegraded":"2024-09-12T19:00:25.944316+0000","last_fullsized":"2024-09-12T19:00:25.944316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:25.944122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:25.944122+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.944122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:30.866495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'343","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.197137+0000","last_change":"2024-09-12T19:00:35.197137+0000","last_active":"2024-09-12T19:00:35.197137+0000","last_peered":"2024-09-12T19:00:35.197137+0000","last_clean":"2024-09-12T19:00:35.197137+0000","last_became_active":"2024-09-12T17:40:24.173360+0000","last_became_peered":"2024-09-12T17:40:24.173360+0000","last_unstale":"2024-09-12T19:00:35.197137+0000","last_undegraded":"2024-09-12T19:00:35.197137+0000","last_fullsized":"2024-09-12T19:00:35.197137+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T19:00:35.196835+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T19:00:35.196835+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.196835+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:55.759104+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61671,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":561,"num_read_kb":1233,"num_write":446,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.376891+0000","last_change":"2024-09-12T19:00:34.376891+0000","last_active":"2024-09-12T19:00:34.376891+0000","last_peered":"2024-09-12T19:00:34.376891+0000","last_clean":"2024-09-12T19:00:34.376891+0000","last_became_active":"2024-09-12T17:40:26.163773+0000","last_became_peered":"2024-09-12T17:40:26.163773+0000","last_unstale":"2024-09-12T19:00:34.376891+0000","last_undegraded":"2024-09-12T19:00:34.376891+0000","last_fullsized":"2024-09-12T19:00:34.376891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.376716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.376716+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.376716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:16.630035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'105","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.816338+0000","last_change":"2024-09-12T19:00:39.816338+0000","last_active":"2024-09-12T19:00:39.816338+0000","last_peered":"2024-09-12T19:00:39.816338+0000","last_clean":"2024-09-12T19:00:39.816338+0000","last_became_active":"2024-09-12T17:40:28.198792+0000","last_became_peered":"2024-09-12T17:40:28.198792+0000","last_unstale":"2024-09-12T19:00:39.816338+0000","last_undegraded":"2024-09-12T19:00:39.816338+0000","last_fullsized":"2024-09-12T19:00:39.816338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T19:00:39.816143+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T19:00:39.816143+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.816143+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:25.653460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":239,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'185","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.805223+0000","last_change":"2024-09-12T19:00:17.804978+0000","last_active":"2024-09-12T19:00:17.805223+0000","last_peered":"2024-09-12T19:00:17.805223+0000","last_clean":"2024-09-12T19:00:17.805223+0000","last_became_active":"2024-09-12T17:40:20.136564+0000","last_became_peered":"2024-09-12T17:40:20.136564+0000","last_unstale":"2024-09-12T19:00:17.805223+0000","last_undegraded":"2024-09-12T19:00:17.805223+0000","last_fullsized":"2024-09-12T19:00:17.805223+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T19:00:17.804709+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T19:00:17.804709+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.804709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:22.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":640,"num_write":266,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'423","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.276533+0000","last_change":"2024-09-12T19:00:10.276396+0000","last_active":"2024-09-12T19:00:10.276533+0000","last_peered":"2024-09-12T19:00:10.276533+0000","last_clean":"2024-09-12T19:00:10.276533+0000","last_became_active":"2024-09-12T17:40:18.779946+0000","last_became_peered":"2024-09-12T17:40:18.779946+0000","last_unstale":"2024-09-12T19:00:10.276533+0000","last_undegraded":"2024-09-12T19:00:10.276533+0000","last_fullsized":"2024-09-12T19:00:10.276533+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'423","last_scrub_stamp":"2024-09-12T19:00:10.276179+0000","last_deep_scrub":"264'423","last_deep_scrub_stamp":"2024-09-12T19:00:10.276179+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.276179+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:31.510413+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1239867,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":711,"num_read_kb":21197,"num_write":1193,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.296054+0000","last_change":"2024-09-12T19:00:28.296054+0000","last_active":"2024-09-12T19:00:28.296054+0000","last_peered":"2024-09-12T19:00:28.296054+0000","last_clean":"2024-09-12T19:00:28.296054+0000","last_became_active":"2024-09-12T17:40:22.137291+0000","last_became_peered":"2024-09-12T17:40:22.137291+0000","last_unstale":"2024-09-12T19:00:28.296054+0000","last_undegraded":"2024-09-12T19:00:28.296054+0000","last_fullsized":"2024-09-12T19:00:28.296054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:28.295851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:28.295851+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.295851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:03.319406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'268","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.360743+0000","last_change":"2024-09-12T19:00:29.360743+0000","last_active":"2024-09-12T19:00:29.360743+0000","last_peered":"2024-09-12T19:00:29.360743+0000","last_clean":"2024-09-12T19:00:29.360743+0000","last_became_active":"2024-09-12T17:40:24.174681+0000","last_became_peered":"2024-09-12T17:40:24.174681+0000","last_unstale":"2024-09-12T19:00:29.360743+0000","last_undegraded":"2024-09-12T19:00:29.360743+0000","last_fullsized":"2024-09-12T19:00:29.360743+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'268","last_scrub_stamp":"2024-09-12T19:00:29.360510+0000","last_deep_scrub":"264'268","last_deep_scrub_stamp":"2024-09-12T19:00:29.360510+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.360510+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:44.506730+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51960,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":993,"num_write":344,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.360878+0000","last_change":"2024-09-12T19:00:26.360731+0000","last_active":"2024-09-12T19:00:26.360878+0000","last_peered":"2024-09-12T19:00:26.360878+0000","last_clean":"2024-09-12T19:00:26.360878+0000","last_became_active":"2024-09-12T17:40:26.187438+0000","last_became_peered":"2024-09-12T17:40:26.187438+0000","last_unstale":"2024-09-12T19:00:26.360878+0000","last_undegraded":"2024-09-12T19:00:26.360878+0000","last_fullsized":"2024-09-12T19:00:26.360878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.360536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.360536+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.360536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:17.085073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'126","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:50.851306+0000","last_change":"2024-09-12T19:00:50.851306+0000","last_active":"2024-09-12T19:00:50.851306+0000","last_peered":"2024-09-12T19:00:50.851306+0000","last_clean":"2024-09-12T19:00:50.851306+0000","last_became_active":"2024-09-12T17:40:28.201534+0000","last_became_peered":"2024-09-12T17:40:28.201534+0000","last_unstale":"2024-09-12T19:00:50.851306+0000","last_undegraded":"2024-09-12T19:00:50.851306+0000","last_fullsized":"2024-09-12T19:00:50.851306+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-12T19:00:50.851086+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-12T19:00:50.851086+0000","last_clean_scrub_stamp":"2024-09-12T19:00:50.851086+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:47.597084+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":291,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'52","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.612810+0000","last_change":"2024-09-12T19:00:19.612666+0000","last_active":"2024-09-12T19:00:19.612810+0000","last_peered":"2024-09-12T19:00:19.612810+0000","last_clean":"2024-09-12T19:00:19.612810+0000","last_became_active":"2024-09-12T17:40:20.117604+0000","last_became_peered":"2024-09-12T17:40:20.117604+0000","last_unstale":"2024-09-12T19:00:19.612810+0000","last_undegraded":"2024-09-12T19:00:19.612810+0000","last_fullsized":"2024-09-12T19:00:19.612810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T19:00:19.612475+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T19:00:19.612475+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.612475+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:58.666585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":67,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'333","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.706552+0000","last_change":"2024-09-12T19:00:24.706416+0000","last_active":"2024-09-12T19:00:24.706552+0000","last_peered":"2024-09-12T19:00:24.706552+0000","last_clean":"2024-09-12T19:00:24.706552+0000","last_became_active":"2024-09-12T17:40:18.767103+0000","last_became_peered":"2024-09-12T17:40:18.767103+0000","last_unstale":"2024-09-12T19:00:24.706552+0000","last_undegraded":"2024-09-12T19:00:24.706552+0000","last_fullsized":"2024-09-12T19:00:24.706552+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-12T19:00:24.706215+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-12T19:00:24.706215+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.706215+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:26.639198+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097225,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":436,"num_read_kb":34280,"num_write":1068,"num_write_kb":41945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.960509+0000","last_change":"2024-09-12T19:00:28.960509+0000","last_active":"2024-09-12T19:00:28.960509+0000","last_peered":"2024-09-12T19:00:28.960509+0000","last_clean":"2024-09-12T19:00:28.960509+0000","last_became_active":"2024-09-12T17:40:22.134242+0000","last_became_peered":"2024-09-12T17:40:22.134242+0000","last_unstale":"2024-09-12T19:00:28.960509+0000","last_undegraded":"2024-09-12T19:00:28.960509+0000","last_fullsized":"2024-09-12T19:00:28.960509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:28.960299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:28.960299+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.960299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:33.212237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'241","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.747311+0000","last_change":"2024-09-12T19:00:33.747311+0000","last_active":"2024-09-12T19:00:33.747311+0000","last_peered":"2024-09-12T19:00:33.747311+0000","last_clean":"2024-09-12T19:00:33.747311+0000","last_became_active":"2024-09-12T17:40:24.181581+0000","last_became_peered":"2024-09-12T17:40:24.181581+0000","last_unstale":"2024-09-12T19:00:33.747311+0000","last_undegraded":"2024-09-12T19:00:33.747311+0000","last_fullsized":"2024-09-12T19:00:33.747311+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'241","last_scrub_stamp":"2024-09-12T19:00:33.747120+0000","last_deep_scrub":"264'241","last_deep_scrub_stamp":"2024-09-12T19:00:33.747120+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.747120+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:35.708518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":967,"num_write":316,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.909798+0000","last_change":"2024-09-12T19:00:37.909798+0000","last_active":"2024-09-12T19:00:37.909798+0000","last_peered":"2024-09-12T19:00:37.909798+0000","last_clean":"2024-09-12T19:00:37.909798+0000","last_became_active":"2024-09-12T17:40:26.195603+0000","last_became_peered":"2024-09-12T17:40:26.195603+0000","last_unstale":"2024-09-12T19:00:37.909798+0000","last_undegraded":"2024-09-12T19:00:37.909798+0000","last_fullsized":"2024-09-12T19:00:37.909798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:37.909628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:37.909628+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.909628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:37.888689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'171","reported_seq":1293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.841114+0000","last_change":"2024-09-12T19:00:38.841114+0000","last_active":"2024-09-12T19:00:38.841114+0000","last_peered":"2024-09-12T19:00:38.841114+0000","last_clean":"2024-09-12T19:00:38.841114+0000","last_became_active":"2024-09-12T17:40:28.200126+0000","last_became_peered":"2024-09-12T17:40:28.200126+0000","last_unstale":"2024-09-12T19:00:38.841114+0000","last_undegraded":"2024-09-12T19:00:38.841114+0000","last_fullsized":"2024-09-12T19:00:38.841114+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T19:00:38.840922+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T19:00:38.840922+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.840922+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:43.048043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":872,"num_read_kb":859,"num_write":427,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'166","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.848337+0000","last_change":"2024-09-12T19:00:16.848337+0000","last_active":"2024-09-12T19:00:16.848337+0000","last_peered":"2024-09-12T19:00:16.848337+0000","last_clean":"2024-09-12T19:00:16.848337+0000","last_became_active":"2024-09-12T17:40:20.131459+0000","last_became_peered":"2024-09-12T17:40:20.131459+0000","last_unstale":"2024-09-12T19:00:16.848337+0000","last_undegraded":"2024-09-12T19:00:16.848337+0000","last_fullsized":"2024-09-12T19:00:16.848337+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T19:00:16.848164+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T19:00:16.848164+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.848164+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:33.348709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":677,"num_write":293,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'344","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.318433+0000","last_change":"2024-09-12T19:00:08.318433+0000","last_active":"2024-09-12T19:00:08.318433+0000","last_peered":"2024-09-12T19:00:08.318433+0000","last_clean":"2024-09-12T19:00:08.318433+0000","last_became_active":"2024-09-12T17:40:18.773667+0000","last_became_peered":"2024-09-12T17:40:18.773667+0000","last_unstale":"2024-09-12T19:00:08.318433+0000","last_undegraded":"2024-09-12T19:00:08.318433+0000","last_fullsized":"2024-09-12T19:00:08.318433+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T19:00:08.318197+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T19:00:08.318197+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.318197+0000","objects_scrubbed":10,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:30.683986+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263633,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":554,"num_read_kb":8714,"num_write":1079,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'6","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.294939+0000","last_change":"2024-09-12T19:00:24.294769+0000","last_active":"2024-09-12T19:00:24.294939+0000","last_peered":"2024-09-12T19:00:24.294939+0000","last_clean":"2024-09-12T19:00:24.294939+0000","last_became_active":"2024-09-12T17:40:22.141182+0000","last_became_peered":"2024-09-12T17:40:22.141182+0000","last_unstale":"2024-09-12T19:00:24.294939+0000","last_undegraded":"2024-09-12T19:00:24.294939+0000","last_fullsized":"2024-09-12T19:00:24.294939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:24.294580+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:24.294580+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.294580+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:23.277435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'310","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.937956+0000","last_change":"2024-09-12T19:00:33.937956+0000","last_active":"2024-09-12T19:00:33.937956+0000","last_peered":"2024-09-12T19:00:33.937956+0000","last_clean":"2024-09-12T19:00:33.937956+0000","last_became_active":"2024-09-12T17:40:24.166330+0000","last_became_peered":"2024-09-12T17:40:24.166330+0000","last_unstale":"2024-09-12T19:00:33.937956+0000","last_undegraded":"2024-09-12T19:00:33.937956+0000","last_fullsized":"2024-09-12T19:00:33.937956+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-12T19:00:33.937774+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-12T19:00:33.937774+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.937774+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:21.539066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51905,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1128,"num_write":400,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.318424+0000","last_change":"2024-09-12T19:00:36.318424+0000","last_active":"2024-09-12T19:00:36.318424+0000","last_peered":"2024-09-12T19:00:36.318424+0000","last_clean":"2024-09-12T19:00:36.318424+0000","last_became_active":"2024-09-12T17:40:26.188351+0000","last_became_peered":"2024-09-12T17:40:26.188351+0000","last_unstale":"2024-09-12T19:00:36.318424+0000","last_undegraded":"2024-09-12T19:00:36.318424+0000","last_fullsized":"2024-09-12T19:00:36.318424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:36.318245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:36.318245+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.318245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:56.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'140","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.889301+0000","last_change":"2024-09-12T19:00:39.889301+0000","last_active":"2024-09-12T19:00:39.889301+0000","last_peered":"2024-09-12T19:00:39.889301+0000","last_clean":"2024-09-12T19:00:39.889301+0000","last_became_active":"2024-09-12T17:40:28.180148+0000","last_became_peered":"2024-09-12T17:40:28.180148+0000","last_unstale":"2024-09-12T19:00:39.889301+0000","last_undegraded":"2024-09-12T19:00:39.889301+0000","last_fullsized":"2024-09-12T19:00:39.889301+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-12T19:00:39.889091+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-12T19:00:39.889091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.889091+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:44.717196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":171,"num_read_kb":158,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'174","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.338634+0000","last_change":"2024-09-12T19:00:19.338356+0000","last_active":"2024-09-12T19:00:19.338634+0000","last_peered":"2024-09-12T19:00:19.338634+0000","last_clean":"2024-09-12T19:00:19.338634+0000","last_became_active":"2024-09-12T17:40:20.127006+0000","last_became_peered":"2024-09-12T17:40:20.127006+0000","last_unstale":"2024-09-12T19:00:19.338634+0000","last_undegraded":"2024-09-12T19:00:19.338634+0000","last_fullsized":"2024-09-12T19:00:19.338634+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T19:00:19.338125+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T19:00:19.338125+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.338125+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:28.379386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":779,"num_read_kb":649,"num_write":260,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'327","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.432395+0000","last_change":"2024-09-12T19:00:12.432395+0000","last_active":"2024-09-12T19:00:12.432395+0000","last_peered":"2024-09-12T19:00:12.432395+0000","last_clean":"2024-09-12T19:00:12.432395+0000","last_became_active":"2024-09-12T17:40:18.757444+0000","last_became_peered":"2024-09-12T17:40:18.757444+0000","last_unstale":"2024-09-12T19:00:12.432395+0000","last_undegraded":"2024-09-12T19:00:12.432395+0000","last_fullsized":"2024-09-12T19:00:12.432395+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T19:00:12.432143+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T19:00:12.432143+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.432143+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:39.703339+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194355,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":91614,"num_write":1080,"num_write_kb":46187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'4205","reported_seq":4828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.334513+0000","last_change":"2024-09-12T19:00:17.334280+0000","last_active":"2024-09-12T19:00:17.334513+0000","last_peered":"2024-09-12T19:00:17.334513+0000","last_clean":"2024-09-12T19:00:17.334513+0000","last_became_active":"2024-09-12T17:40:20.125586+0000","last_became_peered":"2024-09-12T17:40:20.125586+0000","last_unstale":"2024-09-12T19:00:17.334513+0000","last_undegraded":"2024-09-12T19:00:17.334513+0000","last_fullsized":"2024-09-12T19:00:17.334513+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4205","last_scrub_stamp":"2024-09-12T19:00:17.334001+0000","last_deep_scrub":"264'4205","last_deep_scrub_stamp":"2024-09-12T19:00:17.334001+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.334001+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":3000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:15.949061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16904,"num_read_kb":14161,"num_write":6332,"num_write_kb":3161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'321","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.590276+0000","last_change":"2024-09-12T19:00:07.590276+0000","last_active":"2024-09-12T19:00:07.590276+0000","last_peered":"2024-09-12T19:00:07.590276+0000","last_clean":"2024-09-12T19:00:07.590276+0000","last_became_active":"2024-09-12T17:40:18.754335+0000","last_became_peered":"2024-09-12T17:40:18.754335+0000","last_unstale":"2024-09-12T19:00:07.590276+0000","last_undegraded":"2024-09-12T19:00:07.590276+0000","last_fullsized":"2024-09-12T19:00:07.590276+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T19:00:07.590095+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T19:00:07.590095+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.590095+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:24.884297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":433,"num_read_kb":13730,"num_write":1004,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'414","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.347254+0000","last_change":"2024-09-12T19:00:24.347121+0000","last_active":"2024-09-12T19:00:24.347254+0000","last_peered":"2024-09-12T19:00:24.347254+0000","last_clean":"2024-09-12T19:00:24.347254+0000","last_became_active":"2024-09-12T17:40:20.136831+0000","last_became_peered":"2024-09-12T17:40:20.136831+0000","last_unstale":"2024-09-12T19:00:24.347254+0000","last_undegraded":"2024-09-12T19:00:24.347254+0000","last_fullsized":"2024-09-12T19:00:24.347254+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-12T19:00:24.346937+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-12T19:00:24.346937+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.346937+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:09.754944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1812,"num_read_kb":1536,"num_write":694,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2875,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'341","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.271766+0000","last_change":"2024-09-12T19:00:12.271766+0000","last_active":"2024-09-12T19:00:12.271766+0000","last_peered":"2024-09-12T19:00:12.271766+0000","last_clean":"2024-09-12T19:00:12.271766+0000","last_became_active":"2024-09-12T17:40:18.753576+0000","last_became_peered":"2024-09-12T17:40:18.753576+0000","last_unstale":"2024-09-12T19:00:12.271766+0000","last_undegraded":"2024-09-12T19:00:12.271766+0000","last_fullsized":"2024-09-12T19:00:12.271766+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T19:00:12.271560+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T19:00:12.271560+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.271560+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:34.437310+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":449,"num_read_kb":36529,"num_write":1017,"num_write_kb":32314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'363","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.372056+0000","last_change":"2024-09-12T19:00:20.371890+0000","last_active":"2024-09-12T19:00:20.372056+0000","last_peered":"2024-09-12T19:00:20.372056+0000","last_clean":"2024-09-12T19:00:20.372056+0000","last_became_active":"2024-09-12T17:40:20.132826+0000","last_became_peered":"2024-09-12T17:40:20.132826+0000","last_unstale":"2024-09-12T19:00:20.372056+0000","last_undegraded":"2024-09-12T19:00:20.372056+0000","last_fullsized":"2024-09-12T19:00:20.372056+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-12T19:00:20.371710+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-12T19:00:20.371710+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.371710+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:53.712192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1596,"num_read_kb":1285,"num_write":598,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'350","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.351167+0000","last_change":"2024-09-12T19:00:09.351167+0000","last_active":"2024-09-12T19:00:09.351167+0000","last_peered":"2024-09-12T19:00:09.351167+0000","last_clean":"2024-09-12T19:00:09.351167+0000","last_became_active":"2024-09-12T17:40:18.754933+0000","last_became_peered":"2024-09-12T17:40:18.754933+0000","last_unstale":"2024-09-12T19:00:09.351167+0000","last_undegraded":"2024-09-12T19:00:09.351167+0000","last_fullsized":"2024-09-12T19:00:09.351167+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T19:00:09.350866+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T19:00:09.350866+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.350866+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:40.151355+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081897,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":46825,"num_write":1040,"num_write_kb":45673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'114","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.622228+0000","last_change":"2024-09-12T19:00:17.622228+0000","last_active":"2024-09-12T19:00:17.622228+0000","last_peered":"2024-09-12T19:00:17.622228+0000","last_clean":"2024-09-12T19:00:17.622228+0000","last_became_active":"2024-09-12T17:40:20.129769+0000","last_became_peered":"2024-09-12T17:40:20.129769+0000","last_unstale":"2024-09-12T19:00:17.622228+0000","last_undegraded":"2024-09-12T19:00:17.622228+0000","last_fullsized":"2024-09-12T19:00:17.622228+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T19:00:17.622030+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T19:00:17.622030+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.622030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:54.615405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":414,"num_write":175,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'356","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.690197+0000","last_change":"2024-09-12T19:00:10.690017+0000","last_active":"2024-09-12T19:00:10.690197+0000","last_peered":"2024-09-12T19:00:10.690197+0000","last_clean":"2024-09-12T19:00:10.690197+0000","last_became_active":"2024-09-12T17:40:18.773052+0000","last_became_peered":"2024-09-12T17:40:18.773052+0000","last_unstale":"2024-09-12T19:00:10.690197+0000","last_undegraded":"2024-09-12T19:00:10.690197+0000","last_fullsized":"2024-09-12T19:00:10.690197+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T19:00:10.689810+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T19:00:10.689810+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.689810+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:54.998455+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2648214,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":619,"num_read_kb":23542,"num_write":1059,"num_write_kb":26208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'141","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.828290+0000","last_change":"2024-09-12T19:00:18.828290+0000","last_active":"2024-09-12T19:00:18.828290+0000","last_peered":"2024-09-12T19:00:18.828290+0000","last_clean":"2024-09-12T19:00:18.828290+0000","last_became_active":"2024-09-12T17:40:20.146835+0000","last_became_peered":"2024-09-12T17:40:20.146835+0000","last_unstale":"2024-09-12T19:00:18.828290+0000","last_undegraded":"2024-09-12T19:00:18.828290+0000","last_fullsized":"2024-09-12T19:00:18.828290+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T19:00:18.828089+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T19:00:18.828089+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.828089+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:42.635478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":516,"num_write":222,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'452","reported_seq":1235,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.396589+0000","last_change":"2024-09-12T19:00:08.396458+0000","last_active":"2024-09-12T19:00:08.396589+0000","last_peered":"2024-09-12T19:00:08.396589+0000","last_clean":"2024-09-12T19:00:08.396589+0000","last_became_active":"2024-09-12T17:40:18.764545+0000","last_became_peered":"2024-09-12T17:40:18.764545+0000","last_unstale":"2024-09-12T19:00:08.396589+0000","last_undegraded":"2024-09-12T19:00:08.396589+0000","last_fullsized":"2024-09-12T19:00:08.396589+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'452","last_scrub_stamp":"2024-09-12T19:00:08.396245+0000","last_deep_scrub":"264'452","last_deep_scrub_stamp":"2024-09-12T19:00:08.396245+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.396245+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:44.809947+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263245,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":913,"num_read_kb":25412,"num_write":1371,"num_write_kb":29284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'206","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.666116+0000","last_change":"2024-09-12T19:00:23.666116+0000","last_active":"2024-09-12T19:00:23.666116+0000","last_peered":"2024-09-12T19:00:23.666116+0000","last_clean":"2024-09-12T19:00:23.666116+0000","last_became_active":"2024-09-12T17:40:20.133055+0000","last_became_peered":"2024-09-12T17:40:20.133055+0000","last_unstale":"2024-09-12T19:00:23.666116+0000","last_undegraded":"2024-09-12T19:00:23.666116+0000","last_fullsized":"2024-09-12T19:00:23.666116+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T19:00:23.665932+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T19:00:23.665932+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.665932+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:04.141641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":974,"num_read_kb":794,"num_write":355,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'338","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.422529+0000","last_change":"2024-09-12T19:00:08.422287+0000","last_active":"2024-09-12T19:00:08.422529+0000","last_peered":"2024-09-12T19:00:08.422529+0000","last_clean":"2024-09-12T19:00:08.422529+0000","last_became_active":"2024-09-12T17:40:18.764658+0000","last_became_peered":"2024-09-12T17:40:18.764658+0000","last_unstale":"2024-09-12T19:00:08.422529+0000","last_undegraded":"2024-09-12T19:00:08.422529+0000","last_fullsized":"2024-09-12T19:00:08.422529+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T19:00:08.421985+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T19:00:08.421985+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.421985+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:05.651015+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4856534,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":14122,"num_write":1065,"num_write_kb":26720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'195","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.424693+0000","last_change":"2024-09-12T19:00:17.424693+0000","last_active":"2024-09-12T19:00:17.424693+0000","last_peered":"2024-09-12T19:00:17.424693+0000","last_clean":"2024-09-12T19:00:17.424693+0000","last_became_active":"2024-09-12T17:40:20.124247+0000","last_became_peered":"2024-09-12T17:40:20.124247+0000","last_unstale":"2024-09-12T19:00:17.424693+0000","last_undegraded":"2024-09-12T19:00:17.424693+0000","last_fullsized":"2024-09-12T19:00:17.424693+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T19:00:17.424514+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T19:00:17.424514+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.424514+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:47.443716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":903,"num_read_kb":737,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'372","reported_seq":1062,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.719139+0000","last_change":"2024-09-12T19:00:09.718958+0000","last_active":"2024-09-12T19:00:09.719139+0000","last_peered":"2024-09-12T19:00:09.719139+0000","last_clean":"2024-09-12T19:00:09.719139+0000","last_became_active":"2024-09-12T17:40:18.772776+0000","last_became_peered":"2024-09-12T17:40:18.772776+0000","last_unstale":"2024-09-12T19:00:09.719139+0000","last_undegraded":"2024-09-12T19:00:09.719139+0000","last_fullsized":"2024-09-12T19:00:09.719139+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T19:00:09.718726+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T19:00:09.718726+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.718726+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:59.239489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":25353,"num_write":1144,"num_write_kb":19697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'233","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.362881+0000","last_change":"2024-09-12T19:00:19.362881+0000","last_active":"2024-09-12T19:00:19.362881+0000","last_peered":"2024-09-12T19:00:19.362881+0000","last_clean":"2024-09-12T19:00:19.362881+0000","last_became_active":"2024-09-12T17:40:20.116064+0000","last_became_peered":"2024-09-12T17:40:20.116064+0000","last_unstale":"2024-09-12T19:00:19.362881+0000","last_undegraded":"2024-09-12T19:00:19.362881+0000","last_fullsized":"2024-09-12T19:00:19.362881+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-12T19:00:19.362701+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-12T19:00:19.362701+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.362701+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:26.580777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1004,"num_read_kb":824,"num_write":355,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'342","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.289653+0000","last_change":"2024-09-12T19:00:13.289501+0000","last_active":"2024-09-12T19:00:13.289653+0000","last_peered":"2024-09-12T19:00:13.289653+0000","last_clean":"2024-09-12T19:00:13.289653+0000","last_became_active":"2024-09-12T17:40:18.753693+0000","last_became_peered":"2024-09-12T17:40:18.753693+0000","last_unstale":"2024-09-12T19:00:13.289653+0000","last_undegraded":"2024-09-12T19:00:13.289653+0000","last_fullsized":"2024-09-12T19:00:13.289653+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-12T19:00:13.289299+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-12T19:00:13.289299+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.289299+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:49.965185+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194334,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":459,"num_read_kb":12118,"num_write":1082,"num_write_kb":50446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'82","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.817953+0000","last_change":"2024-09-12T19:00:21.817953+0000","last_active":"2024-09-12T19:00:21.817953+0000","last_peered":"2024-09-12T19:00:21.817953+0000","last_clean":"2024-09-12T19:00:21.817953+0000","last_became_active":"2024-09-12T17:40:20.129687+0000","last_became_peered":"2024-09-12T17:40:20.129687+0000","last_unstale":"2024-09-12T19:00:21.817953+0000","last_undegraded":"2024-09-12T19:00:21.817953+0000","last_fullsized":"2024-09-12T19:00:21.817953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'82","last_scrub_stamp":"2024-09-12T19:00:21.817743+0000","last_deep_scrub":"264'82","last_deep_scrub_stamp":"2024-09-12T19:00:21.817743+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.817743+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:53.779281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":302,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'397","reported_seq":1045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.744811+0000","last_change":"2024-09-12T19:00:27.744811+0000","last_active":"2024-09-12T19:00:27.744811+0000","last_peered":"2024-09-12T19:00:27.744811+0000","last_clean":"2024-09-12T19:00:27.744811+0000","last_became_active":"2024-09-12T17:40:18.772969+0000","last_became_peered":"2024-09-12T17:40:18.772969+0000","last_unstale":"2024-09-12T19:00:27.744811+0000","last_undegraded":"2024-09-12T19:00:27.744811+0000","last_fullsized":"2024-09-12T19:00:27.744811+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:27.744590+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:27.744590+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.744590+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:39.153902+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242937,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":478,"num_read_kb":13353,"num_write":1113,"num_write_kb":30519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'211","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.609423+0000","last_change":"2024-09-12T19:00:13.609423+0000","last_active":"2024-09-12T19:00:13.609423+0000","last_peered":"2024-09-12T19:00:13.609423+0000","last_clean":"2024-09-12T19:00:13.609423+0000","last_became_active":"2024-09-12T17:40:20.130606+0000","last_became_peered":"2024-09-12T17:40:20.130606+0000","last_unstale":"2024-09-12T19:00:13.609423+0000","last_undegraded":"2024-09-12T19:00:13.609423+0000","last_fullsized":"2024-09-12T19:00:13.609423+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T19:00:13.609244+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T19:00:13.609244+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.609244+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:10.927640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":765,"num_write":331,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'361","reported_seq":1143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.290572+0000","last_change":"2024-09-12T19:00:14.290572+0000","last_active":"2024-09-12T19:00:14.290572+0000","last_peered":"2024-09-12T19:00:14.290572+0000","last_clean":"2024-09-12T19:00:14.290572+0000","last_became_active":"2024-09-12T17:40:18.780861+0000","last_became_peered":"2024-09-12T17:40:18.780861+0000","last_unstale":"2024-09-12T19:00:14.290572+0000","last_undegraded":"2024-09-12T19:00:14.290572+0000","last_fullsized":"2024-09-12T19:00:14.290572+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-12T19:00:14.290350+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-12T19:00:14.290350+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.290350+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:52.086504+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747960,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":883,"num_read_kb":18830,"num_write":1183,"num_write_kb":42628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'422","reported_seq":1188,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.862014+0000","last_change":"2024-09-12T19:00:20.862014+0000","last_active":"2024-09-12T19:00:20.862014+0000","last_peered":"2024-09-12T19:00:20.862014+0000","last_clean":"2024-09-12T19:00:20.862014+0000","last_became_active":"2024-09-12T17:40:20.149176+0000","last_became_peered":"2024-09-12T17:40:20.149176+0000","last_unstale":"2024-09-12T19:00:20.862014+0000","last_undegraded":"2024-09-12T19:00:20.862014+0000","last_fullsized":"2024-09-12T19:00:20.862014+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'422","last_scrub_stamp":"2024-09-12T19:00:20.861788+0000","last_deep_scrub":"264'422","last_deep_scrub_stamp":"2024-09-12T19:00:20.861788+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.861788+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:54.694114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2034,"num_read_kb":1768,"num_write":658,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'346","reported_seq":1036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.360750+0000","last_change":"2024-09-12T19:00:10.360750+0000","last_active":"2024-09-12T19:00:10.360750+0000","last_peered":"2024-09-12T19:00:10.360750+0000","last_clean":"2024-09-12T19:00:10.360750+0000","last_became_active":"2024-09-12T17:40:18.781543+0000","last_became_peered":"2024-09-12T17:40:18.781543+0000","last_unstale":"2024-09-12T19:00:10.360750+0000","last_undegraded":"2024-09-12T19:00:10.360750+0000","last_fullsized":"2024-09-12T19:00:10.360750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-12T19:00:10.360515+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-12T19:00:10.360515+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.360515+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:06.783092+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457569,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":553,"num_read_kb":27146,"num_write":1120,"num_write_kb":17169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'186","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.911553+0000","last_change":"2024-09-12T19:00:21.911553+0000","last_active":"2024-09-12T19:00:21.911553+0000","last_peered":"2024-09-12T19:00:21.911553+0000","last_clean":"2024-09-12T19:00:21.911553+0000","last_became_active":"2024-09-12T17:40:20.132914+0000","last_became_peered":"2024-09-12T17:40:20.132914+0000","last_unstale":"2024-09-12T19:00:21.911553+0000","last_undegraded":"2024-09-12T19:00:21.911553+0000","last_fullsized":"2024-09-12T19:00:21.911553+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-12T19:00:21.911343+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-12T19:00:21.911343+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.911343+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:50.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":685,"num_write":286,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'422","reported_seq":1145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.381965+0000","last_change":"2024-09-12T19:00:09.381965+0000","last_active":"2024-09-12T19:00:09.381965+0000","last_peered":"2024-09-12T19:00:09.381965+0000","last_clean":"2024-09-12T19:00:09.381965+0000","last_became_active":"2024-09-12T17:40:18.773572+0000","last_became_peered":"2024-09-12T17:40:18.773572+0000","last_unstale":"2024-09-12T19:00:09.381965+0000","last_undegraded":"2024-09-12T19:00:09.381965+0000","last_fullsized":"2024-09-12T19:00:09.381965+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'422","last_scrub_stamp":"2024-09-12T19:00:09.381751+0000","last_deep_scrub":"264'422","last_deep_scrub_stamp":"2024-09-12T19:00:09.381751+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.381751+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:32.068671+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":27791,"num_write":1413,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'107","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.338332+0000","last_change":"2024-09-12T19:00:18.338332+0000","last_active":"2024-09-12T19:00:18.338332+0000","last_peered":"2024-09-12T19:00:18.338332+0000","last_clean":"2024-09-12T19:00:18.338332+0000","last_became_active":"2024-09-12T17:40:20.124905+0000","last_became_peered":"2024-09-12T17:40:20.124905+0000","last_unstale":"2024-09-12T19:00:18.338332+0000","last_undegraded":"2024-09-12T19:00:18.338332+0000","last_fullsized":"2024-09-12T19:00:18.338332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T19:00:18.338034+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T19:00:18.338034+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.338034+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:10.384014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":441,"num_write":144,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'398","reported_seq":1116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.920289+0000","last_change":"2024-09-12T19:00:15.920289+0000","last_active":"2024-09-12T19:00:15.920289+0000","last_peered":"2024-09-12T19:00:15.920289+0000","last_clean":"2024-09-12T19:00:15.920289+0000","last_became_active":"2024-09-12T17:40:18.776865+0000","last_became_peered":"2024-09-12T17:40:18.776865+0000","last_unstale":"2024-09-12T19:00:15.920289+0000","last_undegraded":"2024-09-12T19:00:15.920289+0000","last_fullsized":"2024-09-12T19:00:15.920289+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-12T19:00:15.920038+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-12T19:00:15.920038+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.920038+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:26.024841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":2000,"num_write":1257,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'104","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.745170+0000","last_change":"2024-09-12T19:00:29.745170+0000","last_active":"2024-09-12T19:00:29.745170+0000","last_peered":"2024-09-12T19:00:29.745170+0000","last_clean":"2024-09-12T19:00:29.745170+0000","last_became_active":"2024-09-12T17:40:20.119036+0000","last_became_peered":"2024-09-12T17:40:20.119036+0000","last_unstale":"2024-09-12T19:00:29.745170+0000","last_undegraded":"2024-09-12T19:00:29.745170+0000","last_fullsized":"2024-09-12T19:00:29.745170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'104","last_scrub_stamp":"2024-09-12T19:00:29.744980+0000","last_deep_scrub":"264'104","last_deep_scrub_stamp":"2024-09-12T19:00:29.744980+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.744980+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:13.725787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":455,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'498","reported_seq":1210,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.639674+0000","last_change":"2024-09-12T19:00:08.639674+0000","last_active":"2024-09-12T19:00:08.639674+0000","last_peered":"2024-09-12T19:00:08.639674+0000","last_clean":"2024-09-12T19:00:08.639674+0000","last_became_active":"2024-09-12T17:40:18.768688+0000","last_became_peered":"2024-09-12T17:40:18.768688+0000","last_unstale":"2024-09-12T19:00:08.639674+0000","last_undegraded":"2024-09-12T19:00:08.639674+0000","last_fullsized":"2024-09-12T19:00:08.639674+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'498","last_scrub_stamp":"2024-09-12T19:00:08.639435+0000","last_deep_scrub":"264'498","last_deep_scrub_stamp":"2024-09-12T19:00:08.639435+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.639435+0000","objects_scrubbed":10,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:14.008750+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1574987,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":867,"num_read_kb":49769,"num_write":1400,"num_write_kb":26119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'160","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.913144+0000","last_change":"2024-09-12T19:00:19.912993+0000","last_active":"2024-09-12T19:00:19.913144+0000","last_peered":"2024-09-12T19:00:19.913144+0000","last_clean":"2024-09-12T19:00:19.913144+0000","last_became_active":"2024-09-12T17:40:20.132698+0000","last_became_peered":"2024-09-12T17:40:20.132698+0000","last_unstale":"2024-09-12T19:00:19.913144+0000","last_undegraded":"2024-09-12T19:00:19.913144+0000","last_fullsized":"2024-09-12T19:00:19.913144+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'160","last_scrub_stamp":"2024-09-12T19:00:19.912805+0000","last_deep_scrub":"264'160","last_deep_scrub_stamp":"2024-09-12T19:00:19.912805+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.912805+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:29.782789+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":512,"num_write":259,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'360","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.274101+0000","last_change":"2024-09-12T19:00:15.274101+0000","last_active":"2024-09-12T19:00:15.274101+0000","last_peered":"2024-09-12T19:00:15.274101+0000","last_clean":"2024-09-12T19:00:15.274101+0000","last_became_active":"2024-09-12T17:40:18.784024+0000","last_became_peered":"2024-09-12T17:40:18.784024+0000","last_unstale":"2024-09-12T19:00:15.274101+0000","last_undegraded":"2024-09-12T19:00:15.274101+0000","last_fullsized":"2024-09-12T19:00:15.274101+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-12T19:00:15.273885+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-12T19:00:15.273885+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.273885+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:38.508212+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506065,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":13540,"num_write":1118,"num_write_kb":25363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'385","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.627938+0000","last_change":"2024-09-12T19:00:06.627843+0000","last_active":"2024-09-12T19:00:06.627938+0000","last_peered":"2024-09-12T19:00:06.627938+0000","last_clean":"2024-09-12T19:00:06.627938+0000","last_became_active":"2024-09-12T17:40:55.331839+0000","last_became_peered":"2024-09-12T17:40:55.331839+0000","last_unstale":"2024-09-12T19:00:06.627938+0000","last_undegraded":"2024-09-12T19:00:06.627938+0000","last_fullsized":"2024-09-12T19:00:06.627938+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T19:00:06.627706+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T19:00:06.627706+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.627706+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:52.807717+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":31466,"num_write":1073,"num_write_kb":39606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'70","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.316844+0000","last_change":"2024-09-12T19:00:20.316695+0000","last_active":"2024-09-12T19:00:20.316844+0000","last_peered":"2024-09-12T19:00:20.316844+0000","last_clean":"2024-09-12T19:00:20.316844+0000","last_became_active":"2024-09-12T17:40:20.116230+0000","last_became_peered":"2024-09-12T17:40:20.116230+0000","last_unstale":"2024-09-12T19:00:20.316844+0000","last_undegraded":"2024-09-12T19:00:20.316844+0000","last_fullsized":"2024-09-12T19:00:20.316844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'70","last_scrub_stamp":"2024-09-12T19:00:20.316504+0000","last_deep_scrub":"264'70","last_deep_scrub_stamp":"2024-09-12T19:00:20.316504+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.316504+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:02.569846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":294,"num_write":113,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'391","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.415348+0000","last_change":"2024-09-12T19:00:11.415348+0000","last_active":"2024-09-12T19:00:11.415348+0000","last_peered":"2024-09-12T19:00:11.415348+0000","last_clean":"2024-09-12T19:00:11.415348+0000","last_became_active":"2024-09-12T17:40:18.774332+0000","last_became_peered":"2024-09-12T17:40:18.774332+0000","last_unstale":"2024-09-12T19:00:11.415348+0000","last_undegraded":"2024-09-12T19:00:11.415348+0000","last_fullsized":"2024-09-12T19:00:11.415348+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'391","last_scrub_stamp":"2024-09-12T19:00:11.415109+0000","last_deep_scrub":"264'391","last_deep_scrub_stamp":"2024-09-12T19:00:11.415109+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.415109+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:08.336481+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482012,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":8119,"num_write":1461,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'266","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.311756+0000","last_change":"2024-09-12T19:00:21.311756+0000","last_active":"2024-09-12T19:00:21.311756+0000","last_peered":"2024-09-12T19:00:21.311756+0000","last_clean":"2024-09-12T19:00:21.311756+0000","last_became_active":"2024-09-12T17:40:20.112521+0000","last_became_peered":"2024-09-12T17:40:20.112521+0000","last_unstale":"2024-09-12T19:00:21.311756+0000","last_undegraded":"2024-09-12T19:00:21.311756+0000","last_fullsized":"2024-09-12T19:00:21.311756+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T19:00:21.311545+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T19:00:21.311545+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.311545+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.668351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1090,"num_read_kb":887,"num_write":395,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5850,"num_read_kb":4138,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9425,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1013,"ondisk_log_size":1013,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16272,"num_read_kb":15940,"num_write":16723,"num_write_kb":4884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1847,"ondisk_log_size":1847,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":493,"ondisk_log_size":493,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1567416,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":19029,"num_read_kb":39666,"num_write":15931,"num_write_kb":12049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":682050,"num_omap_keys":1558,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1833,"ondisk_log_size":1833,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103249,"num_read_kb":86122,"num_write":37396,"num_write_kb":18900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44332,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3961,"ondisk_log_size":3961,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":156029425,"num_objects":414,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":414,"num_whiteouts":0,"num_read":36445,"num_read_kb":1876664,"num_write":72236,"num_write_kb":2152272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":313376768,"data_stored":312058850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3611,"ondisk_log_size":3611,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":197405,"num_write":186,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":186093,"num_write":186,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510417,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308820,"kb_used_data":52740,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94063020,"statfs":{"total":96636764160,"available":96320532480,"internally_reserved":0,"allocated":54005760,"data_stored":52302612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":262207946},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510417,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261840,"kb_used_data":27968,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94110000,"statfs":{"total":96636764160,"available":96368640000,"internally_reserved":0,"allocated":28639232,"data_stored":27005259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510416,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140380,"kb_used_data":41228,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94231460,"statfs":{"total":96636764160,"available":96493015040,"internally_reserved":0,"allocated":42217472,"data_stored":40481962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510417,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121988,"kb_used_data":46388,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94249852,"statfs":{"total":96636764160,"available":96511848448,"internally_reserved":0,"allocated":47501312,"data_stored":45836760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510415,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303104,"kb_used_data":51184,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94068736,"statfs":{"total":96636764160,"available":96326385664,"internally_reserved":0,"allocated":52412416,"data_stored":50705649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510415,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133100,"kb_used_data":29788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94238740,"statfs":{"total":96636764160,"available":96500469760,"internally_reserved":0,"allocated":30502912,"data_stored":28881998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510417,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272500,"kb_used_data":56676,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94099340,"statfs":{"total":96636764160,"available":96357724160,"internally_reserved":0,"allocated":58036224,"data_stored":56286500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575824,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110860,"kb_used_data":29756,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94260980,"statfs":{"total":96636764160,"available":96523243520,"internally_reserved":0,"allocated":30470144,"data_stored":28895816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":83032520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53760000,"data_stored":53550290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26857472,"data_stored":26738240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26849280,"data_stored":26750445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48742400,"data_stored":48559608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":43892736,"data_stored":43694024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":38510592,"data_stored":38336597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25014272,"data_stored":24861531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49750016,"data_stored":49568115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:01:08.099 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:01:08.099 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:59:41.963373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=59, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:01:08.099 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:01:08.099 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:01:08.100 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:01:08.100 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:01:08.100 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:01:08.101 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:19:56.803597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=0, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:01:08.105 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:01:28.106 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:01:28.465 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-12T19:01:28.482 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-09-12T19:01:28.494 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":2700,"stamp":"2024-09-12T19:01:27.382582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158204416,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":183664,"num_read_kb":2408959,"num_write":144741,"num_write_kb":2446021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":739618,"num_omap_keys":1785,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13119,"ondisk_log_size":13119,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1652592,"kb_used_data":335728,"kb_used_omap":12,"kb_used_meta":1316723,"kb_avail":753322128,"statfs":{"total":773094113280,"available":771401859072,"internally_reserved":0,"allocated":343785472,"data_stored":330396556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1348324915},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007935"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:52.143113+0000","last_change":"2024-09-12T19:00:52.143113+0000","last_active":"2024-09-12T19:00:52.143113+0000","last_peered":"2024-09-12T19:00:52.143113+0000","last_clean":"2024-09-12T19:00:52.143113+0000","last_became_active":"2024-09-12T18:19:57.853375+0000","last_became_peered":"2024-09-12T18:19:57.853375+0000","last_unstale":"2024-09-12T19:00:52.143113+0000","last_undegraded":"2024-09-12T19:00:52.143113+0000","last_fullsized":"2024-09-12T19:00:52.143113+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:52.142932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:52.142932+0000","last_clean_scrub_stamp":"2024-09-12T19:00:52.142932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:37.656070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:49.179492+0000","last_change":"2024-09-12T19:00:49.179492+0000","last_active":"2024-09-12T19:00:49.179492+0000","last_peered":"2024-09-12T19:00:49.179492+0000","last_clean":"2024-09-12T19:00:49.179492+0000","last_became_active":"2024-09-12T17:59:43.010854+0000","last_became_peered":"2024-09-12T17:59:43.010854+0000","last_unstale":"2024-09-12T19:00:49.179492+0000","last_undegraded":"2024-09-12T19:00:49.179492+0000","last_fullsized":"2024-09-12T19:00:49.179492+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:49.179284+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:49.179284+0000","last_clean_scrub_stamp":"2024-09-12T19:00:49.179284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:40.599701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:51.871562+0000","last_change":"2024-09-12T19:00:51.871562+0000","last_active":"2024-09-12T19:00:51.871562+0000","last_peered":"2024-09-12T19:00:51.871562+0000","last_clean":"2024-09-12T19:00:51.871562+0000","last_became_active":"2024-09-12T17:59:38.987739+0000","last_became_peered":"2024-09-12T17:59:38.987739+0000","last_unstale":"2024-09-12T19:00:51.871562+0000","last_undegraded":"2024-09-12T19:00:51.871562+0000","last_fullsized":"2024-09-12T19:00:51.871562+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:51.871273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:51.871273+0000","last_clean_scrub_stamp":"2024-09-12T19:00:51.871273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:55.840848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'44","reported_seq":193,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.265254+0000","last_change":"2024-09-12T19:00:48.265254+0000","last_active":"2024-09-12T19:00:48.265254+0000","last_peered":"2024-09-12T19:00:48.265254+0000","last_clean":"2024-09-12T19:00:48.265254+0000","last_became_active":"2024-09-12T17:55:59.358302+0000","last_became_peered":"2024-09-12T17:55:59.358302+0000","last_unstale":"2024-09-12T19:00:48.265254+0000","last_undegraded":"2024-09-12T19:00:48.265254+0000","last_fullsized":"2024-09-12T19:00:48.265254+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T19:00:48.265064+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T19:00:48.265064+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.265064+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:02.881099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":154,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.602712+0000","last_change":"2024-09-12T19:00:34.602712+0000","last_active":"2024-09-12T19:00:34.602712+0000","last_peered":"2024-09-12T19:00:34.602712+0000","last_clean":"2024-09-12T19:00:34.602712+0000","last_became_active":"2024-09-12T18:19:57.838918+0000","last_became_peered":"2024-09-12T18:19:57.838918+0000","last_unstale":"2024-09-12T19:00:34.602712+0000","last_undegraded":"2024-09-12T19:00:34.602712+0000","last_fullsized":"2024-09-12T19:00:34.602712+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.602418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.602418+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.602418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:58.606445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:53.797406+0000","last_change":"2024-09-12T19:00:53.797406+0000","last_active":"2024-09-12T19:00:53.797406+0000","last_peered":"2024-09-12T19:00:53.797406+0000","last_clean":"2024-09-12T19:00:53.797406+0000","last_became_active":"2024-09-12T17:59:43.005733+0000","last_became_peered":"2024-09-12T17:59:43.005733+0000","last_unstale":"2024-09-12T19:00:53.797406+0000","last_undegraded":"2024-09-12T19:00:53.797406+0000","last_fullsized":"2024-09-12T19:00:53.797406+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:53.797230+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:53.797230+0000","last_clean_scrub_stamp":"2024-09-12T19:00:53.797230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:34.439903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'8","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.448440+0000","last_change":"2024-09-12T19:00:35.448440+0000","last_active":"2024-09-12T19:00:35.448440+0000","last_peered":"2024-09-12T19:00:35.448440+0000","last_clean":"2024-09-12T19:00:35.448440+0000","last_became_active":"2024-09-12T17:59:38.989854+0000","last_became_peered":"2024-09-12T17:59:38.989854+0000","last_unstale":"2024-09-12T19:00:35.448440+0000","last_undegraded":"2024-09-12T19:00:35.448440+0000","last_fullsized":"2024-09-12T19:00:35.448440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T19:00:35.448258+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T19:00:35.448258+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.448258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.753556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8763,"num_write":8,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'34","reported_seq":165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.644434+0000","last_change":"2024-09-12T19:00:26.644434+0000","last_active":"2024-09-12T19:00:26.644434+0000","last_peered":"2024-09-12T19:00:26.644434+0000","last_clean":"2024-09-12T19:00:26.644434+0000","last_became_active":"2024-09-12T17:55:59.367426+0000","last_became_peered":"2024-09-12T17:55:59.367426+0000","last_unstale":"2024-09-12T19:00:26.644434+0000","last_undegraded":"2024-09-12T19:00:26.644434+0000","last_fullsized":"2024-09-12T19:00:26.644434+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-12T19:00:26.644251+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-12T19:00:26.644251+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.644251+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:22.784901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":114,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.301014+0000","last_change":"2024-09-12T19:00:43.300784+0000","last_active":"2024-09-12T19:00:43.301014+0000","last_peered":"2024-09-12T19:00:43.301014+0000","last_clean":"2024-09-12T19:00:43.301014+0000","last_became_active":"2024-09-12T18:19:57.848735+0000","last_became_peered":"2024-09-12T18:19:57.848735+0000","last_unstale":"2024-09-12T19:00:43.301014+0000","last_undegraded":"2024-09-12T19:00:43.301014+0000","last_fullsized":"2024-09-12T19:00:43.301014+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:43.300572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:43.300572+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.300572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:37.373507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:59.048494+0000","last_change":"2024-09-12T19:00:59.048494+0000","last_active":"2024-09-12T19:00:59.048494+0000","last_peered":"2024-09-12T19:00:59.048494+0000","last_clean":"2024-09-12T19:00:59.048494+0000","last_became_active":"2024-09-12T17:59:43.011603+0000","last_became_peered":"2024-09-12T17:59:43.011603+0000","last_unstale":"2024-09-12T19:00:59.048494+0000","last_undegraded":"2024-09-12T19:00:59.048494+0000","last_fullsized":"2024-09-12T19:00:59.048494+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:00:59.048294+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:00:59.048294+0000","last_clean_scrub_stamp":"2024-09-12T19:00:59.048294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:16.558431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.598570+0000","last_change":"2024-09-12T19:00:30.598570+0000","last_active":"2024-09-12T19:00:30.598570+0000","last_peered":"2024-09-12T19:00:30.598570+0000","last_clean":"2024-09-12T19:00:30.598570+0000","last_became_active":"2024-09-12T17:59:38.984980+0000","last_became_peered":"2024-09-12T17:59:38.984980+0000","last_unstale":"2024-09-12T19:00:30.598570+0000","last_undegraded":"2024-09-12T19:00:30.598570+0000","last_fullsized":"2024-09-12T19:00:30.598570+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.598387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.598387+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.598387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.429276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'15","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.322556+0000","last_change":"2024-09-12T19:00:46.322377+0000","last_active":"2024-09-12T19:00:46.322556+0000","last_peered":"2024-09-12T19:00:46.322556+0000","last_clean":"2024-09-12T19:00:46.322556+0000","last_became_active":"2024-09-12T17:55:59.356144+0000","last_became_peered":"2024-09-12T17:55:59.356144+0000","last_unstale":"2024-09-12T19:00:46.322556+0000","last_undegraded":"2024-09-12T19:00:46.322556+0000","last_fullsized":"2024-09-12T19:00:46.322556+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-09-12T19:00:46.322189+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-09-12T19:00:46.322189+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.322189+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:03.365571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:02.833784+0000","last_change":"2024-09-12T19:01:02.833613+0000","last_active":"2024-09-12T19:01:02.833784+0000","last_peered":"2024-09-12T19:01:02.833784+0000","last_clean":"2024-09-12T19:01:02.833784+0000","last_became_active":"2024-09-12T18:19:57.860464+0000","last_became_peered":"2024-09-12T18:19:57.860464+0000","last_unstale":"2024-09-12T19:01:02.833784+0000","last_undegraded":"2024-09-12T19:01:02.833784+0000","last_fullsized":"2024-09-12T19:01:02.833784+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:01:02.833419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:01:02.833419+0000","last_clean_scrub_stamp":"2024-09-12T19:01:02.833419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:37.828842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'4","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:04.854208+0000","last_change":"2024-09-12T19:01:04.854208+0000","last_active":"2024-09-12T19:01:04.854208+0000","last_peered":"2024-09-12T19:01:04.854208+0000","last_clean":"2024-09-12T19:01:04.854208+0000","last_became_active":"2024-09-12T17:59:43.030545+0000","last_became_peered":"2024-09-12T17:59:43.030545+0000","last_unstale":"2024-09-12T19:01:04.854208+0000","last_undegraded":"2024-09-12T19:01:04.854208+0000","last_fullsized":"2024-09-12T19:01:04.854208+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:01:04.854023+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:01:04.854023+0000","last_clean_scrub_stamp":"2024-09-12T19:01:04.854023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:14.018754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4192,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.810854+0000","last_change":"2024-09-12T19:00:46.810854+0000","last_active":"2024-09-12T19:00:46.810854+0000","last_peered":"2024-09-12T19:00:46.810854+0000","last_clean":"2024-09-12T19:00:46.810854+0000","last_became_active":"2024-09-12T17:59:38.945373+0000","last_became_peered":"2024-09-12T17:59:38.945373+0000","last_unstale":"2024-09-12T19:00:46.810854+0000","last_undegraded":"2024-09-12T19:00:46.810854+0000","last_fullsized":"2024-09-12T19:00:46.810854+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:46.810616+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:46.810616+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.810616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:16.284198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'6","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:49.848794+0000","last_change":"2024-09-12T19:00:49.848598+0000","last_active":"2024-09-12T19:00:49.848794+0000","last_peered":"2024-09-12T19:00:49.848794+0000","last_clean":"2024-09-12T19:00:49.848794+0000","last_became_active":"2024-09-12T17:55:59.338550+0000","last_became_peered":"2024-09-12T17:55:59.338550+0000","last_unstale":"2024-09-12T19:00:49.848794+0000","last_undegraded":"2024-09-12T19:00:49.848794+0000","last_fullsized":"2024-09-12T19:00:49.848794+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:49.848417+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:49.848417+0000","last_clean_scrub_stamp":"2024-09-12T19:00:49.848417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:07.641525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:07.885544+0000","last_change":"2024-09-12T19:01:07.885544+0000","last_active":"2024-09-12T19:01:07.885544+0000","last_peered":"2024-09-12T19:01:07.885544+0000","last_clean":"2024-09-12T19:01:07.885544+0000","last_became_active":"2024-09-12T18:19:57.871345+0000","last_became_peered":"2024-09-12T18:19:57.871345+0000","last_unstale":"2024-09-12T19:01:07.885544+0000","last_undegraded":"2024-09-12T19:01:07.885544+0000","last_fullsized":"2024-09-12T19:01:07.885544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:01:07.885432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:01:07.885432+0000","last_clean_scrub_stamp":"2024-09-12T19:01:07.885432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:25.340118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.221817+0000","last_change":"2024-09-12T19:00:48.221817+0000","last_active":"2024-09-12T19:00:48.221817+0000","last_peered":"2024-09-12T19:00:48.221817+0000","last_clean":"2024-09-12T19:00:48.221817+0000","last_became_active":"2024-09-12T17:59:43.034299+0000","last_became_peered":"2024-09-12T17:59:43.034299+0000","last_unstale":"2024-09-12T19:00:48.221817+0000","last_undegraded":"2024-09-12T19:00:48.221817+0000","last_fullsized":"2024-09-12T19:00:48.221817+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T19:00:48.221632+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T19:00:48.221632+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.221632+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:51.320406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'6","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:53.140558+0000","last_change":"2024-09-12T19:00:53.140558+0000","last_active":"2024-09-12T19:00:53.140558+0000","last_peered":"2024-09-12T19:00:53.140558+0000","last_clean":"2024-09-12T19:00:53.140558+0000","last_became_active":"2024-09-12T17:59:38.976348+0000","last_became_peered":"2024-09-12T17:59:38.976348+0000","last_unstale":"2024-09-12T19:00:53.140558+0000","last_undegraded":"2024-09-12T19:00:53.140558+0000","last_fullsized":"2024-09-12T19:00:53.140558+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T19:00:53.140370+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T19:00:53.140370+0000","last_clean_scrub_stamp":"2024-09-12T19:00:53.140370+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:56.951784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'16","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.803174+0000","last_change":"2024-09-12T19:00:45.803029+0000","last_active":"2024-09-12T19:00:45.803174+0000","last_peered":"2024-09-12T19:00:45.803174+0000","last_clean":"2024-09-12T19:00:45.803174+0000","last_became_active":"2024-09-12T17:55:59.356970+0000","last_became_peered":"2024-09-12T17:55:59.356970+0000","last_unstale":"2024-09-12T19:00:45.803174+0000","last_undegraded":"2024-09-12T19:00:45.803174+0000","last_fullsized":"2024-09-12T19:00:45.803174+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T19:00:45.802864+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T19:00:45.802864+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.802864+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:33.411161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":58,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.466343+0000","last_change":"2024-09-12T19:00:47.466343+0000","last_active":"2024-09-12T19:00:47.466343+0000","last_peered":"2024-09-12T19:00:47.466343+0000","last_clean":"2024-09-12T19:00:47.466343+0000","last_became_active":"2024-09-12T18:19:57.865319+0000","last_became_peered":"2024-09-12T18:19:57.865319+0000","last_unstale":"2024-09-12T19:00:47.466343+0000","last_undegraded":"2024-09-12T19:00:47.466343+0000","last_fullsized":"2024-09-12T19:00:47.466343+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:47.466158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:47.466158+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.466158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:45.700520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'2","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.326653+0000","last_change":"2024-09-12T19:00:40.326653+0000","last_active":"2024-09-12T19:00:40.326653+0000","last_peered":"2024-09-12T19:00:40.326653+0000","last_clean":"2024-09-12T19:00:40.326653+0000","last_became_active":"2024-09-12T17:59:56.386194+0000","last_became_peered":"2024-09-12T17:59:56.386194+0000","last_unstale":"2024-09-12T19:00:40.326653+0000","last_undegraded":"2024-09-12T19:00:40.326653+0000","last_fullsized":"2024-09-12T19:00:40.326653+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:40.326477+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:40.326477+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.326477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:00.992353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'9","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.807079+0000","last_change":"2024-09-12T19:00:48.807079+0000","last_active":"2024-09-12T19:00:48.807079+0000","last_peered":"2024-09-12T19:00:48.807079+0000","last_clean":"2024-09-12T19:00:48.807079+0000","last_became_active":"2024-09-12T17:59:38.977316+0000","last_became_peered":"2024-09-12T17:59:38.977316+0000","last_unstale":"2024-09-12T19:00:48.807079+0000","last_undegraded":"2024-09-12T19:00:48.807079+0000","last_fullsized":"2024-09-12T19:00:48.807079+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T19:00:48.806887+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T19:00:48.806887+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.806887+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.411227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16386,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'37","reported_seq":169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.282266+0000","last_change":"2024-09-12T19:00:34.282096+0000","last_active":"2024-09-12T19:00:34.282266+0000","last_peered":"2024-09-12T19:00:34.282266+0000","last_clean":"2024-09-12T19:00:34.282266+0000","last_became_active":"2024-09-12T17:55:59.366177+0000","last_became_peered":"2024-09-12T17:55:59.366177+0000","last_unstale":"2024-09-12T19:00:34.282266+0000","last_undegraded":"2024-09-12T19:00:34.282266+0000","last_fullsized":"2024-09-12T19:00:34.282266+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-12T19:00:34.281883+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-12T19:00:34.281883+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.281883+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:39.353385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":133,"num_write":64,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:01.812970+0000","last_change":"2024-09-12T19:01:01.812970+0000","last_active":"2024-09-12T19:01:01.812970+0000","last_peered":"2024-09-12T19:01:01.812970+0000","last_clean":"2024-09-12T19:01:01.812970+0000","last_became_active":"2024-09-12T18:19:57.843946+0000","last_became_peered":"2024-09-12T18:19:57.843946+0000","last_unstale":"2024-09-12T19:01:01.812970+0000","last_undegraded":"2024-09-12T19:01:01.812970+0000","last_fullsized":"2024-09-12T19:01:01.812970+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:01:01.812756+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:01:01.812756+0000","last_clean_scrub_stamp":"2024-09-12T19:01:01.812756+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:33.229092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.312204+0000","last_change":"2024-09-12T19:00:41.312204+0000","last_active":"2024-09-12T19:00:41.312204+0000","last_peered":"2024-09-12T19:00:41.312204+0000","last_clean":"2024-09-12T19:00:41.312204+0000","last_became_active":"2024-09-12T17:59:43.013293+0000","last_became_peered":"2024-09-12T17:59:43.013293+0000","last_unstale":"2024-09-12T19:00:41.312204+0000","last_undegraded":"2024-09-12T19:00:41.312204+0000","last_fullsized":"2024-09-12T19:00:41.312204+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:41.312027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:41.312027+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.312027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:34.062293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.833891+0000","last_change":"2024-09-12T19:00:44.833891+0000","last_active":"2024-09-12T19:00:44.833891+0000","last_peered":"2024-09-12T19:00:44.833891+0000","last_clean":"2024-09-12T19:00:44.833891+0000","last_became_active":"2024-09-12T17:59:38.984004+0000","last_became_peered":"2024-09-12T17:59:38.984004+0000","last_unstale":"2024-09-12T19:00:44.833891+0000","last_undegraded":"2024-09-12T19:00:44.833891+0000","last_fullsized":"2024-09-12T19:00:44.833891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:44.833706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:44.833706+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.833706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:43.545551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'21","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.318147+0000","last_change":"2024-09-12T19:00:45.318147+0000","last_active":"2024-09-12T19:00:45.318147+0000","last_peered":"2024-09-12T19:00:45.318147+0000","last_clean":"2024-09-12T19:00:45.318147+0000","last_became_active":"2024-09-12T17:55:59.366968+0000","last_became_peered":"2024-09-12T17:55:59.366968+0000","last_unstale":"2024-09-12T19:00:45.318147+0000","last_undegraded":"2024-09-12T19:00:45.318147+0000","last_fullsized":"2024-09-12T19:00:45.318147+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-12T19:00:45.317964+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-12T19:00:45.317964+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.317964+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:09.029203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:02.857453+0000","last_change":"2024-09-12T19:01:02.857453+0000","last_active":"2024-09-12T19:01:02.857453+0000","last_peered":"2024-09-12T19:01:02.857453+0000","last_clean":"2024-09-12T19:01:02.857453+0000","last_became_active":"2024-09-12T18:19:57.870750+0000","last_became_peered":"2024-09-12T18:19:57.870750+0000","last_unstale":"2024-09-12T19:01:02.857453+0000","last_undegraded":"2024-09-12T19:01:02.857453+0000","last_fullsized":"2024-09-12T19:01:02.857453+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:01:02.857268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:01:02.857268+0000","last_clean_scrub_stamp":"2024-09-12T19:01:02.857268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:59.042487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:58.902274+0000","last_change":"2024-09-12T19:00:58.902274+0000","last_active":"2024-09-12T19:00:58.902274+0000","last_peered":"2024-09-12T19:00:58.902274+0000","last_clean":"2024-09-12T19:00:58.902274+0000","last_became_active":"2024-09-12T17:59:43.021777+0000","last_became_peered":"2024-09-12T17:59:43.021777+0000","last_unstale":"2024-09-12T19:00:58.902274+0000","last_undegraded":"2024-09-12T19:00:58.902274+0000","last_fullsized":"2024-09-12T19:00:58.902274+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T19:00:58.902088+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T19:00:58.902088+0000","last_clean_scrub_stamp":"2024-09-12T19:00:58.902088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:06.336718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'6","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:56.093615+0000","last_change":"2024-09-12T19:00:56.093615+0000","last_active":"2024-09-12T19:00:56.093615+0000","last_peered":"2024-09-12T19:00:56.093615+0000","last_clean":"2024-09-12T19:00:56.093615+0000","last_became_active":"2024-09-12T17:59:38.989753+0000","last_became_peered":"2024-09-12T17:59:38.989753+0000","last_unstale":"2024-09-12T19:00:56.093615+0000","last_undegraded":"2024-09-12T19:00:56.093615+0000","last_fullsized":"2024-09-12T19:00:56.093615+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T19:00:56.093374+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T19:00:56.093374+0000","last_clean_scrub_stamp":"2024-09-12T19:00:56.093374+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:30.412948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'22","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.429811+0000","last_change":"2024-09-12T19:00:34.429649+0000","last_active":"2024-09-12T19:00:34.429811+0000","last_peered":"2024-09-12T19:00:34.429811+0000","last_clean":"2024-09-12T19:00:34.429811+0000","last_became_active":"2024-09-12T17:55:59.329792+0000","last_became_peered":"2024-09-12T17:55:59.329792+0000","last_unstale":"2024-09-12T19:00:34.429811+0000","last_undegraded":"2024-09-12T19:00:34.429811+0000","last_fullsized":"2024-09-12T19:00:34.429811+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-12T19:00:34.429450+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-12T19:00:34.429450+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.429450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:51.008916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.477892+0000","last_change":"2024-09-12T19:00:46.477892+0000","last_active":"2024-09-12T19:00:46.477892+0000","last_peered":"2024-09-12T19:00:46.477892+0000","last_clean":"2024-09-12T19:00:46.477892+0000","last_became_active":"2024-09-12T18:19:57.863600+0000","last_became_peered":"2024-09-12T18:19:57.863600+0000","last_unstale":"2024-09-12T19:00:46.477892+0000","last_undegraded":"2024-09-12T19:00:46.477892+0000","last_fullsized":"2024-09-12T19:00:46.477892+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:46.477707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:46.477707+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.477707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:31.175442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:59.875767+0000","last_change":"2024-09-12T19:00:59.875767+0000","last_active":"2024-09-12T19:00:59.875767+0000","last_peered":"2024-09-12T19:00:59.875767+0000","last_clean":"2024-09-12T19:00:59.875767+0000","last_became_active":"2024-09-12T17:59:43.031016+0000","last_became_peered":"2024-09-12T17:59:43.031016+0000","last_unstale":"2024-09-12T19:00:59.875767+0000","last_undegraded":"2024-09-12T19:00:59.875767+0000","last_fullsized":"2024-09-12T19:00:59.875767+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:00:59.875526+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:00:59.875526+0000","last_clean_scrub_stamp":"2024-09-12T19:00:59.875526+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:42.867904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.224160+0000","last_change":"2024-09-12T19:00:46.224160+0000","last_active":"2024-09-12T19:00:46.224160+0000","last_peered":"2024-09-12T19:00:46.224160+0000","last_clean":"2024-09-12T19:00:46.224160+0000","last_became_active":"2024-09-12T17:59:38.966158+0000","last_became_peered":"2024-09-12T17:59:38.966158+0000","last_unstale":"2024-09-12T19:00:46.224160+0000","last_undegraded":"2024-09-12T19:00:46.224160+0000","last_fullsized":"2024-09-12T19:00:46.224160+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:46.223984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:46.223984+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.223984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:40.994472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'26","reported_seq":133,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:50.214292+0000","last_change":"2024-09-12T19:00:50.214157+0000","last_active":"2024-09-12T19:00:50.214292+0000","last_peered":"2024-09-12T19:00:50.214292+0000","last_clean":"2024-09-12T19:00:50.214292+0000","last_became_active":"2024-09-12T17:55:59.366803+0000","last_became_peered":"2024-09-12T17:55:59.366803+0000","last_unstale":"2024-09-12T19:00:50.214292+0000","last_undegraded":"2024-09-12T19:00:50.214292+0000","last_fullsized":"2024-09-12T19:00:50.214292+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T19:00:50.213963+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T19:00:50.213963+0000","last_clean_scrub_stamp":"2024-09-12T19:00:50.213963+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:01.936720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.621793+0000","last_change":"2024-09-12T19:00:33.621793+0000","last_active":"2024-09-12T19:00:33.621793+0000","last_peered":"2024-09-12T19:00:33.621793+0000","last_clean":"2024-09-12T19:00:33.621793+0000","last_became_active":"2024-09-12T18:19:57.845474+0000","last_became_peered":"2024-09-12T18:19:57.845474+0000","last_unstale":"2024-09-12T19:00:33.621793+0000","last_undegraded":"2024-09-12T19:00:33.621793+0000","last_fullsized":"2024-09-12T19:00:33.621793+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:33.621590+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:33.621590+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.621590+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:48.260800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:53.848573+0000","last_change":"2024-09-12T19:00:53.848573+0000","last_active":"2024-09-12T19:00:53.848573+0000","last_peered":"2024-09-12T19:00:53.848573+0000","last_clean":"2024-09-12T19:00:53.848573+0000","last_became_active":"2024-09-12T17:59:43.034159+0000","last_became_peered":"2024-09-12T17:59:43.034159+0000","last_unstale":"2024-09-12T19:00:53.848573+0000","last_undegraded":"2024-09-12T19:00:53.848573+0000","last_fullsized":"2024-09-12T19:00:53.848573+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:53.848378+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:53.848378+0000","last_clean_scrub_stamp":"2024-09-12T19:00:53.848378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:01.085747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:51.684508+0000","last_change":"2024-09-12T19:00:51.684508+0000","last_active":"2024-09-12T19:00:51.684508+0000","last_peered":"2024-09-12T19:00:51.684508+0000","last_clean":"2024-09-12T19:00:51.684508+0000","last_became_active":"2024-09-12T17:59:38.980797+0000","last_became_peered":"2024-09-12T17:59:38.980797+0000","last_unstale":"2024-09-12T19:00:51.684508+0000","last_undegraded":"2024-09-12T19:00:51.684508+0000","last_fullsized":"2024-09-12T19:00:51.684508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:51.684313+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:51.684313+0000","last_clean_scrub_stamp":"2024-09-12T19:00:51.684313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:20.425081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'6","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:57.864447+0000","last_change":"2024-09-12T19:00:57.864284+0000","last_active":"2024-09-12T19:00:57.864447+0000","last_peered":"2024-09-12T19:00:57.864447+0000","last_clean":"2024-09-12T19:00:57.864447+0000","last_became_active":"2024-09-12T17:55:59.366679+0000","last_became_peered":"2024-09-12T17:55:59.366679+0000","last_unstale":"2024-09-12T19:00:57.864447+0000","last_undegraded":"2024-09-12T19:00:57.864447+0000","last_fullsized":"2024-09-12T19:00:57.864447+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:57.864091+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:57.864091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:57.864091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:15.276951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:00.809681+0000","last_change":"2024-09-12T19:01:00.809681+0000","last_active":"2024-09-12T19:01:00.809681+0000","last_peered":"2024-09-12T19:01:00.809681+0000","last_clean":"2024-09-12T19:01:00.809681+0000","last_became_active":"2024-09-12T18:19:57.840855+0000","last_became_peered":"2024-09-12T18:19:57.840855+0000","last_unstale":"2024-09-12T19:01:00.809681+0000","last_undegraded":"2024-09-12T19:01:00.809681+0000","last_fullsized":"2024-09-12T19:01:00.809681+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:01:00.809494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:01:00.809494+0000","last_clean_scrub_stamp":"2024-09-12T19:01:00.809494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:07.450262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'4","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:00.890980+0000","last_change":"2024-09-12T19:01:00.890980+0000","last_active":"2024-09-12T19:01:00.890980+0000","last_peered":"2024-09-12T19:01:00.890980+0000","last_clean":"2024-09-12T19:01:00.890980+0000","last_became_active":"2024-09-12T17:59:43.021538+0000","last_became_peered":"2024-09-12T17:59:43.021538+0000","last_unstale":"2024-09-12T19:01:00.890980+0000","last_undegraded":"2024-09-12T19:01:00.890980+0000","last_fullsized":"2024-09-12T19:01:00.890980+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:01:00.890737+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:01:00.890737+0000","last_clean_scrub_stamp":"2024-09-12T19:01:00.890737+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:03.567058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'6","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.608183+0000","last_change":"2024-09-12T19:00:29.608183+0000","last_active":"2024-09-12T19:00:29.608183+0000","last_peered":"2024-09-12T19:00:29.608183+0000","last_clean":"2024-09-12T19:00:29.608183+0000","last_became_active":"2024-09-12T17:59:38.979939+0000","last_became_peered":"2024-09-12T17:59:38.979939+0000","last_unstale":"2024-09-12T19:00:29.608183+0000","last_undegraded":"2024-09-12T19:00:29.608183+0000","last_fullsized":"2024-09-12T19:00:29.608183+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:29.607994+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:29.607994+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.607994+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:24.431667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'36","reported_seq":171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.606690+0000","last_change":"2024-09-12T19:00:25.606507+0000","last_active":"2024-09-12T19:00:25.606690+0000","last_peered":"2024-09-12T19:00:25.606690+0000","last_clean":"2024-09-12T19:00:25.606690+0000","last_became_active":"2024-09-12T17:55:59.330570+0000","last_became_peered":"2024-09-12T17:55:59.330570+0000","last_unstale":"2024-09-12T19:00:25.606690+0000","last_undegraded":"2024-09-12T19:00:25.606690+0000","last_fullsized":"2024-09-12T19:00:25.606690+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-12T19:00:25.606314+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-12T19:00:25.606314+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.606314+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:49.274900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":139,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:51.126911+0000","last_change":"2024-09-12T19:00:51.126911+0000","last_active":"2024-09-12T19:00:51.126911+0000","last_peered":"2024-09-12T19:00:51.126911+0000","last_clean":"2024-09-12T19:00:51.126911+0000","last_became_active":"2024-09-12T18:19:57.853269+0000","last_became_peered":"2024-09-12T18:19:57.853269+0000","last_unstale":"2024-09-12T19:00:51.126911+0000","last_undegraded":"2024-09-12T19:00:51.126911+0000","last_fullsized":"2024-09-12T19:00:51.126911+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:51.126706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:51.126706+0000","last_clean_scrub_stamp":"2024-09-12T19:00:51.126706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:31.638078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:52.828240+0000","last_change":"2024-09-12T19:00:52.828240+0000","last_active":"2024-09-12T19:00:52.828240+0000","last_peered":"2024-09-12T19:00:52.828240+0000","last_clean":"2024-09-12T19:00:52.828240+0000","last_became_active":"2024-09-12T17:59:43.020450+0000","last_became_peered":"2024-09-12T17:59:43.020450+0000","last_unstale":"2024-09-12T19:00:52.828240+0000","last_undegraded":"2024-09-12T19:00:52.828240+0000","last_fullsized":"2024-09-12T19:00:52.828240+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T19:00:52.828055+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T19:00:52.828055+0000","last_clean_scrub_stamp":"2024-09-12T19:00:52.828055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:54.571910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'7","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:49.261944+0000","last_change":"2024-09-12T19:00:49.261944+0000","last_active":"2024-09-12T19:00:49.261944+0000","last_peered":"2024-09-12T19:00:49.261944+0000","last_clean":"2024-09-12T19:00:49.261944+0000","last_became_active":"2024-09-12T17:59:38.982556+0000","last_became_peered":"2024-09-12T17:59:38.982556+0000","last_unstale":"2024-09-12T19:00:49.261944+0000","last_undegraded":"2024-09-12T19:00:49.261944+0000","last_fullsized":"2024-09-12T19:00:49.261944+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T19:00:49.261678+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T19:00:49.261678+0000","last_clean_scrub_stamp":"2024-09-12T19:00:49.261678+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.499200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'83","reported_seq":301,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.784338+0000","last_change":"2024-09-12T19:00:45.784338+0000","last_active":"2024-09-12T19:00:45.784338+0000","last_peered":"2024-09-12T19:00:45.784338+0000","last_clean":"2024-09-12T19:00:45.784338+0000","last_became_active":"2024-09-12T17:55:59.363431+0000","last_became_peered":"2024-09-12T17:55:59.363431+0000","last_unstale":"2024-09-12T19:00:45.784338+0000","last_undegraded":"2024-09-12T19:00:45.784338+0000","last_fullsized":"2024-09-12T19:00:45.784338+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'83","last_scrub_stamp":"2024-09-12T19:00:45.784154+0000","last_deep_scrub":"264'83","last_deep_scrub_stamp":"2024-09-12T19:00:45.784154+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.784154+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:24.158887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":321,"num_write":127,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:06.852361+0000","last_change":"2024-09-12T19:01:06.852361+0000","last_active":"2024-09-12T19:01:06.852361+0000","last_peered":"2024-09-12T19:01:06.852361+0000","last_clean":"2024-09-12T19:01:06.852361+0000","last_became_active":"2024-09-12T18:19:57.835852+0000","last_became_peered":"2024-09-12T18:19:57.835852+0000","last_unstale":"2024-09-12T19:01:06.852361+0000","last_undegraded":"2024-09-12T19:01:06.852361+0000","last_fullsized":"2024-09-12T19:01:06.852361+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:01:06.852179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:01:06.852179+0000","last_clean_scrub_stamp":"2024-09-12T19:01:06.852179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:14.473913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.428350+0000","last_change":"2024-09-12T19:00:45.428350+0000","last_active":"2024-09-12T19:00:45.428350+0000","last_peered":"2024-09-12T19:00:45.428350+0000","last_clean":"2024-09-12T19:00:45.428350+0000","last_became_active":"2024-09-12T17:59:43.024103+0000","last_became_peered":"2024-09-12T17:59:43.024103+0000","last_unstale":"2024-09-12T19:00:45.428350+0000","last_undegraded":"2024-09-12T19:00:45.428350+0000","last_fullsized":"2024-09-12T19:00:45.428350+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:45.428168+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:45.428168+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.428168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:13.741664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'3","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.799104+0000","last_change":"2024-09-12T19:00:45.799104+0000","last_active":"2024-09-12T19:00:45.799104+0000","last_peered":"2024-09-12T19:00:45.799104+0000","last_clean":"2024-09-12T19:00:45.799104+0000","last_became_active":"2024-09-12T17:59:38.978126+0000","last_became_peered":"2024-09-12T17:59:38.978126+0000","last_unstale":"2024-09-12T19:00:45.799104+0000","last_undegraded":"2024-09-12T19:00:45.799104+0000","last_fullsized":"2024-09-12T19:00:45.799104+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:45.798914+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:45.798914+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.798914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:47.415942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'83","reported_seq":344,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.729008+0000","last_change":"2024-09-12T19:00:42.728861+0000","last_active":"2024-09-12T19:00:42.729008+0000","last_peered":"2024-09-12T19:00:42.729008+0000","last_clean":"2024-09-12T19:00:42.729008+0000","last_became_active":"2024-09-12T17:55:59.363574+0000","last_became_peered":"2024-09-12T17:55:59.363574+0000","last_unstale":"2024-09-12T19:00:42.729008+0000","last_undegraded":"2024-09-12T19:00:42.729008+0000","last_fullsized":"2024-09-12T19:00:42.729008+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'83","last_scrub_stamp":"2024-09-12T19:00:42.728674+0000","last_deep_scrub":"264'83","last_deep_scrub_stamp":"2024-09-12T19:00:42.728674+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.728674+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:15.202874+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":530,"num_read_kb":371,"num_write":118,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4970,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:03.114380+0000","last_change":"2024-09-12T19:01:03.114380+0000","last_active":"2024-09-12T19:01:03.114380+0000","last_peered":"2024-09-12T19:01:03.114380+0000","last_clean":"2024-09-12T19:01:03.114380+0000","last_became_active":"2024-09-12T18:19:57.847092+0000","last_became_peered":"2024-09-12T18:19:57.847092+0000","last_unstale":"2024-09-12T19:01:03.114380+0000","last_undegraded":"2024-09-12T19:01:03.114380+0000","last_fullsized":"2024-09-12T19:01:03.114380+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:01:03.114194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:01:03.114194+0000","last_clean_scrub_stamp":"2024-09-12T19:01:03.114194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:10.533687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.464268+0000","last_change":"2024-09-12T19:00:44.464268+0000","last_active":"2024-09-12T19:00:44.464268+0000","last_peered":"2024-09-12T19:00:44.464268+0000","last_clean":"2024-09-12T19:00:44.464268+0000","last_became_active":"2024-09-12T17:59:43.034180+0000","last_became_peered":"2024-09-12T17:59:43.034180+0000","last_unstale":"2024-09-12T19:00:44.464268+0000","last_undegraded":"2024-09-12T19:00:44.464268+0000","last_fullsized":"2024-09-12T19:00:44.464268+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T19:00:44.464055+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T19:00:44.464055+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.464055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:03.215015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.855528+0000","last_change":"2024-09-12T19:00:48.855528+0000","last_active":"2024-09-12T19:00:48.855528+0000","last_peered":"2024-09-12T19:00:48.855528+0000","last_clean":"2024-09-12T19:00:48.855528+0000","last_became_active":"2024-09-12T17:59:38.969338+0000","last_became_peered":"2024-09-12T17:59:38.969338+0000","last_unstale":"2024-09-12T19:00:48.855528+0000","last_undegraded":"2024-09-12T19:00:48.855528+0000","last_fullsized":"2024-09-12T19:00:48.855528+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:48.855313+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:48.855313+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.855313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:43.334322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'36","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.279124+0000","last_change":"2024-09-12T19:00:47.279055+0000","last_active":"2024-09-12T19:00:47.279124+0000","last_peered":"2024-09-12T19:00:47.279124+0000","last_clean":"2024-09-12T19:00:47.279124+0000","last_became_active":"2024-09-12T17:55:59.357330+0000","last_became_peered":"2024-09-12T17:55:59.357330+0000","last_unstale":"2024-09-12T19:00:47.279124+0000","last_undegraded":"2024-09-12T19:00:47.279124+0000","last_fullsized":"2024-09-12T19:00:47.279124+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-12T19:00:47.278954+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-12T19:00:47.278954+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.278954+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:36.537205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":130,"num_write":63,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:02.093124+0000","last_change":"2024-09-12T19:01:02.093124+0000","last_active":"2024-09-12T19:01:02.093124+0000","last_peered":"2024-09-12T19:01:02.093124+0000","last_clean":"2024-09-12T19:01:02.093124+0000","last_became_active":"2024-09-12T18:19:57.839696+0000","last_became_peered":"2024-09-12T18:19:57.839696+0000","last_unstale":"2024-09-12T19:01:02.093124+0000","last_undegraded":"2024-09-12T19:01:02.093124+0000","last_fullsized":"2024-09-12T19:01:02.093124+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:01:02.092949+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:01:02.092949+0000","last_clean_scrub_stamp":"2024-09-12T19:01:02.092949+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:59.124099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:56.895265+0000","last_change":"2024-09-12T19:00:56.895265+0000","last_active":"2024-09-12T19:00:56.895265+0000","last_peered":"2024-09-12T19:00:56.895265+0000","last_clean":"2024-09-12T19:00:56.895265+0000","last_became_active":"2024-09-12T17:59:43.030490+0000","last_became_peered":"2024-09-12T17:59:43.030490+0000","last_unstale":"2024-09-12T19:00:56.895265+0000","last_undegraded":"2024-09-12T19:00:56.895265+0000","last_fullsized":"2024-09-12T19:00:56.895265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:56.895042+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:56.895042+0000","last_clean_scrub_stamp":"2024-09-12T19:00:56.895042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:34.772003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16955,"num_write":6,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"261'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.312246+0000","last_change":"2024-09-12T19:00:38.312246+0000","last_active":"2024-09-12T19:00:38.312246+0000","last_peered":"2024-09-12T19:00:38.312246+0000","last_clean":"2024-09-12T19:00:38.312246+0000","last_became_active":"2024-09-12T17:59:38.990212+0000","last_became_peered":"2024-09-12T17:59:38.990212+0000","last_unstale":"2024-09-12T19:00:38.312246+0000","last_undegraded":"2024-09-12T19:00:38.312246+0000","last_fullsized":"2024-09-12T19:00:38.312246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:38.312048+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:38.312048+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.312048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:46.576970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'28","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:49.849272+0000","last_change":"2024-09-12T19:00:49.849104+0000","last_active":"2024-09-12T19:00:49.849272+0000","last_peered":"2024-09-12T19:00:49.849272+0000","last_clean":"2024-09-12T19:00:49.849272+0000","last_became_active":"2024-09-12T17:55:59.356838+0000","last_became_peered":"2024-09-12T17:55:59.356838+0000","last_unstale":"2024-09-12T19:00:49.849272+0000","last_undegraded":"2024-09-12T19:00:49.849272+0000","last_fullsized":"2024-09-12T19:00:49.849272+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-12T19:00:49.848928+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-12T19:00:49.848928+0000","last_clean_scrub_stamp":"2024-09-12T19:00:49.848928+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:40.206866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":96,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:03.885549+0000","last_change":"2024-09-12T19:01:03.885549+0000","last_active":"2024-09-12T19:01:03.885549+0000","last_peered":"2024-09-12T19:01:03.885549+0000","last_clean":"2024-09-12T19:01:03.885549+0000","last_became_active":"2024-09-12T18:19:57.837079+0000","last_became_peered":"2024-09-12T18:19:57.837079+0000","last_unstale":"2024-09-12T19:01:03.885549+0000","last_undegraded":"2024-09-12T19:01:03.885549+0000","last_fullsized":"2024-09-12T19:01:03.885549+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:01:03.885348+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:01:03.885348+0000","last_clean_scrub_stamp":"2024-09-12T19:01:03.885348+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:25.866165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.331177+0000","last_change":"2024-09-12T19:00:39.331177+0000","last_active":"2024-09-12T19:00:39.331177+0000","last_peered":"2024-09-12T19:00:39.331177+0000","last_clean":"2024-09-12T19:00:39.331177+0000","last_became_active":"2024-09-12T17:59:43.032008+0000","last_became_peered":"2024-09-12T17:59:43.032008+0000","last_unstale":"2024-09-12T19:00:39.331177+0000","last_undegraded":"2024-09-12T19:00:39.331177+0000","last_fullsized":"2024-09-12T19:00:39.331177+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T19:00:39.330975+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T19:00:39.330975+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.330975+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:32.780484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'5","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:45.256602+0000","last_change":"2024-09-12T19:00:45.256602+0000","last_active":"2024-09-12T19:00:45.256602+0000","last_peered":"2024-09-12T19:00:45.256602+0000","last_clean":"2024-09-12T19:00:45.256602+0000","last_became_active":"2024-09-12T17:59:38.982037+0000","last_became_peered":"2024-09-12T17:59:38.982037+0000","last_unstale":"2024-09-12T19:00:45.256602+0000","last_undegraded":"2024-09-12T19:00:45.256602+0000","last_fullsized":"2024-09-12T19:00:45.256602+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:00:45.256428+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:00:45.256428+0000","last_clean_scrub_stamp":"2024-09-12T19:00:45.256428+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:58.516528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.874584+0000","last_change":"2024-09-12T19:00:47.874356+0000","last_active":"2024-09-12T19:00:47.874584+0000","last_peered":"2024-09-12T19:00:47.874584+0000","last_clean":"2024-09-12T19:00:47.874584+0000","last_became_active":"2024-09-12T17:55:59.357659+0000","last_became_peered":"2024-09-12T17:55:59.357659+0000","last_unstale":"2024-09-12T19:00:47.874584+0000","last_undegraded":"2024-09-12T19:00:47.874584+0000","last_fullsized":"2024-09-12T19:00:47.874584+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T19:00:47.874165+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T19:00:47.874165+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.874165+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:24.831893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":69,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.561942+0000","last_change":"2024-09-12T19:00:31.561637+0000","last_active":"2024-09-12T19:00:31.561942+0000","last_peered":"2024-09-12T19:00:31.561942+0000","last_clean":"2024-09-12T19:00:31.561942+0000","last_became_active":"2024-09-12T18:19:57.849682+0000","last_became_peered":"2024-09-12T18:19:57.849682+0000","last_unstale":"2024-09-12T19:00:31.561942+0000","last_undegraded":"2024-09-12T19:00:31.561942+0000","last_fullsized":"2024-09-12T19:00:31.561942+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:31.561428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:31.561428+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.561428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:44.351076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:55.869972+0000","last_change":"2024-09-12T19:00:55.869972+0000","last_active":"2024-09-12T19:00:55.869972+0000","last_peered":"2024-09-12T19:00:55.869972+0000","last_clean":"2024-09-12T19:00:55.869972+0000","last_became_active":"2024-09-12T17:59:43.026619+0000","last_became_peered":"2024-09-12T17:59:43.026619+0000","last_unstale":"2024-09-12T19:00:55.869972+0000","last_undegraded":"2024-09-12T19:00:55.869972+0000","last_fullsized":"2024-09-12T19:00:55.869972+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:55.869792+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:55.869792+0000","last_clean_scrub_stamp":"2024-09-12T19:00:55.869792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:42.744250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:49.774983+0000","last_change":"2024-09-12T19:00:49.774983+0000","last_active":"2024-09-12T19:00:49.774983+0000","last_peered":"2024-09-12T19:00:49.774983+0000","last_clean":"2024-09-12T19:00:49.774983+0000","last_became_active":"2024-09-12T17:59:38.988028+0000","last_became_peered":"2024-09-12T17:59:38.988028+0000","last_unstale":"2024-09-12T19:00:49.774983+0000","last_undegraded":"2024-09-12T19:00:49.774983+0000","last_fullsized":"2024-09-12T19:00:49.774983+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:49.774789+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:49.774789+0000","last_clean_scrub_stamp":"2024-09-12T19:00:49.774789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:13.152150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'56","reported_seq":222,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.806939+0000","last_change":"2024-09-12T19:00:44.806939+0000","last_active":"2024-09-12T19:00:44.806939+0000","last_peered":"2024-09-12T19:00:44.806939+0000","last_clean":"2024-09-12T19:00:44.806939+0000","last_became_active":"2024-09-12T17:55:59.360197+0000","last_became_peered":"2024-09-12T17:55:59.360197+0000","last_unstale":"2024-09-12T19:00:44.806939+0000","last_undegraded":"2024-09-12T19:00:44.806939+0000","last_fullsized":"2024-09-12T19:00:44.806939+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-09-12T19:00:44.806766+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-09-12T19:00:44.806766+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.806766+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:17.799959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":199,"num_write":102,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:57.751513+0000","last_change":"2024-09-12T19:00:57.751513+0000","last_active":"2024-09-12T19:00:57.751513+0000","last_peered":"2024-09-12T19:00:57.751513+0000","last_clean":"2024-09-12T19:00:57.751513+0000","last_became_active":"2024-09-12T18:19:57.869302+0000","last_became_peered":"2024-09-12T18:19:57.869302+0000","last_unstale":"2024-09-12T19:00:57.751513+0000","last_undegraded":"2024-09-12T19:00:57.751513+0000","last_fullsized":"2024-09-12T19:00:57.751513+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:57.751310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:57.751310+0000","last_clean_scrub_stamp":"2024-09-12T19:00:57.751310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:29.760205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:54.850637+0000","last_change":"2024-09-12T19:00:54.850637+0000","last_active":"2024-09-12T19:00:54.850637+0000","last_peered":"2024-09-12T19:00:54.850637+0000","last_clean":"2024-09-12T19:00:54.850637+0000","last_became_active":"2024-09-12T17:59:43.030846+0000","last_became_peered":"2024-09-12T17:59:43.030846+0000","last_unstale":"2024-09-12T19:00:54.850637+0000","last_undegraded":"2024-09-12T19:00:54.850637+0000","last_fullsized":"2024-09-12T19:00:54.850637+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:54.850449+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:54.850449+0000","last_clean_scrub_stamp":"2024-09-12T19:00:54.850449+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:48.192144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'6","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.608003+0000","last_change":"2024-09-12T19:00:28.608003+0000","last_active":"2024-09-12T19:00:28.608003+0000","last_peered":"2024-09-12T19:00:28.608003+0000","last_clean":"2024-09-12T19:00:28.608003+0000","last_became_active":"2024-09-12T17:59:38.968775+0000","last_became_peered":"2024-09-12T17:59:38.968775+0000","last_unstale":"2024-09-12T19:00:28.608003+0000","last_undegraded":"2024-09-12T19:00:28.608003+0000","last_fullsized":"2024-09-12T19:00:28.608003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:28.607823+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:28.607823+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.607823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:30.368834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":6,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.250343+0000","last_change":"2024-09-12T19:00:43.250171+0000","last_active":"2024-09-12T19:00:43.250343+0000","last_peered":"2024-09-12T19:00:43.250343+0000","last_clean":"2024-09-12T19:00:43.250343+0000","last_became_active":"2024-09-12T17:55:59.358747+0000","last_became_peered":"2024-09-12T17:55:59.358747+0000","last_unstale":"2024-09-12T19:00:43.250343+0000","last_undegraded":"2024-09-12T19:00:43.250343+0000","last_fullsized":"2024-09-12T19:00:43.250343+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-12T19:00:43.249993+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-12T19:00:43.249993+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.249993+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:46.531373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.332797+0000","last_change":"2024-09-12T19:00:42.332641+0000","last_active":"2024-09-12T19:00:42.332797+0000","last_peered":"2024-09-12T19:00:42.332797+0000","last_clean":"2024-09-12T19:00:42.332797+0000","last_became_active":"2024-09-12T18:19:57.822958+0000","last_became_peered":"2024-09-12T18:19:57.822958+0000","last_unstale":"2024-09-12T19:00:42.332797+0000","last_undegraded":"2024-09-12T19:00:42.332797+0000","last_fullsized":"2024-09-12T19:00:42.332797+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:42.332460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:42.332460+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.332460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:11.254643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'5","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.432452+0000","last_change":"2024-09-12T19:00:43.432452+0000","last_active":"2024-09-12T19:00:43.432452+0000","last_peered":"2024-09-12T19:00:43.432452+0000","last_clean":"2024-09-12T19:00:43.432452+0000","last_became_active":"2024-09-12T17:59:43.006748+0000","last_became_peered":"2024-09-12T17:59:43.006748+0000","last_unstale":"2024-09-12T19:00:43.432452+0000","last_undegraded":"2024-09-12T19:00:43.432452+0000","last_fullsized":"2024-09-12T19:00:43.432452+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:00:43.432269+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:00:43.432269+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.432269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:47.795522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:51.204482+0000","last_change":"2024-09-12T19:00:51.204482+0000","last_active":"2024-09-12T19:00:51.204482+0000","last_peered":"2024-09-12T19:00:51.204482+0000","last_clean":"2024-09-12T19:00:51.204482+0000","last_became_active":"2024-09-12T17:59:38.962944+0000","last_became_peered":"2024-09-12T17:59:38.962944+0000","last_unstale":"2024-09-12T19:00:51.204482+0000","last_undegraded":"2024-09-12T19:00:51.204482+0000","last_fullsized":"2024-09-12T19:00:51.204482+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:51.204294+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:51.204294+0000","last_clean_scrub_stamp":"2024-09-12T19:00:51.204294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:58.660709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'30","reported_seq":154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.321130+0000","last_change":"2024-09-12T19:00:35.320979+0000","last_active":"2024-09-12T19:00:35.321130+0000","last_peered":"2024-09-12T19:00:35.321130+0000","last_clean":"2024-09-12T19:00:35.321130+0000","last_became_active":"2024-09-12T17:55:59.345735+0000","last_became_peered":"2024-09-12T17:55:59.345735+0000","last_unstale":"2024-09-12T19:00:35.321130+0000","last_undegraded":"2024-09-12T19:00:35.321130+0000","last_fullsized":"2024-09-12T19:00:35.321130+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-12T19:00:35.320795+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-12T19:00:35.320795+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.320795+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:40.138142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:56.730076+0000","last_change":"2024-09-12T19:00:56.729807+0000","last_active":"2024-09-12T19:00:56.730076+0000","last_peered":"2024-09-12T19:00:56.730076+0000","last_clean":"2024-09-12T19:00:56.730076+0000","last_became_active":"2024-09-12T18:19:57.855728+0000","last_became_peered":"2024-09-12T18:19:57.855728+0000","last_unstale":"2024-09-12T19:00:56.730076+0000","last_undegraded":"2024-09-12T19:00:56.730076+0000","last_fullsized":"2024-09-12T19:00:56.730076+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:56.729578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:56.729578+0000","last_clean_scrub_stamp":"2024-09-12T19:00:56.729578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:09.004484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:01.850925+0000","last_change":"2024-09-12T19:01:01.850925+0000","last_active":"2024-09-12T19:01:01.850925+0000","last_peered":"2024-09-12T19:01:01.850925+0000","last_clean":"2024-09-12T19:01:01.850925+0000","last_became_active":"2024-09-12T17:59:43.019325+0000","last_became_peered":"2024-09-12T17:59:43.019325+0000","last_unstale":"2024-09-12T19:01:01.850925+0000","last_undegraded":"2024-09-12T19:01:01.850925+0000","last_fullsized":"2024-09-12T19:01:01.850925+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:01:01.850736+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:01:01.850736+0000","last_clean_scrub_stamp":"2024-09-12T19:01:01.850736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:42.171727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.464740+0000","last_change":"2024-09-12T19:00:33.464603+0000","last_active":"2024-09-12T19:00:33.464740+0000","last_peered":"2024-09-12T19:00:33.464740+0000","last_clean":"2024-09-12T19:00:33.464740+0000","last_became_active":"2024-09-12T17:59:38.977733+0000","last_became_peered":"2024-09-12T17:59:38.977733+0000","last_unstale":"2024-09-12T19:00:33.464740+0000","last_undegraded":"2024-09-12T19:00:33.464740+0000","last_fullsized":"2024-09-12T19:00:33.464740+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:33.464414+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:33.464414+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.464414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:30.669642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'50","reported_seq":206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.648500+0000","last_change":"2024-09-12T19:00:23.648328+0000","last_active":"2024-09-12T19:00:23.648500+0000","last_peered":"2024-09-12T19:00:23.648500+0000","last_clean":"2024-09-12T19:00:23.648500+0000","last_became_active":"2024-09-12T17:55:59.341145+0000","last_became_peered":"2024-09-12T17:55:59.341145+0000","last_unstale":"2024-09-12T19:00:23.648500+0000","last_undegraded":"2024-09-12T19:00:23.648500+0000","last_fullsized":"2024-09-12T19:00:23.648500+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-12T19:00:23.648148+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-12T19:00:23.648148+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.648148+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:09.004260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":177,"num_write":99,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:05.841325+0000","last_change":"2024-09-12T19:01:05.841325+0000","last_active":"2024-09-12T19:01:05.841325+0000","last_peered":"2024-09-12T19:01:05.841325+0000","last_clean":"2024-09-12T19:01:05.841325+0000","last_became_active":"2024-09-12T18:19:57.865311+0000","last_became_peered":"2024-09-12T18:19:57.865311+0000","last_unstale":"2024-09-12T19:01:05.841325+0000","last_undegraded":"2024-09-12T19:01:05.841325+0000","last_fullsized":"2024-09-12T19:01:05.841325+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:01:05.841144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:01:05.841144+0000","last_clean_scrub_stamp":"2024-09-12T19:01:05.841144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.740860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'8","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:51.809758+0000","last_change":"2024-09-12T19:00:51.809758+0000","last_active":"2024-09-12T19:00:51.809758+0000","last_peered":"2024-09-12T19:00:51.809758+0000","last_clean":"2024-09-12T19:00:51.809758+0000","last_became_active":"2024-09-12T17:59:43.029489+0000","last_became_peered":"2024-09-12T17:59:43.029489+0000","last_unstale":"2024-09-12T19:00:51.809758+0000","last_undegraded":"2024-09-12T19:00:51.809758+0000","last_fullsized":"2024-09-12T19:00:51.809758+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T19:00:51.809573+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T19:00:51.809573+0000","last_clean_scrub_stamp":"2024-09-12T19:00:51.809573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:36.659177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'3","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:52.165405+0000","last_change":"2024-09-12T19:00:52.165405+0000","last_active":"2024-09-12T19:00:52.165405+0000","last_peered":"2024-09-12T19:00:52.165405+0000","last_clean":"2024-09-12T19:00:52.165405+0000","last_became_active":"2024-09-12T17:59:38.965185+0000","last_became_peered":"2024-09-12T17:59:38.965185+0000","last_unstale":"2024-09-12T19:00:52.165405+0000","last_undegraded":"2024-09-12T19:00:52.165405+0000","last_fullsized":"2024-09-12T19:00:52.165405+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:52.165215+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:52.165215+0000","last_clean_scrub_stamp":"2024-09-12T19:00:52.165215+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:57.150469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'20","reported_seq":123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.315711+0000","last_change":"2024-09-12T19:00:43.315476+0000","last_active":"2024-09-12T19:00:43.315711+0000","last_peered":"2024-09-12T19:00:43.315711+0000","last_clean":"2024-09-12T19:00:43.315711+0000","last_became_active":"2024-09-12T17:55:59.359849+0000","last_became_peered":"2024-09-12T17:55:59.359849+0000","last_unstale":"2024-09-12T19:00:43.315711+0000","last_undegraded":"2024-09-12T19:00:43.315711+0000","last_fullsized":"2024-09-12T19:00:43.315711+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-12T19:00:43.315286+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-12T19:00:43.315286+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.315286+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:04.065775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:59.781861+0000","last_change":"2024-09-12T19:00:59.781861+0000","last_active":"2024-09-12T19:00:59.781861+0000","last_peered":"2024-09-12T19:00:59.781861+0000","last_clean":"2024-09-12T19:00:59.781861+0000","last_became_active":"2024-09-12T18:19:57.855140+0000","last_became_peered":"2024-09-12T18:19:57.855140+0000","last_unstale":"2024-09-12T19:00:59.781861+0000","last_undegraded":"2024-09-12T19:00:59.781861+0000","last_fullsized":"2024-09-12T19:00:59.781861+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:59.781671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:59.781671+0000","last_clean_scrub_stamp":"2024-09-12T19:00:59.781671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.657490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:52.710990+0000","last_change":"2024-09-12T19:00:52.710990+0000","last_active":"2024-09-12T19:00:52.710990+0000","last_peered":"2024-09-12T19:00:52.710990+0000","last_clean":"2024-09-12T19:00:52.710990+0000","last_became_active":"2024-09-12T17:59:43.015273+0000","last_became_peered":"2024-09-12T17:59:43.015273+0000","last_unstale":"2024-09-12T19:00:52.710990+0000","last_undegraded":"2024-09-12T19:00:52.710990+0000","last_fullsized":"2024-09-12T19:00:52.710990+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:52.710800+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:52.710800+0000","last_clean_scrub_stamp":"2024-09-12T19:00:52.710800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:14.950909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'11","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.450205+0000","last_change":"2024-09-12T19:00:36.450205+0000","last_active":"2024-09-12T19:00:36.450205+0000","last_peered":"2024-09-12T19:00:36.450205+0000","last_clean":"2024-09-12T19:00:36.450205+0000","last_became_active":"2024-09-12T17:59:38.984684+0000","last_became_peered":"2024-09-12T17:59:38.984684+0000","last_unstale":"2024-09-12T19:00:36.450205+0000","last_undegraded":"2024-09-12T19:00:36.450205+0000","last_fullsized":"2024-09-12T19:00:36.450205+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-12T19:00:36.449928+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-12T19:00:36.449928+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.449928+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:31.664959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6144,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'48","reported_seq":206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.772107+0000","last_change":"2024-09-12T19:00:41.771972+0000","last_active":"2024-09-12T19:00:41.772107+0000","last_peered":"2024-09-12T19:00:41.772107+0000","last_clean":"2024-09-12T19:00:41.772107+0000","last_became_active":"2024-09-12T17:55:59.346128+0000","last_became_peered":"2024-09-12T17:55:59.346128+0000","last_unstale":"2024-09-12T19:00:41.772107+0000","last_undegraded":"2024-09-12T19:00:41.772107+0000","last_fullsized":"2024-09-12T19:00:41.772107+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-12T19:00:41.771779+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-12T19:00:41.771779+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.771779+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:56.531299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":194,"num_write":71,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:58.739694+0000","last_change":"2024-09-12T19:00:58.739694+0000","last_active":"2024-09-12T19:00:58.739694+0000","last_peered":"2024-09-12T19:00:58.739694+0000","last_clean":"2024-09-12T19:00:58.739694+0000","last_became_active":"2024-09-12T18:19:57.848892+0000","last_became_peered":"2024-09-12T18:19:57.848892+0000","last_unstale":"2024-09-12T19:00:58.739694+0000","last_undegraded":"2024-09-12T19:00:58.739694+0000","last_fullsized":"2024-09-12T19:00:58.739694+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:58.739434+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:58.739434+0000","last_clean_scrub_stamp":"2024-09-12T19:00:58.739434+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:30.515044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.475789+0000","last_change":"2024-09-12T19:00:42.475789+0000","last_active":"2024-09-12T19:00:42.475789+0000","last_peered":"2024-09-12T19:00:42.475789+0000","last_clean":"2024-09-12T19:00:42.475789+0000","last_became_active":"2024-09-12T17:59:43.034558+0000","last_became_peered":"2024-09-12T17:59:43.034558+0000","last_unstale":"2024-09-12T19:00:42.475789+0000","last_undegraded":"2024-09-12T19:00:42.475789+0000","last_fullsized":"2024-09-12T19:00:42.475789+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:42.475526+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:42.475526+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.475526+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:40.704163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:54.097082+0000","last_change":"2024-09-12T19:00:54.097082+0000","last_active":"2024-09-12T19:00:54.097082+0000","last_peered":"2024-09-12T19:00:54.097082+0000","last_clean":"2024-09-12T19:00:54.097082+0000","last_became_active":"2024-09-12T17:59:38.973403+0000","last_became_peered":"2024-09-12T17:59:38.973403+0000","last_unstale":"2024-09-12T19:00:54.097082+0000","last_undegraded":"2024-09-12T19:00:54.097082+0000","last_fullsized":"2024-09-12T19:00:54.097082+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:00:54.096879+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:00:54.096879+0000","last_clean_scrub_stamp":"2024-09-12T19:00:54.096879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:53.218842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'38","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.765771+0000","last_change":"2024-09-12T19:00:42.765597+0000","last_active":"2024-09-12T19:00:42.765771+0000","last_peered":"2024-09-12T19:00:42.765771+0000","last_clean":"2024-09-12T19:00:42.765771+0000","last_became_active":"2024-09-12T17:55:59.345382+0000","last_became_peered":"2024-09-12T17:55:59.345382+0000","last_unstale":"2024-09-12T19:00:42.765771+0000","last_undegraded":"2024-09-12T19:00:42.765771+0000","last_fullsized":"2024-09-12T19:00:42.765771+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-12T19:00:42.765400+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-12T19:00:42.765400+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.765400+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:19.605112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":134,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:01.082681+0000","last_change":"2024-09-12T19:01:01.082681+0000","last_active":"2024-09-12T19:01:01.082681+0000","last_peered":"2024-09-12T19:01:01.082681+0000","last_clean":"2024-09-12T19:01:01.082681+0000","last_became_active":"2024-09-12T18:19:57.843489+0000","last_became_peered":"2024-09-12T18:19:57.843489+0000","last_unstale":"2024-09-12T19:01:01.082681+0000","last_undegraded":"2024-09-12T19:01:01.082681+0000","last_fullsized":"2024-09-12T19:01:01.082681+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:01:01.082503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:01:01.082503+0000","last_clean_scrub_stamp":"2024-09-12T19:01:01.082503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:23.789597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:53.720050+0000","last_change":"2024-09-12T19:00:53.720050+0000","last_active":"2024-09-12T19:00:53.720050+0000","last_peered":"2024-09-12T19:00:53.720050+0000","last_clean":"2024-09-12T19:00:53.720050+0000","last_became_active":"2024-09-12T17:59:43.022592+0000","last_became_peered":"2024-09-12T17:59:43.022592+0000","last_unstale":"2024-09-12T19:00:53.720050+0000","last_undegraded":"2024-09-12T19:00:53.720050+0000","last_fullsized":"2024-09-12T19:00:53.720050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:53.719837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:53.719837+0000","last_clean_scrub_stamp":"2024-09-12T19:00:53.719837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:00.858786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'3","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.839518+0000","last_change":"2024-09-12T19:00:43.839518+0000","last_active":"2024-09-12T19:00:43.839518+0000","last_peered":"2024-09-12T19:00:43.839518+0000","last_clean":"2024-09-12T19:00:43.839518+0000","last_became_active":"2024-09-12T17:59:38.975635+0000","last_became_peered":"2024-09-12T17:59:38.975635+0000","last_unstale":"2024-09-12T19:00:43.839518+0000","last_undegraded":"2024-09-12T19:00:43.839518+0000","last_fullsized":"2024-09-12T19:00:43.839518+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T19:00:43.839286+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T19:00:43.839286+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.839286+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:23.415859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'44","reported_seq":189,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.290898+0000","last_change":"2024-09-12T19:00:32.290763+0000","last_active":"2024-09-12T19:00:32.290898+0000","last_peered":"2024-09-12T19:00:32.290898+0000","last_clean":"2024-09-12T19:00:32.290898+0000","last_became_active":"2024-09-12T17:55:59.351492+0000","last_became_peered":"2024-09-12T17:55:59.351492+0000","last_unstale":"2024-09-12T19:00:32.290898+0000","last_undegraded":"2024-09-12T19:00:32.290898+0000","last_fullsized":"2024-09-12T19:00:32.290898+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T19:00:32.290574+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T19:00:32.290574+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.290574+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.374730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":151,"num_write":82,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:54.700446+0000","last_change":"2024-09-12T19:00:54.700446+0000","last_active":"2024-09-12T19:00:54.700446+0000","last_peered":"2024-09-12T19:00:54.700446+0000","last_clean":"2024-09-12T19:00:54.700446+0000","last_became_active":"2024-09-12T18:19:57.855547+0000","last_became_peered":"2024-09-12T18:19:57.855547+0000","last_unstale":"2024-09-12T19:00:54.700446+0000","last_undegraded":"2024-09-12T19:00:54.700446+0000","last_fullsized":"2024-09-12T19:00:54.700446+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:54.700266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:54.700266+0000","last_clean_scrub_stamp":"2024-09-12T19:00:54.700266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:55.916944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'12","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:01:00.053927+0000","last_change":"2024-09-12T19:01:00.053927+0000","last_active":"2024-09-12T19:01:00.053927+0000","last_peered":"2024-09-12T19:01:00.053927+0000","last_clean":"2024-09-12T19:01:00.053927+0000","last_became_active":"2024-09-12T17:59:43.009629+0000","last_became_peered":"2024-09-12T17:59:43.009629+0000","last_unstale":"2024-09-12T19:01:00.053927+0000","last_undegraded":"2024-09-12T19:01:00.053927+0000","last_fullsized":"2024-09-12T19:01:00.053927+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-12T19:01:00.053759+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-12T19:01:00.053759+0000","last_clean_scrub_stamp":"2024-09-12T19:01:00.053759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:35.067519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":22,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'3","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.723174+0000","last_change":"2024-09-12T19:00:47.723174+0000","last_active":"2024-09-12T19:00:47.723174+0000","last_peered":"2024-09-12T19:00:47.723174+0000","last_clean":"2024-09-12T19:00:47.723174+0000","last_became_active":"2024-09-12T17:59:38.979704+0000","last_became_peered":"2024-09-12T17:59:38.979704+0000","last_unstale":"2024-09-12T19:00:47.723174+0000","last_undegraded":"2024-09-12T19:00:47.723174+0000","last_fullsized":"2024-09-12T19:00:47.723174+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:47.722886+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:47.722886+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.722886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:51.921401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.310746+0000","last_change":"2024-09-12T19:00:44.310597+0000","last_active":"2024-09-12T19:00:44.310746+0000","last_peered":"2024-09-12T19:00:44.310746+0000","last_clean":"2024-09-12T19:00:44.310746+0000","last_became_active":"2024-09-12T17:55:59.356402+0000","last_became_peered":"2024-09-12T17:55:59.356402+0000","last_unstale":"2024-09-12T19:00:44.310746+0000","last_undegraded":"2024-09-12T19:00:44.310746+0000","last_fullsized":"2024-09-12T19:00:44.310746+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T19:00:44.310418+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T19:00:44.310418+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.310418+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:57.608628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:50.141952+0000","last_change":"2024-09-12T19:00:50.141952+0000","last_active":"2024-09-12T19:00:50.141952+0000","last_peered":"2024-09-12T19:00:50.141952+0000","last_clean":"2024-09-12T19:00:50.141952+0000","last_became_active":"2024-09-12T18:19:57.859591+0000","last_became_peered":"2024-09-12T18:19:57.859591+0000","last_unstale":"2024-09-12T19:00:50.141952+0000","last_undegraded":"2024-09-12T19:00:50.141952+0000","last_fullsized":"2024-09-12T19:00:50.141952+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:50.141776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:50.141776+0000","last_clean_scrub_stamp":"2024-09-12T19:00:50.141776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:27.206812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:55.109520+0000","last_change":"2024-09-12T19:00:55.109520+0000","last_active":"2024-09-12T19:00:55.109520+0000","last_peered":"2024-09-12T19:00:55.109520+0000","last_clean":"2024-09-12T19:00:55.109520+0000","last_became_active":"2024-09-12T17:59:43.008547+0000","last_became_peered":"2024-09-12T17:59:43.008547+0000","last_unstale":"2024-09-12T19:00:55.109520+0000","last_undegraded":"2024-09-12T19:00:55.109520+0000","last_fullsized":"2024-09-12T19:00:55.109520+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:55.109304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:55.109304+0000","last_clean_scrub_stamp":"2024-09-12T19:00:55.109304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:48.499558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.602025+0000","last_change":"2024-09-12T19:00:27.602025+0000","last_active":"2024-09-12T19:00:27.602025+0000","last_peered":"2024-09-12T19:00:27.602025+0000","last_clean":"2024-09-12T19:00:27.602025+0000","last_became_active":"2024-09-12T17:59:38.968249+0000","last_became_peered":"2024-09-12T17:59:38.968249+0000","last_unstale":"2024-09-12T19:00:27.602025+0000","last_undegraded":"2024-09-12T19:00:27.602025+0000","last_fullsized":"2024-09-12T19:00:27.602025+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T19:00:27.601798+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T19:00:27.601798+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.601798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:48.890180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'17","reported_seq":119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.301017+0000","last_change":"2024-09-12T19:00:33.300836+0000","last_active":"2024-09-12T19:00:33.301017+0000","last_peered":"2024-09-12T19:00:33.301017+0000","last_clean":"2024-09-12T19:00:33.301017+0000","last_became_active":"2024-09-12T17:55:59.354383+0000","last_became_peered":"2024-09-12T17:55:59.354383+0000","last_unstale":"2024-09-12T19:00:33.301017+0000","last_undegraded":"2024-09-12T19:00:33.301017+0000","last_fullsized":"2024-09-12T19:00:33.301017+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-12T19:00:33.300644+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-12T19:00:33.300644+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.300644+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:06.669201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.493345+0000","last_change":"2024-09-12T19:00:48.493345+0000","last_active":"2024-09-12T19:00:48.493345+0000","last_peered":"2024-09-12T19:00:48.493345+0000","last_clean":"2024-09-12T19:00:48.493345+0000","last_became_active":"2024-09-12T18:19:57.858987+0000","last_became_peered":"2024-09-12T18:19:57.858987+0000","last_unstale":"2024-09-12T19:00:48.493345+0000","last_undegraded":"2024-09-12T19:00:48.493345+0000","last_fullsized":"2024-09-12T19:00:48.493345+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:48.493161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:48.493161+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.493161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:52.293664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'10","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:50.727759+0000","last_change":"2024-09-12T19:00:50.727759+0000","last_active":"2024-09-12T19:00:50.727759+0000","last_peered":"2024-09-12T19:00:50.727759+0000","last_clean":"2024-09-12T19:00:50.727759+0000","last_became_active":"2024-09-12T17:59:43.022405+0000","last_became_peered":"2024-09-12T17:59:43.022405+0000","last_unstale":"2024-09-12T19:00:50.727759+0000","last_undegraded":"2024-09-12T19:00:50.727759+0000","last_fullsized":"2024-09-12T19:00:50.727759+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-12T19:00:50.727575+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-12T19:00:50.727575+0000","last_clean_scrub_stamp":"2024-09-12T19:00:50.727575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:33.553881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12356,"num_write":10,"num_write_kb":8260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.207293+0000","last_change":"2024-09-12T19:00:44.207293+0000","last_active":"2024-09-12T19:00:44.207293+0000","last_peered":"2024-09-12T19:00:44.207293+0000","last_clean":"2024-09-12T19:00:44.207293+0000","last_became_active":"2024-09-12T17:59:38.964439+0000","last_became_peered":"2024-09-12T17:59:38.964439+0000","last_unstale":"2024-09-12T19:00:44.207293+0000","last_undegraded":"2024-09-12T19:00:44.207293+0000","last_fullsized":"2024-09-12T19:00:44.207293+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:00:44.207118+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:00:44.207118+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.207118+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:00.319203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'114","reported_seq":424,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.769023+0000","last_change":"2024-09-12T19:00:46.768851+0000","last_active":"2024-09-12T19:00:46.769023+0000","last_peered":"2024-09-12T19:00:46.769023+0000","last_clean":"2024-09-12T19:00:46.769023+0000","last_became_active":"2024-09-12T17:55:59.360296+0000","last_became_peered":"2024-09-12T17:55:59.360296+0000","last_unstale":"2024-09-12T19:00:46.769023+0000","last_undegraded":"2024-09-12T19:00:46.769023+0000","last_fullsized":"2024-09-12T19:00:46.769023+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T19:00:46.768666+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T19:00:46.768666+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.768666+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:24.705477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":493,"num_write":148,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:54.774098+0000","last_change":"2024-09-12T19:00:54.774098+0000","last_active":"2024-09-12T19:00:54.774098+0000","last_peered":"2024-09-12T19:00:54.774098+0000","last_clean":"2024-09-12T19:00:54.774098+0000","last_became_active":"2024-09-12T18:19:57.870563+0000","last_became_peered":"2024-09-12T18:19:57.870563+0000","last_unstale":"2024-09-12T19:00:54.774098+0000","last_undegraded":"2024-09-12T19:00:54.774098+0000","last_fullsized":"2024-09-12T19:00:54.774098+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:54.773916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:54.773916+0000","last_clean_scrub_stamp":"2024-09-12T19:00:54.773916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:34.035437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:50.807525+0000","last_change":"2024-09-12T19:00:50.807525+0000","last_active":"2024-09-12T19:00:50.807525+0000","last_peered":"2024-09-12T19:00:50.807525+0000","last_clean":"2024-09-12T19:00:50.807525+0000","last_became_active":"2024-09-12T17:59:43.018869+0000","last_became_peered":"2024-09-12T17:59:43.018869+0000","last_unstale":"2024-09-12T19:00:50.807525+0000","last_undegraded":"2024-09-12T19:00:50.807525+0000","last_fullsized":"2024-09-12T19:00:50.807525+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:50.807303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:50.807303+0000","last_clean_scrub_stamp":"2024-09-12T19:00:50.807303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:09.276143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:48.750739+0000","last_change":"2024-09-12T19:00:48.750739+0000","last_active":"2024-09-12T19:00:48.750739+0000","last_peered":"2024-09-12T19:00:48.750739+0000","last_clean":"2024-09-12T19:00:48.750739+0000","last_became_active":"2024-09-12T17:59:38.988237+0000","last_became_peered":"2024-09-12T17:59:38.988237+0000","last_unstale":"2024-09-12T19:00:48.750739+0000","last_undegraded":"2024-09-12T19:00:48.750739+0000","last_fullsized":"2024-09-12T19:00:48.750739+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:48.750546+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:48.750546+0000","last_clean_scrub_stamp":"2024-09-12T19:00:48.750546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:13.103954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'6","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.391627+0000","last_change":"2024-09-12T19:00:38.391627+0000","last_active":"2024-09-12T19:00:38.391627+0000","last_peered":"2024-09-12T19:00:38.391627+0000","last_clean":"2024-09-12T19:00:38.391627+0000","last_became_active":"2024-09-12T17:55:59.353823+0000","last_became_peered":"2024-09-12T17:55:59.353823+0000","last_unstale":"2024-09-12T19:00:38.391627+0000","last_undegraded":"2024-09-12T19:00:38.391627+0000","last_fullsized":"2024-09-12T19:00:38.391627+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:38.391331+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:38.391331+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.391331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.195971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.608345+0000","last_change":"2024-09-12T19:00:32.608185+0000","last_active":"2024-09-12T19:00:32.608345+0000","last_peered":"2024-09-12T19:00:32.608345+0000","last_clean":"2024-09-12T19:00:32.608345+0000","last_became_active":"2024-09-12T18:19:57.839756+0000","last_became_peered":"2024-09-12T18:19:57.839756+0000","last_unstale":"2024-09-12T19:00:32.608345+0000","last_undegraded":"2024-09-12T19:00:32.608345+0000","last_fullsized":"2024-09-12T19:00:32.608345+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:32.608001+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:32.608001+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.608001+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:41.725203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.435243+0000","last_change":"2024-09-12T19:00:41.435243+0000","last_active":"2024-09-12T19:00:41.435243+0000","last_peered":"2024-09-12T19:00:41.435243+0000","last_clean":"2024-09-12T19:00:41.435243+0000","last_became_active":"2024-09-12T17:59:43.033049+0000","last_became_peered":"2024-09-12T17:59:43.033049+0000","last_unstale":"2024-09-12T19:00:41.435243+0000","last_undegraded":"2024-09-12T19:00:41.435243+0000","last_fullsized":"2024-09-12T19:00:41.435243+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:41.435048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:41.435048+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.435048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.077538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'9","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.719288+0000","last_change":"2024-09-12T19:00:43.719288+0000","last_active":"2024-09-12T19:00:43.719288+0000","last_peered":"2024-09-12T19:00:43.719288+0000","last_clean":"2024-09-12T19:00:43.719288+0000","last_became_active":"2024-09-12T17:59:38.985971+0000","last_became_peered":"2024-09-12T17:59:38.985971+0000","last_unstale":"2024-09-12T19:00:43.719288+0000","last_undegraded":"2024-09-12T19:00:43.719288+0000","last_fullsized":"2024-09-12T19:00:43.719288+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'9","last_scrub_stamp":"2024-09-12T19:00:43.719096+0000","last_deep_scrub":"261'9","last_deep_scrub_stamp":"2024-09-12T19:00:43.719096+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.719096+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:44.602293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'13","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.262143+0000","last_change":"2024-09-12T19:00:42.262143+0000","last_active":"2024-09-12T19:00:42.262143+0000","last_peered":"2024-09-12T19:00:42.262143+0000","last_clean":"2024-09-12T19:00:42.262143+0000","last_became_active":"2024-09-12T17:55:59.352474+0000","last_became_peered":"2024-09-12T17:55:59.352474+0000","last_unstale":"2024-09-12T19:00:42.262143+0000","last_undegraded":"2024-09-12T19:00:42.262143+0000","last_fullsized":"2024-09-12T19:00:42.262143+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T19:00:42.261969+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T19:00:42.261969+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.261969+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:15:23.236744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:58.065399+0000","last_change":"2024-09-12T19:00:58.065221+0000","last_active":"2024-09-12T19:00:58.065399+0000","last_peered":"2024-09-12T19:00:58.065399+0000","last_clean":"2024-09-12T19:00:58.065399+0000","last_became_active":"2024-09-12T18:19:57.846907+0000","last_became_peered":"2024-09-12T18:19:57.846907+0000","last_unstale":"2024-09-12T19:00:58.065399+0000","last_undegraded":"2024-09-12T19:00:58.065399+0000","last_fullsized":"2024-09-12T19:00:58.065399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:58.065041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:58.065041+0000","last_clean_scrub_stamp":"2024-09-12T19:00:58.065041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:06.942015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'12","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.175246+0000","last_change":"2024-09-12T19:00:47.175246+0000","last_active":"2024-09-12T19:00:47.175246+0000","last_peered":"2024-09-12T19:00:47.175246+0000","last_clean":"2024-09-12T19:00:47.175246+0000","last_became_active":"2024-09-12T17:59:43.022991+0000","last_became_peered":"2024-09-12T17:59:43.022991+0000","last_unstale":"2024-09-12T19:00:47.175246+0000","last_undegraded":"2024-09-12T19:00:47.175246+0000","last_fullsized":"2024-09-12T19:00:47.175246+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-12T19:00:47.175059+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-12T19:00:47.175059+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.175059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:22.362047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20482,"num_write":22,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'2","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:44.753290+0000","last_change":"2024-09-12T19:00:44.753290+0000","last_active":"2024-09-12T19:00:44.753290+0000","last_peered":"2024-09-12T19:00:44.753290+0000","last_clean":"2024-09-12T19:00:44.753290+0000","last_became_active":"2024-09-12T17:59:38.989530+0000","last_became_peered":"2024-09-12T17:59:38.989530+0000","last_unstale":"2024-09-12T19:00:44.753290+0000","last_undegraded":"2024-09-12T19:00:44.753290+0000","last_fullsized":"2024-09-12T19:00:44.753290+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:44.753097+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:44.753097+0000","last_clean_scrub_stamp":"2024-09-12T19:00:44.753097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:31.423311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'9","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.870652+0000","last_change":"2024-09-12T19:00:42.870652+0000","last_active":"2024-09-12T19:00:42.870652+0000","last_peered":"2024-09-12T19:00:42.870652+0000","last_clean":"2024-09-12T19:00:42.870652+0000","last_became_active":"2024-09-12T17:55:59.344251+0000","last_became_peered":"2024-09-12T17:55:59.344251+0000","last_unstale":"2024-09-12T19:00:42.870652+0000","last_undegraded":"2024-09-12T19:00:42.870652+0000","last_fullsized":"2024-09-12T19:00:42.870652+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T19:00:42.870477+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T19:00:42.870477+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.870477+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:19.295504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:57.059209+0000","last_change":"2024-09-12T19:00:57.059209+0000","last_active":"2024-09-12T19:00:57.059209+0000","last_peered":"2024-09-12T19:00:57.059209+0000","last_clean":"2024-09-12T19:00:57.059209+0000","last_became_active":"2024-09-12T18:19:57.847330+0000","last_became_peered":"2024-09-12T18:19:57.847330+0000","last_unstale":"2024-09-12T19:00:57.059209+0000","last_undegraded":"2024-09-12T19:00:57.059209+0000","last_fullsized":"2024-09-12T19:00:57.059209+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:57.059021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:57.059021+0000","last_clean_scrub_stamp":"2024-09-12T19:00:57.059021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:33.004959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.297210+0000","last_change":"2024-09-12T19:00:36.297210+0000","last_active":"2024-09-12T19:00:36.297210+0000","last_peered":"2024-09-12T19:00:36.297210+0000","last_clean":"2024-09-12T19:00:36.297210+0000","last_became_active":"2024-09-12T17:59:43.028305+0000","last_became_peered":"2024-09-12T17:59:43.028305+0000","last_unstale":"2024-09-12T19:00:36.297210+0000","last_undegraded":"2024-09-12T19:00:36.297210+0000","last_fullsized":"2024-09-12T19:00:36.297210+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:00:36.297030+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:00:36.297030+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.297030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:06.922209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.423999+0000","last_change":"2024-09-12T19:00:39.423999+0000","last_active":"2024-09-12T19:00:39.423999+0000","last_peered":"2024-09-12T19:00:39.423999+0000","last_clean":"2024-09-12T19:00:39.423999+0000","last_became_active":"2024-09-12T17:59:38.986062+0000","last_became_peered":"2024-09-12T17:59:38.986062+0000","last_unstale":"2024-09-12T19:00:39.423999+0000","last_undegraded":"2024-09-12T19:00:39.423999+0000","last_fullsized":"2024-09-12T19:00:39.423999+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T19:00:39.423814+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T19:00:39.423814+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.423814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:26.741012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'31","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.308812+0000","last_change":"2024-09-12T19:00:30.308634+0000","last_active":"2024-09-12T19:00:30.308812+0000","last_peered":"2024-09-12T19:00:30.308812+0000","last_clean":"2024-09-12T19:00:30.308812+0000","last_became_active":"2024-09-12T17:55:59.345469+0000","last_became_peered":"2024-09-12T17:55:59.345469+0000","last_unstale":"2024-09-12T19:00:30.308812+0000","last_undegraded":"2024-09-12T19:00:30.308812+0000","last_fullsized":"2024-09-12T19:00:30.308812+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'31","last_scrub_stamp":"2024-09-12T19:00:30.308449+0000","last_deep_scrub":"261'31","last_deep_scrub_stamp":"2024-09-12T19:00:30.308449+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.308449+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:35.666105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":47,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:55.729066+0000","last_change":"2024-09-12T19:00:55.729066+0000","last_active":"2024-09-12T19:00:55.729066+0000","last_peered":"2024-09-12T19:00:55.729066+0000","last_clean":"2024-09-12T19:00:55.729066+0000","last_became_active":"2024-09-12T18:19:57.844161+0000","last_became_peered":"2024-09-12T18:19:57.844161+0000","last_unstale":"2024-09-12T19:00:55.729066+0000","last_undegraded":"2024-09-12T19:00:55.729066+0000","last_fullsized":"2024-09-12T19:00:55.729066+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:55.728879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:55.728879+0000","last_clean_scrub_stamp":"2024-09-12T19:00:55.728879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.137170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:47.805242+0000","last_change":"2024-09-12T19:00:47.805242+0000","last_active":"2024-09-12T19:00:47.805242+0000","last_peered":"2024-09-12T19:00:47.805242+0000","last_clean":"2024-09-12T19:00:47.805242+0000","last_became_active":"2024-09-12T17:59:43.019274+0000","last_became_peered":"2024-09-12T17:59:43.019274+0000","last_unstale":"2024-09-12T19:00:47.805242+0000","last_undegraded":"2024-09-12T19:00:47.805242+0000","last_fullsized":"2024-09-12T19:00:47.805242+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:47.805023+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:47.805023+0000","last_clean_scrub_stamp":"2024-09-12T19:00:47.805023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:09.189463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.292917+0000","last_change":"2024-09-12T19:00:37.292917+0000","last_active":"2024-09-12T19:00:37.292917+0000","last_peered":"2024-09-12T19:00:37.292917+0000","last_clean":"2024-09-12T19:00:37.292917+0000","last_became_active":"2024-09-12T17:59:38.968500+0000","last_became_peered":"2024-09-12T17:59:38.968500+0000","last_unstale":"2024-09-12T19:00:37.292917+0000","last_undegraded":"2024-09-12T19:00:37.292917+0000","last_fullsized":"2024-09-12T19:00:37.292917+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T19:00:37.292713+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T19:00:37.292713+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.292713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:31.367201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1072,"num_write":18,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.785035+0000","last_change":"2024-09-12T19:00:40.785035+0000","last_active":"2024-09-12T19:00:40.785035+0000","last_peered":"2024-09-12T19:00:40.785035+0000","last_clean":"2024-09-12T19:00:40.785035+0000","last_became_active":"2024-09-12T17:55:59.354620+0000","last_became_peered":"2024-09-12T17:55:59.354620+0000","last_unstale":"2024-09-12T19:00:40.785035+0000","last_undegraded":"2024-09-12T19:00:40.785035+0000","last_fullsized":"2024-09-12T19:00:40.785035+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-12T19:00:40.784849+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-12T19:00:40.784849+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.784849+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:26.840696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":145,"num_write":78,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'397","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.897784+0000","last_change":"2024-09-12T19:00:18.897784+0000","last_active":"2024-09-12T19:00:18.897784+0000","last_peered":"2024-09-12T19:00:18.897784+0000","last_clean":"2024-09-12T19:00:18.897784+0000","last_became_active":"2024-09-12T17:40:18.784159+0000","last_became_peered":"2024-09-12T17:40:18.784159+0000","last_unstale":"2024-09-12T19:00:18.897784+0000","last_undegraded":"2024-09-12T19:00:18.897784+0000","last_fullsized":"2024-09-12T19:00:18.897784+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:18.897555+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:18.897555+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.897555+0000","objects_scrubbed":10,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:40.787061+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813897,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":527,"num_read_kb":37913,"num_write":1207,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'93","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.361475+0000","last_change":"2024-09-12T19:00:22.361348+0000","last_active":"2024-09-12T19:00:22.361475+0000","last_peered":"2024-09-12T19:00:22.361475+0000","last_clean":"2024-09-12T19:00:22.361475+0000","last_became_active":"2024-09-12T17:40:20.138680+0000","last_became_peered":"2024-09-12T17:40:20.138680+0000","last_unstale":"2024-09-12T19:00:22.361475+0000","last_undegraded":"2024-09-12T19:00:22.361475+0000","last_fullsized":"2024-09-12T19:00:22.361475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-12T19:00:22.361173+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-12T19:00:22.361173+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.361173+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:49.691123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'329","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.454755+0000","last_change":"2024-09-12T19:00:12.454755+0000","last_active":"2024-09-12T19:00:12.454755+0000","last_peered":"2024-09-12T19:00:12.454755+0000","last_clean":"2024-09-12T19:00:12.454755+0000","last_became_active":"2024-09-12T17:40:18.761214+0000","last_became_peered":"2024-09-12T17:40:18.761214+0000","last_unstale":"2024-09-12T19:00:12.454755+0000","last_undegraded":"2024-09-12T19:00:12.454755+0000","last_fullsized":"2024-09-12T19:00:12.454755+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T19:00:12.454463+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T19:00:12.454463+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.454463+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:45.994067+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4802709,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":37097,"num_write":958,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'256","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.944120+0000","last_change":"2024-09-12T19:00:22.944120+0000","last_active":"2024-09-12T19:00:22.944120+0000","last_peered":"2024-09-12T19:00:22.944120+0000","last_clean":"2024-09-12T19:00:22.944120+0000","last_became_active":"2024-09-12T17:40:20.133791+0000","last_became_peered":"2024-09-12T17:40:20.133791+0000","last_unstale":"2024-09-12T19:00:22.944120+0000","last_undegraded":"2024-09-12T19:00:22.944120+0000","last_fullsized":"2024-09-12T19:00:22.944120+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'256","last_scrub_stamp":"2024-09-12T19:00:22.943873+0000","last_deep_scrub":"264'256","last_deep_scrub_stamp":"2024-09-12T19:00:22.943873+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.943873+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:13.423617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1087,"num_read_kb":867,"num_write":420,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'407","reported_seq":1075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.350302+0000","last_change":"2024-09-12T19:00:12.350302+0000","last_active":"2024-09-12T19:00:12.350302+0000","last_peered":"2024-09-12T19:00:12.350302+0000","last_clean":"2024-09-12T19:00:12.350302+0000","last_became_active":"2024-09-12T17:40:18.755606+0000","last_became_peered":"2024-09-12T17:40:18.755606+0000","last_unstale":"2024-09-12T19:00:12.350302+0000","last_undegraded":"2024-09-12T19:00:12.350302+0000","last_fullsized":"2024-09-12T19:00:12.350302+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T19:00:12.350095+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T19:00:12.350095+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.350095+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:10.932589+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457546,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":570,"num_read_kb":26533,"num_write":1277,"num_write_kb":46376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'130","reported_seq":768,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.867775+0000","last_change":"2024-09-12T19:00:24.867775+0000","last_active":"2024-09-12T19:00:24.867775+0000","last_peered":"2024-09-12T19:00:24.867775+0000","last_clean":"2024-09-12T19:00:24.867775+0000","last_became_active":"2024-09-12T17:40:20.130123+0000","last_became_peered":"2024-09-12T17:40:20.130123+0000","last_unstale":"2024-09-12T19:00:24.867775+0000","last_undegraded":"2024-09-12T19:00:24.867775+0000","last_fullsized":"2024-09-12T19:00:24.867775+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T19:00:24.867600+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T19:00:24.867600+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.867600+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:11.063827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":589,"num_read_kb":499,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'345","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.351078+0000","last_change":"2024-09-12T19:00:17.350905+0000","last_active":"2024-09-12T19:00:17.351078+0000","last_peered":"2024-09-12T19:00:17.351078+0000","last_clean":"2024-09-12T19:00:17.351078+0000","last_became_active":"2024-09-12T17:40:18.768170+0000","last_became_peered":"2024-09-12T17:40:18.768170+0000","last_unstale":"2024-09-12T19:00:17.351078+0000","last_undegraded":"2024-09-12T19:00:17.351078+0000","last_fullsized":"2024-09-12T19:00:17.351078+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-12T19:00:17.350715+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-12T19:00:17.350715+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.350715+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.875766+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388668,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":59190,"num_write":1207,"num_write_kb":44467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'100","reported_seq":709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.333064+0000","last_change":"2024-09-12T19:00:21.332900+0000","last_active":"2024-09-12T19:00:21.333064+0000","last_peered":"2024-09-12T19:00:21.333064+0000","last_clean":"2024-09-12T19:00:21.333064+0000","last_became_active":"2024-09-12T17:40:20.114923+0000","last_became_peered":"2024-09-12T17:40:20.114923+0000","last_unstale":"2024-09-12T19:00:21.333064+0000","last_undegraded":"2024-09-12T19:00:21.333064+0000","last_fullsized":"2024-09-12T19:00:21.333064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T19:00:21.332717+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T19:00:21.332717+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.332717+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:04.580548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":408,"num_write":151,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'318","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.885850+0000","last_change":"2024-09-12T19:00:14.885692+0000","last_active":"2024-09-12T19:00:14.885850+0000","last_peered":"2024-09-12T19:00:14.885850+0000","last_clean":"2024-09-12T19:00:14.885850+0000","last_became_active":"2024-09-12T17:40:18.778991+0000","last_became_peered":"2024-09-12T17:40:18.778991+0000","last_unstale":"2024-09-12T19:00:14.885850+0000","last_undegraded":"2024-09-12T19:00:14.885850+0000","last_fullsized":"2024-09-12T19:00:14.885850+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-12T19:00:14.885480+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-12T19:00:14.885480+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.885480+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:10.907616+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311787,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":19945,"num_write":986,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'100","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.464947+0000","last_change":"2024-09-12T19:00:18.464796+0000","last_active":"2024-09-12T19:00:18.464947+0000","last_peered":"2024-09-12T19:00:18.464947+0000","last_clean":"2024-09-12T19:00:18.464947+0000","last_became_active":"2024-09-12T17:40:20.127556+0000","last_became_peered":"2024-09-12T17:40:20.127556+0000","last_unstale":"2024-09-12T19:00:18.464947+0000","last_undegraded":"2024-09-12T19:00:18.464947+0000","last_fullsized":"2024-09-12T19:00:18.464947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T19:00:18.464562+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T19:00:18.464562+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.464562+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:00.473679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":458,"num_read_kb":378,"num_write":157,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'384","reported_seq":1012,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.311697+0000","last_change":"2024-09-12T19:00:16.311566+0000","last_active":"2024-09-12T19:00:16.311697+0000","last_peered":"2024-09-12T19:00:16.311697+0000","last_clean":"2024-09-12T19:00:16.311697+0000","last_became_active":"2024-09-12T17:40:18.760958+0000","last_became_peered":"2024-09-12T17:40:18.760958+0000","last_unstale":"2024-09-12T19:00:16.311697+0000","last_undegraded":"2024-09-12T19:00:16.311697+0000","last_fullsized":"2024-09-12T19:00:16.311697+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-12T19:00:16.311345+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-12T19:00:16.311345+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.311345+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:52.751993+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":8666,"num_write":1215,"num_write_kb":27182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'123","reported_seq":763,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.886918+0000","last_change":"2024-09-12T19:00:25.886918+0000","last_active":"2024-09-12T19:00:25.886918+0000","last_peered":"2024-09-12T19:00:25.886918+0000","last_clean":"2024-09-12T19:00:25.886918+0000","last_became_active":"2024-09-12T17:40:20.132985+0000","last_became_peered":"2024-09-12T17:40:20.132985+0000","last_unstale":"2024-09-12T19:00:25.886918+0000","last_undegraded":"2024-09-12T19:00:25.886918+0000","last_fullsized":"2024-09-12T19:00:25.886918+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-09-12T19:00:25.886728+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-09-12T19:00:25.886728+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.886728+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:06.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":462,"num_write":179,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'403","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.903729+0000","last_change":"2024-09-12T19:00:17.903504+0000","last_active":"2024-09-12T19:00:17.903729+0000","last_peered":"2024-09-12T19:00:17.903729+0000","last_clean":"2024-09-12T19:00:17.903729+0000","last_became_active":"2024-09-12T17:40:18.761056+0000","last_became_peered":"2024-09-12T17:40:18.761056+0000","last_unstale":"2024-09-12T19:00:17.903729+0000","last_undegraded":"2024-09-12T19:00:17.903729+0000","last_fullsized":"2024-09-12T19:00:17.903729+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'403","last_scrub_stamp":"2024-09-12T19:00:17.903214+0000","last_deep_scrub":"264'403","last_deep_scrub_stamp":"2024-09-12T19:00:17.903214+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.903214+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:06.436732+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":74800,"num_write":1233,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'208","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.298403+0000","last_change":"2024-09-12T19:00:25.298403+0000","last_active":"2024-09-12T19:00:25.298403+0000","last_peered":"2024-09-12T19:00:25.298403+0000","last_clean":"2024-09-12T19:00:25.298403+0000","last_became_active":"2024-09-12T17:40:20.134441+0000","last_became_peered":"2024-09-12T17:40:20.134441+0000","last_unstale":"2024-09-12T19:00:25.298403+0000","last_undegraded":"2024-09-12T19:00:25.298403+0000","last_fullsized":"2024-09-12T19:00:25.298403+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T19:00:25.298122+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T19:00:25.298122+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.298122+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:23.155447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":897,"num_read_kb":734,"num_write":311,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'373","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.647147+0000","last_change":"2024-09-12T19:00:11.647011+0000","last_active":"2024-09-12T19:00:11.647147+0000","last_peered":"2024-09-12T19:00:11.647147+0000","last_clean":"2024-09-12T19:00:11.647147+0000","last_became_active":"2024-09-12T17:40:18.773843+0000","last_became_peered":"2024-09-12T17:40:18.773843+0000","last_unstale":"2024-09-12T19:00:11.647147+0000","last_undegraded":"2024-09-12T19:00:11.647147+0000","last_fullsized":"2024-09-12T19:00:11.647147+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T19:00:11.646768+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T19:00:11.646768+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.646768+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:20.752287+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":629,"num_read_kb":30255,"num_write":1158,"num_write_kb":52642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'233","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.570316+0000","last_change":"2024-09-12T19:00:15.570316+0000","last_active":"2024-09-12T19:00:15.570316+0000","last_peered":"2024-09-12T19:00:15.570316+0000","last_clean":"2024-09-12T19:00:15.570316+0000","last_became_active":"2024-09-12T17:40:20.120891+0000","last_became_peered":"2024-09-12T17:40:20.120891+0000","last_unstale":"2024-09-12T19:00:15.570316+0000","last_undegraded":"2024-09-12T19:00:15.570316+0000","last_fullsized":"2024-09-12T19:00:15.570316+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-12T19:00:15.570121+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-12T19:00:15.570121+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.570121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:40.079950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":858,"num_write":384,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'192","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.856800+0000","last_change":"2024-09-12T19:00:22.856800+0000","last_active":"2024-09-12T19:00:22.856800+0000","last_peered":"2024-09-12T19:00:22.856800+0000","last_clean":"2024-09-12T19:00:22.856800+0000","last_became_active":"2024-09-12T17:40:20.132466+0000","last_became_peered":"2024-09-12T17:40:20.132466+0000","last_unstale":"2024-09-12T19:00:22.856800+0000","last_undegraded":"2024-09-12T19:00:22.856800+0000","last_fullsized":"2024-09-12T19:00:22.856800+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-09-12T19:00:22.856632+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-09-12T19:00:22.856632+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.856632+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:33.052539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":674,"num_write":287,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'340","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.947779+0000","last_change":"2024-09-12T19:00:12.947508+0000","last_active":"2024-09-12T19:00:12.947779+0000","last_peered":"2024-09-12T19:00:12.947779+0000","last_clean":"2024-09-12T19:00:12.947779+0000","last_became_active":"2024-09-12T17:40:18.783282+0000","last_became_peered":"2024-09-12T17:40:18.783282+0000","last_unstale":"2024-09-12T19:00:12.947779+0000","last_undegraded":"2024-09-12T19:00:12.947779+0000","last_fullsized":"2024-09-12T19:00:12.947779+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-12T19:00:12.947254+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-12T19:00:12.947254+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.947254+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:14.588512+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":17792,"num_write":1019,"num_write_kb":32630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'129","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.953874+0000","last_change":"2024-09-12T19:00:20.953874+0000","last_active":"2024-09-12T19:00:20.953874+0000","last_peered":"2024-09-12T19:00:20.953874+0000","last_clean":"2024-09-12T19:00:20.953874+0000","last_became_active":"2024-09-12T17:40:20.143471+0000","last_became_peered":"2024-09-12T17:40:20.143471+0000","last_unstale":"2024-09-12T19:00:20.953874+0000","last_undegraded":"2024-09-12T19:00:20.953874+0000","last_fullsized":"2024-09-12T19:00:20.953874+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T19:00:20.953686+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T19:00:20.953686+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.953686+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:56.936299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":544,"num_read_kb":441,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'314","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.428631+0000","last_change":"2024-09-12T19:00:13.428631+0000","last_active":"2024-09-12T19:00:13.428631+0000","last_peered":"2024-09-12T19:00:13.428631+0000","last_clean":"2024-09-12T19:00:13.428631+0000","last_became_active":"2024-09-12T17:40:18.756814+0000","last_became_peered":"2024-09-12T17:40:18.756814+0000","last_unstale":"2024-09-12T19:00:13.428631+0000","last_undegraded":"2024-09-12T19:00:13.428631+0000","last_fullsized":"2024-09-12T19:00:13.428631+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T19:00:13.428455+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T19:00:13.428455+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.428455+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:27.159173+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048617,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":410,"num_read_kb":9611,"num_write":991,"num_write_kb":28982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'86","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.320660+0000","last_change":"2024-09-12T19:00:20.320660+0000","last_active":"2024-09-12T19:00:20.320660+0000","last_peered":"2024-09-12T19:00:20.320660+0000","last_clean":"2024-09-12T19:00:20.320660+0000","last_became_active":"2024-09-12T17:40:20.124104+0000","last_became_peered":"2024-09-12T17:40:20.124104+0000","last_unstale":"2024-09-12T19:00:20.320660+0000","last_undegraded":"2024-09-12T19:00:20.320660+0000","last_fullsized":"2024-09-12T19:00:20.320660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T19:00:20.320383+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T19:00:20.320383+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.320383+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:50.248150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":294,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'414","reported_seq":1113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.412693+0000","last_change":"2024-09-12T19:00:11.412693+0000","last_active":"2024-09-12T19:00:11.412693+0000","last_peered":"2024-09-12T19:00:11.412693+0000","last_clean":"2024-09-12T19:00:11.412693+0000","last_became_active":"2024-09-12T17:40:18.773787+0000","last_became_peered":"2024-09-12T17:40:18.773787+0000","last_unstale":"2024-09-12T19:00:11.412693+0000","last_undegraded":"2024-09-12T19:00:11.412693+0000","last_fullsized":"2024-09-12T19:00:11.412693+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-12T19:00:11.412318+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-12T19:00:11.412318+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.412318+0000","objects_scrubbed":10,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:40.943987+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1575003,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":648,"num_read_kb":7584,"num_write":1228,"num_write_kb":45057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'154","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.627859+0000","last_change":"2024-09-12T19:00:11.627859+0000","last_active":"2024-09-12T19:00:11.627859+0000","last_peered":"2024-09-12T19:00:11.627859+0000","last_clean":"2024-09-12T19:00:11.627859+0000","last_became_active":"2024-09-12T17:40:20.120803+0000","last_became_peered":"2024-09-12T17:40:20.120803+0000","last_unstale":"2024-09-12T19:00:11.627859+0000","last_undegraded":"2024-09-12T19:00:11.627859+0000","last_fullsized":"2024-09-12T19:00:11.627859+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-12T19:00:11.627566+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-12T19:00:11.627566+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.627566+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:32.581707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":714,"num_read_kb":606,"num_write":221,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'317","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.802687+0000","last_change":"2024-09-12T19:00:10.802687+0000","last_active":"2024-09-12T19:00:10.802687+0000","last_peered":"2024-09-12T19:00:10.802687+0000","last_clean":"2024-09-12T19:00:10.802687+0000","last_became_active":"2024-09-12T17:40:18.769867+0000","last_became_peered":"2024-09-12T17:40:18.769867+0000","last_unstale":"2024-09-12T19:00:10.802687+0000","last_undegraded":"2024-09-12T19:00:10.802687+0000","last_fullsized":"2024-09-12T19:00:10.802687+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T19:00:10.802484+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T19:00:10.802484+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.802484+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:37.820292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":25356,"num_write":1086,"num_write_kb":19597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'166","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.599974+0000","last_change":"2024-09-12T19:00:14.599974+0000","last_active":"2024-09-12T19:00:14.599974+0000","last_peered":"2024-09-12T19:00:14.599974+0000","last_clean":"2024-09-12T19:00:14.599974+0000","last_became_active":"2024-09-12T17:40:20.131603+0000","last_became_peered":"2024-09-12T17:40:20.131603+0000","last_unstale":"2024-09-12T19:00:14.599974+0000","last_undegraded":"2024-09-12T19:00:14.599974+0000","last_fullsized":"2024-09-12T19:00:14.599974+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T19:00:14.599795+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T19:00:14.599795+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.599795+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:11.205160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":647,"num_write":268,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'329","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.651668+0000","last_change":"2024-09-12T19:00:12.651668+0000","last_active":"2024-09-12T19:00:12.651668+0000","last_peered":"2024-09-12T19:00:12.651668+0000","last_clean":"2024-09-12T19:00:12.651668+0000","last_became_active":"2024-09-12T17:40:18.765584+0000","last_became_peered":"2024-09-12T17:40:18.765584+0000","last_unstale":"2024-09-12T19:00:12.651668+0000","last_undegraded":"2024-09-12T19:00:12.651668+0000","last_fullsized":"2024-09-12T19:00:12.651668+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T19:00:12.651452+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T19:00:12.651452+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.651452+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:48.653995+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":14373,"num_write":1088,"num_write_kb":24714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'218","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.886654+0000","last_change":"2024-09-12T19:00:23.886654+0000","last_active":"2024-09-12T19:00:23.886654+0000","last_peered":"2024-09-12T19:00:23.886654+0000","last_clean":"2024-09-12T19:00:23.886654+0000","last_became_active":"2024-09-12T17:40:20.132166+0000","last_became_peered":"2024-09-12T17:40:20.132166+0000","last_unstale":"2024-09-12T19:00:23.886654+0000","last_undegraded":"2024-09-12T19:00:23.886654+0000","last_fullsized":"2024-09-12T19:00:23.886654+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-09-12T19:00:23.886463+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-09-12T19:00:23.886463+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.886463+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:14.565713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":801,"num_write":328,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'324","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.305986+0000","last_change":"2024-09-12T19:00:11.305986+0000","last_active":"2024-09-12T19:00:11.305986+0000","last_peered":"2024-09-12T19:00:11.305986+0000","last_clean":"2024-09-12T19:00:11.305986+0000","last_became_active":"2024-09-12T17:40:18.753673+0000","last_became_peered":"2024-09-12T17:40:18.753673+0000","last_unstale":"2024-09-12T19:00:11.305986+0000","last_undegraded":"2024-09-12T19:00:11.305986+0000","last_fullsized":"2024-09-12T19:00:11.305986+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-12T19:00:11.305739+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-12T19:00:11.305739+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.305739+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:02.108364+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602146,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":9306,"num_write":1013,"num_write_kb":26120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'144","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.930286+0000","last_change":"2024-09-12T19:00:40.930286+0000","last_active":"2024-09-12T19:00:40.930286+0000","last_peered":"2024-09-12T19:00:40.930286+0000","last_clean":"2024-09-12T19:00:40.930286+0000","last_became_active":"2024-09-12T17:40:28.201205+0000","last_became_peered":"2024-09-12T17:40:28.201205+0000","last_unstale":"2024-09-12T19:00:40.930286+0000","last_undegraded":"2024-09-12T19:00:40.930286+0000","last_fullsized":"2024-09-12T19:00:40.930286+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:40.930076+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:40.930076+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.930076+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:42.788562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'257","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.617677+0000","last_change":"2024-09-12T19:00:14.617677+0000","last_active":"2024-09-12T19:00:14.617677+0000","last_peered":"2024-09-12T19:00:14.617677+0000","last_clean":"2024-09-12T19:00:14.617677+0000","last_became_active":"2024-09-12T17:40:20.132930+0000","last_became_peered":"2024-09-12T17:40:20.132930+0000","last_unstale":"2024-09-12T19:00:14.617677+0000","last_undegraded":"2024-09-12T19:00:14.617677+0000","last_fullsized":"2024-09-12T19:00:14.617677+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-12T19:00:14.617493+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-12T19:00:14.617493+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.617493+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:11.145807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1081,"num_read_kb":890,"num_write":398,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'338","reported_seq":1106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.929838+0000","last_change":"2024-09-12T19:00:13.929838+0000","last_active":"2024-09-12T19:00:13.929838+0000","last_peered":"2024-09-12T19:00:13.929838+0000","last_clean":"2024-09-12T19:00:13.929838+0000","last_became_active":"2024-09-12T17:40:18.785762+0000","last_became_peered":"2024-09-12T17:40:18.785762+0000","last_unstale":"2024-09-12T19:00:13.929838+0000","last_undegraded":"2024-09-12T19:00:13.929838+0000","last_fullsized":"2024-09-12T19:00:13.929838+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T19:00:13.929601+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T19:00:13.929601+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.929601+0000","objects_scrubbed":11,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:54.986642+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364400,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":651,"num_read_kb":5513,"num_write":1121,"num_write_kb":17948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.294876+0000","last_change":"2024-09-12T19:00:26.294876+0000","last_active":"2024-09-12T19:00:26.294876+0000","last_peered":"2024-09-12T19:00:26.294876+0000","last_clean":"2024-09-12T19:00:26.294876+0000","last_became_active":"2024-09-12T17:40:22.146112+0000","last_became_peered":"2024-09-12T17:40:22.146112+0000","last_unstale":"2024-09-12T19:00:26.294876+0000","last_undegraded":"2024-09-12T19:00:26.294876+0000","last_fullsized":"2024-09-12T19:00:26.294876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.294692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.294692+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.294692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:19.193532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'342","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.367212+0000","last_change":"2024-09-12T19:00:28.367212+0000","last_active":"2024-09-12T19:00:28.367212+0000","last_peered":"2024-09-12T19:00:28.367212+0000","last_clean":"2024-09-12T19:00:28.367212+0000","last_became_active":"2024-09-12T17:40:24.161536+0000","last_became_peered":"2024-09-12T17:40:24.161536+0000","last_unstale":"2024-09-12T19:00:28.367212+0000","last_undegraded":"2024-09-12T19:00:28.367212+0000","last_fullsized":"2024-09-12T19:00:28.367212+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-12T19:00:28.367009+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-12T19:00:28.367009+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.367009+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:49.442023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50345,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":1205,"num_write":440,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.791994+0000","last_change":"2024-09-12T19:00:36.791994+0000","last_active":"2024-09-12T19:00:36.791994+0000","last_peered":"2024-09-12T19:00:36.791994+0000","last_clean":"2024-09-12T19:00:36.791994+0000","last_became_active":"2024-09-12T17:40:26.188831+0000","last_became_peered":"2024-09-12T17:40:26.188831+0000","last_unstale":"2024-09-12T19:00:36.791994+0000","last_undegraded":"2024-09-12T19:00:36.791994+0000","last_fullsized":"2024-09-12T19:00:36.791994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:36.791726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:36.791726+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.791726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:23.483824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'162","reported_seq":726,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.278715+0000","last_change":"2024-09-12T19:00:40.278715+0000","last_active":"2024-09-12T19:00:40.278715+0000","last_peered":"2024-09-12T19:00:40.278715+0000","last_clean":"2024-09-12T19:00:40.278715+0000","last_became_active":"2024-09-12T17:40:28.189899+0000","last_became_peered":"2024-09-12T17:40:28.189899+0000","last_unstale":"2024-09-12T19:00:40.278715+0000","last_undegraded":"2024-09-12T19:00:40.278715+0000","last_fullsized":"2024-09-12T19:00:40.278715+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T19:00:40.278524+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T19:00:40.278524+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.278524+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:11.990738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":230,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'92","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.294602+0000","last_change":"2024-09-12T19:00:19.294602+0000","last_active":"2024-09-12T19:00:19.294602+0000","last_peered":"2024-09-12T19:00:19.294602+0000","last_clean":"2024-09-12T19:00:19.294602+0000","last_became_active":"2024-09-12T17:40:20.137252+0000","last_became_peered":"2024-09-12T17:40:20.137252+0000","last_unstale":"2024-09-12T19:00:19.294602+0000","last_undegraded":"2024-09-12T19:00:19.294602+0000","last_fullsized":"2024-09-12T19:00:19.294602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-12T19:00:19.294422+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-12T19:00:19.294422+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.294422+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:43.295706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":356,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'347","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.376265+0000","last_change":"2024-09-12T19:00:05.376265+0000","last_active":"2024-09-12T19:00:05.376265+0000","last_peered":"2024-09-12T19:00:05.376265+0000","last_clean":"2024-09-12T19:00:05.376265+0000","last_became_active":"2024-09-12T17:40:18.756518+0000","last_became_peered":"2024-09-12T17:40:18.756518+0000","last_unstale":"2024-09-12T19:00:05.376265+0000","last_undegraded":"2024-09-12T19:00:05.376265+0000","last_fullsized":"2024-09-12T19:00:05.376265+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T19:00:05.376068+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T19:00:05.376068+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.376068+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:46.598497+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272857,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":466,"num_read_kb":2596,"num_write":1023,"num_write_kb":33023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.624097+0000","last_change":"2024-09-12T19:00:22.624097+0000","last_active":"2024-09-12T19:00:22.624097+0000","last_peered":"2024-09-12T19:00:22.624097+0000","last_clean":"2024-09-12T19:00:22.624097+0000","last_became_active":"2024-09-12T17:40:22.153074+0000","last_became_peered":"2024-09-12T17:40:22.153074+0000","last_unstale":"2024-09-12T19:00:22.624097+0000","last_undegraded":"2024-09-12T19:00:22.624097+0000","last_fullsized":"2024-09-12T19:00:22.624097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.623901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.623901+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.623901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:49.381263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'105","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.924730+0000","last_change":"2024-09-12T19:00:32.924730+0000","last_active":"2024-09-12T19:00:32.924730+0000","last_peered":"2024-09-12T19:00:32.924730+0000","last_clean":"2024-09-12T19:00:32.924730+0000","last_became_active":"2024-09-12T17:40:24.169431+0000","last_became_peered":"2024-09-12T17:40:24.169431+0000","last_unstale":"2024-09-12T19:00:32.924730+0000","last_undegraded":"2024-09-12T19:00:32.924730+0000","last_fullsized":"2024-09-12T19:00:32.924730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T19:00:32.924491+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T19:00:32.924491+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.924491+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:19.774401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.881908+0000","last_change":"2024-09-12T19:00:36.881908+0000","last_active":"2024-09-12T19:00:36.881908+0000","last_peered":"2024-09-12T19:00:36.881908+0000","last_clean":"2024-09-12T19:00:36.881908+0000","last_became_active":"2024-09-12T17:40:26.188501+0000","last_became_peered":"2024-09-12T17:40:26.188501+0000","last_unstale":"2024-09-12T19:00:36.881908+0000","last_undegraded":"2024-09-12T19:00:36.881908+0000","last_fullsized":"2024-09-12T19:00:36.881908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:36.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:36.881726+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:04.430721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'136","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.297377+0000","last_change":"2024-09-12T19:00:41.297377+0000","last_active":"2024-09-12T19:00:41.297377+0000","last_peered":"2024-09-12T19:00:41.297377+0000","last_clean":"2024-09-12T19:00:41.297377+0000","last_became_active":"2024-09-12T17:40:28.186224+0000","last_became_peered":"2024-09-12T17:40:28.186224+0000","last_unstale":"2024-09-12T19:00:41.297377+0000","last_undegraded":"2024-09-12T19:00:41.297377+0000","last_fullsized":"2024-09-12T19:00:41.297377+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-12T19:00:41.297189+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-12T19:00:41.297189+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.297189+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:59.058653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":201,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'278","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.374182+0000","last_change":"2024-09-12T19:00:16.374182+0000","last_active":"2024-09-12T19:00:16.374182+0000","last_peered":"2024-09-12T19:00:16.374182+0000","last_clean":"2024-09-12T19:00:16.374182+0000","last_became_active":"2024-09-12T17:40:20.115862+0000","last_became_peered":"2024-09-12T17:40:20.115862+0000","last_unstale":"2024-09-12T19:00:16.374182+0000","last_undegraded":"2024-09-12T19:00:16.374182+0000","last_fullsized":"2024-09-12T19:00:16.374182+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'278","last_scrub_stamp":"2024-09-12T19:00:16.374003+0000","last_deep_scrub":"264'278","last_deep_scrub_stamp":"2024-09-12T19:00:16.374003+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.374003+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:39.249116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1211,"num_read_kb":988,"num_write":419,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'376","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.350085+0000","last_change":"2024-09-12T19:00:07.349944+0000","last_active":"2024-09-12T19:00:07.350085+0000","last_peered":"2024-09-12T19:00:07.350085+0000","last_clean":"2024-09-12T19:00:07.350085+0000","last_became_active":"2024-09-12T17:40:55.329597+0000","last_became_peered":"2024-09-12T17:40:55.329597+0000","last_unstale":"2024-09-12T19:00:07.350085+0000","last_undegraded":"2024-09-12T19:00:07.350085+0000","last_fullsized":"2024-09-12T19:00:07.350085+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-12T19:00:07.349768+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-12T19:00:07.349768+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.349768+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:52.137674+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263284,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":44050,"num_write":1244,"num_write_kb":40700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.733255+0000","last_change":"2024-09-12T19:00:25.733255+0000","last_active":"2024-09-12T19:00:25.733255+0000","last_peered":"2024-09-12T19:00:25.733255+0000","last_clean":"2024-09-12T19:00:25.733255+0000","last_became_active":"2024-09-12T17:40:22.145769+0000","last_became_peered":"2024-09-12T17:40:22.145769+0000","last_unstale":"2024-09-12T19:00:25.733255+0000","last_undegraded":"2024-09-12T19:00:25.733255+0000","last_fullsized":"2024-09-12T19:00:25.733255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:25.733080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:25.733080+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.733080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:21.958659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'151","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.637691+0000","last_change":"2024-09-12T19:00:20.637691+0000","last_active":"2024-09-12T19:00:20.637691+0000","last_peered":"2024-09-12T19:00:20.637691+0000","last_clean":"2024-09-12T19:00:20.637691+0000","last_became_active":"2024-09-12T17:40:24.163809+0000","last_became_peered":"2024-09-12T17:40:24.163809+0000","last_unstale":"2024-09-12T19:00:20.637691+0000","last_undegraded":"2024-09-12T19:00:20.637691+0000","last_fullsized":"2024-09-12T19:00:20.637691+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T19:00:20.637471+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T19:00:20.637471+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.637471+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:01.042195+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":124,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'765","reported_seq":2954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.836254+0000","last_change":"2024-09-12T19:00:35.836254+0000","last_active":"2024-09-12T19:00:35.836254+0000","last_peered":"2024-09-12T19:00:35.836254+0000","last_clean":"2024-09-12T19:00:35.836254+0000","last_became_active":"2024-09-12T17:40:26.200567+0000","last_became_peered":"2024-09-12T17:40:26.200567+0000","last_unstale":"2024-09-12T19:00:35.836254+0000","last_undegraded":"2024-09-12T19:00:35.836254+0000","last_fullsized":"2024-09-12T19:00:35.836254+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'765","last_scrub_stamp":"2024-09-12T19:00:35.836060+0000","last_deep_scrub":"264'765","last_deep_scrub_stamp":"2024-09-12T19:00:35.836060+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.836060+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:05.982251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'219","reported_seq":1069,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.901011+0000","last_change":"2024-09-12T19:00:41.901011+0000","last_active":"2024-09-12T19:00:41.901011+0000","last_peered":"2024-09-12T19:00:41.901011+0000","last_clean":"2024-09-12T19:00:41.901011+0000","last_became_active":"2024-09-12T17:40:28.171602+0000","last_became_peered":"2024-09-12T17:40:28.171602+0000","last_unstale":"2024-09-12T19:00:41.901011+0000","last_undegraded":"2024-09-12T19:00:41.901011+0000","last_fullsized":"2024-09-12T19:00:41.901011+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-12T19:00:41.900820+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-12T19:00:41.900820+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.900820+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:41.173591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":670,"num_read_kb":661,"num_write":473,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'82","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.627310+0000","last_change":"2024-09-12T19:00:10.627173+0000","last_active":"2024-09-12T19:00:10.627310+0000","last_peered":"2024-09-12T19:00:10.627310+0000","last_clean":"2024-09-12T19:00:10.627310+0000","last_became_active":"2024-09-12T17:40:55.305123+0000","last_became_peered":"2024-09-12T17:40:55.305123+0000","last_unstale":"2024-09-12T19:00:10.627310+0000","last_undegraded":"2024-09-12T19:00:10.627310+0000","last_fullsized":"2024-09-12T19:00:10.627310+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'82","last_scrub_stamp":"2024-09-12T19:00:10.626973+0000","last_deep_scrub":"264'82","last_deep_scrub_stamp":"2024-09-12T19:00:10.626973+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.626973+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:35.142530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":316,"num_write":118,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"264'427","reported_seq":1184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.363489+0000","last_change":"2024-09-12T19:00:10.363489+0000","last_active":"2024-09-12T19:00:10.363489+0000","last_peered":"2024-09-12T19:00:10.363489+0000","last_clean":"2024-09-12T19:00:10.363489+0000","last_became_active":"2024-09-12T17:40:18.755758+0000","last_became_peered":"2024-09-12T17:40:18.755758+0000","last_unstale":"2024-09-12T19:00:10.363489+0000","last_undegraded":"2024-09-12T19:00:10.363489+0000","last_fullsized":"2024-09-12T19:00:10.363489+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'427","last_scrub_stamp":"2024-09-12T19:00:10.363268+0000","last_deep_scrub":"264'427","last_deep_scrub_stamp":"2024-09-12T19:00:10.363268+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.363268+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:15.235474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":768,"num_read_kb":10976,"num_write":1273,"num_write_kb":39454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.266415+0000","last_change":"2024-09-12T19:00:30.266415+0000","last_active":"2024-09-12T19:00:30.266415+0000","last_peered":"2024-09-12T19:00:30.266415+0000","last_clean":"2024-09-12T19:00:30.266415+0000","last_became_active":"2024-09-12T17:40:22.144266+0000","last_became_peered":"2024-09-12T17:40:22.144266+0000","last_unstale":"2024-09-12T19:00:30.266415+0000","last_undegraded":"2024-09-12T19:00:30.266415+0000","last_fullsized":"2024-09-12T19:00:30.266415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.266230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.266230+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.266230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:53.470295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'283","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.875571+0000","last_change":"2024-09-12T19:00:31.875571+0000","last_active":"2024-09-12T19:00:31.875571+0000","last_peered":"2024-09-12T19:00:31.875571+0000","last_clean":"2024-09-12T19:00:31.875571+0000","last_became_active":"2024-09-12T17:40:24.332623+0000","last_became_peered":"2024-09-12T17:40:24.332623+0000","last_unstale":"2024-09-12T19:00:31.875571+0000","last_undegraded":"2024-09-12T19:00:31.875571+0000","last_fullsized":"2024-09-12T19:00:31.875571+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'283","last_scrub_stamp":"2024-09-12T19:00:31.875334+0000","last_deep_scrub":"264'283","last_deep_scrub_stamp":"2024-09-12T19:00:31.875334+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.875334+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:28.468065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50618,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1084,"num_write":376,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'787","reported_seq":4969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.759039+0000","last_change":"2024-09-12T19:00:37.759039+0000","last_active":"2024-09-12T19:00:37.759039+0000","last_peered":"2024-09-12T19:00:37.759039+0000","last_clean":"2024-09-12T19:00:37.759039+0000","last_became_active":"2024-09-12T17:40:26.194264+0000","last_became_peered":"2024-09-12T17:40:26.194264+0000","last_unstale":"2024-09-12T19:00:37.759039+0000","last_undegraded":"2024-09-12T19:00:37.759039+0000","last_fullsized":"2024-09-12T19:00:37.759039+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'787","last_scrub_stamp":"2024-09-12T19:00:37.758842+0000","last_deep_scrub":"264'787","last_deep_scrub_stamp":"2024-09-12T19:00:37.758842+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.758842+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:59.879886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'4314","reported_seq":4936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.309249+0000","last_change":"2024-09-12T19:00:18.309077+0000","last_active":"2024-09-12T19:00:18.309249+0000","last_peered":"2024-09-12T19:00:18.309249+0000","last_clean":"2024-09-12T19:00:18.309249+0000","last_became_active":"2024-09-12T17:40:20.136595+0000","last_became_peered":"2024-09-12T17:40:20.136595+0000","last_unstale":"2024-09-12T19:00:18.309249+0000","last_undegraded":"2024-09-12T19:00:18.309249+0000","last_fullsized":"2024-09-12T19:00:18.309249+0000","mapping_epoch":25,"log_start":"264'4300","ondisk_log_start":"264'4300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4314","last_scrub_stamp":"2024-09-12T19:00:18.308892+0000","last_deep_scrub":"264'4314","last_deep_scrub_stamp":"2024-09-12T19:00:18.308892+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.308892+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:40.254536+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17313,"num_read_kb":14480,"num_write":6459,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8763,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'327","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.882869+0000","last_change":"2024-09-12T19:00:08.882869+0000","last_active":"2024-09-12T19:00:08.882869+0000","last_peered":"2024-09-12T19:00:08.882869+0000","last_clean":"2024-09-12T19:00:08.882869+0000","last_became_active":"2024-09-12T17:40:18.792274+0000","last_became_peered":"2024-09-12T17:40:18.792274+0000","last_unstale":"2024-09-12T19:00:08.882869+0000","last_undegraded":"2024-09-12T19:00:08.882869+0000","last_fullsized":"2024-09-12T19:00:08.882869+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T19:00:08.882605+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T19:00:08.882605+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.882605+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:09.532780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":45936,"num_write":1086,"num_write_kb":27157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.923195+0000","last_change":"2024-09-12T19:00:23.923013+0000","last_active":"2024-09-12T19:00:23.923195+0000","last_peered":"2024-09-12T19:00:23.923195+0000","last_clean":"2024-09-12T19:00:23.923195+0000","last_became_active":"2024-09-12T17:40:22.150553+0000","last_became_peered":"2024-09-12T17:40:22.150553+0000","last_unstale":"2024-09-12T19:00:23.923195+0000","last_undegraded":"2024-09-12T19:00:23.923195+0000","last_fullsized":"2024-09-12T19:00:23.923195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.922835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.922835+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.922835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:28.392845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'421","reported_seq":1071,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.266200+0000","last_change":"2024-09-12T19:00:31.265945+0000","last_active":"2024-09-12T19:00:31.266200+0000","last_peered":"2024-09-12T19:00:31.266200+0000","last_clean":"2024-09-12T19:00:31.266200+0000","last_became_active":"2024-09-12T17:40:24.332413+0000","last_became_peered":"2024-09-12T17:40:24.332413+0000","last_unstale":"2024-09-12T19:00:31.266200+0000","last_undegraded":"2024-09-12T19:00:31.266200+0000","last_fullsized":"2024-09-12T19:00:31.266200+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-09-12T19:00:31.265700+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-09-12T19:00:31.265700+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.265700+0000","objects_scrubbed":9,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:30.182370+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52951,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":647,"num_read_kb":1274,"num_write":502,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.347008+0000","last_change":"2024-09-12T19:00:27.347008+0000","last_active":"2024-09-12T19:00:27.347008+0000","last_peered":"2024-09-12T19:00:27.347008+0000","last_clean":"2024-09-12T19:00:27.347008+0000","last_became_active":"2024-09-12T17:40:26.180448+0000","last_became_peered":"2024-09-12T17:40:26.180448+0000","last_unstale":"2024-09-12T19:00:27.347008+0000","last_undegraded":"2024-09-12T19:00:27.347008+0000","last_fullsized":"2024-09-12T19:00:27.347008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:27.346786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:27.346786+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.346786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:53.370738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'562","reported_seq":1386,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.221015+0000","last_change":"2024-09-12T19:00:36.221015+0000","last_active":"2024-09-12T19:00:36.221015+0000","last_peered":"2024-09-12T19:00:36.221015+0000","last_clean":"2024-09-12T19:00:36.221015+0000","last_became_active":"2024-09-12T17:40:28.189872+0000","last_became_peered":"2024-09-12T17:40:28.189872+0000","last_unstale":"2024-09-12T19:00:36.221015+0000","last_undegraded":"2024-09-12T19:00:36.221015+0000","last_fullsized":"2024-09-12T19:00:36.221015+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'562","last_scrub_stamp":"2024-09-12T19:00:36.220759+0000","last_deep_scrub":"264'562","last_deep_scrub_stamp":"2024-09-12T19:00:36.220759+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.220759+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:18.822188+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1323,"num_read_kb":1321,"num_write":1170,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'151","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.852439+0000","last_change":"2024-09-12T19:00:15.852277+0000","last_active":"2024-09-12T19:00:15.852439+0000","last_peered":"2024-09-12T19:00:15.852439+0000","last_clean":"2024-09-12T19:00:15.852439+0000","last_became_active":"2024-09-12T17:40:20.133890+0000","last_became_peered":"2024-09-12T17:40:20.133890+0000","last_unstale":"2024-09-12T19:00:15.852439+0000","last_undegraded":"2024-09-12T19:00:15.852439+0000","last_fullsized":"2024-09-12T19:00:15.852439+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T19:00:15.852091+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T19:00:15.852091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.852091+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:54.370817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":596,"num_write":262,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'398","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.942403+0000","last_change":"2024-09-12T19:00:10.942259+0000","last_active":"2024-09-12T19:00:10.942403+0000","last_peered":"2024-09-12T19:00:10.942403+0000","last_clean":"2024-09-12T19:00:10.942403+0000","last_became_active":"2024-09-12T17:40:18.779278+0000","last_became_peered":"2024-09-12T17:40:18.779278+0000","last_unstale":"2024-09-12T19:00:10.942403+0000","last_undegraded":"2024-09-12T19:00:10.942403+0000","last_fullsized":"2024-09-12T19:00:10.942403+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-12T19:00:10.942027+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-12T19:00:10.942027+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.942027+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:54.061993+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4801217,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":581,"num_read_kb":90800,"num_write":1176,"num_write_kb":50508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"264'6","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.569622+0000","last_change":"2024-09-12T19:00:17.569464+0000","last_active":"2024-09-12T19:00:17.569622+0000","last_peered":"2024-09-12T19:00:17.569622+0000","last_clean":"2024-09-12T19:00:17.569622+0000","last_became_active":"2024-09-12T17:40:22.133525+0000","last_became_peered":"2024-09-12T17:40:22.133525+0000","last_unstale":"2024-09-12T19:00:17.569622+0000","last_undegraded":"2024-09-12T19:00:17.569622+0000","last_fullsized":"2024-09-12T19:00:17.569622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:17.569265+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:17.569265+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.569265+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:55.942607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'293","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.707014+0000","last_change":"2024-09-12T19:00:26.707014+0000","last_active":"2024-09-12T19:00:26.707014+0000","last_peered":"2024-09-12T19:00:26.707014+0000","last_clean":"2024-09-12T19:00:26.707014+0000","last_became_active":"2024-09-12T17:40:24.177609+0000","last_became_peered":"2024-09-12T17:40:24.177609+0000","last_unstale":"2024-09-12T19:00:26.707014+0000","last_undegraded":"2024-09-12T19:00:26.707014+0000","last_fullsized":"2024-09-12T19:00:26.707014+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'293","last_scrub_stamp":"2024-09-12T19:00:26.706832+0000","last_deep_scrub":"264'293","last_deep_scrub_stamp":"2024-09-12T19:00:26.706832+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.706832+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:04.968086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1115,"num_write":388,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.738630+0000","last_change":"2024-09-12T19:00:39.738506+0000","last_active":"2024-09-12T19:00:39.738630+0000","last_peered":"2024-09-12T19:00:39.738630+0000","last_clean":"2024-09-12T19:00:39.738630+0000","last_became_active":"2024-09-12T17:40:26.203313+0000","last_became_peered":"2024-09-12T17:40:26.203313+0000","last_unstale":"2024-09-12T19:00:39.738630+0000","last_undegraded":"2024-09-12T19:00:39.738630+0000","last_fullsized":"2024-09-12T19:00:39.738630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:39.738317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:39.738317+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.738317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:15.402624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2396","reported_seq":4233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.304518+0000","last_change":"2024-09-12T19:00:28.304518+0000","last_active":"2024-09-12T19:00:28.304518+0000","last_peered":"2024-09-12T19:00:28.304518+0000","last_clean":"2024-09-12T19:00:28.304518+0000","last_became_active":"2024-09-12T17:40:28.183181+0000","last_became_peered":"2024-09-12T17:40:28.183181+0000","last_unstale":"2024-09-12T19:00:28.304518+0000","last_undegraded":"2024-09-12T19:00:28.304518+0000","last_fullsized":"2024-09-12T19:00:28.304518+0000","mapping_epoch":33,"log_start":"264'2300","ondisk_log_start":"264'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2396","last_scrub_stamp":"2024-09-12T19:00:28.304334+0000","last_deep_scrub":"264'2396","last_deep_scrub_stamp":"2024-09-12T19:00:28.304334+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.304334+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":2300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:13.034973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6012,"num_read_kb":6017,"num_write":4828,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'262","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.462441+0000","last_change":"2024-09-12T19:00:15.462287+0000","last_active":"2024-09-12T19:00:15.462441+0000","last_peered":"2024-09-12T19:00:15.462441+0000","last_clean":"2024-09-12T19:00:15.462441+0000","last_became_active":"2024-09-12T17:40:20.133614+0000","last_became_peered":"2024-09-12T17:40:20.133614+0000","last_unstale":"2024-09-12T19:00:15.462441+0000","last_undegraded":"2024-09-12T19:00:15.462441+0000","last_fullsized":"2024-09-12T19:00:15.462441+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'262","last_scrub_stamp":"2024-09-12T19:00:15.462110+0000","last_deep_scrub":"264'262","last_deep_scrub_stamp":"2024-09-12T19:00:15.462110+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.462110+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:42.164388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1175,"num_read_kb":965,"num_write":385,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'314","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.901793+0000","last_change":"2024-09-12T19:00:09.901535+0000","last_active":"2024-09-12T19:00:09.901793+0000","last_peered":"2024-09-12T19:00:09.901793+0000","last_clean":"2024-09-12T19:00:09.901793+0000","last_became_active":"2024-09-12T17:40:18.786288+0000","last_became_peered":"2024-09-12T17:40:18.786288+0000","last_unstale":"2024-09-12T19:00:09.901793+0000","last_undegraded":"2024-09-12T19:00:09.901793+0000","last_fullsized":"2024-09-12T19:00:09.901793+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T19:00:09.901234+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T19:00:09.901234+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.901234+0000","objects_scrubbed":11,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:32.060870+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263265,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":395,"num_read_kb":29289,"num_write":926,"num_write_kb":24158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.613458+0000","last_change":"2024-09-12T19:00:18.613306+0000","last_active":"2024-09-12T19:00:18.613458+0000","last_peered":"2024-09-12T19:00:18.613458+0000","last_clean":"2024-09-12T19:00:18.613458+0000","last_became_active":"2024-09-12T17:40:22.131242+0000","last_became_peered":"2024-09-12T17:40:22.131242+0000","last_unstale":"2024-09-12T19:00:18.613458+0000","last_undegraded":"2024-09-12T19:00:18.613458+0000","last_fullsized":"2024-09-12T19:00:18.613458+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:18.613075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:18.613075+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.613075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:08.425791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'311","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.905085+0000","last_change":"2024-09-12T19:00:29.904934+0000","last_active":"2024-09-12T19:00:29.905085+0000","last_peered":"2024-09-12T19:00:29.905085+0000","last_clean":"2024-09-12T19:00:29.905085+0000","last_became_active":"2024-09-12T17:40:24.162722+0000","last_became_peered":"2024-09-12T17:40:24.162722+0000","last_unstale":"2024-09-12T19:00:29.905085+0000","last_undegraded":"2024-09-12T19:00:29.905085+0000","last_fullsized":"2024-09-12T19:00:29.905085+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-09-12T19:00:29.904721+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-09-12T19:00:29.904721+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.904721+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:27.096545+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":1041,"num_write":382,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'763","reported_seq":2710,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.353917+0000","last_change":"2024-09-12T19:00:31.353760+0000","last_active":"2024-09-12T19:00:31.353917+0000","last_peered":"2024-09-12T19:00:31.353917+0000","last_clean":"2024-09-12T19:00:31.353917+0000","last_became_active":"2024-09-12T17:40:26.181656+0000","last_became_peered":"2024-09-12T17:40:26.181656+0000","last_unstale":"2024-09-12T19:00:31.353917+0000","last_undegraded":"2024-09-12T19:00:31.353917+0000","last_fullsized":"2024-09-12T19:00:31.353917+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'763","last_scrub_stamp":"2024-09-12T19:00:31.353551+0000","last_deep_scrub":"264'763","last_deep_scrub_stamp":"2024-09-12T19:00:31.353551+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.353551+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:43.697271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'119","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.276180+0000","last_change":"2024-09-12T19:00:37.276043+0000","last_active":"2024-09-12T19:00:37.276180+0000","last_peered":"2024-09-12T19:00:37.276180+0000","last_clean":"2024-09-12T19:00:37.276180+0000","last_became_active":"2024-09-12T17:40:28.185975+0000","last_became_peered":"2024-09-12T17:40:28.185975+0000","last_unstale":"2024-09-12T19:00:37.276180+0000","last_undegraded":"2024-09-12T19:00:37.276180+0000","last_fullsized":"2024-09-12T19:00:37.276180+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T19:00:37.275835+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T19:00:37.275835+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.275835+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:40.024593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'268","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.360406+0000","last_change":"2024-09-12T19:00:15.360248+0000","last_active":"2024-09-12T19:00:15.360406+0000","last_peered":"2024-09-12T19:00:15.360406+0000","last_clean":"2024-09-12T19:00:15.360406+0000","last_became_active":"2024-09-12T17:40:20.125386+0000","last_became_peered":"2024-09-12T17:40:20.125386+0000","last_unstale":"2024-09-12T19:00:15.360406+0000","last_undegraded":"2024-09-12T19:00:15.360406+0000","last_fullsized":"2024-09-12T19:00:15.360406+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'268","last_scrub_stamp":"2024-09-12T19:00:15.359983+0000","last_deep_scrub":"264'268","last_deep_scrub_stamp":"2024-09-12T19:00:15.359983+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.359983+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:39.540314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1147,"num_read_kb":967,"num_write":444,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'346","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.287157+0000","last_change":"2024-09-12T19:00:09.286839+0000","last_active":"2024-09-12T19:00:09.287157+0000","last_peered":"2024-09-12T19:00:09.287157+0000","last_clean":"2024-09-12T19:00:09.287157+0000","last_became_active":"2024-09-12T17:40:18.761052+0000","last_became_peered":"2024-09-12T17:40:18.761052+0000","last_unstale":"2024-09-12T19:00:09.287157+0000","last_undegraded":"2024-09-12T19:00:09.287157+0000","last_fullsized":"2024-09-12T19:00:09.287157+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-12T19:00:09.286528+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-12T19:00:09.286528+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.286528+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:01.066566+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":20006,"num_write":1061,"num_write_kb":43376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.564779+0000","last_change":"2024-09-12T19:00:16.564506+0000","last_active":"2024-09-12T19:00:16.564779+0000","last_peered":"2024-09-12T19:00:16.564779+0000","last_clean":"2024-09-12T19:00:16.564779+0000","last_became_active":"2024-09-12T17:40:22.134290+0000","last_became_peered":"2024-09-12T17:40:22.134290+0000","last_unstale":"2024-09-12T19:00:16.564779+0000","last_undegraded":"2024-09-12T19:00:16.564779+0000","last_fullsized":"2024-09-12T19:00:16.564779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:16.564293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:16.564293+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.564293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:21.426598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'495","reported_seq":1157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.378108+0000","last_change":"2024-09-12T19:00:26.377955+0000","last_active":"2024-09-12T19:00:26.378108+0000","last_peered":"2024-09-12T19:00:26.378108+0000","last_clean":"2024-09-12T19:00:26.378108+0000","last_became_active":"2024-09-12T17:40:24.161322+0000","last_became_peered":"2024-09-12T17:40:24.161322+0000","last_unstale":"2024-09-12T19:00:26.378108+0000","last_undegraded":"2024-09-12T19:00:26.378108+0000","last_fullsized":"2024-09-12T19:00:26.378108+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'495","last_scrub_stamp":"2024-09-12T19:00:26.377759+0000","last_deep_scrub":"264'495","last_deep_scrub_stamp":"2024-09-12T19:00:26.377759+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.377759+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:25.593749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92212,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2116,"num_write":710,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.615238+0000","last_change":"2024-09-12T19:00:22.615101+0000","last_active":"2024-09-12T19:00:22.615238+0000","last_peered":"2024-09-12T19:00:22.615238+0000","last_clean":"2024-09-12T19:00:22.615238+0000","last_became_active":"2024-09-12T17:40:26.191395+0000","last_became_peered":"2024-09-12T17:40:26.191395+0000","last_unstale":"2024-09-12T19:00:22.615238+0000","last_undegraded":"2024-09-12T19:00:22.615238+0000","last_fullsized":"2024-09-12T19:00:22.615238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.614917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.614917+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.614917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:11.312442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'148","reported_seq":672,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.372816+0000","last_change":"2024-09-12T19:00:29.372653+0000","last_active":"2024-09-12T19:00:29.372816+0000","last_peered":"2024-09-12T19:00:29.372816+0000","last_clean":"2024-09-12T19:00:29.372816+0000","last_became_active":"2024-09-12T17:40:28.204260+0000","last_became_peered":"2024-09-12T17:40:28.204260+0000","last_unstale":"2024-09-12T19:00:29.372816+0000","last_undegraded":"2024-09-12T19:00:29.372816+0000","last_fullsized":"2024-09-12T19:00:29.372816+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'148","last_scrub_stamp":"2024-09-12T19:00:29.372433+0000","last_deep_scrub":"264'148","last_deep_scrub_stamp":"2024-09-12T19:00:29.372433+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.372433+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:09.349129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":166,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'137","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.750873+0000","last_change":"2024-09-12T19:00:09.750749+0000","last_active":"2024-09-12T19:00:09.750873+0000","last_peered":"2024-09-12T19:00:09.750873+0000","last_clean":"2024-09-12T19:00:09.750873+0000","last_became_active":"2024-09-12T17:40:20.137143+0000","last_became_peered":"2024-09-12T17:40:20.137143+0000","last_unstale":"2024-09-12T19:00:09.750873+0000","last_undegraded":"2024-09-12T19:00:09.750873+0000","last_fullsized":"2024-09-12T19:00:09.750873+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T19:00:09.750552+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T19:00:09.750552+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.750552+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:20.403074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":630,"num_read_kb":531,"num_write":209,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'373","reported_seq":1213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.707254+0000","last_change":"2024-09-12T19:00:07.707106+0000","last_active":"2024-09-12T19:00:07.707254+0000","last_peered":"2024-09-12T19:00:07.707254+0000","last_clean":"2024-09-12T19:00:07.707254+0000","last_became_active":"2024-09-12T17:40:18.759516+0000","last_became_peered":"2024-09-12T17:40:18.759516+0000","last_unstale":"2024-09-12T19:00:07.707254+0000","last_undegraded":"2024-09-12T19:00:07.707254+0000","last_fullsized":"2024-09-12T19:00:07.707254+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T19:00:07.706889+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T19:00:07.706889+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.706889+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:42.136959+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457548,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":9130,"num_write":1131,"num_write_kb":40035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.654119+0000","last_change":"2024-09-12T19:00:19.653978+0000","last_active":"2024-09-12T19:00:19.654119+0000","last_peered":"2024-09-12T19:00:19.654119+0000","last_clean":"2024-09-12T19:00:19.654119+0000","last_became_active":"2024-09-12T17:40:22.151755+0000","last_became_peered":"2024-09-12T17:40:22.151755+0000","last_unstale":"2024-09-12T19:00:19.654119+0000","last_undegraded":"2024-09-12T19:00:19.654119+0000","last_fullsized":"2024-09-12T19:00:19.654119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:19.653812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:19.653812+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.653812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:32.089068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'335","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.959837+0000","last_change":"2024-09-12T19:00:31.959837+0000","last_active":"2024-09-12T19:00:31.959837+0000","last_peered":"2024-09-12T19:00:31.959837+0000","last_clean":"2024-09-12T19:00:31.959837+0000","last_became_active":"2024-09-12T17:40:24.171973+0000","last_became_peered":"2024-09-12T17:40:24.171973+0000","last_unstale":"2024-09-12T19:00:31.959837+0000","last_undegraded":"2024-09-12T19:00:31.959837+0000","last_fullsized":"2024-09-12T19:00:31.959837+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T19:00:31.959642+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T19:00:31.959642+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.959642+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:22.025659+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50887,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":1156,"num_write":474,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.379478+0000","last_change":"2024-09-12T19:00:32.379478+0000","last_active":"2024-09-12T19:00:32.379478+0000","last_peered":"2024-09-12T19:00:32.379478+0000","last_clean":"2024-09-12T19:00:32.379478+0000","last_became_active":"2024-09-12T17:40:26.185070+0000","last_became_peered":"2024-09-12T17:40:26.185070+0000","last_unstale":"2024-09-12T19:00:32.379478+0000","last_undegraded":"2024-09-12T19:00:32.379478+0000","last_fullsized":"2024-09-12T19:00:32.379478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:32.379284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:32.379284+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.379284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:06.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'144","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:43.812475+0000","last_change":"2024-09-12T19:00:43.812322+0000","last_active":"2024-09-12T19:00:43.812475+0000","last_peered":"2024-09-12T19:00:43.812475+0000","last_clean":"2024-09-12T19:00:43.812475+0000","last_became_active":"2024-09-12T17:40:28.194137+0000","last_became_peered":"2024-09-12T17:40:28.194137+0000","last_unstale":"2024-09-12T19:00:43.812475+0000","last_undegraded":"2024-09-12T19:00:43.812475+0000","last_fullsized":"2024-09-12T19:00:43.812475+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:43.812103+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:43.812103+0000","last_clean_scrub_stamp":"2024-09-12T19:00:43.812103+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:44.673892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":145,"num_write":345,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'125","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.830859+0000","last_change":"2024-09-12T19:00:11.830631+0000","last_active":"2024-09-12T19:00:11.830859+0000","last_peered":"2024-09-12T19:00:11.830859+0000","last_clean":"2024-09-12T19:00:11.830859+0000","last_became_active":"2024-09-12T17:40:20.132115+0000","last_became_peered":"2024-09-12T17:40:20.132115+0000","last_unstale":"2024-09-12T19:00:11.830859+0000","last_undegraded":"2024-09-12T19:00:11.830859+0000","last_fullsized":"2024-09-12T19:00:11.830859+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T19:00:11.830405+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T19:00:11.830405+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.830405+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:28.343246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":428,"num_write":212,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'350","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.413824+0000","last_change":"2024-09-12T19:00:07.413688+0000","last_active":"2024-09-12T19:00:07.413824+0000","last_peered":"2024-09-12T19:00:07.413824+0000","last_clean":"2024-09-12T19:00:07.413824+0000","last_became_active":"2024-09-12T17:40:18.773579+0000","last_became_peered":"2024-09-12T17:40:18.773579+0000","last_unstale":"2024-09-12T19:00:07.413824+0000","last_undegraded":"2024-09-12T19:00:07.413824+0000","last_fullsized":"2024-09-12T19:00:07.413824+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T19:00:07.413481+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T19:00:07.413481+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.413481+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:28.872079+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4506445,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":44851,"num_write":1031,"num_write_kb":35490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.278420+0000","last_change":"2024-09-12T19:00:22.278282+0000","last_active":"2024-09-12T19:00:22.278420+0000","last_peered":"2024-09-12T19:00:22.278420+0000","last_clean":"2024-09-12T19:00:22.278420+0000","last_became_active":"2024-09-12T17:40:22.142112+0000","last_became_peered":"2024-09-12T17:40:22.142112+0000","last_unstale":"2024-09-12T19:00:22.278420+0000","last_undegraded":"2024-09-12T19:00:22.278420+0000","last_fullsized":"2024-09-12T19:00:22.278420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.278103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.278103+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.278103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:49.670652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'343","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.651045+0000","last_change":"2024-09-12T19:00:21.651045+0000","last_active":"2024-09-12T19:00:21.651045+0000","last_peered":"2024-09-12T19:00:21.651045+0000","last_clean":"2024-09-12T19:00:21.651045+0000","last_became_active":"2024-09-12T17:40:24.181982+0000","last_became_peered":"2024-09-12T17:40:24.181982+0000","last_unstale":"2024-09-12T19:00:21.651045+0000","last_undegraded":"2024-09-12T19:00:21.651045+0000","last_fullsized":"2024-09-12T19:00:21.651045+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T19:00:21.650816+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T19:00:21.650816+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.650816+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:42.753209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52587,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1218,"num_write":444,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'725","reported_seq":2543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.599978+0000","last_change":"2024-09-12T19:00:24.599978+0000","last_active":"2024-09-12T19:00:24.599978+0000","last_peered":"2024-09-12T19:00:24.599978+0000","last_clean":"2024-09-12T19:00:24.599978+0000","last_became_active":"2024-09-12T17:40:26.187269+0000","last_became_peered":"2024-09-12T17:40:26.187269+0000","last_unstale":"2024-09-12T19:00:24.599978+0000","last_undegraded":"2024-09-12T19:00:24.599978+0000","last_fullsized":"2024-09-12T19:00:24.599978+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'725","last_scrub_stamp":"2024-09-12T19:00:24.599793+0000","last_deep_scrub":"264'725","last_deep_scrub_stamp":"2024-09-12T19:00:24.599793+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.599793+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:04.456575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'142","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.457205+0000","last_change":"2024-09-12T19:00:32.457205+0000","last_active":"2024-09-12T19:00:32.457205+0000","last_peered":"2024-09-12T19:00:32.457205+0000","last_clean":"2024-09-12T19:00:32.457205+0000","last_became_active":"2024-09-12T17:40:28.192211+0000","last_became_peered":"2024-09-12T17:40:28.192211+0000","last_unstale":"2024-09-12T19:00:32.457205+0000","last_undegraded":"2024-09-12T19:00:32.457205+0000","last_fullsized":"2024-09-12T19:00:32.457205+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T19:00:32.457018+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T19:00:32.457018+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.457018+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:52.182385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":224,"num_write":356,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'4139","reported_seq":4794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.856854+0000","last_change":"2024-09-12T19:00:14.856712+0000","last_active":"2024-09-12T19:00:14.856854+0000","last_peered":"2024-09-12T19:00:14.856854+0000","last_clean":"2024-09-12T19:00:14.856854+0000","last_became_active":"2024-09-12T17:40:20.136148+0000","last_became_peered":"2024-09-12T17:40:20.136148+0000","last_unstale":"2024-09-12T19:00:14.856854+0000","last_undegraded":"2024-09-12T19:00:14.856854+0000","last_fullsized":"2024-09-12T19:00:14.856854+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4139","last_scrub_stamp":"2024-09-12T19:00:14.856530+0000","last_deep_scrub":"264'4139","last_deep_scrub_stamp":"2024-09-12T19:00:14.856530+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.856530+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":3000,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:49.369462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16638,"num_read_kb":13967,"num_write":6216,"num_write_kb":3097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'309","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.811675+0000","last_change":"2024-09-12T19:00:06.811526+0000","last_active":"2024-09-12T19:00:06.811675+0000","last_peered":"2024-09-12T19:00:06.811675+0000","last_clean":"2024-09-12T19:00:06.811675+0000","last_became_active":"2024-09-12T17:40:18.773552+0000","last_became_peered":"2024-09-12T17:40:18.773552+0000","last_unstale":"2024-09-12T19:00:06.811675+0000","last_undegraded":"2024-09-12T19:00:06.811675+0000","last_fullsized":"2024-09-12T19:00:06.811675+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-09-12T19:00:06.811280+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-09-12T19:00:06.811280+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.811280+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:29.209861+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5770401,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":475,"num_read_kb":17949,"num_write":926,"num_write_kb":45991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1467,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.287267+0000","last_change":"2024-09-12T19:00:27.287267+0000","last_active":"2024-09-12T19:00:27.287267+0000","last_peered":"2024-09-12T19:00:27.287267+0000","last_clean":"2024-09-12T19:00:27.287267+0000","last_became_active":"2024-09-12T17:40:22.143463+0000","last_became_peered":"2024-09-12T17:40:22.143463+0000","last_unstale":"2024-09-12T19:00:27.287267+0000","last_undegraded":"2024-09-12T19:00:27.287267+0000","last_fullsized":"2024-09-12T19:00:27.287267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T19:00:27.287082+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T19:00:27.287082+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.287082+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:51.076103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'115","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.759134+0000","last_change":"2024-09-12T19:00:35.759134+0000","last_active":"2024-09-12T19:00:35.759134+0000","last_peered":"2024-09-12T19:00:35.759134+0000","last_clean":"2024-09-12T19:00:35.759134+0000","last_became_active":"2024-09-12T17:40:24.329452+0000","last_became_peered":"2024-09-12T17:40:24.329452+0000","last_unstale":"2024-09-12T19:00:35.759134+0000","last_undegraded":"2024-09-12T19:00:35.759134+0000","last_fullsized":"2024-09-12T19:00:35.759134+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-12T19:00:35.758923+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-12T19:00:35.758923+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.758923+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:17.591973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'753","reported_seq":2633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.384786+0000","last_change":"2024-09-12T19:00:24.384786+0000","last_active":"2024-09-12T19:00:24.384786+0000","last_peered":"2024-09-12T19:00:24.384786+0000","last_clean":"2024-09-12T19:00:24.384786+0000","last_became_active":"2024-09-12T17:40:26.183016+0000","last_became_peered":"2024-09-12T17:40:26.183016+0000","last_unstale":"2024-09-12T19:00:24.384786+0000","last_undegraded":"2024-09-12T19:00:24.384786+0000","last_fullsized":"2024-09-12T19:00:24.384786+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'753","last_scrub_stamp":"2024-09-12T19:00:24.384601+0000","last_deep_scrub":"264'753","last_deep_scrub_stamp":"2024-09-12T19:00:24.384601+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.384601+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:42.720645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'113","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.901377+0000","last_change":"2024-09-12T19:00:38.901377+0000","last_active":"2024-09-12T19:00:38.901377+0000","last_peered":"2024-09-12T19:00:38.901377+0000","last_clean":"2024-09-12T19:00:38.901377+0000","last_became_active":"2024-09-12T17:40:28.180192+0000","last_became_peered":"2024-09-12T17:40:28.180192+0000","last_unstale":"2024-09-12T19:00:38.901377+0000","last_undegraded":"2024-09-12T19:00:38.901377+0000","last_fullsized":"2024-09-12T19:00:38.901377+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'113","last_scrub_stamp":"2024-09-12T19:00:38.901198+0000","last_deep_scrub":"264'113","last_deep_scrub_stamp":"2024-09-12T19:00:38.901198+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.901198+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:35.073698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":167,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'272","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.355420+0000","last_change":"2024-09-12T19:00:18.355420+0000","last_active":"2024-09-12T19:00:18.355420+0000","last_peered":"2024-09-12T19:00:18.355420+0000","last_clean":"2024-09-12T19:00:18.355420+0000","last_became_active":"2024-09-12T17:40:20.125511+0000","last_became_peered":"2024-09-12T17:40:20.125511+0000","last_unstale":"2024-09-12T19:00:18.355420+0000","last_undegraded":"2024-09-12T19:00:18.355420+0000","last_fullsized":"2024-09-12T19:00:18.355420+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-12T19:00:18.355195+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-12T19:00:18.355195+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.355195+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:41.045399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1212,"num_read_kb":1000,"num_write":434,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'288","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.711798+0000","last_change":"2024-09-12T19:00:06.711722+0000","last_active":"2024-09-12T19:00:06.711798+0000","last_peered":"2024-09-12T19:00:06.711798+0000","last_clean":"2024-09-12T19:00:06.711798+0000","last_became_active":"2024-09-12T17:40:18.769054+0000","last_became_peered":"2024-09-12T17:40:18.769054+0000","last_unstale":"2024-09-12T19:00:06.711798+0000","last_undegraded":"2024-09-12T19:00:06.711798+0000","last_fullsized":"2024-09-12T19:00:06.711798+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'288","last_scrub_stamp":"2024-09-12T19:00:06.711610+0000","last_deep_scrub":"264'288","last_deep_scrub_stamp":"2024-09-12T19:00:06.711610+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.711610+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:07.586624+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526370,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":78920,"num_write":889,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.906296+0000","last_change":"2024-09-12T19:00:26.906171+0000","last_active":"2024-09-12T19:00:26.906296+0000","last_peered":"2024-09-12T19:00:26.906296+0000","last_clean":"2024-09-12T19:00:26.906296+0000","last_became_active":"2024-09-12T17:40:22.138875+0000","last_became_peered":"2024-09-12T17:40:22.138875+0000","last_unstale":"2024-09-12T19:00:26.906296+0000","last_undegraded":"2024-09-12T19:00:26.906296+0000","last_fullsized":"2024-09-12T19:00:26.906296+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.905998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.905998+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.905998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:49.165143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'405","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.221799+0000","last_change":"2024-09-12T19:00:32.221799+0000","last_active":"2024-09-12T19:00:32.221799+0000","last_peered":"2024-09-12T19:00:32.221799+0000","last_clean":"2024-09-12T19:00:32.221799+0000","last_became_active":"2024-09-12T17:40:24.173537+0000","last_became_peered":"2024-09-12T17:40:24.173537+0000","last_unstale":"2024-09-12T19:00:32.221799+0000","last_undegraded":"2024-09-12T19:00:32.221799+0000","last_fullsized":"2024-09-12T19:00:32.221799+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-12T19:00:32.221589+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-12T19:00:32.221589+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.221589+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:49.519214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47427,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":650,"num_read_kb":1371,"num_write":508,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.364124+0000","last_change":"2024-09-12T19:00:22.364124+0000","last_active":"2024-09-12T19:00:22.364124+0000","last_peered":"2024-09-12T19:00:22.364124+0000","last_clean":"2024-09-12T19:00:22.364124+0000","last_became_active":"2024-09-12T17:40:26.183228+0000","last_became_peered":"2024-09-12T17:40:26.183228+0000","last_unstale":"2024-09-12T19:00:22.364124+0000","last_undegraded":"2024-09-12T19:00:22.364124+0000","last_fullsized":"2024-09-12T19:00:22.364124+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.363940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.363940+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.363940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:55.507213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'141","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.409412+0000","last_change":"2024-09-12T19:00:31.409412+0000","last_active":"2024-09-12T19:00:31.409412+0000","last_peered":"2024-09-12T19:00:31.409412+0000","last_clean":"2024-09-12T19:00:31.409412+0000","last_became_active":"2024-09-12T17:40:28.191461+0000","last_became_peered":"2024-09-12T17:40:28.191461+0000","last_unstale":"2024-09-12T19:00:31.409412+0000","last_undegraded":"2024-09-12T19:00:31.409412+0000","last_fullsized":"2024-09-12T19:00:31.409412+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T19:00:31.409211+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T19:00:31.409211+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.409211+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:12.731717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":326,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'92","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.412245+0000","last_change":"2024-09-12T19:00:14.412245+0000","last_active":"2024-09-12T19:00:14.412245+0000","last_peered":"2024-09-12T19:00:14.412245+0000","last_clean":"2024-09-12T19:00:14.412245+0000","last_became_active":"2024-09-12T17:40:20.146160+0000","last_became_peered":"2024-09-12T17:40:20.146160+0000","last_unstale":"2024-09-12T19:00:14.412245+0000","last_undegraded":"2024-09-12T19:00:14.412245+0000","last_fullsized":"2024-09-12T19:00:14.412245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-12T19:00:14.412058+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-12T19:00:14.412058+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.412058+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:06.611295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":365,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.851657+0000","last_change":"2024-09-12T19:00:07.851479+0000","last_active":"2024-09-12T19:00:07.851657+0000","last_peered":"2024-09-12T19:00:07.851657+0000","last_clean":"2024-09-12T19:00:07.851657+0000","last_became_active":"2024-09-12T17:40:03.636856+0000","last_became_peered":"2024-09-12T17:40:03.636856+0000","last_unstale":"2024-09-12T19:00:07.851657+0000","last_undegraded":"2024-09-12T19:00:07.851657+0000","last_fullsized":"2024-09-12T19:00:07.851657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T19:00:07.851245+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T19:00:07.851245+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.851245+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:47.311318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.303193+0000","last_change":"2024-09-12T19:00:06.303193+0000","last_active":"2024-09-12T19:00:06.303193+0000","last_peered":"2024-09-12T19:00:06.303193+0000","last_clean":"2024-09-12T19:00:06.303193+0000","last_became_active":"2024-09-12T17:40:09.670674+0000","last_became_peered":"2024-09-12T17:40:09.670674+0000","last_unstale":"2024-09-12T19:00:06.303193+0000","last_undegraded":"2024-09-12T19:00:06.303193+0000","last_fullsized":"2024-09-12T19:00:06.303193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:06.303007+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:06.303007+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.303007+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:00.965061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001302742,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'381","reported_seq":1139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.703311+0000","last_change":"2024-09-12T19:00:05.703311+0000","last_active":"2024-09-12T19:00:05.703311+0000","last_peered":"2024-09-12T19:00:05.703311+0000","last_clean":"2024-09-12T19:00:05.703311+0000","last_became_active":"2024-09-12T17:40:18.774164+0000","last_became_peered":"2024-09-12T17:40:18.774164+0000","last_unstale":"2024-09-12T19:00:05.703311+0000","last_undegraded":"2024-09-12T19:00:05.703311+0000","last_fullsized":"2024-09-12T19:00:05.703311+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-12T19:00:05.703231+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-12T19:00:05.703231+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.703231+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.776143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1557056,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":732,"num_read_kb":41235,"num_write":1123,"num_write_kb":37796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.935647+0000","last_change":"2024-09-12T19:00:26.935647+0000","last_active":"2024-09-12T19:00:26.935647+0000","last_peered":"2024-09-12T19:00:26.935647+0000","last_clean":"2024-09-12T19:00:26.935647+0000","last_became_active":"2024-09-12T17:40:22.148190+0000","last_became_peered":"2024-09-12T17:40:22.148190+0000","last_unstale":"2024-09-12T19:00:26.935647+0000","last_undegraded":"2024-09-12T19:00:26.935647+0000","last_fullsized":"2024-09-12T19:00:26.935647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.935461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.935461+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.935461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:01.083634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'739","reported_seq":1464,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.317276+0000","last_change":"2024-09-12T19:00:29.317143+0000","last_active":"2024-09-12T19:00:29.317276+0000","last_peered":"2024-09-12T19:00:29.317276+0000","last_clean":"2024-09-12T19:00:29.317276+0000","last_became_active":"2024-09-12T17:40:24.176757+0000","last_became_peered":"2024-09-12T17:40:24.176757+0000","last_unstale":"2024-09-12T19:00:29.317276+0000","last_undegraded":"2024-09-12T19:00:29.317276+0000","last_fullsized":"2024-09-12T19:00:29.317276+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'739","last_scrub_stamp":"2024-09-12T19:00:29.316937+0000","last_deep_scrub":"264'739","last_deep_scrub_stamp":"2024-09-12T19:00:29.316937+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.316937+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:55.400378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107902,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1433,"num_read_kb":3342,"num_write":1350,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89038,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.307929+0000","last_change":"2024-09-12T19:00:30.307789+0000","last_active":"2024-09-12T19:00:30.307929+0000","last_peered":"2024-09-12T19:00:30.307929+0000","last_clean":"2024-09-12T19:00:30.307929+0000","last_became_active":"2024-09-12T17:40:26.190522+0000","last_became_peered":"2024-09-12T17:40:26.190522+0000","last_unstale":"2024-09-12T19:00:30.307929+0000","last_undegraded":"2024-09-12T19:00:30.307929+0000","last_fullsized":"2024-09-12T19:00:30.307929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.307597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.307597+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.307597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:45.814039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'199","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.271683+0000","last_change":"2024-09-12T19:00:29.271518+0000","last_active":"2024-09-12T19:00:29.271683+0000","last_peered":"2024-09-12T19:00:29.271683+0000","last_clean":"2024-09-12T19:00:29.271683+0000","last_became_active":"2024-09-12T17:40:28.193456+0000","last_became_peered":"2024-09-12T17:40:28.193456+0000","last_unstale":"2024-09-12T19:00:29.271683+0000","last_undegraded":"2024-09-12T19:00:29.271683+0000","last_fullsized":"2024-09-12T19:00:29.271683+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-12T19:00:29.271294+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-12T19:00:29.271294+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.271294+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:08.895317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":530,"num_write":424,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'121","reported_seq":726,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.359863+0000","last_change":"2024-09-12T19:00:14.359729+0000","last_active":"2024-09-12T19:00:14.359863+0000","last_peered":"2024-09-12T19:00:14.359863+0000","last_clean":"2024-09-12T19:00:14.359863+0000","last_became_active":"2024-09-12T17:40:20.130774+0000","last_became_peered":"2024-09-12T17:40:20.130774+0000","last_unstale":"2024-09-12T19:00:14.359863+0000","last_undegraded":"2024-09-12T19:00:14.359863+0000","last_fullsized":"2024-09-12T19:00:14.359863+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-12T19:00:14.359520+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-12T19:00:14.359520+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.359520+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:27.221397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":441,"num_write":172,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.888185+0000","last_change":"2024-09-12T19:00:16.888004+0000","last_active":"2024-09-12T19:00:16.888185+0000","last_peered":"2024-09-12T19:00:16.888185+0000","last_clean":"2024-09-12T19:00:16.888185+0000","last_became_active":"2024-09-12T17:40:09.666272+0000","last_became_peered":"2024-09-12T17:40:09.666272+0000","last_unstale":"2024-09-12T19:00:16.888185+0000","last_undegraded":"2024-09-12T19:00:16.888185+0000","last_fullsized":"2024-09-12T19:00:16.888185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:16.887821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:16.887821+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.887821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:53.458174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001052545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'381","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:03.380638+0000","last_change":"2024-09-12T19:00:03.380638+0000","last_active":"2024-09-12T19:00:03.380638+0000","last_peered":"2024-09-12T19:00:03.380638+0000","last_clean":"2024-09-12T19:00:03.380638+0000","last_became_active":"2024-09-12T17:40:18.774751+0000","last_became_peered":"2024-09-12T17:40:18.774751+0000","last_unstale":"2024-09-12T19:00:03.380638+0000","last_undegraded":"2024-09-12T19:00:03.380638+0000","last_fullsized":"2024-09-12T19:00:03.380638+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-12T19:00:03.380508+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-12T19:00:03.380508+0000","last_clean_scrub_stamp":"2024-09-12T19:00:03.380508+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:57.346685+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":730,"num_write":1215,"num_write_kb":17029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.340588+0000","last_change":"2024-09-12T19:00:23.340365+0000","last_active":"2024-09-12T19:00:23.340588+0000","last_peered":"2024-09-12T19:00:23.340588+0000","last_clean":"2024-09-12T19:00:23.340588+0000","last_became_active":"2024-09-12T17:40:22.147184+0000","last_became_peered":"2024-09-12T17:40:22.147184+0000","last_unstale":"2024-09-12T19:00:23.340588+0000","last_undegraded":"2024-09-12T19:00:23.340588+0000","last_fullsized":"2024-09-12T19:00:23.340588+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.340151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.340151+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.340151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:44.036811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1357","reported_seq":3273,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.312642+0000","last_change":"2024-09-12T19:00:25.312642+0000","last_active":"2024-09-12T19:00:25.312642+0000","last_peered":"2024-09-12T19:00:25.312642+0000","last_clean":"2024-09-12T19:00:25.312642+0000","last_became_active":"2024-09-12T17:40:24.169050+0000","last_became_peered":"2024-09-12T17:40:24.169050+0000","last_unstale":"2024-09-12T19:00:25.312642+0000","last_undegraded":"2024-09-12T19:00:25.312642+0000","last_fullsized":"2024-09-12T19:00:25.312642+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1357","last_scrub_stamp":"2024-09-12T19:00:25.312325+0000","last_deep_scrub":"264'1357","last_deep_scrub_stamp":"2024-09-12T19:00:25.312325+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.312325+0000","objects_scrubbed":12,"log_size":57,"log_dups_size":1300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:35.859451+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147644,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2159,"num_read_kb":4153,"num_write":1266,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.827311+0000","last_change":"2024-09-12T19:00:33.827311+0000","last_active":"2024-09-12T19:00:33.827311+0000","last_peered":"2024-09-12T19:00:33.827311+0000","last_clean":"2024-09-12T19:00:33.827311+0000","last_became_active":"2024-09-12T17:40:26.202360+0000","last_became_peered":"2024-09-12T17:40:26.202360+0000","last_unstale":"2024-09-12T19:00:33.827311+0000","last_undegraded":"2024-09-12T19:00:33.827311+0000","last_fullsized":"2024-09-12T19:00:33.827311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:33.827129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:33.827129+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.827129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:10.410127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'193","reported_seq":742,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.424140+0000","last_change":"2024-09-12T19:00:37.423960+0000","last_active":"2024-09-12T19:00:37.424140+0000","last_peered":"2024-09-12T19:00:37.424140+0000","last_clean":"2024-09-12T19:00:37.424140+0000","last_became_active":"2024-09-12T17:40:28.189387+0000","last_became_peered":"2024-09-12T17:40:28.189387+0000","last_unstale":"2024-09-12T19:00:37.424140+0000","last_undegraded":"2024-09-12T19:00:37.424140+0000","last_fullsized":"2024-09-12T19:00:37.424140+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-12T19:00:37.423750+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-12T19:00:37.423750+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.423750+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:40.018773+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":364,"num_write":413,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'193","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.427674+0000","last_change":"2024-09-12T19:00:14.427403+0000","last_active":"2024-09-12T19:00:14.427674+0000","last_peered":"2024-09-12T19:00:14.427674+0000","last_clean":"2024-09-12T19:00:14.427674+0000","last_became_active":"2024-09-12T17:40:20.129646+0000","last_became_peered":"2024-09-12T17:40:20.129646+0000","last_unstale":"2024-09-12T19:00:14.427674+0000","last_undegraded":"2024-09-12T19:00:14.427674+0000","last_fullsized":"2024-09-12T19:00:14.427674+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-12T19:00:14.427181+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-12T19:00:14.427181+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.427181+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:07.543026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":706,"num_write":294,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.575531+0000","last_change":"2024-09-12T19:00:05.575456+0000","last_active":"2024-09-12T19:00:05.575531+0000","last_peered":"2024-09-12T19:00:05.575531+0000","last_clean":"2024-09-12T19:00:05.575531+0000","last_became_active":"2024-09-12T17:40:09.771196+0000","last_became_peered":"2024-09-12T17:40:09.771196+0000","last_unstale":"2024-09-12T19:00:05.575531+0000","last_undegraded":"2024-09-12T19:00:05.575531+0000","last_fullsized":"2024-09-12T19:00:05.575531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:05.575379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:05.575379+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.575379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:05.851170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010655720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'333","reported_seq":1036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.412121+0000","last_change":"2024-09-12T19:00:05.412049+0000","last_active":"2024-09-12T19:00:05.412121+0000","last_peered":"2024-09-12T19:00:05.412121+0000","last_clean":"2024-09-12T19:00:05.412121+0000","last_became_active":"2024-09-12T17:40:18.759514+0000","last_became_peered":"2024-09-12T17:40:18.759514+0000","last_unstale":"2024-09-12T19:00:05.412121+0000","last_undegraded":"2024-09-12T19:00:05.412121+0000","last_fullsized":"2024-09-12T19:00:05.412121+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-12T19:00:05.411956+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-12T19:00:05.411956+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.411956+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:48.630492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1491790,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":20357,"num_write":1029,"num_write_kb":29003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.647771+0000","last_change":"2024-09-12T19:00:12.647430+0000","last_active":"2024-09-12T19:00:12.647771+0000","last_peered":"2024-09-12T19:00:12.647771+0000","last_clean":"2024-09-12T19:00:12.647771+0000","last_became_active":"2024-09-12T17:40:22.138606+0000","last_became_peered":"2024-09-12T17:40:22.138606+0000","last_unstale":"2024-09-12T19:00:12.647771+0000","last_undegraded":"2024-09-12T19:00:12.647771+0000","last_fullsized":"2024-09-12T19:00:12.647771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:00:12.647148+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:00:12.647148+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.647148+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:08.127072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'303","reported_seq":1819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.954465+0000","last_change":"2024-09-12T19:00:28.954465+0000","last_active":"2024-09-12T19:00:28.954465+0000","last_peered":"2024-09-12T19:00:28.954465+0000","last_clean":"2024-09-12T19:00:28.954465+0000","last_became_active":"2024-09-12T17:40:24.329425+0000","last_became_peered":"2024-09-12T17:40:24.329425+0000","last_unstale":"2024-09-12T19:00:28.954465+0000","last_undegraded":"2024-09-12T19:00:28.954465+0000","last_fullsized":"2024-09-12T19:00:28.954465+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-12T19:00:28.954269+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-12T19:00:28.954269+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.954269+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:32.215543+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":264,"num_read_kb":256,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.354987+0000","last_change":"2024-09-12T19:00:35.354987+0000","last_active":"2024-09-12T19:00:35.354987+0000","last_peered":"2024-09-12T19:00:35.354987+0000","last_clean":"2024-09-12T19:00:35.354987+0000","last_became_active":"2024-09-12T17:40:26.188740+0000","last_became_peered":"2024-09-12T17:40:26.188740+0000","last_unstale":"2024-09-12T19:00:35.354987+0000","last_undegraded":"2024-09-12T19:00:35.354987+0000","last_fullsized":"2024-09-12T19:00:35.354987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:35.354801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:35.354801+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.354801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:02.362356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'273","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.791677+0000","last_change":"2024-09-12T19:00:41.791677+0000","last_active":"2024-09-12T19:00:41.791677+0000","last_peered":"2024-09-12T19:00:41.791677+0000","last_clean":"2024-09-12T19:00:41.791677+0000","last_became_active":"2024-09-12T17:40:28.202238+0000","last_became_peered":"2024-09-12T17:40:28.202238+0000","last_unstale":"2024-09-12T19:00:41.791677+0000","last_undegraded":"2024-09-12T19:00:41.791677+0000","last_fullsized":"2024-09-12T19:00:41.791677+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-12T19:00:41.791464+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-12T19:00:41.791464+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.791464+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:50.967702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":592,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'389","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.365530+0000","last_change":"2024-09-12T19:00:16.365530+0000","last_active":"2024-09-12T19:00:16.365530+0000","last_peered":"2024-09-12T19:00:16.365530+0000","last_clean":"2024-09-12T19:00:16.365530+0000","last_became_active":"2024-09-12T17:40:20.127774+0000","last_became_peered":"2024-09-12T17:40:20.127774+0000","last_unstale":"2024-09-12T19:00:16.365530+0000","last_undegraded":"2024-09-12T19:00:16.365530+0000","last_fullsized":"2024-09-12T19:00:16.365530+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'389","last_scrub_stamp":"2024-09-12T19:00:16.365337+0000","last_deep_scrub":"264'389","last_deep_scrub_stamp":"2024-09-12T19:00:16.365337+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.365337+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:35.682974+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1689,"num_read_kb":1329,"num_write":647,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":733,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.329130+0000","last_change":"2024-09-12T19:00:07.329130+0000","last_active":"2024-09-12T19:00:07.329130+0000","last_peered":"2024-09-12T19:00:07.329130+0000","last_clean":"2024-09-12T19:00:07.329130+0000","last_became_active":"2024-09-12T17:40:09.672745+0000","last_became_peered":"2024-09-12T17:40:09.672745+0000","last_unstale":"2024-09-12T19:00:07.329130+0000","last_undegraded":"2024-09-12T19:00:07.329130+0000","last_fullsized":"2024-09-12T19:00:07.329130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:00:07.328927+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:00:07.328927+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.328927+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:19.924413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002775694,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'386","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:05.822955+0000","last_change":"2024-09-12T19:00:05.822955+0000","last_active":"2024-09-12T19:00:05.822955+0000","last_peered":"2024-09-12T19:00:05.822955+0000","last_clean":"2024-09-12T19:00:05.822955+0000","last_became_active":"2024-09-12T17:40:18.769909+0000","last_became_peered":"2024-09-12T17:40:18.769909+0000","last_unstale":"2024-09-12T19:00:05.822955+0000","last_undegraded":"2024-09-12T19:00:05.822955+0000","last_fullsized":"2024-09-12T19:00:05.822955+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'386","last_scrub_stamp":"2024-09-12T19:00:05.822732+0000","last_deep_scrub":"264'386","last_deep_scrub_stamp":"2024-09-12T19:00:05.822732+0000","last_clean_scrub_stamp":"2024-09-12T19:00:05.822732+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:20.836010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":740079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":12377,"num_write":1306,"num_write_kb":22203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.344459+0000","last_change":"2024-09-12T19:00:23.344459+0000","last_active":"2024-09-12T19:00:23.344459+0000","last_peered":"2024-09-12T19:00:23.344459+0000","last_clean":"2024-09-12T19:00:23.344459+0000","last_became_active":"2024-09-12T17:40:22.145410+0000","last_became_peered":"2024-09-12T17:40:22.145410+0000","last_unstale":"2024-09-12T19:00:23.344459+0000","last_undegraded":"2024-09-12T19:00:23.344459+0000","last_fullsized":"2024-09-12T19:00:23.344459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.344276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.344276+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.344276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:27.422058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'169","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.726655+0000","last_change":"2024-09-12T19:00:28.726514+0000","last_active":"2024-09-12T19:00:28.726655+0000","last_peered":"2024-09-12T19:00:28.726655+0000","last_clean":"2024-09-12T19:00:28.726655+0000","last_became_active":"2024-09-12T17:40:24.169937+0000","last_became_peered":"2024-09-12T17:40:24.169937+0000","last_unstale":"2024-09-12T19:00:28.726655+0000","last_undegraded":"2024-09-12T19:00:28.726655+0000","last_fullsized":"2024-09-12T19:00:28.726655+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-12T19:00:28.726336+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-12T19:00:28.726336+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.726336+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:14.806353+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":193,"num_write":146,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.372733+0000","last_change":"2024-09-12T19:00:21.372606+0000","last_active":"2024-09-12T19:00:21.372733+0000","last_peered":"2024-09-12T19:00:21.372733+0000","last_clean":"2024-09-12T19:00:21.372733+0000","last_became_active":"2024-09-12T17:40:26.171660+0000","last_became_peered":"2024-09-12T17:40:26.171660+0000","last_unstale":"2024-09-12T19:00:21.372733+0000","last_undegraded":"2024-09-12T19:00:21.372733+0000","last_fullsized":"2024-09-12T19:00:21.372733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.372426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.372426+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.372426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:44.988743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'123","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.259951+0000","last_change":"2024-09-12T19:00:37.259703+0000","last_active":"2024-09-12T19:00:37.259951+0000","last_peered":"2024-09-12T19:00:37.259951+0000","last_clean":"2024-09-12T19:00:37.259951+0000","last_became_active":"2024-09-12T17:40:28.201694+0000","last_became_peered":"2024-09-12T17:40:28.201694+0000","last_unstale":"2024-09-12T19:00:37.259951+0000","last_undegraded":"2024-09-12T19:00:37.259951+0000","last_fullsized":"2024-09-12T19:00:37.259951+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-09-12T19:00:37.259452+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-09-12T19:00:37.259452+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.259452+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:06.026195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":250,"num_write":312,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'144","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.402435+0000","last_change":"2024-09-12T19:00:13.402435+0000","last_active":"2024-09-12T19:00:13.402435+0000","last_peered":"2024-09-12T19:00:13.402435+0000","last_clean":"2024-09-12T19:00:13.402435+0000","last_became_active":"2024-09-12T17:40:20.127727+0000","last_became_peered":"2024-09-12T17:40:20.127727+0000","last_unstale":"2024-09-12T19:00:13.402435+0000","last_undegraded":"2024-09-12T19:00:13.402435+0000","last_fullsized":"2024-09-12T19:00:13.402435+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:13.402249+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:13.402249+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.402249+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:53.064547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":625,"num_read_kb":513,"num_write":241,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'316","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.312786+0000","last_change":"2024-09-12T19:00:08.312786+0000","last_active":"2024-09-12T19:00:08.312786+0000","last_peered":"2024-09-12T19:00:08.312786+0000","last_clean":"2024-09-12T19:00:08.312786+0000","last_became_active":"2024-09-12T17:40:18.768544+0000","last_became_peered":"2024-09-12T17:40:18.768544+0000","last_unstale":"2024-09-12T19:00:08.312786+0000","last_undegraded":"2024-09-12T19:00:08.312786+0000","last_fullsized":"2024-09-12T19:00:08.312786+0000","mapping_epoch":23,"log_start":"264'301","ondisk_log_start":"264'301","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T19:00:08.312642+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T19:00:08.312642+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.312642+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":301,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:52.360053+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":425,"num_read_kb":64899,"num_write":927,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.370168+0000","last_change":"2024-09-12T19:00:06.370168+0000","last_active":"2024-09-12T19:00:06.370168+0000","last_peered":"2024-09-12T19:00:06.370168+0000","last_clean":"2024-09-12T19:00:06.370168+0000","last_became_active":"2024-09-12T17:40:09.770645+0000","last_became_peered":"2024-09-12T17:40:09.770645+0000","last_unstale":"2024-09-12T19:00:06.370168+0000","last_undegraded":"2024-09-12T19:00:06.370168+0000","last_fullsized":"2024-09-12T19:00:06.370168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.370093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.370093+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.370093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:21.045928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091158000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:22.368257+0000","last_change":"2024-09-12T19:00:22.368257+0000","last_active":"2024-09-12T19:00:22.368257+0000","last_peered":"2024-09-12T19:00:22.368257+0000","last_clean":"2024-09-12T19:00:22.368257+0000","last_became_active":"2024-09-12T17:40:22.136155+0000","last_became_peered":"2024-09-12T17:40:22.136155+0000","last_unstale":"2024-09-12T19:00:22.368257+0000","last_undegraded":"2024-09-12T19:00:22.368257+0000","last_fullsized":"2024-09-12T19:00:22.368257+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:22.368076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:22.368076+0000","last_clean_scrub_stamp":"2024-09-12T19:00:22.368076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.095079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'658","reported_seq":1363,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.401099+0000","last_change":"2024-09-12T19:00:25.400934+0000","last_active":"2024-09-12T19:00:25.401099+0000","last_peered":"2024-09-12T19:00:25.401099+0000","last_clean":"2024-09-12T19:00:25.401099+0000","last_became_active":"2024-09-12T17:40:24.173380+0000","last_became_peered":"2024-09-12T17:40:24.173380+0000","last_unstale":"2024-09-12T19:00:25.401099+0000","last_undegraded":"2024-09-12T19:00:25.401099+0000","last_fullsized":"2024-09-12T19:00:25.401099+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'658","last_scrub_stamp":"2024-09-12T19:00:25.400715+0000","last_deep_scrub":"264'658","last_deep_scrub_stamp":"2024-09-12T19:00:25.400715+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.400715+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:19.643462+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106768,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":3034,"num_write":2200,"num_write_kb":2020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500800,"num_omap_keys":1132,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.928929+0000","last_change":"2024-09-12T19:00:35.928929+0000","last_active":"2024-09-12T19:00:35.928929+0000","last_peered":"2024-09-12T19:00:35.928929+0000","last_clean":"2024-09-12T19:00:35.928929+0000","last_became_active":"2024-09-12T17:40:26.191417+0000","last_became_peered":"2024-09-12T17:40:26.191417+0000","last_unstale":"2024-09-12T19:00:35.928929+0000","last_undegraded":"2024-09-12T19:00:35.928929+0000","last_fullsized":"2024-09-12T19:00:35.928929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:35.928742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:35.928742+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.928742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:13.337364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'177","reported_seq":715,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.300628+0000","last_change":"2024-09-12T19:00:39.300628+0000","last_active":"2024-09-12T19:00:39.300628+0000","last_peered":"2024-09-12T19:00:39.300628+0000","last_clean":"2024-09-12T19:00:39.300628+0000","last_became_active":"2024-09-12T17:40:28.186922+0000","last_became_peered":"2024-09-12T17:40:28.186922+0000","last_unstale":"2024-09-12T19:00:39.300628+0000","last_undegraded":"2024-09-12T19:00:39.300628+0000","last_fullsized":"2024-09-12T19:00:39.300628+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T19:00:39.300439+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T19:00:39.300439+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.300439+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:10.112573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'144","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.343342+0000","last_change":"2024-09-12T19:00:13.343342+0000","last_active":"2024-09-12T19:00:13.343342+0000","last_peered":"2024-09-12T19:00:13.343342+0000","last_clean":"2024-09-12T19:00:13.343342+0000","last_became_active":"2024-09-12T17:40:20.112490+0000","last_became_peered":"2024-09-12T17:40:20.112490+0000","last_unstale":"2024-09-12T19:00:13.343342+0000","last_undegraded":"2024-09-12T19:00:13.343342+0000","last_fullsized":"2024-09-12T19:00:13.343342+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T19:00:13.343164+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T19:00:13.343164+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.343164+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:03.480373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":606,"num_read_kb":504,"num_write":208,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'318","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.356400+0000","last_change":"2024-09-12T19:00:09.356400+0000","last_active":"2024-09-12T19:00:09.356400+0000","last_peered":"2024-09-12T19:00:09.356400+0000","last_clean":"2024-09-12T19:00:09.356400+0000","last_became_active":"2024-09-12T17:40:18.760130+0000","last_became_peered":"2024-09-12T17:40:18.760130+0000","last_unstale":"2024-09-12T19:00:09.356400+0000","last_undegraded":"2024-09-12T19:00:09.356400+0000","last_fullsized":"2024-09-12T19:00:09.356400+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-12T19:00:09.356157+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-12T19:00:09.356157+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.356157+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:59.332713+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359201,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":428,"num_read_kb":2118,"num_write":932,"num_write_kb":13193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.862213+0000","last_change":"2024-09-12T19:00:06.862213+0000","last_active":"2024-09-12T19:00:06.862213+0000","last_peered":"2024-09-12T19:00:06.862213+0000","last_clean":"2024-09-12T19:00:06.862213+0000","last_became_active":"2024-09-12T17:40:09.770504+0000","last_became_peered":"2024-09-12T17:40:09.770504+0000","last_unstale":"2024-09-12T19:00:06.862213+0000","last_undegraded":"2024-09-12T19:00:06.862213+0000","last_fullsized":"2024-09-12T19:00:06.862213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.862012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.862012+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.862012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:25.645802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001093257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.417289+0000","last_change":"2024-09-12T19:00:19.417289+0000","last_active":"2024-09-12T19:00:19.417289+0000","last_peered":"2024-09-12T19:00:19.417289+0000","last_clean":"2024-09-12T19:00:19.417289+0000","last_became_active":"2024-09-12T17:40:22.136095+0000","last_became_peered":"2024-09-12T17:40:22.136095+0000","last_unstale":"2024-09-12T19:00:19.417289+0000","last_undegraded":"2024-09-12T19:00:19.417289+0000","last_fullsized":"2024-09-12T19:00:19.417289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:19.417107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:19.417107+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.417107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:24.668335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'263","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.374917+0000","last_change":"2024-09-12T19:00:28.374917+0000","last_active":"2024-09-12T19:00:28.374917+0000","last_peered":"2024-09-12T19:00:28.374917+0000","last_clean":"2024-09-12T19:00:28.374917+0000","last_became_active":"2024-09-12T17:40:24.332477+0000","last_became_peered":"2024-09-12T17:40:24.332477+0000","last_unstale":"2024-09-12T19:00:28.374917+0000","last_undegraded":"2024-09-12T19:00:28.374917+0000","last_fullsized":"2024-09-12T19:00:28.374917+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-09-12T19:00:28.374594+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-09-12T19:00:28.374594+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.374594+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:33.713209+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":296,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'760","reported_seq":3106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.209433+0000","last_change":"2024-09-12T19:00:33.209275+0000","last_active":"2024-09-12T19:00:33.209433+0000","last_peered":"2024-09-12T19:00:33.209433+0000","last_clean":"2024-09-12T19:00:33.209433+0000","last_became_active":"2024-09-12T17:40:26.179728+0000","last_became_peered":"2024-09-12T17:40:26.179728+0000","last_unstale":"2024-09-12T19:00:33.209433+0000","last_undegraded":"2024-09-12T19:00:33.209433+0000","last_fullsized":"2024-09-12T19:00:33.209433+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'760","last_scrub_stamp":"2024-09-12T19:00:33.209091+0000","last_deep_scrub":"264'760","last_deep_scrub_stamp":"2024-09-12T19:00:33.209091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.209091+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:21.534199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'149","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.767198+0000","last_change":"2024-09-12T19:00:40.767198+0000","last_active":"2024-09-12T19:00:40.767198+0000","last_peered":"2024-09-12T19:00:40.767198+0000","last_clean":"2024-09-12T19:00:40.767198+0000","last_became_active":"2024-09-12T17:40:28.201571+0000","last_became_peered":"2024-09-12T17:40:28.201571+0000","last_unstale":"2024-09-12T19:00:40.767198+0000","last_undegraded":"2024-09-12T19:00:40.767198+0000","last_fullsized":"2024-09-12T19:00:40.767198+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T19:00:40.767001+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T19:00:40.767001+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.767001+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:36.748244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":253,"num_write":364,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'450","reported_seq":1172,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.610597+0000","last_change":"2024-09-12T19:00:13.610343+0000","last_active":"2024-09-12T19:00:13.610597+0000","last_peered":"2024-09-12T19:00:13.610597+0000","last_clean":"2024-09-12T19:00:13.610597+0000","last_became_active":"2024-09-12T17:40:20.135950+0000","last_became_peered":"2024-09-12T17:40:20.135950+0000","last_unstale":"2024-09-12T19:00:13.610597+0000","last_undegraded":"2024-09-12T19:00:13.610597+0000","last_fullsized":"2024-09-12T19:00:13.610597+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'450","last_scrub_stamp":"2024-09-12T19:00:13.610072+0000","last_deep_scrub":"264'450","last_deep_scrub_stamp":"2024-09-12T19:00:13.610072+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.610072+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:40.560388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1875,"num_read_kb":1500,"num_write":660,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'335","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.674839+0000","last_change":"2024-09-12T19:00:04.674790+0000","last_active":"2024-09-12T19:00:04.674839+0000","last_peered":"2024-09-12T19:00:04.674839+0000","last_clean":"2024-09-12T19:00:04.674839+0000","last_became_active":"2024-09-12T17:40:18.762324+0000","last_became_peered":"2024-09-12T17:40:18.762324+0000","last_unstale":"2024-09-12T19:00:04.674839+0000","last_undegraded":"2024-09-12T19:00:04.674839+0000","last_fullsized":"2024-09-12T19:00:04.674839+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T19:00:04.674691+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T19:00:04.674691+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.674691+0000","objects_scrubbed":10,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:30.535201+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651838,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":496,"num_read_kb":85957,"num_write":1018,"num_write_kb":37704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.356092+0000","last_change":"2024-09-12T19:00:04.355848+0000","last_active":"2024-09-12T19:00:04.356092+0000","last_peered":"2024-09-12T19:00:04.356092+0000","last_clean":"2024-09-12T19:00:04.356092+0000","last_became_active":"2024-09-12T17:40:09.671019+0000","last_became_peered":"2024-09-12T17:40:09.671019+0000","last_unstale":"2024-09-12T19:00:04.356092+0000","last_undegraded":"2024-09-12T19:00:04.356092+0000","last_fullsized":"2024-09-12T19:00:04.356092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:04.355617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:04.355617+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.355617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:55.946006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096571,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.917725+0000","last_change":"2024-09-12T19:00:27.917725+0000","last_active":"2024-09-12T19:00:27.917725+0000","last_peered":"2024-09-12T19:00:27.917725+0000","last_clean":"2024-09-12T19:00:27.917725+0000","last_became_active":"2024-09-12T17:40:22.146131+0000","last_became_peered":"2024-09-12T17:40:22.146131+0000","last_unstale":"2024-09-12T19:00:27.917725+0000","last_undegraded":"2024-09-12T19:00:27.917725+0000","last_fullsized":"2024-09-12T19:00:27.917725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:27.917530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:27.917530+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.917530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:21.943314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'140","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.982000+0000","last_change":"2024-09-12T19:00:30.982000+0000","last_active":"2024-09-12T19:00:30.982000+0000","last_peered":"2024-09-12T19:00:30.982000+0000","last_clean":"2024-09-12T19:00:30.982000+0000","last_became_active":"2024-09-12T17:40:24.163566+0000","last_became_peered":"2024-09-12T17:40:24.163566+0000","last_unstale":"2024-09-12T19:00:30.982000+0000","last_undegraded":"2024-09-12T19:00:30.982000+0000","last_fullsized":"2024-09-12T19:00:30.982000+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-12T19:00:30.981801+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-12T19:00:30.981801+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.981801+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:33.987008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'788","reported_seq":2833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.751402+0000","last_change":"2024-09-12T19:00:36.751402+0000","last_active":"2024-09-12T19:00:36.751402+0000","last_peered":"2024-09-12T19:00:36.751402+0000","last_clean":"2024-09-12T19:00:36.751402+0000","last_became_active":"2024-09-12T17:40:26.194293+0000","last_became_peered":"2024-09-12T17:40:26.194293+0000","last_unstale":"2024-09-12T19:00:36.751402+0000","last_undegraded":"2024-09-12T19:00:36.751402+0000","last_fullsized":"2024-09-12T19:00:36.751402+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'788","last_scrub_stamp":"2024-09-12T19:00:36.751181+0000","last_deep_scrub":"264'788","last_deep_scrub_stamp":"2024-09-12T19:00:36.751181+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.751181+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:42.437380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'202","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.303698+0000","last_change":"2024-09-12T19:00:38.303698+0000","last_active":"2024-09-12T19:00:38.303698+0000","last_peered":"2024-09-12T19:00:38.303698+0000","last_clean":"2024-09-12T19:00:38.303698+0000","last_became_active":"2024-09-12T17:40:28.207048+0000","last_became_peered":"2024-09-12T17:40:28.207048+0000","last_unstale":"2024-09-12T19:00:38.303698+0000","last_undegraded":"2024-09-12T19:00:38.303698+0000","last_fullsized":"2024-09-12T19:00:38.303698+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-09-12T19:00:38.303469+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-09-12T19:00:38.303469+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.303469+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:54.874761+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":318,"num_write":457,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'86","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.883647+0000","last_change":"2024-09-12T19:00:13.883647+0000","last_active":"2024-09-12T19:00:13.883647+0000","last_peered":"2024-09-12T19:00:13.883647+0000","last_clean":"2024-09-12T19:00:13.883647+0000","last_became_active":"2024-09-12T17:40:20.142323+0000","last_became_peered":"2024-09-12T17:40:20.142323+0000","last_unstale":"2024-09-12T19:00:13.883647+0000","last_undegraded":"2024-09-12T19:00:13.883647+0000","last_fullsized":"2024-09-12T19:00:13.883647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T19:00:13.883445+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T19:00:13.883445+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.883445+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:31.548172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":391,"num_read_kb":327,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'428","reported_seq":1218,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.396943+0000","last_change":"2024-09-12T19:00:04.396668+0000","last_active":"2024-09-12T19:00:04.396943+0000","last_peered":"2024-09-12T19:00:04.396943+0000","last_clean":"2024-09-12T19:00:04.396943+0000","last_became_active":"2024-09-12T17:40:18.766817+0000","last_became_peered":"2024-09-12T17:40:18.766817+0000","last_unstale":"2024-09-12T19:00:04.396943+0000","last_undegraded":"2024-09-12T19:00:04.396943+0000","last_fullsized":"2024-09-12T19:00:04.396943+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-12T19:00:04.396400+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-12T19:00:04.396400+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.396400+0000","objects_scrubbed":10,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:18.046636+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4983875,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":942,"num_read_kb":8527,"num_write":1357,"num_write_kb":43864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.360350+0000","last_change":"2024-09-12T19:00:06.360220+0000","last_active":"2024-09-12T19:00:06.360350+0000","last_peered":"2024-09-12T19:00:06.360350+0000","last_clean":"2024-09-12T19:00:06.360350+0000","last_became_active":"2024-09-12T17:40:09.674331+0000","last_became_peered":"2024-09-12T17:40:09.674331+0000","last_unstale":"2024-09-12T19:00:06.360350+0000","last_undegraded":"2024-09-12T19:00:06.360350+0000","last_fullsized":"2024-09-12T19:00:06.360350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:06.360038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:06.360038+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.360038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:41.602732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012562929999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.628096+0000","last_change":"2024-09-12T19:00:21.627955+0000","last_active":"2024-09-12T19:00:21.628096+0000","last_peered":"2024-09-12T19:00:21.628096+0000","last_clean":"2024-09-12T19:00:21.628096+0000","last_became_active":"2024-09-12T17:40:22.147341+0000","last_became_peered":"2024-09-12T17:40:22.147341+0000","last_unstale":"2024-09-12T19:00:21.628096+0000","last_undegraded":"2024-09-12T19:00:21.628096+0000","last_fullsized":"2024-09-12T19:00:21.628096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.627773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.627773+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.627773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:41.060971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'794","reported_seq":1547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.993031+0000","last_change":"2024-09-12T19:00:27.993031+0000","last_active":"2024-09-12T19:00:27.993031+0000","last_peered":"2024-09-12T19:00:27.993031+0000","last_clean":"2024-09-12T19:00:27.993031+0000","last_became_active":"2024-09-12T17:40:24.329314+0000","last_became_peered":"2024-09-12T17:40:24.329314+0000","last_unstale":"2024-09-12T19:00:27.993031+0000","last_undegraded":"2024-09-12T19:00:27.993031+0000","last_fullsized":"2024-09-12T19:00:27.993031+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-09-12T19:00:27.992823+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-09-12T19:00:27.992823+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.992823+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:08.998967+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1403,"num_read_kb":3378,"num_write":1144,"num_write_kb":925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.761641+0000","last_change":"2024-09-12T19:00:34.761641+0000","last_active":"2024-09-12T19:00:34.761641+0000","last_peered":"2024-09-12T19:00:34.761641+0000","last_clean":"2024-09-12T19:00:34.761641+0000","last_became_active":"2024-09-12T17:40:26.197718+0000","last_became_peered":"2024-09-12T17:40:26.197718+0000","last_unstale":"2024-09-12T19:00:34.761641+0000","last_undegraded":"2024-09-12T19:00:34.761641+0000","last_fullsized":"2024-09-12T19:00:34.761641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.761433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.761433+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.761433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:18.548460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'119","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.301208+0000","last_change":"2024-09-12T19:00:38.301208+0000","last_active":"2024-09-12T19:00:38.301208+0000","last_peered":"2024-09-12T19:00:38.301208+0000","last_clean":"2024-09-12T19:00:38.301208+0000","last_became_active":"2024-09-12T17:40:28.199295+0000","last_became_peered":"2024-09-12T17:40:28.199295+0000","last_unstale":"2024-09-12T19:00:38.301208+0000","last_undegraded":"2024-09-12T19:00:38.301208+0000","last_fullsized":"2024-09-12T19:00:38.301208+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T19:00:38.300989+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T19:00:38.300989+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.300989+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:21.748465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":147,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'108","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:42.325770+0000","last_change":"2024-09-12T19:00:42.325770+0000","last_active":"2024-09-12T19:00:42.325770+0000","last_peered":"2024-09-12T19:00:42.325770+0000","last_clean":"2024-09-12T19:00:42.325770+0000","last_became_active":"2024-09-12T17:40:28.192019+0000","last_became_peered":"2024-09-12T17:40:28.192019+0000","last_unstale":"2024-09-12T19:00:42.325770+0000","last_undegraded":"2024-09-12T19:00:42.325770+0000","last_fullsized":"2024-09-12T19:00:42.325770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'108","last_scrub_stamp":"2024-09-12T19:00:42.325587+0000","last_deep_scrub":"264'108","last_deep_scrub_stamp":"2024-09-12T19:00:42.325587+0000","last_clean_scrub_stamp":"2024-09-12T19:00:42.325587+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:11.590573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":192,"num_write":225,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'111","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.848789+0000","last_change":"2024-09-12T19:00:12.848789+0000","last_active":"2024-09-12T19:00:12.848789+0000","last_peered":"2024-09-12T19:00:12.848789+0000","last_clean":"2024-09-12T19:00:12.848789+0000","last_became_active":"2024-09-12T17:40:20.135868+0000","last_became_peered":"2024-09-12T17:40:20.135868+0000","last_unstale":"2024-09-12T19:00:12.848789+0000","last_undegraded":"2024-09-12T19:00:12.848789+0000","last_fullsized":"2024-09-12T19:00:12.848789+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'111","last_scrub_stamp":"2024-09-12T19:00:12.848609+0000","last_deep_scrub":"264'111","last_deep_scrub_stamp":"2024-09-12T19:00:12.848609+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.848609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:47.505689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":445,"num_write":160,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'289","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.773680+0000","last_change":"2024-09-12T19:00:07.773680+0000","last_active":"2024-09-12T19:00:07.773680+0000","last_peered":"2024-09-12T19:00:07.773680+0000","last_clean":"2024-09-12T19:00:07.773680+0000","last_became_active":"2024-09-12T17:40:18.788674+0000","last_became_peered":"2024-09-12T17:40:18.788674+0000","last_unstale":"2024-09-12T19:00:07.773680+0000","last_undegraded":"2024-09-12T19:00:07.773680+0000","last_fullsized":"2024-09-12T19:00:07.773680+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-12T19:00:07.773396+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-12T19:00:07.773396+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.773396+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:22.864639+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117782,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":10615,"num_write":904,"num_write_kb":14901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.325270+0000","last_change":"2024-09-12T19:00:21.325270+0000","last_active":"2024-09-12T19:00:21.325270+0000","last_peered":"2024-09-12T19:00:21.325270+0000","last_clean":"2024-09-12T19:00:21.325270+0000","last_became_active":"2024-09-12T17:40:22.141326+0000","last_became_peered":"2024-09-12T17:40:22.141326+0000","last_unstale":"2024-09-12T19:00:21.325270+0000","last_undegraded":"2024-09-12T19:00:21.325270+0000","last_fullsized":"2024-09-12T19:00:21.325270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:21.325088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:21.325088+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.325088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:11.574471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'309","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.735075+0000","last_change":"2024-09-12T19:00:30.735075+0000","last_active":"2024-09-12T19:00:30.735075+0000","last_peered":"2024-09-12T19:00:30.735075+0000","last_clean":"2024-09-12T19:00:30.735075+0000","last_became_active":"2024-09-12T17:40:24.169248+0000","last_became_peered":"2024-09-12T17:40:24.169248+0000","last_unstale":"2024-09-12T19:00:30.735075+0000","last_undegraded":"2024-09-12T19:00:30.735075+0000","last_fullsized":"2024-09-12T19:00:30.735075+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-09-12T19:00:30.734871+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-09-12T19:00:30.734871+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.734871+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:57.413664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1219,"num_write":420,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.712706+0000","last_change":"2024-09-12T19:00:38.712706+0000","last_active":"2024-09-12T19:00:38.712706+0000","last_peered":"2024-09-12T19:00:38.712706+0000","last_clean":"2024-09-12T19:00:38.712706+0000","last_became_active":"2024-09-12T17:40:26.203855+0000","last_became_peered":"2024-09-12T17:40:26.203855+0000","last_unstale":"2024-09-12T19:00:38.712706+0000","last_undegraded":"2024-09-12T19:00:38.712706+0000","last_fullsized":"2024-09-12T19:00:38.712706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:38.712521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:38.712521+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.712521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:52.759517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:52.877836+0000","last_change":"2024-09-12T19:00:52.877836+0000","last_active":"2024-09-12T19:00:52.877836+0000","last_peered":"2024-09-12T19:00:52.877836+0000","last_clean":"2024-09-12T19:00:52.877836+0000","last_became_active":"2024-09-12T17:40:28.204204+0000","last_became_peered":"2024-09-12T17:40:28.204204+0000","last_unstale":"2024-09-12T19:00:52.877836+0000","last_undegraded":"2024-09-12T19:00:52.877836+0000","last_fullsized":"2024-09-12T19:00:52.877836+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T19:00:52.877659+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T19:00:52.877659+0000","last_clean_scrub_stamp":"2024-09-12T19:00:52.877659+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:59.019775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":252,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'238","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.393511+0000","last_change":"2024-09-12T19:00:15.393511+0000","last_active":"2024-09-12T19:00:15.393511+0000","last_peered":"2024-09-12T19:00:15.393511+0000","last_clean":"2024-09-12T19:00:15.393511+0000","last_became_active":"2024-09-12T17:40:20.128532+0000","last_became_peered":"2024-09-12T17:40:20.128532+0000","last_unstale":"2024-09-12T19:00:15.393511+0000","last_undegraded":"2024-09-12T19:00:15.393511+0000","last_fullsized":"2024-09-12T19:00:15.393511+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'238","last_scrub_stamp":"2024-09-12T19:00:15.393329+0000","last_deep_scrub":"264'238","last_deep_scrub_stamp":"2024-09-12T19:00:15.393329+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.393329+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:00.980128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":846,"num_write":360,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'397","reported_seq":1111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.937018+0000","last_change":"2024-09-12T19:00:11.937018+0000","last_active":"2024-09-12T19:00:11.937018+0000","last_peered":"2024-09-12T19:00:11.937018+0000","last_clean":"2024-09-12T19:00:11.937018+0000","last_became_active":"2024-09-12T17:40:55.305689+0000","last_became_peered":"2024-09-12T17:40:55.305689+0000","last_unstale":"2024-09-12T19:00:11.937018+0000","last_undegraded":"2024-09-12T19:00:11.937018+0000","last_fullsized":"2024-09-12T19:00:11.937018+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:11.936824+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:11.936824+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.936824+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:31.586190+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":44917,"num_write":1304,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.618172+0000","last_change":"2024-09-12T19:00:20.618172+0000","last_active":"2024-09-12T19:00:20.618172+0000","last_peered":"2024-09-12T19:00:20.618172+0000","last_clean":"2024-09-12T19:00:20.618172+0000","last_became_active":"2024-09-12T17:40:22.143466+0000","last_became_peered":"2024-09-12T17:40:22.143466+0000","last_unstale":"2024-09-12T19:00:20.618172+0000","last_undegraded":"2024-09-12T19:00:20.618172+0000","last_fullsized":"2024-09-12T19:00:20.618172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:20.617988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:20.617988+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.617988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:25.354445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'64","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.330148+0000","last_change":"2024-09-12T19:00:27.330148+0000","last_active":"2024-09-12T19:00:27.330148+0000","last_peered":"2024-09-12T19:00:27.330148+0000","last_clean":"2024-09-12T19:00:27.330148+0000","last_became_active":"2024-09-12T17:40:24.151530+0000","last_became_peered":"2024-09-12T17:40:24.151530+0000","last_unstale":"2024-09-12T19:00:27.330148+0000","last_undegraded":"2024-09-12T19:00:27.330148+0000","last_fullsized":"2024-09-12T19:00:27.330148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-12T19:00:27.329940+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-12T19:00:27.329940+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.329940+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:38.476922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.820506+0000","last_change":"2024-09-12T19:00:34.820506+0000","last_active":"2024-09-12T19:00:34.820506+0000","last_peered":"2024-09-12T19:00:34.820506+0000","last_clean":"2024-09-12T19:00:34.820506+0000","last_became_active":"2024-09-12T17:40:26.187122+0000","last_became_peered":"2024-09-12T17:40:26.187122+0000","last_unstale":"2024-09-12T19:00:34.820506+0000","last_undegraded":"2024-09-12T19:00:34.820506+0000","last_fullsized":"2024-09-12T19:00:34.820506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.820308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.820308+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.820308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:23.590071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'251","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.270085+0000","last_change":"2024-09-12T19:00:40.270085+0000","last_active":"2024-09-12T19:00:40.270085+0000","last_peered":"2024-09-12T19:00:40.270085+0000","last_clean":"2024-09-12T19:00:40.270085+0000","last_became_active":"2024-09-12T17:40:28.194047+0000","last_became_peered":"2024-09-12T17:40:28.194047+0000","last_unstale":"2024-09-12T19:00:40.270085+0000","last_undegraded":"2024-09-12T19:00:40.270085+0000","last_fullsized":"2024-09-12T19:00:40.270085+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T19:00:40.269814+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T19:00:40.269814+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.269814+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:38.167229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":367,"num_read_kb":352,"num_write":540,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'120","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.619652+0000","last_change":"2024-09-12T19:00:18.619652+0000","last_active":"2024-09-12T19:00:18.619652+0000","last_peered":"2024-09-12T19:00:18.619652+0000","last_clean":"2024-09-12T19:00:18.619652+0000","last_became_active":"2024-09-12T17:40:20.130567+0000","last_became_peered":"2024-09-12T17:40:20.130567+0000","last_unstale":"2024-09-12T19:00:18.619652+0000","last_undegraded":"2024-09-12T19:00:18.619652+0000","last_fullsized":"2024-09-12T19:00:18.619652+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T19:00:18.619454+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T19:00:18.619454+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.619454+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:46.704065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":440,"num_write":198,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'397","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.290827+0000","last_change":"2024-09-12T19:00:11.290827+0000","last_active":"2024-09-12T19:00:11.290827+0000","last_peered":"2024-09-12T19:00:11.290827+0000","last_clean":"2024-09-12T19:00:11.290827+0000","last_became_active":"2024-09-12T17:40:18.781135+0000","last_became_peered":"2024-09-12T17:40:18.781135+0000","last_unstale":"2024-09-12T19:00:11.290827+0000","last_undegraded":"2024-09-12T19:00:11.290827+0000","last_fullsized":"2024-09-12T19:00:11.290827+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:11.290616+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:11.290616+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.290616+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:13.553119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306781,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":11928,"num_write":1198,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.965742+0000","last_change":"2024-09-12T19:00:24.965742+0000","last_active":"2024-09-12T19:00:24.965742+0000","last_peered":"2024-09-12T19:00:24.965742+0000","last_clean":"2024-09-12T19:00:24.965742+0000","last_became_active":"2024-09-12T17:40:22.150912+0000","last_became_peered":"2024-09-12T17:40:22.150912+0000","last_unstale":"2024-09-12T19:00:24.965742+0000","last_undegraded":"2024-09-12T19:00:24.965742+0000","last_fullsized":"2024-09-12T19:00:24.965742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:24.965556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:24.965556+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.965556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:45.272866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'347","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.748826+0000","last_change":"2024-09-12T19:00:32.748826+0000","last_active":"2024-09-12T19:00:32.748826+0000","last_peered":"2024-09-12T19:00:32.748826+0000","last_clean":"2024-09-12T19:00:32.748826+0000","last_became_active":"2024-09-12T17:40:24.176722+0000","last_became_peered":"2024-09-12T17:40:24.176722+0000","last_unstale":"2024-09-12T19:00:32.748826+0000","last_undegraded":"2024-09-12T19:00:32.748826+0000","last_fullsized":"2024-09-12T19:00:32.748826+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T19:00:32.748627+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T19:00:32.748627+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.748627+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:59.648696+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48896,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":559,"num_read_kb":1238,"num_write":442,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.373420+0000","last_change":"2024-09-12T19:00:23.373420+0000","last_active":"2024-09-12T19:00:23.373420+0000","last_peered":"2024-09-12T19:00:23.373420+0000","last_clean":"2024-09-12T19:00:23.373420+0000","last_became_active":"2024-09-12T17:40:26.167280+0000","last_became_peered":"2024-09-12T17:40:26.167280+0000","last_unstale":"2024-09-12T19:00:23.373420+0000","last_undegraded":"2024-09-12T19:00:23.373420+0000","last_fullsized":"2024-09-12T19:00:23.373420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.373235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.373235+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.373235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:28.340798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'108","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:41.254669+0000","last_change":"2024-09-12T19:00:41.254669+0000","last_active":"2024-09-12T19:00:41.254669+0000","last_peered":"2024-09-12T19:00:41.254669+0000","last_clean":"2024-09-12T19:00:41.254669+0000","last_became_active":"2024-09-12T17:40:28.192629+0000","last_became_peered":"2024-09-12T17:40:28.192629+0000","last_unstale":"2024-09-12T19:00:41.254669+0000","last_undegraded":"2024-09-12T19:00:41.254669+0000","last_fullsized":"2024-09-12T19:00:41.254669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'108","last_scrub_stamp":"2024-09-12T19:00:41.254478+0000","last_deep_scrub":"264'108","last_deep_scrub_stamp":"2024-09-12T19:00:41.254478+0000","last_clean_scrub_stamp":"2024-09-12T19:00:41.254478+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:41.328980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.590597+0000","last_change":"2024-09-12T19:00:16.590597+0000","last_active":"2024-09-12T19:00:16.590597+0000","last_peered":"2024-09-12T19:00:16.590597+0000","last_clean":"2024-09-12T19:00:16.590597+0000","last_became_active":"2024-09-12T17:40:55.301950+0000","last_became_peered":"2024-09-12T17:40:55.301950+0000","last_unstale":"2024-09-12T19:00:16.590597+0000","last_undegraded":"2024-09-12T19:00:16.590597+0000","last_fullsized":"2024-09-12T19:00:16.590597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-12T19:00:16.590364+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-12T19:00:16.590364+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.590364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:37.860965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":400,"num_write":158,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'409","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.344070+0000","last_change":"2024-09-12T19:00:06.344003+0000","last_active":"2024-09-12T19:00:06.344070+0000","last_peered":"2024-09-12T19:00:06.344070+0000","last_clean":"2024-09-12T19:00:06.344070+0000","last_became_active":"2024-09-12T17:40:18.755694+0000","last_became_peered":"2024-09-12T17:40:18.755694+0000","last_unstale":"2024-09-12T19:00:06.344070+0000","last_undegraded":"2024-09-12T19:00:06.344070+0000","last_fullsized":"2024-09-12T19:00:06.344070+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'409","last_scrub_stamp":"2024-09-12T19:00:06.343896+0000","last_deep_scrub":"264'409","last_deep_scrub_stamp":"2024-09-12T19:00:06.343896+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.343896+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:09.006520+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194332,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":35553,"num_write":1273,"num_write_kb":53517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.338329+0000","last_change":"2024-09-12T19:00:25.338329+0000","last_active":"2024-09-12T19:00:25.338329+0000","last_peered":"2024-09-12T19:00:25.338329+0000","last_clean":"2024-09-12T19:00:25.338329+0000","last_became_active":"2024-09-12T17:40:22.135547+0000","last_became_peered":"2024-09-12T17:40:22.135547+0000","last_unstale":"2024-09-12T19:00:25.338329+0000","last_undegraded":"2024-09-12T19:00:25.338329+0000","last_fullsized":"2024-09-12T19:00:25.338329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:25.338146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:25.338146+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.338146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:19.495885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'313","reported_seq":906,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.900396+0000","last_change":"2024-09-12T19:00:30.900396+0000","last_active":"2024-09-12T19:00:30.900396+0000","last_peered":"2024-09-12T19:00:30.900396+0000","last_clean":"2024-09-12T19:00:30.900396+0000","last_became_active":"2024-09-12T17:40:24.162901+0000","last_became_peered":"2024-09-12T17:40:24.162901+0000","last_unstale":"2024-09-12T19:00:30.900396+0000","last_undegraded":"2024-09-12T19:00:30.900396+0000","last_fullsized":"2024-09-12T19:00:30.900396+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T19:00:30.900145+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T19:00:30.900145+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.900145+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:39.433014+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51001,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1227,"num_write":416,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.367179+0000","last_change":"2024-09-12T19:00:33.367179+0000","last_active":"2024-09-12T19:00:33.367179+0000","last_peered":"2024-09-12T19:00:33.367179+0000","last_clean":"2024-09-12T19:00:33.367179+0000","last_became_active":"2024-09-12T17:40:26.190755+0000","last_became_peered":"2024-09-12T17:40:26.190755+0000","last_unstale":"2024-09-12T19:00:33.367179+0000","last_undegraded":"2024-09-12T19:00:33.367179+0000","last_fullsized":"2024-09-12T19:00:33.367179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:33.367006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:33.367006+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.367006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:39.709430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'428","reported_seq":1200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.440828+0000","last_change":"2024-09-12T19:00:16.440828+0000","last_active":"2024-09-12T19:00:16.440828+0000","last_peered":"2024-09-12T19:00:16.440828+0000","last_clean":"2024-09-12T19:00:16.440828+0000","last_became_active":"2024-09-12T17:40:20.127413+0000","last_became_peered":"2024-09-12T17:40:20.127413+0000","last_unstale":"2024-09-12T19:00:16.440828+0000","last_undegraded":"2024-09-12T19:00:16.440828+0000","last_fullsized":"2024-09-12T19:00:16.440828+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-12T19:00:16.440639+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-12T19:00:16.440639+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.440639+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:08.283126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2096,"num_read_kb":1807,"num_write":754,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'348","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.711102+0000","last_change":"2024-09-12T19:00:08.711102+0000","last_active":"2024-09-12T19:00:08.711102+0000","last_peered":"2024-09-12T19:00:08.711102+0000","last_clean":"2024-09-12T19:00:08.711102+0000","last_became_active":"2024-09-12T17:40:18.759467+0000","last_became_peered":"2024-09-12T17:40:18.759467+0000","last_unstale":"2024-09-12T19:00:08.711102+0000","last_undegraded":"2024-09-12T19:00:08.711102+0000","last_fullsized":"2024-09-12T19:00:08.711102+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T19:00:08.710899+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T19:00:08.710899+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.710899+0000","objects_scrubbed":10,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:25.297780+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399269,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":67738,"num_write":1092,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.349916+0000","last_change":"2024-09-12T19:00:24.349773+0000","last_active":"2024-09-12T19:00:24.349916+0000","last_peered":"2024-09-12T19:00:24.349916+0000","last_clean":"2024-09-12T19:00:24.349916+0000","last_became_active":"2024-09-12T17:40:22.143764+0000","last_became_peered":"2024-09-12T17:40:22.143764+0000","last_unstale":"2024-09-12T19:00:24.349916+0000","last_undegraded":"2024-09-12T19:00:24.349916+0000","last_fullsized":"2024-09-12T19:00:24.349916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:24.349597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:24.349597+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.349597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:40.760179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'543","reported_seq":1199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.338159+0000","last_change":"2024-09-12T19:00:26.338025+0000","last_active":"2024-09-12T19:00:26.338159+0000","last_peered":"2024-09-12T19:00:26.338159+0000","last_clean":"2024-09-12T19:00:26.338159+0000","last_became_active":"2024-09-12T17:40:24.178354+0000","last_became_peered":"2024-09-12T17:40:24.178354+0000","last_unstale":"2024-09-12T19:00:26.338159+0000","last_undegraded":"2024-09-12T19:00:26.338159+0000","last_fullsized":"2024-09-12T19:00:26.338159+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'543","last_scrub_stamp":"2024-09-12T19:00:26.337832+0000","last_deep_scrub":"264'543","last_deep_scrub_stamp":"2024-09-12T19:00:26.337832+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.337832+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:34.313521+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110471,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":953,"num_read_kb":2361,"num_write":826,"num_write_kb":742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.232729+0000","last_change":"2024-09-12T19:00:34.232729+0000","last_active":"2024-09-12T19:00:34.232729+0000","last_peered":"2024-09-12T19:00:34.232729+0000","last_clean":"2024-09-12T19:00:34.232729+0000","last_became_active":"2024-09-12T17:40:26.184572+0000","last_became_peered":"2024-09-12T17:40:26.184572+0000","last_unstale":"2024-09-12T19:00:34.232729+0000","last_undegraded":"2024-09-12T19:00:34.232729+0000","last_fullsized":"2024-09-12T19:00:34.232729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.232547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.232547+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.232547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:15.459942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'245","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:46.834830+0000","last_change":"2024-09-12T19:00:46.834830+0000","last_active":"2024-09-12T19:00:46.834830+0000","last_peered":"2024-09-12T19:00:46.834830+0000","last_clean":"2024-09-12T19:00:46.834830+0000","last_became_active":"2024-09-12T17:40:28.200289+0000","last_became_peered":"2024-09-12T17:40:28.200289+0000","last_unstale":"2024-09-12T19:00:46.834830+0000","last_undegraded":"2024-09-12T19:00:46.834830+0000","last_fullsized":"2024-09-12T19:00:46.834830+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T19:00:46.834609+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T19:00:46.834609+0000","last_clean_scrub_stamp":"2024-09-12T19:00:46.834609+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:42.343737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":402,"num_read_kb":380,"num_write":484,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'278","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.329668+0000","last_change":"2024-09-12T19:00:17.329492+0000","last_active":"2024-09-12T19:00:17.329668+0000","last_peered":"2024-09-12T19:00:17.329668+0000","last_clean":"2024-09-12T19:00:17.329668+0000","last_became_active":"2024-09-12T17:40:20.128840+0000","last_became_peered":"2024-09-12T17:40:20.128840+0000","last_unstale":"2024-09-12T19:00:17.329668+0000","last_undegraded":"2024-09-12T19:00:17.329668+0000","last_fullsized":"2024-09-12T19:00:17.329668+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'278","last_scrub_stamp":"2024-09-12T19:00:17.329286+0000","last_deep_scrub":"264'278","last_deep_scrub_stamp":"2024-09-12T19:00:17.329286+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.329286+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:15.910212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1419,"num_read_kb":1187,"num_write":525,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'305","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.389191+0000","last_change":"2024-09-12T19:00:10.388940+0000","last_active":"2024-09-12T19:00:10.389191+0000","last_peered":"2024-09-12T19:00:10.389191+0000","last_clean":"2024-09-12T19:00:10.389191+0000","last_became_active":"2024-09-12T17:40:18.762421+0000","last_became_peered":"2024-09-12T17:40:18.762421+0000","last_unstale":"2024-09-12T19:00:10.389191+0000","last_undegraded":"2024-09-12T19:00:10.389191+0000","last_fullsized":"2024-09-12T19:00:10.389191+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-12T19:00:10.388665+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-12T19:00:10.388665+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.388665+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:37.537161+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":428,"num_read_kb":9963,"num_write":965,"num_write_kb":16756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.400755+0000","last_change":"2024-09-12T19:00:20.400755+0000","last_active":"2024-09-12T19:00:20.400755+0000","last_peered":"2024-09-12T19:00:20.400755+0000","last_clean":"2024-09-12T19:00:20.400755+0000","last_became_active":"2024-09-12T17:40:22.133919+0000","last_became_peered":"2024-09-12T17:40:22.133919+0000","last_unstale":"2024-09-12T19:00:20.400755+0000","last_undegraded":"2024-09-12T19:00:20.400755+0000","last_fullsized":"2024-09-12T19:00:20.400755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:20.400574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:20.400574+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.400574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:25.599834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'321","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:32.834473+0000","last_change":"2024-09-12T19:00:32.834473+0000","last_active":"2024-09-12T19:00:32.834473+0000","last_peered":"2024-09-12T19:00:32.834473+0000","last_clean":"2024-09-12T19:00:32.834473+0000","last_became_active":"2024-09-12T17:40:24.167870+0000","last_became_peered":"2024-09-12T17:40:24.167870+0000","last_unstale":"2024-09-12T19:00:32.834473+0000","last_undegraded":"2024-09-12T19:00:32.834473+0000","last_fullsized":"2024-09-12T19:00:32.834473+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T19:00:32.834263+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T19:00:32.834263+0000","last_clean_scrub_stamp":"2024-09-12T19:00:32.834263+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:47.433880+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50431,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":1079,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12380,"num_omap_keys":28,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:30.413176+0000","last_change":"2024-09-12T19:00:30.413176+0000","last_active":"2024-09-12T19:00:30.413176+0000","last_peered":"2024-09-12T19:00:30.413176+0000","last_clean":"2024-09-12T19:00:30.413176+0000","last_became_active":"2024-09-12T17:40:26.199065+0000","last_became_peered":"2024-09-12T17:40:26.199065+0000","last_unstale":"2024-09-12T19:00:30.413176+0000","last_undegraded":"2024-09-12T19:00:30.413176+0000","last_fullsized":"2024-09-12T19:00:30.413176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:30.412978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:30.412978+0000","last_clean_scrub_stamp":"2024-09-12T19:00:30.412978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:31.543757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'190","reported_seq":1097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.337413+0000","last_change":"2024-09-12T19:00:31.337413+0000","last_active":"2024-09-12T19:00:31.337413+0000","last_peered":"2024-09-12T19:00:31.337413+0000","last_clean":"2024-09-12T19:00:31.337413+0000","last_became_active":"2024-09-12T17:40:28.192588+0000","last_became_peered":"2024-09-12T17:40:28.192588+0000","last_unstale":"2024-09-12T19:00:31.337413+0000","last_undegraded":"2024-09-12T19:00:31.337413+0000","last_fullsized":"2024-09-12T19:00:31.337413+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T19:00:31.337228+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T19:00:31.337228+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.337228+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:13.419733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":737,"num_read_kb":706,"num_write":515,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'254","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.634317+0000","last_change":"2024-09-12T19:00:15.634145+0000","last_active":"2024-09-12T19:00:15.634317+0000","last_peered":"2024-09-12T19:00:15.634317+0000","last_clean":"2024-09-12T19:00:15.634317+0000","last_became_active":"2024-09-12T17:40:20.133067+0000","last_became_peered":"2024-09-12T17:40:20.133067+0000","last_unstale":"2024-09-12T19:00:15.634317+0000","last_undegraded":"2024-09-12T19:00:15.634317+0000","last_fullsized":"2024-09-12T19:00:15.634317+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'254","last_scrub_stamp":"2024-09-12T19:00:15.633957+0000","last_deep_scrub":"264'254","last_deep_scrub_stamp":"2024-09-12T19:00:15.633957+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.633957+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:24.007199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1200,"num_read_kb":1015,"num_write":444,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'349","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.743053+0000","last_change":"2024-09-12T19:00:08.742895+0000","last_active":"2024-09-12T19:00:08.743053+0000","last_peered":"2024-09-12T19:00:08.743053+0000","last_clean":"2024-09-12T19:00:08.743053+0000","last_became_active":"2024-09-12T17:40:18.773029+0000","last_became_peered":"2024-09-12T17:40:18.773029+0000","last_unstale":"2024-09-12T19:00:08.743053+0000","last_undegraded":"2024-09-12T19:00:08.743053+0000","last_fullsized":"2024-09-12T19:00:08.743053+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-12T19:00:08.742672+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-12T19:00:08.742672+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.742672+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:43.956356+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5769265,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":426,"num_read_kb":38404,"num_write":1086,"num_write_kb":31393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.951082+0000","last_change":"2024-09-12T19:00:29.951082+0000","last_active":"2024-09-12T19:00:29.951082+0000","last_peered":"2024-09-12T19:00:29.951082+0000","last_clean":"2024-09-12T19:00:29.951082+0000","last_became_active":"2024-09-12T17:40:22.145871+0000","last_became_peered":"2024-09-12T17:40:22.145871+0000","last_unstale":"2024-09-12T19:00:29.951082+0000","last_undegraded":"2024-09-12T19:00:29.951082+0000","last_fullsized":"2024-09-12T19:00:29.951082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:29.950902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:29.950902+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.950902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:28.152645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'313","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:31.770346+0000","last_change":"2024-09-12T19:00:31.770346+0000","last_active":"2024-09-12T19:00:31.770346+0000","last_peered":"2024-09-12T19:00:31.770346+0000","last_clean":"2024-09-12T19:00:31.770346+0000","last_became_active":"2024-09-12T17:40:24.329413+0000","last_became_peered":"2024-09-12T17:40:24.329413+0000","last_unstale":"2024-09-12T19:00:31.770346+0000","last_undegraded":"2024-09-12T19:00:31.770346+0000","last_fullsized":"2024-09-12T19:00:31.770346+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T19:00:31.770156+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T19:00:31.770156+0000","last_clean_scrub_stamp":"2024-09-12T19:00:31.770156+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:12.931738+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47334,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1206,"num_write":420,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:40.471670+0000","last_change":"2024-09-12T19:00:40.471475+0000","last_active":"2024-09-12T19:00:40.471670+0000","last_peered":"2024-09-12T19:00:40.471670+0000","last_clean":"2024-09-12T19:00:40.471670+0000","last_became_active":"2024-09-12T17:40:26.198930+0000","last_became_peered":"2024-09-12T17:40:26.198930+0000","last_unstale":"2024-09-12T19:00:40.471670+0000","last_undegraded":"2024-09-12T19:00:40.471670+0000","last_fullsized":"2024-09-12T19:00:40.471670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:40.471293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:40.471293+0000","last_clean_scrub_stamp":"2024-09-12T19:00:40.471293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:17.593253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'120","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.321432+0000","last_change":"2024-09-12T19:00:39.321432+0000","last_active":"2024-09-12T19:00:39.321432+0000","last_peered":"2024-09-12T19:00:39.321432+0000","last_clean":"2024-09-12T19:00:39.321432+0000","last_became_active":"2024-09-12T17:40:28.192689+0000","last_became_peered":"2024-09-12T17:40:28.192689+0000","last_unstale":"2024-09-12T19:00:39.321432+0000","last_undegraded":"2024-09-12T19:00:39.321432+0000","last_fullsized":"2024-09-12T19:00:39.321432+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T19:00:39.321187+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T19:00:39.321187+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.321187+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:00.540498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":258,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'197","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.631338+0000","last_change":"2024-09-12T19:00:09.631176+0000","last_active":"2024-09-12T19:00:09.631338+0000","last_peered":"2024-09-12T19:00:09.631338+0000","last_clean":"2024-09-12T19:00:09.631338+0000","last_became_active":"2024-09-12T17:40:20.132998+0000","last_became_peered":"2024-09-12T17:40:20.132998+0000","last_unstale":"2024-09-12T19:00:09.631338+0000","last_undegraded":"2024-09-12T19:00:09.631338+0000","last_fullsized":"2024-09-12T19:00:09.631338+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'197","last_scrub_stamp":"2024-09-12T19:00:09.630961+0000","last_deep_scrub":"264'197","last_deep_scrub_stamp":"2024-09-12T19:00:09.630961+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.630961+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:43.492350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":791,"num_read_kb":641,"num_write":284,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'452","reported_seq":1204,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.350146+0000","last_change":"2024-09-12T19:00:07.349873+0000","last_active":"2024-09-12T19:00:07.350146+0000","last_peered":"2024-09-12T19:00:07.350146+0000","last_clean":"2024-09-12T19:00:07.350146+0000","last_became_active":"2024-09-12T17:40:18.774892+0000","last_became_peered":"2024-09-12T17:40:18.774892+0000","last_unstale":"2024-09-12T19:00:07.350146+0000","last_undegraded":"2024-09-12T19:00:07.350146+0000","last_fullsized":"2024-09-12T19:00:07.350146+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'452","last_scrub_stamp":"2024-09-12T19:00:07.349511+0000","last_deep_scrub":"264'452","last_deep_scrub_stamp":"2024-09-12T19:00:07.349511+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.349511+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:27.593097+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":517958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":741,"num_read_kb":87834,"num_write":1424,"num_write_kb":30285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.305895+0000","last_change":"2024-09-12T19:00:23.305895+0000","last_active":"2024-09-12T19:00:23.305895+0000","last_peered":"2024-09-12T19:00:23.305895+0000","last_clean":"2024-09-12T19:00:23.305895+0000","last_became_active":"2024-09-12T17:40:22.141670+0000","last_became_peered":"2024-09-12T17:40:22.141670+0000","last_unstale":"2024-09-12T19:00:23.305895+0000","last_undegraded":"2024-09-12T19:00:23.305895+0000","last_fullsized":"2024-09-12T19:00:23.305895+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:23.305714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:23.305714+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.305714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:29.599014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'139","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.910715+0000","last_change":"2024-09-12T19:00:34.910582+0000","last_active":"2024-09-12T19:00:34.910715+0000","last_peered":"2024-09-12T19:00:34.910715+0000","last_clean":"2024-09-12T19:00:34.910715+0000","last_became_active":"2024-09-12T17:40:24.329446+0000","last_became_peered":"2024-09-12T17:40:24.329446+0000","last_unstale":"2024-09-12T19:00:34.910715+0000","last_undegraded":"2024-09-12T19:00:34.910715+0000","last_fullsized":"2024-09-12T19:00:34.910715+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'139","last_scrub_stamp":"2024-09-12T19:00:34.910379+0000","last_deep_scrub":"264'139","last_deep_scrub_stamp":"2024-09-12T19:00:34.910379+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.910379+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:51.726194+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'753","reported_seq":4504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.318003+0000","last_change":"2024-09-12T19:00:27.318003+0000","last_active":"2024-09-12T19:00:27.318003+0000","last_peered":"2024-09-12T19:00:27.318003+0000","last_clean":"2024-09-12T19:00:27.318003+0000","last_became_active":"2024-09-12T17:40:26.192341+0000","last_became_peered":"2024-09-12T17:40:26.192341+0000","last_unstale":"2024-09-12T19:00:27.318003+0000","last_undegraded":"2024-09-12T19:00:27.318003+0000","last_fullsized":"2024-09-12T19:00:27.318003+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'753","last_scrub_stamp":"2024-09-12T19:00:27.317824+0000","last_deep_scrub":"264'753","last_deep_scrub_stamp":"2024-09-12T19:00:27.317824+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.317824+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:00.226970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'117","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.841374+0000","last_change":"2024-09-12T19:00:37.841374+0000","last_active":"2024-09-12T19:00:37.841374+0000","last_peered":"2024-09-12T19:00:37.841374+0000","last_clean":"2024-09-12T19:00:37.841374+0000","last_became_active":"2024-09-12T17:40:28.187089+0000","last_became_peered":"2024-09-12T17:40:28.187089+0000","last_unstale":"2024-09-12T19:00:37.841374+0000","last_undegraded":"2024-09-12T19:00:37.841374+0000","last_fullsized":"2024-09-12T19:00:37.841374+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T19:00:37.841189+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T19:00:37.841189+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.841189+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:43.510128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'389","reported_seq":1142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.883979+0000","last_change":"2024-09-12T19:00:19.883704+0000","last_active":"2024-09-12T19:00:19.883979+0000","last_peered":"2024-09-12T19:00:19.883979+0000","last_clean":"2024-09-12T19:00:19.883979+0000","last_became_active":"2024-09-12T17:40:20.142478+0000","last_became_peered":"2024-09-12T17:40:20.142478+0000","last_unstale":"2024-09-12T19:00:19.883979+0000","last_undegraded":"2024-09-12T19:00:19.883979+0000","last_fullsized":"2024-09-12T19:00:19.883979+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'389","last_scrub_stamp":"2024-09-12T19:00:19.883428+0000","last_deep_scrub":"264'389","last_deep_scrub_stamp":"2024-09-12T19:00:19.883428+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.883428+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:21.623543+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1845,"num_read_kb":1583,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25754,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'344","reported_seq":1178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:04.599344+0000","last_change":"2024-09-12T19:00:04.599290+0000","last_active":"2024-09-12T19:00:04.599344+0000","last_peered":"2024-09-12T19:00:04.599344+0000","last_clean":"2024-09-12T19:00:04.599344+0000","last_became_active":"2024-09-12T17:40:55.330696+0000","last_became_peered":"2024-09-12T17:40:55.330696+0000","last_unstale":"2024-09-12T19:00:04.599344+0000","last_undegraded":"2024-09-12T19:00:04.599344+0000","last_fullsized":"2024-09-12T19:00:04.599344+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T19:00:04.599196+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T19:00:04.599196+0000","last_clean_scrub_stamp":"2024-09-12T19:00:04.599196+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:34.856416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35759,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":915,"num_read_kb":9625,"num_write":1190,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:25.944316+0000","last_change":"2024-09-12T19:00:25.944316+0000","last_active":"2024-09-12T19:00:25.944316+0000","last_peered":"2024-09-12T19:00:25.944316+0000","last_clean":"2024-09-12T19:00:25.944316+0000","last_became_active":"2024-09-12T17:40:22.151083+0000","last_became_peered":"2024-09-12T17:40:22.151083+0000","last_unstale":"2024-09-12T19:00:25.944316+0000","last_undegraded":"2024-09-12T19:00:25.944316+0000","last_fullsized":"2024-09-12T19:00:25.944316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:25.944122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:25.944122+0000","last_clean_scrub_stamp":"2024-09-12T19:00:25.944122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:30.866495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'343","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:35.197137+0000","last_change":"2024-09-12T19:00:35.197137+0000","last_active":"2024-09-12T19:00:35.197137+0000","last_peered":"2024-09-12T19:00:35.197137+0000","last_clean":"2024-09-12T19:00:35.197137+0000","last_became_active":"2024-09-12T17:40:24.173360+0000","last_became_peered":"2024-09-12T17:40:24.173360+0000","last_unstale":"2024-09-12T19:00:35.197137+0000","last_undegraded":"2024-09-12T19:00:35.197137+0000","last_fullsized":"2024-09-12T19:00:35.197137+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T19:00:35.196835+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T19:00:35.196835+0000","last_clean_scrub_stamp":"2024-09-12T19:00:35.196835+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:55.759104+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61671,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":561,"num_read_kb":1233,"num_write":446,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:34.376891+0000","last_change":"2024-09-12T19:00:34.376891+0000","last_active":"2024-09-12T19:00:34.376891+0000","last_peered":"2024-09-12T19:00:34.376891+0000","last_clean":"2024-09-12T19:00:34.376891+0000","last_became_active":"2024-09-12T17:40:26.163773+0000","last_became_peered":"2024-09-12T17:40:26.163773+0000","last_unstale":"2024-09-12T19:00:34.376891+0000","last_undegraded":"2024-09-12T19:00:34.376891+0000","last_fullsized":"2024-09-12T19:00:34.376891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:34.376716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:34.376716+0000","last_clean_scrub_stamp":"2024-09-12T19:00:34.376716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:16.630035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'105","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.816338+0000","last_change":"2024-09-12T19:00:39.816338+0000","last_active":"2024-09-12T19:00:39.816338+0000","last_peered":"2024-09-12T19:00:39.816338+0000","last_clean":"2024-09-12T19:00:39.816338+0000","last_became_active":"2024-09-12T17:40:28.198792+0000","last_became_peered":"2024-09-12T17:40:28.198792+0000","last_unstale":"2024-09-12T19:00:39.816338+0000","last_undegraded":"2024-09-12T19:00:39.816338+0000","last_fullsized":"2024-09-12T19:00:39.816338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T19:00:39.816143+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T19:00:39.816143+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.816143+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:25.653460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":239,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'185","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.805223+0000","last_change":"2024-09-12T19:00:17.804978+0000","last_active":"2024-09-12T19:00:17.805223+0000","last_peered":"2024-09-12T19:00:17.805223+0000","last_clean":"2024-09-12T19:00:17.805223+0000","last_became_active":"2024-09-12T17:40:20.136564+0000","last_became_peered":"2024-09-12T17:40:20.136564+0000","last_unstale":"2024-09-12T19:00:17.805223+0000","last_undegraded":"2024-09-12T19:00:17.805223+0000","last_fullsized":"2024-09-12T19:00:17.805223+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T19:00:17.804709+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T19:00:17.804709+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.804709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:22.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":640,"num_write":266,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'423","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.276533+0000","last_change":"2024-09-12T19:00:10.276396+0000","last_active":"2024-09-12T19:00:10.276533+0000","last_peered":"2024-09-12T19:00:10.276533+0000","last_clean":"2024-09-12T19:00:10.276533+0000","last_became_active":"2024-09-12T17:40:18.779946+0000","last_became_peered":"2024-09-12T17:40:18.779946+0000","last_unstale":"2024-09-12T19:00:10.276533+0000","last_undegraded":"2024-09-12T19:00:10.276533+0000","last_fullsized":"2024-09-12T19:00:10.276533+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'423","last_scrub_stamp":"2024-09-12T19:00:10.276179+0000","last_deep_scrub":"264'423","last_deep_scrub_stamp":"2024-09-12T19:00:10.276179+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.276179+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:31.510413+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1239867,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":711,"num_read_kb":21197,"num_write":1193,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.296054+0000","last_change":"2024-09-12T19:00:28.296054+0000","last_active":"2024-09-12T19:00:28.296054+0000","last_peered":"2024-09-12T19:00:28.296054+0000","last_clean":"2024-09-12T19:00:28.296054+0000","last_became_active":"2024-09-12T17:40:22.137291+0000","last_became_peered":"2024-09-12T17:40:22.137291+0000","last_unstale":"2024-09-12T19:00:28.296054+0000","last_undegraded":"2024-09-12T19:00:28.296054+0000","last_fullsized":"2024-09-12T19:00:28.296054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:28.295851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:28.295851+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.295851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:03.319406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'268","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.360743+0000","last_change":"2024-09-12T19:00:29.360743+0000","last_active":"2024-09-12T19:00:29.360743+0000","last_peered":"2024-09-12T19:00:29.360743+0000","last_clean":"2024-09-12T19:00:29.360743+0000","last_became_active":"2024-09-12T17:40:24.174681+0000","last_became_peered":"2024-09-12T17:40:24.174681+0000","last_unstale":"2024-09-12T19:00:29.360743+0000","last_undegraded":"2024-09-12T19:00:29.360743+0000","last_fullsized":"2024-09-12T19:00:29.360743+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'268","last_scrub_stamp":"2024-09-12T19:00:29.360510+0000","last_deep_scrub":"264'268","last_deep_scrub_stamp":"2024-09-12T19:00:29.360510+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.360510+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:44.506730+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51960,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":993,"num_write":344,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:26.360878+0000","last_change":"2024-09-12T19:00:26.360731+0000","last_active":"2024-09-12T19:00:26.360878+0000","last_peered":"2024-09-12T19:00:26.360878+0000","last_clean":"2024-09-12T19:00:26.360878+0000","last_became_active":"2024-09-12T17:40:26.187438+0000","last_became_peered":"2024-09-12T17:40:26.187438+0000","last_unstale":"2024-09-12T19:00:26.360878+0000","last_undegraded":"2024-09-12T19:00:26.360878+0000","last_fullsized":"2024-09-12T19:00:26.360878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:26.360536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:26.360536+0000","last_clean_scrub_stamp":"2024-09-12T19:00:26.360536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:17.085073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'126","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:50.851306+0000","last_change":"2024-09-12T19:00:50.851306+0000","last_active":"2024-09-12T19:00:50.851306+0000","last_peered":"2024-09-12T19:00:50.851306+0000","last_clean":"2024-09-12T19:00:50.851306+0000","last_became_active":"2024-09-12T17:40:28.201534+0000","last_became_peered":"2024-09-12T17:40:28.201534+0000","last_unstale":"2024-09-12T19:00:50.851306+0000","last_undegraded":"2024-09-12T19:00:50.851306+0000","last_fullsized":"2024-09-12T19:00:50.851306+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-12T19:00:50.851086+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-12T19:00:50.851086+0000","last_clean_scrub_stamp":"2024-09-12T19:00:50.851086+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:47.597084+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":291,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'52","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.612810+0000","last_change":"2024-09-12T19:00:19.612666+0000","last_active":"2024-09-12T19:00:19.612810+0000","last_peered":"2024-09-12T19:00:19.612810+0000","last_clean":"2024-09-12T19:00:19.612810+0000","last_became_active":"2024-09-12T17:40:20.117604+0000","last_became_peered":"2024-09-12T17:40:20.117604+0000","last_unstale":"2024-09-12T19:00:19.612810+0000","last_undegraded":"2024-09-12T19:00:19.612810+0000","last_fullsized":"2024-09-12T19:00:19.612810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T19:00:19.612475+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T19:00:19.612475+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.612475+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:58.666585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":67,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'333","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.706552+0000","last_change":"2024-09-12T19:00:24.706416+0000","last_active":"2024-09-12T19:00:24.706552+0000","last_peered":"2024-09-12T19:00:24.706552+0000","last_clean":"2024-09-12T19:00:24.706552+0000","last_became_active":"2024-09-12T17:40:18.767103+0000","last_became_peered":"2024-09-12T17:40:18.767103+0000","last_unstale":"2024-09-12T19:00:24.706552+0000","last_undegraded":"2024-09-12T19:00:24.706552+0000","last_fullsized":"2024-09-12T19:00:24.706552+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-12T19:00:24.706215+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-12T19:00:24.706215+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.706215+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:26.639198+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097225,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":436,"num_read_kb":34280,"num_write":1068,"num_write_kb":41945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:28.960509+0000","last_change":"2024-09-12T19:00:28.960509+0000","last_active":"2024-09-12T19:00:28.960509+0000","last_peered":"2024-09-12T19:00:28.960509+0000","last_clean":"2024-09-12T19:00:28.960509+0000","last_became_active":"2024-09-12T17:40:22.134242+0000","last_became_peered":"2024-09-12T17:40:22.134242+0000","last_unstale":"2024-09-12T19:00:28.960509+0000","last_undegraded":"2024-09-12T19:00:28.960509+0000","last_fullsized":"2024-09-12T19:00:28.960509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:28.960299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:28.960299+0000","last_clean_scrub_stamp":"2024-09-12T19:00:28.960299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:33.212237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'241","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.747311+0000","last_change":"2024-09-12T19:00:33.747311+0000","last_active":"2024-09-12T19:00:33.747311+0000","last_peered":"2024-09-12T19:00:33.747311+0000","last_clean":"2024-09-12T19:00:33.747311+0000","last_became_active":"2024-09-12T17:40:24.181581+0000","last_became_peered":"2024-09-12T17:40:24.181581+0000","last_unstale":"2024-09-12T19:00:33.747311+0000","last_undegraded":"2024-09-12T19:00:33.747311+0000","last_fullsized":"2024-09-12T19:00:33.747311+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'241","last_scrub_stamp":"2024-09-12T19:00:33.747120+0000","last_deep_scrub":"264'241","last_deep_scrub_stamp":"2024-09-12T19:00:33.747120+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.747120+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:35.708518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":967,"num_write":316,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:37.909798+0000","last_change":"2024-09-12T19:00:37.909798+0000","last_active":"2024-09-12T19:00:37.909798+0000","last_peered":"2024-09-12T19:00:37.909798+0000","last_clean":"2024-09-12T19:00:37.909798+0000","last_became_active":"2024-09-12T17:40:26.195603+0000","last_became_peered":"2024-09-12T17:40:26.195603+0000","last_unstale":"2024-09-12T19:00:37.909798+0000","last_undegraded":"2024-09-12T19:00:37.909798+0000","last_fullsized":"2024-09-12T19:00:37.909798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:37.909628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:37.909628+0000","last_clean_scrub_stamp":"2024-09-12T19:00:37.909628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:37.888689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'171","reported_seq":1293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:38.841114+0000","last_change":"2024-09-12T19:00:38.841114+0000","last_active":"2024-09-12T19:00:38.841114+0000","last_peered":"2024-09-12T19:00:38.841114+0000","last_clean":"2024-09-12T19:00:38.841114+0000","last_became_active":"2024-09-12T17:40:28.200126+0000","last_became_peered":"2024-09-12T17:40:28.200126+0000","last_unstale":"2024-09-12T19:00:38.841114+0000","last_undegraded":"2024-09-12T19:00:38.841114+0000","last_fullsized":"2024-09-12T19:00:38.841114+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T19:00:38.840922+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T19:00:38.840922+0000","last_clean_scrub_stamp":"2024-09-12T19:00:38.840922+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:43.048043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":872,"num_read_kb":859,"num_write":427,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'166","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:16.848337+0000","last_change":"2024-09-12T19:00:16.848337+0000","last_active":"2024-09-12T19:00:16.848337+0000","last_peered":"2024-09-12T19:00:16.848337+0000","last_clean":"2024-09-12T19:00:16.848337+0000","last_became_active":"2024-09-12T17:40:20.131459+0000","last_became_peered":"2024-09-12T17:40:20.131459+0000","last_unstale":"2024-09-12T19:00:16.848337+0000","last_undegraded":"2024-09-12T19:00:16.848337+0000","last_fullsized":"2024-09-12T19:00:16.848337+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T19:00:16.848164+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T19:00:16.848164+0000","last_clean_scrub_stamp":"2024-09-12T19:00:16.848164+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:33.348709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":677,"num_write":293,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'344","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.318433+0000","last_change":"2024-09-12T19:00:08.318433+0000","last_active":"2024-09-12T19:00:08.318433+0000","last_peered":"2024-09-12T19:00:08.318433+0000","last_clean":"2024-09-12T19:00:08.318433+0000","last_became_active":"2024-09-12T17:40:18.773667+0000","last_became_peered":"2024-09-12T17:40:18.773667+0000","last_unstale":"2024-09-12T19:00:08.318433+0000","last_undegraded":"2024-09-12T19:00:08.318433+0000","last_fullsized":"2024-09-12T19:00:08.318433+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T19:00:08.318197+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T19:00:08.318197+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.318197+0000","objects_scrubbed":10,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:30.683986+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263633,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":554,"num_read_kb":8714,"num_write":1079,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'6","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.294939+0000","last_change":"2024-09-12T19:00:24.294769+0000","last_active":"2024-09-12T19:00:24.294939+0000","last_peered":"2024-09-12T19:00:24.294939+0000","last_clean":"2024-09-12T19:00:24.294939+0000","last_became_active":"2024-09-12T17:40:22.141182+0000","last_became_peered":"2024-09-12T17:40:22.141182+0000","last_unstale":"2024-09-12T19:00:24.294939+0000","last_undegraded":"2024-09-12T19:00:24.294939+0000","last_fullsized":"2024-09-12T19:00:24.294939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:00:24.294580+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:00:24.294580+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.294580+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:23.277435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'310","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:33.937956+0000","last_change":"2024-09-12T19:00:33.937956+0000","last_active":"2024-09-12T19:00:33.937956+0000","last_peered":"2024-09-12T19:00:33.937956+0000","last_clean":"2024-09-12T19:00:33.937956+0000","last_became_active":"2024-09-12T17:40:24.166330+0000","last_became_peered":"2024-09-12T17:40:24.166330+0000","last_unstale":"2024-09-12T19:00:33.937956+0000","last_undegraded":"2024-09-12T19:00:33.937956+0000","last_fullsized":"2024-09-12T19:00:33.937956+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-12T19:00:33.937774+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-12T19:00:33.937774+0000","last_clean_scrub_stamp":"2024-09-12T19:00:33.937774+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:21.539066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51905,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1128,"num_write":400,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:36.318424+0000","last_change":"2024-09-12T19:00:36.318424+0000","last_active":"2024-09-12T19:00:36.318424+0000","last_peered":"2024-09-12T19:00:36.318424+0000","last_clean":"2024-09-12T19:00:36.318424+0000","last_became_active":"2024-09-12T17:40:26.188351+0000","last_became_peered":"2024-09-12T17:40:26.188351+0000","last_unstale":"2024-09-12T19:00:36.318424+0000","last_undegraded":"2024-09-12T19:00:36.318424+0000","last_fullsized":"2024-09-12T19:00:36.318424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:00:36.318245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:00:36.318245+0000","last_clean_scrub_stamp":"2024-09-12T19:00:36.318245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:56.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'140","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:39.889301+0000","last_change":"2024-09-12T19:00:39.889301+0000","last_active":"2024-09-12T19:00:39.889301+0000","last_peered":"2024-09-12T19:00:39.889301+0000","last_clean":"2024-09-12T19:00:39.889301+0000","last_became_active":"2024-09-12T17:40:28.180148+0000","last_became_peered":"2024-09-12T17:40:28.180148+0000","last_unstale":"2024-09-12T19:00:39.889301+0000","last_undegraded":"2024-09-12T19:00:39.889301+0000","last_fullsized":"2024-09-12T19:00:39.889301+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-12T19:00:39.889091+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-12T19:00:39.889091+0000","last_clean_scrub_stamp":"2024-09-12T19:00:39.889091+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:44.717196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":171,"num_read_kb":158,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'174","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.338634+0000","last_change":"2024-09-12T19:00:19.338356+0000","last_active":"2024-09-12T19:00:19.338634+0000","last_peered":"2024-09-12T19:00:19.338634+0000","last_clean":"2024-09-12T19:00:19.338634+0000","last_became_active":"2024-09-12T17:40:20.127006+0000","last_became_peered":"2024-09-12T17:40:20.127006+0000","last_unstale":"2024-09-12T19:00:19.338634+0000","last_undegraded":"2024-09-12T19:00:19.338634+0000","last_fullsized":"2024-09-12T19:00:19.338634+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T19:00:19.338125+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T19:00:19.338125+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.338125+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:28.379386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":779,"num_read_kb":649,"num_write":260,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'327","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.432395+0000","last_change":"2024-09-12T19:00:12.432395+0000","last_active":"2024-09-12T19:00:12.432395+0000","last_peered":"2024-09-12T19:00:12.432395+0000","last_clean":"2024-09-12T19:00:12.432395+0000","last_became_active":"2024-09-12T17:40:18.757444+0000","last_became_peered":"2024-09-12T17:40:18.757444+0000","last_unstale":"2024-09-12T19:00:12.432395+0000","last_undegraded":"2024-09-12T19:00:12.432395+0000","last_fullsized":"2024-09-12T19:00:12.432395+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T19:00:12.432143+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T19:00:12.432143+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.432143+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:39.703339+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194355,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":91614,"num_write":1080,"num_write_kb":46187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'4205","reported_seq":4828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.334513+0000","last_change":"2024-09-12T19:00:17.334280+0000","last_active":"2024-09-12T19:00:17.334513+0000","last_peered":"2024-09-12T19:00:17.334513+0000","last_clean":"2024-09-12T19:00:17.334513+0000","last_became_active":"2024-09-12T17:40:20.125586+0000","last_became_peered":"2024-09-12T17:40:20.125586+0000","last_unstale":"2024-09-12T19:00:17.334513+0000","last_undegraded":"2024-09-12T19:00:17.334513+0000","last_fullsized":"2024-09-12T19:00:17.334513+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4205","last_scrub_stamp":"2024-09-12T19:00:17.334001+0000","last_deep_scrub":"264'4205","last_deep_scrub_stamp":"2024-09-12T19:00:17.334001+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.334001+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":3000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:15.949061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16904,"num_read_kb":14161,"num_write":6332,"num_write_kb":3161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'321","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:07.590276+0000","last_change":"2024-09-12T19:00:07.590276+0000","last_active":"2024-09-12T19:00:07.590276+0000","last_peered":"2024-09-12T19:00:07.590276+0000","last_clean":"2024-09-12T19:00:07.590276+0000","last_became_active":"2024-09-12T17:40:18.754335+0000","last_became_peered":"2024-09-12T17:40:18.754335+0000","last_unstale":"2024-09-12T19:00:07.590276+0000","last_undegraded":"2024-09-12T19:00:07.590276+0000","last_fullsized":"2024-09-12T19:00:07.590276+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T19:00:07.590095+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T19:00:07.590095+0000","last_clean_scrub_stamp":"2024-09-12T19:00:07.590095+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:24.884297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":433,"num_read_kb":13730,"num_write":1004,"num_write_kb":29574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'414","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:24.347254+0000","last_change":"2024-09-12T19:00:24.347121+0000","last_active":"2024-09-12T19:00:24.347254+0000","last_peered":"2024-09-12T19:00:24.347254+0000","last_clean":"2024-09-12T19:00:24.347254+0000","last_became_active":"2024-09-12T17:40:20.136831+0000","last_became_peered":"2024-09-12T17:40:20.136831+0000","last_unstale":"2024-09-12T19:00:24.347254+0000","last_undegraded":"2024-09-12T19:00:24.347254+0000","last_fullsized":"2024-09-12T19:00:24.347254+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-12T19:00:24.346937+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-12T19:00:24.346937+0000","last_clean_scrub_stamp":"2024-09-12T19:00:24.346937+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:09.754944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1812,"num_read_kb":1536,"num_write":694,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2875,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'341","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:12.271766+0000","last_change":"2024-09-12T19:00:12.271766+0000","last_active":"2024-09-12T19:00:12.271766+0000","last_peered":"2024-09-12T19:00:12.271766+0000","last_clean":"2024-09-12T19:00:12.271766+0000","last_became_active":"2024-09-12T17:40:18.753576+0000","last_became_peered":"2024-09-12T17:40:18.753576+0000","last_unstale":"2024-09-12T19:00:12.271766+0000","last_undegraded":"2024-09-12T19:00:12.271766+0000","last_fullsized":"2024-09-12T19:00:12.271766+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T19:00:12.271560+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T19:00:12.271560+0000","last_clean_scrub_stamp":"2024-09-12T19:00:12.271560+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:34.437310+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":449,"num_read_kb":36529,"num_write":1017,"num_write_kb":32314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'363","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.372056+0000","last_change":"2024-09-12T19:00:20.371890+0000","last_active":"2024-09-12T19:00:20.372056+0000","last_peered":"2024-09-12T19:00:20.372056+0000","last_clean":"2024-09-12T19:00:20.372056+0000","last_became_active":"2024-09-12T17:40:20.132826+0000","last_became_peered":"2024-09-12T17:40:20.132826+0000","last_unstale":"2024-09-12T19:00:20.372056+0000","last_undegraded":"2024-09-12T19:00:20.372056+0000","last_fullsized":"2024-09-12T19:00:20.372056+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-12T19:00:20.371710+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-12T19:00:20.371710+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.371710+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:53.712192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1596,"num_read_kb":1285,"num_write":598,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'350","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.351167+0000","last_change":"2024-09-12T19:00:09.351167+0000","last_active":"2024-09-12T19:00:09.351167+0000","last_peered":"2024-09-12T19:00:09.351167+0000","last_clean":"2024-09-12T19:00:09.351167+0000","last_became_active":"2024-09-12T17:40:18.754933+0000","last_became_peered":"2024-09-12T17:40:18.754933+0000","last_unstale":"2024-09-12T19:00:09.351167+0000","last_undegraded":"2024-09-12T19:00:09.351167+0000","last_fullsized":"2024-09-12T19:00:09.351167+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T19:00:09.350866+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T19:00:09.350866+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.350866+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:40.151355+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081897,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":46825,"num_write":1040,"num_write_kb":45673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'114","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.622228+0000","last_change":"2024-09-12T19:00:17.622228+0000","last_active":"2024-09-12T19:00:17.622228+0000","last_peered":"2024-09-12T19:00:17.622228+0000","last_clean":"2024-09-12T19:00:17.622228+0000","last_became_active":"2024-09-12T17:40:20.129769+0000","last_became_peered":"2024-09-12T17:40:20.129769+0000","last_unstale":"2024-09-12T19:00:17.622228+0000","last_undegraded":"2024-09-12T19:00:17.622228+0000","last_fullsized":"2024-09-12T19:00:17.622228+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T19:00:17.622030+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T19:00:17.622030+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.622030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:54.615405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":414,"num_write":175,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'356","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.690197+0000","last_change":"2024-09-12T19:00:10.690017+0000","last_active":"2024-09-12T19:00:10.690197+0000","last_peered":"2024-09-12T19:00:10.690197+0000","last_clean":"2024-09-12T19:00:10.690197+0000","last_became_active":"2024-09-12T17:40:18.773052+0000","last_became_peered":"2024-09-12T17:40:18.773052+0000","last_unstale":"2024-09-12T19:00:10.690197+0000","last_undegraded":"2024-09-12T19:00:10.690197+0000","last_fullsized":"2024-09-12T19:00:10.690197+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T19:00:10.689810+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T19:00:10.689810+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.689810+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:54.998455+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2648214,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":619,"num_read_kb":23542,"num_write":1059,"num_write_kb":26208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'141","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.828290+0000","last_change":"2024-09-12T19:00:18.828290+0000","last_active":"2024-09-12T19:00:18.828290+0000","last_peered":"2024-09-12T19:00:18.828290+0000","last_clean":"2024-09-12T19:00:18.828290+0000","last_became_active":"2024-09-12T17:40:20.146835+0000","last_became_peered":"2024-09-12T17:40:20.146835+0000","last_unstale":"2024-09-12T19:00:18.828290+0000","last_undegraded":"2024-09-12T19:00:18.828290+0000","last_fullsized":"2024-09-12T19:00:18.828290+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T19:00:18.828089+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T19:00:18.828089+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.828089+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:42.635478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":516,"num_write":222,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'452","reported_seq":1235,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.396589+0000","last_change":"2024-09-12T19:00:08.396458+0000","last_active":"2024-09-12T19:00:08.396589+0000","last_peered":"2024-09-12T19:00:08.396589+0000","last_clean":"2024-09-12T19:00:08.396589+0000","last_became_active":"2024-09-12T17:40:18.764545+0000","last_became_peered":"2024-09-12T17:40:18.764545+0000","last_unstale":"2024-09-12T19:00:08.396589+0000","last_undegraded":"2024-09-12T19:00:08.396589+0000","last_fullsized":"2024-09-12T19:00:08.396589+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'452","last_scrub_stamp":"2024-09-12T19:00:08.396245+0000","last_deep_scrub":"264'452","last_deep_scrub_stamp":"2024-09-12T19:00:08.396245+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.396245+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:44.809947+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263245,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":913,"num_read_kb":25412,"num_write":1371,"num_write_kb":29284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'206","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:23.666116+0000","last_change":"2024-09-12T19:00:23.666116+0000","last_active":"2024-09-12T19:00:23.666116+0000","last_peered":"2024-09-12T19:00:23.666116+0000","last_clean":"2024-09-12T19:00:23.666116+0000","last_became_active":"2024-09-12T17:40:20.133055+0000","last_became_peered":"2024-09-12T17:40:20.133055+0000","last_unstale":"2024-09-12T19:00:23.666116+0000","last_undegraded":"2024-09-12T19:00:23.666116+0000","last_fullsized":"2024-09-12T19:00:23.666116+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T19:00:23.665932+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T19:00:23.665932+0000","last_clean_scrub_stamp":"2024-09-12T19:00:23.665932+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:04.141641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":974,"num_read_kb":794,"num_write":355,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'338","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.422529+0000","last_change":"2024-09-12T19:00:08.422287+0000","last_active":"2024-09-12T19:00:08.422529+0000","last_peered":"2024-09-12T19:00:08.422529+0000","last_clean":"2024-09-12T19:00:08.422529+0000","last_became_active":"2024-09-12T17:40:18.764658+0000","last_became_peered":"2024-09-12T17:40:18.764658+0000","last_unstale":"2024-09-12T19:00:08.422529+0000","last_undegraded":"2024-09-12T19:00:08.422529+0000","last_fullsized":"2024-09-12T19:00:08.422529+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T19:00:08.421985+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T19:00:08.421985+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.421985+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:05.651015+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4856534,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":14122,"num_write":1065,"num_write_kb":26720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'195","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:17.424693+0000","last_change":"2024-09-12T19:00:17.424693+0000","last_active":"2024-09-12T19:00:17.424693+0000","last_peered":"2024-09-12T19:00:17.424693+0000","last_clean":"2024-09-12T19:00:17.424693+0000","last_became_active":"2024-09-12T17:40:20.124247+0000","last_became_peered":"2024-09-12T17:40:20.124247+0000","last_unstale":"2024-09-12T19:00:17.424693+0000","last_undegraded":"2024-09-12T19:00:17.424693+0000","last_fullsized":"2024-09-12T19:00:17.424693+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T19:00:17.424514+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T19:00:17.424514+0000","last_clean_scrub_stamp":"2024-09-12T19:00:17.424514+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:47.443716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":903,"num_read_kb":737,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'372","reported_seq":1062,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.719139+0000","last_change":"2024-09-12T19:00:09.718958+0000","last_active":"2024-09-12T19:00:09.719139+0000","last_peered":"2024-09-12T19:00:09.719139+0000","last_clean":"2024-09-12T19:00:09.719139+0000","last_became_active":"2024-09-12T17:40:18.772776+0000","last_became_peered":"2024-09-12T17:40:18.772776+0000","last_unstale":"2024-09-12T19:00:09.719139+0000","last_undegraded":"2024-09-12T19:00:09.719139+0000","last_fullsized":"2024-09-12T19:00:09.719139+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T19:00:09.718726+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T19:00:09.718726+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.718726+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:59.239489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":25353,"num_write":1144,"num_write_kb":19697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'233","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.362881+0000","last_change":"2024-09-12T19:00:19.362881+0000","last_active":"2024-09-12T19:00:19.362881+0000","last_peered":"2024-09-12T19:00:19.362881+0000","last_clean":"2024-09-12T19:00:19.362881+0000","last_became_active":"2024-09-12T17:40:20.116064+0000","last_became_peered":"2024-09-12T17:40:20.116064+0000","last_unstale":"2024-09-12T19:00:19.362881+0000","last_undegraded":"2024-09-12T19:00:19.362881+0000","last_fullsized":"2024-09-12T19:00:19.362881+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-12T19:00:19.362701+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-12T19:00:19.362701+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.362701+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:26.580777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1004,"num_read_kb":824,"num_write":355,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'342","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.289653+0000","last_change":"2024-09-12T19:00:13.289501+0000","last_active":"2024-09-12T19:00:13.289653+0000","last_peered":"2024-09-12T19:00:13.289653+0000","last_clean":"2024-09-12T19:00:13.289653+0000","last_became_active":"2024-09-12T17:40:18.753693+0000","last_became_peered":"2024-09-12T17:40:18.753693+0000","last_unstale":"2024-09-12T19:00:13.289653+0000","last_undegraded":"2024-09-12T19:00:13.289653+0000","last_fullsized":"2024-09-12T19:00:13.289653+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-12T19:00:13.289299+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-12T19:00:13.289299+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.289299+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:49.965185+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194334,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":459,"num_read_kb":12118,"num_write":1082,"num_write_kb":50446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'82","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.817953+0000","last_change":"2024-09-12T19:00:21.817953+0000","last_active":"2024-09-12T19:00:21.817953+0000","last_peered":"2024-09-12T19:00:21.817953+0000","last_clean":"2024-09-12T19:00:21.817953+0000","last_became_active":"2024-09-12T17:40:20.129687+0000","last_became_peered":"2024-09-12T17:40:20.129687+0000","last_unstale":"2024-09-12T19:00:21.817953+0000","last_undegraded":"2024-09-12T19:00:21.817953+0000","last_fullsized":"2024-09-12T19:00:21.817953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'82","last_scrub_stamp":"2024-09-12T19:00:21.817743+0000","last_deep_scrub":"264'82","last_deep_scrub_stamp":"2024-09-12T19:00:21.817743+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.817743+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:53.779281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":302,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'397","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:27.744954+0000","last_change":"2024-09-12T19:00:27.744811+0000","last_active":"2024-09-12T19:00:27.744954+0000","last_peered":"2024-09-12T19:00:27.744954+0000","last_clean":"2024-09-12T19:00:27.744954+0000","last_became_active":"2024-09-12T17:40:18.772969+0000","last_became_peered":"2024-09-12T17:40:18.772969+0000","last_unstale":"2024-09-12T19:00:27.744954+0000","last_undegraded":"2024-09-12T19:00:27.744954+0000","last_fullsized":"2024-09-12T19:00:27.744954+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'397","last_scrub_stamp":"2024-09-12T19:00:27.744590+0000","last_deep_scrub":"264'397","last_deep_scrub_stamp":"2024-09-12T19:00:27.744590+0000","last_clean_scrub_stamp":"2024-09-12T19:00:27.744590+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:39.153902+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242937,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":478,"num_read_kb":13353,"num_write":1113,"num_write_kb":30519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'211","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:13.609423+0000","last_change":"2024-09-12T19:00:13.609423+0000","last_active":"2024-09-12T19:00:13.609423+0000","last_peered":"2024-09-12T19:00:13.609423+0000","last_clean":"2024-09-12T19:00:13.609423+0000","last_became_active":"2024-09-12T17:40:20.130606+0000","last_became_peered":"2024-09-12T17:40:20.130606+0000","last_unstale":"2024-09-12T19:00:13.609423+0000","last_undegraded":"2024-09-12T19:00:13.609423+0000","last_fullsized":"2024-09-12T19:00:13.609423+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T19:00:13.609244+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T19:00:13.609244+0000","last_clean_scrub_stamp":"2024-09-12T19:00:13.609244+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:10.927640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":765,"num_write":331,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'361","reported_seq":1144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:14.290710+0000","last_change":"2024-09-12T19:00:14.290572+0000","last_active":"2024-09-12T19:00:14.290710+0000","last_peered":"2024-09-12T19:00:14.290710+0000","last_clean":"2024-09-12T19:00:14.290710+0000","last_became_active":"2024-09-12T17:40:18.780861+0000","last_became_peered":"2024-09-12T17:40:18.780861+0000","last_unstale":"2024-09-12T19:00:14.290710+0000","last_undegraded":"2024-09-12T19:00:14.290710+0000","last_fullsized":"2024-09-12T19:00:14.290710+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-12T19:00:14.290350+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-12T19:00:14.290350+0000","last_clean_scrub_stamp":"2024-09-12T19:00:14.290350+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:52.086504+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747960,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":883,"num_read_kb":18830,"num_write":1183,"num_write_kb":42628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'422","reported_seq":1189,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.862285+0000","last_change":"2024-09-12T19:00:20.862014+0000","last_active":"2024-09-12T19:00:20.862285+0000","last_peered":"2024-09-12T19:00:20.862285+0000","last_clean":"2024-09-12T19:00:20.862285+0000","last_became_active":"2024-09-12T17:40:20.149176+0000","last_became_peered":"2024-09-12T17:40:20.149176+0000","last_unstale":"2024-09-12T19:00:20.862285+0000","last_undegraded":"2024-09-12T19:00:20.862285+0000","last_fullsized":"2024-09-12T19:00:20.862285+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'422","last_scrub_stamp":"2024-09-12T19:00:20.861788+0000","last_deep_scrub":"264'422","last_deep_scrub_stamp":"2024-09-12T19:00:20.861788+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.861788+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:54.694114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2034,"num_read_kb":1768,"num_write":658,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'346","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:10.360900+0000","last_change":"2024-09-12T19:00:10.360750+0000","last_active":"2024-09-12T19:00:10.360900+0000","last_peered":"2024-09-12T19:00:10.360900+0000","last_clean":"2024-09-12T19:00:10.360900+0000","last_became_active":"2024-09-12T17:40:18.781543+0000","last_became_peered":"2024-09-12T17:40:18.781543+0000","last_unstale":"2024-09-12T19:00:10.360900+0000","last_undegraded":"2024-09-12T19:00:10.360900+0000","last_fullsized":"2024-09-12T19:00:10.360900+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-12T19:00:10.360515+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-12T19:00:10.360515+0000","last_clean_scrub_stamp":"2024-09-12T19:00:10.360515+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:06.783092+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457569,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":553,"num_read_kb":27146,"num_write":1120,"num_write_kb":17169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'186","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.911698+0000","last_change":"2024-09-12T19:00:21.911553+0000","last_active":"2024-09-12T19:00:21.911698+0000","last_peered":"2024-09-12T19:00:21.911698+0000","last_clean":"2024-09-12T19:00:21.911698+0000","last_became_active":"2024-09-12T17:40:20.132914+0000","last_became_peered":"2024-09-12T17:40:20.132914+0000","last_unstale":"2024-09-12T19:00:21.911698+0000","last_undegraded":"2024-09-12T19:00:21.911698+0000","last_fullsized":"2024-09-12T19:00:21.911698+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-12T19:00:21.911343+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-12T19:00:21.911343+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.911343+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:50.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":685,"num_write":286,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'422","reported_seq":1146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:09.382135+0000","last_change":"2024-09-12T19:00:09.381965+0000","last_active":"2024-09-12T19:00:09.382135+0000","last_peered":"2024-09-12T19:00:09.382135+0000","last_clean":"2024-09-12T19:00:09.382135+0000","last_became_active":"2024-09-12T17:40:18.773572+0000","last_became_peered":"2024-09-12T17:40:18.773572+0000","last_unstale":"2024-09-12T19:00:09.382135+0000","last_undegraded":"2024-09-12T19:00:09.382135+0000","last_fullsized":"2024-09-12T19:00:09.382135+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'422","last_scrub_stamp":"2024-09-12T19:00:09.381751+0000","last_deep_scrub":"264'422","last_deep_scrub_stamp":"2024-09-12T19:00:09.381751+0000","last_clean_scrub_stamp":"2024-09-12T19:00:09.381751+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:32.068671+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":27791,"num_write":1413,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'107","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:18.338608+0000","last_change":"2024-09-12T19:00:18.338332+0000","last_active":"2024-09-12T19:00:18.338608+0000","last_peered":"2024-09-12T19:00:18.338608+0000","last_clean":"2024-09-12T19:00:18.338608+0000","last_became_active":"2024-09-12T17:40:20.124905+0000","last_became_peered":"2024-09-12T17:40:20.124905+0000","last_unstale":"2024-09-12T19:00:18.338608+0000","last_undegraded":"2024-09-12T19:00:18.338608+0000","last_fullsized":"2024-09-12T19:00:18.338608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T19:00:18.338034+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T19:00:18.338034+0000","last_clean_scrub_stamp":"2024-09-12T19:00:18.338034+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:10.384014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":441,"num_write":144,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'398","reported_seq":1116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.920289+0000","last_change":"2024-09-12T19:00:15.920289+0000","last_active":"2024-09-12T19:00:15.920289+0000","last_peered":"2024-09-12T19:00:15.920289+0000","last_clean":"2024-09-12T19:00:15.920289+0000","last_became_active":"2024-09-12T17:40:18.776865+0000","last_became_peered":"2024-09-12T17:40:18.776865+0000","last_unstale":"2024-09-12T19:00:15.920289+0000","last_undegraded":"2024-09-12T19:00:15.920289+0000","last_fullsized":"2024-09-12T19:00:15.920289+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-12T19:00:15.920038+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-12T19:00:15.920038+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.920038+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:26.024841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":2000,"num_write":1257,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'104","reported_seq":739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:29.745325+0000","last_change":"2024-09-12T19:00:29.745170+0000","last_active":"2024-09-12T19:00:29.745325+0000","last_peered":"2024-09-12T19:00:29.745325+0000","last_clean":"2024-09-12T19:00:29.745325+0000","last_became_active":"2024-09-12T17:40:20.119036+0000","last_became_peered":"2024-09-12T17:40:20.119036+0000","last_unstale":"2024-09-12T19:00:29.745325+0000","last_undegraded":"2024-09-12T19:00:29.745325+0000","last_fullsized":"2024-09-12T19:00:29.745325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'104","last_scrub_stamp":"2024-09-12T19:00:29.744980+0000","last_deep_scrub":"264'104","last_deep_scrub_stamp":"2024-09-12T19:00:29.744980+0000","last_clean_scrub_stamp":"2024-09-12T19:00:29.744980+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:13.725787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":455,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'498","reported_seq":1210,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:08.639674+0000","last_change":"2024-09-12T19:00:08.639674+0000","last_active":"2024-09-12T19:00:08.639674+0000","last_peered":"2024-09-12T19:00:08.639674+0000","last_clean":"2024-09-12T19:00:08.639674+0000","last_became_active":"2024-09-12T17:40:18.768688+0000","last_became_peered":"2024-09-12T17:40:18.768688+0000","last_unstale":"2024-09-12T19:00:08.639674+0000","last_undegraded":"2024-09-12T19:00:08.639674+0000","last_fullsized":"2024-09-12T19:00:08.639674+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'498","last_scrub_stamp":"2024-09-12T19:00:08.639435+0000","last_deep_scrub":"264'498","last_deep_scrub_stamp":"2024-09-12T19:00:08.639435+0000","last_clean_scrub_stamp":"2024-09-12T19:00:08.639435+0000","objects_scrubbed":10,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:14.008750+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1574987,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":867,"num_read_kb":49769,"num_write":1400,"num_write_kb":26119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'160","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:19.913144+0000","last_change":"2024-09-12T19:00:19.912993+0000","last_active":"2024-09-12T19:00:19.913144+0000","last_peered":"2024-09-12T19:00:19.913144+0000","last_clean":"2024-09-12T19:00:19.913144+0000","last_became_active":"2024-09-12T17:40:20.132698+0000","last_became_peered":"2024-09-12T17:40:20.132698+0000","last_unstale":"2024-09-12T19:00:19.913144+0000","last_undegraded":"2024-09-12T19:00:19.913144+0000","last_fullsized":"2024-09-12T19:00:19.913144+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'160","last_scrub_stamp":"2024-09-12T19:00:19.912805+0000","last_deep_scrub":"264'160","last_deep_scrub_stamp":"2024-09-12T19:00:19.912805+0000","last_clean_scrub_stamp":"2024-09-12T19:00:19.912805+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:29.782789+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":512,"num_write":259,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'360","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:15.274101+0000","last_change":"2024-09-12T19:00:15.274101+0000","last_active":"2024-09-12T19:00:15.274101+0000","last_peered":"2024-09-12T19:00:15.274101+0000","last_clean":"2024-09-12T19:00:15.274101+0000","last_became_active":"2024-09-12T17:40:18.784024+0000","last_became_peered":"2024-09-12T17:40:18.784024+0000","last_unstale":"2024-09-12T19:00:15.274101+0000","last_undegraded":"2024-09-12T19:00:15.274101+0000","last_fullsized":"2024-09-12T19:00:15.274101+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-12T19:00:15.273885+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-12T19:00:15.273885+0000","last_clean_scrub_stamp":"2024-09-12T19:00:15.273885+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:38.508212+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506065,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":13540,"num_write":1118,"num_write_kb":25363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'385","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:06.627938+0000","last_change":"2024-09-12T19:00:06.627843+0000","last_active":"2024-09-12T19:00:06.627938+0000","last_peered":"2024-09-12T19:00:06.627938+0000","last_clean":"2024-09-12T19:00:06.627938+0000","last_became_active":"2024-09-12T17:40:55.331839+0000","last_became_peered":"2024-09-12T17:40:55.331839+0000","last_unstale":"2024-09-12T19:00:06.627938+0000","last_undegraded":"2024-09-12T19:00:06.627938+0000","last_fullsized":"2024-09-12T19:00:06.627938+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T19:00:06.627706+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T19:00:06.627706+0000","last_clean_scrub_stamp":"2024-09-12T19:00:06.627706+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:52.807717+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":31466,"num_write":1073,"num_write_kb":39606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'70","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:20.316844+0000","last_change":"2024-09-12T19:00:20.316695+0000","last_active":"2024-09-12T19:00:20.316844+0000","last_peered":"2024-09-12T19:00:20.316844+0000","last_clean":"2024-09-12T19:00:20.316844+0000","last_became_active":"2024-09-12T17:40:20.116230+0000","last_became_peered":"2024-09-12T17:40:20.116230+0000","last_unstale":"2024-09-12T19:00:20.316844+0000","last_undegraded":"2024-09-12T19:00:20.316844+0000","last_fullsized":"2024-09-12T19:00:20.316844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'70","last_scrub_stamp":"2024-09-12T19:00:20.316504+0000","last_deep_scrub":"264'70","last_deep_scrub_stamp":"2024-09-12T19:00:20.316504+0000","last_clean_scrub_stamp":"2024-09-12T19:00:20.316504+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:02.569846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":294,"num_write":113,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'391","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:11.415348+0000","last_change":"2024-09-12T19:00:11.415348+0000","last_active":"2024-09-12T19:00:11.415348+0000","last_peered":"2024-09-12T19:00:11.415348+0000","last_clean":"2024-09-12T19:00:11.415348+0000","last_became_active":"2024-09-12T17:40:18.774332+0000","last_became_peered":"2024-09-12T17:40:18.774332+0000","last_unstale":"2024-09-12T19:00:11.415348+0000","last_undegraded":"2024-09-12T19:00:11.415348+0000","last_fullsized":"2024-09-12T19:00:11.415348+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'391","last_scrub_stamp":"2024-09-12T19:00:11.415109+0000","last_deep_scrub":"264'391","last_deep_scrub_stamp":"2024-09-12T19:00:11.415109+0000","last_clean_scrub_stamp":"2024-09-12T19:00:11.415109+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:08.336481+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482012,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":8119,"num_write":1461,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'266","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T19:00:21.311756+0000","last_change":"2024-09-12T19:00:21.311756+0000","last_active":"2024-09-12T19:00:21.311756+0000","last_peered":"2024-09-12T19:00:21.311756+0000","last_clean":"2024-09-12T19:00:21.311756+0000","last_became_active":"2024-09-12T17:40:20.112521+0000","last_became_peered":"2024-09-12T17:40:20.112521+0000","last_unstale":"2024-09-12T19:00:21.311756+0000","last_undegraded":"2024-09-12T19:00:21.311756+0000","last_fullsized":"2024-09-12T19:00:21.311756+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T19:00:21.311545+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T19:00:21.311545+0000","last_clean_scrub_stamp":"2024-09-12T19:00:21.311545+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.668351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1090,"num_read_kb":887,"num_write":395,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5850,"num_read_kb":4138,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9425,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1013,"ondisk_log_size":1013,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16272,"num_read_kb":15940,"num_write":16723,"num_write_kb":4884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1847,"ondisk_log_size":1847,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":493,"ondisk_log_size":493,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1567416,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":19029,"num_read_kb":39666,"num_write":15931,"num_write_kb":12049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":682050,"num_omap_keys":1558,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1833,"ondisk_log_size":1833,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103249,"num_read_kb":86122,"num_write":37396,"num_write_kb":18900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44332,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3961,"ondisk_log_size":3961,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":156029425,"num_objects":414,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":414,"num_whiteouts":0,"num_read":36445,"num_read_kb":1876664,"num_write":72236,"num_write_kb":2152272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":313376768,"data_stored":312058850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3611,"ondisk_log_size":3611,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":197405,"num_write":186,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":186093,"num_write":186,"num_write_kb":127711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510421,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308820,"kb_used_data":52740,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94063020,"statfs":{"total":96636764160,"available":96320532480,"internally_reserved":0,"allocated":54005760,"data_stored":52302612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":262207946},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510421,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261840,"kb_used_data":27968,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94110000,"statfs":{"total":96636764160,"available":96368640000,"internally_reserved":0,"allocated":28639232,"data_stored":27005259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510420,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140380,"kb_used_data":41228,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94231460,"statfs":{"total":96636764160,"available":96493015040,"internally_reserved":0,"allocated":42217472,"data_stored":40481962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510421,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121988,"kb_used_data":46388,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94249852,"statfs":{"total":96636764160,"available":96511848448,"internally_reserved":0,"allocated":47501312,"data_stored":45836760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510419,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303104,"kb_used_data":51184,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94068736,"statfs":{"total":96636764160,"available":96326385664,"internally_reserved":0,"allocated":52412416,"data_stored":50705649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510419,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133100,"kb_used_data":29788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94238740,"statfs":{"total":96636764160,"available":96500469760,"internally_reserved":0,"allocated":30502912,"data_stored":28881998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510421,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272500,"kb_used_data":56676,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94099340,"statfs":{"total":96636764160,"available":96357724160,"internally_reserved":0,"allocated":58036224,"data_stored":56286500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575828,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110860,"kb_used_data":29756,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94260980,"statfs":{"total":96636764160,"available":96523243520,"internally_reserved":0,"allocated":30470144,"data_stored":28895816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":83032520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53760000,"data_stored":53550290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26857472,"data_stored":26738240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26849280,"data_stored":26750445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48742400,"data_stored":48559608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":43892736,"data_stored":43694024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":38510592,"data_stored":38336597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25014272,"data_stored":24861531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49750016,"data_stored":49568115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:01:28.518 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T19:01:28.878 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T19:01:28.879 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T19:01:28.879 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T19:01:28.879 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:28.974 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T19:01:28.974 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T19:01:28.975 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:29.069 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T19:01:29.070 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T19:01:29.070 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:29.170 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T19:01:29.170 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T19:01:29.170 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:29.267 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T19:01:29.267 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T19:01:29.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:29.364 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T19:01:29.364 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T19:01:29.365 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:29.454 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T19:01:29.455 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T19:01:29.455 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:30.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-12T19:01:30.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-12T19:01:35.556 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T19:01:35.557 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T19:01:35.557 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:35.637 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T19:01:35.638 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T19:01:35.638 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T19:01:35.638 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:35.670 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T19:01:35.670 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T19:01:35.670 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:35.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-12T19:01:35.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-12T19:01:35.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-12T19:01:35.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-12T19:01:35.700 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T19:01:35.700 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T19:01:35.700 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T19:01:35.700 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:35.731 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T19:01:35.732 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T19:01:35.732 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:35.796 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T19:01:35.796 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T19:01:35.797 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:01:35.820 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T19:01:35.820 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T19:01:35.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T19:01:35.853 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T19:01:35.854 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T19:01:36.216 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T19:01:36.216 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T19:01:36.394 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T19:01:36.395 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T19:01:36.569 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T19:01:36.569 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T19:01:36.743 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T19:01:36.743 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T19:01:37.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T19:01:37.078 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T19:01:37.234 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T19:01:37.234 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T19:01:37.374 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T19:01:37.374 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T19:01:37.508 INFO:tasks.ceph:Archiving mon data... 2024-09-12T19:01:37.509 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746/data/mon.a.tgz 2024-09-12T19:01:37.510 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-09-12T19:01:37.516 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.Gg5aNPQgQo 2024-09-12T19:01:37.516 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Gg5aNPQgQo 2024-09-12T19:01:37.697 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.Gg5aNPQgQo 2024-09-12T19:01:37.760 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.Gg5aNPQgQo is 511KB 2024-09-12T19:01:37.822 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.Gg5aNPQgQo 2024-09-12T19:01:37.828 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746/data/mon.c.tgz 2024-09-12T19:01:37.828 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-09-12T19:01:37.876 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.AFkUdghAb9 2024-09-12T19:01:37.876 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.AFkUdghAb9 2024-09-12T19:01:38.064 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.AFkUdghAb9 2024-09-12T19:01:38.128 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.AFkUdghAb9 is 531KB 2024-09-12T19:01:38.185 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.AFkUdghAb9 2024-09-12T19:01:38.190 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746/data/mon.b.tgz 2024-09-12T19:01:38.190 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-09-12T19:01:38.196 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.uskkhGNe57 2024-09-12T19:01:38.196 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.uskkhGNe57 2024-09-12T19:01:38.375 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.uskkhGNe57 2024-09-12T19:01:38.437 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.uskkhGNe57 is 531KB 2024-09-12T19:01:38.499 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.uskkhGNe57 2024-09-12T19:01:38.505 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T19:01:38.505 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T19:01:38.508 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T19:01:38.623 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T19:01:38.628 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T19:01:38.628 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T19:01:38.630 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746/remote/smithi157/crash 2024-09-12T19:01:38.631 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T19:01:38.645 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746/remote/smithi190/crash 2024-09-12T19:01:38.646 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T19:01:38.686 INFO:tasks.ceph:Compressing logs... 2024-09-12T19:01:38.686 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T19:01:38.693 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T19:01:38.715 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31282.log 2024-09-12T19:01:38.716 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137669.log 2024-09-12T19:01:38.716 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31282.log.gz 2024-09-12T19:01:38.716 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41285.log 2024-09-12T19:01:38.718 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180027.log 2024-09-12T19:01:38.718 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.137669.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T19:01:38.719 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.41285.log: /var/log/ceph/ceph-client.admin.180027.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.137669.log.gz 2024-09-12T19:01:38.719 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26658.log 2024-09-12T19:01:38.719 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180027.log.gz 2024-09-12T19:01:38.719 INFO:teuthology.orchestra.run.smithi157.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.41285.log.gz 2024-09-12T19:01:38.719 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153674.log 2024-09-12T19:01:38.719 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.26658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114067.log 2024-09-12T19:01:38.719 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26658.log.gz 2024-09-12T19:01:38.721 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.153674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43105.log 2024-09-12T19:01:38.721 INFO:teuthology.orchestra.run.smithi157.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.153674.log.gz 2024-09-12T19:01:38.721 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.114067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50235.log 2024-09-12T19:01:38.721 INFO:teuthology.orchestra.run.smithi157.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.114067.log.gz 2024-09-12T19:01:38.721 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5/var/log/ceph/ceph-client.admin.43105.log: --verbose -- /var/log/ceph/ceph-client.admin.75712.log 2024-09-12T19:01:38.721 INFO:teuthology.orchestra.run.smithi157.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.43105.log.gz 2024-09-12T19:01:38.722 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.50235.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T19:01:38.722 INFO:teuthology.orchestra.run.smithi157.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.50235.log.gz 2024-09-12T19:01:38.722 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.75712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129408.log 2024-09-12T19:01:38.722 INFO:teuthology.orchestra.run.smithi157.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.75712.log.gz 2024-09-12T19:01:38.722 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36287.log 2024-09-12T19:01:38.722 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.129408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26907.log 2024-09-12T19:01:38.724 INFO:teuthology.orchestra.run.smithi157.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129408.log.gz 2024-09-12T19:01:38.724 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.36287.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.36287.log.gz 2024-09-12T19:01:38.724 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85744.log 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31805.log 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.26907.log: /var/log/ceph/ceph-client.admin.85744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131768.log 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26907.log.gz 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr: 87.4%/var/log/ceph/ceph-client.admin.31805.log: -- replaced with /var/log/ceph/ceph-client.admin.85744.log.gz 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31805.log.gz 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95184.log 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150652.log 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.131768.log: /var/log/ceph/ceph-client.admin.95184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180523.log 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.131768.log.gz 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.95184.log.gz 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.150652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150652.log.gz 2024-09-12T19:01:38.725 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54390.log 2024-09-12T19:01:38.726 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42465.log 2024-09-12T19:01:38.728 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180523.log: /var/log/ceph/ceph-client.admin.54390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132358.log 2024-09-12T19:01:38.728 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180523.log.gz 2024-09-12T19:01:38.728 INFO:teuthology.orchestra.run.smithi157.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.54390.log.gz 2024-09-12T19:01:38.728 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.42465.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T19:01:38.728 INFO:teuthology.orchestra.run.smithi157.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.42465.log.gz 2024-09-12T19:01:38.728 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.132358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141211.log 2024-09-12T19:01:38.729 INFO:teuthology.orchestra.run.smithi157.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.132358.log.gz 2024-09-12T19:01:38.729 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51465.log 2024-09-12T19:01:38.729 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.141211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31600.log 2024-09-12T19:01:38.729 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.51465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118787.log 2024-09-12T19:01:38.729 INFO:teuthology.orchestra.run.smithi157.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.51465.log.gz 2024-09-12T19:01:38.729 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31600.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31600.log.gz 2024-09-12T19:01:38.729 INFO:teuthology.orchestra.run.smithi157.stderr: 86.4% --verbose -- /var/log/ceph/ceph-client.admin.130588.log 2024-09-12T19:01:38.729 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141211.log.gz 2024-09-12T19:01:38.729 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.118787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98134.log 2024-09-12T19:01:38.729 INFO:teuthology.orchestra.run.smithi157.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.118787.log.gz 2024-09-12T19:01:38.732 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.130588.log: 81.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.130588.log.gz 2024-09-12T19:01:38.732 INFO:teuthology.orchestra.run.smithi157.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.170034.log 2024-09-12T19:01:38.732 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64255.log 2024-09-12T19:01:38.732 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.98134.log: /var/log/ceph/ceph-client.0.170034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143571.log 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.98134.log.gz 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.170034.log.gz 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.64255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31620.log 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.64255.log.gz 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.143571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107574.log 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.143571.log.gz 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31620.log.gz 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148292.log 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31818.log 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107574.log: /var/log/ceph/ceph-client.admin.148292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154264.log 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.107574.log.gz 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.148292.log.gz 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31818.log.gz 2024-09-12T19:01:38.733 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32010.log 2024-09-12T19:01:38.738 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114657.log 2024-09-12T19:01:38.738 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.154264.log: /var/log/ceph/ceph-client.admin.32010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32010.log.gz 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103444.log 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.154264.log.gz 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135899.log 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.114657.log: /var/log/ceph/ceph-client.admin.103444.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.114657.log.gz 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32158.log 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.103444.log.gz 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.135899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122328.log 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.135899.log.gz 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161725.log 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32158.log.gz 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.122328.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.122328.log.gz 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97544.log 2024-09-12T19:01:38.739 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142391.log 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.161725.log: /var/log/ceph/ceph-client.admin.97544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31813.log 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.161725.log.gz 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.142391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87514.log 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.142391.log.gz 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31395.log 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31813.log.gz 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.87514.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.97544.log.gz 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177501.log 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31395.log.gz 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87514.log.gz 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94004.log 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123508.log 2024-09-12T19:01:38.740 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.177501.log: /var/log/ceph/ceph-client.admin.94004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177501.log.gz 2024-09-12T19:01:38.741 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125278.log 2024-09-12T19:01:38.741 INFO:teuthology.orchestra.run.smithi157.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94004.log.gz 2024-09-12T19:01:38.744 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.123508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137079.log 2024-09-12T19:01:38.744 INFO:teuthology.orchestra.run.smithi157.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.123508.log.gz 2024-09-12T19:01:38.744 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81613.log 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.125278.log: /var/log/ceph/ceph-client.admin.137079.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.125278.log.gz 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165893.log 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31829.log 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.81613.log: /var/log/ceph/ceph-client.admin.165893.log: 82.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53849.log 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81613.log.gz 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr: 92.5%/var/log/ceph/ceph-client.admin.31829.log: -- replaced with /var/log/ceph/ceph-client.admin.165893.log.gz 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78073.log 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31829.log.gz 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.137079.log.gz 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126458.log 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.53849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92234.log 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.78073.log: /var/log/ceph/ceph-client.admin.126458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31606.log 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.78073.log.gz 2024-09-12T19:01:38.745 INFO:teuthology.orchestra.run.smithi157.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.126458.log.gz 2024-09-12T19:01:38.746 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.92234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113477.log 2024-09-12T19:01:38.746 INFO:teuthology.orchestra.run.smithi157.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.92234.log.gz 2024-09-12T19:01:38.746 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31606.log.gz 2024-09-12T19:01:38.746 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31409.log 2024-09-12T19:01:38.746 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64847.log 2024-09-12T19:01:38.746 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.113477.log: /var/log/ceph/ceph-client.admin.31409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142981.log 2024-09-12T19:01:38.746 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31409.log.gz 2024-09-12T19:01:38.746 INFO:teuthology.orchestra.run.smithi157.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113477.log.gz/var/log/ceph/ceph-client.admin.64847.log: 2024-09-12T19:01:38.746 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89284.log 2024-09-12T19:01:38.751 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.142981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84564.log 2024-09-12T19:01:38.751 INFO:teuthology.orchestra.run.smithi157.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64847.log.gz 2024-09-12T19:01:38.751 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62791.log 2024-09-12T19:01:38.751 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.89284.log: /var/log/ceph/ceph-client.admin.84564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32086.log 2024-09-12T19:01:38.751 INFO:teuthology.orchestra.run.smithi157.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.84564.log.gz 2024-09-12T19:01:38.751 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.62791.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.62791.log.gz 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.142981.log.gz 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180393.log 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32086.log.gz 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.89284.log.gz 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66671.log 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180393.log.gz 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.66671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180133.log 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.66671.log.gz 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155444.log 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180133.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56974.log 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.180133.log.gz 2024-09-12T19:01:38.752 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31619.log 2024-09-12T19:01:38.753 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.155444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155444.log.gz 2024-09-12T19:01:38.753 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.56974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54415.log 2024-09-12T19:01:38.753 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105214.log 2024-09-12T19:01:38.753 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31619.log.gz 2024-09-12T19:01:38.753 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.54415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167084.log 2024-09-12T19:01:38.753 INFO:teuthology.orchestra.run.smithi157.stderr: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.54415.log.gz 2024-09-12T19:01:38.753 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26752.log 2024-09-12T19:01:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105214.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105214.log.gz 2024-09-12T19:01:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174164.log 2024-09-12T19:01:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.167084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85154.log 2024-09-12T19:01:38.757 INFO:teuthology.orchestra.run.smithi157.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.0.167084.log.gz 2024-09-12T19:01:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.174164.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.174164.log.gz 2024-09-12T19:01:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180263.log 2024-09-12T19:01:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.85154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70401.log 2024-09-12T19:01:38.757 INFO:teuthology.orchestra.run.smithi157.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.85154.log.gz 2024-09-12T19:01:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180263.log: 0.0% 93.2% -- replaced with /var/log/ceph/ceph-client.admin.56974.log.gz -- replaced with /var/log/ceph/ceph-client.admin.180263.log.gz 2024-09-12T19:01:38.758 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-09-12T19:01:38.758 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46055.log 2024-09-12T19:01:38.758 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.70401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120558.log 2024-09-12T19:01:38.758 INFO:teuthology.orchestra.run.smithi157.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.70401.log.gz 2024-09-12T19:01:38.758 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.46055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155469.log 2024-09-12T19:01:38.758 INFO:teuthology.orchestra.run.smithi157.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.46055.log.gz/var/log/ceph/ceph-client.admin.120558.log: 2024-09-12T19:01:38.758 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122918.log 2024-09-12T19:01:38.758 INFO:teuthology.orchestra.run.smithi157.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.120558.log.gz 2024-09-12T19:01:38.758 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.155469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155469.log.gz 2024-09-12T19:01:38.758 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109344.log 2024-09-12T19:01:38.768 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26896.log 2024-09-12T19:01:38.769 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.26752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26920.log 2024-09-12T19:01:38.769 INFO:teuthology.orchestra.run.smithi190.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26752.log.gz 2024-09-12T19:01:38.769 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.26896.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T19:01:38.769 INFO:teuthology.orchestra.run.smithi190.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26896.log.gz 2024-09-12T19:01:38.769 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.26920.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T19:01:38.769 INFO:teuthology.orchestra.run.smithi190.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26920.log.gz 2024-09-12T19:01:38.769 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26824.log 2024-09-12T19:01:38.769 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T19:01:38.769 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.26824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26824.log.gz 2024-09-12T19:01:38.769 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26848.log 2024-09-12T19:01:38.769 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.26848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26848.log.gz 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26776.log 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.26776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26776.log.gz 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26800.log 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.26800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26800.log.gz 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26872.log 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T19:01:38.770 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.26872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26872.log.gz 2024-09-12T19:01:38.772 INFO:teuthology.orchestra.run.smithi190.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T19:01:38.775 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.122918.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T19:01:38.775 INFO:teuthology.orchestra.run.smithi157.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122918.log.gz/var/log/ceph/ceph-client.admin.109344.log: 2024-09-12T19:01:38.775 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180315.log 2024-09-12T19:01:38.775 INFO:teuthology.orchestra.run.smithi157.stderr: 82.0% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53849.log.gz 2024-09-12T19:01:38.775 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180079.log 2024-09-12T19:01:38.775 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109344.log.gz 2024-09-12T19:01:38.775 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.180315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180315.log.gz 2024-09-12T19:01:38.775 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76892.log 2024-09-12T19:01:38.776 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180185.log 2024-09-12T19:01:38.776 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180079.log.gz 2024-09-12T19:01:38.776 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.76892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60202.log 2024-09-12T19:01:38.776 INFO:teuthology.orchestra.run.smithi157.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.76892.log.gz 2024-09-12T19:01:38.776 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77483.log 2024-09-12T19:01:38.776 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180185.log: /var/log/ceph/ceph-client.admin.60202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95774.log 2024-09-12T19:01:38.776 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180185.log.gz 2024-09-12T19:01:38.776 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.77483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43695.log 2024-09-12T19:01:38.776 INFO:teuthology.orchestra.run.smithi157.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77483.log.gz 2024-09-12T19:01:38.776 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.95774.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.95774.log.gz 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86924.log 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr: 92.6%/var/log/ceph/ceph-client.admin.43695.log: -- replaced with /var/log/ceph/ceph-client.admin.60202.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111114.log 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.43695.log.gz 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.86924.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.86924.log.gz 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38875.log 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.111114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53874.log 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.111114.log.gz 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.38875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117607.log 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.38875.log.gz 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.53874.log: 52.7% -- replaced with /var/log/ceph/ceph-client.admin.53874.log.gz 2024-09-12T19:01:38.777 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52645.log 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.117607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49030.log 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.117607.log.gz 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.52645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63666.log 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.52645.log.gz 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127048.log 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.49030.log: /var/log/ceph/ceph-client.admin.63666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49030.log.gz 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.63666.log.gz 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149472.log 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.127048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79253.log 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.127048.log.gz 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.149472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79843.log 2024-09-12T19:01:38.778 INFO:teuthology.orchestra.run.smithi157.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.149472.log.gz 2024-09-12T19:01:38.779 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.79253.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.79253.log.gz 2024-09-12T19:01:38.779 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155494.log 2024-09-12T19:01:38.779 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.79843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179434.log 2024-09-12T19:01:38.779 INFO:teuthology.orchestra.run.smithi157.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.79843.log.gz 2024-09-12T19:01:38.779 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.155494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180445.log 2024-09-12T19:01:38.779 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51415.log 2024-09-12T19:01:38.779 INFO:teuthology.orchestra.run.smithi157.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155494.log.gz 2024-09-12T19:01:38.779 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180445.log: /var/log/ceph/ceph-client.0.179434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180445.log.gz 2024-09-12T19:01:38.784 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66619.log 2024-09-12T19:01:38.785 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.51415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31398.log 2024-09-12T19:01:38.785 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51415.log.gz 2024-09-12T19:01:38.785 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82203.log 2024-09-12T19:01:38.785 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.66619.log: /var/log/ceph/ceph-client.admin.31398.log: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.66619.log.gz 2024-09-12T19:01:38.785 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31398.log.gz 2024-09-12T19:01:38.785 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158164.log 2024-09-12T19:01:38.785 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47235.log 2024-09-12T19:01:38.785 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.82203.log: /var/log/ceph/ceph-client.admin.158164.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.82203.log.gz 2024-09-12T19:01:38.785 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21866.log 2024-09-12T19:01:38.785 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.47235.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.47235.log.gz 2024-09-12T19:01:38.785 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112884.log 2024-09-12T19:01:38.786 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.tmp-client.admin.21866.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21866.log.gz 2024-09-12T19:01:38.786 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31413.log 2024-09-12T19:01:38.786 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.112884.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.112884.log.gz 2024-09-12T19:01:38.786 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152444.log 2024-09-12T19:01:38.786 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31413.log.gz 2024-09-12T19:01:38.786 INFO:teuthology.orchestra.run.smithi157.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158164.log.gz 2024-09-12T19:01:38.786 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180627.log 2024-09-12T19:01:38.786 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35703.log 2024-09-12T19:01:38.786 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.152444.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.152444.log.gz 2024-09-12T19:01:38.786 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180627.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53617.log 2024-09-12T19:01:38.786 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.180627.log.gz 2024-09-12T19:01:38.787 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.35703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50825.log 2024-09-12T19:01:38.791 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.53617.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.35703.log.gz 2024-09-12T19:01:38.791 INFO:teuthology.orchestra.run.smithi157.stderr: 51.0% -- replaced with /var/log/ceph/ceph-client.admin.53617.log.gz 2024-09-12T19:01:38.791 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141801.log 2024-09-12T19:01:38.792 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32771.log 2024-09-12T19:01:38.792 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.50825.log: /var/log/ceph/ceph-client.admin.141801.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.50825.log.gz 2024-09-12T19:01:38.792 INFO:teuthology.orchestra.run.smithi157.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.141801.log.gz 2024-09-12T19:01:38.792 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145341.log 2024-09-12T19:01:38.792 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108754.log 2024-09-12T19:01:38.792 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.32771.log: /var/log/ceph/ceph-client.admin.145341.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.32771.log.gz 2024-09-12T19:01:38.792 INFO:teuthology.orchestra.run.smithi157.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.145341.log.gz 2024-09-12T19:01:38.792 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98724.log 2024-09-12T19:01:38.792 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31622.log 2024-09-12T19:01:38.793 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108754.log: /var/log/ceph/ceph-client.admin.98724.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108754.log.gz 2024-09-12T19:01:38.793 INFO:teuthology.orchestra.run.smithi157.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.98724.log.gz 2024-09-12T19:01:38.793 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58267.log 2024-09-12T19:01:38.793 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151854.log 2024-09-12T19:01:38.793 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31622.log.gz 2024-09-12T19:01:38.793 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.58267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35119.log 2024-09-12T19:01:38.793 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.151854.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.151854.log.gz 2024-09-12T19:01:38.793 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41875.log 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.35119.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35119.log.gz 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr: 90.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104624.log 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58267.log.gz 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.41875.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.41875.log.gz 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119377.log 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31404.log 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.104624.log: /var/log/ceph/ceph-client.admin.119377.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104624.log.gz 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr: 81.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68524.log 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.119377.log.gz 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31404.log.gz 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178240.log 2024-09-12T19:01:38.796 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147112.log 2024-09-12T19:01:38.798 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.68524.log: /var/log/ceph/ceph-client.admin.178240.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.68524.log.gz 2024-09-12T19:01:38.798 INFO:teuthology.orchestra.run.smithi157.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.178240.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T19:01:38.798 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-09-12T19:01:38.798 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.147112.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.147112.log.gz 2024-09-12T19:01:38.798 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144161.log 2024-09-12T19:01:38.798 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73352.log 2024-09-12T19:01:38.799 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.144161.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.144161.log.gz 2024-09-12T19:01:38.802 INFO:teuthology.orchestra.run.smithi157.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.0.179434.log.gz 2024-09-12T19:01:38.802 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135309.log 2024-09-12T19:01:38.803 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169444.log 2024-09-12T19:01:38.803 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.73352.log: /var/log/ceph/ceph-client.admin.135309.log: 82.1% 82.2% -- replaced with /var/log/ceph/ceph-client.admin.73352.log.gz 2024-09-12T19:01:38.803 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.135309.log.gz 2024-09-12T19:01:38.804 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115247.log 2024-09-12T19:01:38.804 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148882.log 2024-09-12T19:01:38.804 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.169444.log: /var/log/ceph/ceph-client.admin.115247.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.169444.log.gz 2024-09-12T19:01:38.805 INFO:teuthology.orchestra.run.smithi157.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.115247.log.gz 2024-09-12T19:01:38.805 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180159.log 2024-09-12T19:01:38.805 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69221.log 2024-09-12T19:01:38.806 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.148882.log: /var/log/ceph/ceph-client.admin.180159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180159.log.gz 82.5% -- replaced with /var/log/ceph/ceph-client.admin.148882.log.gz 2024-09-12T19:01:38.806 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-09-12T19:01:38.806 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62140.log 2024-09-12T19:01:38.807 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69811.log 2024-09-12T19:01:38.807 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.69221.log: /var/log/ceph/ceph-client.admin.62140.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.69221.log.gz 2024-09-12T19:01:38.808 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106394.log 2024-09-12T19:01:38.808 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.69811.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.69811.log.gz 2024-09-12T19:01:38.809 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96954.log 2024-09-12T19:01:38.809 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106394.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.106394.log.gz 2024-09-12T19:01:38.810 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118197.log 2024-09-12T19:01:38.810 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.96954.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.96954.log.gz 2024-09-12T19:01:38.811 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31604.log 2024-09-12T19:01:38.811 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.118197.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.62140.log.gz 2024-09-12T19:01:38.812 INFO:teuthology.orchestra.run.smithi157.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.118197.log.gz 2024-09-12T19:01:38.813 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117017.log 2024-09-12T19:01:38.819 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61492.log 2024-09-12T19:01:38.819 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31604.log: /var/log/ceph/ceph-client.admin.117017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31604.log.gz 2024-09-12T19:01:38.819 INFO:teuthology.orchestra.run.smithi157.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.117017.log.gz 2024-09-12T19:01:38.819 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119968.log 2024-09-12T19:01:38.819 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.61492.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61492.log.gz 2024-09-12T19:01:38.819 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T19:01:38.819 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55683.log 2024-09-12T19:01:38.819 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.119968.log: /var/log/ceph/ops-log-ceph-client.admin.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119968.log.gz 2024-09-12T19:01:38.819 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36871.log 2024-09-12T19:01:38.819 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.55683.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.55683.log.gz 2024-09-12T19:01:38.820 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T19:01:38.820 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.36871.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36871.log.gz 2024-09-12T19:01:38.820 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134719.log 2024-09-12T19:01:38.821 INFO:teuthology.orchestra.run.smithi190.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T19:01:38.821 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.1.log: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T19:01:38.840 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40055.log 2024-09-12T19:01:38.841 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.134719.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.134719.log.gz 2024-09-12T19:01:38.841 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158753.log 2024-09-12T19:01:38.842 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.40055.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.40055.log.gz 2024-09-12T19:01:38.842 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54449.log 2024-09-12T19:01:38.843 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.158753.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.158753.log.gz 2024-09-12T19:01:38.844 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125868.log 2024-09-12T19:01:38.844 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.54449.log: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.54449.log.gz 2024-09-12T19:01:38.845 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.157572.log 2024-09-12T19:01:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.125868.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.125868.log.gz 2024-09-12T19:01:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154854.log 2024-09-12T19:01:38.847 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.157572.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.157572.log.gz 2024-09-12T19:01:38.847 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31308.log 2024-09-12T19:01:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.154854.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.154854.log.gz 2024-09-12T19:01:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40645.log 2024-09-12T19:01:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31308.log.gz 2024-09-12T19:01:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180549.log 2024-09-12T19:01:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.40645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40645.log.gz 2024-09-12T19:01:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31214.log 2024-09-12T19:01:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180549.log.gz 2024-09-12T19:01:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99904.log 2024-09-12T19:01:38.853 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31214.log.gz 2024-09-12T19:01:38.853 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115837.log 2024-09-12T19:01:38.854 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.99904.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.99904.log.gz 2024-09-12T19:01:38.854 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65437.log 2024-09-12T19:01:38.855 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.115837.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.115837.log.gz 2024-09-12T19:01:38.855 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33945.log 2024-09-12T19:01:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.65437.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.65437.log.gz 2024-09-12T19:01:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75122.log 2024-09-12T19:01:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.33945.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.33945.log.gz 2024-09-12T19:01:38.858 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178189.log 2024-09-12T19:01:38.858 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.75122.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.75122.log.gz 2024-09-12T19:01:38.859 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93414.log 2024-09-12T19:01:38.860 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.178189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178189.log.gz 2024-09-12T19:01:38.860 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153034.log 2024-09-12T19:01:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.93414.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.93414.log.gz 2024-09-12T19:01:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100494.log 2024-09-12T19:01:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.153034.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.153034.log.gz 2024-09-12T19:01:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178215.log 2024-09-12T19:01:38.863 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100494.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.100494.log.gz 2024-09-12T19:01:38.864 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31360.log 2024-09-12T19:01:38.864 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.178215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178215.log.gz 2024-09-12T19:01:38.865 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31828.log 2024-09-12T19:01:38.865 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31360.log.gz 2024-09-12T19:01:38.866 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109934.log 2024-09-12T19:01:38.866 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31828.log.gz 2024-09-12T19:01:38.867 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111704.log 2024-09-12T19:01:38.867 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109934.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.109934.log.gz 2024-09-12T19:01:38.868 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44875.log 2024-09-12T19:01:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.111704.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.111704.log.gz 2024-09-12T19:01:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T19:01:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.44875.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.44875.log.gz 2024-09-12T19:01:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162448.log 2024-09-12T19:01:38.883 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164215.log 2024-09-12T19:01:38.885 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.162448.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.162448.log.gz 2024-09-12T19:01:38.888 INFO:teuthology.orchestra.run.smithi157.stderr: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T19:01:38.889 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163626.log 2024-09-12T19:01:38.890 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.164215.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.164215.log.gz 2024-09-12T19:01:38.890 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180497.log 2024-09-12T19:01:38.892 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.163626.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.163626.log.gz 2024-09-12T19:01:38.892 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180471.log 2024-09-12T19:01:38.893 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180497.log.gz 2024-09-12T19:01:38.893 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131178.log 2024-09-12T19:01:38.893 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180471.log.gz 2024-09-12T19:01:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31806.log 2024-09-12T19:01:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.131178.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.131178.log.gz 2024-09-12T19:01:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83974.log 2024-09-12T19:01:38.896 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31806.log.gz 2024-09-12T19:01:38.896 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178164.log 2024-09-12T19:01:38.897 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.83974.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.83974.log.gz 2024-09-12T19:01:38.897 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180211.log 2024-09-12T19:01:38.898 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.178164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178164.log.gz 2024-09-12T19:01:38.898 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44285.log 2024-09-12T19:01:38.899 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180211.log.gz 2024-09-12T19:01:38.900 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150062.log 2024-09-12T19:01:38.900 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.44285.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.44285.log.gz 2024-09-12T19:01:38.901 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31239.log 2024-09-12T19:01:38.902 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.150062.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.150062.log.gz 2024-09-12T19:01:38.902 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180107.log 2024-09-12T19:01:38.903 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31239.log.gz 2024-09-12T19:01:38.903 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60847.log 2024-09-12T19:01:38.904 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180107.log.gz 2024-09-12T19:01:38.904 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76302.log 2024-09-12T19:01:38.906 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.60847.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60847.log.gz 2024-09-12T19:01:38.907 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32181.log 2024-09-12T19:01:38.907 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.76302.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.76302.log.gz 2024-09-12T19:01:38.908 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72172.log 2024-09-12T19:01:38.909 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.32181.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.32181.log.gz 2024-09-12T19:01:38.910 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104034.log 2024-09-12T19:01:38.911 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.72172.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.72172.log.gz 2024-09-12T19:01:38.911 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150674.log 2024-09-12T19:01:38.913 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.104034.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.104034.log.gz 2024-09-12T19:01:38.913 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45465.log 2024-09-12T19:01:38.914 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.150674.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.150674.log.gz 2024-09-12T19:01:38.915 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66028.log 2024-09-12T19:01:38.915 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.45465.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.45465.log.gz 2024-09-12T19:01:38.916 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110524.log 2024-09-12T19:01:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.66028.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.66028.log.gz 2024-09-12T19:01:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136489.log 2024-09-12T19:01:38.918 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.110524.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110524.log.gz 2024-09-12T19:01:38.918 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T19:01:38.919 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.136489.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.136489.log.gz 2024-09-12T19:01:38.920 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78663.log 2024-09-12T19:01:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128818.log 2024-09-12T19:01:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.78663.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.78663.log.gz 2024-09-12T19:01:38.968 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133538.log 2024-09-12T19:01:38.968 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.128818.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.128818.log.gz 2024-09-12T19:01:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128228.log 2024-09-12T19:01:38.976 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.133538.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.133538.log.gz 2024-09-12T19:01:38.984 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147702.log 2024-09-12T19:01:38.985 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.128228.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.128228.log.gz 2024-09-12T19:01:38.992 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71581.log 2024-09-12T19:01:38.992 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.147702.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.147702.log.gz 2024-09-12T19:01:39.000 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53543.log 2024-09-12T19:01:39.000 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.71581.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71581.log.gz 2024-09-12T19:01:39.008 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153624.log 2024-09-12T19:01:39.008 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.53543.log: 50.9% -- replaced with /var/log/ceph/ceph-client.admin.53543.log.gz 2024-09-12T19:01:39.015 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32062.log 2024-09-12T19:01:39.016 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.153624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153624.log.gz 2024-09-12T19:01:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34529.log 2024-09-12T19:01:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32062.log.gz 2024-09-12T19:01:39.032 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173574.log 2024-09-12T19:01:39.032 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.34529.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.34529.log.gz 2024-09-12T19:01:39.039 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102854.log 2024-09-12T19:01:39.040 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.173574.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.173574.log.gz 2024-09-12T19:01:39.047 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180367.log 2024-09-12T19:01:39.048 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102854.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.102854.log.gz 2024-09-12T19:01:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159958.log 2024-09-12T19:01:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180367.log.gz 2024-09-12T19:01:39.079 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160547.log 2024-09-12T19:01:39.081 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.159958.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.159958.log.gz 2024-09-12T19:01:39.091 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32110.log 2024-09-12T19:01:39.092 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.160547.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.160547.log.gz 2024-09-12T19:01:39.103 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48415.log 2024-09-12T19:01:39.104 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32110.log.gz 2024-09-12T19:01:39.115 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90464.log 2024-09-12T19:01:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.48415.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.48415.log.gz 2024-09-12T19:01:39.135 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180601.log 2024-09-12T19:01:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.90464.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.90464.log.gz 2024-09-12T19:01:39.156 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96364.log 2024-09-12T19:01:39.156 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180601.log.gz 2024-09-12T19:01:39.176 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91054.log 2024-09-12T19:01:39.176 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.96364.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.96364.log.gz 2024-09-12T19:01:39.190 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43080.log 2024-09-12T19:01:39.191 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.91054.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91054.log.gz 2024-09-12T19:01:39.203 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49005.log 2024-09-12T19:01:39.204 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.43080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43080.log.gz 2024-09-12T19:01:39.215 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52055.log 2024-09-12T19:01:39.216 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.49005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49005.log.gz 2024-09-12T19:01:39.235 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31141.log 2024-09-12T19:01:39.236 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.52055.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.52055.log.gz 2024-09-12T19:01:39.247 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T19:01:39.248 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31141.log.gz 2024-09-12T19:01:39.259 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31334.log 2024-09-12T19:01:39.272 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180575.log 2024-09-12T19:01:39.272 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31334.log.gz 2024-09-12T19:01:39.279 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138259.log 2024-09-12T19:01:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180575.log.gz 2024-09-12T19:01:39.295 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156674.log 2024-09-12T19:01:39.296 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.138259.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.138259.log.gz 2024-09-12T19:01:39.304 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153649.log 2024-09-12T19:01:39.304 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.156674.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.156674.log.gz 2024-09-12T19:01:39.311 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31594.log 2024-09-12T19:01:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.153649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153649.log.gz 2024-09-12T19:01:39.336 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176273.log 2024-09-12T19:01:39.336 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31594.log.gz 2024-09-12T19:01:39.347 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31406.log 2024-09-12T19:01:39.348 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.176273.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.176273.log.gz 2024-09-12T19:01:39.363 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180237.log 2024-09-12T19:01:39.364 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31406.log.gz 2024-09-12T19:01:39.379 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T19:01:39.380 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180237.log.gz 2024-09-12T19:01:39.391 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180341.log 2024-09-12T19:01:39.395 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T19:01:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92824.log 2024-09-12T19:01:39.412 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180341.log.gz 2024-09-12T19:01:39.429 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67934.log 2024-09-12T19:01:39.429 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.92824.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.92824.log.gz 2024-09-12T19:01:39.452 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88104.log 2024-09-12T19:01:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.67934.log: 92.1% -- replaced with /var/log/ceph/ceph-client.0.67934.log.gz 2024-09-12T19:01:39.463 INFO:teuthology.orchestra.run.smithi157.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T19:01:39.467 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86334.log 2024-09-12T19:01:39.468 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.88104.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.88104.log.gz 2024-09-12T19:01:39.468 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140621.log 2024-09-12T19:01:39.469 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.86334.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.86334.log.gz 2024-09-12T19:01:39.484 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144751.log 2024-09-12T19:01:39.484 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.140621.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.140621.log.gz 2024-09-12T19:01:39.500 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47825.log 2024-09-12T19:01:39.501 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.144751.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.144751.log.gz 2024-09-12T19:01:39.508 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70991.log 2024-09-12T19:01:39.508 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.47825.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.47825.log.gz 2024-09-12T19:01:39.516 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170624.log 2024-09-12T19:01:39.516 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.70991.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.70991.log.gz 2024-09-12T19:01:39.517 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T19:01:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53897.log 2024-09-12T19:01:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.170624.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.170624.log.gz 2024-09-12T19:01:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180653.log 2024-09-12T19:01:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.53897.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.53897.log.gz 2024-09-12T19:01:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99314.log 2024-09-12T19:01:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180653.log.gz 2024-09-12T19:01:39.520 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53329.log 2024-09-12T19:01:39.521 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.99314.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99314.log.gz 2024-09-12T19:01:39.521 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127638.log 2024-09-12T19:01:39.522 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.53329.log: 59.6% -- replaced with /var/log/ceph/ceph-client.admin.53329.log.gz 2024-09-12T19:01:39.522 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T19:01:39.523 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.127638.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.127638.log.gz 2024-09-12T19:01:39.523 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32036.log 2024-09-12T19:01:39.524 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 62.2% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T19:01:39.524 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67261.log 2024-09-12T19:01:39.524 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32036.log.gz 2024-09-12T19:01:39.525 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138851.log 2024-09-12T19:01:39.526 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.67261.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.67261.log.gz 2024-09-12T19:01:39.526 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73942.log 2024-09-12T19:01:39.526 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.138851.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.138851.log.gz 2024-09-12T19:01:39.527 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178837.log 2024-09-12T19:01:39.527 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.73942.log: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.73942.log.gz 2024-09-12T19:01:39.528 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156084.log 2024-09-12T19:01:39.528 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.178837.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.178837.log.gz 2024-09-12T19:01:39.529 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31621.log 2024-09-12T19:01:39.530 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.156084.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.156084.log.gz 2024-09-12T19:01:39.530 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151264.log 2024-09-12T19:01:39.530 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31621.log.gz 2024-09-12T19:01:39.531 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134128.log 2024-09-12T19:01:39.531 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.151264.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.151264.log.gz 2024-09-12T19:01:39.531 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172394.log 2024-09-12T19:01:39.532 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.134128.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.134128.log.gz 2024-09-12T19:01:39.532 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32134.log 2024-09-12T19:01:39.533 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.172394.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.172394.log.gz 2024-09-12T19:01:39.534 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139441.log 2024-09-12T19:01:39.534 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32134.log.gz 2024-09-12T19:01:39.535 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165304.log 2024-09-12T19:01:39.535 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.139441.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.139441.log.gz 2024-09-12T19:01:39.536 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121148.log 2024-09-12T19:01:39.538 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.165304.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.165304.log.gz 2024-09-12T19:01:39.538 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39465.log 2024-09-12T19:01:39.539 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.121148.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.121148.log.gz 2024-09-12T19:01:39.539 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129998.log 2024-09-12T19:01:39.539 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.39465.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.39465.log.gz 2024-09-12T19:01:39.540 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38285.log 2024-09-12T19:01:39.541 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.129998.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.129998.log.gz 2024-09-12T19:01:39.541 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132948.log 2024-09-12T19:01:39.542 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.38285.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.38285.log.gz 2024-09-12T19:01:39.542 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51440.log 2024-09-12T19:01:39.544 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.132948.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.132948.log.gz 2024-09-12T19:01:39.545 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177526.log 2024-09-12T19:01:39.545 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.51440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51440.log.gz 2024-09-12T19:01:39.545 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31817.log 2024-09-12T19:01:39.546 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.177526.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.177526.log.gz 2024-09-12T19:01:39.546 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88694.log 2024-09-12T19:01:39.547 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31817.log.gz 2024-09-12T19:01:39.547 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72762.log 2024-09-12T19:01:39.548 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.88694.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.88694.log.gz 2024-09-12T19:01:39.548 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180289.log 2024-09-12T19:01:39.549 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.72762.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.72762.log.gz 2024-09-12T19:01:39.549 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177476.log 2024-09-12T19:01:39.550 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180289.log.gz 2024-09-12T19:01:39.550 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101084.log 2024-09-12T19:01:39.550 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.177476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177476.log.gz 2024-09-12T19:01:39.551 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116427.log 2024-09-12T19:01:39.551 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101084.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.101084.log.gz 2024-09-12T19:01:39.552 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82794.log 2024-09-12T19:01:39.552 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.116427.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116427.log.gz 2024-09-12T19:01:39.553 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26805.log 2024-09-12T19:01:39.554 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.82794.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.82794.log.gz 2024-09-12T19:01:39.554 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168264.log 2024-09-12T19:01:39.554 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.26805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26805.log.gz 2024-09-12T19:01:39.555 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108164.log 2024-09-12T19:01:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.168264.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.168264.log.gz 2024-09-12T19:01:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168854.log 2024-09-12T19:01:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108164.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.108164.log.gz 2024-09-12T19:01:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40670.log 2024-09-12T19:01:39.558 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.168854.log: 81.2% -- replaced with /var/log/ceph/ceph-client.0.168854.log.gz 2024-09-12T19:01:39.558 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46645.log 2024-09-12T19:01:39.558 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.40670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40670.log.gz 2024-09-12T19:01:39.559 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171804.log 2024-09-12T19:01:39.560 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.46645.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.46645.log.gz 2024-09-12T19:01:39.560 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174754.log 2024-09-12T19:01:39.560 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.171804.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.171804.log.gz 2024-09-12T19:01:39.561 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58912.log 2024-09-12T19:01:39.561 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.174754.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.174754.log.gz 2024-09-12T19:01:39.562 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105804.log 2024-09-12T19:01:39.564 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.58912.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58912.log.gz 2024-09-12T19:01:39.565 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80433.log 2024-09-12T19:01:39.565 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105804.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.105804.log.gz 2024-09-12T19:01:39.566 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121738.log 2024-09-12T19:01:39.566 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.80433.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.80433.log.gz 2024-09-12T19:01:39.567 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49055.log 2024-09-12T19:01:39.567 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.121738.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.121738.log.gz 2024-09-12T19:01:39.568 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176863.log 2024-09-12T19:01:39.568 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.49055.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.49055.log.gz 2024-09-12T19:01:39.568 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124688.log 2024-09-12T19:01:39.569 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.176863.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.176863.log.gz 2024-09-12T19:01:39.570 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172984.log 2024-09-12T19:01:39.571 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.124688.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.124688.log.gz 2024-09-12T19:01:39.572 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55038.log 2024-09-12T19:01:39.572 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.172984.log: 84.7% -- replaced with /var/log/ceph/ceph-client.0.172984.log.gz 2024-09-12T19:01:39.573 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31411.log 2024-09-12T19:01:39.584 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.55038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53826.log 2024-09-12T19:01:39.584 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31411.log.gz 2024-09-12T19:01:39.589 INFO:teuthology.orchestra.run.smithi157.stderr: 93.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83384.log 2024-09-12T19:01:39.589 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.53826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53826.log.gz 2024-09-12T19:01:39.590 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55038.log.gz 2024-09-12T19:01:39.590 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67899.log 2024-09-12T19:01:39.591 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.83384.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.83384.log.gz 2024-09-12T19:01:39.591 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53788.log 2024-09-12T19:01:39.591 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.67899.log: 51.8% -- replaced with /var/log/ceph/ceph-client.admin.67899.log.gz 2024-09-12T19:01:39.592 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57622.log 2024-09-12T19:01:39.592 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.53788.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53788.log.gz 2024-09-12T19:01:39.593 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89874.log 2024-09-12T19:01:39.598 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.57622.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.57622.log.gz 2024-09-12T19:01:39.599 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74532.log 2024-09-12T19:01:39.599 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.89874.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.89874.log.gz 2024-09-12T19:01:39.600 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124098.log 2024-09-12T19:01:39.601 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.74532.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74532.log.gz 2024-09-12T19:01:39.601 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43055.log 2024-09-12T19:01:39.601 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.124098.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.124098.log.gz 2024-09-12T19:01:39.602 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101674.log 2024-09-12T19:01:39.602 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.43055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43055.log.gz 2024-09-12T19:01:39.603 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59557.log 2024-09-12T19:01:39.603 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101674.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.101674.log.gz 2024-09-12T19:01:39.604 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180053.log 2024-09-12T19:01:39.620 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.59557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178116.log 2024-09-12T19:01:39.620 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180053.log.gz 2024-09-12T19:01:39.628 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94594.log 2024-09-12T19:01:39.628 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.178116.log: 25.5% -- replaced with /var/log/ceph/ceph-client.admin.178116.log.gz 2024-09-12T19:01:39.629 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31262.log 2024-09-12T19:01:39.635 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.94594.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.94594.log.gz 2024-09-12T19:01:39.635 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112294.log 2024-09-12T19:01:39.635 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31262.log.gz 2024-09-12T19:01:39.635 INFO:teuthology.orchestra.run.smithi157.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.59557.log.gz 2024-09-12T19:01:39.635 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49645.log 2024-09-12T19:01:39.635 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.112294.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.112294.log.gz 2024-09-12T19:01:39.635 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56328.log 2024-09-12T19:01:39.635 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.49645.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.49645.log.gz 2024-09-12T19:01:39.636 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40695.log 2024-09-12T19:01:39.641 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.56328.log: 93.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.166494.log 2024-09-12T19:01:39.641 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.40695.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.40695.log.gz 2024-09-12T19:01:39.641 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56328.log.gz 2024-09-12T19:01:39.642 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140031.log 2024-09-12T19:01:39.642 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.166494.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.166494.log.gz 2024-09-12T19:01:39.643 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102264.log 2024-09-12T19:01:39.643 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.140031.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.140031.log.gz 2024-09-12T19:01:39.644 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163037.log 2024-09-12T19:01:39.644 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102264.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102264.log.gz 2024-09-12T19:01:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171214.log 2024-09-12T19:01:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.163037.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.163037.log.gz 2024-09-12T19:01:39.646 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146522.log 2024-09-12T19:01:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.171214.log: 81.2% -- replaced with /var/log/ceph/ceph-client.0.171214.log.gz 2024-09-12T19:01:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177453.log 2024-09-12T19:01:39.648 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.146522.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.146522.log.gz 2024-09-12T19:01:39.648 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161136.log 2024-09-12T19:01:39.649 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.177453.log: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.177453.log.gz 2024-09-12T19:01:39.650 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.161136.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.161136.log.gz 2024-09-12T19:01:39.655 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178139.log 2024-09-12T19:01:39.655 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31830.log 2024-09-12T19:01:39.656 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.178139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178139.log.gz 2024-09-12T19:01:39.656 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33355.log 2024-09-12T19:01:39.657 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31830.log.gz 2024-09-12T19:01:39.657 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175344.log 2024-09-12T19:01:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.33355.log: 81.0% -- replaced with /var/log/ceph/ceph-client.0.33355.log.gz 2024-09-12T19:01:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180419.log 2024-09-12T19:01:39.659 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.175344.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.175344.log.gz 2024-09-12T19:01:39.659 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91644.log 2024-09-12T19:01:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180419.log.gz 2024-09-12T19:01:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31414.log 2024-09-12T19:01:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.91644.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.91644.log.gz 2024-09-12T19:01:39.662 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106984.log 2024-09-12T19:01:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31414.log.gz 2024-09-12T19:01:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81023.log 2024-09-12T19:01:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106984.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.106984.log.gz 2024-09-12T19:01:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180677.log 2024-09-12T19:01:39.666 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.81023.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.81023.log.gz 2024-09-12T19:01:39.666 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167674.log 2024-09-12T19:01:39.667 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.180677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180677.log.gz 2024-09-12T19:01:39.667 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145931.log 2024-09-12T19:01:39.668 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.167674.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.167674.log.gz 2024-09-12T19:01:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.145931.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.145931.log.gz 2024-09-12T19:01:40.086 INFO:teuthology.orchestra.run.smithi190.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T19:01:40.352 INFO:teuthology.orchestra.run.smithi157.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T19:01:40.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-12T19:01:40.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-12T19:01:41.666 INFO:teuthology.orchestra.run.smithi157.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T19:01:42.975 INFO:teuthology.orchestra.run.smithi157.stderr: 92.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T19:01:45.271 INFO:teuthology.orchestra.run.smithi157.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T19:01:46.055 INFO:teuthology.orchestra.run.smithi190.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T19:01:47.201 INFO:teuthology.orchestra.run.smithi190.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T19:01:47.436 INFO:teuthology.orchestra.run.smithi190.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T19:01:47.930 INFO:teuthology.orchestra.run.smithi157.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T19:01:50.084 INFO:teuthology.orchestra.run.smithi157.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T19:01:52.123 INFO:teuthology.orchestra.run.smithi190.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T19:01:52.124 INFO:teuthology.orchestra.run.smithi190.stderr: 2024-09-12T19:01:52.124 INFO:teuthology.orchestra.run.smithi190.stderr:real 0m13.391s 2024-09-12T19:01:52.124 INFO:teuthology.orchestra.run.smithi190.stderr:user 0m37.882s 2024-09-12T19:01:52.124 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m1.339s 2024-09-12T19:01:55.638 INFO:teuthology.orchestra.run.smithi157.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T19:01:55.639 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-09-12T19:01:55.639 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m16.944s 2024-09-12T19:01:55.640 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m51.830s 2024-09-12T19:01:55.640 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m1.863s 2024-09-12T19:01:55.640 INFO:tasks.ceph:Archiving logs... 2024-09-12T19:01:55.640 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746/remote/smithi157/log 2024-09-12T19:01:55.641 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T19:02:02.763 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746/remote/smithi190/log 2024-09-12T19:02:02.764 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T19:02:07.580 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T19:02:07.591 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T19:02:07.592 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T19:02:07.594 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T19:02:07.670 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T19:02:07.687 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T19:02:07.687 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T19:02:07.690 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T19:02:07.704 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T19:02:07.704 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-09-12T19:02:07.704 INFO:teuthology.orchestra.run.smithi157.stdout:*hv01.front.sepi 67.205.162.81 3 u 100 128 377 0.180 -2.351 0.232 2024-09-12T19:02:07.704 INFO:teuthology.orchestra.run.smithi157.stdout:+hv02.front.sepi 63.231.80.2 3 u 55 128 377 0.165 -3.499 0.200 2024-09-12T19:02:07.704 INFO:teuthology.orchestra.run.smithi157.stdout:+hv03.front.sepi 74.6.168.72 3 u 97 128 377 0.168 -0.825 0.196 2024-09-12T19:02:07.704 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T19:02:07.707 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T19:02:07.707 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2024-09-12T19:02:07.707 INFO:teuthology.orchestra.run.smithi190.stdout:*hv01.front.sepi 67.205.162.81 3 u 12 128 377 0.167 -0.463 0.101 2024-09-12T19:02:07.707 INFO:teuthology.orchestra.run.smithi190.stdout:+hv02.front.sepi 63.231.80.2 3 u 115 128 377 0.126 -1.275 0.293 2024-09-12T19:02:07.707 INFO:teuthology.orchestra.run.smithi190.stdout:+hv03.front.sepi 74.6.168.72 3 u 118 128 377 0.128 +0.998 0.050 2024-09-12T19:02:07.707 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T19:02:07.708 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T19:02:07.719 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T19:02:07.720 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T19:02:07.729 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T19:02:07.744 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T19:02:07.757 INFO:teuthology.task.internal:Duration was 5567.347495 seconds 2024-09-12T19:02:07.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T19:02:07.768 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T19:02:07.769 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T19:02:07.771 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T19:02:07.808 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T19:02:07.808 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-09-12T19:02:07.809 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T19:02:07.856 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2024-09-12T19:02:07.857 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T19:02:07.867 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T19:02:07.868 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T19:02:07.901 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T19:02:07.935 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T19:02:07.935 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T19:02:07.969 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T19:02:08.034 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T19:02:08.051 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T19:02:08.052 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T19:02:08.063 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T19:02:08.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T19:02:08.087 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:02:08.109 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:02:08.117 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-09-12T19:02:08.126 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2024-09-12T19:02:08.145 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:02:08.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:02:08.179 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:02:08.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:02:08.193 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T19:02:08.205 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T19:02:08.206 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746/remote/smithi157 2024-09-12T19:02:08.206 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T19:02:08.249 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902746/remote/smithi190 2024-09-12T19:02:08.249 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T19:02:08.270 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T19:02:08.270 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T19:02:08.285 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T19:02:08.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T19:02:08.331 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T19:02:08.331 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T19:02:08.345 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T19:02:08.345 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T19:02:08.347 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T19:02:08.351 INFO:teuthology.orchestra.run.smithi157.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 19:02 /home/ubuntu/cephtest 2024-09-12T19:02:08.366 INFO:teuthology.orchestra.run.smithi190.stdout: 658463 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 19:02 /home/ubuntu/cephtest 2024-09-12T19:02:08.368 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T19:02:08.382 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T19:02:08.413 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 5567.347494840622 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T19:02:08.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T19:02:08.515 INFO:teuthology.run:pass